From owner-freebsd-arch@FreeBSD.ORG Sun Apr 18 02:37:30 2010 Return-Path: Delivered-To: freebsd-arch@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 172D2106566C for ; Sun, 18 Apr 2010 02:37:29 +0000 (UTC) (envelope-from jroberson@jroberson.net) Received: from mail-gy0-f182.google.com (mail-gy0-f182.google.com [209.85.160.182]) by mx1.freebsd.org (Postfix) with ESMTP id 8FA558FC08 for ; Sun, 18 Apr 2010 02:37:29 +0000 (UTC) Received: by gyh20 with SMTP id 20so2071855gyh.13 for ; Sat, 17 Apr 2010 19:37:28 -0700 (PDT) Received: by 10.101.5.29 with SMTP id h29mr9519022ani.40.1271556537016; Sat, 17 Apr 2010 19:08:57 -0700 (PDT) Received: from [10.0.1.198] (udp022762uds.hawaiiantel.net [72.234.79.107]) by mx.google.com with ESMTPS id y6sm29683557ana.5.2010.04.17.19.08.54 (version=SSLv3 cipher=RC4-MD5); Sat, 17 Apr 2010 19:08:55 -0700 (PDT) Date: Sat, 17 Apr 2010 16:08:57 -1000 (HST) From: Jeff Roberson X-X-Sender: jroberson@desktop To: Scott Long In-Reply-To: Message-ID: References: <29917.1271406183@critter.freebsd.dk> User-Agent: Alpine 2.00 (BSF 1167 2008-08-23) MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Cc: Attilio Rao , Poul-Henning Kamp , Giovanni Trematerra , freebsd-arch@freebsd.org Subject: Re: [PATCH] Syncer rewriting X-BeenThere: freebsd-arch@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussion related to FreeBSD architecture List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 18 Apr 2010 02:37:30 -0000 On Sat, 17 Apr 2010, Scott Long wrote: > On Apr 16, 2010, at 2:23 AM, Poul-Henning Kamp wrote: >> >> >>> - The standard syncer may be further improved getting rid of the >>> bufobj. It should actually handle a list of vnodes rather than a list >>> of bufobj. However similar optimizations may be done after the patch >>> is ready to enter the tree. >> >> That would be the wrong direction: we need the bufobj because for instance >> a RAID5 geom module does not have a vnode for the parity data. >> >> If you force the syncer to only work on vnodes, then we need a parallel >> mechanism for non-filesystem disk users. > > It's been 5-6 (7?) years since you invented the bufobj, but I still haven't seen > anything in GEOM use it as you suggest. You used to have a saying about > premature optimization... I'd like to see Attilio's work move forward despite this. > I tend to agree. I also think the syncer is inherently a vnode centric operation. RAID5 should have its own rules and optimizations for managing its dirty data. It would have to anyway to keep the disk state consistent. Wouldn't it be a write through cache anyway and only keep clean data in core? Thanks, Jeff > Scott > > _______________________________________________ > freebsd-arch@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-arch > To unsubscribe, send any mail to "freebsd-arch-unsubscribe@freebsd.org" > From owner-freebsd-arch@FreeBSD.ORG Sun Apr 18 02:46:59 2010 Return-Path: Delivered-To: freebsd-arch@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 5FAAA1065674; Sun, 18 Apr 2010 02:46:59 +0000 (UTC) (envelope-from scottl@samsco.org) Received: from pooker.samsco.org (pooker.samsco.org [168.103.85.57]) by mx1.freebsd.org (Postfix) with ESMTP id F02018FC1E; Sun, 18 Apr 2010 02:46:58 +0000 (UTC) Received: from [127.0.0.1] (pooker.samsco.org [168.103.85.57]) (authenticated bits=0) by pooker.samsco.org (8.14.3/8.14.3) with ESMTP id o3I2ktur041963; Sat, 17 Apr 2010 20:46:55 -0600 (MDT) (envelope-from scottl@samsco.org) Mime-Version: 1.0 (Apple Message framework v1078) Content-Type: text/plain; charset=us-ascii From: Scott Long In-Reply-To: Date: Sat, 17 Apr 2010 20:46:55 -0600 Content-Transfer-Encoding: quoted-printable Message-Id: <91973FF7-4067-43ED-A20C-14B7B7D78449@samsco.org> References: <29917.1271406183@critter.freebsd.dk> To: Jeff Roberson X-Mailer: Apple Mail (2.1078) X-Spam-Status: No, score=-1.0 required=3.8 tests=ALL_TRUSTED, T_RP_MATCHES_RCVD autolearn=unavailable version=3.3.0 X-Spam-Checker-Version: SpamAssassin 3.3.0 (2010-01-18) on pooker.samsco.org Cc: Attilio Rao , Poul-Henning Kamp , Giovanni Trematerra , freebsd-arch@freebsd.org Subject: Re: [PATCH] Syncer rewriting X-BeenThere: freebsd-arch@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussion related to FreeBSD architecture List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 18 Apr 2010 02:46:59 -0000 On Apr 17, 2010, at 8:08 PM, Jeff Roberson wrote: > On Sat, 17 Apr 2010, Scott Long wrote: >=20 >> On Apr 16, 2010, at 2:23 AM, Poul-Henning Kamp wrote: >>>=20 >>>=20 >>>> - The standard syncer may be further improved getting rid of the >>>> bufobj. It should actually handle a list of vnodes rather than a = list >>>> of bufobj. However similar optimizations may be done after the = patch >>>> is ready to enter the tree. >>>=20 >>> That would be the wrong direction: we need the bufobj because for = instance >>> a RAID5 geom module does not have a vnode for the parity data. >>>=20 >>> If you force the syncer to only work on vnodes, then we need a = parallel >>> mechanism for non-filesystem disk users. >>=20 >> It's been 5-6 (7?) years since you invented the bufobj, but I still = haven't seen >> anything in GEOM use it as you suggest. You used to have a saying = about >> premature optimization... I'd like to see Attilio's work move = forward despite this. >>=20 >=20 > I tend to agree. I also think the syncer is inherently a vnode = centric operation. RAID5 should have its own rules and optimizations = for managing its dirty data. It would have to anyway to keep the disk = state consistent. Wouldn't it be a write through cache anyway and only = keep clean data in core? No, the fundamental idea behind RAID-5 caching is that is should try to = hold onto write buffers in an effort to collect enough to do a full = stripe write, instead of having to do a read-modify-write. So yes, = dirty buffers must be cached. However, I agree that the caching and = syncing policy here is likely to be completely different from what the = syncer might think is appropriate. Scott From owner-freebsd-arch@FreeBSD.ORG Sun Apr 18 07:10:13 2010 Return-Path: Delivered-To: freebsd-arch@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id F12CB106564A; Sun, 18 Apr 2010 07:10:13 +0000 (UTC) (envelope-from phk@critter.freebsd.dk) Received: from phk.freebsd.dk (phk.freebsd.dk [130.225.244.222]) by mx1.freebsd.org (Postfix) with ESMTP id B22BF8FC08; Sun, 18 Apr 2010 07:10:13 +0000 (UTC) Received: from critter.freebsd.dk (critter-phk.freebsd.dk [192.168.48.2]) by phk.freebsd.dk (Postfix) with ESMTP id 3222390193; Sun, 18 Apr 2010 07:10:12 +0000 (UTC) Received: from critter.freebsd.dk (localhost [127.0.0.1]) by critter.freebsd.dk (8.14.4/8.14.4) with ESMTP id o3I7AADH009890; Sun, 18 Apr 2010 07:10:11 GMT (envelope-from phk@critter.freebsd.dk) To: Scott Long From: "Poul-Henning Kamp" In-Reply-To: Your message of "Sat, 17 Apr 2010 16:49:36 CST." Date: Sun, 18 Apr 2010 07:10:10 +0000 Message-ID: <9889.1271574610@critter.freebsd.dk> Sender: phk@critter.freebsd.dk Cc: Attilio Rao , Giovanni Trematerra , freebsd-arch@freebsd.org Subject: Re: [PATCH] Syncer rewriting X-BeenThere: freebsd-arch@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussion related to FreeBSD architecture List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 18 Apr 2010 07:10:14 -0000 In message , Scott Long writes : >On Apr 16, 2010, at 2:23 AM, Poul-Henning Kamp wrote: >It's been 5-6 (7?) years since you invented the bufobj, but I still = >haven't seen >anything in GEOM use it as you suggest. Pretty much because we need to give the syncer the lobotomy Attilio is current in the middle of. -- Poul-Henning Kamp | UNIX since Zilog Zeus 3.20 phk@FreeBSD.ORG | TCP/IP since RFC 956 FreeBSD committer | BSD since 4.3-tahoe Never attribute to malice what can adequately be explained by incompetence. From owner-freebsd-arch@FreeBSD.ORG Sun Apr 18 14:39:49 2010 Return-Path: Delivered-To: freebsd-arch@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id AB276106566B for ; Sun, 18 Apr 2010 14:39:49 +0000 (UTC) (envelope-from asmrookie@gmail.com) Received: from fg-out-1718.google.com (fg-out-1718.google.com [72.14.220.154]) by mx1.freebsd.org (Postfix) with ESMTP id 2FC5A8FC28 for ; Sun, 18 Apr 2010 14:39:48 +0000 (UTC) Received: by fg-out-1718.google.com with SMTP id 22so731957fge.13 for ; Sun, 18 Apr 2010 07:39:48 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:sender:received:in-reply-to :references:date:x-google-sender-auth:received:message-id:subject :from:to:cc:content-type; bh=mz6oxz3PFTIjkrPqsstNQhePXY0WVHtGEH71XqQ2c0c=; b=GxPZQ0pNmdBzWtzsK8RgayVPJNHsfvhWA7dtompVjW4wMw4++eGlkuNswQ0k8DhxC5 POOFn3O8LMUEaOw4kHa59FWiF53rhNW9XsjmorJhdfdKdIoiNqZOIEeDdEqS73dxfVzp UW+RlFfgQe3FadVcic7w591WSuiuwCKbkKYhA= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:cc:content-type; b=kUh7E9Z3TFvw+/CqiAlCDreOSmg3Doaulz0JN27+8SfehOmldyHETLYaKtnBdVjXGf tlgZ7fsGa/6OxvK7H9eaH9ZQmxytu8CckhBtHnFcmwQxiIghka7GroktbnZS3YOiclsy fKRS+wVYxolToUWoVs852KFiXsoFbYTYRzte0= MIME-Version: 1.0 Sender: asmrookie@gmail.com Received: by 10.239.164.140 with HTTP; Sun, 18 Apr 2010 07:39:47 -0700 (PDT) In-Reply-To: <9889.1271574610@critter.freebsd.dk> References: <9889.1271574610@critter.freebsd.dk> Date: Sun, 18 Apr 2010 16:39:47 +0200 X-Google-Sender-Auth: 2c0dc9194110e1dd Received: by 10.239.193.4 with SMTP id g4mr336045hbi.192.1271601587808; Sun, 18 Apr 2010 07:39:47 -0700 (PDT) Message-ID: From: Attilio Rao To: Poul-Henning Kamp Content-Type: text/plain; charset=UTF-8 Cc: Scott Long , Giovanni Trematerra , freebsd-arch@freebsd.org Subject: Re: [PATCH] Syncer rewriting X-BeenThere: freebsd-arch@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussion related to FreeBSD architecture List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 18 Apr 2010 14:39:49 -0000 2010/4/18 Poul-Henning Kamp : > In message , Scott Long writes > : >>On Apr 16, 2010, at 2:23 AM, Poul-Henning Kamp wrote: > >>It's been 5-6 (7?) years since you invented the bufobj, but I still = >>haven't seen >>anything in GEOM use it as you suggest. > > Pretty much because we need to give the syncer the lobotomy Attilio > is current in the middle of. Being more precise, what kind of support do you need for completing this? Do you think do you need all the standard syncer logic we have now to be replicated for bufobj? I have the impression that this is very much vnode specific (for example, also the rush/speedup mechanism has meaning mostly in terms of pages held by the vnode). Do you think, looking at the patch, that the offered support is enough with having it remplemented efficiently and only bufobj specific? Thanks, Attilio -- Peace can only be achieved by understanding - A. Einstein From owner-freebsd-arch@FreeBSD.ORG Sun Apr 18 16:43:28 2010 Return-Path: Delivered-To: freebsd-arch@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D29D3106566B; Sun, 18 Apr 2010 16:43:28 +0000 (UTC) (envelope-from gary.jennejohn@freenet.de) Received: from mout3.freenet.de (mout3.freenet.de [IPv6:2001:748:100:40::2:5]) by mx1.freebsd.org (Postfix) with ESMTP id 6A0C88FC17; Sun, 18 Apr 2010 16:43:28 +0000 (UTC) Received: from [195.4.92.18] (helo=8.mx.freenet.de) by mout3.freenet.de with esmtpa (ID gary.jennejohn@freenet.de) (port 25) (Exim 4.72 #3) id 1O3Xah-0002AM-2h; Sun, 18 Apr 2010 18:43:27 +0200 Received: from p57ae2469.dip0.t-ipconnect.de ([87.174.36.105]:12853 helo=ernst.jennejohn.org) by 8.mx.freenet.de with esmtpa (ID gary.jennejohn@freenet.de) (port 25) (Exim 4.72 #3) id 1O3Xag-0002nO-Jr; Sun, 18 Apr 2010 18:43:27 +0200 Date: Sun, 18 Apr 2010 18:43:25 +0200 From: Gary Jennejohn To: kmacy@freebsd.org Message-ID: <20100418184325.53e091fd@ernst.jennejohn.org> In-Reply-To: References: X-Mailer: Claws Mail 3.7.5 (GTK+ 2.18.7; amd64-portbld-freebsd9.0) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit Cc: freebsd-arch@freebsd.org Subject: Re: Moving forward with vm page lock X-BeenThere: freebsd-arch@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: gary.jennejohn@freenet.de List-Id: Discussion related to FreeBSD architecture List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 18 Apr 2010 16:43:28 -0000 On Sat, 17 Apr 2010 14:55:30 -0700 "K. Macy" wrote: > The current version of the patch can be found at: > http://people.freebsd.org/~kmacy/diffs/head_page_lock.diff > Unfortunately, this patch is already out-of-date: [apply patch] find . -type f -name \*.rej ./sys/amd64/amd64/pmap.c.rej ./sys/vm/swap_pager.c.rej ./sys/vm/vm_glue.c.rej ./sys/vm/vm_object.c.rej All result from applying the patch. -- Gary Jennejohn From owner-freebsd-arch@FreeBSD.ORG Sun Apr 18 18:50:51 2010 Return-Path: Delivered-To: freebsd-arch@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 5BAEB1065675 for ; Sun, 18 Apr 2010 18:50:51 +0000 (UTC) (envelope-from kmatthew.macy@gmail.com) Received: from mail-qy0-f199.google.com (mail-qy0-f199.google.com [209.85.221.199]) by mx1.freebsd.org (Postfix) with ESMTP id 1394C8FC0C for ; Sun, 18 Apr 2010 18:50:50 +0000 (UTC) Received: by qyk37 with SMTP id 37so3674549qyk.8 for ; Sun, 18 Apr 2010 11:50:50 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:sender:reply-to:received :in-reply-to:references:date:x-google-sender-auth:received :message-id:subject:from:to:cc:content-type; bh=znIapgWrVhm/+FiRxPng2E16XioXN1swfya92895XbI=; b=nbbhY28DW/+CjPO4iE9DlDm0XaAHgkWXhA6dKFuM2YfU05FTtrWK+KBWlgYJxm7rHa 2BgBZ533se7buT0Yp92fH7keH1RGxkwgpHSv5bWd3z1ccXcPZfeEXoAuFUaGl67QvJiq ydxBgZvYXYXKMeC4aZBdgIg7v8BC/xAlc/Wys= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:sender:reply-to:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:cc:content-type; b=VGg8t/OcUcqo+evtlEsbECRz4k0hJY84uCiQzR5fOgwUWK9smWnl4A9p6lxMOT8VAZ HWE6EVb+hOWcorvS8/G7vM4L/gtyuvLlj8wsEOy2qVgqG5gJxiMXekWfXH31y9uZeYaX QuAu3CpUL1YBjJO1dMA+JSWj/XNtCzNbz5PmU= MIME-Version: 1.0 Sender: kmatthew.macy@gmail.com Received: by 10.229.226.6 with HTTP; Sun, 18 Apr 2010 11:50:50 -0700 (PDT) In-Reply-To: <20100418184325.53e091fd@ernst.jennejohn.org> References: <20100418184325.53e091fd@ernst.jennejohn.org> Date: Sun, 18 Apr 2010 11:50:50 -0700 X-Google-Sender-Auth: ee4b314b0cf9d205 Received: by 10.229.224.149 with SMTP id io21mr5657872qcb.64.1271616650099; Sun, 18 Apr 2010 11:50:50 -0700 (PDT) Message-ID: From: "K. Macy" To: gary.jennejohn@freenet.de Content-Type: text/plain; charset=ISO-8859-1 Cc: freebsd-arch@freebsd.org Subject: Re: Moving forward with vm page lock X-BeenThere: freebsd-arch@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: kmacy@freebsd.org List-Id: Discussion related to FreeBSD architecture List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 18 Apr 2010 18:50:51 -0000 On Sun, Apr 18, 2010 at 9:43 AM, Gary Jennejohn wrote: > On Sat, 17 Apr 2010 14:55:30 -0700 > "K. Macy" wrote: > >> The current version of the patch can be found at: >> http://people.freebsd.org/~kmacy/diffs/head_page_lock.diff >> > > Unfortunately, this patch is already out-of-date: > > [apply patch] > find . -type f -name \*.rej > ./sys/amd64/amd64/pmap.c.rej > ./sys/vm/swap_pager.c.rej > ./sys/vm/vm_glue.c.rej > ./sys/vm/vm_object.c.rej Please try the branch. I will update the patch today, but I cannot make any guarantees about the absence of conflicts from one day to the next. -Kip From owner-freebsd-arch@FreeBSD.ORG Sun Apr 18 19:31:59 2010 Return-Path: Delivered-To: freebsd-arch@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 11BBC106566B for ; Sun, 18 Apr 2010 19:31:59 +0000 (UTC) (envelope-from alan.l.cox@gmail.com) Received: from mail-pz0-f201.google.com (mail-pz0-f201.google.com [209.85.222.201]) by mx1.freebsd.org (Postfix) with ESMTP id CFC2B8FC19 for ; Sun, 18 Apr 2010 19:31:58 +0000 (UTC) Received: by pzk39 with SMTP id 39so2868680pzk.7 for ; Sun, 18 Apr 2010 12:31:58 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:reply-to:in-reply-to :references:date:received:message-id:subject:from:to:cc:content-type; bh=8kCCI51TTQVc9OMJ32W+whWAOXVrq/DqT+5Oj0CCKwk=; b=Xmpahl3dYAOLYbKFhQTdNO3DqOT2KRb5ohJ2IDHyrs0D0o8jh0lKzuXussY3hIkZjM l1GvIoLLT/s1eHKlfHKPFMtUyO+TKwCp1lpuuFJ8MPC7RxsnDLxsI209vtFuE7bHvub2 aoqXxqj7fDw3g+hSk0TKRQsVMS6aXBkSytoto= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:reply-to:in-reply-to:references:date:message-id :subject:from:to:cc:content-type; b=Xizx3Lvo/tfXJtG54sZeOeZxOlD/TsIDwSjE0uy9fnqWfpWwFGfW2SVJ+WZvZQ1hs2 bsuQHyH1DBKxcAsIf36gZUVjI6a+vncYFBjvdGedTIIbyTtz2b3b9gjCgH1jb2GgBgUk 9Kl5zZuiYqeJuBoe17oa49vJqSl2K7N1y8KAM= MIME-Version: 1.0 Received: by 10.142.254.16 with HTTP; Sun, 18 Apr 2010 12:31:58 -0700 (PDT) In-Reply-To: References: <20100418184325.53e091fd@ernst.jennejohn.org> Date: Sun, 18 Apr 2010 14:31:58 -0500 Received: by 10.142.2.2 with SMTP id 2mr1648670wfb.75.1271619118269; Sun, 18 Apr 2010 12:31:58 -0700 (PDT) Message-ID: From: Alan Cox To: kmacy@freebsd.org Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: gary.jennejohn@freenet.de, freebsd-arch@freebsd.org Subject: Re: Moving forward with vm page lock X-BeenThere: freebsd-arch@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: alc@freebsd.org List-Id: Discussion related to FreeBSD architecture List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 18 Apr 2010 19:31:59 -0000 On Sun, Apr 18, 2010 at 1:50 PM, K. Macy wrote: > On Sun, Apr 18, 2010 at 9:43 AM, Gary Jennejohn > wrote: > > On Sat, 17 Apr 2010 14:55:30 -0700 > > "K. Macy" wrote: > > > >> The current version of the patch can be found at: > >> http://people.freebsd.org/~kmacy/diffs/head_page_lock.diff > >> > > > > Unfortunately, this patch is already out-of-date: > > > > [apply patch] > > find . -type f -name \*.rej > > ./sys/amd64/amd64/pmap.c.rej > > ./sys/vm/swap_pager.c.rej > > ./sys/vm/vm_glue.c.rej > > ./sys/vm/vm_object.c.rej > > Please try the branch. I will update the patch today, but I cannot > make any guarantees about the absence of conflicts from one day to the > next. > > I will be done making changes this evening. If you can wait about 12 hours before making the patch, it should be good for about a week. Regards, Alan From owner-freebsd-arch@FreeBSD.ORG Mon Apr 19 04:12:05 2010 Return-Path: Delivered-To: freebsd-arch@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id DF7041065670 for ; Mon, 19 Apr 2010 04:12:05 +0000 (UTC) (envelope-from kmatthew.macy@gmail.com) Received: from mail-qy0-f199.google.com (mail-qy0-f199.google.com [209.85.221.199]) by mx1.freebsd.org (Postfix) with ESMTP id 982DB8FC08 for ; Mon, 19 Apr 2010 04:12:05 +0000 (UTC) Received: by qyk37 with SMTP id 37so3952648qyk.8 for ; Sun, 18 Apr 2010 21:12:04 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:sender:reply-to:received :in-reply-to:references:date:x-google-sender-auth:received :message-id:subject:from:to:cc:content-type; bh=WxSDSXuaUVBwjQ/EafUU6o8KGQ35dUaLGfLNyBjnqLc=; b=q4MyLoHGtnXHFCcrAI0/uDZDQCZJMiU7KK/qyTczvr74uys/RZPdlhDi3i6LmMNQJl tOL9iLpr0rGGMQntOdIrlXuLvUnA9WjEX3w1NPueKPa7IFCUrMXxOArdHDu6mYbZyWxk QLmUEc0JjQTos5uqPBv1kyRtQSQ73EOb9mgrU= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:sender:reply-to:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:cc:content-type; b=F852tOvTSlZ6FyDohRJV8kXAQ80pe2CTq0XKbd1oF3HTyfoESmqEg8RH6k3uFyQhqR fE7ubGf1xXEXDgALm38ECkvTFiH2autrmg3Vq7hZUozortRTqYfoP1dvS3jkfDXZkOz5 9XEZfW9ao7OJWJQktEr2CMlv7e1N4NNDB53UE= MIME-Version: 1.0 Sender: kmatthew.macy@gmail.com Received: by 10.229.226.6 with HTTP; Sun, 18 Apr 2010 21:12:04 -0700 (PDT) In-Reply-To: <20100418184325.53e091fd@ernst.jennejohn.org> References: <20100418184325.53e091fd@ernst.jennejohn.org> Date: Sun, 18 Apr 2010 21:12:04 -0700 X-Google-Sender-Auth: 96700d9e37328d21 Received: by 10.229.250.206 with SMTP id mp14mr4023491qcb.62.1271650324489; Sun, 18 Apr 2010 21:12:04 -0700 (PDT) Message-ID: From: "K. Macy" To: gary.jennejohn@freenet.de Content-Type: text/plain; charset=ISO-8859-1 Cc: freebsd-arch@freebsd.org Subject: Re: Moving forward with vm page lock X-BeenThere: freebsd-arch@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: kmacy@freebsd.org List-Id: Discussion related to FreeBSD architecture List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Apr 2010 04:12:06 -0000 The updated patch is: http://people.freebsd.org/~kmacy/diffs/head_page_lock_2.diff The new branch is: svn://svn.freebsd.org/base/user/kmacy/head_page_lock_2/ Cheers, Kip On Sun, Apr 18, 2010 at 9:43 AM, Gary Jennejohn wrote: > On Sat, 17 Apr 2010 14:55:30 -0700 > "K. Macy" wrote: > >> The current version of the patch can be found at: >> http://people.freebsd.org/~kmacy/diffs/head_page_lock.diff >> > > Unfortunately, this patch is already out-of-date: > > [apply patch] > find . -type f -name \*.rej > ./sys/amd64/amd64/pmap.c.rej > ./sys/vm/swap_pager.c.rej > ./sys/vm/vm_glue.c.rej > ./sys/vm/vm_object.c.rej > > All result from applying the patch. > > -- > Gary Jennejohn > From owner-freebsd-arch@FreeBSD.ORG Mon Apr 19 09:10:02 2010 Return-Path: Delivered-To: freebsd-arch@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 8FAD6106566C; Mon, 19 Apr 2010 09:10:02 +0000 (UTC) (envelope-from gary.jennejohn@freenet.de) Received: from mout7.freenet.de (mout7.freenet.de [IPv6:2001:748:100:40::2:9]) by mx1.freebsd.org (Postfix) with ESMTP id 204448FC25; Mon, 19 Apr 2010 09:10:02 +0000 (UTC) Received: from [195.4.92.18] (helo=8.mx.freenet.de) by mout7.freenet.de with esmtpa (ID gary.jennejohn@freenet.de) (port 25) (Exim 4.72 #3) id 1O3mzQ-00079q-Lp; Mon, 19 Apr 2010 11:10:00 +0200 Received: from p57ae05d8.dip0.t-ipconnect.de ([87.174.5.216]:20217 helo=ernst.jennejohn.org) by 8.mx.freenet.de with esmtpa (ID gary.jennejohn@freenet.de) (port 25) (Exim 4.72 #3) id 1O3mzQ-0006AN-CU; Mon, 19 Apr 2010 11:10:00 +0200 Date: Mon, 19 Apr 2010 11:09:59 +0200 From: Gary Jennejohn To: kmacy@freebsd.org Message-ID: <20100419110959.295b84c2@ernst.jennejohn.org> In-Reply-To: References: <20100418184325.53e091fd@ernst.jennejohn.org> X-Mailer: Claws Mail 3.7.5 (GTK+ 2.18.7; amd64-portbld-freebsd9.0) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit Cc: freebsd-arch@freebsd.org Subject: Re: Moving forward with vm page lock X-BeenThere: freebsd-arch@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: gary.jennejohn@freenet.de List-Id: Discussion related to FreeBSD architecture List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Apr 2010 09:10:02 -0000 On Sun, 18 Apr 2010 21:12:04 -0700 "K. Macy" wrote: > The updated patch is: > > http://people.freebsd.org/~kmacy/diffs/head_page_lock_2.diff > > The new branch is: > svn://svn.freebsd.org/base/user/kmacy/head_page_lock_2/ > Thanks, the patch works for me. Starting X kills the box dead. I didn't get a crash dump so can't say more than that. Maybe a double fault? Note that I'm using the experimental 7.5 server. I thought it might be caused by dri (locking etc.) so I deleted it but the crash persisted. I did _not_ try reinstalling all my X-based ports - too much hassle. -- Gary Jennejohn From owner-freebsd-arch@FreeBSD.ORG Mon Apr 19 11:06:55 2010 Return-Path: Delivered-To: freebsd-arch@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 184F81065670 for ; Mon, 19 Apr 2010 11:06:55 +0000 (UTC) (envelope-from owner-bugmaster@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id E1C778FC08 for ; Mon, 19 Apr 2010 11:06:54 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.4/8.14.4) with ESMTP id o3JB6sCV034031 for ; Mon, 19 Apr 2010 11:06:54 GMT (envelope-from owner-bugmaster@FreeBSD.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.4/8.14.4/Submit) id o3JB6s98034029 for freebsd-arch@FreeBSD.org; Mon, 19 Apr 2010 11:06:54 GMT (envelope-from owner-bugmaster@FreeBSD.org) Date: Mon, 19 Apr 2010 11:06:54 GMT Message-Id: <201004191106.o3JB6s98034029@freefall.freebsd.org> X-Authentication-Warning: freefall.freebsd.org: gnats set sender to owner-bugmaster@FreeBSD.org using -f From: FreeBSD bugmaster To: freebsd-arch@FreeBSD.org Cc: Subject: Current problem reports assigned to freebsd-arch@FreeBSD.org X-BeenThere: freebsd-arch@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussion related to FreeBSD architecture List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Apr 2010 11:06:55 -0000 Note: to view an individual PR, use: http://www.freebsd.org/cgi/query-pr.cgi?pr=(number). The following is a listing of current problems submitted by FreeBSD users. These represent problem reports covering all versions including experimental development code and obsolete releases. S Tracker Resp. Description -------------------------------------------------------------------------------- o kern/120749 arch [request] Suggest upping the default kern.ps_arg_cache 1 problem total. From owner-freebsd-arch@FreeBSD.ORG Sat Apr 24 19:29:59 2010 Return-Path: Delivered-To: freebsd-arch@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id E44AF106566B; Sat, 24 Apr 2010 19:29:59 +0000 (UTC) (envelope-from matthew.fleming@isilon.com) Received: from seaxch09.isilon.com (seaxch09.isilon.com [74.85.160.25]) by mx1.freebsd.org (Postfix) with ESMTP id C65788FC15; Sat, 24 Apr 2010 19:29:59 +0000 (UTC) Content-class: urn:content-classes:message MIME-Version: 1.0 Date: Sat, 24 Apr 2010 12:29:59 -0700 x-mimeole: Produced By Microsoft Exchange V6.5 Message-ID: <06D5F9F6F655AD4C92E28B662F7F853E021D4D37@seaxch09.desktop.isilon.com> X-MS-Has-Attach: X-MS-TNEF-Correlator: Thread-Topic: GDC/libdispatch for kernel Thread-Index: Acrj5IcQ+uJZCoMQT6CdM8qdOSWV3g== From: "Matthew Fleming" To: Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: rwatson@freebsd.org Subject: GDC/libdispatch for kernel X-BeenThere: freebsd-arch@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussion related to FreeBSD architecture List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 24 Apr 2010 19:30:00 -0000 I have the need for a simple mechanism to farm off work blocks that will = be run on other processors if there is spare compute time, and on the = current CPU if there is not any spare time. An example of something I want to do is compute an error correcting code = and a crc32 checksum on a block of data, potentially while also dealing = with system resources so the block can be written to disk. I dont want to reinvent the wheel, and the GCD framework looks like it = would provide what I want in dispatch groups run on a parallel queue. = However, theres a lot of things supported in GCD that I dont need (now = and possibly ever). Has anyone done any work to support some of the GCD functions in the = kernel? If not, how useful would other people find such a thing? In my = specific instance, I was thinking along the lines of having the idle = thread run a dispatch object off a global queue, setting its priority to = the curthread->td_priority of the thread that initiated the dispatch, in = order to prevent priority inversions. I dont want the farmed off work = to preempt anything else useful the system may have to do, which is why = I was considering the idle threads (or my own threads running at = PRI_MAX_IDLE-1 until they have work). However, I dont think this implementation is really in the spirit of the = rest of the GCD architecture. So in addition to wondering if there is = an existing BSD-licensed code to do such a thing, I also am wondering = what direction the community can provide on a few design points to make = this useful both for me and for the general community. I will be at BSDCan but I need something usable (for me, at least) next = week to fix some issues at work. Meanwhile, one other question I had was regarding the name of all the = dispatch_foo_t objects, which are typedefs of a pointer-to-struct. This = is explicitly frowned upon in style(9), so would it be better to be = consistent with libdispatch names or style(9)? I would tend to assume = style(9). Thanks, matthew