From owner-freebsd-smp Sun Jan 6 23:36:28 2002 Delivered-To: freebsd-smp@freebsd.org Received: from kayak.xcllnt.net (209-128-86-226.bayarea.net [209.128.86.226]) by hub.freebsd.org (Postfix) with ESMTP id 1EB5537B400; Sun, 6 Jan 2002 23:36:26 -0800 (PST) Received: from dhcp01.pn.xcllnt.net (dhcp01.pn.xcllnt.net [192.168.4.201]) by kayak.xcllnt.net (8.11.6/8.11.4) with ESMTP id g077aPQ86882; Sun, 6 Jan 2002 23:36:25 -0800 (PST) (envelope-from marcel@kayak.pn.xcllnt.net) Received: (from marcel@localhost) by dhcp01.pn.xcllnt.net (8.11.6/8.11.6) id g077amY03196; Sun, 6 Jan 2002 23:36:48 -0800 (PST) (envelope-from marcel) Date: Sun, 6 Jan 2002 23:36:48 -0800 From: Marcel Moolenaar To: "Andrew R. Reiter" Cc: freebsd-smp@FreeBSD.ORG Subject: Re: SMPng biweekly updates Message-ID: <20020106233647.B2879@dhcp01.pn.xcllnt.net> References: Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.3.21i Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org On Fri, Jan 04, 2002 at 05:50:46PM -0500, Andrew R. Reiter wrote: > [snip] > I propose a biweekly mini-email that goes out to -smp that is essentially > an outline of what's being done, what's being discussed, what needs to be > done, and any design changes/thoughts. [snip] > I am volunteering to do this job... But, what Im interested in is seeing > if those out there listening are interested in having this done... [snip] Yes. I fail to have time to fully participate, but need to be aware of SMPng to have SMP support on ia64 make sense. For that I already need to invest a lot of energy (new ground), and if I progress/learn less quickly than SMPng can change the world around me, I'll probably not catch up anytime soon. I don't think it's crucial for me to have the mini-email, but it'll probably help me to more quickly reach a point where implementing stops being a catch-up activity and instead becomes staying in sync or hopefully even ahead... -- Marcel Moolenaar USPA: A-39004 marcel@xcllnt.net To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Sun Jan 6 23:59:28 2002 Delivered-To: freebsd-smp@freebsd.org Received: from mail11.speakeasy.net (mail11.speakeasy.net [216.254.0.211]) by hub.freebsd.org (Postfix) with ESMTP id 453B637B419 for ; Sun, 6 Jan 2002 23:59:24 -0800 (PST) Received: (qmail 3150 invoked from network); 7 Jan 2002 07:59:23 -0000 Received: from unknown (HELO laptop.baldwin.cx) ([64.81.54.73]) (envelope-sender ) by mail11.speakeasy.net (qmail-ldap-1.03) with SMTP for ; 7 Jan 2002 07:59:23 -0000 Message-ID: X-Mailer: XFMail 1.4.0 on FreeBSD X-Priority: 3 (Normal) Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 8bit MIME-Version: 1.0 In-Reply-To: <20020106233647.B2879@dhcp01.pn.xcllnt.net> Date: Sun, 06 Jan 2002 23:59:11 -0800 (PST) From: John Baldwin To: Marcel Moolenaar Subject: Re: SMPng biweekly updates Cc: freebsd-smp@FreeBSD.ORG, "Andrew R. Reiter" Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org On 07-Jan-02 Marcel Moolenaar wrote: > On Fri, Jan 04, 2002 at 05:50:46PM -0500, Andrew R. Reiter wrote: >> > [snip] >> I propose a biweekly mini-email that goes out to -smp that is essentially >> an outline of what's being done, what's being discussed, what needs to be >> done, and any design changes/thoughts. > [snip] >> I am volunteering to do this job... But, what Im interested in is seeing >> if those out there listening are interested in having this done... > [snip] > > Yes. I fail to have time to fully participate, but need to be aware > of SMPng to have SMP support on ia64 make sense. For that I already > need to invest a lot of energy (new ground), and if I progress/learn > less quickly than SMPng can change the world around me, I'll probably > not catch up anytime soon. Actually, SMPng at this point won't change much as far as implementing the MD code to get SMP up and running. If you need some hints or have questions, feel free to ask on here. I worked on getting it going for Alpha, and Jake Burkholder is currently doing it for sparc64, so hopefully we can help answer your questions. :) -- John Baldwin <>< http://www.FreeBSD.org/~jhb/ "Power Users Use the Power to Serve!" - http://www.FreeBSD.org/ To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Mon Jan 7 4: 6:46 2002 Delivered-To: freebsd-smp@freebsd.org Received: from svr-ganmtc-appserv-mgmt.ncf.coxexpress.com (svr-ganmtc-appserv-mgmt.ncf.coxexpress.com [24.136.46.5]) by hub.freebsd.org (Postfix) with ESMTP id E2EAA37B420; Mon, 7 Jan 2002 04:06:23 -0800 (PST) Received: from darkstar.doublethink.cx (cpe-oca-24-136-59-202-cmcpe.ncf.coxexpress.com [24.136.59.202]) by svr-ganmtc-appserv-mgmt.ncf.coxexpress.com (8.11.4/8.11.4) with ESMTP id g07C6Ml29455; Mon, 7 Jan 2002 07:06:23 -0500 Received: by darkstar.doublethink.cx (Postfix, from userid 1000) id 105F52B99; Mon, 7 Jan 2002 07:06:22 -0500 (EST) Date: Mon, 7 Jan 2002 07:06:22 -0500 From: Chris Faulhaber To: peter@FreeBSD.org, scottl@FreeBSD.org Cc: smp@FreeBSD.org Subject: P5 vs. SMP, part 2 Message-ID: <20020107120621.GA23585@darkstar.doublethink.cx> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="sm4nu43k4a2Rpi4c" Content-Disposition: inline User-Agent: Mutt/1.3.24i Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org --sm4nu43k4a2Rpi4c Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable I finally got around to narrowing down the commit (see below) that slowed by dual P5 box. From my original message to -smp: On Tue, 25 Sep 2001, Chris Faulhaber wrote: > I just updated my Dual Pentium (P54C) box from RELENG_4_3 to > RELENG_4 and have found that the box is significantly slower > when running an SMP kernel versus UP. Under 4.3, an SMP -j4 > buildworld took just over 4.5 hours. It now takes upwards > of 20 hours w/SMP and 6 (no -j) UP. When logging in and > running basic commands the system seems quite sluggish. Backing out this commit (with a slight conflict in /sys/sys/kernel.h) allows my box to build an up-to-date -stable world is less than 5 hours (instead of 20) again. Any chance someone with i386/smp-foo can look at this? Original message at: http://docs.freebsd.org/cgi/getmsg.cgi?fetch=3D33169+0+archive/2001/freebsd= -smp/20010930.freebsd-smp --=20 Chris D. Faulhaber - jedgar@fxp.org - jedgar@FreeBSD.org -------------------------------------------------------- FreeBSD: The Power To Serve - http://www.FreeBSD.org From: Scott Long To: cvs-committers@FreeBSD.org, cvs-all@FreeBSD.org Subject: cvs commit: src/sys/sys kernel.h src/sys/kern init_main.c kern_descrip.c kern_kthread.c src/sys/i386/include md_var.h cpu.h src/sys/i386/i386 vm_machdep.c mp_machdep.c machdep.c locore.s Date: Fri, 15 Jun 2001 02:38:07 -0700 (PDT) scottl 2001/06/15 02:38:07 PDT Modified files: (Branch: RELENG_4) sys/sys kernel.h=20 sys/kern init_main.c kern_descrip.c kern_kthread.c=20 sys/i386/include md_var.h cpu.h=20 sys/i386/i386 vm_machdep.c mp_machdep.c machdep.c=20 locore.s=20 Log: MFC Peter Wemm's init and kthread enhancements from 08/11/2000 of -curren= t. This allows kthreads to be used by device drivers long before root is mou= nted and init is officially started. This also brings RAIDframe one step clos= er. =20 Reviewed by: peter =20 Revision Changes Path 1.63.2.1 +8 -7 src/sys/sys/kernel.h 1.134.2.6 +62 -100 src/sys/kern/init_main.c 1.81.2.8 +13 -7 src/sys/kern/kern_descrip.c 1.5.2.2 +2 -2 src/sys/kern/kern_kthread.c 1.35.2.1 +2 -1 src/sys/i386/include/md_var.h 1.43.2.2 +1 -2 src/sys/i386/include/cpu.h 1.132.2.3 +9 -8 src/sys/i386/i386/vm_machdep.c 1.115.2.8 +3 -12 src/sys/i386/i386/mp_machdep.c 1.385.2.12 +21 -1 src/sys/i386/i386/machdep.c 1.132.2.4 +1 -46 src/sys/i386/i386/locore.s --sm4nu43k4a2Rpi4c Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.0.6 (FreeBSD) Comment: FreeBSD: The Power To Serve iEYEARECAAYFAjw5jz0ACgkQObaG4P6BelDIMgCfdO1QI9waj3Qk5ePWGxC4BVJh FZkAoKKuFPQvLRe8Im/TVFGwIeNxJoFq =uSnL -----END PGP SIGNATURE----- --sm4nu43k4a2Rpi4c-- To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Mon Jan 7 10:36: 4 2002 Delivered-To: freebsd-smp@freebsd.org Received: from mailhost.iprg.nokia.com (mailhost.iprg.nokia.com [205.226.5.12]) by hub.freebsd.org (Postfix) with ESMTP id C0F4237B43E; Mon, 7 Jan 2002 10:35:39 -0800 (PST) Received: from darkstar.iprg.nokia.com (darkstar.iprg.nokia.com [205.226.5.69]) by mailhost.iprg.nokia.com (8.9.3/8.9.3-GLGS) with ESMTP id KAA06084; Mon, 7 Jan 2002 10:35:39 -0800 (PST) Received: (from root@localhost) by darkstar.iprg.nokia.com (8.11.0/8.11.0-DARKSTAR) id g07IZcZ02910; Mon, 7 Jan 2002 10:35:38 -0800 X-mProtect: Mon, 7 Jan 2002 10:35:38 -0800 Nokia Silicon Valley Messaging Protection Received: from UNKNOWN (172.19.66.107, claiming to be "iprg.nokia.com") by darkstar.iprg.nokia.com smtpdKdEhdD; Mon, 07 Jan 2002 10:35:36 PST Message-ID: <3C39EA78.56073818@iprg.nokia.com> Date: Mon, 07 Jan 2002 10:35:36 -0800 From: vijay singh Organization: nokia X-Mailer: Mozilla 4.75 [en]C-CCK-MCD {Nokia} (Win98; U) X-Accept-Language: en MIME-Version: 1.0 Cc: Michal Mertl , "Andrew R. Reiter" , freebsd-smp@FreeBSD.ORG Subject: Re: SMPng biweekly updates References: <003901c1959e$84afce10$0a00a8c0@gandalf> Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org hello - i am just learning to hack but i would like to help in whatever way i can and learn along the way. vijay Mario Doria wrote: > > Count me in :) > > ----- Original Message ----- > From: "Michal Mertl" > To: "Andrew R. Reiter" > Cc: > Sent: Friday, January 04, 2002 5:09 PM > Subject: Re: SMPng biweekly updates > > > On Fri, 4 Jan 2002, Andrew R. Reiter wrote: > > > > > > I propose a biweekly mini-email that goes out to -smp that is > essentially > > > an outline of what's being done, what's being discussed, what needs to > be > > > done, and any design changes/thoughts. I'd like to think of it as a cvs > > > log dump for the SMPng project for a two week period. Essentially > someone > > > > That's a great idea. I think there may exists some issues which may > > require only mechanic changes to the code which we 'not so informed' may > > do and let those who know better what they're doing to concentrate on > > design or specific complex changes. > > > > > > > I am volunteering to do this job... But, what Im interested in is > seeing > > > if those out there listening are interested in having this done... > > > > I think you may be surprised how many people are reading the lists being > > mostly quiet yet willing to help. This could allow them to participate. > > > > > > > > -- > > Michal Mertl > > mime@traveller.cz > > > > > > > > To Unsubscribe: send mail to majordomo@FreeBSD.org > > with "unsubscribe freebsd-smp" in the body of the message > > To Unsubscribe: send mail to majordomo@FreeBSD.org > with "unsubscribe freebsd-smp" in the body of the message -- Vijay Singh, home: 408.246.4339 3131 Homestead Road, work: 650.625.2572 24K Laguna Clara, cell: 650.743.9632 Santa Clara, CA - 95051 To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Mon Jan 7 15:50:45 2002 Delivered-To: freebsd-smp@freebsd.org Received: from rwcrmhc51.attbi.com (rwcrmhc51.attbi.com [204.127.198.38]) by hub.freebsd.org (Postfix) with ESMTP id 64B0A37B419; Mon, 7 Jan 2002 15:50:36 -0800 (PST) Received: from peter3.wemm.org ([12.232.27.13]) by rwcrmhc51.attbi.com (InterMail vM.4.01.03.27 201-229-121-127-20010626) with ESMTP id <20020107235036.YSCP288.rwcrmhc51.attbi.com@peter3.wemm.org>; Mon, 7 Jan 2002 23:50:36 +0000 Received: from overcee.netplex.com.au (overcee.wemm.org [10.0.0.3]) by peter3.wemm.org (8.11.0/8.11.0) with ESMTP id g07NoZs51082; Mon, 7 Jan 2002 15:50:35 -0800 (PST) (envelope-from peter@wemm.org) Received: from wemm.org (localhost [127.0.0.1]) by overcee.netplex.com.au (Postfix) with ESMTP id 95C263808; Mon, 7 Jan 2002 15:50:35 -0800 (PST) (envelope-from peter@wemm.org) X-Mailer: exmh version 2.5 07/13/2001 with nmh-1.0.4 To: Chris Faulhaber Cc: scottl@FreeBSD.org, smp@FreeBSD.org Subject: Re: P5 vs. SMP, part 2 In-Reply-To: <20020107120621.GA23585@darkstar.doublethink.cx> Date: Mon, 07 Jan 2002 15:50:35 -0800 From: Peter Wemm Message-Id: <20020107235035.95C263808@overcee.netplex.com.au> Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org Chris Faulhaber wrote: > > --sm4nu43k4a2Rpi4c > Content-Type: text/plain; charset=us-ascii > Content-Disposition: inline > Content-Transfer-Encoding: quoted-printable > > I finally got around to narrowing down the commit (see > below) that slowed by dual P5 box. From my original > message to -smp: !!!!. I just reread the diff and I dont see anything obviously wrong. Do you just see this in P5 machines? (ie: do you have a P6 smp box as well?) I have a dual P5-90 at home but it is missing some components. I suspect it will take a while to get working.. :-] > On Tue, 25 Sep 2001, Chris Faulhaber wrote: > > I just updated my Dual Pentium (P54C) box from RELENG_4_3 to > > RELENG_4 and have found that the box is significantly slower > > when running an SMP kernel versus UP. Under 4.3, an SMP -j4 > > buildworld took just over 4.5 hours. It now takes upwards > > of 20 hours w/SMP and 6 (no -j) UP. When logging in and > > running basic commands the system seems quite sluggish. > > Backing out this commit (with a slight conflict in > /sys/sys/kernel.h) allows my box to build an up-to-date > -stable world is less than 5 hours (instead of 20) again. > > Any chance someone with i386/smp-foo can look at this? > > Original message at: > http://docs.freebsd.org/cgi/getmsg.cgi?fetch=3D33169+0+archive/2001/freebsd= > -smp/20010930.freebsd-smp > > --=20 > Chris D. Faulhaber - jedgar@fxp.org - jedgar@FreeBSD.org > -------------------------------------------------------- > FreeBSD: The Power To Serve - http://www.FreeBSD.org > > From: Scott Long > To: cvs-committers@FreeBSD.org, cvs-all@FreeBSD.org > Subject: cvs commit: src/sys/sys kernel.h src/sys/kern init_main.c > kern_descrip.c kern_kthread.c src/sys/i386/include md_var.h cpu.h > src/sys/i386/i386 vm_machdep.c mp_machdep.c machdep.c locore.s > Date: Fri, 15 Jun 2001 02:38:07 -0700 (PDT) > > scottl 2001/06/15 02:38:07 PDT > > Modified files: (Branch: RELENG_4) > sys/sys kernel.h=20 > sys/kern init_main.c kern_descrip.c kern_kthread.c=20 > sys/i386/include md_var.h cpu.h=20 > sys/i386/i386 vm_machdep.c mp_machdep.c machdep.c=20 > locore.s=20 > Log: > MFC Peter Wemm's init and kthread enhancements from 08/11/2000 of -curren= > t. > This allows kthreads to be used by device drivers long before root is mou= > nted > and init is officially started. This also brings RAIDframe one step clos= > er. > =20 > Reviewed by: peter > =20 > Revision Changes Path > 1.63.2.1 +8 -7 src/sys/sys/kernel.h > 1.134.2.6 +62 -100 src/sys/kern/init_main.c > 1.81.2.8 +13 -7 src/sys/kern/kern_descrip.c > 1.5.2.2 +2 -2 src/sys/kern/kern_kthread.c > 1.35.2.1 +2 -1 src/sys/i386/include/md_var.h > 1.43.2.2 +1 -2 src/sys/i386/include/cpu.h > 1.132.2.3 +9 -8 src/sys/i386/i386/vm_machdep.c > 1.115.2.8 +3 -12 src/sys/i386/i386/mp_machdep.c > 1.385.2.12 +21 -1 src/sys/i386/i386/machdep.c > 1.132.2.4 +1 -46 src/sys/i386/i386/locore.s > > > --sm4nu43k4a2Rpi4c > Content-Type: application/pgp-signature > Content-Disposition: inline > > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1.0.6 (FreeBSD) > Comment: FreeBSD: The Power To Serve > > iEYEARECAAYFAjw5jz0ACgkQObaG4P6BelDIMgCfdO1QI9waj3Qk5ePWGxC4BVJh > FZkAoKKuFPQvLRe8Im/TVFGwIeNxJoFq > =uSnL > -----END PGP SIGNATURE----- > > --sm4nu43k4a2Rpi4c-- > > Cheers, -Peter -- Peter Wemm - peter@FreeBSD.org; peter@yahoo-inc.com; peter@netplex.com.au "All of this is for nothing if we don't go to the stars" - JMS/B5 To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Mon Jan 7 16: 8:30 2002 Delivered-To: freebsd-smp@freebsd.org Received: from peitho.fxp.org (peitho.fxp.org [209.26.95.40]) by hub.freebsd.org (Postfix) with ESMTP id F1B2037B419; Mon, 7 Jan 2002 16:08:25 -0800 (PST) Received: by peitho.fxp.org (Postfix, from userid 1000) id 658BE13668; Mon, 7 Jan 2002 19:08:25 -0500 (EST) Date: Mon, 7 Jan 2002 19:08:25 -0500 From: Chris Faulhaber To: Peter Wemm Cc: scottl@FreeBSD.org, smp@FreeBSD.org Subject: Re: P5 vs. SMP, part 2 Message-ID: <20020108000825.GA60374@peitho.fxp.org> References: <20020107120621.GA23585@darkstar.doublethink.cx> <20020107235035.95C263808@overcee.netplex.com.au> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="KsGdsel6WgEHnImy" Content-Disposition: inline In-Reply-To: <20020107235035.95C263808@overcee.netplex.com.au> User-Agent: Mutt/1.3.24i Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org --KsGdsel6WgEHnImy Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Mon, Jan 07, 2002 at 03:50:35PM -0800, Peter Wemm wrote: > Chris Faulhaber wrote: > >=20 > > --sm4nu43k4a2Rpi4c > > Content-Type: text/plain; charset=3Dus-ascii > > Content-Disposition: inline > > Content-Transfer-Encoding: quoted-printable > >=20 > > I finally got around to narrowing down the commit (see > > below) that slowed by dual P5 box. From my original > > message to -smp: >=20 > !!!!. >=20 > I just reread the diff and I dont see anything obviously wrong. Do you j= ust > see this in P5 machines? (ie: do you have a P6 smp box as well?) >=20 I have been in contact with a few other people that are also having problems with their P5's. Gunnar Pruessner reported a similiar problem at: http://www.freebsd.org/cgi/getmsg.cgi?fetch=3D5782+15738+/usr/local/www/db/= text/2001/freebsd-smp/20011007.freebsd-smp We have not had any problems on the dual and quad PIII's at work and I have not seen anyone using P6's report anything similiar. > I have a dual P5-90 at home but it is missing some components. I suspect > it will take a while to get working.. :-] >=20 I wonder how many dual P5's are still being used :/ --=20 Chris D. Faulhaber - jedgar@fxp.org - jedgar@FreeBSD.org -------------------------------------------------------- FreeBSD: The Power To Serve - http://www.FreeBSD.org --KsGdsel6WgEHnImy Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.0.6 (FreeBSD) Comment: FreeBSD: The Power To Serve iEYEARECAAYFAjw6OHgACgkQObaG4P6BelASqwCffe3xSjY47I500Y9r7RIh06pd XRQAn28PQ4IXqf1sT4lLO2jswp3zxaZC =w+7f -----END PGP SIGNATURE----- --KsGdsel6WgEHnImy-- To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Mon Jan 7 16:35:17 2002 Delivered-To: freebsd-smp@freebsd.org Received: from pintail.mail.pas.earthlink.net (pintail.mail.pas.earthlink.net [207.217.120.122]) by hub.freebsd.org (Postfix) with ESMTP id 238A937B404; Mon, 7 Jan 2002 16:35:15 -0800 (PST) Received: from pool0392.cvx21-bradley.dialup.earthlink.net ([209.179.193.137] helo=mindspring.com) by pintail.mail.pas.earthlink.net with esmtp (Exim 3.33 #1) id 16NkED-0002n7-00; Mon, 07 Jan 2002 16:34:58 -0800 Message-ID: <3C3A3EB0.548F0F59@mindspring.com> Date: Mon, 07 Jan 2002 16:34:56 -0800 From: Terry Lambert X-Mailer: Mozilla 4.7 [en]C-CCK-MCD {Sony} (Win98; U) X-Accept-Language: en MIME-Version: 1.0 To: Chris Faulhaber Cc: Peter Wemm , scottl@FreeBSD.org, smp@FreeBSD.org Subject: Re: P5 vs. SMP, part 2 References: <20020107120621.GA23585@darkstar.doublethink.cx> <20020107235035.95C263808@overcee.netplex.com.au> <20020108000825.GA60374@peitho.fxp.org> Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org Chris Faulhaber wrote: > I wonder how many dual P5's are still being used :/ There's at least you, Gunnar, Me, and (if he finds the parts), Peter. As a scratch SMP box, there's very little that beats a dual P5-90. It also keeps you honest on slowdown problems, which you might not see, if you had 2 processors each going 10-20 times the clock rate in question. I also like it because the IPIs and synchornization are relatively costly, which is a good approximation to a faster machine with many more CPUs. -- Terry To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Mon Jan 7 16:49:13 2002 Delivered-To: freebsd-smp@freebsd.org Received: from toyland.drapple.com (toyland.drapple.com [204.200.26.114]) by hub.freebsd.org (Postfix) with ESMTP id 2388B37B405; Mon, 7 Jan 2002 16:49:05 -0800 (PST) Received: (from patrick@localhost) by toyland.drapple.com (8.9.3/8.9.3) id QAA00338; Mon, 7 Jan 2002 16:48:54 -0800 (PST) (envelope-from patrick) Date: Mon, 7 Jan 2002 16:48:53 -0800 From: Patrick Gardella To: Terry Lambert Cc: Chris Faulhaber , Peter Wemm , scottl@FreeBSD.ORG, smp@FreeBSD.ORG Subject: Re: P5 vs. SMP, part 2 Message-ID: <20020107164853.A325@toyland.drapple.com> References: <20020107120621.GA23585@darkstar.doublethink.cx> <20020107235035.95C263808@overcee.netplex.com.au> <20020108000825.GA60374@peitho.fxp.org> <3C3A3EB0.548F0F59@mindspring.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.2.5i In-Reply-To: <3C3A3EB0.548F0F59@mindspring.com>; from tlambert2@mindspring.com on Mon, Jan 07, 2002 at 04:34:56PM -0800 Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org On Mon, Jan 07, 2002 at 04:34:56PM -0800, Terry Lambert wrote: > Chris Faulhaber wrote: > > I wonder how many dual P5's are still being used :/ > > There's at least you, Gunnar, Me, and (if he finds the parts), > Peter. > I use a dual P5 (200) as my primary home development system. Besides the MB, its very easy to find parts for. Patrick To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Mon Jan 7 16:55:54 2002 Delivered-To: freebsd-smp@freebsd.org Received: from peitho.fxp.org (peitho.fxp.org [209.26.95.40]) by hub.freebsd.org (Postfix) with ESMTP id 5F99737B405; Mon, 7 Jan 2002 16:55:51 -0800 (PST) Received: by peitho.fxp.org (Postfix, from userid 1000) id B75B013667; Mon, 7 Jan 2002 19:55:45 -0500 (EST) Date: Mon, 7 Jan 2002 19:55:45 -0500 From: Chris Faulhaber To: Patrick Gardella Cc: Terry Lambert , Peter Wemm , scottl@FreeBSD.ORG, smp@FreeBSD.ORG Subject: Re: P5 vs. SMP, part 2 Message-ID: <20020108005545.GA2736@peitho.fxp.org> References: <20020107120621.GA23585@darkstar.doublethink.cx> <20020107235035.95C263808@overcee.netplex.com.au> <20020108000825.GA60374@peitho.fxp.org> <3C3A3EB0.548F0F59@mindspring.com> <20020107164853.A325@toyland.drapple.com> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="wRRV7LY7NUeQGEoC" Content-Disposition: inline In-Reply-To: <20020107164853.A325@toyland.drapple.com> User-Agent: Mutt/1.3.24i Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org --wRRV7LY7NUeQGEoC Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Mon, Jan 07, 2002 at 04:48:53PM -0800, Patrick Gardella wrote: > On Mon, Jan 07, 2002 at 04:34:56PM -0800, Terry Lambert wrote: > > Chris Faulhaber wrote: > > > I wonder how many dual P5's are still being used :/ > >=20 > > There's at least you, Gunnar, Me, and (if he finds the parts), > > Peter. > > >=20 > I use a dual P5 (200) as my primary home development system. Besides > the MB, its very easy to find parts for. >=20 I assume, as we move farther off topic, that you guys haven't seen any significant slowdowns with your dual P5's with 4.x after mid-June? --=20 Chris D. Faulhaber - jedgar@fxp.org - jedgar@FreeBSD.org -------------------------------------------------------- FreeBSD: The Power To Serve - http://www.FreeBSD.org --wRRV7LY7NUeQGEoC Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.0.6 (FreeBSD) Comment: FreeBSD: The Power To Serve iEYEARECAAYFAjw6Q5EACgkQObaG4P6BelBKcgCeIrKV/Zo1sbZOqxBVWQWJ4QJs XJkAnirfR08RPUAovSNmpwy+TdJIWjY9 =RRJw -----END PGP SIGNATURE----- --wRRV7LY7NUeQGEoC-- To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Mon Jan 7 21: 3:14 2002 Delivered-To: freebsd-smp@freebsd.org Received: from avocet.prod.itd.earthlink.net (avocet.mail.pas.earthlink.net [207.217.120.50]) by hub.freebsd.org (Postfix) with ESMTP id 19A7237B41B; Mon, 7 Jan 2002 21:03:07 -0800 (PST) Received: from pool0442.cvx21-bradley.dialup.earthlink.net ([209.179.193.187] helo=mindspring.com) by avocet.prod.itd.earthlink.net with esmtp (Exim 3.33 #1) id 16NoPU-0002UW-00; Mon, 07 Jan 2002 21:02:53 -0800 Message-ID: <3C3A7D7B.AB4E0A92@mindspring.com> Date: Mon, 07 Jan 2002 21:02:51 -0800 From: Terry Lambert X-Mailer: Mozilla 4.7 [en]C-CCK-MCD {Sony} (Win98; U) X-Accept-Language: en MIME-Version: 1.0 To: Chris Faulhaber Cc: Patrick Gardella , Peter Wemm , scottl@FreeBSD.ORG, smp@FreeBSD.ORG Subject: Re: P5 vs. SMP, part 2 References: <20020107120621.GA23585@darkstar.doublethink.cx> <20020107235035.95C263808@overcee.netplex.com.au> <20020108000825.GA60374@peitho.fxp.org> <3C3A3EB0.548F0F59@mindspring.com> <20020107164853.A325@toyland.drapple.com> <20020108005545.GA2736@peitho.fxp.org> Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org Chris Faulhaber wrote: > > > > I wonder how many dual P5's are still being used :/ > > > There's at least you, Gunnar, Me, and (if he finds the parts), > > > Peter. > > I use a dual P5 (200) as my primary home development system. Besides > > the MB, its very easy to find parts for. > > I assume, as we move farther off topic, that you guys haven't > seen any significant slowdowns with your dual P5's with 4.x > after mid-June? I haven't loaded a -current that recently; it's not stable enough to do real work, unfortunately. I can load it, if I can get to Fry's for another disk to burn; I rather expect to see it be slower... -- Terry To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Tue Jan 8 0:35:30 2002 Delivered-To: freebsd-smp@freebsd.org Received: from mail6.speakeasy.net (mail6.speakeasy.net [216.254.0.206]) by hub.freebsd.org (Postfix) with ESMTP id 0C4E237B41D for ; Tue, 8 Jan 2002 00:35:18 -0800 (PST) Received: (qmail 19025 invoked from network); 8 Jan 2002 08:35:17 -0000 Received: from unknown (HELO laptop.baldwin.cx) ([64.81.54.73]) (envelope-sender ) by mail6.speakeasy.net (qmail-ldap-1.03) with SMTP for ; 8 Jan 2002 08:35:17 -0000 Message-ID: X-Mailer: XFMail 1.4.0 on FreeBSD X-Priority: 3 (Normal) Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 8bit MIME-Version: 1.0 In-Reply-To: <3C3A7D7B.AB4E0A92@mindspring.com> Date: Tue, 08 Jan 2002 00:34:46 -0800 (PST) From: John Baldwin To: Terry Lambert Subject: Re: P5 vs. SMP, part 2 Cc: smp@FreeBSD.ORG, scottl@FreeBSD.ORG, Peter Wemm , Patrick Gardella , Chris Faulhaber Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org On 08-Jan-02 Terry Lambert wrote: > Chris Faulhaber wrote: >> > > > I wonder how many dual P5's are still being used :/ >> > > There's at least you, Gunnar, Me, and (if he finds the parts), >> > > Peter. >> > I use a dual P5 (200) as my primary home development system. Besides >> > the MB, its very easy to find parts for. >> >> I assume, as we move farther off topic, that you guys haven't >> seen any significant slowdowns with your dual P5's with 4.x >> after mid-June? > > I haven't loaded a -current that recently; it's not stable enough > to do real work, unfortunately. > > I can load it, if I can get to Fry's for another disk to burn; > I rather expect to see it be slower... -stable, not -current. -- John Baldwin <>< http://www.FreeBSD.org/~jhb/ "Power Users Use the Power to Serve!" - http://www.FreeBSD.org/ To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Tue Jan 8 4:39:18 2002 Delivered-To: freebsd-smp@freebsd.org Received: from mail11.speakeasy.net (mail11.speakeasy.net [216.254.0.211]) by hub.freebsd.org (Postfix) with ESMTP id 2D08337B41A for ; Tue, 8 Jan 2002 04:39:05 -0800 (PST) Received: (qmail 1235 invoked from network); 8 Jan 2002 12:39:04 -0000 Received: from unknown (HELO server.baldwin.cx) ([64.81.54.73]) (envelope-sender ) by mail11.speakeasy.net (qmail-ldap-1.03) with DES-CBC3-SHA encrypted SMTP for ; 8 Jan 2002 12:39:04 -0000 Received: from laptop.baldwin.cx (root@laptop.baldwin.cx [192.168.0.4]) by server.baldwin.cx (8.11.6/8.11.6) with ESMTP id g08BCuK51591; Tue, 8 Jan 2002 03:12:56 -0800 (PST) (envelope-from john@laptop.baldwin.cx) Received: (from john@localhost) by laptop.baldwin.cx (8.11.6/8.11.6) id g08BCAX00673; Tue, 8 Jan 2002 03:12:10 -0800 (PST) (envelope-from john) Message-ID: X-Mailer: XFMail 1.4.0 on FreeBSD X-Priority: 3 (Normal) Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 8bit MIME-Version: 1.0 In-Reply-To: <3C3A7D7B.AB4E0A92@mindspring.com> Date: Tue, 08 Jan 2002 03:12:10 -0800 (PST) From: John Baldwin To: Terry Lambert Subject: Re: P5 vs. SMP, part 2 Cc: smp@FreeBSD.ORG, scottl@FreeBSD.ORG, Peter Wemm , Patrick Gardella , Chris Faulhaber Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org On 08-Jan-02 Terry Lambert wrote: > Chris Faulhaber wrote: >> > > > I wonder how many dual P5's are still being used :/ >> > > There's at least you, Gunnar, Me, and (if he finds the parts), >> > > Peter. >> > I use a dual P5 (200) as my primary home development system. Besides >> > the MB, its very easy to find parts for. >> >> I assume, as we move farther off topic, that you guys haven't >> seen any significant slowdowns with your dual P5's with 4.x >> after mid-June? > > I haven't loaded a -current that recently; it's not stable enough > to do real work, unfortunately. > > I can load it, if I can get to Fry's for another disk to burn; > I rather expect to see it be slower... -stable, not -current. -- John Baldwin <>< http://www.FreeBSD.org/~jhb/ "Power Users Use the Power to Serve!" - http://www.FreeBSD.org/ To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Tue Jan 8 17:45:50 2002 Delivered-To: freebsd-smp@freebsd.org Received: from wantadilla.lemis.com (wantadilla.lemis.com [192.109.197.80]) by hub.freebsd.org (Postfix) with ESMTP id 1623137B41A; Tue, 8 Jan 2002 17:45:38 -0800 (PST) Received: by wantadilla.lemis.com (Postfix, from userid 1004) id 348DC78306; Wed, 9 Jan 2002 12:15:37 +1030 (CST) Date: Wed, 9 Jan 2002 12:15:37 +1030 From: Greg Lehey To: "Andrew R. Reiter" Cc: freebsd-smp@FreeBSD.org Subject: Re: SMPng biweekly updates Message-ID: <20020109121537.C77497@wantadilla.lemis.com> References: Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.3.23i Organization: The FreeBSD Project Phone: +61-8-8388-8286 Fax: +61-8-8388-8725 Mobile: +61-418-838-708 WWW-Home-Page: http://www.FreeBSD.org/ X-PGP-Fingerprint: 6B 7B C3 8C 61 CD 54 AF 13 24 52 F8 6D A4 95 EF Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org On Friday, 4 January 2002 at 17:50:46 -0500, Andrew R. Reiter wrote: > > I propose a biweekly mini-email that goes out to -smp that is essentially > an outline of what's being done, what's being discussed, what needs to be > done, and any design changes/thoughts. I'd like to think of it as a cvs > log dump for the SMPng project for a two week period. Essentially someone > would track the changes to the repo (p4 and cvs) and conversations that > happen randomly (irc, private email, mailing lists) and generate this > outline. I believe then that this would be an easy transition into > generating a monthly status report that are accurate and are helpful to > those who are not following -smp. Also, if we had had these, it would be > an easy way for someone who worked on the project but went on vacation to > come back and easily understand what has occured (or atleast allow for > making it extremely easy to find out what's changed). > > I am volunteering to do this job... But, what Im interested in is seeing > if those out there listening are interested in having this done... I think this would be a good start. IMO It's not enough, though. It seems to me that the real issue is that we don't have an overall strategy for SMPng. We had the beginnings of one, but it changed, and currently what we're seeing is detail work rather than the implementation of an overall architecture. We need to discuss that, and IRC isn't the place. Bosko started something a couple of weeks ago, but it didn't get anything near enough response. If we want SMPng to be a success, we need to address that issue first. Greg -- See complete headers for address and phone numbers To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Wed Jan 9 18: 1:52 2002 Delivered-To: freebsd-smp@freebsd.org Received: from falcon.prod.itd.earthlink.net (falcon.mail.pas.earthlink.net [207.217.120.74]) by hub.freebsd.org (Postfix) with ESMTP id D3B8637B405 for ; Wed, 9 Jan 2002 18:01:50 -0800 (PST) Received: from pool0266.cvx40-bradley.dialup.earthlink.net ([216.244.43.11] helo=mindspring.com) by falcon.prod.itd.earthlink.net with esmtp (Exim 3.33 #1) id 16OUXO-0002Ql-00 for smp@freebsd.org; Wed, 09 Jan 2002 18:01:50 -0800 Message-ID: <3C3CF60B.CE5F3E6C@mindspring.com> Date: Wed, 09 Jan 2002 18:01:47 -0800 From: Terry Lambert X-Mailer: Mozilla 4.7 [en]C-CCK-MCD {Sony} (Win98; U) X-Accept-Language: en MIME-Version: 1.0 To: smp@freebsd.org Subject: Linux moves to per CPU run queues Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org As I have been suggesting for FreeBSD for some time, Linux has just moved to per CPU run queues to reduce scheduler contention and to improve affinity. http://www.uwsg.iu.edu/hypermail/linux/kernel/0201.0/0810.html -- Terry To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Wed Jan 9 20:37:52 2002 Delivered-To: freebsd-smp@freebsd.org Received: from troutmask.apl.washington.edu (troutmask.apl.washington.edu [128.208.78.105]) by hub.freebsd.org (Postfix) with ESMTP id 5C04037B416 for ; Wed, 9 Jan 2002 20:37:49 -0800 (PST) Received: (from sgk@localhost) by troutmask.apl.washington.edu (8.11.4/8.11.4) id g0A4bmn86899; Wed, 9 Jan 2002 20:37:48 -0800 (PST) (envelope-from sgk) Date: Wed, 9 Jan 2002 20:37:47 -0800 From: Steve Kargl To: Terry Lambert Cc: smp@FreeBSD.ORG Subject: Re: Linux moves to per CPU run queues Message-ID: <20020109203747.A86842@troutmask.apl.washington.edu> References: <3C3CF60B.CE5F3E6C@mindspring.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.2.5i In-Reply-To: <3C3CF60B.CE5F3E6C@mindspring.com>; from tlambert2@mindspring.com on Wed, Jan 09, 2002 at 06:01:47PM -0800 Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org On Wed, Jan 09, 2002 at 06:01:47PM -0800, Terry Lambert wrote: > As I have been suggesting for FreeBSD for some time, Linux has > just moved to per CPU run queues to reduce scheduler contention > and to improve affinity. > > http://www.uwsg.iu.edu/hypermail/linux/kernel/0201.0/0810.html > Where are your patches? -- Steve To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Wed Jan 9 21:56:18 2002 Delivered-To: freebsd-smp@freebsd.org Received: from mail.rpi.edu (mail.rpi.edu [128.113.22.40]) by hub.freebsd.org (Postfix) with ESMTP id CE65B37B416 for ; Wed, 9 Jan 2002 21:56:15 -0800 (PST) Received: from [128.113.24.47] (gilead.acs.rpi.edu [128.113.24.47]) by mail.rpi.edu (8.11.3/8.11.3) with ESMTP id g0A5uE349362; Thu, 10 Jan 2002 00:56:14 -0500 Mime-Version: 1.0 X-Sender: drosih@mail.rpi.edu Message-Id: In-Reply-To: <3C3CF60B.CE5F3E6C@mindspring.com> References: <3C3CF60B.CE5F3E6C@mindspring.com> Date: Thu, 10 Jan 2002 00:56:13 -0500 To: Terry Lambert , smp@FreeBSD.ORG From: Garance A Drosihn Subject: Re: Linux moves to per CPU run queues Content-Type: text/plain; charset="us-ascii" ; format="flowed" X-Scanned-By: MIMEDefang 2.1 Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org At 6:01 PM -0800 1/9/02, Terry Lambert wrote: >As I have been suggesting for FreeBSD for some time, Linux has >just moved to per CPU run queues to reduce scheduler contention >and to improve affinity. > >http://www.uwsg.iu.edu/hypermail/linux/kernel/0201.0/0810.html > >-- Terry Well, it's still in the testing stage, it's not like the switch has "gone production" yet. It does look very interesting, and it will be good to keep track of how well it performs as more people beat on it. There clearly seemed to be a lot of interest for this change in the above mailing list. There seem to be several "doubters" in the list, so I'm sure they'll come up with several different ways to benchmark the results. Always good to have a little competition in the world of ideas... -- Garance Alistair Drosehn = gad@eclipse.acs.rpi.edu Senior Systems Programmer or gad@freebsd.org Rensselaer Polytechnic Institute or drosih@rpi.edu To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Wed Jan 9 23:40:19 2002 Delivered-To: freebsd-smp@freebsd.org Received: from rwcrmhc51.attbi.com (rwcrmhc51.attbi.com [204.127.198.38]) by hub.freebsd.org (Postfix) with ESMTP id 8606D37B405 for ; Wed, 9 Jan 2002 23:40:09 -0800 (PST) Received: from InterJet.elischer.org ([12.232.206.8]) by rwcrmhc51.attbi.com (InterMail vM.4.01.03.27 201-229-121-127-20010626) with ESMTP id <20020110074009.DHMQ288.rwcrmhc51.attbi.com@InterJet.elischer.org>; Thu, 10 Jan 2002 07:40:09 +0000 Received: from localhost (localhost.elischer.org [127.0.0.1]) by InterJet.elischer.org (8.9.1a/8.9.1) with ESMTP id XAA56052; Wed, 9 Jan 2002 23:33:42 -0800 (PST) Date: Wed, 9 Jan 2002 23:33:40 -0800 (PST) From: Julian Elischer To: Garance A Drosihn Cc: Terry Lambert , smp@FreeBSD.ORG Subject: Re: Linux moves to per CPU run queues In-Reply-To: Message-ID: MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org I have doubts that it will make a big differnce on busy systems with real world applications. Maybe it may help a bit with machines with many many processors. On Thu, 10 Jan 2002, Garance A Drosihn wrote: > At 6:01 PM -0800 1/9/02, Terry Lambert wrote: > >As I have been suggesting for FreeBSD for some time, Linux has > >just moved to per CPU run queues to reduce scheduler contention > >and to improve affinity. > > > >http://www.uwsg.iu.edu/hypermail/linux/kernel/0201.0/0810.html > > > >-- Terry > > Well, it's still in the testing stage, it's not like the switch > has "gone production" yet. > > It does look very interesting, and it will be good to keep track > of how well it performs as more people beat on it. There clearly > seemed to be a lot of interest for this change in the above > mailing list. There seem to be several "doubters" in the list, > so I'm sure they'll come up with several different ways to > benchmark the results. > > Always good to have a little competition in the world of ideas... > > -- > Garance Alistair Drosehn = gad@eclipse.acs.rpi.edu > Senior Systems Programmer or gad@freebsd.org > Rensselaer Polytechnic Institute or drosih@rpi.edu > > To Unsubscribe: send mail to majordomo@FreeBSD.org > with "unsubscribe freebsd-smp" in the body of the message > To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Thu Jan 10 11: 9:37 2002 Delivered-To: freebsd-smp@freebsd.org Received: from pintail.mail.pas.earthlink.net (pintail.mail.pas.earthlink.net [207.217.120.122]) by hub.freebsd.org (Postfix) with ESMTP id 4076F37B400 for ; Thu, 10 Jan 2002 11:09:34 -0800 (PST) Received: from pool0030.cvx22-bradley.dialup.earthlink.net ([209.179.198.30] helo=mindspring.com) by pintail.mail.pas.earthlink.net with esmtp (Exim 3.33 #1) id 16OkZh-0004Eb-00; Thu, 10 Jan 2002 11:09:18 -0800 Message-ID: <3C3DE6DB.5210233E@mindspring.com> Date: Thu, 10 Jan 2002 11:09:15 -0800 From: Terry Lambert X-Mailer: Mozilla 4.7 [en]C-CCK-MCD {Sony} (Win98; U) X-Accept-Language: en MIME-Version: 1.0 To: Steve Kargl Cc: smp@FreeBSD.ORG Subject: Re: Linux moves to per CPU run queues References: <3C3CF60B.CE5F3E6C@mindspring.com> <20020109203747.A86842@troutmask.apl.washington.edu> Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org Steve Kargl wrote: > On Wed, Jan 09, 2002 at 06:01:47PM -0800, Terry Lambert wrote: > > As I have been suggesting for FreeBSD for some time, Linux has > > just moved to per CPU run queues to reduce scheduler contention > > and to improve affinity. > > > > http://www.uwsg.iu.edu/hypermail/linux/kernel/0201.0/0810.html > > Where are your patches? Why not commit Alfred's patches instead? I talked them over with him a number of times in the break room when we were both working at ClickArray, and they are very close (all you would need to do is remove the global run queue dependency he kept). -- Terry To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Thu Jan 10 11:11:43 2002 Delivered-To: freebsd-smp@freebsd.org Received: from pintail.mail.pas.earthlink.net (pintail.mail.pas.earthlink.net [207.217.120.122]) by hub.freebsd.org (Postfix) with ESMTP id 2FD2337B400 for ; Thu, 10 Jan 2002 11:11:40 -0800 (PST) Received: from pool0030.cvx22-bradley.dialup.earthlink.net ([209.179.198.30] helo=mindspring.com) by pintail.mail.pas.earthlink.net with esmtp (Exim 3.33 #1) id 16Okbx-0000O9-00; Thu, 10 Jan 2002 11:11:37 -0800 Message-ID: <3C3DE767.8A1EBD8B@mindspring.com> Date: Thu, 10 Jan 2002 11:11:35 -0800 From: Terry Lambert X-Mailer: Mozilla 4.7 [en]C-CCK-MCD {Sony} (Win98; U) X-Accept-Language: en MIME-Version: 1.0 To: Garance A Drosihn Cc: smp@FreeBSD.ORG Subject: Re: Linux moves to per CPU run queues References: <3C3CF60B.CE5F3E6C@mindspring.com> Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org Garance A Drosihn wrote: > At 6:01 PM -0800 1/9/02, Terry Lambert wrote: > >As I have been suggesting for FreeBSD for some time, Linux has > >just moved to per CPU run queues to reduce scheduler contention > >and to improve affinity. > > > >http://www.uwsg.iu.edu/hypermail/linux/kernel/0201.0/0810.html > > Well, it's still in the testing stage, it's not like the switch > has "gone production" yet. > > It does look very interesting, and it will be good to keep track > of how well it performs as more people beat on it. There clearly > seemed to be a lot of interest for this change in the above > mailing list. There seem to be several "doubters" in the list, > so I'm sure they'll come up with several different ways to > benchmark the results. > > Always good to have a little competition in the world of ideas... Or we could look at the benchmarks published about a similar approach in Dynix, back in 1991, on a 32 CPU system, and just decide that it's the right way to do things... -- Terry To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Thu Jan 10 11:13:12 2002 Delivered-To: freebsd-smp@freebsd.org Received: from pintail.mail.pas.earthlink.net (pintail.mail.pas.earthlink.net [207.217.120.122]) by hub.freebsd.org (Postfix) with ESMTP id 7B9A337B416 for ; Thu, 10 Jan 2002 11:13:08 -0800 (PST) Received: from pool0030.cvx22-bradley.dialup.earthlink.net ([209.179.198.30] helo=mindspring.com) by pintail.mail.pas.earthlink.net with esmtp (Exim 3.33 #1) id 16OkdM-0002f0-00; Thu, 10 Jan 2002 11:13:05 -0800 Message-ID: <3C3DE7BE.D266C09F@mindspring.com> Date: Thu, 10 Jan 2002 11:13:02 -0800 From: Terry Lambert X-Mailer: Mozilla 4.7 [en]C-CCK-MCD {Sony} (Win98; U) X-Accept-Language: en MIME-Version: 1.0 To: Julian Elischer Cc: Garance A Drosihn , smp@FreeBSD.ORG Subject: Re: Linux moves to per CPU run queues References: Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org Julian Elischer wrote: > I have doubts that it will make a big differnce on busy systems with real > world applications. Maybe it may help a bit with machines with many many > processors. The problem with Intel geeks is that their definitions go: "one, two, three, four, many many". 8-) 8-) -- Terry To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Thu Jan 10 11:23:29 2002 Delivered-To: freebsd-smp@freebsd.org Received: from elvis.mu.org (elvis.mu.org [192.203.228.196]) by hub.freebsd.org (Postfix) with ESMTP id D01B037B41D for ; Thu, 10 Jan 2002 11:23:23 -0800 (PST) Received: by elvis.mu.org (Postfix, from userid 1192) id B491010DDF7; Thu, 10 Jan 2002 11:23:23 -0800 (PST) Date: Thu, 10 Jan 2002 11:23:23 -0800 From: Alfred Perlstein To: Terry Lambert Cc: Steve Kargl , smp@FreeBSD.ORG Subject: Re: Linux moves to per CPU run queues Message-ID: <20020110112323.F7984@elvis.mu.org> References: <3C3CF60B.CE5F3E6C@mindspring.com> <20020109203747.A86842@troutmask.apl.washington.edu> <3C3DE6DB.5210233E@mindspring.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.2.5i In-Reply-To: <3C3DE6DB.5210233E@mindspring.com>; from tlambert2@mindspring.com on Thu, Jan 10, 2002 at 11:09:15AM -0800 Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org * Terry Lambert [020110 11:09] wrote: > Steve Kargl wrote: > > On Wed, Jan 09, 2002 at 06:01:47PM -0800, Terry Lambert wrote: > > > As I have been suggesting for FreeBSD for some time, Linux has > > > just moved to per CPU run queues to reduce scheduler contention > > > and to improve affinity. > > > > > > http://www.uwsg.iu.edu/hypermail/linux/kernel/0201.0/0810.html > > > > Where are your patches? > > Why not commit Alfred's patches instead? I talked them over > with him a number of times in the break room when we were > both working at ClickArray, and they are very close (all you > would need to do is remove the global run queue dependency he > kept). My patches are leet, but no one would give them the time of day. -- -Alfred Perlstein [alfred@freebsd.org] 'Instead of asking why a piece of software is using "1970s technology," start asking why software is ignoring 30 years of accumulated wisdom.' Tax deductable donations for FreeBSD: http://www.freebsdfoundation.org/ To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Thu Jan 10 11:26:26 2002 Delivered-To: freebsd-smp@freebsd.org Received: from fledge.watson.org (fledge.watson.org [204.156.12.50]) by hub.freebsd.org (Postfix) with ESMTP id 1F56737B41E for ; Thu, 10 Jan 2002 11:26:22 -0800 (PST) Received: from localhost (arr@localhost) by fledge.watson.org (8.11.6/8.11.5) with SMTP id g0AJQDn65299; Thu, 10 Jan 2002 14:26:13 -0500 (EST) (envelope-from arr@FreeBSD.org) X-Authentication-Warning: fledge.watson.org: arr owned process doing -bs Date: Thu, 10 Jan 2002 14:26:12 -0500 (EST) From: "Andrew R. Reiter" X-Sender: arr@fledge.watson.org To: Alfred Perlstein Cc: Terry Lambert , Steve Kargl , smp@FreeBSD.org Subject: Re: Linux moves to per CPU run queues In-Reply-To: <20020110112323.F7984@elvis.mu.org> Message-ID: MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org On Thu, 10 Jan 2002, Alfred Perlstein wrote: :My patches are leet, but no one would give them the time of day. What about putting them in a p4 tree? -- Andrew R. Reiter arr@watson.org arr@FreeBSD.org To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Thu Jan 10 11:28:32 2002 Delivered-To: freebsd-smp@freebsd.org Received: from elvis.mu.org (elvis.mu.org [192.203.228.196]) by hub.freebsd.org (Postfix) with ESMTP id E3D7537B425; Thu, 10 Jan 2002 11:28:19 -0800 (PST) Received: by elvis.mu.org (Postfix, from userid 1192) id C569E10DDF8; Thu, 10 Jan 2002 11:28:19 -0800 (PST) Date: Thu, 10 Jan 2002 11:28:19 -0800 From: Alfred Perlstein To: "Andrew R. Reiter" Cc: Terry Lambert , Steve Kargl , smp@FreeBSD.org Subject: Re: Linux moves to per CPU run queues Message-ID: <20020110112819.G7984@elvis.mu.org> References: <20020110112323.F7984@elvis.mu.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.2.5i In-Reply-To: ; from arr@FreeBSD.org on Thu, Jan 10, 2002 at 02:26:12PM -0500 Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org * Andrew R. Reiter [020110 11:26] wrote: > On Thu, 10 Jan 2002, Alfred Perlstein wrote: > > :My patches are leet, but no one would give them the time of day. > > What about putting them in a p4 tree? If someone did a detailed HOWTO i might consider it, but I don't have the time to learn another SCM tool right now. -- -Alfred Perlstein [alfred@freebsd.org] 'Instead of asking why a piece of software is using "1970s technology," start asking why software is ignoring 30 years of accumulated wisdom.' Tax deductable donations for FreeBSD: http://www.freebsdfoundation.org/ To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Thu Jan 10 11:33: 9 2002 Delivered-To: freebsd-smp@freebsd.org Received: from fledge.watson.org (fledge.watson.org [204.156.12.50]) by hub.freebsd.org (Postfix) with ESMTP id 8697437B404 for ; Thu, 10 Jan 2002 11:33:04 -0800 (PST) Received: from localhost (arr@localhost) by fledge.watson.org (8.11.6/8.11.5) with SMTP id g0AJWuL65505; Thu, 10 Jan 2002 14:32:56 -0500 (EST) (envelope-from arr@FreeBSD.org) X-Authentication-Warning: fledge.watson.org: arr owned process doing -bs Date: Thu, 10 Jan 2002 14:32:55 -0500 (EST) From: "Andrew R. Reiter" X-Sender: arr@fledge.watson.org To: Alfred Perlstein Cc: Terry Lambert , Steve Kargl , smp@FreeBSD.org Subject: Re: Linux moves to per CPU run queues In-Reply-To: <20020110112819.G7984@elvis.mu.org> Message-ID: MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org On Thu, 10 Jan 2002, Alfred Perlstein wrote: :* Andrew R. Reiter [020110 11:26] wrote: :> On Thu, 10 Jan 2002, Alfred Perlstein wrote: :> :> :My patches are leet, but no one would give them the time of day. :> :> What about putting them in a p4 tree? : :If someone did a detailed HOWTO i might consider it, but I don't :have the time to learn another SCM tool right now. http://people.freebsd.org/~peter/p4cookbook.{html,txt} + IRC seems to be the trick. -- Andrew R. Reiter arr@watson.org arr@FreeBSD.org To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Thu Jan 10 12:47:36 2002 Delivered-To: freebsd-smp@freebsd.org Received: from mail12.speakeasy.net (mail12.speakeasy.net [216.254.0.212]) by hub.freebsd.org (Postfix) with ESMTP id C42ED37B402 for ; Thu, 10 Jan 2002 12:47:32 -0800 (PST) Received: (qmail 30002 invoked from network); 10 Jan 2002 20:47:31 -0000 Received: from unknown (HELO laptop.baldwin.cx) ([64.81.54.73]) (envelope-sender ) by mail12.speakeasy.net (qmail-ldap-1.03) with SMTP for ; 10 Jan 2002 20:47:31 -0000 Message-ID: X-Mailer: XFMail 1.4.0 on FreeBSD X-Priority: 3 (Normal) Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 8bit MIME-Version: 1.0 In-Reply-To: <3C3DE7BE.D266C09F@mindspring.com> Date: Thu, 10 Jan 2002 12:46:53 -0800 (PST) From: John Baldwin To: Terry Lambert Subject: Re: Linux moves to per CPU run queues Cc: smp@FreeBSD.ORG, Garance A Drosihn , Julian Elischer Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org On 10-Jan-02 Terry Lambert wrote: > Julian Elischer wrote: >> I have doubts that it will make a big differnce on busy systems with real >> world applications. Maybe it may help a bit with machines with many many >> processors. > > The problem with Intel geeks is that their definitions go: > > "one, two, three, four, many many". "hrair" CPUs. :) Seriously, first we need to let KSE settle in its changes to the system before we do this or something like it. KSE can be made to do this w/o too much trouble. -- John Baldwin <>< http://www.FreeBSD.org/~jhb/ "Power Users Use the Power to Serve!" - http://www.FreeBSD.org/ To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Thu Jan 10 15:14:42 2002 Delivered-To: freebsd-smp@freebsd.org Received: from wantadilla.lemis.com (wantadilla.lemis.com [192.109.197.80]) by hub.freebsd.org (Postfix) with ESMTP id A9B3837BD03 for ; Thu, 10 Jan 2002 15:14:14 -0800 (PST) Received: by wantadilla.lemis.com (Postfix, from userid 1004) id 7529F782FC; Fri, 11 Jan 2002 09:44:12 +1030 (CST) Date: Fri, 11 Jan 2002 09:44:12 +1030 From: Greg Lehey To: Terry Lambert Cc: Garance A Drosihn , smp@FreeBSD.ORG Subject: Re: Linux moves to per CPU run queues Message-ID: <20020111094412.B42285@wantadilla.lemis.com> References: <3C3CF60B.CE5F3E6C@mindspring.com> <3C3DE767.8A1EBD8B@mindspring.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <3C3DE767.8A1EBD8B@mindspring.com> User-Agent: Mutt/1.3.23i Organization: The FreeBSD Project Phone: +61-8-8388-8286 Fax: +61-8-8388-8725 Mobile: +61-418-838-708 WWW-Home-Page: http://www.FreeBSD.org/ X-PGP-Fingerprint: 6B 7B C3 8C 61 CD 54 AF 13 24 52 F8 6D A4 95 EF Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org On Thursday, 10 January 2002 at 11:11:35 -0800, Terry Lambert wrote: > Garance A Drosihn wrote: >> At 6:01 PM -0800 1/9/02, Terry Lambert wrote: >>> As I have been suggesting for FreeBSD for some time, Linux has >>> just moved to per CPU run queues to reduce scheduler contention >>> and to improve affinity. >>> >>> http://www.uwsg.iu.edu/hypermail/linux/kernel/0201.0/0810.html >> >> Well, it's still in the testing stage, it's not like the switch >> has "gone production" yet. >> >> It does look very interesting, and it will be good to keep track >> of how well it performs as more people beat on it. There clearly >> seemed to be a lot of interest for this change in the above >> mailing list. There seem to be several "doubters" in the list, >> so I'm sure they'll come up with several different ways to >> benchmark the results. >> >> Always good to have a little competition in the world of ideas... > > Or we could look at the benchmarks published about a similar > approach in Dynix, back in 1991, on a 32 CPU system, and just > decide that it's the right way to do things... Sure, because the rest of Dynix worked the same way, and the hardware was the same. It's got to be the right way! Greg -- See complete headers for address and phone numbers To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Thu Jan 10 15:15:13 2002 Delivered-To: freebsd-smp@freebsd.org Received: from wantadilla.lemis.com (wantadilla.lemis.com [192.109.197.80]) by hub.freebsd.org (Postfix) with ESMTP id 8E32A37BD2E for ; Thu, 10 Jan 2002 15:14:53 -0800 (PST) Received: by wantadilla.lemis.com (Postfix, from userid 1004) id DC3C478307; Fri, 11 Jan 2002 09:44:51 +1030 (CST) Date: Fri, 11 Jan 2002 09:44:51 +1030 From: Greg Lehey To: Alfred Perlstein Cc: Terry Lambert , Steve Kargl , smp@FreeBSD.ORG Subject: Re: Linux moves to per CPU run queues Message-ID: <20020111094451.C42285@wantadilla.lemis.com> References: <3C3CF60B.CE5F3E6C@mindspring.com> <20020109203747.A86842@troutmask.apl.washington.edu> <3C3DE6DB.5210233E@mindspring.com> <20020110112323.F7984@elvis.mu.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20020110112323.F7984@elvis.mu.org> User-Agent: Mutt/1.3.23i Organization: The FreeBSD Project Phone: +61-8-8388-8286 Fax: +61-8-8388-8725 Mobile: +61-418-838-708 WWW-Home-Page: http://www.FreeBSD.org/ X-PGP-Fingerprint: 6B 7B C3 8C 61 CD 54 AF 13 24 52 F8 6D A4 95 EF Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org On Thursday, 10 January 2002 at 11:23:23 -0800, Alfred Perlstein wrote: > * Terry Lambert [020110 11:09] wrote: >> Steve Kargl wrote: >>> On Wed, Jan 09, 2002 at 06:01:47PM -0800, Terry Lambert wrote: >>>> As I have been suggesting for FreeBSD for some time, Linux has >>>> just moved to per CPU run queues to reduce scheduler contention >>>> and to improve affinity. >>>> >>>> http://www.uwsg.iu.edu/hypermail/linux/kernel/0201.0/0810.html >>> >>> Where are your patches? >> >> Why not commit Alfred's patches instead? I talked them over >> with him a number of times in the break room when we were >> both working at ClickArray, and they are very close (all you >> would need to do is remove the global run queue dependency he >> kept). > > My patches are leet, but no one would give them the time of day. Do you have performance measurements? Greg -- See complete headers for address and phone numbers To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Thu Jan 10 15:17:17 2002 Delivered-To: freebsd-smp@freebsd.org Received: from elvis.mu.org (elvis.mu.org [192.203.228.196]) by hub.freebsd.org (Postfix) with ESMTP id 12D3837B47E; Thu, 10 Jan 2002 15:17:02 -0800 (PST) Received: by elvis.mu.org (Postfix, from userid 1192) id E243310DDFA; Thu, 10 Jan 2002 15:17:01 -0800 (PST) Date: Thu, 10 Jan 2002 15:17:01 -0800 From: Alfred Perlstein To: Greg Lehey Cc: Terry Lambert , Steve Kargl , smp@FreeBSD.ORG Subject: Re: Linux moves to per CPU run queues Message-ID: <20020110151701.Q7984@elvis.mu.org> References: <3C3CF60B.CE5F3E6C@mindspring.com> <20020109203747.A86842@troutmask.apl.washington.edu> <3C3DE6DB.5210233E@mindspring.com> <20020110112323.F7984@elvis.mu.org> <20020111094451.C42285@wantadilla.lemis.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.2.5i In-Reply-To: <20020111094451.C42285@wantadilla.lemis.com>; from grog@FreeBSD.org on Fri, Jan 11, 2002 at 09:44:51AM +1030 Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org * Greg Lehey [020110 15:14] wrote: > On Thursday, 10 January 2002 at 11:23:23 -0800, Alfred Perlstein wrote: > > * Terry Lambert [020110 11:09] wrote: > >> Steve Kargl wrote: > >>> On Wed, Jan 09, 2002 at 06:01:47PM -0800, Terry Lambert wrote: > >>>> As I have been suggesting for FreeBSD for some time, Linux has > >>>> just moved to per CPU run queues to reduce scheduler contention > >>>> and to improve affinity. > >>>> > >>>> http://www.uwsg.iu.edu/hypermail/linux/kernel/0201.0/0810.html > >>> > >>> Where are your patches? > >> > >> Why not commit Alfred's patches instead? I talked them over > >> with him a number of times in the break room when we were > >> both working at ClickArray, and they are very close (all you > >> would need to do is remove the global run queue dependency he > >> kept). > > > > My patches are leet, but no one would give them the time of day. > > Do you have performance measurements? I did several months ago, they were small, but there was a difference. -- -Alfred Perlstein [alfred@freebsd.org] 'Instead of asking why a piece of software is using "1970s technology," start asking why software is ignoring 30 years of accumulated wisdom.' Tax deductable donations for FreeBSD: http://www.freebsdfoundation.org/ To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Thu Jan 10 15:42:37 2002 Delivered-To: freebsd-smp@freebsd.org Received: from falcon.prod.itd.earthlink.net (falcon.mail.pas.earthlink.net [207.217.120.74]) by hub.freebsd.org (Postfix) with ESMTP id BB0AB37B400; Thu, 10 Jan 2002 15:42:31 -0800 (PST) Received: from pool0272.cvx22-bradley.dialup.earthlink.net ([209.179.199.17] helo=mindspring.com) by falcon.prod.itd.earthlink.net with esmtp (Exim 3.33 #1) id 16Ooq6-0005NI-00; Thu, 10 Jan 2002 15:42:31 -0800 Message-ID: <3C3E26E3.1E4BDAAE@mindspring.com> Date: Thu, 10 Jan 2002 15:42:27 -0800 From: Terry Lambert X-Mailer: Mozilla 4.7 [en]C-CCK-MCD {Sony} (Win98; U) X-Accept-Language: en MIME-Version: 1.0 To: Greg Lehey Cc: Garance A Drosihn , smp@FreeBSD.ORG Subject: Re: Linux moves to per CPU run queues References: <3C3CF60B.CE5F3E6C@mindspring.com> <3C3DE767.8A1EBD8B@mindspring.com> <20020111094412.B42285@wantadilla.lemis.com> Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org Greg Lehey wrote: > > Or we could look at the benchmarks published about a similar > > approach in Dynix, back in 1991, on a 32 CPU system, and just > > decide that it's the right way to do things... > > Sure, because the rest of Dynix worked the same way, and the hardware > was the same. It's got to be the right way! I wish he had posted to the list, it would be more than just hear-say from me... Sam Leffler informs me that IRIX also uses per CPU queues. -- Terry To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Fri Jan 11 3: 8:45 2002 Delivered-To: freebsd-smp@freebsd.org Received: from mail009.syd.optusnet.com.au (mail009.syd.optusnet.com.au [203.2.75.170]) by hub.freebsd.org (Postfix) with ESMTP id 1332137B416 for ; Fri, 11 Jan 2002 03:08:42 -0800 (PST) Received: from bigpond.com (ocmax1-106.dialup.optusnet.com.au [198.142.33.106]) by mail009.syd.optusnet.com.au (8.11.1/8.11.1) with ESMTP id g0BB8eD18323 for ; Fri, 11 Jan 2002 22:08:40 +1100 Message-ID: <3C3EC791.8030609@bigpond.com> Date: Fri, 11 Jan 2002 22:08:01 +1100 From: Nero User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; en-US; rv:0.9.7) Gecko/20011222 X-Accept-Language: en-us MIME-Version: 1.0 To: freebsd-smp@freebsd.org Subject: Status Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org Why are there never any status reports anymore? A lot of people in the community would like to know what's going on without being a developer. The last status update on http://www.freebsd.org/smp/ was in March of 2001! Please, status reports are good :-) To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Fri Jan 11 3:31:32 2002 Delivered-To: freebsd-smp@freebsd.org Received: from mail11.speakeasy.net (mail11.speakeasy.net [216.254.0.211]) by hub.freebsd.org (Postfix) with ESMTP id BD0C337B416 for ; Fri, 11 Jan 2002 03:31:29 -0800 (PST) Received: (qmail 16356 invoked from network); 11 Jan 2002 11:31:29 -0000 Received: from unknown (HELO laptop.baldwin.cx) ([64.81.54.73]) (envelope-sender ) by mail11.speakeasy.net (qmail-ldap-1.03) with SMTP for ; 11 Jan 2002 11:31:29 -0000 Message-ID: X-Mailer: XFMail 1.4.0 on FreeBSD X-Priority: 3 (Normal) Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 8bit MIME-Version: 1.0 In-Reply-To: <3C3EC791.8030609@bigpond.com> Date: Fri, 11 Jan 2002 03:30:54 -0800 (PST) From: John Baldwin To: Nero Subject: RE: Status Cc: freebsd-smp@freebsd.org Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org On 11-Jan-02 Nero wrote: > Why are there never any status reports anymore? A lot > of people in the community would like to know what's going > on without being a developer. The last status update on > http://www.freebsd.org/smp/ was in March of 2001! > > Please, status reports are good :-) Because we are rather underresourced. Andrew Reiter has volunteered to start working on this however. -- John Baldwin <>< http://www.FreeBSD.org/~jhb/ "Power Users Use the Power to Serve!" - http://www.FreeBSD.org/ To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Fri Jan 11 4:39:42 2002 Delivered-To: freebsd-smp@freebsd.org Received: from rwcrmhc52.attbi.com (rwcrmhc52.attbi.com [216.148.227.88]) by hub.freebsd.org (Postfix) with ESMTP id C513537B41B; Fri, 11 Jan 2002 04:39:34 -0800 (PST) Received: from peter3.wemm.org ([12.232.27.13]) by rwcrmhc52.attbi.com (InterMail vM.4.01.03.27 201-229-121-127-20010626) with ESMTP id <20020111123929.YGRC3578.rwcrmhc52.attbi.com@peter3.wemm.org>; Fri, 11 Jan 2002 12:39:29 +0000 Received: from overcee.netplex.com.au (overcee.wemm.org [10.0.0.3]) by peter3.wemm.org (8.11.0/8.11.0) with ESMTP id g0BCdTs66060; Fri, 11 Jan 2002 04:39:29 -0800 (PST) (envelope-from peter@wemm.org) Received: from wemm.org (localhost [127.0.0.1]) by overcee.netplex.com.au (Postfix) with ESMTP id 2536138FD; Fri, 11 Jan 2002 04:39:29 -0800 (PST) (envelope-from peter@wemm.org) X-Mailer: exmh version 2.5 07/13/2001 with nmh-1.0.4 To: Chris Faulhaber Cc: scottl@FreeBSD.org, smp@FreeBSD.org Subject: Re: P5 vs. SMP, part 2 In-Reply-To: <20020108000825.GA60374@peitho.fxp.org> Date: Fri, 11 Jan 2002 04:39:29 -0800 From: Peter Wemm Message-Id: <20020111123929.2536138FD@overcee.netplex.com.au> Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org Chris Faulhaber wrote: > On Mon, Jan 07, 2002 at 03:50:35PM -0800, Peter Wemm wrote: > > Chris Faulhaber wrote: > > > I finally got around to narrowing down the commit (see > > > below) that slowed by dual P5 box. From my original > > > message to -smp: > >=20 > > !!!!. > >=20 > > I just reread the diff and I dont see anything obviously wrong. Do you j= > ust > > see this in P5 machines? (ie: do you have a P6 smp box as well?) > >=20 > > I have been in contact with a few other people that are also > having problems with their P5's. Gunnar Pruessner reported > a similiar problem at: > http://www.freebsd.org/cgi/getmsg.cgi?fetch=3D5782+15738+/usr/local/www/db/= > text/2001/freebsd-smp/20011007.freebsd-smp > > We have not had any problems on the dual and quad PIII's at > work and I have not seen anyone using P6's report anything > similiar. After some extended trauma (blew up a hard drive), I got my box working. Wow! the slowdown is spectacular. It is running 4.4-RELEASE right now and it is immediately obvious just while booting that it is broken. After it's up, running top takes between 4 and 8 seconds to start up. It's nearly instant in UP mode. If I ktrace it, top takes 26 seconds to start up. Most of the time seems to be spent doing lseek/read of either /dev/mem or /dev/kmem. I'm going to go through this in detail tomorrow after some sleep. At 4:30am I can't think straight. :-] Cheers, -Peter -- Peter Wemm - peter@FreeBSD.org; peter@yahoo-inc.com; peter@netplex.com.au "All of this is for nothing if we don't go to the stars" - JMS/B5 To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Fri Jan 11 8: 9:11 2002 Delivered-To: freebsd-smp@freebsd.org Received: from fledge.watson.org (fledge.watson.org [204.156.12.50]) by hub.freebsd.org (Postfix) with ESMTP id A04A837B405 for ; Fri, 11 Jan 2002 08:08:58 -0800 (PST) Received: from localhost (arr@localhost) by fledge.watson.org (8.11.6/8.11.5) with SMTP id g0BG8mH80305; Fri, 11 Jan 2002 11:08:49 -0500 (EST) (envelope-from arr@FreeBSD.org) X-Authentication-Warning: fledge.watson.org: arr owned process doing -bs Date: Fri, 11 Jan 2002 11:08:47 -0500 (EST) From: "Andrew R. Reiter" X-Sender: arr@fledge.watson.org To: Nero Cc: freebsd-smp@FreeBSD.org Subject: Re: Status In-Reply-To: <3C3EC791.8030609@bigpond.com> Message-ID: MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org This was just discussed... Im putting one together for "this weekend" (anytime from now til monday AM). Cheers, Andrew On Fri, 11 Jan 2002, Nero wrote: :Why are there never any status reports anymore? A lot :of people in the community would like to know what's going :on without being a developer. The last status update on :http://www.freebsd.org/smp/ was in March of 2001! : :Please, status reports are good :-) : : :To Unsubscribe: send mail to majordomo@FreeBSD.org :with "unsubscribe freebsd-smp" in the body of the message : -- Andrew R. Reiter arr@watson.org arr@FreeBSD.org To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Fri Jan 11 12:19:21 2002 Delivered-To: freebsd-smp@freebsd.org Received: from storm.FreeBSD.org.uk (storm.FreeBSD.org.uk [194.242.139.170]) by hub.freebsd.org (Postfix) with ESMTP id E385B37B400; Fri, 11 Jan 2002 12:19:16 -0800 (PST) Received: (from uucp@localhost) by storm.FreeBSD.org.uk (8.11.6/8.11.6) with UUCP id g0BKIxp57535; Fri, 11 Jan 2002 20:18:59 GMT (envelope-from mark@grondar.za) Received: from grondar.za (mark@localhost [127.0.0.1]) by grimreaper.grondar.org (8.11.6/8.11.6) with ESMTP id g0BKFE103071; Fri, 11 Jan 2002 20:15:14 GMT (envelope-from mark@grondar.za) Message-Id: <200201112015.g0BKFE103071@grimreaper.grondar.org> To: Chris Faulhaber Cc: Peter Wemm , scottl@FreeBSD.ORG, smp@FreeBSD.ORG Subject: Re: P5 vs. SMP, part 2 References: <20020108000825.GA60374@peitho.fxp.org> In-Reply-To: <20020108000825.GA60374@peitho.fxp.org> ; from Chris Faulhaber "Mon, 07 Jan 2002 19:08:25 EST." Date: Fri, 11 Jan 2002 20:15:14 +0000 From: Mark Murray Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org > I wonder how many dual P5's are still being used :/ I have one (2xP5 @200MHz); I use it only in desktop mode, and it launches X and Mozilla-CURRENT very slowly. I'm running CURRENT. My dual PPro box is _fast_. M -- o Mark Murray \_ FreeBSD Services Limited O.\_ Warning: this .sig is umop ap!sdn To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Fri Jan 11 19:49:10 2002 Delivered-To: freebsd-smp@freebsd.org Received: from rwcrmhc52.attbi.com (rwcrmhc52.attbi.com [216.148.227.88]) by hub.freebsd.org (Postfix) with ESMTP id 0B1DC37B41A; Fri, 11 Jan 2002 19:49:07 -0800 (PST) Received: from peter3.wemm.org ([12.232.27.13]) by rwcrmhc52.attbi.com (InterMail vM.4.01.03.27 201-229-121-127-20010626) with ESMTP id <20020112034904.XFBX3578.rwcrmhc52.attbi.com@peter3.wemm.org>; Sat, 12 Jan 2002 03:49:04 +0000 Received: from overcee.netplex.com.au (overcee.wemm.org [10.0.0.3]) by peter3.wemm.org (8.11.0/8.11.0) with ESMTP id g0C3n4s68760; Fri, 11 Jan 2002 19:49:04 -0800 (PST) (envelope-from peter@wemm.org) Received: from wemm.org (localhost [127.0.0.1]) by overcee.netplex.com.au (Postfix) with ESMTP id 7784A38FD; Fri, 11 Jan 2002 19:49:04 -0800 (PST) (envelope-from peter@wemm.org) X-Mailer: exmh version 2.5 07/13/2001 with nmh-1.0.4 To: Mark Murray Cc: Chris Faulhaber , scottl@FreeBSD.ORG, smp@FreeBSD.ORG Subject: Re: P5 vs. SMP, part 2 In-Reply-To: <200201112015.g0BKFE103071@grimreaper.grondar.org> Date: Fri, 11 Jan 2002 19:49:04 -0800 From: Peter Wemm Message-Id: <20020112034904.7784A38FD@overcee.netplex.com.au> Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org Mark Murray wrote: > > I wonder how many dual P5's are still being used :/ > > I have one (2xP5 @200MHz); I use it only in desktop mode, and it > launches X and Mozilla-CURRENT very slowly. I'm running CURRENT. The good news is that I found part of the problem. Fix: Index: machdep.c =================================================================== RCS file: /home/ncvs/src/sys/i386/i386/machdep.c,v retrieving revision 1.385.2.21 diff -u -1 -2 -r1.385.2.21 machdep.c --- machdep.c 2001/12/13 19:18:00 1.385.2.21 +++ machdep.c 2002/01/12 03:35:12 @@ -1093,24 +1093,25 @@ void cpu_setregs(void) { unsigned int cr0; cr0 = rcr0(); cr0 |= CR0_NE; /* Done by npxinit() */ cr0 |= CR0_MP | CR0_TS; /* Done at every execve() too. */ #ifdef I386_CPU if (cpu_class != CPUCLASS_386) #endif cr0 |= CR0_WP | CR0_AM; + cr0 &= ~(CR0_CD | CR0_NW); load_cr0(cr0); load_gs(_udatasel); } static int sysctl_machdep_adjkerntz(SYSCTL_HANDLER_ARGS) { int error; error = sysctl_handle_int(oidp, oidp->oid_arg1, oidp->oid_arg2, req); if (!error && req->newptr) resettodr(); The problem is that the AP cpus were running with the CR0_CD (cache disable) and CR0_NW (cache writethrough, not writeback). This is very bad. :-] PPro and above bioses seem to cause the AP cpus enter the kernel with cache enabled, so that this looks like it should be a p5/i586 problem only. Cheers, -Peter -- Peter Wemm - peter@FreeBSD.org; peter@yahoo-inc.com; peter@netplex.com.au "All of this is for nothing if we don't go to the stars" - JMS/B5 To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Fri Jan 11 20:16:21 2002 Delivered-To: freebsd-smp@freebsd.org Received: from peitho.fxp.org (peitho.fxp.org [209.26.95.40]) by hub.freebsd.org (Postfix) with ESMTP id 70B4037B41B; Fri, 11 Jan 2002 20:16:08 -0800 (PST) Received: by peitho.fxp.org (Postfix, from userid 1000) id AD92313668; Fri, 11 Jan 2002 23:16:07 -0500 (EST) Date: Fri, 11 Jan 2002 23:16:07 -0500 From: Chris Faulhaber To: Peter Wemm Cc: scottl@FreeBSD.ORG, smp@FreeBSD.ORG Subject: Re: P5 vs. SMP, part 2 Message-ID: <20020112041607.GA44767@peitho.fxp.org> References: <200201112015.g0BKFE103071@grimreaper.grondar.org> <20020112034904.7784A38FD@overcee.netplex.com.au> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="J/dobhs11T7y2rNN" Content-Disposition: inline In-Reply-To: <20020112034904.7784A38FD@overcee.netplex.com.au> User-Agent: Mutt/1.3.24i Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org --J/dobhs11T7y2rNN Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Fri, Jan 11, 2002 at 07:49:04PM -0800, Peter Wemm wrote: > Mark Murray wrote: > > > I wonder how many dual P5's are still being used :/ > >=20 > > I have one (2xP5 @200MHz); I use it only in desktop mode, and it > > launches X and Mozilla-CURRENT very slowly. I'm running CURRENT. >=20 > The good news is that I found part of the problem. Fix: >=20 Yep, that seem to fix it. Good catch! --=20 Chris D. Faulhaber - jedgar@fxp.org - jedgar@FreeBSD.org -------------------------------------------------------- FreeBSD: The Power To Serve - http://www.FreeBSD.org --J/dobhs11T7y2rNN Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.0.6 (FreeBSD) Comment: FreeBSD: The Power To Serve iEYEARECAAYFAjw/uIcACgkQObaG4P6BelB6OQCfRa9uBE+6cIA9IWcneNFnuvAK W3QAni9m2dfvdymY/RoOGC6RTdnTbQ1Q =8nvp -----END PGP SIGNATURE----- --J/dobhs11T7y2rNN-- To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Fri Jan 11 21:10:16 2002 Delivered-To: freebsd-smp@freebsd.org Received: from rwcrmhc52.attbi.com (rwcrmhc52.attbi.com [216.148.227.88]) by hub.freebsd.org (Postfix) with ESMTP id 8541F37B404; Fri, 11 Jan 2002 21:10:11 -0800 (PST) Received: from peter3.wemm.org ([12.232.27.13]) by rwcrmhc52.attbi.com (InterMail vM.4.01.03.27 201-229-121-127-20010626) with ESMTP id <20020112051011.ZBAY3578.rwcrmhc52.attbi.com@peter3.wemm.org>; Sat, 12 Jan 2002 05:10:11 +0000 Received: from overcee.netplex.com.au (overcee.wemm.org [10.0.0.3]) by peter3.wemm.org (8.11.0/8.11.0) with ESMTP id g0C5AAs68983; Fri, 11 Jan 2002 21:10:10 -0800 (PST) (envelope-from peter@wemm.org) Received: from wemm.org (localhost [127.0.0.1]) by overcee.netplex.com.au (Postfix) with ESMTP id A359138FD; Fri, 11 Jan 2002 21:10:10 -0800 (PST) (envelope-from peter@wemm.org) X-Mailer: exmh version 2.5 07/13/2001 with nmh-1.0.4 To: Chris Faulhaber Cc: scottl@FreeBSD.ORG, smp@FreeBSD.ORG Subject: Re: P5 vs. SMP, part 2 In-Reply-To: <20020112041607.GA44767@peitho.fxp.org> Date: Fri, 11 Jan 2002 21:10:10 -0800 From: Peter Wemm Message-Id: <20020112051010.A359138FD@overcee.netplex.com.au> Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org Chris Faulhaber wrote: > > --J/dobhs11T7y2rNN > Content-Type: text/plain; charset=us-ascii > Content-Disposition: inline > Content-Transfer-Encoding: quoted-printable > > On Fri, Jan 11, 2002 at 07:49:04PM -0800, Peter Wemm wrote: > > Mark Murray wrote: > > > > I wonder how many dual P5's are still being used :/ > > >=20 > > > I have one (2xP5 @200MHz); I use it only in desktop mode, and it > > > launches X and Mozilla-CURRENT very slowly. I'm running CURRENT. > >=20 > > The good news is that I found part of the problem. Fix: > >=20 > > Yep, that seem to fix it. Good catch! We cant commit it like that though as it Would Be Bad(TM) for the non-intel cpus that have special cache handling. See i386/initcpu.c. I think a better fix would be to turn off the bits in the AP startup code since we know that the cpus that support SMP all treat these bits the same way. A more complete solution (perhaps having the AP's run the initcpu stuff to replicate the magic changes that were done to the BSP already) is the better solution for after the release. Cheers, -Peter -- Peter Wemm - peter@FreeBSD.org; peter@yahoo-inc.com; peter@netplex.com.au "All of this is for nothing if we don't go to the stars" - JMS/B5 To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Fri Jan 11 22:36:53 2002 Delivered-To: freebsd-smp@freebsd.org Received: from mailman.zeta.org.au (mailman.zeta.org.au [203.26.10.16]) by hub.freebsd.org (Postfix) with ESMTP id B376637B41B; Fri, 11 Jan 2002 22:36:49 -0800 (PST) Received: from bde.zeta.org.au (bde.zeta.org.au [203.2.228.102]) by mailman.zeta.org.au (8.9.3/8.8.7) with ESMTP id RAA27163; Sat, 12 Jan 2002 17:35:59 +1100 Date: Sat, 12 Jan 2002 17:36:43 +1100 (EST) From: Bruce Evans X-X-Sender: To: Peter Wemm Cc: Mark Murray , Chris Faulhaber , , Subject: Re: P5 vs. SMP, part 2 In-Reply-To: <20020112034904.7784A38FD@overcee.netplex.com.au> Message-ID: <20020112173153.G4872-100000@gamplex.bde.org> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org On Fri, 11 Jan 2002, Peter Wemm wrote: > The problem is that the AP cpus were running with the CR0_CD (cache disable) > and CR0_NW (cache writethrough, not writeback). This is very bad. :-] > > PPro and above bioses seem to cause the AP cpus enter the kernel with cache > enabled, so that this looks like it should be a p5/i586 problem only. Where were they set before? initcpu() has a mazing amount of code for setting these bits. We should set all CR* bits that we know and care about. We also sort of depend on BIOSes to clear CR4_TSD so that the TSC works in user mode. The TSC in user mode is not really supported, but I often use it. Bruce To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Fri Jan 11 23:24:45 2002 Delivered-To: freebsd-smp@freebsd.org Received: from rwcrmhc52.attbi.com (rwcrmhc52.attbi.com [216.148.227.88]) by hub.freebsd.org (Postfix) with ESMTP id C4C9237B417; Fri, 11 Jan 2002 23:24:41 -0800 (PST) Received: from peter3.wemm.org ([12.232.27.13]) by rwcrmhc52.attbi.com (InterMail vM.4.01.03.27 201-229-121-127-20010626) with ESMTP id <20020112072440.BLBC3578.rwcrmhc52.attbi.com@peter3.wemm.org>; Sat, 12 Jan 2002 07:24:40 +0000 Received: from overcee.netplex.com.au (overcee.wemm.org [10.0.0.3]) by peter3.wemm.org (8.11.0/8.11.0) with ESMTP id g0C7Oes69305; Fri, 11 Jan 2002 23:24:40 -0800 (PST) (envelope-from peter@wemm.org) Received: from wemm.org (localhost [127.0.0.1]) by overcee.netplex.com.au (Postfix) with ESMTP id 3273038FD; Fri, 11 Jan 2002 23:24:40 -0800 (PST) (envelope-from peter@wemm.org) X-Mailer: exmh version 2.5 07/13/2001 with nmh-1.0.4 To: Bruce Evans Cc: Mark Murray , Chris Faulhaber , scottl@FreeBSD.ORG, smp@FreeBSD.ORG Subject: Re: P5 vs. SMP, part 2 In-Reply-To: <20020112173153.G4872-100000@gamplex.bde.org> Date: Fri, 11 Jan 2002 23:24:40 -0800 From: Peter Wemm Message-Id: <20020112072440.3273038FD@overcee.netplex.com.au> Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org Bruce Evans wrote: > On Fri, 11 Jan 2002, Peter Wemm wrote: > > > The problem is that the AP cpus were running with the CR0_CD (cache disable ) > > and CR0_NW (cache writethrough, not writeback). This is very bad. :-] > > > > PPro and above bioses seem to cause the AP cpus enter the kernel with cache > > enabled, so that this looks like it should be a p5/i586 problem only. > > Where were they set before? They used to be done as a side effect of a load_cr0(magic_number); and several other bits were tweaked later. That's what broke, no baseline was set. cvs diff -u -r1.119 -r1.120 -kk mp_machdep.c +++ mp_machdep.c 11 Aug 2000 09:05:11 -0000 1.120 @@ -487,8 +487,6 @@ common_tssd = *tss_gdt; ltr(gsel_tss); - load_cr0(0x8005003b); /* XXX! */ - pmap_set_opt(); } @@ -623,13 +621,6 @@ /* start each Application Processor */ start_all_aps(boot_addr); - - /* - * The init process might be started on a different CPU now, - * and the boot CPU might not call prepare_usermode to get - * cr0 correctly configured. Thus we initialize cr0 here. - */ - load_cr0(rcr0() | CR0_WP | CR0_AM); } @@ -2375,8 +2366,8 @@ printf("SMP: AP CPU #%d Launched!\n", cpuid); - /* XXX FIXME: i386 specific, and redundant: Setup the FPU. */ - load_cr0((rcr0() & ~CR0_EM) | CR0_MP | CR0_NE | CR0_TS); + /* set up CPU registers and state */ + cpu_setregs(); /* set up FPU state on the AP */ npxinit(__INITIAL_NPXCW__); > initcpu() has a mazing amount of code for setting these bits. Yes. And it sets some machine dependent registers on the BSP only that is missing on the AP's I think. > We should set all CR* bits that we know and care about. We also sort of > depend on BIOSes to clear CR4_TSD so that the TSC works in user mode. > The TSC in user mode is not really supported, but I often use it. Yes, depending on bios leftovers has proven itself to be a problem. It is just lucky that the P6+ bioses tend to duplicate the BSP 'cache enable' bios setting on the AP's when waking them up and doing the warm start vector for mpboot.s. Cheers, -Peter -- Peter Wemm - peter@FreeBSD.org; peter@yahoo-inc.com; peter@netplex.com.au "All of this is for nothing if we don't go to the stars" - JMS/B5 To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Sat Jan 12 3:11:49 2002 Delivered-To: freebsd-smp@freebsd.org Received: from elvis.mu.org (elvis.mu.org [192.203.228.196]) by hub.freebsd.org (Postfix) with ESMTP id B002537B41B; Sat, 12 Jan 2002 03:11:44 -0800 (PST) Received: by elvis.mu.org (Postfix, from userid 1192) id 9296310DDF8; Sat, 12 Jan 2002 03:11:44 -0800 (PST) Date: Sat, 12 Jan 2002 03:11:44 -0800 From: Alfred Perlstein To: smp@freebsd.org Cc: dillon@freebsd.org, tanimura@freebsd.org Subject: fd locking. Message-ID: <20020112031144.F7984@elvis.mu.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.2.5i Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org I've got world building with these patches. http://people.freebsd.org/~alfred/fd.diff or http://people.freebsd.org/~alfred/fd.diff.gz -- -Alfred Perlstein [alfred@freebsd.org] 'Instead of asking why a piece of software is using "1970s technology," start asking why software is ignoring 30 years of accumulated wisdom.' Tax deductable donations for FreeBSD: http://www.freebsdfoundation.org/ To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Sat Jan 12 17:30:42 2002 Delivered-To: freebsd-smp@freebsd.org Received: from elvis.mu.org (elvis.mu.org [192.203.228.196]) by hub.freebsd.org (Postfix) with ESMTP id 5AF0637B404; Sat, 12 Jan 2002 17:30:38 -0800 (PST) Received: by elvis.mu.org (Postfix, from userid 1192) id 361CF10DDF9; Sat, 12 Jan 2002 17:30:38 -0800 (PST) Date: Sat, 12 Jan 2002 17:30:38 -0800 From: Alfred Perlstein To: smp@freebsd.org Cc: dillon@freebsd.org, tanimura@freebsd.org Subject: Re: fd locking. Message-ID: <20020112173038.H7984@elvis.mu.org> References: <20020112031144.F7984@elvis.mu.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.2.5i In-Reply-To: <20020112031144.F7984@elvis.mu.org>; from bright@mu.org on Sat, Jan 12, 2002 at 03:11:44AM -0800 Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org * Alfred Perlstein [020112 03:11] wrote: > I've got world building with these patches. > > http://people.freebsd.org/~alfred/fd.diff > > or > > http://people.freebsd.org/~alfred/fd.diff.gz I've been asked for an archetectural overview. Here we go: Locks: 1 mutex in each filedesc protects all the fields. protects "struct file" initialization, while a struct file is being changed from &badfileops -> &pipeops or something the filedesc should be locked. 1 mutex in each struct file protects the refcount fields. doesn't protect anything else. the flags used for garbage collection have been moved to f_gcflag which was the FILLER short, this doesn't need locking because the garbage collection is a single threaded container. could likely be made to use a pool mutex. 1 sx lock for the filelist. void fhold(struct file *fp); /* increments reference count on a file */ void fhold_locked(struct file *fp); /* like fhold but expects file to locked */ struct file *ffind_hold(struct thread *, int fd); /* finds the struct file in thread, adds one reference and returns it unlocked */ struct file *ffind_lock(struct thread *, int fd); /* ffind_hold, but returns file locked */ I still have to smp-safe Dillon's fget cruft, but I'll get to that asap. -- -Alfred Perlstein [alfred@freebsd.org] 'Instead of asking why a piece of software is using "1970s technology," start asking why software is ignoring 30 years of accumulated wisdom.' Tax deductable donations for FreeBSD: http://www.freebsdfoundation.org/ To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Sat Jan 12 17:45:54 2002 Delivered-To: freebsd-smp@freebsd.org Received: from mail5.speakeasy.net (mail5.speakeasy.net [216.254.0.205]) by hub.freebsd.org (Postfix) with ESMTP id B8F4137B41A for ; Sat, 12 Jan 2002 17:45:43 -0800 (PST) Received: (qmail 28250 invoked from network); 13 Jan 2002 01:45:42 -0000 Received: from unknown (HELO laptop.baldwin.cx) ([64.81.54.73]) (envelope-sender ) by mail5.speakeasy.net (qmail-ldap-1.03) with SMTP for ; 13 Jan 2002 01:45:42 -0000 Message-ID: X-Mailer: XFMail 1.4.0 on FreeBSD X-Priority: 3 (Normal) Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 8bit MIME-Version: 1.0 In-Reply-To: <20020112173038.H7984@elvis.mu.org> Date: Sat, 12 Jan 2002 17:44:56 -0800 (PST) From: John Baldwin To: Alfred Perlstein Subject: Re: fd locking. Cc: tanimura@freebsd.org, dillon@freebsd.org, smp@freebsd.org Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org On 13-Jan-02 Alfred Perlstein wrote: > * Alfred Perlstein [020112 03:11] wrote: >> I've got world building with these patches. >> >> http://people.freebsd.org/~alfred/fd.diff >> >> or >> >> http://people.freebsd.org/~alfred/fd.diff.gz > > I've been asked for an archetectural overview. One cosmetic tweak: > void fhold(struct file *fp); > /* increments reference count on a file */ > > void fhold_locked(struct file *fp); > /* like fhold but expects file to locked */ Could you change these to return a reference to the fp like crhold()? Thus you end up with code like newfp = fhold(oldfp) which reads better and documents what the old and new references are. It's actually a Terry suggestion. :) Other than that it sounds good. I'm looking over the patch atm and will get back to you if I have any questions. -- John Baldwin <>< http://www.FreeBSD.org/~jhb/ "Power Users Use the Power to Serve!" - http://www.FreeBSD.org/ To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Sat Jan 12 18: 3:17 2002 Delivered-To: freebsd-smp@freebsd.org Received: from mail5.speakeasy.net (mail5.speakeasy.net [216.254.0.205]) by hub.freebsd.org (Postfix) with ESMTP id 2766037B41A for ; Sat, 12 Jan 2002 18:03:11 -0800 (PST) Received: (qmail 3831 invoked from network); 13 Jan 2002 02:03:10 -0000 Received: from unknown (HELO laptop.baldwin.cx) ([64.81.54.73]) (envelope-sender ) by mail5.speakeasy.net (qmail-ldap-1.03) with SMTP for ; 13 Jan 2002 02:03:10 -0000 Message-ID: X-Mailer: XFMail 1.4.0 on FreeBSD X-Priority: 3 (Normal) Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 8bit MIME-Version: 1.0 In-Reply-To: Date: Sat, 12 Jan 2002 18:02:31 -0800 (PST) From: John Baldwin To: John Baldwin Subject: Re: fd locking. Cc: smp@freebsd.org, dillon@freebsd.org, tanimura@freebsd.org, Alfred Perlstein Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org On 13-Jan-02 John Baldwin wrote: > > On 13-Jan-02 Alfred Perlstein wrote: >> * Alfred Perlstein [020112 03:11] wrote: >>> I've got world building with these patches. >>> >>> http://people.freebsd.org/~alfred/fd.diff >>> >>> or >>> >>> http://people.freebsd.org/~alfred/fd.diff.gz >> >> I've been asked for an archetectural overview. One bug: --- compat/svr4/svr4_fcntl.c 2001/09/12 08:36:58 +++ compat/svr4/svr4_fcntl.c 2002/01/08 08:39:08 @@ -341,7 +349,10 @@ SCARG(&ft, fd) = fd; SCARG(&ft, length) = start; - return ftruncate(td, &ft); + error = ftruncate(p, &ft); + + fdrop(fp, td); + return (error); } int ftruncate() takes a thread, not a proc. -- John Baldwin <>< http://www.FreeBSD.org/~jhb/ "Power Users Use the Power to Serve!" - http://www.FreeBSD.org/ To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Sat Jan 12 18:13:32 2002 Delivered-To: freebsd-smp@freebsd.org Received: from elvis.mu.org (elvis.mu.org [192.203.228.196]) by hub.freebsd.org (Postfix) with ESMTP id E231437B405; Sat, 12 Jan 2002 18:13:26 -0800 (PST) Received: by elvis.mu.org (Postfix, from userid 1192) id 8AE4B10DDF9; Sat, 12 Jan 2002 18:13:25 -0800 (PST) Date: Sat, 12 Jan 2002 18:13:25 -0800 From: Alfred Perlstein To: John Baldwin Cc: smp@freebsd.org, dillon@freebsd.org, tanimura@freebsd.org Subject: Re: fd locking. Message-ID: <20020112181325.I7984@elvis.mu.org> References: Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.2.5i In-Reply-To: ; from jhb@FreeBSD.org on Sat, Jan 12, 2002 at 06:02:31PM -0800 Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org * John Baldwin [020112 18:03] wrote: > > On 13-Jan-02 John Baldwin wrote: > > > > On 13-Jan-02 Alfred Perlstein wrote: > >> * Alfred Perlstein [020112 03:11] wrote: > >>> I've got world building with these patches. > >>> > >>> http://people.freebsd.org/~alfred/fd.diff > >>> > >>> or > >>> > >>> http://people.freebsd.org/~alfred/fd.diff.gz > >> > >> I've been asked for an archetectural overview. > > One bug: > > --- compat/svr4/svr4_fcntl.c 2001/09/12 08:36:58 > +++ compat/svr4/svr4_fcntl.c 2002/01/08 08:39:08 > @@ -341,7 +349,10 @@ > SCARG(&ft, fd) = fd; > SCARG(&ft, length) = start; > > - return ftruncate(td, &ft); > + error = ftruncate(p, &ft); > + > + fdrop(fp, td); > + return (error); > } > > int > > ftruncate() takes a thread, not a proc. There's also a bug in dupfdopen(), at about line 1862 there's a superfulous FILE_UNLOCK that i had to remove. -- -Alfred Perlstein [alfred@freebsd.org] 'Instead of asking why a piece of software is using "1970s technology," start asking why software is ignoring 30 years of accumulated wisdom.' Tax deductable donations for FreeBSD: http://www.freebsdfoundation.org/ To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Sat Jan 12 19: 0:34 2002 Delivered-To: freebsd-smp@freebsd.org Received: from mail5.speakeasy.net (mail5.speakeasy.net [216.254.0.205]) by hub.freebsd.org (Postfix) with ESMTP id E216437B417 for ; Sat, 12 Jan 2002 19:00:25 -0800 (PST) Received: (qmail 28771 invoked from network); 13 Jan 2002 03:00:24 -0000 Received: from unknown (HELO laptop.baldwin.cx) ([64.81.54.73]) (envelope-sender ) by mail5.speakeasy.net (qmail-ldap-1.03) with SMTP for ; 13 Jan 2002 03:00:24 -0000 Message-ID: X-Mailer: XFMail 1.4.0 on FreeBSD X-Priority: 3 (Normal) Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 8bit MIME-Version: 1.0 In-Reply-To: Date: Sat, 12 Jan 2002 18:59:45 -0800 (PST) From: John Baldwin To: John Baldwin Subject: Re: fd locking. Cc: smp@freebsd.org, dillon@freebsd.org, tanimura@freebsd.org, Alfred Perlstein Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org On 13-Jan-02 John Baldwin wrote: > > On 13-Jan-02 Alfred Perlstein wrote: >> * Alfred Perlstein [020112 03:11] wrote: >>> I've got world building with these patches. >>> >>> http://people.freebsd.org/~alfred/fd.diff >>> >>> or >>> >>> http://people.freebsd.org/~alfred/fd.diff.gz Why did you add the else here: diff -u -r1.9 svr4_ioctl.c --- compat/svr4/svr4_ioctl.c 2001/09/12 08:36:58 1.9 +++ compat/svr4/svr4_ioctl.c 2002/01/08 22:26:13 @@ -100,21 +100,22 @@ dir, c, num, argsiz, SCARG(uap, data))); #endif retval = td->td_retval; - fdp = td->td_proc->p_fd; cmd = SCARG(uap, com); - if ((u_int)SCARG(uap, fd) >= fdp->fd_nfiles || - (fp = fdp->fd_ofiles[SCARG(uap, fd)]) == NULL) + fp = ffind_hold(td, uap->fd); + if (fp == NULL) return EBADF; - if ((fp->f_flag & (FREAD | FWRITE)) == 0) + if ((fp->f_flag & (FREAD | FWRITE)) == 0) { + fdrop(fp, td); return EBADF; + } #if defined(DEBUG_SVR4) if (fp->f_type == DTYPE_SOCKET) { struct socket *so = (struct socket *)fp->f_data; DPRINTF(("<<< IN: so_state = 0x%x\n", so->so_state)); - } + } else #endif switch (cmd & 0xff00) { and another proc -> thread bug at the bottom of this hunk: @@ -145,17 +146,23 @@ case SVR4_XIOC: /* We do not support those */ + fdrop(fp, td); return EINVAL; default: + fdrop(fp, td); DPRINTF(("Unimplemented ioctl %lx\n", cmd)); return 0; /* XXX: really ENOSYS */ } #if defined(DEBUG_SVR4) if (fp->f_type == DTYPE_SOCKET) { - struct socket *so = (struct socket *)fp->f_data; + struct socket *so; + + so = (struct socket *)fp->f_data; DPRINTF((">>> OUT: so_state = 0x%x\n", so->so_state)); } #endif - return (*fun)(fp, td, retval, SCARG(uap, fd), cmd, SCARG(uap, data)); + error = (*fun)(fp, p, retval, SCARG(uap, fd), cmd, SCARG(uap, data)); + fdrop(fp, td); + return (error); } And another one: diff -u -r1.34 svr4_misc.c --- compat/svr4/svr4_misc.c 2001/10/10 23:06:52 1.34 +++ compat/svr4/svr4_misc.c 2002/01/08 22:30:32 @@ -400,9 +405,10 @@ eof: td->td_retval[0] = nbytes - resid; out: + VOP_UNLOCK(vp, 0, p); + fdrop(fp, td); if (cookies) free(cookies, M_TEMP); - VOP_UNLOCK(vp, 0, td); free(buf, M_TEMP); return error; } hmm, some more, have you compiled this? :) Might want to compile LINT (minus usb since that is broken) and fix the new warnings In svr4_stream.c, do_putmsg and do_getmsg should be taking a thread not a proc as their first argument and callers should be fixed as well. You might consider a file_init() and file_destroy() function or macro like so: void file_init(struct file *fp) { mtx_init(&fp->f_mtx, "struct file", MTX_DEF); fp->f_count = 1; } void file_destroy(struct file *fp) { mtx_destroy(&fp->f_mtx); } I would just make file_destroy a macro for now. Having file_init a function would save a little space since the "struct file" string wouldn't be duplicated, but you can always change it later. You could add more stuff if needed as well. :) Hmm, do you think you could change fdalloc() to take a filedesc * instead of a thread so it's clearer when you lock the old filedesc that it is being used? hmm, for this code: + mtx_init(&fp->f_mtx, "file structure", MTX_DEF); + fp->f_gcflag = 0; fp->f_count = 1; fp->f_cred = crhold(p->p_ucred); fp->f_ops = &badfileops; fp->f_seqcount = 1; + FILEDESC_UNLOCK(p->p_fd); + sx_xlock(&filelist_lock); + FILEDESC_LOCK(p->p_fd); if ((fq = p->p_fd->fd_ofiles[0])) { LIST_INSERT_AFTER(fq, fp, f_list); } else { LIST_INSERT_HEAD(&filehead, fp, f_list); } p->p_fd->fd_ofiles[i] = fp; + FILEDESC_UNLOCK(p->p_fd); + sx_xunlock(&filelist_lock); if (resultfp) *resultfp = fp; if (resultfd) You could xlock filelist_lock earlier before the first FILEDESC_LOCK with associated changes to avoid as many locking operations. You wouldn't keep the xlock held for much longer and it would probably be quicker in the long run. Bruce is going to not like you for adding nested includes of sys/lock.h and sys/mutex.h. Instead, add nested includes of sys/_lock.h and sys/_mutex.h, and then add sys/lock.h and sys/mutex.h to the files that need them. Other then that it looks great. Can you clean these bits up and post a new patch for folks to test. Aside form svr4, the current patch should be good for testing as well. Esp. need people with SMP machines to test this stuff. -- John Baldwin <>< http://www.FreeBSD.org/~jhb/ "Power Users Use the Power to Serve!" - http://www.FreeBSD.org/ To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Sat Jan 12 19: 1:38 2002 Delivered-To: freebsd-smp@freebsd.org Received: from fledge.watson.org (fledge.watson.org [204.156.12.50]) by hub.freebsd.org (Postfix) with ESMTP id 9F94937B417 for ; Sat, 12 Jan 2002 19:01:32 -0800 (PST) Received: from localhost (arr@localhost) by fledge.watson.org (8.11.6/8.11.5) with SMTP id g0D31SG05854 for ; Sat, 12 Jan 2002 22:01:28 -0500 (EST) (envelope-from arr@FreeBSD.org) X-Authentication-Warning: fledge.watson.org: arr owned process doing -bs Date: Sat, 12 Jan 2002 22:01:27 -0500 (EST) From: "Andrew R. Reiter" X-Sender: arr@fledge.watson.org To: freebsd-smp@FreeBSD.org Subject: SMPng Status Update Message-ID: MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org SMPng Progress Update ===================== Contact: freebsd-smp@FreeBSD.org Date: January 12th, 2002 URL: http://www.FreeBSD.org/smp/ Recent Progress --------------- - mb_alloc(): Bosko Milekic has been doing some cleaning up on the mbuf and cluster allocator. The code has been in the tree and pretty stable for about 7 or 8 months now. - fd locking patches: Alfred Perlstein is working on getting make world to build with regards to locking the fd code. A recent patch can be found at: http://people.freebsd.org/~alfred/fd.diff - icu_lock: John Baldwin added the icu_lock in the pci interrupt code up a layer in order to resolve locking problems during low-level console init. (p4) - kernel preemption: p4 work by John Baldwin - TLB shootdowns: Peter Wemm has been working on pmap cleanups for x86 SMP TLB shootdowns. To do ----- - mb_alloc(): Wait and see what happens with Jeff Roberson's general purpose allocator and how it will affect mbuf and cluster allocation. - proc lockdown: Continued work in the jhb proc lock tree in perforce. - Kernel preemption - Making ktrace handle requests asynchronously via a kernel process - Determining affinity rules; waiting on KSEs to be implemented in full. - Discuss and decide how this will affect interrupt latency issues - Look at the linux per-cpu runqueues further - Determining the next steps for locking down the network stack. - fd locking: modify the code if needed to please -smp@ and commit - Continue work on tlb shootdowns. - Check SMPng web page for more information on TODOs. (comments and/or suggestions on format or layout, please reply to sender only) -- Andrew R. Reiter arr@watson.org arr@FreeBSD.org To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Sat Jan 12 19:10: 5 2002 Delivered-To: freebsd-smp@freebsd.org Received: from albatross.prod.itd.earthlink.net (albatross.mail.pas.earthlink.net [207.217.120.120]) by hub.freebsd.org (Postfix) with ESMTP id BA09137B419; Sat, 12 Jan 2002 19:10:00 -0800 (PST) Received: from pool0052.cvx21-bradley.dialup.earthlink.net ([209.179.192.52] helo=mindspring.com) by albatross.prod.itd.earthlink.net with esmtp (Exim 3.33 #1) id 16Pb1v-0007Qx-00; Sat, 12 Jan 2002 19:09:55 -0800 Message-ID: <3C40FA80.89C73745@mindspring.com> Date: Sat, 12 Jan 2002 19:09:52 -0800 From: Terry Lambert X-Mailer: Mozilla 4.7 [en]C-CCK-MCD {Sony} (Win98; U) X-Accept-Language: en MIME-Version: 1.0 To: John Baldwin Cc: Alfred Perlstein , tanimura@freebsd.org, dillon@freebsd.org, smp@freebsd.org Subject: Re: fd locking. References: Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org John Baldwin wrote: > Could you change these to return a reference to the fp like crhold()? > > Thus you end up with code like > > newfp = fhold(oldfp) which reads better and documents what the old > and new references are. It's actually a Terry suggestion. :) FWIW, the reason I wanted this was to let me instrument the operations transparently to the caller, which you can't do unless this is the way it works. That it also looks pretty is just gravy. 8-). -- Terry To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Sat Jan 12 19:16:51 2002 Delivered-To: freebsd-smp@freebsd.org Received: from elvis.mu.org (elvis.mu.org [192.203.228.196]) by hub.freebsd.org (Postfix) with ESMTP id 0A7C437B404; Sat, 12 Jan 2002 19:16:46 -0800 (PST) Received: by elvis.mu.org (Postfix, from userid 1192) id CFBF310DDF9; Sat, 12 Jan 2002 19:16:45 -0800 (PST) Date: Sat, 12 Jan 2002 19:16:45 -0800 From: Alfred Perlstein To: John Baldwin Cc: smp@freebsd.org, dillon@freebsd.org, tanimura@freebsd.org Subject: Re: fd locking. Message-ID: <20020112191645.J7984@elvis.mu.org> References: Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.2.5i In-Reply-To: ; from jhb@FreeBSD.org on Sat, Jan 12, 2002 at 06:59:45PM -0800 Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org * John Baldwin [020112 19:00] wrote: > > On 13-Jan-02 John Baldwin wrote: > > > > On 13-Jan-02 Alfred Perlstein wrote: > >> * Alfred Perlstein [020112 03:11] wrote: > >>> I've got world building with these patches. > >>> > >>> http://people.freebsd.org/~alfred/fd.diff > >>> > >>> or > >>> > >>> http://people.freebsd.org/~alfred/fd.diff.gz > > Why did you add the else here: Axed. > and another proc -> thread bug at the bottom of this hunk: ok. > > And another one: > > diff -u -r1.34 svr4_misc.c yup. > hmm, some more, have you compiled this? :) Might want to compile LINT (minus > usb since that is broken) and fix the new warnings I've compiled my kernel, i'm in the process of building world, but it's kinda slow because i have all the INVARIANT and WITNESS stuff on for that. > In svr4_stream.c, do_putmsg and do_getmsg should be taking a thread not a proc > as their first argument and callers should be fixed as well. Can this be delayed? > You might consider a file_init() and file_destroy() function or macro like so: > > void > file_init(struct file *fp) > { > > mtx_init(&fp->f_mtx, "struct file", MTX_DEF); > fp->f_count = 1; > } > > void > file_destroy(struct file *fp) > { > > mtx_destroy(&fp->f_mtx); > } > > I would just make file_destroy a macro for now. Having file_init a function > would save a little space since the "struct file" string wouldn't be > duplicated, but you can always change it later. You could add more stuff if > needed as well. :) Can this be delayed? > > Hmm, do you think you could change fdalloc() to take a filedesc * instead of a > thread so it's clearer when you lock the old filedesc that it is being used? Might work, Can this be delayed? > hmm, for this code: > > + mtx_init(&fp->f_mtx, "file structure", MTX_DEF); > + fp->f_gcflag = 0; > fp->f_count = 1; > fp->f_cred = crhold(p->p_ucred); > fp->f_ops = &badfileops; > fp->f_seqcount = 1; > + FILEDESC_UNLOCK(p->p_fd); > + sx_xlock(&filelist_lock); > + FILEDESC_LOCK(p->p_fd); > if ((fq = p->p_fd->fd_ofiles[0])) { > LIST_INSERT_AFTER(fq, fp, f_list); > } else { > LIST_INSERT_HEAD(&filehead, fp, f_list); > } > p->p_fd->fd_ofiles[i] = fp; > + FILEDESC_UNLOCK(p->p_fd); > + sx_xunlock(&filelist_lock); > if (resultfp) > *resultfp = fp; > if (resultfd) > > You could xlock filelist_lock earlier before the first FILEDESC_LOCK with > associated changes to avoid as many locking operations. You wouldn't keep the > xlock held for much longer and it would probably be quicker in the long run. Yes, but those codes call malloc with M_WAITOK, if someone was to close a filedescriptor i may get deadlock because they block on the filehead sx lock while i'm blocked in malloc and i already have the filedesc lock. > Bruce is going to not like you for adding nested includes of sys/lock.h and > sys/mutex.h. Instead, add nested includes of sys/_lock.h and sys/_mutex.h, and > then add sys/lock.h and sys/mutex.h to the files that need them. Can this be delayed? > Other then that it looks great. Can you clean these bits up and post a new > patch for folks to test. Aside form svr4, the current patch should be good for > testing as well. Esp. need people with SMP machines to test this stuff. New patch up: http://people.freebsd.org/~alfred/fd.diff I still need to fix Matt's fd holding stuff, but I'm anxious to get this in before I loose it all to some massive structure renaming or whitespace run like I have before. :) -- -Alfred Perlstein [alfred@freebsd.org] 'Instead of asking why a piece of software is using "1970s technology," start asking why software is ignoring 30 years of accumulated wisdom.' Tax deductable donations for FreeBSD: http://www.freebsdfoundation.org/ To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message