From owner-freebsd-hackers@FreeBSD.ORG Sun Nov 9 00:54:03 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id CE4BF16A4CE for ; Sun, 9 Nov 2003 00:54:03 -0800 (PST) Received: from mx.nsu.ru (mx.nsu.ru [212.192.164.5]) by mx1.FreeBSD.org (Postfix) with ESMTP id 6F99744003 for ; Sun, 9 Nov 2003 00:54:02 -0800 (PST) (envelope-from danfe@regency.nsu.ru) Received: from mail by mx.nsu.ru with drweb-scanned (Exim 3.35 #1 (Debian)) id 1AImKJ-00067g-00 for ; Sun, 09 Nov 2003 15:57:47 +0600 Received: from regency.nsu.ru ([193.124.210.26]) by mx.nsu.ru with esmtp (Exim 3.35 #1 (Debian)) id 1AImKJ-000672-00 for ; Sun, 09 Nov 2003 15:57:47 +0600 Received: from regency.nsu.ru (localhost [127.0.0.1]) by regency.nsu.ru (8.12.9p2/8.12.9) with ESMTP id hA98sxg1036337 for ; Sun, 9 Nov 2003 14:54:59 +0600 (NOVT) (envelope-from danfe@regency.nsu.ru) Received: (from danfe@localhost) by regency.nsu.ru (8.12.9p2/8.12.9/Submit) id hA98sxtk036147 for hackers@freebsd.org; Sun, 9 Nov 2003 14:54:59 +0600 (NOVT) (envelope-from danfe) Date: Sun, 9 Nov 2003 14:54:59 +0600 From: Alexey Dokuchaev To: hackers@freebsd.org Message-ID: <20031109085459.GA31751@regency.nsu.ru> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.4.1i X-Envelope-To: hackers@freebsd.org Subject: Status of unionfs in -STABLE X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 09 Nov 2003 08:54:03 -0000 Hi there, Recently I've began to consider making some use of unionfs in (semi-)production environment. Can someone aware of its current status in -STABLE comment a bit on this subject? Probably any information would be appreciated. Thanks so far, ./danfe From owner-freebsd-hackers@FreeBSD.ORG Sun Nov 9 03:24:26 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 1F54F16A4CE for ; Sun, 9 Nov 2003 03:24:26 -0800 (PST) Received: from obsecurity.dyndns.org (adsl-63-207-60-234.dsl.lsan03.pacbell.net [63.207.60.234]) by mx1.FreeBSD.org (Postfix) with ESMTP id 41D9343FBF for ; Sun, 9 Nov 2003 03:24:25 -0800 (PST) (envelope-from kris@obsecurity.org) Received: by obsecurity.dyndns.org (Postfix, from userid 1000) id 721CD66BC5; Sun, 9 Nov 2003 03:24:21 -0800 (PST) Date: Sun, 9 Nov 2003 03:24:21 -0800 From: Kris Kennaway To: Alexey Dokuchaev Message-ID: <20031109112421.GA94746@xor.obsecurity.org> References: <20031109085459.GA31751@regency.nsu.ru> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="/9DWx/yDrRhgMJTb" Content-Disposition: inline In-Reply-To: <20031109085459.GA31751@regency.nsu.ru> User-Agent: Mutt/1.4.1i cc: hackers@freebsd.org Subject: Re: Status of unionfs in -STABLE X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 09 Nov 2003 11:24:26 -0000 --/9DWx/yDrRhgMJTb Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Sun, Nov 09, 2003 at 02:54:59PM +0600, Alexey Dokuchaev wrote: > Hi there, >=20 > Recently I've began to consider making some use of unionfs in > (semi-)production environment. Can someone aware of its current status > in -STABLE comment a bit on this subject? >=20 > Probably any information would be appreciated. Unchanged since the other times this topic has been discussed recently - see the archives for extensive discussion. (Summary: it's possible to avoid panicking if you carefully restrict the activities you do with unionfs, but expect panics and possible filesystem corruption while discovering those limits). Kris --/9DWx/yDrRhgMJTb Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.3 (FreeBSD) iD8DBQE/riPlWry0BWjoQKURArQ/AKD55bjLqLZE+x9/hOIAJ/CuStsW1ACfeGGV oQE/Elt0sOBdy1ioDOItx3Y= =KR2R -----END PGP SIGNATURE----- --/9DWx/yDrRhgMJTb-- From owner-freebsd-hackers@FreeBSD.ORG Sun Nov 9 03:27:08 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 6EFB316A4CE for ; Sun, 9 Nov 2003 03:27:08 -0800 (PST) Received: from mx.nsu.ru (mx.nsu.ru [212.192.164.5]) by mx1.FreeBSD.org (Postfix) with ESMTP id 7097A43FCB for ; Sun, 9 Nov 2003 03:27:07 -0800 (PST) (envelope-from danfe@regency.nsu.ru) Received: from mail by mx.nsu.ru with drweb-scanned (Exim 3.35 #1 (Debian)) id 1AIoiU-0008AL-00; Sun, 09 Nov 2003 18:30:54 +0600 Received: from regency.nsu.ru ([193.124.210.26]) by mx.nsu.ru with esmtp (Exim 3.35 #1 (Debian)) id 1AIoiT-0008AA-00; Sun, 09 Nov 2003 18:30:53 +0600 Received: from regency.nsu.ru (localhost [127.0.0.1]) by regency.nsu.ru (8.12.9p2/8.12.9) with ESMTP id hA9BS8g1078762; Sun, 9 Nov 2003 17:28:08 +0600 (NOVT) (envelope-from danfe@regency.nsu.ru) Received: (from danfe@localhost) by regency.nsu.ru (8.12.9p2/8.12.9/Submit) id hA9BS8S4078749; Sun, 9 Nov 2003 17:28:08 +0600 (NOVT) (envelope-from danfe) Date: Sun, 9 Nov 2003 17:28:08 +0600 From: Alexey Dokuchaev To: Kris Kennaway Message-ID: <20031109112808.GA70947@regency.nsu.ru> References: <20031109085459.GA31751@regency.nsu.ru> <20031109112421.GA94746@xor.obsecurity.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20031109112421.GA94746@xor.obsecurity.org> User-Agent: Mutt/1.4.1i X-Envelope-To: kris@obsecurity.org, hackers@freebsd.org cc: hackers@freebsd.org Subject: Re: Status of unionfs in -STABLE X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 09 Nov 2003 11:27:08 -0000 On Sun, Nov 09, 2003 at 03:24:21AM -0800, Kris Kennaway wrote: > On Sun, Nov 09, 2003 at 02:54:59PM +0600, Alexey Dokuchaev wrote: > > Hi there, > > > > Recently I've began to consider making some use of unionfs in > > (semi-)production environment. Can someone aware of its current status > > in -STABLE comment a bit on this subject? > > > > Probably any information would be appreciated. > > Unchanged since the other times this topic has been discussed recently > - see the archives for extensive discussion. (Summary: it's possible > to avoid panicking if you carefully restrict the activities you do > with unionfs, but expect panics and possible filesystem corruption > while discovering those limits). Thanks, I'll investigate further. ./danfe From owner-freebsd-hackers@FreeBSD.ORG Sun Nov 9 03:45:40 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 97B3516A4CE; Sun, 9 Nov 2003 03:45:40 -0800 (PST) Received: from ferengi.borderworlds.dk (borderworlds.dk [62.79.110.124]) by mx1.FreeBSD.org (Postfix) with ESMTP id 1F23C43FDF; Sun, 9 Nov 2003 03:45:39 -0800 (PST) (envelope-from xi@borderworlds.dk) Received: from borg.borderworlds.dk (localhost [127.0.0.1]) by ferengi.borderworlds.dk (Postfix) with ESMTP id 6951A5C21; Sun, 9 Nov 2003 12:45:35 +0100 (CET) Received: by borg.borderworlds.dk (Postfix, from userid 1001) id 7D83CB823; Sun, 9 Nov 2003 12:45:34 +0100 (CET) Sender: xi@borderworlds.dk To: David Schultz References: <20031109003617.K626@korben.in.tern> <20031109023041.GA9171@VARK.homeunix.com> From: Christian Laursen Date: 09 Nov 2003 12:45:34 +0100 In-Reply-To: <20031109023041.GA9171@VARK.homeunix.com> Message-ID: <868ympydcx.fsf@borg.borderworlds.dk> Lines: 24 User-Agent: Gnus/5.09 (Gnus v5.9.0) Emacs/21.3 MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii cc: hackers@FreeBSD.ORG cc: phk@FreeBSD.ORG cc: Lukas Ertl Subject: Re: geom_mirror implementation X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 09 Nov 2003 11:45:40 -0000 David Schultz writes: > On Sun, Nov 09, 2003, Lukas Ertl wrote: > > Hi hackers@, > > > > I've played around with GEOM a bit and beefed up geom_mirror, which is > > already in the tree but not built yet. > > > > You can find the patch at . > > Hmm...I believe geom_mirror is supposed to be an example, and > geom_ccd is supposed to be the production mirroring implementation. > ccd does have its quirks, though... Last time I checked ccd needed to be manually reconfigured to run in degraded mode and sync is not possible. In my book that's not good enough for production. Furthermore it would be nice with a mirror implementation that automatically syncs the mirror after an unclean shutdown. -- Best regards Christian Laursen From owner-freebsd-hackers@FreeBSD.ORG Sun Nov 9 04:18:37 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 0AA2A16A4CE for ; Sun, 9 Nov 2003 04:18:37 -0800 (PST) Received: from park.rambler.ru (park.rambler.ru [81.19.64.101]) by mx1.FreeBSD.org (Postfix) with ESMTP id 466F743FE1 for ; Sun, 9 Nov 2003 04:18:35 -0800 (PST) (envelope-from is@rambler-co.ru) Received: from is.park.rambler.ru (is.park.rambler.ru [81.19.64.102]) by park.rambler.ru (8.12.6/8.12.6) with ESMTP id hA9CGtJ6002693; Sun, 9 Nov 2003 15:16:56 +0300 (MSK) (envelope-from is@rambler-co.ru) Date: Sun, 9 Nov 2003 15:16:55 +0300 (MSK) From: Igor Sysoev X-Sender: is@is.park.rambler.ru To: John-Mark Gurney In-Reply-To: <20031109033026.GF558@funkthat.com> Message-ID: MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII cc: freebsd-hackers@freebsd.org cc: Vivek Pai cc: Alan Cox Subject: Re: Update: Debox sendfile modifications X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 09 Nov 2003 12:18:37 -0000 On Sat, 8 Nov 2003, John-Mark Gurney wrote: > Igor Sysoev wrote this message on Wed, Nov 05, 2003 at 12:31 +0300: > > I think it can done in the following way - a socket should have flag > > that says that sendfile() had started the reading a page. > > layer violation... I do not think that it's layer violation. sendfile() works with descriptor so it should know its state. It should know wheather descriptor is non-blocking or has it enough buffer space. > how do you know that the fd is a socket? fp->f_type == DTYPE_SOCKET > > select()/poll()/kevent() should check this flag before the checking > > a socket buffer space. When the page had been read this flag is reset. > > So, what about using sendfile on a pipe? are you going to teach sendfile > how to interact with pipe's too? What about other fd types? > > If you made this a fd transparent operation then I would agree with > it. The current sendfile() implementation works with sockets only. Well, I agree that such sendfile() implementation is a hack. Nowever this implementation is very usefull in the real world - it allows to minimize a data copy in http and ftp servers. I just could not figure to myself where can be usefull the high perfomance sendfile() to a pipe. I think that it's better to leave sendfile() as a sending to a socket only hack. I believe that any sendfile() generalization (e.g. sending data from a socket to a file) is useless. Igor Sysoev http://sysoev.ru/en/ From owner-freebsd-hackers@FreeBSD.ORG Sun Nov 9 04:21:17 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 6243E16A4CE for ; Sun, 9 Nov 2003 04:21:17 -0800 (PST) Received: from lurza.secnetix.de (lurza.secnetix.de [195.143.231.20]) by mx1.FreeBSD.org (Postfix) with ESMTP id 9466D43FB1 for ; Sun, 9 Nov 2003 04:21:14 -0800 (PST) (envelope-from olli@lurza.secnetix.de) Received: from lurza.secnetix.de (dazwtc@localhost [127.0.0.1]) by lurza.secnetix.de (8.12.9p2/8.12.9) with ESMTP id hA9CLDb0068573 for ; Sun, 9 Nov 2003 13:21:13 +0100 (CET) (envelope-from oliver.fromme@secnetix.de) Received: (from olli@localhost) by lurza.secnetix.de (8.12.9p2/8.12.9/Submit) id hA9CLCE8068572; Sun, 9 Nov 2003 13:21:12 +0100 (CET) (envelope-from olli) Date: Sun, 9 Nov 2003 13:21:12 +0100 (CET) Message-Id: <200311091221.hA9CLCE8068572@lurza.secnetix.de> From: Oliver Fromme To: freebsd-hackers@FreeBSD.ORG In-Reply-To: <20031109085459.GA31751@regency.nsu.ru> X-Newsgroups: list.freebsd-hackers User-Agent: tin/1.5.4-20000523 ("1959") (UNIX) (FreeBSD/4.9-RELEASE (i386)) MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 8bit Subject: Re: Status of unionfs in -STABLE X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list Reply-To: freebsd-hackers@FreeBSD.ORG List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 09 Nov 2003 12:21:17 -0000 Alexey Dokuchaev wrote: > Recently I've began to consider making some use of unionfs in > (semi-)production environment. Can someone aware of its current status > in -STABLE comment a bit on this subject? > > Probably any information would be appreciated. Last time I tried, it was unusable, and from the discussions on the lists it became apparent that it wouldn't change in 4-stable. However, the union flag on standard mounts (i.e. -o union, which can be combined with almost anything, including loopback NFS mounts) works perfectly fine. It doesn't provide all of the features of UNIONFS, but it can be used as a substitute in many common situations. I'm using it extensively, for example for shared read-only binaries across jails, and I've yet to see a panic. Regards Oliver -- Oliver Fromme, secnetix GmbH & Co KG, Oettingenstr. 2, 80538 München Any opinions expressed in this message may be personal to the author and may not necessarily reflect the opinions of secnetix in any way. "C is quirky, flawed, and an enormous success." -- Dennis M. Ritchie. From owner-freebsd-hackers@FreeBSD.ORG Sun Nov 9 10:26:25 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 6267D16A4CE for ; Sun, 9 Nov 2003 10:26:25 -0800 (PST) Received: from mail.speakeasy.net (mail6.speakeasy.net [216.254.0.206]) by mx1.FreeBSD.org (Postfix) with ESMTP id 374A443FA3 for ; Sun, 9 Nov 2003 10:26:24 -0800 (PST) (envelope-from jmg@hydrogen.funkthat.com) Received: (qmail 14696 invoked from network); 9 Nov 2003 18:26:23 -0000 Received: from unknown (HELO hydrogen.funkthat.com) ([69.17.45.168]) (envelope-sender ) by mail6.speakeasy.net (qmail-ldap-1.03) with SMTP for ; 9 Nov 2003 18:26:23 -0000 Received: from hydrogen.funkthat.com (jqdovs@localhost.funkthat.com [127.0.0.1])hA9IQHgP052596; Sun, 9 Nov 2003 10:26:17 -0800 (PST) (envelope-from jmg@hydrogen.funkthat.com) Received: (from jmg@localhost) by hydrogen.funkthat.com (8.12.10/8.12.10/Submit) id hA9IQFmO052595; Sun, 9 Nov 2003 10:26:15 -0800 (PST) Date: Sun, 9 Nov 2003 10:26:14 -0800 From: John-Mark Gurney To: Igor Sysoev Message-ID: <20031109182614.GH558@funkthat.com> Mail-Followup-To: Igor Sysoev , Mike Silbersack , freebsd-hackers@freebsd.org, Vivek Pai , Alan Cox References: <20031109033026.GF558@funkthat.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.4.1i X-Operating-System: FreeBSD 4.2-RELEASE i386 X-PGP-Fingerprint: B7 EC EF F8 AE ED A7 31 96 7A 22 B3 D8 56 36 F4 X-Files: The truth is out there X-URL: http://resnet.uoregon.edu/~gurney_j/ X-Resume: http://resnet.uoregon.edu/~gurney_j/resume.html cc: freebsd-hackers@freebsd.org cc: Vivek Pai cc: Alan Cox Subject: Re: Update: Debox sendfile modifications X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list Reply-To: John-Mark Gurney List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 09 Nov 2003 18:26:25 -0000 Igor Sysoev wrote this message on Sun, Nov 09, 2003 at 15:16 +0300: > On Sat, 8 Nov 2003, John-Mark Gurney wrote: > > > Igor Sysoev wrote this message on Wed, Nov 05, 2003 at 12:31 +0300: > > > I think it can done in the following way - a socket should have flag > > > that says that sendfile() had started the reading a page. > > > > layer violation... > > I do not think that it's layer violation. sendfile() works with > descriptor so it should know its state. It should know wheather > descriptor is non-blocking or has it enough buffer space. Ugh, yes, you are correct.. it is limited to sockets: if ((error = fgetsock(td, uap->s, &so, NULL)) != 0) goto done; if (so->so_type != SOCK_STREAM) { :( [...] > > If you made this a fd transparent operation then I would agree with > > it. > > The current sendfile() implementation works with sockets only. > Well, I agree that such sendfile() implementation is a hack. > Nowever this implementation is very usefull in the real world - > it allows to minimize a data copy in http and ftp servers. > > I just could not figure to myself where can be usefull the > high perfomance sendfile() to a pipe. It's not so much of how, but optimizing for the general case, not the specific case. I was using pipes as an example, what about for coping one fd to another? Right now cp will try to mmap a 16meg buffer, and use that, if it fails, it falls back to a read/write loop.. why not do something like copyfd that does it more optimally? > I think that it's better to leave sendfile() as a sending to a socket > only hack. I believe that any sendfile() generalization (e.g. sending > data from a socket to a file) is useless. oh? why do you think that is useless? What about all the applications like ftp clients, and wget/fetch/curl that do it on a regular basis? -- John-Mark Gurney Voice: +1 415 225 5579 "All that I will do, has been done, All that I have, has not." From owner-freebsd-hackers@FreeBSD.ORG Sun Nov 9 10:45:20 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 08ACD16A4CE for ; Sun, 9 Nov 2003 10:45:20 -0800 (PST) Received: from ganymede.hub.org (u46n208.hfx.eastlink.ca [24.222.46.208]) by mx1.FreeBSD.org (Postfix) with ESMTP id 2479F43FA3 for ; Sun, 9 Nov 2003 10:45:19 -0800 (PST) (envelope-from scrappy@hub.org) Received: by ganymede.hub.org (Postfix, from userid 1000) id D135F34524; Sun, 9 Nov 2003 14:43:04 -0400 (AST) Received: from localhost (localhost [127.0.0.1]) by ganymede.hub.org (Postfix) with ESMTP id CECA333DC2; Sun, 9 Nov 2003 14:43:04 -0400 (AST) Date: Sun, 9 Nov 2003 14:43:04 -0400 (AST) From: "Marc G. Fournier" To: Alexey Dokuchaev In-Reply-To: <20031109085459.GA31751@regency.nsu.ru> Message-ID: <20031109143838.X12394@ganymede.hub.org> References: <20031109085459.GA31751@regency.nsu.ru> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII cc: hackers@freebsd.org Subject: Re: Status of unionfs in -STABLE X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 09 Nov 2003 18:45:20 -0000 On Sun, 9 Nov 2003, Alexey Dokuchaev wrote: > Hi there, > > Recently I've began to consider making some use of unionfs in > (semi-)production environment. Can someone aware of its current status > in -STABLE comment a bit on this subject? I use it *quite* extensively on all my production servers ... one is running >90 unionfs mounted file systems to service as many jail'd environments ... current uptime on all 4 servers is *knock on wood* 27 days, without incident. There are a couple of conditions that I've noticed can force a crash as a result of unionfs, pkg_delete seeming to be one of them, and trying to work with a UNIX socket being the other ... Beyond that, I've been using unionfs for almost 2 years now ... there was a period there where I was hitting some major limits with vfs "file descriptors" that both Tor and David did work on ... but, beyond those, I've not been disappointed with using unionfs ... One caveat I will say though ... if it crashes, fsck is *painfully* slow ... unionfs creates a bunch of 'zero length directories', and fsck has to go through and clear each and every one of those ... I've had fsck's last >11hrs on a 100Gig file system :) From owner-freebsd-hackers@FreeBSD.ORG Sun Nov 9 13:36:22 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 70F7716A4CE; Sun, 9 Nov 2003 13:36:22 -0800 (PST) Received: from VARK.homeunix.com (adsl-68-123-40-77.dsl.pltn13.pacbell.net [68.123.40.77]) by mx1.FreeBSD.org (Postfix) with ESMTP id 942B943F75; Sun, 9 Nov 2003 13:36:21 -0800 (PST) (envelope-from das@FreeBSD.ORG) Received: from VARK.homeunix.com (localhost [127.0.0.1]) by VARK.homeunix.com (8.12.9/8.12.9) with ESMTP id hA9LYpen014114; Sun, 9 Nov 2003 13:34:51 -0800 (PST) (envelope-from das@FreeBSD.ORG) Received: (from das@localhost) by VARK.homeunix.com (8.12.9/8.12.9/Submit) id hA9LYo39014113; Sun, 9 Nov 2003 13:34:50 -0800 (PST) (envelope-from das@FreeBSD.ORG) Date: Sun, 9 Nov 2003 13:34:50 -0800 From: David Schultz To: Christian Laursen Message-ID: <20031109213450.GB13982@VARK.homeunix.com> Mail-Followup-To: Christian Laursen , Lukas Ertl , hackers@FreeBSD.ORG, phk@FreeBSD.ORG References: <20031109003617.K626@korben.in.tern> <20031109023041.GA9171@VARK.homeunix.com> <868ympydcx.fsf@borg.borderworlds.dk> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <868ympydcx.fsf@borg.borderworlds.dk> cc: hackers@FreeBSD.ORG cc: phk@FreeBSD.ORG cc: Lukas Ertl Subject: Re: geom_mirror implementation X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 09 Nov 2003 21:36:22 -0000 On Sun, Nov 09, 2003, Christian Laursen wrote: > David Schultz writes: > > > On Sun, Nov 09, 2003, Lukas Ertl wrote: > > > Hi hackers@, > > > > > > I've played around with GEOM a bit and beefed up geom_mirror, which is > > > already in the tree but not built yet. > > > > > > You can find the patch at . > > > > Hmm...I believe geom_mirror is supposed to be an example, and > > geom_ccd is supposed to be the production mirroring implementation. > > ccd does have its quirks, though... > > Last time I checked ccd needed to be manually reconfigured to run in > degraded mode and sync is not possible. In my book that's not good > enough for production. > > Furthermore it would be nice with a mirror implementation that > automatically syncs the mirror after an unclean shutdown. Yeah, RAID support in FreeBSD is in a rather sorry state right now. ccd(4) doesn't work with ATAng on my machine without causing panics and data corruption, raidframe is broken in -CURRENT, and vinum tends to lag behind changes and break. But that doesn't mean that the right solution is to add a *fourth* incompatible RAID implementation. If there's a good reason ccd(4) is harder to fix than geom_mirror, then you might want to talk to phk about rewriting geom_ccd based on geom_mirror. I believe scottl and phk have plans to fix raidframe, though, which would address a lot of the present limitations. From owner-freebsd-hackers@FreeBSD.ORG Sun Nov 9 13:48:43 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 938CE16A4CE; Sun, 9 Nov 2003 13:48:43 -0800 (PST) Received: from mailbox.univie.ac.at (mailbox.univie.ac.at [131.130.1.27]) by mx1.FreeBSD.org (Postfix) with ESMTP id 6A46943FBF; Sun, 9 Nov 2003 13:48:42 -0800 (PST) (envelope-from l.ertl@univie.ac.at) Received: from wireless (adslle.cc.univie.ac.at [131.130.102.11]) hA9LmPhN601706; Sun, 9 Nov 2003 22:48:27 +0100 Date: Sun, 9 Nov 2003 22:48:20 +0100 (CET) From: Lukas Ertl To: David Schultz In-Reply-To: <20031109213450.GB13982@VARK.homeunix.com> Message-ID: <20031109224505.E58774@korben.in.tern> References: <20031109003617.K626@korben.in.tern> <20031109023041.GA9171@VARK.homeunix.com> <20031109213450.GB13982@VARK.homeunix.com> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII X-DCC-ZID-Univie-Metrics: imap 4244; Body=0 Fuz1=0 Fuz2=0 cc: hackers@FreeBSD.ORG cc: Christian Laursen cc: phk@FreeBSD.ORG Subject: Re: geom_mirror implementation X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 09 Nov 2003 21:48:43 -0000 On Sun, 9 Nov 2003, David Schultz wrote: > Yeah, RAID support in FreeBSD is in a rather sorry state right > now. ccd(4) doesn't work with ATAng on my machine without causing > panics and data corruption, raidframe is broken in -CURRENT, and > vinum tends to lag behind changes and break. But that doesn't > mean that the right solution is to add a *fourth* incompatible > RAID implementation. Yes, this is a good point. The advantage I see in geom_mirror is that it fits into the GEOM framework and doesn't take a lot to set up. > If there's a good reason ccd(4) is harder to fix than geom_mirror, then > you might want to talk to phk about rewriting geom_ccd based on > geom_mirror. I believe scottl and phk have plans to fix raidframe, > though, which would address a lot of the present limitations. I haven't used ccd or raidframe before, and vinum is still a lot of 'voodoo'. I just wanted to play around and do something useful; furthermore I learned a real lot about GEOM internals. regards, le -- Lukas Ertl eMail: l.ertl@univie.ac.at UNIX Systemadministrator Tel.: (+43 1) 4277-14073 Vienna University Computer Center Fax.: (+43 1) 4277-9140 University of Vienna http://mailbox.univie.ac.at/~le/ From owner-freebsd-hackers@FreeBSD.ORG Sun Nov 9 14:07:09 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id EF40416A4CF; Sun, 9 Nov 2003 14:07:09 -0800 (PST) Received: from VARK.homeunix.com (adsl-68-123-40-77.dsl.pltn13.pacbell.net [68.123.40.77]) by mx1.FreeBSD.org (Postfix) with ESMTP id ED18E43FDD; Sun, 9 Nov 2003 14:07:08 -0800 (PST) (envelope-from das@FreeBSD.ORG) Received: from VARK.homeunix.com (localhost [127.0.0.1]) by VARK.homeunix.com (8.12.9/8.12.9) with ESMTP id hA9M5gen014255; Sun, 9 Nov 2003 14:05:42 -0800 (PST) (envelope-from das@FreeBSD.ORG) Received: (from das@localhost) by VARK.homeunix.com (8.12.9/8.12.9/Submit) id hA9M5gKK014254; Sun, 9 Nov 2003 14:05:42 -0800 (PST) (envelope-from das@FreeBSD.ORG) Date: Sun, 9 Nov 2003 14:05:42 -0800 From: David Schultz To: Lukas Ertl Message-ID: <20031109220542.GA14205@VARK.homeunix.com> Mail-Followup-To: Lukas Ertl , Christian Laursen , hackers@FreeBSD.ORG, phk@FreeBSD.ORG References: <20031109003617.K626@korben.in.tern> <20031109023041.GA9171@VARK.homeunix.com> <868ympydcx.fsf@borg.borderworlds.dk> <20031109213450.GB13982@VARK.homeunix.com> <20031109224505.E58774@korben.in.tern> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20031109224505.E58774@korben.in.tern> cc: hackers@FreeBSD.ORG cc: Christian Laursen cc: phk@FreeBSD.ORG Subject: Re: geom_mirror implementation X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 09 Nov 2003 22:07:10 -0000 On Sun, Nov 09, 2003, Lukas Ertl wrote: > > If there's a good reason ccd(4) is harder to fix than geom_mirror, then > > you might want to talk to phk about rewriting geom_ccd based on > > geom_mirror. I believe scottl and phk have plans to fix raidframe, > > though, which would address a lot of the present limitations. > > I haven't used ccd or raidframe before, and vinum is still a lot of > 'voodoo'. I just wanted to play around and do something useful; > furthermore I learned a real lot about GEOM internals. If you're feeling up to it, I think people would much appreciate some of the problems in ccd being fixed. One of the things that ccd needs and that is probably pretty straightforward is a better algorithm to select which side of the mirror to read from. The present algorithm is broken and generally winds up with one of the disks satisfying all the requests unless a read error is reported. From owner-freebsd-hackers@FreeBSD.ORG Sun Nov 9 14:23:56 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id E2C3216A4CE; Sun, 9 Nov 2003 14:23:56 -0800 (PST) Received: from spider.deepcore.dk (cpe.atm2-0-53484.0x50a6c9a6.abnxx9.customer.tele.dk [80.166.201.166]) by mx1.FreeBSD.org (Postfix) with ESMTP id AAE1643FCB; Sun, 9 Nov 2003 14:23:55 -0800 (PST) (envelope-from sos@spider.deepcore.dk) Received: from spider.deepcore.dk (localhost [127.0.0.1]) by spider.deepcore.dk (8.12.10/8.12.10) with ESMTP id hA9MOZuU008681; Sun, 9 Nov 2003 23:24:35 +0100 (CET) (envelope-from sos@spider.deepcore.dk) Received: (from sos@localhost) by spider.deepcore.dk (8.12.10/8.12.10/Submit) id hA9MOZ8v008680; Sun, 9 Nov 2003 23:24:35 +0100 (CET) (envelope-from sos) From: Soren Schmidt Message-Id: <200311092224.hA9MOZ8v008680@spider.deepcore.dk> In-Reply-To: <20031109224505.E58774@korben.in.tern> To: Lukas Ertl Date: Sun, 9 Nov 2003 23:24:34 +0100 (CET) X-Mailer: ELM [version 2.4ME+ PL99f (25)] MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Content-Type: text/plain; charset=ISO-8859-1 X-mail-scanned: by DeepCore Virus & Spam killer v1.3 cc: David Schultz cc: hackers@FreeBSD.ORG Subject: Re: geom_mirror implementation X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 09 Nov 2003 22:23:57 -0000 It seems Lukas Ertl wrote: > > If there's a good reason ccd(4) is harder to fix than geom_mirror, then > > you might want to talk to phk about rewriting geom_ccd based on > > geom_mirror. I believe scottl and phk have plans to fix raidframe, > > though, which would address a lot of the present limitations. > > I haven't used ccd or raidframe before, and vinum is still a lot of > 'voodoo'. I just wanted to play around and do something useful; > furthermore I learned a real lot about GEOM internals. HMM!! Maybe we could end up doing something usefull here for a change... I would *love* GEOM to grow RAIDX support, so that I just needed to write the read/write RAID config routines to support Promise/HPT/xxx RAID's. That would also mean we could end the miserable lifes of ataraid/vinum/raidframe, which would be a reallygood thing (tm). But I'll bet this sensible a solution to the RAID problems will drown in religion/warfare/bikesheds between those involded in the above RAID solutions and the usual whiners/armchair generals. But count me in for this!! -Sĝren From owner-freebsd-hackers@FreeBSD.ORG Mon Nov 10 00:24:03 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id AF7E016A4D0 for ; Mon, 10 Nov 2003 00:24:03 -0800 (PST) Received: from arginine.spc.org (arginine.spc.org [195.206.69.236]) by mx1.FreeBSD.org (Postfix) with ESMTP id 7CAA443FBF for ; Mon, 10 Nov 2003 00:24:01 -0800 (PST) (envelope-from bms@spc.org) Received: from localhost (localhost [127.0.0.1]) by arginine.spc.org (Postfix) with ESMTP id 0F1BC65211; Sun, 9 Nov 2003 07:56:19 +0000 (GMT) Received: from arginine.spc.org ([127.0.0.1]) by localhost (arginine.spc.org [127.0.0.1]) (amavisd-new, port 10024) with LMTP id 34977-04; Sun, 9 Nov 2003 07:56:18 +0000 (GMT) Received: from saboteur.dek.spc.org (unknown [82.147.19.91]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by arginine.spc.org (Postfix) with ESMTP id 21DF46520F; Sun, 9 Nov 2003 07:56:18 +0000 (GMT) Received: by saboteur.dek.spc.org (Postfix, from userid 1001) id 49FBDF; Sun, 9 Nov 2003 07:56:17 +0000 (GMT) Date: Sun, 9 Nov 2003 07:56:17 +0000 From: Bruce M Simpson To: Craig StJean Message-ID: <20031109075617.GK683@saboteur.dek.spc.org> Mail-Followup-To: Craig StJean , freebsd-hackers@freebsd.org References: <410-22003110931122484@earthlink.net> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <410-22003110931122484@earthlink.net> cc: freebsd-hackers@freebsd.org Subject: Re: Driver question X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 10 Nov 2003 08:24:03 -0000 Craig, On Sat, Nov 08, 2003 at 10:11:22PM -0500, Craig StJean wrote: > I have a prism2 USB wireless device. I've never written drivers before but I have been developing for the past 8 years. Could someone guide me to a website or something that would help me write a USB wrapper for the wi device? I have a copy of the old uwi driver which is now broken so it may help me along the way aswell. I'd suggest co-ordinating your efforts with Stuart Walsh who wrote the atwi USB driver. This is for atmel USB parts, but there are certain devices with the same VID/PIDs which are prism2 USB devices. His code might serve as a good starting point for you. Regards, BMS From owner-freebsd-hackers@FreeBSD.ORG Mon Nov 10 00:52:10 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 8F53916A4CE; Mon, 10 Nov 2003 00:52:10 -0800 (PST) Received: from milla.ask33.net (milla.ask33.net [217.197.166.60]) by mx1.FreeBSD.org (Postfix) with ESMTP id 8B79F43F93; Mon, 10 Nov 2003 00:52:09 -0800 (PST) (envelope-from nick@milla.ask33.net) Received: by milla.ask33.net (Postfix, from userid 1001) id 449223ABB35; Mon, 10 Nov 2003 09:51:16 +0100 (CET) Date: Mon, 10 Nov 2003 09:51:15 +0100 From: Pawel Jakub Dawidek To: Christian Laursen , Lukas Ertl , hackers@FreeBSD.ORG, phk@FreeBSD.ORG Message-ID: <20031110085115.GE84474@garage.freebsd.pl> References: <20031109003617.K626@korben.in.tern> <20031109023041.GA9171@VARK.homeunix.com> <868ympydcx.fsf@borg.borderworlds.dk> <20031109213450.GB13982@VARK.homeunix.com> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-md5; protocol="application/pgp-signature"; boundary="ZEJJ1/LkT8WyxxO+" Content-Disposition: inline In-Reply-To: <20031109213450.GB13982@VARK.homeunix.com> X-PGP-Key-URL: http://garage.freebsd.pl/jules.asc X-OS: FreeBSD 4.8-RELEASE-p9 i386 X-URL: http://garage.freebsd.pl User-Agent: Mutt/1.5.1i Subject: Re: geom_mirror implementation X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 10 Nov 2003 08:52:10 -0000 --ZEJJ1/LkT8WyxxO+ Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Sun, Nov 09, 2003 at 01:34:50PM -0800, David Schultz wrote: +> > > > I've played around with GEOM a bit and beefed up geom_mirror, whic= h is +> > > > already in the tree but not built yet. +> > > >=20 +> > > > You can find the patch at . +> > >=20 +> > > Hmm...I believe geom_mirror is supposed to be an example, and +> > > geom_ccd is supposed to be the production mirroring implementation. = =20 +> > > ccd does have its quirks, though... +> >=20 +> > Last time I checked ccd needed to be manually reconfigured to run in +> > degraded mode and sync is not possible. In my book that's not good +> > enough for production. +> >=20 +> > Furthermore it would be nice with a mirror implementation that +> > automatically syncs the mirror after an unclean shutdown. +>=20 +> Yeah, RAID support in FreeBSD is in a rather sorry state right +> now. ccd(4) doesn't work with ATAng on my machine without causing +> panics and data corruption, raidframe is broken in -CURRENT, and +> vinum tends to lag behind changes and break. But that doesn't +> mean that the right solution is to add a *fourth* incompatible +> RAID implementation. If there's a good reason ccd(4) is harder to +> fix than geom_mirror, then you might want to talk to phk about +> rewriting geom_ccd based on geom_mirror. I believe scottl and phk +> have plans to fix raidframe, though, which would address a lot of +> the present limitations. Raidframe is going to be fixed by scottl@. This is a good news, but raidframe doesn't fit too good to GEOM infrastructure. GEOM gives flexibility which is duplicated by RF. I've start some work on more advance RAID implementation wich should fit to GEOM just fine. Every RAID level will be a different GEOM class, but with one configuration utility. All classes will share as many code as possible to be flexible in adding new RAID levels in futher. Strategy of choosing disks, failures handle, etc. should be also general. I want to provide support for many on-disk metadata formats if it will be possible. The bad news is that it is only a concept, I've only some initial code and project draft. I hope I'll find time to implement this. --=20 Pawel Jakub Dawidek pawel@dawidek.net UNIX Systems Programmer/Administrator http://garage.freebsd.pl Am I Evil? Yes, I Am! http://cerber.sourceforge.net --ZEJJ1/LkT8WyxxO+ Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.0.7 (FreeBSD) iQCVAwUBP69Rgz/PhmMH/Mf1AQFWvgP+N+5awW96gY4jV7nchcGEGiUtneUP/xTG 1OlUOKJwXTVO0+22w1whyQc/n/M6WnTUvZ0l/3sAn9FoJBYGvcLDLdPwHTYrJ6rn IOxWqX611kJTE9FPdyyP4la3rN+HiVocyqkIdwKOaiZbA8C+41eMmNqLuP5fiutg fjWpo4YiSSQ= =4iN8 -----END PGP SIGNATURE----- --ZEJJ1/LkT8WyxxO+-- From owner-freebsd-hackers@FreeBSD.ORG Mon Nov 10 00:56:44 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 8700716A4CE for ; Mon, 10 Nov 2003 00:56:44 -0800 (PST) Received: from mail.speakeasy.net (mail6.speakeasy.net [216.254.0.206]) by mx1.FreeBSD.org (Postfix) with ESMTP id 6951C43FB1 for ; Mon, 10 Nov 2003 00:56:43 -0800 (PST) (envelope-from jmg@hydrogen.funkthat.com) Received: (qmail 27495 invoked from network); 10 Nov 2003 08:56:42 -0000 Received: from unknown (HELO hydrogen.funkthat.com) ([69.17.45.168]) (envelope-sender ) by mail6.speakeasy.net (qmail-ldap-1.03) with SMTP for ; 10 Nov 2003 08:56:42 -0000 Received: from hydrogen.funkthat.com (jqdovs@localhost.funkthat.com [127.0.0.1])hAA8ufgP075153; Mon, 10 Nov 2003 00:56:41 -0800 (PST) (envelope-from jmg@hydrogen.funkthat.com) Received: (from jmg@localhost) by hydrogen.funkthat.com (8.12.10/8.12.10/Submit) id hAA8ueYo075152; Mon, 10 Nov 2003 00:56:40 -0800 (PST) Date: Mon, 10 Nov 2003 00:56:40 -0800 From: John-Mark Gurney To: andi payn Message-ID: <20031110085640.GB64793@funkthat.com> Mail-Followup-To: andi payn , freebsd-hackers@freebsd.org References: <1067529247.36829.2138.camel@verdammt.falcotronic.net> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <1067529247.36829.2138.camel@verdammt.falcotronic.net> User-Agent: Mutt/1.4.1i X-Operating-System: FreeBSD 4.2-RELEASE i386 X-PGP-Fingerprint: B7 EC EF F8 AE ED A7 31 96 7A 22 B3 D8 56 36 F4 X-Files: The truth is out there X-URL: http://resnet.uoregon.edu/~gurney_j/ X-Resume: http://resnet.uoregon.edu/~gurney_j/resume.html cc: freebsd-hackers@freebsd.org Subject: Re: kevent and related stuff X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list Reply-To: John-Mark Gurney List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 10 Nov 2003 08:56:44 -0000 andi payn wrote this message on Thu, Oct 30, 2003 at 07:54 -0800: > * The kevent mechanism doesn't monitor directories in a sufficient way > to make fam happy. If you change a file in a directory that you're > watching, unlike imon or dnotify, kevent won't see anything worth > reporting at all. This means that for directory monitoring, kevent is > useless as-is. Again, if I wanted to patch kevent to provide this > additional notification, would others want this? This is to prevent running out of memory.. one of the great advantages of kqueue's is that all memory necessary is allocated at the time the event is posted. If kevent successfully set your event, then you know you'll get all instances of the event. The problem with putting a notify on a directory and having it watch the children is that file's ATIMES change w/o the directory knowing about it. Are you suggesting that files start to know which directory they are located in? What happens when you link the same file into the directory thousands of times? Do you get the one notification or thousands of notifications? The solution to that is to open each file in the directory, and monitor that. You also monitor the directory for changes to get notified of any new or removed files. As for getting notified of atime, etc, it shouldn't be hard to add a VN_KNOTE(vp, NOTE_ATTRIB); to ufs_itimes, though you should only post it if any of the three times get modified. -- John-Mark Gurney Voice: +1 415 225 5579 "All that I will do, has been done, All that I have, has not." From owner-freebsd-hackers@FreeBSD.ORG Mon Nov 10 01:09:45 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id ACFE716A4CE for ; Mon, 10 Nov 2003 01:09:45 -0800 (PST) Received: from mail.speakeasy.net (mail6.speakeasy.net [216.254.0.206]) by mx1.FreeBSD.org (Postfix) with ESMTP id 9FE0A43FF3 for ; Mon, 10 Nov 2003 01:09:44 -0800 (PST) (envelope-from jmg@hydrogen.funkthat.com) Received: (qmail 947 invoked from network); 10 Nov 2003 09:09:44 -0000 Received: from unknown (HELO hydrogen.funkthat.com) ([69.17.45.168]) (envelope-sender ) by mail6.speakeasy.net (qmail-ldap-1.03) with SMTP for ; 10 Nov 2003 09:09:44 -0000 Received: from hydrogen.funkthat.com (zcdsdy@localhost.funkthat.com [127.0.0.1])hAA99hgP075520; Mon, 10 Nov 2003 01:09:43 -0800 (PST) (envelope-from jmg@hydrogen.funkthat.com) Received: (from jmg@localhost) by hydrogen.funkthat.com (8.12.10/8.12.10/Submit) id hAA99gM7075519; Mon, 10 Nov 2003 01:09:42 -0800 (PST) Date: Mon, 10 Nov 2003 01:09:42 -0800 From: John-Mark Gurney To: Sean McNeil Message-ID: <20031110090942.GC64793@funkthat.com> Mail-Followup-To: Sean McNeil , freebsd-hackers@freebsd.org References: <1067726450.65578.6.camel@blue.mcneil.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <1067726450.65578.6.camel@blue.mcneil.com> User-Agent: Mutt/1.4.1i X-Operating-System: FreeBSD 4.2-RELEASE i386 X-PGP-Fingerprint: B7 EC EF F8 AE ED A7 31 96 7A 22 B3 D8 56 36 F4 X-Files: The truth is out there X-URL: http://resnet.uoregon.edu/~gurney_j/ X-Resume: http://resnet.uoregon.edu/~gurney_j/resume.html cc: freebsd-hackers@freebsd.org Subject: Re: question about user space addressed, mmap, and getting phys address X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list Reply-To: John-Mark Gurney List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 10 Nov 2003 09:09:45 -0000 Sean McNeil wrote this message on Sat, Nov 01, 2003 at 14:40 -0800: > Sorry I am not on the list, but I was hoping someone here might be able > to help me. I have a design that I cannot change that does the > following: > > 1) Calls mmap on a chunk of memory that the device driver uses to DMA to > a video decoder. > > 2) This chunk of memory is treated as several DMA buffers. There is an > ioctl setup to indicate when a section of that memory is being used and > when it is freed (usage count). > > I need to take the address from the mmap, add an offset, send it through > an ioctl, and then relate it back to the physical address that it was > originally mapped from. > > Unfortunately, the address I get from the ioctl is a user-space address > and when I use vtophys I get back 0. Is there some other mechanism to > convert a user-space address to a physical address? > > Any and all help will be greatly appreciated. I wrote a fucntion for a video encoder card that does this. I think passing in physical address is a bad thing, (and svgalib is nice and mmap's the video frame buffer for you) so I made my driver require you to pass the address via ioctl pointing to it's local buffer. The function is a bit long, but look at http://people.FreeBSD.org/~jmg/zoran-0.5.tar.gz in the file zoran-0.5/dev/zr/zr_os.c the function verify_contig. I've stolen that code from other parts of the kernel that do something similar, but I forget where now. -- John-Mark Gurney Voice: +1 415 225 5579 "All that I will do, has been done, All that I have, has not." From owner-freebsd-hackers@FreeBSD.ORG Mon Nov 10 01:32:23 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 07DC916A4CE for ; Mon, 10 Nov 2003 01:32:23 -0800 (PST) Received: from mail.speakeasy.net (mail6.speakeasy.net [216.254.0.206]) by mx1.FreeBSD.org (Postfix) with ESMTP id CAE5C43FD7 for ; Mon, 10 Nov 2003 01:32:20 -0800 (PST) (envelope-from jmg@hydrogen.funkthat.com) Received: (qmail 9039 invoked from network); 10 Nov 2003 09:32:20 -0000 Received: from unknown (HELO hydrogen.funkthat.com) ([69.17.45.168]) (envelope-sender ) by mail6.speakeasy.net (qmail-ldap-1.03) with SMTP for ; 10 Nov 2003 09:32:20 -0000 Received: from hydrogen.funkthat.com (ipknwl@localhost.funkthat.com [127.0.0.1])hAA9WIgP076043; Mon, 10 Nov 2003 01:32:19 -0800 (PST) (envelope-from jmg@hydrogen.funkthat.com) Received: (from jmg@localhost) by hydrogen.funkthat.com (8.12.10/8.12.10/Submit) id hAA9WGa9076042; Mon, 10 Nov 2003 01:32:16 -0800 (PST) Date: Mon, 10 Nov 2003 01:32:16 -0800 From: John-Mark Gurney To: Pawel Jakub Dawidek Message-ID: <20031110093215.GD64793@funkthat.com> Mail-Followup-To: Pawel Jakub Dawidek , Christian Laursen , Lukas Ertl , hackers@freebsd.org, phk@freebsd.org References: <20031109003617.K626@korben.in.tern> <20031109023041.GA9171@VARK.homeunix.com> <868ympydcx.fsf@borg.borderworlds.dk> <20031109213450.GB13982@VARK.homeunix.com> <20031110085115.GE84474@garage.freebsd.pl> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20031110085115.GE84474@garage.freebsd.pl> User-Agent: Mutt/1.4.1i X-Operating-System: FreeBSD 4.2-RELEASE i386 X-PGP-Fingerprint: B7 EC EF F8 AE ED A7 31 96 7A 22 B3 D8 56 36 F4 X-Files: The truth is out there X-URL: http://resnet.uoregon.edu/~gurney_j/ X-Resume: http://resnet.uoregon.edu/~gurney_j/resume.html cc: phk@freebsd.org cc: hackers@freebsd.org cc: Christian Laursen cc: Lukas Ertl Subject: Re: geom_mirror implementation X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list Reply-To: John-Mark Gurney List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 10 Nov 2003 09:32:23 -0000 Pawel Jakub Dawidek wrote this message on Mon, Nov 10, 2003 at 09:51 +0100: > I've start some work on more advance RAID implementation wich should > fit to GEOM just fine. Every RAID level will be a different GEOM class, > but with one configuration utility. All classes will share as many code as > possible to be flexible in adding new RAID levels in futher. Strategy > of choosing disks, failures handle, etc. should be also general. I want to > provide support for many on-disk metadata formats if it will be possible. > > The bad news is that it is only a concept, I've only some initial code > and project draft. I hope I'll find time to implement this. I think GEOM aware raid is a good idea, though it'd be cool to be able to support controllers/drives that have an onboard engine. I've heard of scsi drives that have an xor engine that can take a block of data, xor it with the on disk data, write the new data, and pass the xor'd data to the parity disk. I've started writing a raid4 style geom module. I've realized that this is more complex since blocks can come in at any time, and you have to be careful. One thing that I wouldn't mind would be the ability to stick a cache layer between two GEOM modules. Could we do this by tricky use of a vnode or something? Read caching with a write through cache is a must if you want decent performance in raid[45] configs. -- John-Mark Gurney Voice: +1 415 225 5579 "All that I will do, has been done, All that I have, has not." From owner-freebsd-hackers@FreeBSD.ORG Mon Nov 10 01:43:04 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 7731116A4CE for ; Mon, 10 Nov 2003 01:43:04 -0800 (PST) Received: from mail.speakeasy.net (mail8.speakeasy.net [216.254.0.208]) by mx1.FreeBSD.org (Postfix) with ESMTP id 5F3E043FCB for ; Mon, 10 Nov 2003 01:43:03 -0800 (PST) (envelope-from jmg@hydrogen.funkthat.com) Received: (qmail 6746 invoked from network); 10 Nov 2003 09:43:03 -0000 Received: from unknown (HELO hydrogen.funkthat.com) ([69.17.45.168]) (envelope-sender ) by mail8.speakeasy.net (qmail-ldap-1.03) with SMTP for ; 10 Nov 2003 09:43:03 -0000 Received: from hydrogen.funkthat.com (zyrozo@localhost.funkthat.com [127.0.0.1])hAA9h1gP076298; Mon, 10 Nov 2003 01:43:02 -0800 (PST) (envelope-from jmg@hydrogen.funkthat.com) Received: (from jmg@localhost) by hydrogen.funkthat.com (8.12.10/8.12.10/Submit) id hAA9h1tg076297; Mon, 10 Nov 2003 01:43:01 -0800 (PST) Date: Mon, 10 Nov 2003 01:43:01 -0800 From: John-Mark Gurney To: TSaplin Mikhail Message-ID: <20031110094301.GE64793@funkthat.com> Mail-Followup-To: TSaplin Mikhail , freebsd-hackers@freebsd.org References: <200312091125.10365.tsmm@list.ru> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <200312091125.10365.tsmm@list.ru> User-Agent: Mutt/1.4.1i X-Operating-System: FreeBSD 4.2-RELEASE i386 X-PGP-Fingerprint: B7 EC EF F8 AE ED A7 31 96 7A 22 B3 D8 56 36 F4 X-Files: The truth is out there X-URL: http://resnet.uoregon.edu/~gurney_j/ X-Resume: http://resnet.uoregon.edu/~gurney_j/resume.html cc: freebsd-hackers@freebsd.org Subject: Re: config and opt_*h files, how it works? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list Reply-To: John-Mark Gurney List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 10 Nov 2003 09:43:04 -0000 TSaplin Mikhail wrote this message on Tue, Dec 09, 2003 at 11:25 +0600: > I want add some my own options to kernel. > I've add "U04_KOI8R opt_cdunicode.h" to sys/conf/options, > and #include "opt_cdunicode.h" to source files. > > But when i do make depend, mkdep cant find opt_cdunicode.h > Whats wrong and how it works? Did you rerun config? the opt_*.h files are created by config, so if you modify the sys/conf/options files you need to rerun config. Hope this helps. P.S. You might want to fix the date on your computer. It's not yet December. -- John-Mark Gurney Voice: +1 415 225 5579 "All that I will do, has been done, All that I have, has not." From owner-freebsd-hackers@FreeBSD.ORG Mon Nov 10 01:52:51 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id A712316A4CE for ; Mon, 10 Nov 2003 01:52:51 -0800 (PST) Received: from mailbox.univie.ac.at (mailbox.univie.ac.at [131.130.1.27]) by mx1.FreeBSD.org (Postfix) with ESMTP id 442F343FE1 for ; Mon, 10 Nov 2003 01:52:48 -0800 (PST) (envelope-from l.ertl@univie.ac.at) Received: from pcle2.cc.univie.ac.at (pcle2.cc.univie.ac.at [131.130.2.177]) hAA9qdFA084580; Mon, 10 Nov 2003 10:52:42 +0100 Date: Mon, 10 Nov 2003 10:52:39 +0100 (CET) From: Lukas Ertl To: Pawel Jakub Dawidek In-Reply-To: <20031110085115.GE84474@garage.freebsd.pl> Message-ID: <20031110104725.S22613@pcle2.cc.univie.ac.at> References: <20031109003617.K626@korben.in.tern> <20031109023041.GA9171@VARK.homeunix.com> <20031109213450.GB13982@VARK.homeunix.com> <20031110085115.GE84474@garage.freebsd.pl> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII X-DCC-ZID-Univie-Metrics: mx1 4261; Body=0 Fuz1=0 Fuz2=0 cc: hackers@FreeBSD.ORG cc: Christian Laursen cc: phk@FreeBSD.ORG Subject: Re: geom_mirror implementation X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 10 Nov 2003 09:52:51 -0000 On Mon, 10 Nov 2003, Pawel Jakub Dawidek wrote: > I've start some work on more advance RAID implementation wich should > fit to GEOM just fine. Every RAID level will be a different GEOM class, > but with one configuration utility. All classes will share as many code as > possible to be flexible in adding new RAID levels in futher. Strategy > of choosing disks, failures handle, etc. should be also general. I want to > provide support for many on-disk metadata formats if it will be possible. Having a 'generic' RAID GEOM with individual RAID levels in subclasses sounds like a very good idea. The basic difference would be the routine that splits up IO requests according to the RAID level. regards, le -- Lukas Ertl eMail: l.ertl@univie.ac.at UNIX Systemadministrator Tel.: (+43 1) 4277-14073 Vienna University Computer Center Fax.: (+43 1) 4277-9140 University of Vienna http://mailbox.univie.ac.at/~le/ From owner-freebsd-hackers@FreeBSD.ORG Mon Nov 10 02:34:15 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 847BC16A4D8 for ; Mon, 10 Nov 2003 02:34:15 -0800 (PST) Received: from cs.huji.ac.il (cs.huji.ac.il [132.65.16.30]) by mx1.FreeBSD.org (Postfix) with ESMTP id D5EEA43FE0 for ; Mon, 10 Nov 2003 02:34:14 -0800 (PST) (envelope-from danny@cs.huji.ac.il) Received: from pampa.cs.huji.ac.il ([132.65.80.32] ident=danny) by cs.huji.ac.il with esmtp id 1AJ9N1-000Bel-Io for freebsd-hackers@freebsd.org; Mon, 10 Nov 2003 12:34:07 +0200 X-Mailer: exmh version 2.6.3 04/04/2003 with nmh-1.0.4 To: freebsd-hackers@freebsd.org In-reply-to: Your message of Mon, 15 Sep 2003 22:56:20 +0200 . Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Date: Mon, 10 Nov 2003 12:34:07 +0200 From: Danny Braniss Message-Id: Subject: Re: EMCsq/SAN X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 10 Nov 2003 10:34:15 -0000 some time ago I asked if there was any experience with EMC/SAN/FiberChanel under FreeBSD, so for the record: Qlogic ISP 2300 PCI FC-AL Adapter connected to EMC/Clariion works, it's faster than any local disk/raids we've tried, but have no numbers to compare with other OS (Windows/Linux). danny From owner-freebsd-hackers@FreeBSD.ORG Mon Nov 10 06:15:06 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 7281B16A4CE for ; Mon, 10 Nov 2003 06:15:06 -0800 (PST) Received: from park.rambler.ru (park.rambler.ru [81.19.64.101]) by mx1.FreeBSD.org (Postfix) with ESMTP id 8E87443FE5 for ; Mon, 10 Nov 2003 06:15:04 -0800 (PST) (envelope-from is@rambler-co.ru) Received: from is.park.rambler.ru (is.park.rambler.ru [81.19.64.102]) by park.rambler.ru (8.12.6/8.12.6) with ESMTP id hAAEENJ6030202; Mon, 10 Nov 2003 17:14:23 +0300 (MSK) (envelope-from is@rambler-co.ru) Date: Mon, 10 Nov 2003 17:14:23 +0300 (MSK) From: Igor Sysoev X-Sender: is@is.park.rambler.ru To: John-Mark Gurney In-Reply-To: <20031109182614.GH558@funkthat.com> Message-ID: MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII cc: freebsd-hackers@freebsd.org cc: Vivek Pai cc: Alan Cox Subject: Re: Update: Debox sendfile modifications X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 10 Nov 2003 14:15:06 -0000 On Sun, 9 Nov 2003, John-Mark Gurney wrote: > Igor Sysoev wrote this message on Sun, Nov 09, 2003 at 15:16 +0300: > > > If you made this a fd transparent operation then I would agree with > > > it. > > > > The current sendfile() implementation works with sockets only. > > Well, I agree that such sendfile() implementation is a hack. > > Nowever this implementation is very usefull in the real world - > > it allows to minimize a data copy in http and ftp servers. > > > > I just could not figure to myself where can be usefull the > > high perfomance sendfile() to a pipe. > > It's not so much of how, but optimizing for the general case, not > the specific case. I was using pipes as an example, what about for > coping one fd to another? Right now cp will try to mmap a 16meg buffer, > and use that, if it fails, it falls back to a read/write loop.. why > not do something like copyfd that does it more optimally? > > > I think that it's better to leave sendfile() as a sending to a socket > > only hack. I believe that any sendfile() generalization (e.g. sending > > data from a socket to a file) is useless. > > oh? why do you think that is useless? What about all the applications > like ftp clients, and wget/fetch/curl that do it on a regular basis? To notice some perfomance impact of using sendfile() in cp, wget, etc I need to run simultaneously hundreds of these applications. To see the perfomance impact of using sendfile() in http or ftp server I need to serve hundreds of clients. The first case is too rare while the second one is common for the busy servers. Igor Sysoev http://sysoev.ru/en/ From owner-freebsd-hackers@FreeBSD.ORG Mon Nov 10 09:38:23 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 9BB2716A4CE for ; Mon, 10 Nov 2003 09:38:23 -0800 (PST) Received: from harmony.village.org (rover.bsdimp.com [204.144.255.66]) by mx1.FreeBSD.org (Postfix) with ESMTP id AC4DB43FAF for ; Mon, 10 Nov 2003 09:38:22 -0800 (PST) (envelope-from imp@bsdimp.com) Received: from localhost (warner@rover2.village.org [10.0.0.1]) by harmony.village.org (8.12.9p2/8.12.9) with ESMTP id hAAHc3eG034819; Mon, 10 Nov 2003 10:38:04 -0700 (MST) (envelope-from imp@bsdimp.com) Date: Mon, 10 Nov 2003 10:35:58 -0700 (MST) Message-Id: <20031110.103558.58456706.imp@bsdimp.com> To: bms@spc.org From: "M. Warner Losh" In-Reply-To: <20031109075617.GK683@saboteur.dek.spc.org> References: <410-22003110931122484@earthlink.net> <20031109075617.GK683@saboteur.dek.spc.org> X-Mailer: Mew version 2.1 on Emacs 21.3 / Mule 5.0 (SAKAKI) Mime-Version: 1.0 Content-Type: Text/Plain; charset=us-ascii Content-Transfer-Encoding: 7bit cc: freebsd-hackers@freebsd.org cc: valiantsoul@earthlink.net Subject: Re: Driver question X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 10 Nov 2003 17:38:23 -0000 In message: <20031109075617.GK683@saboteur.dek.spc.org> Bruce M Simpson writes: : Craig, : : On Sat, Nov 08, 2003 at 10:11:22PM -0500, Craig StJean wrote: : > I have a prism2 USB wireless device. I've never written drivers before but I have been developing for the past 8 years. Could someone guide me to a website or something that would help me write a USB wrapper for the wi device? I have a copy of the old uwi driver which is now broken so it may help me along the way aswell. : : I'd suggest co-ordinating your efforts with Stuart Walsh who wrote the atwi : USB driver. This is for atmel USB parts, but there are certain devices with : the same VID/PIDs which are prism2 USB devices. His code might serve as a : good starting point for you. There's also an OpenBSD wi driver that has a USB attachment. Warner From owner-freebsd-hackers@FreeBSD.ORG Mon Nov 10 09:41:13 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 2CF7316A4CE for ; Mon, 10 Nov 2003 09:41:13 -0800 (PST) Received: from naughty.monkey.org (naughty.monkey.org [66.93.9.164]) by mx1.FreeBSD.org (Postfix) with ESMTP id 7E69643FA3 for ; Mon, 10 Nov 2003 09:41:12 -0800 (PST) (envelope-from marius@naughty.monkey.org) Received: by naughty.monkey.org (Postfix, from userid 6) id 7C4AC1BA93E; Mon, 10 Nov 2003 12:41:09 -0500 (EST) Date: Mon, 10 Nov 2003 12:41:09 -0500 From: marius aamodt eriksen To: hackers@openbsd.org, tech-kern@netbsd.org, freebsd-hackers@freebsd.org Message-ID: <20031110174109.GA13852@monkey.org> Mail-Followup-To: hackers@openbsd.org, tech-kern@netbsd.org, freebsd-hackers@freebsd.org, Niels Provos Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.3.99i cc: Niels Provos Subject: kqueue, NOTE_EOF X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list Reply-To: marius@monkey.org List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 10 Nov 2003 17:41:13 -0000 hi - in order to be able to preserve consistent semantics across poll, select, and kqueue (EVFILT_READ), i propose the following change: on EVFILT_READ, add an fflag NOTE_EOF which will return when the file pointer *is* at the end of the file (effectively always returning on EVFILT_READ, but setting the NOTE_EOF flag when it is at the end). specifically, this allows libevent[1] to behave consistently across underlying polling infrastructures (this has become a practical issue). in openbsd, this was a trivial change in filt_ufsread(): kn->kn_data = ip->i_ffs_size - kn->kn_fp->f_offset; +if (kn->kn_data == 0 && kn->kn_sfflags & NOTE_EOF) { + kn->kn_fflags |= NOTE_EOF; + return (1); +} + return (kn->kn_data != 0); (and adding NOTE_EOF to event.h, of course) what do you think about this? can it be integrated into netbsd and freebsd as well? i have discussed this with provos@, and we seem to agree this is a viable solution. thanks, marius. [1] http://monkey.org/~provos/libevent -- > marius@monkey.org > http://monkey.org/~marius From owner-freebsd-hackers@FreeBSD.ORG Mon Nov 10 18:52:04 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 6B83B16A4CE for ; Mon, 10 Nov 2003 18:52:04 -0800 (PST) Received: from mta11.adelphia.net (mta11.adelphia.net [68.168.78.205]) by mx1.FreeBSD.org (Postfix) with ESMTP id 1B56743FD7 for ; Mon, 10 Nov 2003 18:52:03 -0800 (PST) (envelope-from andi_payn@speedymail.org) Received: from [10.1.0.9] ([68.65.235.109]) by mta11.adelphia.net (InterMail vM.5.01.06.05 201-253-122-130-105-20030824) with ESMTP id <20031111025203.XXVT14094.mta11.adelphia.net@[10.1.0.9]>; Mon, 10 Nov 2003 21:52:03 -0500 From: andi payn To: Marco van de Voort In-Reply-To: <20031106140957.B1B1E93@toad.stack.nl> References: <20031106140957.B1B1E93@toad.stack.nl> Content-Type: text/plain Message-Id: <1068519118.3935.12.camel@verdammt.falcotronic.net> Mime-Version: 1.0 X-Mailer: Ximian Evolution 1.4.5 Date: Mon, 10 Nov 2003 18:51:58 -0800 Content-Transfer-Encoding: 7bit cc: freebsd-hackers@freebsd.org Subject: Re: Kylix in FreeBSD X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 11 Nov 2003 02:52:04 -0000 On Thu, 2003-11-06 at 06:09, Marco van de Voort wrote: > > * jasaorp [031031 04:59]: > > Getting the Kylix IDE to function on FreeBSD has been one of the ongoing > > hair-pulling tasks I undertake every few months. The installer alone is > > a pain in the ass, since it performs "compatibility checks" in such > > Linux-centric ways as hard-coding /bin/bash into the shell scripts, and > > searching for shared libraries by name from hard-coded paths. (GTK > > especially gives the installer fits because FreeBSD's gtk library has a > > -x11 at the end of the name.) But once you work around those issues > > with some creative symlinking and script editing, the console tools > > install fairly painlessly. A while back, someone put together a howto for installing Kylix on Mandrake (which, despite being a linux distro, also has the "wrong" names for many libraries, such as gtk-x11). If this is still being maintained, it might have some useful hints for getting/keeping it working on FreeBSD. > If you futs with getting Kylix to run under FreeBSD, don't forget the > special glibc requirements that some versions of Kylix have. Maybe you > should probably simply replace the entire /compat userland with the userland > of a distro that Kylix supprorts _with_ kylix extra patches installed? I managed to get Kylix sort of working by booting to linux, installing Kylix, rebooting to FreeBSD, then copying most of /mnt/linux to /compat/linux. Unfortunately, this also broke nearly all of my other linux ports.... Is there some documentation on what exactly FreeBSD expects to find there? For example, if I wanted to build a linux_base-mdk9.2, so I could more easily run all the binaries I have built/installed on a Mandrake 9.2 system, where would I start? From owner-freebsd-hackers@FreeBSD.ORG Mon Nov 10 19:19:42 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 7915016A4CE for ; Mon, 10 Nov 2003 19:19:42 -0800 (PST) Received: from mta9.adelphia.net (mta9.adelphia.net [68.168.78.199]) by mx1.FreeBSD.org (Postfix) with ESMTP id 9B2DE43FCB for ; Mon, 10 Nov 2003 19:19:41 -0800 (PST) (envelope-from andi_payn@speedymail.org) Received: from [10.1.0.9] ([68.65.235.109]) by mta9.adelphia.net (InterMail vM.5.01.06.05 201-253-122-130-105-20030824) with ESMTP id <20031111031944.MFF18020.mta9.adelphia.net@[10.1.0.9]>; Mon, 10 Nov 2003 22:19:44 -0500 From: andi payn To: Marco van de Voort In-Reply-To: <20031106140957.B1B1E93@toad.stack.nl> References: <20031106140957.B1B1E93@toad.stack.nl> Content-Type: text/plain Message-Id: <1068519118.3935.12.camel@verdammt.falcotronic.net> Mime-Version: 1.0 X-Mailer: Ximian Evolution 1.4.5 Date: Mon, 10 Nov 2003 19:19:39 -0800 Content-Transfer-Encoding: 7bit cc: freebsd-hackers@freebsd.org Subject: Re: Kylix in FreeBSD X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 11 Nov 2003 03:19:42 -0000 On Thu, 2003-11-06 at 06:09, Marco van de Voort wrote: > > * jasaorp [031031 04:59]: > > Getting the Kylix IDE to function on FreeBSD has been one of the ongoing > > hair-pulling tasks I undertake every few months. The installer alone is > > a pain in the ass, since it performs "compatibility checks" in such > > Linux-centric ways as hard-coding /bin/bash into the shell scripts, and > > searching for shared libraries by name from hard-coded paths. (GTK > > especially gives the installer fits because FreeBSD's gtk library has a > > -x11 at the end of the name.) But once you work around those issues > > with some creative symlinking and script editing, the console tools > > install fairly painlessly. A while back, someone put together a howto for installing Kylix on Mandrake (which, despite being a linux distro, also has the "wrong" names for many libraries, such as gtk-x11). If this is still being maintained, it might have some useful hints for getting/keeping it working on FreeBSD. > If you futs with getting Kylix to run under FreeBSD, don't forget the > special glibc requirements that some versions of Kylix have. Maybe you > should probably simply replace the entire /compat userland with the userland > of a distro that Kylix supprorts _with_ kylix extra patches installed? I managed to get Kylix sort of working by booting to linux, installing Kylix, rebooting to FreeBSD, then copying most of /mnt/linux to /compat/linux. Unfortunately, this also broke nearly all of my other linux ports.... Is there some documentation on what exactly FreeBSD expects to find there? For example, if I wanted to build a linux_base-mdk9.2, so I could more easily run all the binaries I have built/installed on a Mandrake 9.2 system, where would I start? From owner-freebsd-hackers@FreeBSD.ORG Mon Nov 10 21:10:55 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 4508416A4CE; Mon, 10 Nov 2003 21:10:55 -0800 (PST) Received: from ms-smtp-03-eri0.southeast.rr.com (ms-smtp-03-lbl.southeast.rr.com [24.25.9.102]) by mx1.FreeBSD.org (Postfix) with ESMTP id 2B1F243F85; Mon, 10 Nov 2003 21:10:53 -0800 (PST) (envelope-from jason@ec.rr.com) Received: from ec.rr.com (cpe-024-211-231-149.ec.rr.com [24.211.231.149]) hAB5AoOi013249; Tue, 11 Nov 2003 00:10:51 -0500 (EST) Message-ID: <3FB06F35.40402@ec.rr.com> Date: Tue, 11 Nov 2003 00:10:13 -0500 From: Jason User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; en-US; rv:1.5) Gecko/20031205 Thunderbird/0.3 X-Accept-Language: en-us, en MIME-Version: 1.0 To: freebsd-current@freebsd.org, freebsd-hackers@freebsd.org Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: Symantec AntiVirus Scan Engine Subject: driver problem without lock held X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 11 Nov 2003 05:10:55 -0000 Here is the error: drm0: port 0xa000-0xa0ff mem 0xec020000-0xec02ffff,0xe0000000-0xe7ffffff irq 10 at device 0.0 on pci2 info: [drm] Initialized radeon 1.9.0 20020828 on minor 0 error: [drm:radeon_cp_init] *ERROR* radeon_cp_init called without lock held error: [drm:radeon_unlock] *ERROR* Process 512 using kernel context 0 Now are there any suggestions on what is causing this or how to fix this? I have a nforce2 epox 8rda, freebsd 5.1, and cvsuped and did a buildworld today. Thanks, Jason From owner-freebsd-hackers@FreeBSD.ORG Mon Nov 10 23:19:23 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 9C9DD16A4CE for ; Mon, 10 Nov 2003 23:19:23 -0800 (PST) Received: from mail2.dslextreme.com (mail2.dslextreme.com [66.51.199.52]) by mx1.FreeBSD.org (Postfix) with SMTP id E2A8A43FDD for ; Mon, 10 Nov 2003 23:19:22 -0800 (PST) (envelope-from jos@catnook.com) Received: (qmail 28478 invoked from network); 11 Nov 2003 07:19:21 -0000 Received: from unknown (HELO w250.z064001178.sjc-ca.dsl.cnc.net) (66.218.45.239) by 192.168.8.48 with SMTP; Tue, 11 Nov 2003 07:19:21 +0000 Received: (qmail 83983 invoked by uid 1000); 11 Nov 2003 07:19:44 -0000 Date: Mon, 10 Nov 2003 23:19:22 -0800 From: Jos Backus To: freebsd-hackers@freebsd.org Message-ID: <20031111071944.GA5778@lizzy.catnook.com> Mail-Followup-To: freebsd-hackers@freebsd.org References: <3F9CF3F6.8307.ABC1250@localhost> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <3F9CF3F6.8307.ABC1250@localhost> User-Agent: Mutt/1.5.5.1i Subject: Re: non-root process and PID files X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list Reply-To: jos@catnook.com List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 11 Nov 2003 07:19:23 -0000 On Mon, Oct 27, 2003 at 10:31:18AM -0500, Dan Langille wrote: > If a process starts up and does a setuid, should it be writing the > PID file before or after the setuid? > > Two methods exists AFAIK: > > 1 - write your PID immediately, and the file is chown root:wheel > 2 - write your PID to /var/run/myapp/myapp.pid where /var/run/myapp/ > is chown myapp:myapp > > Of the two, I think #1 is cleaner as it does not require another > directory with special permissions. > > Any suggestions? Why use pid files at all if you could be using a process supervisor instead? -- Jos Backus _/ _/_/_/ Sunnyvale, CA _/ _/ _/ _/ _/_/_/ _/ _/ _/ _/ jos at catnook.com _/_/ _/_/_/ require 'std/disclaimer' From owner-freebsd-hackers@FreeBSD.ORG Mon Nov 10 23:37:16 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 6F90516A4CE; Mon, 10 Nov 2003 23:37:16 -0800 (PST) Received: from VARK.homeunix.com (adsl-68-123-40-77.dsl.pltn13.pacbell.net [68.123.40.77]) by mx1.FreeBSD.org (Postfix) with ESMTP id 9C51C43FD7; Mon, 10 Nov 2003 23:37:15 -0800 (PST) (envelope-from das@FreeBSD.ORG) Received: from VARK.homeunix.com (localhost [127.0.0.1]) by VARK.homeunix.com (8.12.9/8.12.9) with ESMTP id hAB7Zren019778; Mon, 10 Nov 2003 23:35:53 -0800 (PST) (envelope-from das@FreeBSD.ORG) Received: (from das@localhost) by VARK.homeunix.com (8.12.9/8.12.9/Submit) id hAB7ZrMP019777; Mon, 10 Nov 2003 23:35:53 -0800 (PST) (envelope-from das@FreeBSD.ORG) Date: Mon, 10 Nov 2003 23:35:53 -0800 From: David Schultz To: Igor Serikov , FreeBSD Bugs , FreeBSD Hackers Message-ID: <20031111073553.GA14907@VARK.homeunix.com> Mail-Followup-To: Igor Serikov , FreeBSD Bugs , FreeBSD Hackers References: <3FA61A17.70605@turtle.freedns.us> <20031104081800.GA78439@VARK.homeunix.com> <3FA76D43.1040508@turtle.freedns.us> <20031104191526.GA79079@VARK.homeunix.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20031104191526.GA79079@VARK.homeunix.com> Subject: Re: rfork problem X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 11 Nov 2003 07:37:16 -0000 On Tue, Nov 04, 2003, David Schultz wrote: > On Tue, Nov 04, 2003, Igor Serikov wrote: > > > > David, > > > > Is it okay to have a condition that can be created by a mortal user and > > then cannot be changed by the root? The waiting process cannot be killed > > and would keep "waiting" till system reboot. Fixed in RELENG_4 in: src/sys/sys/unistd.h,v 1.22.2.3 src/sys/kern/kern_fork.c,v 1.72.2.16 From owner-freebsd-hackers@FreeBSD.ORG Tue Nov 11 00:10:01 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 48EBC16A4CE for ; Tue, 11 Nov 2003 00:10:01 -0800 (PST) Received: from hpna.infotecstt.ru (hpna.infotecstt.ru [80.68.0.217]) by mx1.FreeBSD.org (Postfix) with ESMTP id 3BCDA43FE3 for ; Tue, 11 Nov 2003 00:09:58 -0800 (PST) (envelope-from xm@x-infinity.com) Received: from XMWXP (ms69vi [80.68.3.184]) by hpna.infotecstt.ru (8.11.6/8.11.6) with ESMTP id hAB899S00913 for ; Tue, 11 Nov 2003 11:09:12 +0300 From: "Aristarkh A Zagorodnikov" To: Date: Tue, 11 Nov 2003 11:09:09 +0300 Message-ID: <000001c3a82b$1a678d80$0600a8c0@XMWXP> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable X-Priority: 3 (Normal) X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook, Build 10.0.4510 Importance: Normal X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2800.1165 Subject: PR bin/59167 fix question X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 11 Nov 2003 08:10:01 -0000 Hi! Recently, I submitted PR bin/59167 and I'm interested in the preferred way of fixing it. Below, I duplicate the "Fix" section of submitted PR for your convenience. Note that the following conclusions are made after only a brief looking = at the problem code so they may be partially or event completely wrong. The fix involves support for __SSTR and __SALC FILE flags in output = function which is called from internal formatting function __vfwprintf. Currently, __vfwprintf uses __fputwc for output, which in = turn uses __sputc which blindly writes characters and calls __swbuf when buffer is exhausted. In contrast, single-character internal formatting function __vfprintf uses __sfvwrite function to write output, which correctly handles __SSTR and __SALC FILE flags (reallocating the buffer) and does not exhibit the problem. So, proposed solutions are: 1. rewrite __vfwprintf output to use something other than __fputwc (i.e. = use __sfvwrite with some wcs->mbcs preprocessing?) 2. fix __fputwc to support the __SSTR and __SALC flags (bad idea, this function should be fast) 3. fix __swbuf to support the __SSTR and __SALC flags (looks good to me, especially because it's called at the exact time when buffer is about to overflow) I already concluded a quick patch using (3), but not tested it good = enough, so I'm not posting it here. If someone considers that my patch can be of any value, I will gladly = submit it for review. Aristarkh A Zagorodnikov X-Infinity Software From owner-freebsd-hackers@FreeBSD.ORG Tue Nov 11 09:04:25 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 1F85216A4D0 for ; Tue, 11 Nov 2003 09:04:25 -0800 (PST) Received: from amsfep13-int.chello.nl (amsfep13-int.chello.nl [213.46.243.24]) by mx1.FreeBSD.org (Postfix) with ESMTP id 7A0F143F93 for ; Tue, 11 Nov 2003 09:04:20 -0800 (PST) (envelope-from Reinier@Kleipool.org) Received: from titan.kleipool.org ([213.93.137.166]) by amsfep13-int.chello.nlESMTP <20031111170158.FVA1451.amsfep13-int.chello.nl@titan.kleipool.org> for ; Tue, 11 Nov 2003 18:01:58 +0100 Received: from io (io.ovs.kleipool.org [192.168.1.82]) by titan.kleipool.org (8.12.6/8.12.6) with SMTP id hABH1unk070685 for ; Tue, 11 Nov 2003 18:01:57 +0100 (CET) (envelope-from Reinier@Kleipool.org) From: "Reinier Kleipool" To: Date: Tue, 11 Nov 2003 18:01:55 +0100 Message-ID: <001701c3a875$836b1960$5201a8c0@ovs.kleipool.org> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit X-Priority: 3 (Normal) X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook CWS, Build 9.0.2416 (9.0.2911.0) X-MimeOLE: Produced By Microsoft MimeOLE V5.50.4925.2800 Importance: Normal Subject: kernel enviroment in sysctl MIB X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 11 Nov 2003 17:04:25 -0000 Hello, I am investigating the possiblilies for looking at the kernel boot parameters from within a userland utility. (Possibly a new FreeBSD install facility) The idea is that by looking at sysctl kern.environment.* you should be able to see the BTX variables. An install program could use this to see an INSTALL_SERVER=install.company.com variable (etc...) to use as install server. The BTX loader could provide these variables at install boot time, thus enableing fully automated installs. When I look at kern/kern_environment.c I see that the BTX loader provides its "environment variables" to the kernel. They show up in the kernel under char *kern_envp. When looking at this variable in the gdb debugger I see the first environment variable of the BTX loader: "LINES=24". I do not master the gdb enhough to see the next enviroment variable (I tried (kgdb) print kern_envp@2, but this does not show the variable after the first \0 character) but I am sure its there. My question is this: When looking at kern/kern_environmet.c I see routines that install a SYSCTL_NODE kern.environment. The sysctl_kernenv routine handles this node. What I do not understand is how the environment is returned from this routine. I suppose that at sys_init time you should traverse the environment once and install SYSCTL_ADD_STRING leaves for all environment variables. Then later sysctl calls could ask for the value of these strings. Am I right? Or does it work differently? When you issue the command "sysctl kern.environment" as root you see no output, but also no error! When you try "sysctl kern.environment.LINES" you do get an error I can understand why! No leaves were installed. What is wrong, and how can we fix it? Vriendelijke groet / Kind Regards, Reinier Kleipool, Network Engineer, Protocomix Rotterdamserijweg 122 3042 AS Rotterdam Tel 0654 227144 Fax 010 245 0902 Reinier@protocomix.nl From owner-freebsd-hackers@FreeBSD.ORG Tue Nov 11 09:41:55 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 825CD16A4CE for ; Tue, 11 Nov 2003 09:41:55 -0800 (PST) Received: from mail.speakeasy.net (mail5.speakeasy.net [216.254.0.205]) by mx1.FreeBSD.org (Postfix) with ESMTP id 1A50E43F3F for ; Tue, 11 Nov 2003 09:41:54 -0800 (PST) (envelope-from jhb@FreeBSD.org) Received: (qmail 4914 invoked from network); 11 Nov 2003 17:41:53 -0000 Received: from unknown (HELO server.baldwin.cx) ([216.27.160.63]) (envelope-sender )encrypted SMTP for ; 11 Nov 2003 17:41:53 -0000 Received: from laptop.baldwin.cx (gw1.twc.weather.com [216.133.140.1]) by server.baldwin.cx (8.12.9/8.12.9) with ESMTP id hABHfTce020091; Tue, 11 Nov 2003 12:41:29 -0500 (EST) (envelope-from jhb@FreeBSD.org) Message-ID: X-Mailer: XFMail 1.5.4 on FreeBSD X-Priority: 3 (Normal) Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 8bit MIME-Version: 1.0 In-Reply-To: <3FB06F35.40402@ec.rr.com> Date: Tue, 11 Nov 2003 12:41:27 -0500 (EST) From: John Baldwin To: Jason X-Spam-Checker-Version: SpamAssassin 2.55 (1.174.2.19-2003-05-19-exp) cc: freebsd-hackers@freebsd.org cc: freebsd-current@freebsd.org Subject: RE: driver problem without lock held X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 11 Nov 2003 17:41:55 -0000 On 11-Nov-2003 Jason wrote: > Here is the error: > > drm0: port 0xa000-0xa0ff mem > 0xec020000-0xec02ffff,0xe0000000-0xe7ffffff irq 10 at device 0.0 on pci2 > info: [drm] Initialized radeon 1.9.0 20020828 on minor 0 > error: [drm:radeon_cp_init] *ERROR* radeon_cp_init called without lock held > error: [drm:radeon_unlock] *ERROR* Process 512 using kernel context 0 > > Now are there any suggestions on what is causing this or how to fix > this? I have a nforce2 epox 8rda, freebsd 5.1, and cvsuped and did a > buildworld today. That is an issue in the radeon DRM driver. You can try asking on the DRI lists. -- John Baldwin <>< http://www.FreeBSD.org/~jhb/ "Power Users Use the Power to Serve!" - http://www.FreeBSD.org/ From owner-freebsd-hackers@FreeBSD.ORG Tue Nov 11 17:52:42 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id A2C7C16A4CE for ; Tue, 11 Nov 2003 17:52:42 -0800 (PST) Received: from lakemtao04.cox.net (lakemtao04.cox.net [68.1.17.241]) by mx1.FreeBSD.org (Postfix) with ESMTP id 05B9A43F3F for ; Tue, 11 Nov 2003 17:52:41 -0800 (PST) (envelope-from A.J.Caines@halplant.com) Received: from mail.halplant.com ([68.100.200.14]) by lakemtao04.cox.net (InterMail vM.5.01.06.05 201-253-122-130-105-20030824) with ESMTP id <20031112015240.NBDI19895.lakemtao04.cox.net@mail.halplant.com> for ; Tue, 11 Nov 2003 20:52:40 -0500 Received: by mail.halplant.com (Postfix, from userid 1001) id B6A33A4; Tue, 11 Nov 2003 20:52:39 -0500 (EST) Date: Tue, 11 Nov 2003 20:52:39 -0500 From: Andrew J Caines To: freebsd-hackers@freebsd.org Message-ID: <20031112015239.GM22572@hal9000.halplant.com> Mail-Followup-To: freebsd-hackers@freebsd.org References: <3F9CF3F6.8307.ABC1250@localhost> <20031111071944.GA5778@lizzy.catnook.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20031111071944.GA5778@lizzy.catnook.com> Organization: H.A.L. Plant X-PGP-Fingerprint: C59A 2F74 1139 9432 B457 0B61 DDF2 AA61 67C3 18A1 X-Powered-by: FreeBSD 4.9-STABLE X-URL: http://halplant.com:88/ X-Yahoo-Profile: AJ_Z0 X-ICQ: 283813972 Importance: Normal User-Agent: Mutt/1.5.4i Subject: Re: non-root process and PID files X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list Reply-To: Andrew J Caines List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 12 Nov 2003 01:52:42 -0000 On Mon, Oct 27, 2003 at 10:31:18AM -0500, Dan Langille wrote: > If a process starts up and does a setuid, should it be writing the > PID file before or after the setuid? After of course, since to do so before is using UID 0 to solve the wrong problem and creates the removal problem. > Any suggestions? Set /var/run to 1777 if you don't have untrusted users, or 1770 with daemons in the owning group if you do. I don't see any obvious serious problem introduced by doing this. My /var/run is on a small mfs. I don't recall if this is (now) default on install. Jos Backus said... > Why use pid files at all if you could be using a process supervisor instead? Because this requires the overhead of making the system, tools and admins familiar with the supervisor system. Then there's the resource overhead, the extra stuff to configure, etc. That hasn't stopped me putting my DNS cache, web server and distributed.net client under the watchful eye of supervise(8) (from DJB's daemontools[1]), though. [1] sysutils/daemontools, http://cr.yp.to/daemontools.html -Andrew- -- _______________________________________________________________________ | -Andrew J. Caines- Unix Systems Engineer A.J.Caines@halplant.com | | "They that can give up essential liberty to obtain a little temporary | | safety deserve neither liberty nor safety" - Benjamin Franklin, 1759 | From owner-freebsd-hackers@FreeBSD.ORG Wed Nov 12 00:58:17 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 6867F16A4CE for ; Wed, 12 Nov 2003 00:58:17 -0800 (PST) Received: from t2s5.tele2.cz (t2s5.tele2.cz [213.246.64.40]) by mx1.FreeBSD.org (Postfix) with SMTP id B8E3743F85 for ; Wed, 12 Nov 2003 00:58:15 -0800 (PST) (envelope-from dolecek@s102-n054.tele2.cz) Received: (qmail 5433 invoked from network); 12 Nov 2003 08:58:09 -0000 Received: from s102-n054.tele2.cz (213.246.102.54) by t2s5.tele2.cz with SMTP; 12 Nov 2003 08:58:09 -0000 Received: (from dolecek@localhost) by s102-n054.tele2.cz (8.12.9p1/8.12.9/Submit) id hAC8wFfg001905; Wed, 12 Nov 2003 09:58:15 +0100 (CET) From: Jaromir Dolecek Message-Id: <200311120858.hAC8wFfg001905@s102-n054.tele2.cz> In-Reply-To: <20031110174109.GA13852@monkey.org> To: marius@monkey.org Date: Wed, 12 Nov 2003 09:58:15 +0100 (CET) X-Mailer: ELM [version 2.4ME+ PL93 (25)] MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII cc: freebsd-hackers@freebsd.org cc: Niels Provos cc: hackers@openbsd.org cc: tech-kern@NetBSD.org Subject: Re: kqueue, NOTE_EOF X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 12 Nov 2003 08:58:17 -0000 marius aamodt eriksen wrote: > hi - > > in order to be able to preserve consistent semantics across poll, > select, and kqueue (EVFILT_READ), i propose the following change: on > EVFILT_READ, add an fflag NOTE_EOF which will return when the file > pointer *is* at the end of the file (effectively always returning on > EVFILT_READ, but setting the NOTE_EOF flag when it is at the end). > > specifically, this allows libevent[1] to behave consistently across > underlying polling infrastructures (this has become a practical > issue). I'm not sure I understand what is the exact issue. Why would this be necessary or what does this exactly solve? AFAIK poll() doesn't set any flags in this case neither, so I don't see how this is inconsistent. BTW, shouldn't the EOF flag be cleared when the file is extended? Jaromir -- Jaromir Dolecek http://www.NetBSD.cz/ -=- We should be mindful of the potential goal, but as the Buddhist -=- -=- masters say, ``You may notice during meditation that you -=- -=- sometimes levitate or glow. Do not let this distract you.'' -=- From owner-freebsd-hackers@FreeBSD.ORG Wed Nov 12 01:20:25 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id A4BD816A4CE; Wed, 12 Nov 2003 01:20:25 -0800 (PST) Received: from critter.freebsd.dk (critter.freebsd.dk [212.242.86.163]) by mx1.FreeBSD.org (Postfix) with ESMTP id 6709143F3F; Wed, 12 Nov 2003 01:20:24 -0800 (PST) (envelope-from phk@phk.freebsd.dk) Received: from critter.freebsd.dk (localhost [127.0.0.1]) by critter.freebsd.dk (8.12.10/8.12.10) with ESMTP id hAC9KNtB033134; Wed, 12 Nov 2003 10:20:23 +0100 (CET) (envelope-from phk@phk.freebsd.dk) To: David Schultz From: "Poul-Henning Kamp" In-Reply-To: Your message of "Sat, 08 Nov 2003 18:30:41 PST." <20031109023041.GA9171@VARK.homeunix.com> Date: Wed, 12 Nov 2003 10:20:23 +0100 Message-ID: <33133.1068628823@critter.freebsd.dk> cc: hackers@FreeBSD.ORG cc: Lukas Ertl Subject: Re: geom_mirror implementation X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 12 Nov 2003 09:20:25 -0000 In message <20031109023041.GA9171@VARK.homeunix.com>, David Schultz writes: >On Sun, Nov 09, 2003, Lukas Ertl wrote: >> Hi hackers@, >> >> I've played around with GEOM a bit and beefed up geom_mirror, which is >> already in the tree but not built yet. >> >> You can find the patch at . > >Hmm...I believe geom_mirror is supposed to be an example, and >geom_ccd is supposed to be the production mirroring implementation. >ccd does have its quirks, though... I guess I should just weigh in here: geom_mirror was meant mostly as a "hands on" example to inspire people writing GEOM classes. It is 100% inside the envelope to improve geom_mirror and provided the patches are sane I see no reason not to commit them. GEOM_CCD has many shortcomings and is only provided for backwards compatibility. It should die, rather than be improved. In general my position is that I would like to get a chance to see any patch committed to the GEOM infrastructure before it's committed (unless it is just trivial matters like typos etc: just go ahead). For individual GEOM classes I'll be happy to review and comment (time permitting) and generally don't care what people do as long as they don't break my system. With regards to the larger "volume management picture" I will reiterate my position: Ideally I would prefer to have a set of primitive GEOM classes, GEOM_MIRROR, GEOM_STRIPE, GEOM_RAID5 etc and a separate set of "controller" GEOM classes, GEOM_VINUM, GEOM_RF, GEOM_VERITAS, to recognize the various "traditional LVM" metadata on the disk, and from that metadata stack the primitive modules. This would in the long term give us the maximal flexibility and ability with the least code. But since I am not going to do that (lack of time), I will not try to impose my will on the people who are doing the work: GEOM is extensible enough for us to have any number of (competing) classes. So realistically I expect that we will some day soon see a GEOM_RAIDFRAME (I gather Pawel is trying to help Scott on this). Maybe we will also see a GEOM_VINUM class and who knows what else. And maybe some day down the road, somebody will pick up on the consolidation idea, or maybe he will instead show it to be hopelessly idealistic and burried it firmly. -- Poul-Henning Kamp | UNIX since Zilog Zeus 3.20 phk@FreeBSD.ORG | TCP/IP since RFC 956 FreeBSD committer | BSD since 4.3-tahoe Never attribute to malice what can adequately be explained by incompetence. From owner-freebsd-hackers@FreeBSD.ORG Wed Nov 12 02:22:10 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id E657A16A4CE for ; Wed, 12 Nov 2003 02:22:10 -0800 (PST) Received: from www.kukulies.org (www.kukulies.org [213.146.112.180]) by mx1.FreeBSD.org (Postfix) with ESMTP id A492343FBD for ; Wed, 12 Nov 2003 02:22:09 -0800 (PST) (envelope-from kuku@www.kukulies.org) Received: from www.kukulies.org (localhost [127.0.0.1]) by www.kukulies.org (8.12.10/8.12.6) with ESMTP id hACAM6oR018240 for ; Wed, 12 Nov 2003 11:22:07 +0100 (CET) (envelope-from kuku@www.kukulies.org) Received: (from kuku@localhost) by www.kukulies.org (8.12.10/8.12.6/Submit) id hACAM5mZ018239 for hackers@freebsd.org; Wed, 12 Nov 2003 11:22:05 +0100 (CET) Date: Wed, 12 Nov 2003 11:22:05 +0100 (CET) From: "C. Kukulies" Message-Id: <200311121022.hACAM5mZ018239@www.kukulies.org> To: hackers@freebsd.org Subject: Blade X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 12 Nov 2003 10:22:11 -0000 Anyone running FreeBSD on blade systems? Recommendable hardware vendor? -- Chris Christoph P. U. Kukulies kuku_at_physik.rwth-aachen.de From owner-freebsd-hackers@FreeBSD.ORG Wed Nov 12 02:45:06 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 3A2FF16A4CE for ; Wed, 12 Nov 2003 02:45:06 -0800 (PST) Received: from c1-2-6.rz.ruhr-uni-bochum.de (c1-2-6.rz.ruhr-uni-bochum.de [134.147.32.86]) by mx1.FreeBSD.org (Postfix) with SMTP id BE03543FBF for ; Wed, 12 Nov 2003 02:45:03 -0800 (PST) (envelope-from gandalf@nm.ruhr-uni-bochum.de) Received: (qmail 23563 invoked by uid 82); 12 Nov 2003 10:45:02 -0000 Received: from gandalf@nm.ruhr-uni-bochum.de by c1-2-6.rz.ruhr-uni-bochum.de by uid 80 with qmail-scanner-1.16 (sophie: 2.17/3.75. Clear:. Processed in 0.026768 secs); 12 Nov 2003 10:45:02 -0000 Received: from sunu450.rz.ruhr-uni-bochum.de (134.147.32.69) by c1-2-6.rz.ruhr-uni-bochum.de with SMTP; 12 Nov 2003 10:45:02 -0000 Received: (qmail 1701 invoked from network); 12 Nov 2003 10:45:02 -0000 Received: from server.nm.ruhr-uni-bochum.de (HELO mailhost.nm.ruhr-uni-bochum.de) (134.147.252.40) by sunu450.rz.ruhr-uni-bochum.de with SMTP; 12 Nov 2003 10:45:02 -0000 Received: (qmail 93347 invoked by uid 101); 12 Nov 2003 10:45:00 -0000 Received: from pc-o.nm.ruhr-uni-bochum.de (134.147.252.55) by server.nm.ruhr-uni-bochum.de with SMTP; 12 Nov 2003 10:45:00 -0000 Received: from pc-o.nm.ruhr-uni-bochum.de (localhost [127.0.0.1]) hACAixXB000883; Wed, 12 Nov 2003 11:45:00 +0100 (CET) (envelope-from gandalf@pc-o.nm.ruhr-uni-bochum.de) Received: (from gandalf@localhost)hACAixru000877; Wed, 12 Nov 2003 11:44:59 +0100 (CET) Date: Wed, 12 Nov 2003 11:44:59 +0100 From: Andre Grosse Bley To: John Baldwin Message-ID: <20031112104458.GA94744@nm.ruhr-uni-bochum.de> References: Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.4.1i cc: freebsd-hackers@FreeBSD.org Subject: Re: 4.9-RELEASE, ACPI and DELL Latitude D600 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 12 Nov 2003 10:45:06 -0000 > > Ah, the problem is that ACPI tries to sleep from a task, which is not safe > > to do. This is not easy to fix. :( > > Actually, it may not be too hard. In current, ACPI uses its own thread > to run the tasks in, so stable would need the same sort of thing. > Basically, ACPI needs to start up a kproc and needs to have its own > taskqueue again that uses this kproc for its execution context. So - as I am not a experienced kernel hacker - there is no easy solution for me to 'fix' this panic? Should I open a PR? Greetings, Andre From owner-freebsd-hackers@FreeBSD.ORG Wed Nov 12 02:59:39 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 4D96B16A4CE; Wed, 12 Nov 2003 02:59:39 -0800 (PST) Received: from milla.ask33.net (milla.ask33.net [217.197.166.60]) by mx1.FreeBSD.org (Postfix) with ESMTP id AEC2E43F85; Wed, 12 Nov 2003 02:59:36 -0800 (PST) (envelope-from nick@milla.ask33.net) Received: by milla.ask33.net (Postfix, from userid 1001) id 817003ABB2D; Wed, 12 Nov 2003 11:58:56 +0100 (CET) Date: Wed, 12 Nov 2003 11:58:56 +0100 From: Pawel Jakub Dawidek To: Poul-Henning Kamp Message-ID: <20031112105856.GJ84474@garage.freebsd.pl> References: <20031109023041.GA9171@VARK.homeunix.com> <33133.1068628823@critter.freebsd.dk> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-md5; protocol="application/pgp-signature"; boundary="nV0Xx5nODoP5kWxY" Content-Disposition: inline In-Reply-To: <33133.1068628823@critter.freebsd.dk> X-PGP-Key-URL: http://garage.freebsd.pl/jules.asc X-OS: FreeBSD 4.8-RELEASE-p9 i386 X-URL: http://garage.freebsd.pl User-Agent: Mutt/1.5.1i cc: David Schultz cc: hackers@FreeBSD.ORG cc: Lukas Ertl Subject: Re: geom_mirror implementation X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 12 Nov 2003 10:59:39 -0000 --nV0Xx5nODoP5kWxY Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Wed, Nov 12, 2003 at 10:20:23AM +0100, Poul-Henning Kamp wrote: +> With regards to the larger "volume management picture" I will +> reiterate my position: +>=20 +> Ideally I would prefer to have a set of primitive GEOM classes, +> GEOM_MIRROR, GEOM_STRIPE, GEOM_RAID5 etc and a separate set of +> "controller" GEOM classes, GEOM_VINUM, GEOM_RF, GEOM_VERITAS, to +> recognize the various "traditional LVM" metadata on the disk, and +> from that metadata stack the primitive modules. This would in the +> long term give us the maximal flexibility and ability with the +> least code. Actually I've done already GEOM_STRIPE class: http://garage.freebsd.pl/geom_stripe.tbz # stripe -v -s 65536 test /dev/da0 /dev/da1 /dev/da2 /dev/da3 Magic value stored on /dev/da0 Magic value stored on /dev/da1 Magic value stored on /dev/da2 Magic value stored on /dev/da3 # ls -l /dev/*.stripe /dev/test.stripe =46rom my tests it is a bit faster than ccd(4). +> So realistically I expect that we will some day soon see a +> GEOM_RAIDFRAME (I gather Pawel is trying to help Scott on this). Not really. I've start planing something different (see my previous mail). --=20 Pawel Jakub Dawidek pawel@dawidek.net UNIX Systems Programmer/Administrator http://garage.freebsd.pl Am I Evil? Yes, I Am! http://cerber.sourceforge.net --nV0Xx5nODoP5kWxY Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.0.7 (FreeBSD) iQCVAwUBP7ISbz/PhmMH/Mf1AQHpqQQAj43MB6D9N7ja8RWV5+VWKFL+CkfCXhyY ge9CdmiKPyF3pZrUNyTE3OLmQqa0AllXTzbQHg8Az6oz1ibyJhqvbmleVYzOVTc9 qng6ZJxVein4L03NV6FuxD2MAX+R1MYqAJ5BIOJaN9Ki7zKe6vlbIVXXxvHMi2v/ xhacem7TWvw= =kFbv -----END PGP SIGNATURE----- --nV0Xx5nODoP5kWxY-- From owner-freebsd-hackers@FreeBSD.ORG Wed Nov 12 07:01:01 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id B176516A4CE for ; Wed, 12 Nov 2003 07:01:01 -0800 (PST) Received: from gandalf.online.bg (gandalf.online.bg [217.75.128.9]) by mx1.FreeBSD.org (Postfix) with SMTP id E05B343FB1 for ; Wed, 12 Nov 2003 07:00:58 -0800 (PST) (envelope-from roam@ringlet.net) Received: (qmail 20953 invoked from network); 12 Nov 2003 14:59:42 -0000 Received: from office.sbnd.net (HELO straylight.ringlet.net) (217.75.140.130) by gandalf.online.bg with SMTP; 12 Nov 2003 14:59:41 -0000 Received: (qmail 3739 invoked by uid 1000); 12 Nov 2003 15:00:54 -0000 Date: Wed, 12 Nov 2003 17:00:54 +0200 From: Peter Pentchev To: Reinier Kleipool Message-ID: <20031112150054.GA453@straylight.oblivion.bg> Mail-Followup-To: Reinier Kleipool , freebsd-hackers@freebsd.org References: <001701c3a875$836b1960$5201a8c0@ovs.kleipool.org> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="WIyZ46R2i8wDzkSu" Content-Disposition: inline In-Reply-To: <001701c3a875$836b1960$5201a8c0@ovs.kleipool.org> User-Agent: Mutt/1.5.5.1i cc: freebsd-hackers@freebsd.org Subject: Re: kernel enviroment in sysctl MIB X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 12 Nov 2003 15:01:01 -0000 --WIyZ46R2i8wDzkSu Content-Type: text/plain; charset=windows-1251 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Tue, Nov 11, 2003 at 06:01:55PM +0100, Reinier Kleipool wrote: > Hello, >=20 > I am investigating the possiblilies for looking at the kernel boot > parameters from within a userland utility. (Possibly a new FreeBSD install > facility) The idea is that by looking at sysctl kern.environment.* you > should be able to see the BTX variables. An install program could use this > to see an INSTALL_SERVER=3Dinstall.company.com variable (etc...) to use as > install server. The BTX loader could provide these variables at install b= oot > time, thus enableing fully automated installs. [snip] > My question is this: When looking at kern/kern_environmet.c I see routines > that install a SYSCTL_NODE kern.environment. The sysctl_kernenv routine > handles this node. What I do not understand is how the environment is > returned from this routine. Take a look at the kenv(1) utility - its source is in the src/usr.bin/kenv/kenv.c file. There is a weird comment at line 74, where the kern.environment sysctl is accessed in a really 'magic & undocumented' way. Look at what it does - basically enumerating oid's =66rom a given starting point, the starting point being obtained in said 'magic & undocumented' way - and see if you could use the same approach. Alternatively, you could just invoke kenv(1) with your variables as command-line parameters from your program/script, although this might incur a performance cost. G'luck, Peter --=20 Peter Pentchev roam@ringlet.net roam@sbnd.net roam@FreeBSD.org PGP key: http://people.FreeBSD.org/~roam/roam.key.asc Key fingerprint FDBA FD79 C26F 3C51 C95E DF9E ED18 B68D 1619 4553 =2Esiht ekil ti gnidaer eb d'uoy ,werbeH ni erew ecnetnes siht fI --WIyZ46R2i8wDzkSu Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.3 (FreeBSD) iD8DBQE/sksm7Ri2jRYZRVMRAhVSAJ45V7VhY38gXM1+maZIzPgCS7dobACfRECD QxO7LVMh/kYGcVKycCXU4SQ= =XzeM -----END PGP SIGNATURE----- --WIyZ46R2i8wDzkSu-- From owner-freebsd-hackers@FreeBSD.ORG Wed Nov 12 07:31:10 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 9E96616A4CE for ; Wed, 12 Nov 2003 07:31:10 -0800 (PST) Received: from gandalf.online.bg (gandalf.online.bg [217.75.128.9]) by mx1.FreeBSD.org (Postfix) with SMTP id C12FC43FE1 for ; Wed, 12 Nov 2003 07:31:08 -0800 (PST) (envelope-from roam@ringlet.net) Received: (qmail 28185 invoked from network); 12 Nov 2003 15:29:52 -0000 Received: from office.sbnd.net (HELO straylight.ringlet.net) (217.75.140.130) by gandalf.online.bg with SMTP; 12 Nov 2003 15:29:52 -0000 Received: (qmail 4765 invoked by uid 1000); 12 Nov 2003 15:31:07 -0000 Date: Wed, 12 Nov 2003 17:31:07 +0200 From: Peter Pentchev To: Reinier Kleipool Message-ID: <20031112153107.GB453@straylight.oblivion.bg> Mail-Followup-To: Reinier Kleipool , freebsd-hackers@freebsd.org References: <001701c3a875$836b1960$5201a8c0@ovs.kleipool.org> <20031112150054.GA453@straylight.oblivion.bg> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="rJwd6BRFiFCcLxzm" Content-Disposition: inline In-Reply-To: <20031112150054.GA453@straylight.oblivion.bg> User-Agent: Mutt/1.5.5.1i cc: freebsd-hackers@freebsd.org Subject: Re: kernel enviroment in sysctl MIB X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 12 Nov 2003 15:31:10 -0000 --rJwd6BRFiFCcLxzm Content-Type: text/plain; charset=windows-1251 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Wed, Nov 12, 2003 at 05:00:54PM +0200, Peter Pentchev wrote: > On Tue, Nov 11, 2003 at 06:01:55PM +0100, Reinier Kleipool wrote: > > Hello, > >=20 > > I am investigating the possiblilies for looking at the kernel boot > > parameters from within a userland utility. (Possibly a new FreeBSD inst= all > > facility) The idea is that by looking at sysctl kern.environment.* you > > should be able to see the BTX variables. An install program could use t= his > > to see an INSTALL_SERVER=3Dinstall.company.com variable (etc...) to use= as > > install server. The BTX loader could provide these variables at install= boot > > time, thus enableing fully automated installs. > [snip] > > My question is this: When looking at kern/kern_environmet.c I see routi= nes > > that install a SYSCTL_NODE kern.environment. The sysctl_kernenv routine > > handles this node. What I do not understand is how the environment is > > returned from this routine. >=20 > Take a look at the kenv(1) utility - its source is in the > src/usr.bin/kenv/kenv.c file. Errr, of course, if you're working with FreeBSD 5.x after 2003/01/20, that would be src/bin/kenv/kenv.c :) G'luck, Peter --=20 Peter Pentchev roam@ringlet.net roam@sbnd.net roam@FreeBSD.org PGP key: http://people.FreeBSD.org/~roam/roam.key.asc Key fingerprint FDBA FD79 C26F 3C51 C95E DF9E ED18 B68D 1619 4553 Nostalgia ain't what it used to be. --rJwd6BRFiFCcLxzm Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.3 (FreeBSD) iD8DBQE/slI67Ri2jRYZRVMRAlKbAJ9e1sWG1XP8CgsIM3sCYuTnXldq2gCgod+T fB1taa7TpF7tra+f851r4eM= =CO3d -----END PGP SIGNATURE----- --rJwd6BRFiFCcLxzm-- From owner-freebsd-hackers@FreeBSD.ORG Wed Nov 12 09:08:42 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 6C50316A4CE for ; Wed, 12 Nov 2003 09:08:42 -0800 (PST) Received: from mail.speakeasy.net (mail8.speakeasy.net [216.254.0.208]) by mx1.FreeBSD.org (Postfix) with ESMTP id 4353B43FE0 for ; Wed, 12 Nov 2003 09:08:41 -0800 (PST) (envelope-from jhb@FreeBSD.org) Received: (qmail 2172 invoked from network); 12 Nov 2003 17:08:40 -0000 Received: from unknown (HELO server.baldwin.cx) ([216.27.160.63]) (envelope-sender )encrypted SMTP for ; 12 Nov 2003 17:08:40 -0000 Received: from laptop.baldwin.cx (gw1.twc.weather.com [216.133.140.1]) by server.baldwin.cx (8.12.9/8.12.9) with ESMTP id hACH8Ece026145; Wed, 12 Nov 2003 12:08:14 -0500 (EST) (envelope-from jhb@FreeBSD.org) Message-ID: X-Mailer: XFMail 1.5.4 on FreeBSD X-Priority: 3 (Normal) Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 8bit MIME-Version: 1.0 In-Reply-To: <20031112104458.GA94744@nm.ruhr-uni-bochum.de> Date: Wed, 12 Nov 2003 12:08:12 -0500 (EST) From: John Baldwin To: Andre Grosse Bley X-Spam-Checker-Version: SpamAssassin 2.55 (1.174.2.19-2003-05-19-exp) cc: freebsd-hackers@FreeBSD.org Subject: Re: 4.9-RELEASE, ACPI and DELL Latitude D600 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 12 Nov 2003 17:08:42 -0000 On 12-Nov-2003 Andre Grosse Bley wrote: >> > Ah, the problem is that ACPI tries to sleep from a task, which is not safe >> > to do. This is not easy to fix. :( >> >> Actually, it may not be too hard. In current, ACPI uses its own thread >> to run the tasks in, so stable would need the same sort of thing. >> Basically, ACPI needs to start up a kproc and needs to have its own >> taskqueue again that uses this kproc for its execution context. > > So - as I am not a experienced kernel hacker - there is no easy solution > for me to 'fix' this panic? Should I open a PR? A PR might be a good idea. The basic details are that ACPI in 4.x needs to create a kernel process to service it's private taskqueue and then use this taskqueue instead of the system taskqueue to service events. -- John Baldwin <>< http://www.FreeBSD.org/~jhb/ "Power Users Use the Power to Serve!" - http://www.FreeBSD.org/ From owner-freebsd-hackers@FreeBSD.ORG Wed Nov 12 09:27:51 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 8D6B416A4DB for ; Wed, 12 Nov 2003 09:27:51 -0800 (PST) Received: from mail.netbsd.org (mail.isc.netbsd.org [204.152.185.212]) by mx1.FreeBSD.org (Postfix) with SMTP id DCD2943FB1 for ; Wed, 12 Nov 2003 09:27:50 -0800 (PST) (envelope-from wrstuden@netbsd.org) Received: (qmail 11000 invoked by uid 1130); 12 Nov 2003 17:27:50 -0000 Date: Wed, 12 Nov 2003 09:27:50 -0800 From: Bill Studenmund To: Jaromir Dolecek Message-ID: <20031112172750.GB14368@netbsd.org> References: <20031110174109.GA13852@monkey.org> <200311120858.hAC8wFfg001905@s102-n054.tele2.cz> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="St7VIuEGZ6dlpu13" Content-Disposition: inline In-Reply-To: <200311120858.hAC8wFfg001905@s102-n054.tele2.cz> User-Agent: Mutt/1.4.1i cc: freebsd-hackers@freebsd.org cc: tech-kern@NetBSD.org cc: Niels Provos cc: marius@monkey.org cc: hackers@openbsd.org Subject: Re: kqueue, NOTE_EOF X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 12 Nov 2003 17:27:51 -0000 --St7VIuEGZ6dlpu13 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Wed, Nov 12, 2003 at 09:58:15AM +0100, Jaromir Dolecek wrote: > marius aamodt eriksen wrote: > > hi -=20 > >=20 > > in order to be able to preserve consistent semantics across poll, > > select, and kqueue (EVFILT_READ), i propose the following change: on > > EVFILT_READ, add an fflag NOTE_EOF which will return when the file > > pointer *is* at the end of the file (effectively always returning on > > EVFILT_READ, but setting the NOTE_EOF flag when it is at the end). > >=20 > > specifically, this allows libevent[1] to behave consistently across > > underlying polling infrastructures (this has become a practical > > issue). >=20 > I'm not sure I understand what is the exact issue. I'm only responding to the notes also. > Why would this be necessary or what does this exactly solve? AFAIK > poll() doesn't set any flags in this case neither, so I don't > see how this is inconsistent. I think the difference is in the default behavior. When you're at EOF, I=20 know that poll() will give you a read-availability event, so you'll read=20 the EOF. Will kqueue? > BTW, shouldn't the EOF flag be cleared when the file is extended? Probably. Take care, Bill --St7VIuEGZ6dlpu13 Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.3 (NetBSD) iD8DBQE/sm2VWz+3JHUci9cRAn21AJ92dWa5pTIsSiWOXerBOsAjNjYj7ACfZdXH ZGm/kil/juuS7l/6YyZF6X8= =8LPL -----END PGP SIGNATURE----- --St7VIuEGZ6dlpu13-- From owner-freebsd-hackers@FreeBSD.ORG Wed Nov 12 10:01:27 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 6AEB416A4CE for ; Wed, 12 Nov 2003 10:01:27 -0800 (PST) Received: from webclan.com (webclan.com [216.149.213.2]) by mx1.FreeBSD.org (Postfix) with SMTP id 3F85943FD7 for ; Wed, 12 Nov 2003 10:01:24 -0800 (PST) (envelope-from freebsd@msquaredweb.net) Received: (qmail 51644 invoked by uid 1006); 12 Nov 2003 18:09:04 -0000 Received: from unknown (HELO mk2pzfb2xon2q5) (24.54.225.150) by msquaredweb.net with SMTP; 12 Nov 2003 18:09:04 -0000 From: "FB" To: Date: Wed, 12 Nov 2003 10:01:23 -0800 MIME-Version: 1.0 Content-Type: text/plain; charset="Windows-1252" Content-Transfer-Encoding: 7bit X-Mailer: Microsoft Office Outlook, Build 11.0.5510 X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2800.1165 Thread-Index: AcOpRvtrWS3Mz9XgQ7WHvIsOcb2nAQ== Message-Id: <20031112180124.3F85943FD7@mx1.FreeBSD.org> Subject: Multiple IPs in Jail X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 12 Nov 2003 18:01:27 -0000 Hey all - We patched mijail5 (http://garage.freebsd.pl/mijail.README) against RELENG_5_1. Most of the patch was successful with a little fuzz, except for a couple lines in jls which didn't patch due to cosmetic changes (easily fixed). Before the patch was applied, the jail environment had no problem with dns. After the patch was applied however (and userland rebuilt both on host and jail), dns breaks in the jail environment. Basically, gethostbyname fails and h_errno is set to 2 - Host name lookup failure. the system is configured properly, since the only changes are to the kernel and the modified jail mechanism. Also interesting is that the failure is immediate, there is no timeout. However, inbound/outbound TCP traffic is not effected. - we are able to ssh in/out of the jailed environment. I was testing outbound UDP traffic however - simple matter of binding a socket to send a packet to a remote host. Outside the jail, it worked fine. inside the jail, sendto failed with a EINVAL error. Any help on this topic would be much appreciated. -Mike PS: I apologize for the cross-post to the freebsd-hackers and freebsd-questions lists... Need to get this box up ASAP and this is a major setback. --- Outgoing mail is certified Virus Free. Checked by AVG anti-virus system (http://www.grisoft.com). Version: 6.0.537 / Virus Database: 332 - Release Date: 11/6/2003 From owner-freebsd-hackers@FreeBSD.ORG Wed Nov 12 10:41:29 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id C38B616A4CE for ; Wed, 12 Nov 2003 10:41:29 -0800 (PST) Received: from naughty.monkey.org (naughty.monkey.org [66.93.9.164]) by mx1.FreeBSD.org (Postfix) with ESMTP id 6368C43F85 for ; Wed, 12 Nov 2003 10:41:02 -0800 (PST) (envelope-from marius@naughty.monkey.org) Received: by naughty.monkey.org (Postfix, from userid 6) id 289A41BA96F; Wed, 12 Nov 2003 13:40:42 -0500 (EST) Date: Wed, 12 Nov 2003 13:40:42 -0500 From: marius aamodt eriksen To: Bill Studenmund Message-ID: <20031112184042.GC2942@monkey.org> Mail-Followup-To: Bill Studenmund , Jaromir Dolecek , hackers@openbsd.org, tech-kern@NetBSD.org, freebsd-hackers@freebsd.org, Niels Provos References: <20031110174109.GA13852@monkey.org> <200311120858.hAC8wFfg001905@s102-n054.tele2.cz> <20031112172750.GB14368@netbsd.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20031112172750.GB14368@netbsd.org> User-Agent: Mutt/1.3.99i cc: freebsd-hackers@freebsd.org cc: Niels Provos cc: hackers@openbsd.org cc: Jaromir Dolecek cc: tech-kern@NetBSD.org Subject: Re: kqueue, NOTE_EOF X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list Reply-To: marius@monkey.org List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 12 Nov 2003 18:41:29 -0000 * Bill Studenmund [031112 12:27]: > > I'm not sure I understand what is the exact issue. > > I'm only responding to the notes also. > > > Why would this be necessary or what does this exactly solve? AFAIK > > poll() doesn't set any flags in this case neither, so I don't > > see how this is inconsistent. > > I think the difference is in the default behavior. When you're at EOF, I > know that poll() will give you a read-availability event, so you'll read > the EOF. Will kqueue? correct - this is the difference, kqueue will not yield any event at EOF. > > BTW, shouldn't the EOF flag be cleared when the file is extended? > > Probably. i'm not sure this is an issue - at the point where EOF is determined, the kqueue event returns success. and in this case, the event is always successful, so the process will not sleep on the kevent() call. in a preemptible kernel, there is a race between the EOF condition is determined and kevent() actually returns. semantically, in this case it makes sense to cancel the event (for which there is no infrastructure), and not necessarily clear its flag. though in this case, that hack will work correctly. marius. -- marius a eriksen | http://monkey.org/~marius/ From owner-freebsd-hackers@FreeBSD.ORG Wed Nov 12 10:54:26 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 3D82516A4CE for ; Wed, 12 Nov 2003 10:54:26 -0800 (PST) Received: from yeah-baby.shagadelic.org (yeah-baby.shagadelic.org [208.176.2.162]) by mx1.FreeBSD.org (Postfix) with ESMTP id DF62B43F85 for ; Wed, 12 Nov 2003 10:54:24 -0800 (PST) (envelope-from thorpej@wasabisystems.com) Received: from [127.0.0.1] (localhost [127.0.0.1]) by yeah-baby.shagadelic.org (Postfix) with ESMTP id 29AF71E081C; Wed, 12 Nov 2003 10:54:30 -0800 (PST) In-Reply-To: <20031112184042.GC2942@monkey.org> References: <20031110174109.GA13852@monkey.org> <200311120858.hAC8wFfg001905@s102-n054.tele2.cz> <20031112172750.GB14368@netbsd.org> <20031112184042.GC2942@monkey.org> Mime-Version: 1.0 (Apple Message framework v606) Content-Type: text/plain; charset=US-ASCII; format=flowed Message-Id: Content-Transfer-Encoding: 7bit From: Jason Thorpe Date: Wed, 12 Nov 2003 10:54:32 -0800 To: marius@monkey.org X-Mailer: Apple Mail (2.606) cc: Bill Studenmund cc: tech-kern@NetBSD.org cc: freebsd-hackers@freebsd.org cc: Niels Provos cc: hackers@openbsd.org cc: Jaromir Dolecek Subject: Re: kqueue, NOTE_EOF X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 12 Nov 2003 18:54:26 -0000 On Nov 12, 2003, at 10:40 AM, marius aamodt eriksen wrote: > correct - this is the difference, kqueue will not yield any event at > EOF. So, kqueue should simply be changed to report the event. I don't see any need for a separate EOF flag. EOF can simply be determined as normal in the kqueue case as well. -- Jason R. Thorpe From owner-freebsd-hackers@FreeBSD.ORG Wed Nov 12 10:57:41 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id B049616A4CF for ; Wed, 12 Nov 2003 10:57:41 -0800 (PST) Received: from naughty.monkey.org (naughty.monkey.org [66.93.9.164]) by mx1.FreeBSD.org (Postfix) with ESMTP id BC10043FAF for ; Wed, 12 Nov 2003 10:57:39 -0800 (PST) (envelope-from marius@naughty.monkey.org) Received: by naughty.monkey.org (Postfix, from userid 6) id 56FD81BA96C; Wed, 12 Nov 2003 13:57:38 -0500 (EST) Date: Wed, 12 Nov 2003 13:57:38 -0500 From: marius aamodt eriksen To: Jason Thorpe Message-ID: <20031112185738.GD2942@monkey.org> Mail-Followup-To: Jason Thorpe , freebsd-hackers@freebsd.org, Niels Provos , hackers@openbsd.org, Bill Studenmund , tech-kern@NetBSD.org, Jaromir Dolecek References: <20031110174109.GA13852@monkey.org> <200311120858.hAC8wFfg001905@s102-n054.tele2.cz> <20031112172750.GB14368@netbsd.org> <20031112184042.GC2942@monkey.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.3.99i cc: Bill Studenmund cc: tech-kern@NetBSD.org cc: freebsd-hackers@freebsd.org cc: Niels Provos cc: hackers@openbsd.org cc: Jaromir Dolecek Subject: Re: kqueue, NOTE_EOF X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list Reply-To: marius@monkey.org List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 12 Nov 2003 18:57:41 -0000 * Jason Thorpe [031112 13:54]: > On Nov 12, 2003, at 10:40 AM, marius aamodt eriksen wrote: > > >correct - this is the difference, kqueue will not yield any event at > >EOF. > > So, kqueue should simply be changed to report the event. I don't see > any need for a separate EOF flag. EOF can simply be determined as > normal in the kqueue case as well. right - the idea was to preserve existing semantics, while leaving the poll-like semantics optional. marius. -- marius a eriksen | http://monkey.org/~marius/ From owner-freebsd-hackers@FreeBSD.ORG Wed Nov 12 11:00:13 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 9AE7A16A4CE for ; Wed, 12 Nov 2003 11:00:13 -0800 (PST) Received: from yeah-baby.shagadelic.org (yeah-baby.shagadelic.org [208.176.2.162]) by mx1.FreeBSD.org (Postfix) with ESMTP id 707B743FA3 for ; Wed, 12 Nov 2003 11:00:12 -0800 (PST) (envelope-from thorpej@wasabisystems.com) Received: from [127.0.0.1] (localhost [127.0.0.1]) by yeah-baby.shagadelic.org (Postfix) with ESMTP id 3A6891E081C; Wed, 12 Nov 2003 11:00:20 -0800 (PST) In-Reply-To: <20031112185738.GD2942@monkey.org> References: <20031110174109.GA13852@monkey.org> <200311120858.hAC8wFfg001905@s102-n054.tele2.cz> <20031112172750.GB14368@netbsd.org> <20031112184042.GC2942@monkey.org> <20031112185738.GD2942@monkey.org> Mime-Version: 1.0 (Apple Message framework v606) Content-Type: text/plain; charset=US-ASCII; format=flowed Message-Id: <777AA90C-1542-11D8-9DA8-000A957650EC@wasabisystems.com> Content-Transfer-Encoding: 7bit From: Jason Thorpe Date: Wed, 12 Nov 2003 11:00:22 -0800 To: marius@monkey.org X-Mailer: Apple Mail (2.606) cc: Bill Studenmund cc: tech-kern@NetBSD.org cc: freebsd-hackers@freebsd.org cc: Niels Provos cc: hackers@openbsd.org cc: Jaromir Dolecek Subject: Re: kqueue, NOTE_EOF X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 12 Nov 2003 19:00:13 -0000 On Nov 12, 2003, at 10:57 AM, marius aamodt eriksen wrote: > right - the idea was to preserve existing semantics, while leaving the > poll-like semantics optional. I'm not sure the "existing semantics" are anything more than a bug that should be fixed. -- Jason R. Thorpe From owner-freebsd-hackers@FreeBSD.ORG Wed Nov 12 11:06:39 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id E57D116A4CE for ; Wed, 12 Nov 2003 11:06:39 -0800 (PST) Received: from naughty.monkey.org (naughty.monkey.org [66.93.9.164]) by mx1.FreeBSD.org (Postfix) with ESMTP id 690B543F75 for ; Wed, 12 Nov 2003 11:06:38 -0800 (PST) (envelope-from marius@naughty.monkey.org) Received: by naughty.monkey.org (Postfix, from userid 6) id D7D551BA96C; Wed, 12 Nov 2003 14:06:35 -0500 (EST) Date: Wed, 12 Nov 2003 14:06:35 -0500 From: marius aamodt eriksen To: Jason Thorpe Message-ID: <20031112190635.GE2942@monkey.org> Mail-Followup-To: Jason Thorpe , freebsd-hackers@freebsd.org, Niels Provos , hackers@openbsd.org, Bill Studenmund , tech-kern@NetBSD.org, Jaromir Dolecek References: <20031110174109.GA13852@monkey.org> <200311120858.hAC8wFfg001905@s102-n054.tele2.cz> <20031112172750.GB14368@netbsd.org> <20031112184042.GC2942@monkey.org> <20031112185738.GD2942@monkey.org> <777AA90C-1542-11D8-9DA8-000A957650EC@wasabisystems.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <777AA90C-1542-11D8-9DA8-000A957650EC@wasabisystems.com> User-Agent: Mutt/1.3.99i cc: Bill Studenmund cc: tech-kern@NetBSD.org cc: freebsd-hackers@freebsd.org cc: Niels Provos cc: hackers@openbsd.org cc: Jaromir Dolecek Subject: Re: kqueue, NOTE_EOF X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list Reply-To: marius@monkey.org List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 12 Nov 2003 19:06:40 -0000 * Jason Thorpe [031112 14:00]: > On Nov 12, 2003, at 10:57 AM, marius aamodt eriksen wrote: > > >right - the idea was to preserve existing semantics, while leaving the > >poll-like semantics optional. > > I'm not sure the "existing semantics" are anything more than a bug that > should be fixed. this behavior is useful in, for example, "tail -f" marius. -- marius a eriksen | http://monkey.org/~marius/ From owner-freebsd-hackers@FreeBSD.ORG Wed Nov 12 11:18:09 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 8D12A16A4CE for ; Wed, 12 Nov 2003 11:18:09 -0800 (PST) Received: from neumann.typhon.ufal.br (ns.typhon.ufal.br [200.17.112.70]) by mx1.FreeBSD.org (Postfix) with ESMTP id 7DA8B43F93 for ; Wed, 12 Nov 2003 11:18:00 -0800 (PST) (envelope-from left@typhon.ufal.br) Received: from typhon.ufal.br ([172.17.0.31])hACJGTP4087436; Wed, 12 Nov 2003 16:16:33 -0300 (BRT) (envelope-from left@typhon.ufal.br) Message-ID: <3FB25CFD.10900@typhon.ufal.br> Date: Wed, 12 Nov 2003 16:17:01 +0000 From: Luiz Eugenio Fernandes Tenorio Organization: Typhon Project - Universidade Federal de Alagoas User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; en-US; rv:1.4.1) Gecko/20031015 X-Accept-Language: pt-br, en-us, en MIME-Version: 1.0 To: Rayson Ho References: <20031107005951.2157.qmail@web11407.mail.yahoo.com> In-Reply-To: <20031107005951.2157.qmail@web11407.mail.yahoo.com> Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit cc: List cc: bioclusters@bioinformatics.org cc: beowulf cc: Linux Cluster Subject: Re: Linux vs FreeBSD clusters X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 12 Nov 2003 19:18:09 -0000 Hi, We have a 64 node cluster entire based on FreeBSD 5.1 for high performance computing at the Federal University of Alagoas (http://www.typhon.ufal.br). It has 36 Dell Pentium IV 2.4GHz nodes and 36 Gateway Atlhon 1GHz using a fast-ethernet network (the peak performance for Dell machines, measured with xhpl, is 37 Gflops). Applications may use MPI for inter-process communication. For the cluster management we are testing the Ganglia (http://ganglia.sourceforge.net) and for scheduling the Maui (http://supercluster.org/maui). []'s left Rayson Ho wrote: > A very good paper about building HPC clusters with FreeBSD: > > "Building a High-performance Computing Cluster Using FreeBSD" > > http://people.freebsd.org/~brooks/papers/bsdcon2003/ > > The author talked about hardware issues: KVM, BIOS redirection, CPU > choices; and then talked about why he chose FreeBSD instead of Linux... > he also did the port of GridEngine (SGE) to FreeBSD. > > Anyone tried to setup HPC clusters with *BSD?? > > Rayson > > > --- Fernan Aguero wrote: > >>Any FreeBSD users willing to share clustering experiences >>out there? >> >>Fernan > > > > > __________________________________ > Do you Yahoo!? > Protect your identity with Yahoo! Mail AddressGuard > http://antispam.yahoo.com/whatsnewfree > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" From owner-freebsd-hackers@FreeBSD.ORG Wed Nov 12 11:28:27 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id B418616A4CE for ; Wed, 12 Nov 2003 11:28:27 -0800 (PST) Received: from mail.eecs.harvard.edu (bowser.eecs.harvard.edu [140.247.60.24]) by mx1.FreeBSD.org (Postfix) with ESMTP id 5F3B743FE0 for ; Wed, 12 Nov 2003 11:28:26 -0800 (PST) (envelope-from ellard@eecs.harvard.edu) Received: by mail.eecs.harvard.edu (Postfix, from userid 465) id B487354C4AA; Wed, 12 Nov 2003 14:28:25 -0500 (EST) Received: from localhost (localhost [127.0.0.1]) by mail.eecs.harvard.edu (Postfix) with ESMTP id B16CF54C47E for ; Wed, 12 Nov 2003 14:28:25 -0500 (EST) Date: Wed, 12 Nov 2003 14:28:25 -0500 (EST) From: Daniel Ellard To: freebsd-hackers@freebsd.org Message-ID: <20031112103358.S11644@bowser.eecs.harvard.edu> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Subject: Confused about HyperThreading and Performance X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 12 Nov 2003 19:28:27 -0000 Can someone point me at some non-marketing documentation about hyperthreading on the latest Intel chips? I'm seeing some strange performance measurements and I would like to figure out what they mean. My systems have the following CPU: CPU: Intel(R) Xeon(TM) CPU 1.80GHz (1799.81-MHz 686-class CPU) Origin = "GenuineIntel" Id = 0xf27 Stepping = 7 Features=0xbfebfbff They are running FreeBSD 4.8-RELEASE-p13. I'm running an application that pumps a lot of data quickly over a gigabit NIC (an Alteon AceNIC 1000baseT Gigabit Ethernet, using the ti driver). The network uses normal ethernet frames (MTU=1500) instead of jumbo frames, so there are lots of interrupts. In this case, the system is mostly reading data from the network, in case that makes a difference. The application is multi-threaded, using pthreads. When I run a kernel using the default configuration (no SMP, no APIC), the application takes an average of 8.45 seconds (wall-clock time) to run, and this number is consistent from run to run. When I run a kernel built with either SMP or SMP+APIC, it takes an average of 13.25 seconds, and this number is also quite consistent. (It's not the Alteon; using the Intel Pro/1000 XT server adapter with the em driver gives a similar difference, although the intel NIC is slower.) Interestingly, the CPU utilization for the default kernel is about 75-80%, while for the APIC kernel it is over 95%. My guess would be that something is spinning on a lock in the APIC kernel, but that's just a hunch. My questions: 1. Any idea why the performance plummets from 8.45 seconds to 13.25? 2. Is the situation any better in FreeBSD 5.1 (or 4.9)? I know in 4.9 APIC is turned on by default, but if this is the result than I won't be upgrading to 4.9 any time soon! Thanks, -Dan From owner-freebsd-hackers@FreeBSD.ORG Wed Nov 12 11:41:20 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 8E31116A4CE for ; Wed, 12 Nov 2003 11:41:20 -0800 (PST) Received: from vsmtp3.tin.it (vsmtp3.tin.it [212.216.176.223]) by mx1.FreeBSD.org (Postfix) with ESMTP id CBB5F43F3F for ; Wed, 12 Nov 2003 11:41:19 -0800 (PST) (envelope-from flag@libero.it) Received: from willow.homeunix.org (80.183.95.38) by vsmtp3.tin.it (7.0.019) id 3F98DAEA0092E3F7; Wed, 12 Nov 2003 20:41:09 +0100 Received: by willow.homeunix.org (Postfix, from userid 1001) id 24BE82075; Wed, 12 Nov 2003 20:44:48 +0100 (CET) Date: Wed, 12 Nov 2003 20:44:47 +0100 From: Paolo Pisati To: Daniel Ellard Message-ID: <20031112194447.GA4767@tin.it> References: <20031112103358.S11644@bowser.eecs.harvard.edu> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20031112103358.S11644@bowser.eecs.harvard.edu> User-Agent: Mutt/1.4.1i cc: FreeBSD_Hackers Subject: Re: Confused about HyperThreading and Performance X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 12 Nov 2003 19:41:20 -0000 On Wed, Nov 12, 2003 at 02:28:25PM -0500, Daniel Ellard wrote: > > My questions: did you try setting: machdep.cpu_idle_hlt: 1 ? It should help on HTT system. -- Paolo Italian FreeBSD User Group: http://www.gufi.org From owner-freebsd-hackers@FreeBSD.ORG Wed Nov 12 14:17:42 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id CFD1A16A4F5 for ; Wed, 12 Nov 2003 14:17:42 -0800 (PST) Received: from dan.emsphone.com (dan.emsphone.com [199.67.51.101]) by mx1.FreeBSD.org (Postfix) with ESMTP id EFD6543FE3 for ; Wed, 12 Nov 2003 14:17:41 -0800 (PST) (envelope-from dan@dan.emsphone.com) Received: (from dan@localhost) by dan.emsphone.com (8.12.9/8.12.9) id hACMHZWG076057; Wed, 12 Nov 2003 16:17:35 -0600 (CST) (envelope-from dan) Date: Wed, 12 Nov 2003 16:17:35 -0600 From: Dan Nelson To: Daniel Ellard Message-ID: <20031112221735.GE37293@dan.emsphone.com> References: <20031112103358.S11644@bowser.eecs.harvard.edu> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20031112103358.S11644@bowser.eecs.harvard.edu> X-OS: FreeBSD 5.1-CURRENT X-message-flag: Outlook Error User-Agent: Mutt/1.5.5.1i cc: freebsd-hackers@freebsd.org Subject: Re: Confused about HyperThreading and Performance X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 12 Nov 2003 22:17:42 -0000 In the last episode (Nov 12), Daniel Ellard said: > When I run a kernel using the default configuration (no SMP, no > APIC), the application takes an average of 8.45 seconds (wall-clock > time) to run, and this number is consistent from run to run. When I > run a kernel built with either SMP or SMP+APIC, it takes an average > of 13.25 seconds, and this number is also quite consistent. (It's > not the Alteon; using the Intel Pro/1000 XT server adapter with the > em driver gives a similar difference, although the intel NIC is > slower.) > > Interestingly, the CPU utilization for the default kernel is about > 75-80%, while for the APIC kernel it is over 95%. My guess would be > that something is spinning on a lock in the APIC kernel, but that's > just a hunch. You may just be seeing the overhead due to having SMP enabled. A single-processor kernel doesn't need to lock structures against simultaneous access by another CPU. -- Dan Nelson dnelson@allantgroup.com From owner-freebsd-hackers@FreeBSD.ORG Wed Nov 12 15:08:25 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 5C5BF16A4CE for ; Wed, 12 Nov 2003 15:08:25 -0800 (PST) Received: from mail.speakeasy.net (mail8.speakeasy.net [216.254.0.208]) by mx1.FreeBSD.org (Postfix) with ESMTP id 74F6D43FD7 for ; Wed, 12 Nov 2003 15:08:24 -0800 (PST) (envelope-from jhb@FreeBSD.org) Received: (qmail 12253 invoked from network); 12 Nov 2003 23:08:23 -0000 Received: from unknown (HELO server.baldwin.cx) ([216.27.160.63]) (envelope-sender )encrypted SMTP for ; 12 Nov 2003 23:08:23 -0000 Received: from laptop.baldwin.cx (gw1.twc.weather.com [216.133.140.1]) by server.baldwin.cx (8.12.9/8.12.9) with ESMTP id hACN80ce028196; Wed, 12 Nov 2003 18:08:00 -0500 (EST) (envelope-from jhb@FreeBSD.org) Message-ID: X-Mailer: XFMail 1.5.4 on FreeBSD X-Priority: 3 (Normal) Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 8bit MIME-Version: 1.0 In-Reply-To: <20031112103358.S11644@bowser.eecs.harvard.edu> Date: Wed, 12 Nov 2003 18:07:58 -0500 (EST) From: John Baldwin To: Daniel Ellard X-Spam-Checker-Version: SpamAssassin 2.55 (1.174.2.19-2003-05-19-exp) cc: freebsd-hackers@freebsd.org Subject: RE: Confused about HyperThreading and Performance X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 12 Nov 2003 23:08:25 -0000 On 12-Nov-2003 Daniel Ellard wrote: > > Can someone point me at some non-marketing documentation about > hyperthreading on the latest Intel chips? I'm seeing some strange > performance measurements and I would like to figure out what they > mean. > > My systems have the following CPU: > > CPU: Intel(R) Xeon(TM) CPU 1.80GHz (1799.81-MHz 686-class CPU) Origin = "GenuineIntel" Id = > 0xf27 Stepping = 7 > > Features=0xbfebfbff H,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE> > > They are running FreeBSD 4.8-RELEASE-p13. > > I'm running an application that pumps a lot of data quickly over a > gigabit NIC (an Alteon AceNIC 1000baseT Gigabit Ethernet, using the ti > driver). The network uses normal ethernet frames (MTU=1500) instead > of jumbo frames, so there are lots of interrupts. In this case, the > system is mostly reading data from the network, in case that makes a > difference. The application is multi-threaded, using pthreads. > > When I run a kernel using the default configuration (no SMP, no APIC), > the application takes an average of 8.45 seconds (wall-clock time) to > run, and this number is consistent from run to run. When I run a > kernel built with either SMP or SMP+APIC, it takes an average of 13.25 > seconds, and this number is also quite consistent. (It's not the > Alteon; using the Intel Pro/1000 XT server adapter with the em driver > gives a similar difference, although the intel NIC is slower.) > > Interestingly, the CPU utilization for the default kernel is about > 75-80%, while for the APIC kernel it is over 95%. My guess would be > that something is spinning on a lock in the APIC kernel, but that's > just a hunch. > > My questions: > > 1. Any idea why the performance plummets from 8.45 seconds to 13.25? > > 2. Is the situation any better in FreeBSD 5.1 (or 4.9)? I know in > 4.9 APIC is turned on by default, but if this is the result > than I won't be upgrading to 4.9 any time soon! APIC is not on by default for 4.9, it will be for 5.2. 4.9 does have HTT on by default when you build an SMP kernel though. Did you include 'options HTT' in your 4.8 SMP kernel? If not, you aren't actually using your second CPU. Also, as someone else mentioned, setting 'machdep.cpu_idle_hlt=1' can be useful on some HTT systems. However, p4's have a problem with their interrupt routing that can leave the second CPU halted for a long time if you do that. -- John Baldwin <>< http://www.FreeBSD.org/~jhb/ "Power Users Use the Power to Serve!" - http://www.FreeBSD.org/ From owner-freebsd-hackers@FreeBSD.ORG Wed Nov 12 16:10:32 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 1375616A4CE for ; Wed, 12 Nov 2003 16:10:32 -0800 (PST) Received: from mail.speakeasy.net (mail8.speakeasy.net [216.254.0.208]) by mx1.FreeBSD.org (Postfix) with ESMTP id B033643FA3 for ; Wed, 12 Nov 2003 16:10:30 -0800 (PST) (envelope-from jmg@hydrogen.funkthat.com) Received: (qmail 19855 invoked from network); 13 Nov 2003 00:10:30 -0000 Received: from unknown (HELO hydrogen.funkthat.com) ([69.17.45.168]) (envelope-sender ) by mail8.speakeasy.net (qmail-ldap-1.03) with SMTP for ; 13 Nov 2003 00:10:30 -0000 Received: from hydrogen.funkthat.com (kbczgz@localhost.funkthat.com [127.0.0.1])hAD0ASgP041983; Wed, 12 Nov 2003 16:10:28 -0800 (PST) (envelope-from jmg@hydrogen.funkthat.com) Received: (from jmg@localhost) by hydrogen.funkthat.com (8.12.10/8.12.10/Submit) id hAD0AIbU041982; Wed, 12 Nov 2003 16:10:18 -0800 (PST) Date: Wed, 12 Nov 2003 16:10:18 -0800 From: John-Mark Gurney To: Jason Thorpe , freebsd-hackers@freebsd.org, Niels Provos , hackers@openbsd.org, Bill Studenmund , tech-kern@netbsd.org, Jaromir Dolecek Message-ID: <20031113001018.GM64793@funkthat.com> Mail-Followup-To: Jason Thorpe , freebsd-hackers@freebsd.org, Niels Provos , hackers@openbsd.org, Bill Studenmund , tech-kern@NetBSD.org, Jaromir Dolecek References: <20031110174109.GA13852@monkey.org> <200311120858.hAC8wFfg001905@s102-n054.tele2.cz> <20031112172750.GB14368@netbsd.org> <20031112184042.GC2942@monkey.org> <20031112185738.GD2942@monkey.org> <777AA90C-1542-11D8-9DA8-000A957650EC@wasabisystems.com> <20031112190635.GE2942@monkey.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20031112190635.GE2942@monkey.org> User-Agent: Mutt/1.4.1i X-Operating-System: FreeBSD 4.2-RELEASE i386 X-PGP-Fingerprint: B7 EC EF F8 AE ED A7 31 96 7A 22 B3 D8 56 36 F4 X-Files: The truth is out there X-URL: http://resnet.uoregon.edu/~gurney_j/ X-Resume: http://resnet.uoregon.edu/~gurney_j/resume.html Subject: Re: kqueue, NOTE_EOF X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list Reply-To: John-Mark Gurney List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 13 Nov 2003 00:10:32 -0000 marius aamodt eriksen wrote this message on Wed, Nov 12, 2003 at 14:06 -0500: > > >right - the idea was to preserve existing semantics, while leaving the > > >poll-like semantics optional. > > > > I'm not sure the "existing semantics" are anything more than a bug that > > should be fixed. > > this behavior is useful in, for example, > > "tail -f" Why not use EVFILT_VNODE, NOTE_EXTEND for this? -- John-Mark Gurney Voice: +1 415 225 5579 "All that I will do, has been done, All that I have, has not." From owner-freebsd-hackers@FreeBSD.ORG Wed Nov 12 17:20:59 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 896D216A4CE; Wed, 12 Nov 2003 17:20:59 -0800 (PST) Received: from smtp.sw.oz.au (alt.aurema.com [203.217.18.57]) by mx1.FreeBSD.org (Postfix) with ESMTP id C6FF543FDD; Wed, 12 Nov 2003 17:20:57 -0800 (PST) (envelope-from vance@aurema.com) Received: from smtp.sw.oz.au (localhost [127.0.0.1]) by smtp.sw.oz.au with ESMTP id hAD1KlBA005633; Thu, 13 Nov 2003 12:20:47 +1100 (EST) Received: (from vance@localhost) by smtp.sw.oz.au id hAD1KkU9005632; Thu, 13 Nov 2003 12:20:46 +1100 (EST) Date: Thu, 13 Nov 2003 12:20:46 +1100 From: Christopher Vance To: Daniel Ellard Message-ID: <20031113012046.GB407@aurema.com> References: <20031112103358.S11644@bowser.eecs.harvard.edu> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.4.1i X-Scanned-By: MIMEDefang 2.38 cc: freebsd-hackers@FreeBSD.org cc: John Baldwin Subject: Re: Confused about HyperThreading and Performance X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 13 Nov 2003 01:20:59 -0000 On Wed, Nov 12, 2003 at 06:07:58PM -0500, John Baldwin wrote: >APIC is not on by default for 4.9, it will be for 5.2. 4.9 does have >HTT on by default when you build an SMP kernel though. Did you include >'options HTT' in your 4.8 SMP kernel? If not, you aren't actually >using your second CPU. Also, as someone else mentioned, setting >'machdep.cpu_idle_hlt=1' can be useful on some HTT systems. However, >p4's have a problem with their interrupt routing that can leave the >second CPU halted for a long time if you do that. Just because you have a cpu with HTT doesn't mean you can use it. Your motherboard and BIOS also need to be aware of it, and enable it. -- Christopher Vance From owner-freebsd-hackers@FreeBSD.ORG Wed Nov 12 20:07:40 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 2C1FC16A4CE; Wed, 12 Nov 2003 20:07:40 -0800 (PST) Received: from swin.edu.au (c3p0.cc.swin.edu.au [136.186.1.30]) by mx1.FreeBSD.org (Postfix) with ESMTP id 68D4B44001; Wed, 12 Nov 2003 20:07:37 -0800 (PST) (envelope-from pvandenbergen@swin.edu.au) Received: from pvdbergen.caia.swin.edu.au (pvdbergen.caia.swin.edu.au [136.186.229.26]) by swin.edu.au (8.9.3p2-20030918/8.9.3) with ESMTP id PAA627810; Thu, 13 Nov 2003 15:07:36 +1100 (EST) From: paul van den bergen To: freebsd-net@freebsd.org, freebsd-hackers@freebsd.org, hardware@freebsd.org Date: Thu, 13 Nov 2003 15:07:36 +1100 User-Agent: KMail/1.5 MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200311131507.36373.pvandenbergen@swin.edu.au> Subject: WiFi intermittant cutout - IPv6 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 13 Nov 2003 04:07:40 -0000 Hi all, I've noticed some odd and frustrating behaviour and am looking for some help. I have a 3 network setup for MIP6 (aka Kame snap of a few weeks ago). consider one section of the network. CN (host) <-> fec0:200:: <-> HN (router) <-> fec0:10:: <-> MN (host) the fec0:10:: network is an 802.11b network. I can either set it up as an AP based connection e.g. HN - wi0 - - - - AP - - - - an0 - MN or as an adhoc connection HN - wi0 - - - - - - an0 - MN for some reason, every now and again, the connectivity between the two ends drops off, with either a No route to host or ping rejection, depending which side of the remote host I am pinging... this is independant of adhoc or AP sometimes I can get the network connected by doing wicontrol -c 1 or some such - starting tcpdump on the an0 interface after starting the pings seems guarenteed to kill connectivity. but starting tcpdump ahead of time mostly doesn't. the hosts are accepting rtadv and the routers are forwarding ipv6 traffic. the same behaviour if I set up IPv4... HN wicontrol output NIC serial number: [ 99SA01000000 ] Station name: [ HomeNet ] SSID for IBSS creation: [ MAGIC-ADHOC ] Current netname (SSID): [ MAGIC-ADHOC ] Desired netname (SSID): [ MAGIC-ADHOC ] Current BSSID: [ 62:00:e6:00:06:01 ] Channel list: [ 2047 ] IBSS channel: [ 1 ] Current channel: [ 1 ] Comms quality/signal/noise: [ 92 154 13 ] Promiscuous mode: [ Off ] Process 802.11b Frame: [ Off ] Intersil-Prism2 based card: [ 1 ] Port type (1=BSS, 3=ad-hoc): [ 3 ] MAC address: [ 00:30:ab:20:a2:4c ] TX rate (selection): [ 3 ] TX rate (actual speed): [ 11 ] RTS/CTS handshake threshold: [ 2347 ] Create IBSS: [ Off ] Access point density: [ 1 ] Power Mgmt (1=on, 0=off): [ 0 ] Max sleep time: [ 100 ] WEP encryption: [ Off ] TX encryption key: [ 1 ] Encryption keys: [ ][ ][ ][ ] MN ancontrol -C output Operating mode: [ ad-hoc ] Receive mode: [ broadcast/multicast/unicast ] Fragment threshold: [ 2312 ] RTS threshold: [ 2312 ] MAC address: [ 00:09:7c:85:82:74 ] Supported rates: [ 1.0Mbps 2.0Mbps 5.5Mbps 11.0Mbps ] Short retry limit: [ 16 ] Long retry limit: [ 16 ] TX MSDU lifetime: [ 5000 ] RX MSDU lifetime: [ 10000 ] Stationary: [ Off ] Ordering: [ Off ] Device type: [ unknown (7f) ] Scanning mode: [ active ] Probe delay: [ 3 ] Probe energy timeout: [ 3 ] Probe response timeout: [ 20 ] Beacon listen timeout: [ 40 ] IBSS join network timeout: [ 10000 ] Authentication timeout: [ 2000 ] WEP enabled: [ no ] Authentication type: [ open ] Association timeout: [ 5000 ] Specified AP association timeout: [ 10000 ] Offline scan interval: [ 0 ] Offline scan duration: [ 0 ] Link loss delay: [ 0 ] Max beacon loss time: [ 500 ] Refresh interval: [ 10000 ] Power save mode: [ none ] Sleep through DTIMs: [ Off ] Power save listen interval: [ 200 ] Power save fast listen interval: [ 100 ] Power save listen decay: [ 2 ] Power save fast listen decay: [ 200 ] AP/ad-hoc Beacon period: [ 100 ] AP/ad-hoc ATIM duration: [ 0 ] AP/ad-hoc current channel: [ 1 ] AP/ad-hoc DTIM period: [ 1 ] Radio type: [ 802.11 DS ] RX Diversity: [ antenna 1 and 2 ] TX Diversity: [ antenna 1 and 2 ] Transmit power level: [ 100 ] RSS threshold: [ 0 ] Node name: [ MobileNode ] ARL threshold: [ 65535 ] ARL decay: [ 65535 ] ARL delay: [ 65535 ] Configuration: [ Enterprise Configuration ] WEP Key status: The active transmit key is 0 any idea why my network is goign up and down? -- Dr Paul van den Bergen Centre for Advanced Internet Architectures caia.swin.edu.au pvandenbergen@swin.edu.au IM:bulwynkl2002 "And some run up hill and down dale, knapping the chucky stones to pieces wi' hammers, like so many road makers run daft. They say it is to see how the world was made." Sir Walter Scott, St. Ronan's Well 1824 From owner-freebsd-hackers@FreeBSD.ORG Wed Nov 12 21:38:13 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 2F37616A4CE for ; Wed, 12 Nov 2003 21:38:13 -0800 (PST) Received: from h00609772adf0.ne.client2.attbi.com (h00609772adf0.ne.client2.attbi.com [66.31.45.197]) by mx1.FreeBSD.org (Postfix) with ESMTP id E6FD743FB1 for ; Wed, 12 Nov 2003 21:38:11 -0800 (PST) (envelope-from rodrigc@crodrigues.org) Received: from h00609772adf0.ne.client2.attbi.com (localhost.crodrigues.org [127.0.0.1])hAD5e8XP005855 for ; Thu, 13 Nov 2003 00:40:08 -0500 (EST) (envelope-from rodrigc@h00609772adf0.ne.client2.attbi.com) Received: (from rodrigc@localhost)hAD5e8jh005854 for freebsd-hackers@freebsd.org; Thu, 13 Nov 2003 00:40:08 -0500 (EST) (envelope-from rodrigc) Date: Thu, 13 Nov 2003 00:40:07 -0500 From: Craig Rodrigues To: freebsd-hackers@freebsd.org Message-ID: <20031113054007.GA5797@crodrigues.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.4.1i Subject: Netgraph-ATM used in Masters thesis X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 13 Nov 2003 05:38:13 -0000 Hi, I saw some posts to the cvs-all mailing list recently, giving Harti Brandt a hard time for importing bsnmp to the FreeBSD source tree, so I thought I would post this. :) I recently used Netgraph-ATM as part of my masters thesis at Harvard Extension School, which looked at ATM, CORBA, and network management. My thesis is online at: http://crodrigues.org/thesis_web/ Netgraph-ATM played a big part in my thesis, and Harti was VERY helpful. Harti even extended certain ATM device drivers with sysctl's to get at lower-level register information which allowed me to look at SONET alarm information. The main reason I started using FreeBSD was because of Harti's active maintenance of Netgraph-ATM, versus the less-maintained ATM implementation under Linux. While working on my thesis, I was so impressed with FreeBSD that I switched my home systems over to it, and am still using it, even though my thesis is done. :) I realize that 99% of people out there don't use or care about ATM and bsnmp being in the FreeBSD source tree , but I would just say: - the stability of a lot of Netgraph ATM stuff improved when it got into the tree, since I didn't need to get private patches from Harti - I benefited a lot from it being in the tree (a bit selfish to say, but true) I would like to thank Harti for his hard work on Netgraph-ATM, and all of the FreeBSD committers for producing a great OS and a great piece of software that let me get my work done!! -- Craig Rodrigues http://crodrigues.org rodrigc@crodrigues.org From owner-freebsd-hackers@FreeBSD.ORG Thu Nov 13 00:40:17 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 3323C16A4CE for ; Thu, 13 Nov 2003 00:40:17 -0800 (PST) Received: from milla.ask33.net (milla.ask33.net [217.197.166.60]) by mx1.FreeBSD.org (Postfix) with ESMTP id 4529B43FCB for ; Thu, 13 Nov 2003 00:40:16 -0800 (PST) (envelope-from nick@milla.ask33.net) Received: by milla.ask33.net (Postfix, from userid 1001) id 4E98E3ABB2D; Thu, 13 Nov 2003 09:39:42 +0100 (CET) Date: Thu, 13 Nov 2003 09:39:41 +0100 From: Pawel Jakub Dawidek To: FB Message-ID: <20031113083941.GR84474@garage.freebsd.pl> References: <20031112180124.3F85943FD7@mx1.FreeBSD.org> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-md5; protocol="application/pgp-signature"; boundary="uepJbk9oh0IF4lih" Content-Disposition: inline In-Reply-To: <20031112180124.3F85943FD7@mx1.FreeBSD.org> X-PGP-Key-URL: http://garage.freebsd.pl/jules.asc X-OS: FreeBSD 4.8-RELEASE-p9 i386 X-URL: http://garage.freebsd.pl User-Agent: Mutt/1.5.1i cc: freebsd-hackers@freebsd.org Subject: Re: Multiple IPs in Jail X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 13 Nov 2003 08:40:17 -0000 --uepJbk9oh0IF4lih Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Wed, Nov 12, 2003 at 10:01:23AM -0800, FB wrote: +> We patched mijail5 (http://garage.freebsd.pl/mijail.README) against +> RELENG_5_1. Most of the patch was successful with a little fuzz, except = for +> a couple lines in jls which didn't patch due to cosmetic changes (easily +> fixed).=20 +> =20 +> Before the patch was applied, the jail environment had no problem with d= ns. +> After the patch was applied however (and userland rebuilt both on host = and +> jail), dns breaks in the jail environment. Basically, gethostbyname fai= ls +> and h_errno is set to 2 - Host name lookup failure. the system is config= ured +> properly, since the only changes are to the kernel and the modified jail +> mechanism. Also interesting is that the failure is immediate, there is no +> timeout.=20 +> =20 +> However, inbound/outbound TCP traffic is not effected. - we are able to = ssh +> in/out of the jailed environment.=20 +> I was testing outbound UDP traffic however - simple matter of binding a +> socket to send a packet to a remote host.=20 +> =20 +> Outside the jail, it worked fine. inside the jail, sendto failed with a +> EINVAL error.=20 +> =20 +> Any help on this topic would be much appreciated.=20 I've many reports about DNS problems with my patch in jail, that's true. I can't promise, but I'll try to find some time in few days to track this problem down. --=20 Pawel Jakub Dawidek pawel@dawidek.net UNIX Systems Programmer/Administrator http://garage.freebsd.pl Am I Evil? Yes, I Am! http://cerber.sourceforge.net --uepJbk9oh0IF4lih Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.0.7 (FreeBSD) iQCVAwUBP7NDTT/PhmMH/Mf1AQH5XQP7BUhcrwo5E5ISKq6UNg1jxdCh5Udku387 YFixtPunpkUCk58xpatG38iJFkWSaR4BObLhKF0zqpWuu/KiWIIn1ikUlM7A2Nv7 Yao/FF5UXTKz2RoozUDxtGXs7bJFW8ky8thZ+AzUl26FzrB+fzKxK1wypMsyudX6 1rSvwa8kB68= =WRh1 -----END PGP SIGNATURE----- --uepJbk9oh0IF4lih-- From owner-freebsd-hackers@FreeBSD.ORG Thu Nov 13 00:59:59 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 9676816A4CE for ; Thu, 13 Nov 2003 00:59:59 -0800 (PST) Received: from horsey.gshapiro.net (horsey.gshapiro.net [64.105.95.154]) by mx1.FreeBSD.org (Postfix) with ESMTP id A28A843FE9 for ; Thu, 13 Nov 2003 00:59:58 -0800 (PST) (envelope-from gshapiro@gshapiro.net) Received: from horsey.gshapiro.net (localhost [127.0.0.1]) hAD8xvGx064753 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Thu, 13 Nov 2003 00:59:58 -0800 (PST) Received: (from gshapiro@localhost)hAD8xvSM064752; Thu, 13 Nov 2003 00:59:57 -0800 (PST) Date: Thu, 13 Nov 2003 00:59:57 -0800 From: Gregory Neil Shapiro To: FB Message-ID: <20031113085957.GJ10031@horsey.gshapiro.net> References: <20031112180124.3F85943FD7@mx1.FreeBSD.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20031112180124.3F85943FD7@mx1.FreeBSD.org> User-Agent: Mutt/1.5.4i cc: freebsd-hackers@freebsd.org Subject: Re: Multiple IPs in Jail X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 13 Nov 2003 08:59:59 -0000 > Outside the jail, it worked fine. inside the jail, sendto failed with a > EINVAL error. See: http://www.freebsd.org/cgi/query-pr.cgi?pr=kern/26506 From owner-freebsd-hackers@FreeBSD.ORG Thu Nov 13 01:26:08 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id DB80A16A4CE for ; Thu, 13 Nov 2003 01:26:08 -0800 (PST) Received: from t2s5.tele2.cz (t2s5.tele2.cz [213.246.64.40]) by mx1.FreeBSD.org (Postfix) with SMTP id 11A0F43FA3 for ; Thu, 13 Nov 2003 01:26:06 -0800 (PST) (envelope-from dolecek@s102-n054.tele2.cz) Received: (qmail 31085 invoked from network); 13 Nov 2003 09:25:59 -0000 Received: from s102-n054.tele2.cz (213.246.102.54) by t2s5.tele2.cz with SMTP; 13 Nov 2003 09:25:59 -0000 Received: (from dolecek@localhost) by s102-n054.tele2.cz (8.12.9p1/8.12.9/Submit) id hAD9Q3jv024862; Thu, 13 Nov 2003 10:26:03 +0100 (CET) From: Jaromir Dolecek Message-Id: <200311130926.hAD9Q3jv024862@s102-n054.tele2.cz> In-Reply-To: <20031112172750.GB14368@netbsd.org> To: Bill Studenmund Date: Thu, 13 Nov 2003 10:26:03 +0100 (CET) X-Mailer: ELM [version 2.4ME+ PL93 (25)] MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII cc: freebsd-hackers@freebsd.org cc: tech-kern@NetBSD.org cc: Niels Provos cc: marius@monkey.org cc: hackers@openbsd.org Subject: Re: kqueue, NOTE_EOF X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 13 Nov 2003 09:26:09 -0000 Bill Studenmund wrote: > I think the difference is in the default behavior. When you're at EOF, I > know that poll() will give you a read-availability event, so you'll read > the EOF. Will kqueue? AFAIK yes for sockets, not for file descriptor (i.e. descriptor open to a file on filesystem). Would poll() give you read-availability event when on end of file on filesystem. Jaromir -- Jaromir Dolecek http://www.NetBSD.cz/ -=- We should be mindful of the potential goal, but as the Buddhist -=- -=- masters say, ``You may notice during meditation that you -=- -=- sometimes levitate or glow. Do not let this distract you.'' -=- From owner-freebsd-hackers@FreeBSD.ORG Thu Nov 13 02:04:05 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 238D016A4CF for ; Thu, 13 Nov 2003 02:04:05 -0800 (PST) Received: from Sparkle.Rodents.Montreal.QC.CA (Sparkle.Rodents.Montreal.QC.CA [216.46.5.7]) by mx1.FreeBSD.org (Postfix) with ESMTP id D358443FE0 for ; Thu, 13 Nov 2003 02:04:03 -0800 (PST) (envelope-from mouse@Sparkle.Rodents.Montreal.QC.CA) Received: (from mouse@localhost) by Sparkle.Rodents.Montreal.QC.CA (8.8.8/8.8.8) id FAA25087; Thu, 13 Nov 2003 05:04:01 -0500 (EST) From: der Mouse Message-Id: <200311131004.FAA25087@Sparkle.Rodents.Montreal.QC.CA> Mime-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 8bit X-Erik-Conspiracy: There is no Conspiracy - and if there were I wouldn't be part of it anyway. Date: Thu, 13 Nov 2003 04:56:42 -0500 (EST) To: hackers@openbsd.org, tech-kern@NetBSD.org, freebsd-hackers@freebsd.org In-Reply-To: <200311130926.hAD9Q3jv024862@s102-n054.tele2.cz> References: <200311130926.hAD9Q3jv024862@s102-n054.tele2.cz> Subject: Re: kqueue, NOTE_EOF X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 13 Nov 2003 10:04:05 -0000 >> I think the difference is in the default behavior. When you're at >> EOF, I know that poll() will give you a read-availability event, so >> you'll read the EOF. Will kqueue? > AFAIK yes for sockets, not for file descriptor (i.e. descriptor open > to a file on filesystem). Would poll() give you read-availability > event when on end of file on filesystem. IMO it should, since a read() wouldn't block. When I tried it (admittedly against a rather old kernel) it does. /~\ The ASCII der Mouse \ / Ribbon Campaign X Against HTML mouse@rodents.montreal.qc.ca / \ Email! 7D C8 61 52 5D E7 2D 39 4E F1 31 3E E8 B3 27 4B From owner-freebsd-hackers@FreeBSD.ORG Thu Nov 13 02:06:32 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 425ED16A4D1 for ; Thu, 13 Nov 2003 02:06:32 -0800 (PST) Received: from purple.the-7.net (purple.the-7.net [207.158.28.23]) by mx1.FreeBSD.org (Postfix) with ESMTP id 1662F43FF3 for ; Thu, 13 Nov 2003 02:06:31 -0800 (PST) (envelope-from ab@astralblue.net) Received: from astralblue.net (adsl-68-123-46-151.dsl.pltn13.pacbell.net [68.123.46.151]) by purple.the-7.net (8.12.9p2/8.12.9) with ESMTP id hADA7gKF053384 for ; Thu, 13 Nov 2003 02:07:49 -0800 (PST) (envelope-from ab@astralblue.net) Message-ID: <3FB357A3.4030907@astralblue.net> Date: Thu, 13 Nov 2003 02:06:27 -0800 From: "Eugene M. Kim" User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; en-US; rv:1.6a) Gecko/20031103 X-Accept-Language: en-us, en, ko MIME-Version: 1.0 To: freebsd-hackers@freebsd.org References: In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Spam-Status: No, hits=-4.9 required=5.0 tests=BAYES_00 autolearn=ham version=2.60 X-Spam-Checker-Version: SpamAssassin 2.60 (1.212-2003-09-23-exp) on purple.the-7.net Subject: cpu_idle_hlt (Re: Confused about HyperThreading and Performance) X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 13 Nov 2003 10:06:32 -0000 John Baldwin wrote: > Also, as someone else mentioned, setting 'machdep.cpu_idle_hlt=1' can > be useful on some HTT systems. However, p4's have a problem with their > interrupt routing that can leave the second CPU halted for a long time > if you do that. I have a few quick questions... Searched on Google but couldn't get satisfactory answers: 1. Without cpu_idle_hlt, is the problem that the idle spin loop one logical CPU executes would eat up CPU time and prevent the other logical CPU from running? 2. If so, would it explain the unusually high percentage of system time and unusually low percentage of user time (shown on systat -vm 1) when processes should be mostly doing CPU work and some heavy disk I/O at the same time? 3. Is cpu_idle_hlt also potentially unsafe on P4 Xeon-based SMP systems? Thanks, Eugene P.S. It'd be greatly appreciated if someone could point to an in-depth discussion about Hyperthreading and cpu_idle_hlt... *yells at his poor Googling skill XD* From owner-freebsd-hackers@FreeBSD.ORG Thu Nov 13 02:35:26 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 34AB816A4CE for ; Thu, 13 Nov 2003 02:35:26 -0800 (PST) Received: from dial81-131-218-250.in-addr.btopenworld.com (dial81-131-218-250.in-addr.btopenworld.com [81.131.218.250]) by mx1.FreeBSD.org (Postfix) with ESMTP id 9BCED43FBF for ; Thu, 13 Nov 2003 02:35:23 -0800 (PST) (envelope-from dsl@l8s.co.uk) Received: from snowdrop.l8s.co.uk (localhost [IPv6:::1]) by snowdrop.l8s.co.uk (8.12.9/8.12.8) with ESMTP id hADAbHMD002187; Thu, 13 Nov 2003 10:37:18 GMT Received: (from dsl@localhost) by snowdrop.l8s.co.uk (8.12.9/8.12.9) id hADAbCN8025996; Thu, 13 Nov 2003 10:37:12 GMT Date: Thu, 13 Nov 2003 10:37:12 +0000 From: David Laight To: Jaromir Dolecek Message-ID: <20031113103712.B1838@snowdrop.l8s.co.uk> References: <20031112172750.GB14368@netbsd.org> <200311130926.hAD9Q3jv024862@s102-n054.tele2.cz> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.2.5.1i In-Reply-To: <200311130926.hAD9Q3jv024862@s102-n054.tele2.cz>; from jdolecek@NetBSD.org on Thu, Nov 13, 2003 at 10:26:03AM +0100 cc: Bill Studenmund cc: marius@monkey.org cc: tech-kern@NetBSD.org cc: freebsd-hackers@freebsd.org cc: Niels Provos cc: hackers@openbsd.org Subject: Re: kqueue, NOTE_EOF X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 13 Nov 2003 10:35:26 -0000 > AFAIK yes for sockets, not for file descriptor (i.e. descriptor > open to a file on filesystem). Would poll() give you read-availability > event when on end of file on filesystem. IIRC poll() is required to report that files are always readable. (So tail -f can't use poll() to avoid looping.) This is consistent with poll reporting whether a (blocking) read would return. David -- David Laight: david@l8s.co.uk From owner-freebsd-hackers@FreeBSD.ORG Thu Nov 13 02:50:46 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 5945816A4CE for ; Thu, 13 Nov 2003 02:50:46 -0800 (PST) Received: from razorbill.mail.pas.earthlink.net (razorbill.mail.pas.earthlink.net [207.217.121.248]) by mx1.FreeBSD.org (Postfix) with ESMTP id 7DF024406C for ; Thu, 13 Nov 2003 02:50:44 -0800 (PST) (envelope-from tlambert2@mindspring.com) Received: from user-2ivfmpo.dialup.mindspring.com ([165.247.219.56] helo=mindspring.com) by razorbill.mail.pas.earthlink.net with asmtp (SSLv3:RC4-MD5:128) (Exim 3.33 #1) id 1AKF3i-0006Go-00; Thu, 13 Nov 2003 02:50:43 -0800 Message-ID: <3FB360BE.779DB42F@mindspring.com> Date: Thu, 13 Nov 2003 02:45:18 -0800 From: Terry Lambert X-Mailer: Mozilla 4.79 [en] (Win98; U) X-Accept-Language: en MIME-Version: 1.0 To: jos@catnook.com References: <3F9CF3F6.8307.ABC1250@localhost> <20031111071944.GA5778@lizzy.catnook.com> Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-ELNK-Trace: b1a02af9316fbb217a47c185c03b154d40683398e744b8a4bd409fa7ddab47227e3e90fb37c11010666fa475841a1c7a350badd9bab72f9c350badd9bab72f9c cc: freebsd-hackers@freebsd.org Subject: Re: non-root process and PID files X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 13 Nov 2003 10:50:46 -0000 Jos Backus wrote: > On Mon, Oct 27, 2003 at 10:31:18AM -0500, Dan Langille wrote: > > If a process starts up and does a setuid, should it be writing the > > PID file before or after the setuid? > > > > Two methods exists AFAIK: > > > > 1 - write your PID immediately, and the file is chown root:wheel > > 2 - write your PID to /var/run/myapp/myapp.pid where /var/run/myapp/ > > is chown myapp:myapp > > > > Of the two, I think #1 is cleaner as it does not require another > > directory with special permissions. > > > > Any suggestions? > > Why use pid files at all if you could be using a process supervisor instead? Who supervises the supervisor? Sure, you can take the English Bobby approach (init dies, the kernel yells "Help me, human, or I shall yell 'Help me Human!' again", and tries to start software that will never start over and over), but that solves nothing; you would be amazed at the number of people who want MacOS X to try to restart init, instead of panicing, when init can't be started in the first place, or won't stay running if it was. So this doesn't solve the origin of authority problem. The problem being solved is avoiding running multiple instances of roles... so actually, it would be better if the file were named e.g. "smtp.pid", rather than "sendmail.pid", which would step on the toes of everyone who wanted to use their program name as part of the file name to make it harder to use someone else's software to replace their software. There are also the small issues of ordering (the reason you can't just run everything out of /etc/ttys via init in the first place), multiple instances, and removing human error from adding and removing new things to be monitored. -- Terry From owner-freebsd-hackers@FreeBSD.ORG Thu Nov 13 03:03:10 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id AB91A16A4CF for ; Thu, 13 Nov 2003 03:03:10 -0800 (PST) Received: from amsfep16-int.chello.nl (amsfep16-int.chello.nl [213.46.243.26]) by mx1.FreeBSD.org (Postfix) with ESMTP id 6CB9143FBF for ; Thu, 13 Nov 2003 03:03:04 -0800 (PST) (envelope-from Reinier@Kleipool.org) Received: from titan.kleipool.org ([213.93.137.166]) by amsfep16-int.chello.nlESMTP <20031113110302.SYIR1445.amsfep16-int.chello.nl@titan.kleipool.org> for ; Thu, 13 Nov 2003 12:03:02 +0100 Received: from io (io.ovs.kleipool.org [192.168.1.82]) by titan.kleipool.org (8.12.6/8.12.6) with SMTP id hADB30nk078837 for ; Thu, 13 Nov 2003 12:03:02 +0100 (CET) (envelope-from Reinier@Kleipool.org) From: "Reinier Kleipool" To: Date: Thu, 13 Nov 2003 12:02:59 +0100 Message-ID: <00bf01c3a9d5$b3bb9890$5201a8c0@ovs.kleipool.org> MIME-Version: 1.0 Content-Type: text/plain; charset="windows-1251" Content-Transfer-Encoding: 7bit X-Priority: 3 (Normal) X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook CWS, Build 9.0.2416 (9.0.2911.0) In-Reply-To: <20031112153107.GB453@straylight.oblivion.bg> Importance: Normal X-MimeOLE: Produced By Microsoft MimeOLE V5.50.4925.2800 Subject: RE: kernel enviroment in sysctl MIB X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 13 Nov 2003 11:03:10 -0000 Perter Pentechv wrote > Take a look at the kenv(1) utility - its source is in the > src/usr.bin/kenv/kenv.c file. Yes this does the job. But in a strange way... It starts at OID 0.3 (kern.environment) and appends small integers to it (0,1,2,3 etc). Why do it so strange.. Why are the variable names not just visible in sysctl. I know that the kern enviroment is not often used in normal operation, but would't it be nicer to just see the variables in the sysctl mib? I can incorporate this "trick" in my install program, but I could also try to patch kern_environment.c so the variables become visible. What do you think.... Kind regards, Reinier From owner-freebsd-hackers@FreeBSD.ORG Thu Nov 13 03:10:18 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 76AD816A4CE for ; Thu, 13 Nov 2003 03:10:18 -0800 (PST) Received: from grummit.biaix.org (86.Red-213-97-212.pooles.rima-tde.net [213.97.212.86]) by mx1.FreeBSD.org (Postfix) with SMTP id 9911B43FAF for ; Thu, 13 Nov 2003 03:10:15 -0800 (PST) (envelope-from joan@grummit.biaix.org) Received: (qmail 51951 invoked by uid 1000); 13 Nov 2003 11:04:34 -0000 Date: Thu, 13 Nov 2003 12:04:34 +0100 From: Joan Picanyol To: freebsd-hackers@freebsd.org Message-ID: <20031113110434.GA51335@grummit.biaix.org> Mail-Followup-To: freebsd-hackers@freebsd.org References: <3F9CF3F6.8307.ABC1250@localhost> <20031111071944.GA5778@lizzy.catnook.com> <3FB360BE.779DB42F@mindspring.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <3FB360BE.779DB42F@mindspring.com> User-Agent: Mutt/1.4.1i Subject: Re: non-root process and PID files X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 13 Nov 2003 11:10:18 -0000 * Terry Lambert [20031113 11:46]: > Jos Backus wrote: > > On Mon, Oct 27, 2003 at 10:31:18AM -0500, Dan Langille wrote: > > > 1 - write your PID immediately, and the file is chown root:wheel > > > 2 - write your PID to /var/run/myapp/myapp.pid where /var/run/myapp/ > > > is chown myapp:myapp > > > > > > Of the two, I think #1 is cleaner as it does not require another > > > directory with special permissions. > > > > > > Any suggestions? > > > > Why use pid files at all if you could be using a process supervisor instead? > > Who supervises the supervisor? Sure, you can take the English > Bobby approach (init dies, the kernel yells "Help me, human, or > I shall yell 'Help me Human!' again", and tries to start software > that will never start over and over), but that solves nothing; Let the supervisor be process 1: http://multivac.cwru.edu/svscan-1/ http://smarden.org/runit/ http://www.fefe.de/minit/ qvb -- pica From owner-freebsd-hackers@FreeBSD.ORG Thu Nov 13 03:10:29 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id DFC7516A4CE for ; Thu, 13 Nov 2003 03:10:29 -0800 (PST) Received: from web80707.mail.yahoo.com (web80707.mail.yahoo.com [66.163.170.64]) by mx1.FreeBSD.org (Postfix) with SMTP id 7C1CD43F75 for ; Thu, 13 Nov 2003 03:10:29 -0800 (PST) (envelope-from buttmanizer@yahoo.com) Message-ID: <20031113111029.76042.qmail@web80707.mail.yahoo.com> Received: from [202.92.128.25] by web80707.mail.yahoo.com via HTTP; Thu, 13 Nov 2003 11:10:29 GMT Date: Thu, 13 Nov 2003 11:10:29 +0000 (GMT) From: =?iso-8859-1?q?Jose=20Kulalapnot?= To: freebsd-hackers@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: 8bit Subject: instant message: ymessenger problem X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 13 Nov 2003 11:10:30 -0000 my system is running 5.1 and i installed the latest ymessenger from the ports. when i run it i get this message: /usr/libexec/ld-elf.so.1: Shared object "libintl.so.4" not found how can i fix this? ________________________________________________________________________ Want to chat instantly with your online friends? Get the FREE Yahoo! Messenger http://mail.messenger.yahoo.co.uk From owner-freebsd-hackers@FreeBSD.ORG Thu Nov 13 03:15:31 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 1C0B516A4CF for ; Thu, 13 Nov 2003 03:15:31 -0800 (PST) Received: from diaspar.rdsnet.ro (diaspar.rdsnet.ro [213.157.165.224]) by mx1.FreeBSD.org (Postfix) with ESMTP id 9B23143FB1 for ; Thu, 13 Nov 2003 03:15:29 -0800 (PST) (envelope-from dudu@diaspar.rdsnet.ro) Received: (qmail 14092 invoked by uid 89); 13 Nov 2003 11:15:28 -0000 Received: from unknown (HELO diaspar.rdsnet.ro) (213.157.165.224) by 0 with AES256-SHA encrypted SMTP; 13 Nov 2003 11:15:27 -0000 Date: Thu, 13 Nov 2003 13:15:25 +0200 From: Vlad Galu To: freebsd-hackers@freebsd.org Message-Id: <20031113131525.01681378.dudu@diaspar.rdsnet.ro> In-Reply-To: <20031113111029.76042.qmail@web80707.mail.yahoo.com> References: <20031113111029.76042.qmail@web80707.mail.yahoo.com> X-Mailer: Sylpheed version 0.9.7 (GTK+ 1.2.10; i386-portbld-freebsd4.9) Mime-Version: 1.0 Content-Type: multipart/signed; protocol="application/pgp-signature"; micalg="pgp-sha1"; boundary="Signature=_Thu__13_Nov_2003_13_15_25_+0200_4pDAz6fa3lPvTKyL" Subject: Re: instant message: ymessenger problem X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 13 Nov 2003 11:15:31 -0000 --Signature=_Thu__13_Nov_2003_13_15_25_+0200_4pDAz6fa3lPvTKyL Content-Type: text/plain; charset=US-ASCII Content-Disposition: inline Content-Transfer-Encoding: 7bit Jose Kulalapnot writes: |my system is running 5.1 and i installed the latest |ymessenger from the ports. when i run it i get this |message: | |/usr/libexec/ld-elf.so.1: Shared object "libintl.so.4" Reinstall gettext and everything that depends on it from scratch. |not found | |how can i fix this? | |______________________________________________________________________ |__ Want to chat instantly with your online friends? Get the FREE |Yahoo! Messenger http://mail.messenger.yahoo.co.uk |_______________________________________________ |freebsd-hackers@freebsd.org mailing list |http://lists.freebsd.org/mailman/listinfo/freebsd-hackers |To unsubscribe, send any mail to |"freebsd-hackers-unsubscribe@freebsd.org" | +-------------------------------------------------------+ |"Ana are mere" - Abecedar, | | Editura Didactica si Pedagogica, Bucuresti, 1985| +-------------------------------------------------------+ --Signature=_Thu__13_Nov_2003_13_15_25_+0200_4pDAz6fa3lPvTKyL Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.3 (FreeBSD) iD8DBQE/s2fPP5WtpVOrzpcRAieyAKCBiYEn6HMk4hBozzKq+vt0MDnPLwCfTMP1 1CHCrsnrdtQdgem/JzMe6aM= =qUER -----END PGP SIGNATURE----- --Signature=_Thu__13_Nov_2003_13_15_25_+0200_4pDAz6fa3lPvTKyL-- From owner-freebsd-hackers@FreeBSD.ORG Thu Nov 13 03:16:12 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 4AD7C16A4CE for ; Thu, 13 Nov 2003 03:16:12 -0800 (PST) Received: from c1-2-6.rz.ruhr-uni-bochum.de (c1-2-6.rz.ruhr-uni-bochum.de [134.147.32.86]) by mx1.FreeBSD.org (Postfix) with SMTP id 5C42A43FD7 for ; Thu, 13 Nov 2003 03:16:09 -0800 (PST) (envelope-from gandalf@nm.ruhr-uni-bochum.de) Received: (qmail 25270 invoked by uid 82); 13 Nov 2003 11:16:08 -0000 Received: from gandalf@nm.ruhr-uni-bochum.de by c1-2-6.rz.ruhr-uni-bochum.de by uid 80 with qmail-scanner-1.16 (sophie: 2.17/3.75. Clear:. Processed in 0.025956 secs); 13 Nov 2003 11:16:08 -0000 Received: from sunu450.rz.ruhr-uni-bochum.de (134.147.32.69) by c1-2-6.rz.ruhr-uni-bochum.de with SMTP; 13 Nov 2003 11:16:07 -0000 Received: (qmail 67 invoked from network); 13 Nov 2003 11:16:07 -0000 Received: from server.nm.ruhr-uni-bochum.de (HELO mailhost.nm.ruhr-uni-bochum.de) (134.147.252.40) by sunu450.rz.ruhr-uni-bochum.de with SMTP; 13 Nov 2003 11:16:07 -0000 Received: (qmail 13015 invoked by uid 101); 13 Nov 2003 11:16:05 -0000 Received: from pc-o.nm.ruhr-uni-bochum.de (134.147.252.55) by server.nm.ruhr-uni-bochum.de with SMTP; 13 Nov 2003 11:16:05 -0000 Received: from pc-o.nm.ruhr-uni-bochum.de (localhost [127.0.0.1]) hADBG4XB048157; Thu, 13 Nov 2003 12:16:04 +0100 (CET) (envelope-from gandalf@pc-o.nm.ruhr-uni-bochum.de) Received: (from gandalf@localhost)hADBG4iM048156; Thu, 13 Nov 2003 12:16:04 +0100 (CET) Date: Thu, 13 Nov 2003 12:16:04 +0100 From: Andre Grosse Bley To: John Baldwin Message-ID: <20031113111604.GA48138@nm.ruhr-uni-bochum.de> References: <20031112104458.GA94744@nm.ruhr-uni-bochum.de> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.4.1i cc: freebsd-hackers@FreeBSD.org Subject: Re: 4.9-RELEASE, ACPI and DELL Latitude D600 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 13 Nov 2003 11:16:12 -0000 > A PR might be a good idea. The basic details are that ACPI in 4.x needs > to create a kernel process to service it's private taskqueue and then > use this taskqueue instead of the system taskqueue to service events. FYI: PR is kern/59248. Andre From owner-freebsd-hackers@FreeBSD.ORG Thu Nov 13 03:23:44 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id B74A516A4CE for ; Thu, 13 Nov 2003 03:23:44 -0800 (PST) Received: from diaspar.rdsnet.ro (diaspar.rdsnet.ro [213.157.165.224]) by mx1.FreeBSD.org (Postfix) with ESMTP id 5A9F643F3F for ; Thu, 13 Nov 2003 03:23:43 -0800 (PST) (envelope-from dudu@diaspar.rdsnet.ro) Received: (qmail 32425 invoked by uid 89); 13 Nov 2003 11:23:42 -0000 Received: from unknown (HELO diaspar.rdsnet.ro) (213.157.165.224) by 0 with AES256-SHA encrypted SMTP; 13 Nov 2003 11:23:42 -0000 Date: Thu, 13 Nov 2003 13:23:42 +0200 From: Vlad Galu To: freebsd-hackers@freebsd.org Message-Id: <20031113132342.25f423af.dudu@diaspar.rdsnet.ro> In-Reply-To: <20031113131525.01681378.dudu@diaspar.rdsnet.ro> References: <20031113111029.76042.qmail@web80707.mail.yahoo.com> <20031113131525.01681378.dudu@diaspar.rdsnet.ro> X-Mailer: Sylpheed version 0.9.7 (GTK+ 1.2.10; i386-portbld-freebsd4.9) Mime-Version: 1.0 Content-Type: multipart/signed; protocol="application/pgp-signature"; micalg="pgp-sha1"; boundary="Signature=_Thu__13_Nov_2003_13_23_42_+0200_mtcqOq0W8xRgUWTP" Subject: Re: instant message: ymessenger problem X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 13 Nov 2003 11:23:44 -0000 --Signature=_Thu__13_Nov_2003_13_23_42_+0200_mtcqOq0W8xRgUWTP Content-Type: text/plain; charset=US-ASCII Content-Disposition: inline Content-Transfer-Encoding: 7bit Vlad Galu writes: |Jose Kulalapnot writes: | ||my system is running 5.1 and i installed the latest ||ymessenger from the ports. when i run it i get this ||message: || ||/usr/libexec/ld-elf.so.1: Shared object "libintl.so.4" | | Reinstall gettext and everything that depends on it from scratch. I'm sorry. This wasn't the right answer. I read your message in a hurry, without paying enough atention. The problem is that Y! was linked against gettext 0.11, and your system probably has 0.12. Symlinking libintl.so.4 to libintl.so.5 will probably do the job. | ||not found || ||how can i fix this? || ||______________________________________________________________________ ||__ Want to chat instantly with your online friends? Get the FREE ||Yahoo! Messenger http://mail.messenger.yahoo.co.uk ||_______________________________________________ ||freebsd-hackers@freebsd.org mailing list ||http://lists.freebsd.org/mailman/listinfo/freebsd-hackers ||To unsubscribe, send any mail to ||"freebsd-hackers-unsubscribe@freebsd.org" || | | |+-------------------------------------------------------+ ||"Ana are mere" - Abecedar, | || Editura Didactica si Pedagogica, Bucuresti, 1985| |+-------------------------------------------------------+ | +-------------------------------------------------------+ |"Ana are mere" - Abecedar, | | Editura Didactica si Pedagogica, Bucuresti, 1985| +-------------------------------------------------------+ --Signature=_Thu__13_Nov_2003_13_23_42_+0200_mtcqOq0W8xRgUWTP Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.3 (FreeBSD) iD8DBQE/s2m+P5WtpVOrzpcRAqutAJ9EvbCLPYF4S5uCXRSAAW/VIRWe4wCgi5EB aBiC0f/5CDm4IJabkSkFRSo= =coKu -----END PGP SIGNATURE----- --Signature=_Thu__13_Nov_2003_13_23_42_+0200_mtcqOq0W8xRgUWTP-- From owner-freebsd-hackers@FreeBSD.ORG Thu Nov 13 03:48:39 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 33EB416A4CE for ; Thu, 13 Nov 2003 03:48:39 -0800 (PST) Received: from web80706.mail.yahoo.com (web80706.mail.yahoo.com [66.163.170.63]) by mx1.FreeBSD.org (Postfix) with SMTP id EE1D243FDD for ; Thu, 13 Nov 2003 03:48:35 -0800 (PST) (envelope-from buttmanizer@yahoo.com) Message-ID: <20031113114835.93842.qmail@web80706.mail.yahoo.com> Received: from [202.92.128.25] by web80706.mail.yahoo.com via HTTP; Thu, 13 Nov 2003 11:48:35 GMT Date: Thu, 13 Nov 2003 11:48:35 +0000 (GMT) From: =?iso-8859-1?q?Jose=20Kulalapnot?= To: freebsd-hackers@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: 8bit Subject: Re: failure delivery X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 13 Nov 2003 11:48:39 -0000 tnx Vlad. im now running ymessenger. my id is buttmanizer. add me if u want. --- Vlad Galu wrote: > Vlad Galu writes: > > |Jose Kulalapnot writes: > | > ||my system is running 5.1 and i installed the > latest > ||ymessenger from the ports. when i run it i get > this > ||message: > || > ||/usr/libexec/ld-elf.so.1: Shared object > "libintl.so.4" > | > | Reinstall gettext and everything that depends on > it from scratch. > > I'm sorry. This wasn't the right answer. I read > your message in a > hurry, without paying enough atention. The problem > is that Y! was linked > against gettext 0.11, and your system probably has > 0.12. Symlinking > libintl.so.4 to libintl.so.5 will probably do the > job. > > | > ||not found > || > ||how can i fix this? > || ________________________________________________________________________ Want to chat instantly with your online friends? Get the FREE Yahoo! Messenger http://mail.messenger.yahoo.co.uk From owner-freebsd-hackers@FreeBSD.ORG Thu Nov 13 03:53:29 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id DC55316A4CE for ; Thu, 13 Nov 2003 03:53:29 -0800 (PST) Received: from web80706.mail.yahoo.com (web80706.mail.yahoo.com [66.163.170.63]) by mx1.FreeBSD.org (Postfix) with SMTP id 5A1B243F93 for ; Thu, 13 Nov 2003 03:53:29 -0800 (PST) (envelope-from buttmanizer@yahoo.com) Message-ID: <20031113115329.95150.qmail@web80706.mail.yahoo.com> Received: from [202.92.128.25] by web80706.mail.yahoo.com via HTTP; Thu, 13 Nov 2003 11:53:29 GMT Date: Thu, 13 Nov 2003 11:53:29 +0000 (GMT) From: =?iso-8859-1?q?Jose=20Kulalapnot?= To: freebsd-hackers@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: 8bit Subject: Re: instant message: ymessenger problem X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 13 Nov 2003 11:53:30 -0000 X-List-Received-Date: Thu, 13 Nov 2003 11:53:30 -0000 tnx Vlad. im now running ymessenger. my id is buttmanizer. add me if u want. --- Vlad Galu wrote: > Vlad Galu writes: > > |Jose Kulalapnot writes: > | > ||my system is running 5.1 and i installed the > latest > ||ymessenger from the ports. when i run it i get > this > ||message: > || > ||/usr/libexec/ld-elf.so.1: Shared object > "libintl.so.4" > | > | Reinstall gettext and everything that depends on > it from scratch. > > I'm sorry. This wasn't the right answer. I read > your message in a > hurry, without paying enough atention. The problem > is that Y! was linked > against gettext 0.11, and your system probably has > 0.12. Symlinking > libintl.so.4 to libintl.so.5 will probably do the > job. > > | > ||not found > || > ||how can i fix this? > || ________________________________________________________________________ Want to chat instantly with your online friends? Get the FREE Yahoo! Messenger http://mail.messenger.yahoo.co.uk From owner-freebsd-hackers@FreeBSD.ORG Thu Nov 13 03:54:00 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 7080E16A4CE for ; Thu, 13 Nov 2003 03:54:00 -0800 (PST) Received: from razorbill.mail.pas.earthlink.net (razorbill.mail.pas.earthlink.net [207.217.121.248]) by mx1.FreeBSD.org (Postfix) with ESMTP id 9DEE543FDD for ; Thu, 13 Nov 2003 03:53:59 -0800 (PST) (envelope-from tlambert2@mindspring.com) Received: from user-2ivfmpo.dialup.mindspring.com ([165.247.219.56] helo=mindspring.com) by razorbill.mail.pas.earthlink.net with asmtp (SSLv3:RC4-MD5:128) (Exim 3.33 #1) id 1AKG2r-0005Dk-00; Thu, 13 Nov 2003 03:53:54 -0800 Message-ID: <3FB36EA2.6318962F@mindspring.com> Date: Thu, 13 Nov 2003 03:44:34 -0800 From: Terry Lambert X-Mailer: Mozilla 4.79 [en] (Win98; U) X-Accept-Language: en MIME-Version: 1.0 To: Jaromir Dolecek References: <200311120858.hAC8wFfg001905@s102-n054.tele2.cz> Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-ELNK-Trace: b1a02af9316fbb217a47c185c03b154d40683398e744b8a4b16d4a9357fb6aaa68407555f39f83ca93caf27dac41a8fd350badd9bab72f9c350badd9bab72f9c cc: freebsd-hackers@freebsd.org cc: tech-kern@NetBSD.org cc: hackers@openbsd.org cc: marius@monkey.org cc: Niels Provos Subject: Re: kqueue, NOTE_EOF X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 13 Nov 2003 11:54:00 -0000 Jaromir Dolecek wrote: > marius aamodt eriksen wrote: > > in order to be able to preserve consistent semantics across poll, > > select, and kqueue (EVFILT_READ), i propose the following change: on > > EVFILT_READ, add an fflag NOTE_EOF which will return when the file > > pointer *is* at the end of the file (effectively always returning on > > EVFILT_READ, but setting the NOTE_EOF flag when it is at the end). > > > > specifically, this allows libevent[1] to behave consistently across > > underlying polling infrastructures (this has become a practical > > issue). > > I'm not sure I understand what is the exact issue. > > Why would this be necessary or what does this exactly solve? AFAIK > poll() doesn't set any flags in this case neither, so I don't > see how this is inconsistent. > > BTW, shouldn't the EOF flag be cleared when the file is extended? It solves the half-close-on-socket issue which occurs on an HTTP/1.0 request or an HTTP/1.1 non-pipelined/terminal request that occurs on most HTTP connections as a result of the client closing their side of the socket connection, but the server being expected to provide a response to the request on the same socket. You need this to be able to distinguish, after getting an EOF, if you need to provide a response to the request, or you need to drop it, based on additional processing you choose to do in your application. Doing it this way saves you 33%, 50%, or 66% of the required system calls to detect the edge conditions, depending on your I/O model and when they hit. It is useful for HTTP servers, HTTP Proxy servers, L7 load balancers, load balancers that implement Direct Server Return for requests, and in a number of other common cases having to do with networking (e.g. transcoding proxies for cell phones or other users requiring it, FTP control vs. data channels in the non-passive case, ssh/rcmd/etc., as just a couple of select examples). I rather expect that it would be singularly useless for socketpair(), pipe(), named pipe (FIFO), or file operations, but that's not what we are talking about when we talk about event libraries that deal with input sources/sinks. -- Terry From owner-freebsd-hackers@FreeBSD.ORG Thu Nov 13 03:56:58 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 48F1D16A4CE for ; Thu, 13 Nov 2003 03:56:58 -0800 (PST) Received: from diaspar.rdsnet.ro (diaspar.rdsnet.ro [213.157.165.224]) by mx1.FreeBSD.org (Postfix) with ESMTP id E169543FD7 for ; Thu, 13 Nov 2003 03:56:56 -0800 (PST) (envelope-from dudu@diaspar.rdsnet.ro) Received: (qmail 48665 invoked by uid 89); 13 Nov 2003 11:56:55 -0000 Received: from unknown (HELO diaspar.rdsnet.ro) (213.157.165.224) by 0 with AES256-SHA encrypted SMTP; 13 Nov 2003 11:56:55 -0000 Date: Thu, 13 Nov 2003 13:56:55 +0200 From: Vlad Galu To: freebsd-hackers@freebsd.org Message-Id: <20031113135655.6a6b2a3b.dudu@diaspar.rdsnet.ro> In-Reply-To: <20031113115329.95150.qmail@web80706.mail.yahoo.com> References: <20031113115329.95150.qmail@web80706.mail.yahoo.com> X-Mailer: Sylpheed version 0.9.7 (GTK+ 1.2.10; i386-portbld-freebsd4.9) Mime-Version: 1.0 Content-Type: multipart/signed; protocol="application/pgp-signature"; micalg="pgp-sha1"; boundary="Signature=_Thu__13_Nov_2003_13_56_55_+0200_kyb0kpcy/oj84qaP" Subject: Re: instant message: ymessenger problem X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 13 Nov 2003 11:56:58 -0000 --Signature=_Thu__13_Nov_2003_13_56_55_+0200_kyb0kpcy/oj84qaP Content-Type: text/plain; charset=US-ASCII Content-Disposition: inline Content-Transfer-Encoding: 7bit Jose Kulalapnot writes: |tnx Vlad. im now running ymessenger. my id is |buttmanizer. add me if u want. | I would, but your ID sounds scary :) | | | --- Vlad Galu wrote: > Vlad |Galu writes: |> |> |Jose Kulalapnot writes: |> | |> ||my system is running 5.1 and i installed the |> latest |> ||ymessenger from the ports. when i run it i get |> this |> ||message: |> || |> ||/usr/libexec/ld-elf.so.1: Shared object |> "libintl.so.4" |> | |> | Reinstall gettext and everything that depends on |> it from scratch. |> |> I'm sorry. This wasn't the right answer. I read |> your message in a |> hurry, without paying enough atention. The problem |> is that Y! was linked |> against gettext 0.11, and your system probably has |> 0.12. Symlinking |> libintl.so.4 to libintl.so.5 will probably do the |> job. |> |> | |> ||not found |> || |> ||how can i fix this? |> || | |______________________________________________________________________ |__ Want to chat instantly with your online friends? Get the FREE |Yahoo! Messenger http://mail.messenger.yahoo.co.uk |_______________________________________________ |freebsd-hackers@freebsd.org mailing list |http://lists.freebsd.org/mailman/listinfo/freebsd-hackers |To unsubscribe, send any mail to |"freebsd-hackers-unsubscribe@freebsd.org" | +-------------------------------------------------------+ |"Ana are mere" - Abecedar, | | Editura Didactica si Pedagogica, Bucuresti, 1985| +-------------------------------------------------------+ --Signature=_Thu__13_Nov_2003_13_56_55_+0200_kyb0kpcy/oj84qaP Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.3 (FreeBSD) iD8DBQE/s3GHP5WtpVOrzpcRAnbcAJ9LIoVyBRvA/GrjQLXHLNWHR6rTsQCgi8xe 2VZ235iuxy7bXqlLzzPBw8I= =6IdF -----END PGP SIGNATURE----- --Signature=_Thu__13_Nov_2003_13_56_55_+0200_kyb0kpcy/oj84qaP-- From owner-freebsd-hackers@FreeBSD.ORG Thu Nov 13 04:36:35 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 39F3D16A4CE for ; Thu, 13 Nov 2003 04:36:35 -0800 (PST) Received: from heron.mail.pas.earthlink.net (heron.mail.pas.earthlink.net [207.217.120.189]) by mx1.FreeBSD.org (Postfix) with ESMTP id 81B7943FBF for ; Thu, 13 Nov 2003 04:36:34 -0800 (PST) (envelope-from tlambert2@mindspring.com) Received: from user-2ivfmpo.dialup.mindspring.com ([165.247.219.56] helo=mindspring.com) by heron.mail.pas.earthlink.net with asmtp (SSLv3:RC4-MD5:128) (Exim 3.33 #1) id 1AKGi8-0003RY-00; Thu, 13 Nov 2003 04:36:33 -0800 Message-ID: <3FB37807.2887043C@mindspring.com> Date: Thu, 13 Nov 2003 04:24:39 -0800 From: Terry Lambert X-Mailer: Mozilla 4.79 [en] (Win98; U) X-Accept-Language: en MIME-Version: 1.0 To: Daniel Ellard References: <20031112103358.S11644@bowser.eecs.harvard.edu> Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-ELNK-Trace: b1a02af9316fbb217a47c185c03b154d40683398e744b8a470459bcf3b8945d5fa834d01351b5c49a2d4e88014a4647c350badd9bab72f9c350badd9bab72f9c cc: freebsd-hackers@freebsd.org Subject: Re: Confused about HyperThreading and Performance X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 13 Nov 2003 12:36:35 -0000 Daniel Ellard wrote: > Can someone point me at some non-marketing documentation about > hyperthreading on the latest Intel chips? I'm seeing some strange > performance measurements and I would like to figure out what they > mean. Go out to Intel's web site's "developer" section, and look for "SMT". There is a lot of literature. The reason you are seeing a performance drop is contention for shared resources that the scheduler doesn't know are shared. SPECmark and similar benchmarks tend to get worse numbers on every OS when SMT is enabled, due to contention. The only model which will work is a hierarchical affinity and negaffinity model, and I am not away of an OS that is not also treating the hardware as NUMA which works this way (and none of those run on Intel chips; mostly, they run on real NUMA hardware). -- Terry From owner-freebsd-hackers@FreeBSD.ORG Thu Nov 13 08:56:27 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 7B95216A4CE for ; Thu, 13 Nov 2003 08:56:27 -0800 (PST) Received: from mail2.dslextreme.com (mail2.dslextreme.com [66.51.199.52]) by mx1.FreeBSD.org (Postfix) with SMTP id 3D73343FDF for ; Thu, 13 Nov 2003 08:56:26 -0800 (PST) (envelope-from jos@catnook.com) Received: (qmail 8645 invoked from network); 13 Nov 2003 16:56:25 -0000 Received: from unknown (HELO w250.z064001178.sjc-ca.dsl.cnc.net) (66.218.45.239) by 192.168.8.48 with SMTP; Thu, 13 Nov 2003 16:56:25 +0000 Received: (qmail 81268 invoked by uid 1000); 13 Nov 2003 16:56:47 -0000 Date: Thu, 13 Nov 2003 08:56:25 -0800 From: Jos Backus To: Terry Lambert Message-ID: <20031113165647.GA80504@lizzy.catnook.com> Mail-Followup-To: Terry Lambert , freebsd-hackers@freebsd.org References: <3F9CF3F6.8307.ABC1250@localhost> <20031111071944.GA5778@lizzy.catnook.com> <3FB360BE.779DB42F@mindspring.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <3FB360BE.779DB42F@mindspring.com> User-Agent: Mutt/1.5.5.1i cc: freebsd-hackers@freebsd.org Subject: Re: non-root process and PID files X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list Reply-To: jos@catnook.com List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 13 Nov 2003 16:56:27 -0000 On Thu, Nov 13, 2003 at 02:45:18AM -0800, Terry Lambert wrote: > > Why use pid files at all if you could be using a process supervisor instead? > > Who supervises the supervisor? Heh. The supervisor should be small and robust, like init. Has init died on you recently? Do you want to solve this problem or find Nirvana? If the latter, don't use computers. > So this doesn't solve the origin of authority problem. > The problem being solved is avoiding running multiple instances > of roles... so actually, it would be better if the file were > named e.g. "smtp.pid", rather than "sendmail.pid", which would > step on the toes of everyone who wanted to use their program name > as part of the file name to make it harder to use someone else's > software to replace their software. Agreed, but that's a different problem, and using pidfiles is just one way of implementing this. My suggestion is to use /service/smtpd, avoiding the use of pidfiles and their associated problems. > There are also the small issues of ordering (the reason you can't > just run everything out of /etc/ttys via init in the first place), Sure. Hard to get right but not unsolvable. No reason you can't use process monitoring with something like rcNG. > multiple instances, /service/smtpd.{external,internal} > and removing human error from adding and removing new things to be > monitored. That's a generic problem with any type of change management. > -- Terry -- Jos Backus _/ _/_/_/ Sunnyvale, CA _/ _/ _/ _/ _/_/_/ _/ _/ _/ _/ jos at catnook.com _/_/ _/_/_/ require 'std/disclaimer' From owner-freebsd-hackers@FreeBSD.ORG Fri Nov 14 01:46:11 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id D638C16A4CF for ; Fri, 14 Nov 2003 01:46:11 -0800 (PST) Received: from heron.mail.pas.earthlink.net (heron.mail.pas.earthlink.net [207.217.120.189]) by mx1.FreeBSD.org (Postfix) with ESMTP id 0FE9743FD7 for ; Fri, 14 Nov 2003 01:46:11 -0800 (PST) (envelope-from tlambert2@mindspring.com) Received: from user-38lc14c.dialup.mindspring.com ([209.86.4.140] helo=mindspring.com) by heron.mail.pas.earthlink.net with asmtp (SSLv3:RC4-MD5:128) (Exim 3.33 #1) id 1AKaWj-0000kH-00; Fri, 14 Nov 2003 01:46:06 -0800 Message-ID: <3FB4A449.7452A382@mindspring.com> Date: Fri, 14 Nov 2003 01:45:45 -0800 From: Terry Lambert X-Mailer: Mozilla 4.79 [en] (Win98; U) X-Accept-Language: en MIME-Version: 1.0 To: jos@catnook.com References: <3F9CF3F6.8307.ABC1250@localhost> <20031111071944.GA5778@lizzy.catnook.com> <3FB360BE.779DB42F@mindspring.com> <20031113165647.GA80504@lizzy.catnook.com> Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-ELNK-Trace: b1a02af9316fbb217a47c185c03b154d40683398e744b8a472348844266de4801e3d9900071f5fd6350badd9bab72f9c350badd9bab72f9c350badd9bab72f9c cc: freebsd-hackers@freebsd.org Subject: Re: non-root process and PID files X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 14 Nov 2003 09:46:12 -0000 Jos Backus wrote: > On Thu, Nov 13, 2003 at 02:45:18AM -0800, Terry Lambert wrote: > > > Why use pid files at all if you could be using a process supervisor instead? > > > > Who supervises the supervisor? > > Heh. The supervisor should be small and robust, like init. Has init died on > you recently? Do you want to solve this problem or find Nirvana? If the > latter, don't use computers. OK. We already have one of those. We call it "init". 8-). > > There are also the small issues of ordering (the reason you can't > > just run everything out of /etc/ttys via init in the first place), > > Sure. Hard to get right but not unsolvable. No reason you can't use process > monitoring with something like rcNG. We tried very hard to do this on the InterJet. We still ended up shooting most things in the head with large caliber bullets each time the dial on demand interface went up or down because we did not have the idea of hard and soft dependencies. Even if we had had them, though, we would still have been SOL, since many of the Open Source programs we used cached information when they started. Because of this, the data could get stale. For example, say I ran sendmail and bound it to the external port (or INADDR_ANY). What is the host name that I should claim to the remote host when I answer with the "200 Connected" message? What should I use for the argument to the "HELO" or "EHLO" for outbound SMTP connections so that the name I use matches the name the remote host gets on it's crosscheck for the canonical name of the machine contacting it via a gethostbyaddr(getpeername())? Basically, you end up with a system where you either can't cache data, or where the cache has to be chared, or where you implement a generic notification mechanism. No matter how you slice it, though, you're talking about rewriting millions of lines of code. "Cacheing Considered Harmful". > > multiple instances, > > /service/smtpd.{external,internal} Yeah, we did this, so that we could shoot "only" half the processes in the head on link up/down. It sucked. We almost shipped a product that wouldn't hav worked when we did the DNS split, because the dependency graph had to be manually managed, and wasn't. > > and removing human error from adding and removing new things to be > > monitored. > > That's a generic problem with any type of change management. Not really. If your configuration changes all happened in a centralized data repository, and nobody cached anything, but got their information from that central repository, and the interface to the repository was a system interface (so the system could cache on your behalf so performance didn't degrade unbearably), THEN you might have something. After you rewrote millions of lines of Open Source code to use your registry instead of working the way it currently works, which is everyone has their own poop files. If you are lucky, hitting them over the head with a shovel (SIGHUP) works, and you don't have to kill and resurrect them (you just have to wait a long time before the services become usable again, e.g. DNS reading its config files). Anyway, FreeBSD has steadfastly disliked the concept of a registry, ever since Microsoft implemented it in Windows95; it's on of the biggest "NIH" items of all time. -- Terry From owner-freebsd-hackers@FreeBSD.ORG Fri Nov 14 03:57:11 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 8506B16A4CE for ; Fri, 14 Nov 2003 03:57:11 -0800 (PST) Received: from milla.ask33.net (milla.ask33.net [217.197.166.60]) by mx1.FreeBSD.org (Postfix) with ESMTP id 8FB7943FCB for ; Fri, 14 Nov 2003 03:57:10 -0800 (PST) (envelope-from nick@milla.ask33.net) Received: by milla.ask33.net (Postfix, from userid 1001) id D22AB3ABB35; Fri, 14 Nov 2003 12:56:42 +0100 (CET) Date: Fri, 14 Nov 2003 12:56:42 +0100 From: Pawel Jakub Dawidek To: FB Message-ID: <20031114115642.GE85962@garage.freebsd.pl> References: <20031112180124.3F85943FD7@mx1.FreeBSD.org> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-md5; protocol="application/pgp-signature"; boundary="sDKAb4OeUBrWWL6P" Content-Disposition: inline In-Reply-To: <20031112180124.3F85943FD7@mx1.FreeBSD.org> X-PGP-Key-URL: http://garage.freebsd.pl/jules.asc X-OS: FreeBSD 4.8-RELEASE-p9 i386 X-URL: http://garage.freebsd.pl User-Agent: Mutt/1.5.1i cc: freebsd-hackers@freebsd.org Subject: Re: Multiple IPs in Jail X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 14 Nov 2003 11:57:11 -0000 --sDKAb4OeUBrWWL6P Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Wed, Nov 12, 2003 at 10:01:23AM -0800, FB wrote: +> Before the patch was applied, the jail environment had no problem with d= ns. +> After the patch was applied however (and userland rebuilt both on host = and +> jail), dns breaks in the jail environment. Basically, gethostbyname fai= ls +> and h_errno is set to 2 - Host name lookup failure. the system is config= ured +> properly, since the only changes are to the kernel and the modified jail +> mechanism. Also interesting is that the failure is immediate, there is no +> timeout.=20 Gethostbyname(3) always fails? You could try this patch againt recent -CURRENT, but I haven't added anything - for me gethostbyname(3) in jail works fine. http://garage.freebsd.pl/patches/mijail5_2.patch --=20 Pawel Jakub Dawidek pawel@dawidek.net UNIX Systems Programmer/Administrator http://garage.freebsd.pl Am I Evil? Yes, I Am! http://cerber.sourceforge.net --sDKAb4OeUBrWWL6P Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.0.7 (FreeBSD) iQCVAwUBP7TC+j/PhmMH/Mf1AQH/JwP+Nai/Xw9M8/K3O6d1I0/FH0b+jNNN/jF5 dVZBzSzaakzQ0zFlFqMJmhXfxwI/vuQ2CGrVUSZB/oHACFC7lLV5QW0slT534gWT clZMdTqVgQCKCF2tcHE9eW5lGheTcaqAyWeiqGbNqhHD3gXEo9r9/aikruDiuiwv G8wCdr9eaDM= =sjLb -----END PGP SIGNATURE----- --sDKAb4OeUBrWWL6P-- From owner-freebsd-hackers@FreeBSD.ORG Fri Nov 14 05:42:59 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id CAEC116A4CE for ; Fri, 14 Nov 2003 05:42:59 -0800 (PST) Received: from pixies.tirloni.org (pixies.tirloni.org [200.203.183.37]) by mx1.FreeBSD.org (Postfix) with ESMTP id E29B343FAF for ; Fri, 14 Nov 2003 05:42:58 -0800 (PST) (envelope-from tirloni@tirloni.org) Received: by pixies.tirloni.org (Postfix, from userid 1000) id A01651E140B; Fri, 14 Nov 2003 11:42:54 -0200 (BRST) Date: Fri, 14 Nov 2003 11:42:54 -0200 From: "Giovanni P. Tirloni" To: freebsd-hackers@freebsd.org Message-ID: <20031114134254.GX78465@pixies.tirloni.org> Mail-Followup-To: freebsd-hackers@freebsd.org Mime-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline X-Info: http://www.tirloni.org User-Agent: Mutt/1.5.4i Subject: netstat(8) GEN and per-CPU caches X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 14 Nov 2003 13:42:59 -0000 Hi, When is the GEN cache used ? My desktop machine never has mbufs in the GEN pool but some other machine (acting as gateways in small/medium-sized networks) do have them. DESKTOP (no load at all) mbuf usage: GEN cache: 0/0 (in use/in pool) CPU #0 cache: 1/128 (in use/in pool) Total: 1/128 (in use/in pool) mbuf cluster usage: GEN cache: 0/0 (in use/in pool) CPU #0 cache: 0/120 (in use/in pool) Total: 0/120 (in use/in pool) GATEWAY (12 machines, kind of loaded) mbuf usage: GEN cache: 0/32 (in use/in pool) CPU #0 cache: 3/512 (in use/in pool) Total: 3/544 (in use/in pool) mbuf cluster usage: GEN cache: 0/0 (in use/in pool) CPU #0 cache: 0/88 (in use/in pool) Total: 0/88 (in use/in pool) GATEWAY (30 machines) mbuf usage: GEN cache: 0/0 (in use/in pool) CPU #0 cache: 2/256 (in use/in pool) Total: 2/256 (in use/in pool) mbuf cluster usage: GEN cache: 0/56 (in use/in pool) CPU #0 cache: 0/128 (in use/in pool) Total: 0/184 (in use/in pool) Thanks in advance, -- Giovanni P. Tirloni Fingerprint: 8C3F BEC5 79BD 3E9B EDB8 72F4 16E8 BA5E D031 5C26 From owner-freebsd-hackers@FreeBSD.ORG Fri Nov 14 07:08:11 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 0FACC16A4CE for ; Fri, 14 Nov 2003 07:08:11 -0800 (PST) Received: from bast.unixathome.org (bast.unixathome.org [66.11.174.150]) by mx1.FreeBSD.org (Postfix) with ESMTP id DA31C43FDF for ; Fri, 14 Nov 2003 07:08:09 -0800 (PST) (envelope-from dan@langille.org) Received: from wocker (wocker.unixathome.org [192.168.0.99]) by bast.unixathome.org (Postfix) with ESMTP id 9F26C3D28; Fri, 14 Nov 2003 10:08:08 -0500 (EST) From: "Dan Langille" To: Daniel Eischen Date: Fri, 14 Nov 2003 10:08:08 -0500 MIME-Version: 1.0 Message-ID: <3FB4A988.15769.9BCCC68@localhost> Priority: normal In-reply-to: <3F683824.14446.AB8FEDA@localhost> References: X-mailer: Pegasus Mail for Windows (v4.02a) Content-type: text/plain; charset=US-ASCII Content-transfer-encoding: 7BIT Content-description: Mail message body cc: hackers@freebsd.org Subject: Re: [PATCH] : libc_r/uthread/uthread_write.c X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 14 Nov 2003 15:08:11 -0000 Daniel: It appears the patch which was comitted didn't include everything it should. I blame myself because the patch below contains both debugging code and is reversed. I will submit a PR with a patch. In brief, what is missing is: + if (n == 0) { + break; + } + Oops. On 17 Sep 2003 at 10:32, Dan Langille wrote: > On 16 Sep 2003 at 20:49, Daniel Eischen wrote: > > > On Tue, 16 Sep 2003, Dan Langille wrote: > > > > > I've had preliminary success with this patch. More testing needs > > > to be done, but in the meantime, I would appreciate reviews and > > > comments. The patched code is available from > > > http://beta.freebsddiary.org/tmp/uthread_write.c and the patch > > > appears below. > > > > > > In short, the logic has been changed to ensure that if __sys_write > > > returns zero, this value is returned by _write. > > > > I think this is not quite correct. Since libc_r is looping > > and some data may have been read, then the partial byte count > > should be returned, not zero. It is possible the partial byte > > count could also be zero in some cases, so it would result > > in zero being returned in those instances. > > I see what you mean. Please have a look at > http://beta.freebsddiary.org/tmp/uthread_write.c2 > The patch appears at the end of this message. > > This version will return the partial byte count (which has always been > zero in testing) but exit the loop if the return code is zero. > > > I think the problem lies with the SCSI tape device. It should > > either return 0 or -1 with errno=ENOSPC on a write that detects an > > EOT, not partial byte count. > > You are referring to sa(4)? > > > If you are using libkse or > > libthr, you will get a partial byte count and not zero because > > the tape driver returns the (partial) bytes written. So exiting the > > loop in libc_r and returning 0 would only seem to correct the > > "problem" for libc_r. > > The problem found when running under pthreads on 4.8-stable [i.e. EOT > is not returned to the application code] is not found with libkse on > 5.1-current. > > --- uthread_write.c Wed Sep 17 06:23:43 2003 > +++ uthread_write.c.org Tue Sep 16 12:14:22 2003 > @@ -39,7 +39,6 @@ > #include > #include > #include "pthread_private.h" > -#include > > ssize_t > _write(int fd, const void *buf, size_t nbytes) > @@ -71,10 +70,6 @@ > /* Check if file operations are to block */ > blocking = ((_thread_fd_getflags(fd) & O_NONBLOCK) == 0); > > - setlogmask (LOG_UPTO (LOG_NOTICE)); > - openlog("uthread_write.c", LOG_CONS | LOG_PID | LOG_NDELAY, > LOG_LOCAL1); > - syslog (LOG_NOTICE, "uthread_write.c : blocking = '%d'", > blocking); > - > /* > * Loop while no error occurs and until the expected number > * of bytes are written if performing a blocking write: > @@ -98,7 +93,7 @@ > * write: > */ > if (blocking && ((n < 0 && (errno == EWOULDBLOCK || > - errno == EAGAIN)) || (n > 0 && num < nbytes))) { > + errno == EAGAIN)) || (n >= 0 && num < nbytes))) { > curthread->data.fd.fd = fd; > _thread_kern_set_timeout(NULL); > > @@ -136,16 +131,11 @@ > * If there was an error, return partial success > * (if any bytes were written) or else the error: > */ > - } else if (n <= 0) { > + } else if (n < 0) { > if (num > 0) > ret = num; > else > ret = n; > - > - if (n == 0) { > - syslog (LOG_NOTICE, "zero has been returned in uthread_write.c; > num = '%d'", num); - break; - } > > /* Check if the write has completed: */ > } else if (num >= nbytes) > > -- > Dan Langille : http://www.langille.org/ > > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to > "freebsd-hackers-unsubscribe@freebsd.org" > -- Dan Langille : http://www.langille.org/ From owner-freebsd-hackers@FreeBSD.ORG Fri Nov 14 07:37:26 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 21EC316A4CF for ; Fri, 14 Nov 2003 07:37:26 -0800 (PST) Received: from bast.unixathome.org (bast.unixathome.org [66.11.174.150]) by mx1.FreeBSD.org (Postfix) with ESMTP id 0347B43F75 for ; Fri, 14 Nov 2003 07:37:24 -0800 (PST) (envelope-from dan@langille.org) Received: from wocker (wocker.unixathome.org [192.168.0.99]) by bast.unixathome.org (Postfix) with ESMTP id 30CE93D28; Fri, 14 Nov 2003 10:37:23 -0500 (EST) From: "Dan Langille" To: Daniel Eischen Date: Fri, 14 Nov 2003 10:37:23 -0500 MIME-Version: 1.0 Message-ID: <3FB4B063.19806.9D792B7@localhost> Priority: normal In-reply-to: <3FB4A988.15769.9BCCC68@localhost> References: <3F683824.14446.AB8FEDA@localhost> X-mailer: Pegasus Mail for Windows (v4.02a) Content-type: text/plain; charset=US-ASCII Content-transfer-encoding: 7BIT Content-description: Mail message body cc: hackers@freebsd.org Subject: Re: [PATCH] : libc_r/uthread/uthread_write.c X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 14 Nov 2003 15:37:26 -0000 On 14 Nov 2003 at 10:08, Dan Langille wrote: > Daniel: It appears the patch which was comitted didn't include > everything it should. I blame myself because the patch below > contains both debugging code and is reversed. I will submit a PR > with a patch. In brief, what is missing is: > > + if (n == 0) { > + break; > + } > + See http://www.freebsd.org/cgi/query-pr.cgi?pr=59291 Please don't commit this until I've checked something else out first. I am 100% sure this is correct, but I want it to be validated by testing on other systems first. I suspect this will be completed within a week or so. cheers -- Dan Langille : http://www.langille.org/ From owner-freebsd-hackers@FreeBSD.ORG Fri Nov 14 07:41:29 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 4C3BA16A4CE for ; Fri, 14 Nov 2003 07:41:29 -0800 (PST) Received: from smtp.omnis.com (smtp.omnis.com [216.239.128.26]) by mx1.FreeBSD.org (Postfix) with ESMTP id 9A4C743FDD for ; Fri, 14 Nov 2003 07:41:27 -0800 (PST) (envelope-from wes@softweyr.com) Received: from softweyr.homeunix.net (66-91-236-204.san.rr.com [66.91.236.204]) by smtp-relay.omnis.com (Postfix) with ESMTP id 7931372E15; Fri, 14 Nov 2003 07:34:07 -0800 (PST) From: Wes Peters Organization: Softweyr To: Terry Lambert , jos@catnook.com Date: Fri, 14 Nov 2003 07:41:24 -0800 User-Agent: KMail/1.5.4 References: <3F9CF3F6.8307.ABC1250@localhost> <20031113165647.GA80504@lizzy.catnook.com> <3FB4A449.7452A382@mindspring.com> In-Reply-To: <3FB4A449.7452A382@mindspring.com> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200311140741.24751.wes@softweyr.com> cc: freebsd-hackers@freebsd.org Subject: Re: non-root process and PID files X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 14 Nov 2003 15:41:29 -0000 On Friday 14 November 2003 01:45 am, Terry Lambert wrote: > Jos Backus wrote: > > On Thu, Nov 13, 2003 at 02:45:18AM -0800, Terry Lambert wrote: > > > > > > There are also the small issues of ordering (the reason you can't > > > just run everything out of /etc/ttys via init in the first place), > > > > Sure. Hard to get right but not unsolvable. No reason you can't use > > process monitoring with something like rcNG. > > We tried very hard to do this on the InterJet. We still ended up > shooting most things in the head with large caliber bullets each > time the dial on demand interface went up or down because we did > not have the idea of hard and soft dependencies. On the latest iteration of system configuration at St. Bernard, we do track hard and soft dependencies. It turns out that it doesn't help as much as you'd like, because... > Even if we had > had them, though, we would still have been SOL, since many of the > Open Source programs we used cached information when they started. > Because of this, the data could get stale. Yup. I'm still amazed at the amount of software that doesn't have the ability to reset it's configuration without just shooting it and starting anew. > > /service/smtpd.{external,internal} > > Yeah, we did this, so that we could shoot "only" half the processes > in the head on link up/down. > > It sucked. We almost shipped a product that wouldn't hav worked > when we did the DNS split, because the dependency graph had to be > manually managed, and wasn't. We work in a much more static environment, which does make things a bit less of a challenge. I encountered all the same problems at DoBox, and solved them the same way. The St. Bernard appliances tend to get reconfigured several times during installation then rarely after the fact, so the challenge is to make sure we don't blow up while the customer is trying to get it working out of the box. Tracking the startup dependencies separately from reconfiguration dependencies helps quite a bit on this front. > > > and removing human error from adding and removing new things to be > > > monitored. > > > > That's a generic problem with any type of change management. > > Not really. If your configuration changes all happened in a > centralized data repository, and nobody cached anything, but got > their information from that central repository, and the interface > to the repository was a system interface (so the system could > cache on your behalf so performance didn't degrade unbearably), > THEN you might have something. After you rewrote millions of > lines of Open Source code to use your registry instead of working > the way it currently works, which is everyone has their own poop > files. If you are lucky, hitting them over the head with a > shovel (SIGHUP) works, and you don't have to kill and resurrect > them (you just have to wait a long time before the services become > usable again, e.g. DNS reading its config files). We have one of those. It even has a (relatively) stable API. It's called PostgreSQL, perhaps you've heard of it? ;^) Not what I'd recommend for a general configuration database, but we were already using it for other data, and it does a pretty good job of cache coherency. The differences in processor speed and memory cost these days vs. what you worked with at Whistle makes a lot of difference in what you can do as well. > Anyway, FreeBSD has steadfastly disliked the concept of a registry, > ever since Microsoft implemented it in Windows95; it's on of the > biggest "NIH" items of all time. And yet struggles to move towards it in a limited fashion, with the rc.conf concept. The problem would be making the necessary changes to all those millions of lines of somebody else's code to have everything work out of the "registry." -- Where am I, and what am I doing in this handbasket? Wes Peters wes@softweyr.com From owner-freebsd-hackers@FreeBSD.ORG Fri Nov 14 07:57:07 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 48C2316A4CE for ; Fri, 14 Nov 2003 07:57:07 -0800 (PST) Received: from Vitsch.net (b74143.upc-b.chello.nl [212.83.74.143]) by mx1.FreeBSD.org (Postfix) with ESMTP id 7441043FAF for ; Fri, 14 Nov 2003 07:57:05 -0800 (PST) (envelope-from Danovitsch@Vitsch.net) Received: from FreeBSD.Danovitsch.LAN (b83007.upc-b.chello.nl [212.83.83.7]) by Vitsch.net (8.12.3p2/8.11.3) with ESMTP id hAEFv1rO002722 for ; Fri, 14 Nov 2003 16:57:02 +0100 (CET) (envelope-from Danovitsch@Vitsch.net) Content-Type: text/plain; charset="us-ascii" From: "Daan Vreeken [PA4DAN]" To: FreeBSD-hackers@FreeBSD.org Date: Fri, 14 Nov 2003 16:56:58 +0100 User-Agent: KMail/1.4.3 MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable Message-Id: <200311141656.58587.Danovitsch@Vitsch.net> Subject: Errors in USB subsystem and bktr driver X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 14 Nov 2003 15:57:07 -0000 Hi, I have just filed kern/59290 about an error in all usb ethernet drivers t= hat=20 can crash a system and kern/59289 about small error in an ioctl in the bk= tr=20 driver. (Both with patch). Anyone interrested in fixing them? grtz, Daan From owner-freebsd-hackers@FreeBSD.ORG Fri Nov 14 09:45:50 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 210ED16A4CF for ; Fri, 14 Nov 2003 09:45:50 -0800 (PST) Received: from mail3.dslextreme.com (mail3.dslextreme.com [66.51.199.73]) by mx1.FreeBSD.org (Postfix) with SMTP id 3D4AE43FBF for ; Fri, 14 Nov 2003 09:45:49 -0800 (PST) (envelope-from jos@catnook.com) Received: (qmail 3632 invoked from network); 14 Nov 2003 17:45:48 -0000 Received: from unknown (HELO w250.z064001178.sjc-ca.dsl.cnc.net) (66.218.45.239) by 192.168.8.73 with SMTP; Fri, 14 Nov 2003 17:45:48 +0000 Received: (qmail 43444 invoked by uid 1000); 14 Nov 2003 17:46:07 -0000 Date: Fri, 14 Nov 2003 09:45:45 -0801 From: Jos Backus To: Terry Lambert Message-ID: <20031114174607.GA42257@lizzy.catnook.com> Mail-Followup-To: Terry Lambert , freebsd-hackers@freebsd.org References: <3F9CF3F6.8307.ABC1250@localhost> <20031111071944.GA5778@lizzy.catnook.com> <3FB360BE.779DB42F@mindspring.com> <20031113165647.GA80504@lizzy.catnook.com> <3FB4A449.7452A382@mindspring.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <3FB4A449.7452A382@mindspring.com> User-Agent: Mutt/1.5.5.1i cc: freebsd-hackers@freebsd.org Subject: Re: non-root process and PID files X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list Reply-To: jos@catnook.com List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 14 Nov 2003 17:45:50 -0000 On Fri, Nov 14, 2003 at 01:45:45AM -0800, Terry Lambert wrote: > Jos Backus wrote: > > On Thu, Nov 13, 2003 at 02:45:18AM -0800, Terry Lambert wrote: > > > > Why use pid files at all if you could be using a process supervisor instead? > > > > > > Who supervises the supervisor? > > > > Heh. The supervisor should be small and robust, like init. Has init died on > > you recently? Do you want to solve this problem or find Nirvana? If the > > latter, don't use computers. > > OK. We already have one of those. We call it "init". 8-). Feature-wise init and svscan/supervise don't quite match; svscan has more features, one of which being that it doesn't use a single control file which if you screw it can render your system unusable. Even SysV init has more (useful) features than ours. Also, init is kinda hard to use by non-root users for that reason. People have been known to successfully replace init with svscan, btw. > > > There are also the small issues of ordering (the reason you can't > > > just run everything out of /etc/ttys via init in the first place), > > > > Sure. Hard to get right but not unsolvable. No reason you can't use process > > monitoring with something like rcNG. > > We tried very hard to do this on the InterJet. We still ended up > shooting most things in the head with large caliber bullets each > time the dial on demand interface went up or down because we did > not have the idea of hard and soft dependencies. Even if we had > had them, though, we would still have been SOL, since many of the > Open Source programs we used cached information when they started. > Because of this, the data could get stale. [snip] > "Cacheing Considered Harmful". This is really off-topic. But sure, there are instances where this approach is less than robust. So what? Using pidfiles doesn't solve this problem either. [snip] > > > and removing human error from adding and removing new things to be > > > monitored. > > > > That's a generic problem with any type of change management. > > Not really. If your configuration changes all happened in a > centralized data repository, and nobody cached anything, but got > their information from that central repository, and the interface > to the repository was a system interface (so the system could > cache on your behalf so performance didn't degrade unbearably), > THEN you might have something. Ahh, the gold server approach lurks behind this (as one example). But until we have a perfect world where people don't have to touch boxes directly we're stuck with them making mistakes. Also, software can fail in ways unaccounted for. But this is really off-topic. > After you rewrote millions of > lines of Open Source code to use your registry instead of working > the way it currently works, which is everyone has their own poop > files. If you are lucky, hitting them over the head with a > shovel (SIGHUP) works, and you don't have to kill and resurrect > them (you just have to wait a long time before the services become > usable again, e.g. DNS reading its config files). > > Anyway, FreeBSD has steadfastly disliked the concept of a registry, > ever since Microsoft implemented it in Windows95; it's on of the > biggest "NIH" items of all time. I think it would help if config files had a common structure and could be queried for "interesting" service metadata like dependencies. See the Arusha project for an example. Anyway, we were talking about the use of pidfiles versus using a process monitor. I'm simply claiming that using a process monitor is far superior. > -- Terry -- Jos Backus _/ _/_/_/ Sunnyvale, CA _/ _/ _/ _/ _/_/_/ _/ _/ _/ _/ jos at catnook.com _/_/ _/_/_/ require 'std/disclaimer' From owner-freebsd-hackers@FreeBSD.ORG Fri Nov 14 11:13:59 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id A9D5F16A4CE for ; Fri, 14 Nov 2003 11:13:59 -0800 (PST) Received: from hanoi.cronyx.ru (hanoi.cronyx.ru [144.206.181.53]) by mx1.FreeBSD.org (Postfix) with ESMTP id 030A643FBF for ; Fri, 14 Nov 2003 11:13:58 -0800 (PST) (envelope-from rik@cronyx.ru) Received: (from root@localhost) by hanoi.cronyx.ru id hAEJBAKf044241 for freebsd-hackers@freebsd.org.checked; (8.12.8/vak/2.1) Fri, 14 Nov 2003 22:11:10 +0300 (MSK) (envelope-from rik@cronyx.ru) Received: from cronyx.ru (hi.cronyx.ru [144.206.181.94]) by hanoi.cronyx.ru with ESMTP id hAEJ9o24044190 for ; (8.12.8/vak/2.1) Fri, 14 Nov 2003 22:09:50 +0300 (MSK) (envelope-from rik@cronyx.ru) Message-ID: <3FB52925.4000009@cronyx.ru> Date: Fri, 14 Nov 2003 22:12:37 +0300 From: Roman Kurakin User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.4a) Gecko/20030401 X-Accept-Language: en-us, en MIME-Version: 1.0 To: freebsd-hackers@freebsd.org Content-Type: text/plain; charset=KOI8-R; format=flowed Content-Transfer-Encoding: 7bit Subject: MAJOR number X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 14 Nov 2003 19:13:59 -0000 Hi, I need a new MAJOR number for our new device. How can I get it? I've read that FreeBSD doesn't use them any more. But we may need it to not interfere with other device drivers in previous releases of FreeBSD. ??? ce Cronyx Tau-32 E1 adapter ___ Best regars, Roman Kurakin Cronyx Engineering http://www.cronyx.ru From owner-freebsd-hackers@FreeBSD.ORG Fri Nov 14 11:24:49 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id BA48516A4CE for ; Fri, 14 Nov 2003 11:24:49 -0800 (PST) Received: from mail.pcnet.com (mail.pcnet.com [204.213.232.4]) by mx1.FreeBSD.org (Postfix) with ESMTP id E4DAC43FAF for ; Fri, 14 Nov 2003 11:24:48 -0800 (PST) (envelope-from eischen@vigrid.com) Received: from mail.pcnet.com (mail.pcnet.com [204.213.232.4]) by mail.pcnet.com (8.12.10/8.12.1) with ESMTP id hAEJOm1G005968; Fri, 14 Nov 2003 14:24:48 -0500 (EST) Date: Fri, 14 Nov 2003 14:24:48 -0500 (EST) From: Daniel Eischen X-Sender: eischen@pcnet5.pcnet.com To: Dan Langille In-Reply-To: <3FB4A988.15769.9BCCC68@localhost> Message-ID: MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII cc: hackers@freebsd.org Subject: Re: [PATCH] : libc_r/uthread/uthread_write.c X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 14 Nov 2003 19:24:49 -0000 On Fri, 14 Nov 2003, Dan Langille wrote: > Daniel: It appears the patch which was comitted didn't include > everything it should. I blame myself because the patch below > contains both debugging code and is reversed. I will submit a PR > with a patch. In brief, what is missing is: > > + if (n == 0) { > + break; > + } > + > > Oops. Please send me another email when you are done testing it and want it committed. -- Dan Eischen From owner-freebsd-hackers@FreeBSD.ORG Fri Nov 14 13:37:09 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id F2E3316A4CE for ; Fri, 14 Nov 2003 13:37:08 -0800 (PST) Received: from malasada.lava.net (malasada.lava.net [64.65.64.17]) by mx1.FreeBSD.org (Postfix) with ESMTP id 5A2F243F75 for ; Fri, 14 Nov 2003 13:37:08 -0800 (PST) (envelope-from cliftonr@lava.net) Received: by malasada.lava.net (Postfix, from userid 102) id 585841539EC; Fri, 14 Nov 2003 11:37:06 -1000 (HST) Date: Fri, 14 Nov 2003 11:37:05 -1000 From: Clifton Royston To: hackers@freebsd.org Message-ID: <20031114113705.D5759@tikitechnologies.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.2.5.1i Subject: Observations on make release process? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 14 Nov 2003 21:37:09 -0000 Is this as good a list as any for observations on the FreeBSD "make release" process? I can't see any other list that fits the subject. I have some observations fairly fresh in my mind from trying to build a version of FreeBSD 4.8.12 with the IBM Propolice anti-stack-smash patch. This was intended as a quick prelude to trying to build our own internal release with a reduced set of base binaries, different packages available on CD for install, etc. However, I certainly ran into more pitfalls than I expected along the way, and a lot less detail and more handwaving than I expected in the docs I could find. I'm hoping I can usefully lay a few of the pitfalls or issues out for future reference by others, and for correction by those who are more knowledgeable than I. -- Clifton -- Clifton Royston -- cliftonr@tikitechnologies.com Tiki Technologies Lead Programmer/Software Architect Did you ever fly a kite in bed? Did you ever walk with ten cats on your head? Did you ever milk this kind of cow? Well we can do it. We know how. If you never did, you should. These things are fun, and fun is good. -- Dr. Seuss From owner-freebsd-hackers@FreeBSD.ORG Fri Nov 14 13:48:17 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 3EA3D16A4E0 for ; Fri, 14 Nov 2003 13:48:17 -0800 (PST) Received: from smtpzilla2.xs4all.nl (smtpzilla2.xs4all.nl [194.109.127.138]) by mx1.FreeBSD.org (Postfix) with ESMTP id 80EA443FDD for ; Fri, 14 Nov 2003 13:48:15 -0800 (PST) (envelope-from wkb@freebie.xs4all.nl) Received: from freebie.xs4all.nl (freebie.xs4all.nl [213.84.32.253]) by smtpzilla2.xs4all.nl (8.12.9/8.12.9) with ESMTP id hAELmD6n042622; Fri, 14 Nov 2003 22:48:14 +0100 (CET) Received: from freebie.xs4all.nl (localhost [127.0.0.1]) by freebie.xs4all.nl (8.12.9p2/8.12.9) with ESMTP id hAELmDcH008230; Fri, 14 Nov 2003 22:48:13 +0100 (CET) (envelope-from wkb@freebie.xs4all.nl) Received: (from wkb@localhost) by freebie.xs4all.nl (8.12.9p2/8.12.9/Submit) id hAELmDIX008229; Fri, 14 Nov 2003 22:48:13 +0100 (CET) (envelope-from wkb) Date: Fri, 14 Nov 2003 22:48:13 +0100 From: Wilko Bulte To: Clifton Royston Message-ID: <20031114214813.GA8188@freebie.xs4all.nl> References: <20031114113705.D5759@tikitechnologies.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20031114113705.D5759@tikitechnologies.com> User-Agent: Mutt/1.4.1i X-OS: FreeBSD 4.9-STABLE X-PGP: finger wilko@freebsd.org cc: hackers@freebsd.org Subject: Re: Observations on make release process? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 14 Nov 2003 21:48:17 -0000 On Fri, Nov 14, 2003 at 11:37:05AM -1000, Clifton Royston wrote: > Is this as good a list as any for observations on the FreeBSD "make > release" process? I can't see any other list that fits the subject. Did you dig into http://www.freebsd.org/releng/#docs ? -- | / o / /_ _ |/|/ / / /( (_) Bulte wilko@FreeBSD.org From owner-freebsd-hackers@FreeBSD.ORG Fri Nov 14 14:48:37 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 636DF16A4CE for ; Fri, 14 Nov 2003 14:48:37 -0800 (PST) Received: from vorlon.swishmail.com (vorlon.swishmail.com [209.10.110.97]) by mx1.FreeBSD.org (Postfix) with ESMTP id 6291243FCB for ; Fri, 14 Nov 2003 14:48:36 -0800 (PST) (envelope-from freebsd@swishmail.com) Received: (qmail 62901 invoked by uid 89); 14 Nov 2003 22:48:35 -0000 Received: from unknown (HELO ?192.168.2.143?) (mach@swishmail.com@209.208.197.50) by vorlon.swishmail.com with AES256-SHA encrypted SMTP; 14 Nov 2003 22:48:35 -0000 Date: Fri, 14 Nov 2003 17:52:27 -0500 From: Kris von Mach To: freebsd-hackers@freebsd.org Message-ID: <28306703.1068832347@[192.168.2.143]> X-Mailer: Mulberry/3.1.0b9 (Win32) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit Content-Disposition: inline Subject: Problems with uthread_kern.c in FreeBSD-5.1-p10 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 14 Nov 2003 22:48:37 -0000 Hello, I am not sure if this is the right place to post this, but here it goes. There seems to be problems with uthread_kern.c and maybe other parts of libc/threads in FreeBSD-5.1-p10. Here are some details about the system: FreeBSD vorlon.swishmail.com 5.1-RELEASE-p10 FreeBSD 5.1-RELEASE-p10 #0: Mon Oct 6 02:16:15 EDT 2003 root@vorlon.swishmail.com:/usr/obj/usr/src/sys/VORLON i386 CPU: AMD Opteron(tm) Processor 246 (1990.05-MHz 686-class CPU) real memory = 3690987520 (3520 MB) avail memory = 3590627328 (3424 MB) FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs I have installed Apache2, mod_php4, openssl from ports. Apache/2.0.48 (Unix) PHP/4.3.4 mod_ssl/2.0.48 OpenSSL/0.9.7c Apache starts up fine. But after a while httpd process ends up using 100% CPU, and eventually more httpd processes start doing the same and the web server becomes unresponsive. PID USERNAME PRI NICE SIZE RES STATE C TIME WCPU CPU COMMAND 59780 nobody 130 0 36080K 20316K *Giant 1 19:57 94.09% 94.09% httpd Nov 14 16:22:55 vorlon kernel: pid 59390 (httpd), uid 65534: exited on signal 6 Nov 14 16:25:33 vorlon kernel: pid 59393 (httpd), uid 65534: exited on signal 6 Nov 14 16:28:10 vorlon kernel: pid 59672 (httpd), uid 65534: exited on signal 6 I have been trying to track what is causing this and enabled debug in httpd.conf and I started getting these errors in error_log for apache: Fatal error 'Unable to read from thread kernel pipe' at line 1100 in file /usr/src/lib/libc_r/uthread/uthread_kern.c (errno = 0) [Fri Nov 14 16:28:10 2003] [notice] child pid 59672 exit signal Abort trap (6) I believe someone posted that Gnucash, and ruby have problems and give the same error as above. Also there was a post about Apache2 and SSL locking up the system, and this may be related. On another note, I have installed Setiathome, and when ran it only starts with one process instead of two like it should: /usr/local/etc/rc.d/setiathome.sh start Another processes is already using the shared memory. SETI@home ps -auxw |grep seti setiathome 62458 99.0 0.4 16232 15228 p2 RN 5:37PM 5:38.64 /usr/local/sbin/setiathome -email -graphics -nice 15 setiathome 62457 0.0 0.0 900 484 p2 I 5:37PM 0:00.00 /bin/sh -T /usr/local/libexec/setiathome.bin setiathome 62465 0.0 0.0 144 36 p2 I 5:37PM 0:00.00 sleep 21600 I have not experienced any of these problems on FreeBSD-4.8 or earlier. Though I haven't tried running apache2 on them yet. Is this a bug or a user problem? From owner-freebsd-hackers@FreeBSD.ORG Fri Nov 14 14:57:21 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 9749C16A4CE for ; Fri, 14 Nov 2003 14:57:21 -0800 (PST) Received: from malasada.lava.net (malasada.lava.net [64.65.64.17]) by mx1.FreeBSD.org (Postfix) with ESMTP id CD66943FDD for ; Fri, 14 Nov 2003 14:57:20 -0800 (PST) (envelope-from cliftonr@lava.net) Received: by malasada.lava.net (Postfix, from userid 102) id 3D249153E32; Fri, 14 Nov 2003 12:57:20 -1000 (HST) Date: Fri, 14 Nov 2003 12:57:19 -1000 From: Clifton Royston To: Wilko Bulte Message-ID: <20031114125719.E5759@tikitechnologies.com> References: <20031114113705.D5759@tikitechnologies.com> <20031114214813.GA8188@freebie.xs4all.nl> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.2.5.1i In-Reply-To: <20031114214813.GA8188@freebie.xs4all.nl>; from wkb@freebie.xs4all.nl on Fri, Nov 14, 2003 at 10:48:13PM +0100 cc: hackers@freebsd.org Subject: Re: Observations on make release process? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 14 Nov 2003 22:57:21 -0000 On Fri, Nov 14, 2003 at 10:48:13PM +0100, Wilko Bulte wrote: > On Fri, Nov 14, 2003 at 11:37:05AM -1000, Clifton Royston wrote: > > Is this as good a list as any for observations on the FreeBSD "make > > release" process? I can't see any other list that fits the subject. > > Did you dig into http://www.freebsd.org/releng/#docs ? Oh yes, that was one of my "bibles" so far, especially along with "man release" and some other notes I've found on the web like: Here's one minor inaccuracy (or at any rate inadequacy) I've found in "man release" and the above pages: * The "release" man page refers to the release.1 - release.10, ftp.1, etc. as subtargets of "release". Actually, they are not proper subtargets of release and you can't use them like that. The release.1-release.10 and similar are instead subtargets of the dorelease target, a special target which must only be executed in the chrooted environment and only with a number of environment variables previously set. The "release" and "rerelease" targets both create an "mk" script in the root for the chroot and then execute it in the chrooted environment to set a number of variables and make the "dorelease" target. This limits the number of things you can set to control the behavior of the build process to *only* the specific variables documented in the release man page which the "release" and "rerelease" targets know how to set in the chrooted /mk script. Only the "release" and "rerelease" targets are valid in the normal environment; only the "dorelease" target and its subtargets are valid in the chrooted release environment. Another really confusing pitfall I ran into: * Two different copies of cc/gcc get used for different parts of the release build. This really had me pulling my hair out as to why some compiler arguments were being rejected in some parts of the chrooted build, while they worked fine in others. Finally I realized that many makefiles in the kernel-building portion of the release process (not always building kernel files themselves, and not always invoked with COPTFLAGS) get invoked with a path which corresponds to /var/release/usr/obj/usr/src/i386/usr/bin. This isn't mentioned anywhere that I found, unless I'm just blind. * I also ran into some weird interactions from the fact (documented) that you must do a buildworld outside the chrooted environment first, and then another one gets done inside the chrooted environment. What's not documented but seems to be required is that the make configuration defaults used for these two builds must match (exactly? fairly closely?) and the latter set of defaults comes out of a fresh CVS checkout. Therefore it would seem that if you have a custom /etc/make.conf file that you are normally building/updating your system with (e.g. if you have run "use.perl ports") you must move it aside before doing a buildworld in /usr/src for a "make release", and then must move it back and clean everything before you next do a regular buildworld for your system. * To have the vn portions of the build run properly, if you have not built vn into your kernel, it would seem the "make release" and "make rerelease" targets must be run from a normal root shell, not via sudo. (I rarely use a root shell, preferring to use sudo.) It would seem that "sudo make release" should have done it, but whenever I tried that, the vnconfig step would fail to load the vn module, whereas it would load if it was run from a separate shell.Again, it took me quite a while of troubleshooting to figure out that vn worked as root both outside and inside the chroot environment, but apparently wouldn't work from a sudo'd make. I'm completely mystified by that one, as I can't see why it wouldn't work. * It would appear with 4.8 that if you don't explicitly set KERNEL_FLAGS="'COPTFLAGS=-O -pipe'" in the "make release" command, you end up with a kernel and root file system set that is too big to fit on a floppy, causing the "make release" to bomb at the boot floppy creation step. (I should confirm this by rerunning...) * There is currently no documentation I've been able to find on how to remove certain elements from the base system in a release build. In particular, what one might try because it "normally" works - namely setting NOBIND, NOSENDMAIL, etc. in your make configuration variables - only causes the build process to fail. However, I hope to puzzle this out pretty shortly as I think I saw something mentioned about this on -hackers a while back, and will then add that to my notes. Of course, it's possible I have made some errors in some of these observations. One problem is that it takes so long to rerun a build from scratch, it is tempting (and timesaving) to redo from where it failed with "make rerelease" but in that case it's hard to be sure that you have consistent results. Even after thinking I had the process down 100%, I retried it and failed, which led me to have to do some more tweaking on the compiler options to correctly deal with my second point above. It also bears mentioning that if you are having errors in the make process and want to do serious debugging on what's going wrong, you really *must* do it by chrooting a root shell into the release chroot environment, and doing all your troubleshooting there. Trying to troubleshoot from outside the chroot is likely to mislead you. Hopefully if I can put these notes together and get any errors I've made corrected, it will help others get a head start on this kind of thing. -- Clifton -- Clifton Royston -- cliftonr@tikitechnologies.com Tiki Technologies Lead Programmer/Software Architect Did you ever fly a kite in bed? Did you ever walk with ten cats on your head? Did you ever milk this kind of cow? Well we can do it. We know how. If you never did, you should. These things are fun, and fun is good. -- Dr. Seuss From owner-freebsd-hackers@FreeBSD.ORG Fri Nov 14 20:42:27 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 4DD0D16A4CE for ; Fri, 14 Nov 2003 20:42:27 -0800 (PST) Received: from smtp1.adl2.internode.on.net (smtp1.adl2.internode.on.net [203.16.214.181]) by mx1.FreeBSD.org (Postfix) with ESMTP id 9B88943FA3 for ; Fri, 14 Nov 2003 20:42:25 -0800 (PST) (envelope-from doconnor@gsoft.com.au) Received: from midget.dons.net.au (ppp110-132.lns1.adl1.internode.on.net [150.101.110.132])hAF4gNTn096973; Sat, 15 Nov 2003 15:12:23 +1030 (CST) Received: from localhost (root@localhost.dons.net.au [127.0.0.1]) by midget.dons.net.au (8.12.9/8.12.9) with ESMTP id hAF4gLlT032178; Sat, 15 Nov 2003 15:12:21 +1030 (CST) (envelope-from doconnor@gsoft.com.au) From: "Daniel O'Connor" To: Clifton Royston , hackers@freebsd.org Date: Sat, 15 Nov 2003 15:12:19 +1030 User-Agent: KMail/1.5.3 References: <20031114113705.D5759@tikitechnologies.com> In-Reply-To: <20031114113705.D5759@tikitechnologies.com> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200311151512.20032.doconnor@gsoft.com.au> X-Spam-Score: -5 () IN_REP_TO,QUOTED_EMAIL_TEXT,REFERENCES,SIGNATURE_SHORT_DENSE,SPAM_PHRASE_00_01,USER_AGENT,USER_AGENT_KMAIL X-Scanned-By: MIMEDefang 2.26 (www . roaringpenguin . com / mimedefang) Subject: Re: Observations on make release process? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 15 Nov 2003 04:42:27 -0000 X-List-Received-Date: Sat, 15 Nov 2003 04:42:27 -0000 On Saturday 15 November 2003 08:07, Clifton Royston wrote: > I have some observations fairly fresh in my mind from trying to build > a version of FreeBSD 4.8.12 with the IBM Propolice anti-stack-smash > patch. This was intended as a quick prelude to trying to build our own > internal release with a reduced set of base binaries, different > packages available on CD for install, etc. However, I certainly ran > into more pitfalls than I expected along the way, and a lot less detail > and more handwaving than I expected in the docs I could find. I have a procedure for make release -> http://www.gsoft.com.au/~doconnor/FreeBSD-release-2.html but the way I do it is not 'normal' - I don't use the CVS repo because I can't commit into that tree (and local CVS hacks make my head hurt) so I check out and modify the source in /usr/src, build it and test then after I'm happy with it I make release with a patch to copy the source instead of checking it out. -- Daniel O'Connor software and network engineer for Genesis Software - http://www.gsoft.com.au "The nice thing about standards is that there are so many of them to choose from." -- Andrew Tanenbaum GPG Fingerprint - 9A8C 569F 685A D928 5140 AE4B 319B 41F4 5D17 FDD5 From owner-freebsd-hackers@FreeBSD.ORG Fri Nov 14 20:42:27 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id DA9D816A4CE for ; Fri, 14 Nov 2003 20:42:27 -0800 (PST) Received: from smtp01.syd.iprimus.net.au (smtp01.syd.iprimus.net.au [210.50.30.52]) by mx1.FreeBSD.org (Postfix) with ESMTP id 45D9243FB1 for ; Fri, 14 Nov 2003 20:42:27 -0800 (PST) (envelope-from tim@robbins.dropbear.id.au) Received: from robbins.dropbear.id.au (210.50.41.228) by smtp01.syd.iprimus.net.au (7.0.020) id 3F8B009E00CA3948 for freebsd-hackers@freebsd.org; Sat, 15 Nov 2003 15:42:25 +1100 Received: by robbins.dropbear.id.au (Postfix, from userid 1000) id 08029611E; Sat, 15 Nov 2003 15:42:52 +1100 (EST) Date: Sat, 15 Nov 2003 15:42:52 +1100 From: Tim Robbins To: freebsd-hackers@freebsd.org Message-ID: <20031115044252.GA17062@wombat.robbins.dropbear.id.au> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.4.1i Subject: Revised sort utility X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 15 Nov 2003 04:42:28 -0000 I announced my BSD-licensed reimplementation of sort(1) on this list a few months ago. Since then I've fixed many bugs found by my own testing and the GNU textutils test suite, and vastly improved performance for many common cases (e.g. the "fast path" is now qsort() -> memcmp()). The new version is available at http://people.freebsd.org/~tjr/sort2.tar.gz . Comments/patches are welcome. Tim From owner-freebsd-hackers@FreeBSD.ORG Fri Nov 14 21:45:21 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 232A816A4CE for ; Fri, 14 Nov 2003 21:45:21 -0800 (PST) Received: from harmony.village.org (rover.bsdimp.com [204.144.255.66]) by mx1.FreeBSD.org (Postfix) with ESMTP id 46EA543FBD for ; Fri, 14 Nov 2003 21:45:20 -0800 (PST) (envelope-from imp@bsdimp.com) Received: from localhost (warner@rover2.village.org [10.0.0.1]) by harmony.village.org (8.12.9p2/8.12.9) with ESMTP id hAF5jJeG004415 for ; Fri, 14 Nov 2003 22:45:19 -0700 (MST) (envelope-from imp@bsdimp.com) Date: Fri, 14 Nov 2003 22:45:14 -0700 (MST) Message-Id: <20031114.224514.74751078.imp@bsdimp.com> To: hackers@freebsd.org From: "M. Warner Losh" X-Mailer: Mew version 2.1 on Emacs 21.3 / Mule 5.0 (SAKAKI) Mime-Version: 1.0 Content-Type: Text/Plain; charset=us-ascii Content-Transfer-Encoding: 7bit Subject: New complaints X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 15 Nov 2003 05:45:21 -0000 checking stopevent 2 with the following non-sleepable locks held: exclusive sleep mutex sigacts r = 0 (0xc48c5aa8) locked @ kern/subr_trap.c:260 checking stopevent 2 with the following non-sleepable locks held: exclusive sleep mutex sigacts r = 0 (0xc48c5aa8) locked @ kern/subr_trap.c:260 Lots and lots of these (thousands) when I login. pwd causes this. This is as of 0230 UTC Nov 15, 2003. Yesterday's kernel (2300 UTC Nov 13, 2003), on a different machine, doesn't seem to have this problem. Is anybody else seeing this? Warner From owner-freebsd-hackers@FreeBSD.ORG Fri Nov 14 22:03:08 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 998C416A4CE for ; Fri, 14 Nov 2003 22:03:08 -0800 (PST) Received: from gw.catspoiler.org (217-ip-163.nccn.net [209.79.217.163]) by mx1.FreeBSD.org (Postfix) with ESMTP id B10C843FBD for ; Fri, 14 Nov 2003 22:03:07 -0800 (PST) (envelope-from truckman@FreeBSD.org) Received: from FreeBSD.org (mousie.catspoiler.org [192.168.101.2]) by gw.catspoiler.org (8.12.9p2/8.12.9) with ESMTP id hAF62qeF079519; Fri, 14 Nov 2003 22:02:56 -0800 (PST) (envelope-from truckman@FreeBSD.org) Message-Id: <200311150602.hAF62qeF079519@gw.catspoiler.org> Date: Fri, 14 Nov 2003 22:02:51 -0800 (PST) From: Don Lewis To: imp@bsdimp.com In-Reply-To: <20031114.224514.74751078.imp@bsdimp.com> MIME-Version: 1.0 Content-Type: TEXT/plain; charset=us-ascii cc: hackers@FreeBSD.org Subject: Re: New complaints X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 15 Nov 2003 06:03:08 -0000 On 14 Nov, M. Warner Losh wrote: > checking stopevent 2 with the following non-sleepable locks held: > exclusive sleep mutex sigacts r = 0 (0xc48c5aa8) locked @ kern/subr_trap.c:260 > checking stopevent 2 with the following non-sleepable locks held: > exclusive sleep mutex sigacts r = 0 (0xc48c5aa8) locked @ kern/subr_trap.c:260 > > Lots and lots of these (thousands) when I login. pwd causes this. > This is as of 0230 UTC Nov 15, 2003. Yesterday's kernel (2300 UTC Nov > 13, 2003), on a different machine, doesn't seem to have this problem. > > Is anybody else seeing this? There have been an number of reports of this earlier today. I just upgraded and got bit by it as, too. The culprit is sys/sys/proc.h 1.359. From owner-freebsd-hackers@FreeBSD.ORG Fri Nov 14 22:10:37 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 8CC9E16A4CE; Fri, 14 Nov 2003 22:10:37 -0800 (PST) Received: from harmony.village.org (rover.bsdimp.com [204.144.255.66]) by mx1.FreeBSD.org (Postfix) with ESMTP id 9350F43FAF; Fri, 14 Nov 2003 22:10:36 -0800 (PST) (envelope-from imp@bsdimp.com) Received: from localhost (warner@rover2.village.org [10.0.0.1]) by harmony.village.org (8.12.9p2/8.12.9) with ESMTP id hAF6AZeG004780; Fri, 14 Nov 2003 23:10:35 -0700 (MST) (envelope-from imp@bsdimp.com) Date: Fri, 14 Nov 2003 23:10:27 -0700 (MST) Message-Id: <20031114.231027.28787101.imp@bsdimp.com> To: truckman@FreeBSD.org From: "M. Warner Losh" In-Reply-To: <200311150602.hAF62qeF079519@gw.catspoiler.org> References: <20031114.224514.74751078.imp@bsdimp.com> <200311150602.hAF62qeF079519@gw.catspoiler.org> X-Mailer: Mew version 2.1 on Emacs 21.3 / Mule 5.0 (SAKAKI) Mime-Version: 1.0 Content-Type: Text/Plain; charset=us-ascii Content-Transfer-Encoding: 7bit cc: hackers@FreeBSD.org Subject: Re: New complaints X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 15 Nov 2003 06:10:37 -0000 In message: <200311150602.hAF62qeF079519@gw.catspoiler.org> Don Lewis writes: : There have been an number of reports of this earlier today. I just : upgraded and got bit by it as, too. The culprit is sys/sys/proc.h : 1.359. People on irc have since told me this is a known issue and is being worked on. bde's changes to proc.h doen't fix it either... :-) The change does look deliberate, even if the results are verbose. Warner From owner-freebsd-hackers@FreeBSD.ORG Sat Nov 15 14:32:06 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 078D316A4CE for ; Sat, 15 Nov 2003 14:32:06 -0800 (PST) Received: from stork.mail.pas.earthlink.net (stork.mail.pas.earthlink.net [207.217.120.188]) by mx1.FreeBSD.org (Postfix) with ESMTP id E823243FDD for ; Sat, 15 Nov 2003 14:32:04 -0800 (PST) (envelope-from tlambert2@mindspring.com) Received: from user-2ivfj2j.dialup.mindspring.com ([165.247.204.83] helo=mindspring.com) by stork.mail.pas.earthlink.net with asmtp (SSLv3:RC4-MD5:128) (Exim 3.33 #1) id 1AL8wc-0003D7-00; Sat, 15 Nov 2003 14:31:07 -0800 Message-ID: <3FB6A907.1CC86D3E@mindspring.com> Date: Sat, 15 Nov 2003 14:30:31 -0800 From: Terry Lambert X-Mailer: Mozilla 4.79 [en] (Win98; U) X-Accept-Language: en MIME-Version: 1.0 To: jos@catnook.com References: <3F9CF3F6.8307.ABC1250@localhost> <20031111071944.GA5778@lizzy.catnook.com> <3FB360BE.779DB42F@mindspring.com> <20031113165647.GA80504@lizzy.catnook.com> <3FB4A449.7452A382@mindspring.com> <20031114174607.GA42257@lizzy.catnook.com> Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-ELNK-Trace: b1a02af9316fbb217a47c185c03b154d40683398e744b8a4e92a567895908f402052d7278feef8242601a10902912494350badd9bab72f9c350badd9bab72f9c cc: freebsd-hackers@freebsd.org Subject: Re: non-root process and PID files X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 15 Nov 2003 22:32:06 -0000 Jos Backus wrote: > On Fri, Nov 14, 2003 at 01:45:45AM -0800, Terry Lambert wrote: > > OK. We already have one of those. We call it "init". 8-). > > Feature-wise init and svscan/supervise don't quite match; svscan has more > features, one of which being that it doesn't use a single control file which > if you screw it can render your system unusable. Even SysV init has more > (useful) features than ours. Also, init is kinda hard to use by non-root users > for that reason. People have been known to successfully replace init with > svscan, btw. The main feature svscan lacks for me is the right license. 8-). Practically, init does what you want: monitors and restarts things that die. This whole discussion, though, is pretty stupid, since the things you are worring about keeping running should be written to not die in the first place, and if they *are* dying, it's generally dumb to restart them thinking that they will magically not die again, since, having ben restarted, they are now among the blessed. 8-) 8-). > This is really off-topic. But sure, there are instances where this approach is > less than robust. So what? Using pidfiles doesn't solve this problem either. Not using PID files won't fix it either. So portraying PID files as being a bad way to solve this problem (which is what people were originally complaining about) is really dumb: PID files work very well for resolving the problem that they were intended to resolve. You just need to create them when you are first started, which is done by "root", unless you are SUID to some other UID, in which case it's done by that ID instead. After that, the same UID has priviledges on the file, and the problem is entirely solved. [ ... ] > Also, software can fail in ways unaccounted > for. But this is really off-topic. It can't fail that way if you account for it failing that way. 8-). But see the above: restarting sshd because it core dumps when you try to login using putty isn't going to magically make attempting to login via putty not core dump it. > > Anyway, FreeBSD has steadfastly disliked the concept of a registry, > > ever since Microsoft implemented it in Windows95; it's on of the > > biggest "NIH" items of all time. > > I think it would help if config files had a common structure and could be > queried for "interesting" service metadata like dependencies. See the Arusha > project for an example. This is totally bogus. Data interfaces are the same things that screw us over with "proc size mismatch" messages every time the proc structure changes. The only reasoanble interface is one that provides procedural accessor/mutator functions to abstract the format of the interned vs. the externed data, so that it then becomes *impossible* to get a "proc size mismatch". FreeBSD currently continues to have the "proc size mismatch" problem because it currently insists on continuing to use data interfaces. FreeBSD continues to use data interfaces in this are because it can not use procedural interfaces to operate against system dumps. FreeBSD can't use procedural interfaces to operate against system dumps because it does not take advantage of the ELF format to add an ELF section to the kernel image to contain the shared library for the procedural interface to use against the kernel (with an internal, but therefore hidden, data interface), so that there is never a discrepancy. > Anyway, we were talking about the use of pidfiles versus using a process > monitor. I'm simply claiming that using a process monitor is far superior. And I'm simply claiming that they solve different problems, and that complaining about not having a solution to the problem that a process monitor solves (to wit: restartting buggy programs that should not be crashing in the first place) is OK, but complaining that PID files don't solve the same problem is incredibly bogus. They solve different problems, and you can't simply replace PID files with process monitors, and continue to solve the problems that PID files solve that process monitors don't solve. -- Terry From owner-freebsd-hackers@FreeBSD.ORG Sat Nov 15 15:58:11 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 3EBD116A4CE for ; Sat, 15 Nov 2003 15:58:11 -0800 (PST) Received: from mail3.dslextreme.com (mail3.dslextreme.com [66.51.199.73]) by mx1.FreeBSD.org (Postfix) with SMTP id C2D2343F85 for ; Sat, 15 Nov 2003 15:58:08 -0800 (PST) (envelope-from jos@catnook.com) Received: (qmail 32518 invoked from network); 15 Nov 2003 23:58:07 -0000 Received: from unknown (HELO w250.z064001178.sjc-ca.dsl.cnc.net) (66.218.45.239) by 192.168.8.73 with SMTP; Sat, 15 Nov 2003 23:58:07 +0000 Received: (qmail 11831 invoked by uid 1000); 15 Nov 2003 23:58:29 -0000 Date: Sat, 15 Nov 2003 15:58:07 -0800 From: Jos Backus To: freebsd-hackers@freebsd.org Message-ID: <20031115235829.GB98569@lizzy.catnook.com> Mail-Followup-To: freebsd-hackers@freebsd.org References: <3F9CF3F6.8307.ABC1250@localhost> <20031111071944.GA5778@lizzy.catnook.com> <3FB360BE.779DB42F@mindspring.com> <20031113165647.GA80504@lizzy.catnook.com> <3FB4A449.7452A382@mindspring.com> <20031114174607.GA42257@lizzy.catnook.com> <3FB6A907.1CC86D3E@mindspring.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <3FB6A907.1CC86D3E@mindspring.com> User-Agent: Mutt/1.5.5.1i Subject: Re: non-root process and PID files X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list Reply-To: jos@catnook.com List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 15 Nov 2003 23:58:11 -0000 On Sat, Nov 15, 2003 at 02:30:31PM -0800, Terry Lambert wrote: > Jos Backus wrote: > > On Fri, Nov 14, 2003 at 01:45:45AM -0800, Terry Lambert wrote: > > > OK. We already have one of those. We call it "init". 8-). > > > > Feature-wise init and svscan/supervise don't quite match; svscan has more > > features, one of which being that it doesn't use a single control file which > > if you screw it can render your system unusable. Even SysV init has more > > (useful) features than ours. Also, init is kinda hard to use by non-root users > > for that reason. People have been known to successfully replace init with > > svscan, btw. > > The main feature svscan lacks for me is the right license. 8-). Heh. Let's not go there. There are similar tools out there with friendly licenses; see /usr/ports/sysutils/mktool for an example. > Practically, init does what you want: monitors and restarts things > that die. I want more :-) I also want a uniform, cross-platform way to control daemons on UNIX. Hell, even Windows has one. > This whole discussion, though, is pretty stupid, since the things > you are worring about keeping running should be written to not die > in the first place, and if they *are* dying, it's generally dumb > to restart them thinking that they will magically not die again, > since, having ben restarted, they are now among the blessed. > > 8-) 8-). That's true, but it's also irrelevant :-) This is not just about automatically restarting daemons when they die. For example, such a mechanism lets me give members of the lmadmin group control over lmgrd, even though it runs as a different user. > > This is really off-topic. But sure, there are instances where this approach is > > less than robust. So what? Using pidfiles doesn't solve this problem either. > > Not using PID files won't fix it either. So portraying PID files > as being a bad way to solve this problem (which is what people were > originally complaining about) is really dumb: PID files work very > well for resolving the problem that they were intended to resolve. > > You just need to create them when you are first started, which is > done by "root", unless you are SUID to some other UID, in which case > it's done by that ID instead. After that, the same UID has priviledges > on the file, and the problem is entirely solved. So you mean adding the complexity/fragility of managing/using pidfiles, even though we can just use the natural parent/child relationship is a good thing? Doesn't make sense to me but I must be really dumb :-) Let's drop the argument and agree to disagree (I didn't really expect many people to agree with me anyways). After all, _I_'m not the one having the pidfile problem. > > Also, software can fail in ways unaccounted > > for. But this is really off-topic. > > It can't fail that way if you account for it failing that way. 8-). > > But see the above: restarting sshd because it core dumps when you > try to login using putty isn't going to magically make attempting > to login via putty not core dump it. It depends. Maybe it only cores under certain circumstances. > > > Anyway, FreeBSD has steadfastly disliked the concept of a registry, > > > ever since Microsoft implemented it in Windows95; it's on of the > > > biggest "NIH" items of all time. > > > > I think it would help if config files had a common structure and could be > > queried for "interesting" service metadata like dependencies. See the Arusha > > project for an example. > > This is totally bogus. Data interfaces are the same things that > screw us over with "proc size mismatch" messages every time the > proc structure changes. The only reasoanble interface is one > that provides procedural accessor/mutator functions to abstract > the format of the interned vs. the externed data, so that it then > becomes *impossible* to get a "proc size mismatch". Again, I disagree. This interface is just poorly designed. I guess you don't like SOAP, XML/RPC, etc. either. But it's really off-topic so this is all I'm going to say about this. We can always discuss this over lunch sometime :-) > FreeBSD currently continues to have the "proc size mismatch" problem > because it currently insists on continuing to use data interfaces. > > FreeBSD continues to use data interfaces in this are because it can > not use procedural interfaces to operate against system dumps. > > FreeBSD can't use procedural interfaces to operate against system > dumps because it does not take advantage of the ELF format to add > an ELF section to the kernel image to contain the shared library > for the procedural interface to use against the kernel (with an > internal, but therefore hidden, data interface), so that there is > never a discrepancy. > > > > Anyway, we were talking about the use of pidfiles versus using a process > > monitor. I'm simply claiming that using a process monitor is far superior. > > And I'm simply claiming that they solve different problems, and > that complaining about not having a solution to the problem that > a process monitor solves (to wit: restartting buggy programs that > should not be crashing in the first place) is OK, but complaining > that PID files don't solve the same problem is incredibly bogus. You are dragging all kinds of other issues into this discussion. How can a pidfile restart a service, provided you agree that this sometimes useful behavior? Please, rather than trying to bring about world peace, let's agree to disagree because this discussion is not going anywhere (sound familiar?). Apparently you oppose the incremental improvement (imo) that process monitors bring. Fine. > They solve different problems, and you can't simply replace PID > files with process monitors, and continue to solve the problems > that PID files solve that process monitors don't solve. Hm, what problems do pidfiles solve that a process monitor doesn't? -- Jos Backus _/ _/_/_/ Sunnyvale, CA _/ _/ _/ _/ _/_/_/ _/ _/ _/ _/ jos at catnook.com _/_/ _/_/_/ require 'std/disclaimer' From owner-freebsd-hackers@FreeBSD.ORG Sat Nov 15 17:32:05 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id D619416A4CE; Sat, 15 Nov 2003 17:32:05 -0800 (PST) Received: from oneplusone.ch (oneplusone.ch [212.55.208.170]) by mx1.FreeBSD.org (Postfix) with ESMTP id 08F6D43F75; Sat, 15 Nov 2003 17:32:04 -0800 (PST) (envelope-from ast@marabu.ch) Received: from oneplusone.ch (localhost [127.0.0.1]) by oneplusone.ch (8.12.9p1/8.12.9) with ESMTP id hAG1W2i3032588; Sun, 16 Nov 2003 02:32:02 +0100 (MET) (envelope-from ast@marabu.ch) Received: (from uucp@localhost) by oneplusone.ch (8.12.9p1/8.12.9/Submit) with UUCP id hAG1W2X0032587; Sun, 16 Nov 2003 02:32:02 +0100 (MET) (envelope-from ast@marabu.ch) Received: from marabu.marabu.ch (marabu.marabu.ch [192.168.21.3]) by nano.marabu.ch (8.12.9/8.12.9) with ESMTP id hAG1VZuv057093; Sun, 16 Nov 2003 02:31:35 +0100 (MET) (envelope-from ast@marabu.marabu.ch) Received: by marabu.marabu.ch (8.7.5/20001028-ast-8.3) id CAA21864; Sun, 16 Nov 2003 02:31:33 +0100 (CET) Message-Id: <200311160131.CAA21864@marabu.marabu.ch> MIME-Version: 1.0 (NeXT Mail 3.3 v124.8483.6) Content-Type: text/plain In-Reply-To: <3FB281B4.5060105@soekris.com> X-Nextstep-Mailer: Mail 3.3 (Enhance 2.0b6) Received: by NeXT.Mailer (1.124.8483.6) From: Adrian Steinmann Date: Sun, 16 Nov 2003 02:31:31 +0100 To: Soren Kristensen References: <32365.1068624044@critter.freebsd.dk> <3FB281B4.5060105@soekris.com> X-Organization: Webgroup Consulting AG, Apollostrasse 21, 8032 Zurich X-Phone-Numbers: Switzerland, Tel +41 1 380 30 83 Fax +41 1 380 30 85 cc: Poul-Henning Kamp cc: hackers@freebsd.org cc: msmith@freebsd.org Subject: BTX loader reboot on Soekris comBIOS1.22 fails (patches for btx.s and loader/main.c enclosed) X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 16 Nov 2003 01:32:06 -0000 After "reboot" in the FreeBSD-stable BTX loader just hangs on Soekris comBIOS 1.22 Soren asked me: ... how does the loader do the actual reboot ? And does it differ from how FreeBSD otherwise reboots ? I have investigated this now: from FreeeBSD, /sbin/reboot first tries a 8042 keyboard reset, i.e. it writes 0xFE to 0x064. On FreeBSD-stable this is near line 441 in /usr/src/sys/i386/i386/vm_machdep.c (unless a kernel config BROKEN_KEYBOARD_RESET is defined): #if !defined(BROKEN_KEYBOARD_RESET) outb(IO_KBD + 4, 0xFE); DELAY(500000); /* wait 0.5 sec to see if that did it */ printf("Keyboard reset did not work, attempting CPU shutdown\n"); DELAY(1000000); /* wait 1 sec for printf to complete */ #endif this works on Soekris comBIOS 1.22. If the above fails, vm_machdep.ch falls back to unmapping the address space and invalidating TLD: /* force a shutdown by unmapping entire address space ! */ bzero((caddr_t) PTD, PAGE_SIZE); /* "good night, sweet prince .... " */ invltlb(); but since the keyboard reset works work, this case is never used (on Soekris) on /sbin/reboot. In the BTX loader, the reboot command simply exits the loader, and end up in exit near line 252 in /usr/src/sys/boot/i386/btx/btx/btx.s which disables paging, flushes TLB, switches to real mode, flags a warm boot (writes 0x1234 to 0x472) and then jumps to the BIOS reboot handler: - ljmp $0xffff,$0x0 # reboot the machine however in various literature it is mentioned that $0xf000,$0xfff0 is bound to work better on most platforms, so I tried + ljmp $0xf000,$0xfff0 # reboot the machine which indeed works! (OpenBSD, for example, uses ljmp $0xf000,$0xfff0). I prefer the KEYBOARD_RESET method because it follows the /sbin/reboot style, but I think FreeBSD should consider using ljmp $0xf000,$0xfff0 instead of ljmp $0xffff,$0x0 in btx.s for better compatibility. For this reason I'm copying msmith@ and jhb@ and hackers@ I hope you can confirm that Soekris comBIOS 1.22 acts strangly when ljmp $0xffff,$0x0 is used. The choice $0xffff,$0x0 was made Feb 2000 by jhb and msmith and was committed to version btx.s 1.15 with these comments: 1) Fix a bug in the int15 function 87 emulation where we only copied half of what the BIOS asked for. This caused the Mylex RAID adapter to go haywire and start trashing memory when you tried to boot from it. 2) Don't use interrupt 19 to reboot. Instead, set the reboot flag to a warm boot and jump to the BIOS's reboot handler. int 19 doesn't clear memory or restore the interrupt vector table, and thus really isn't safe. For example, when booting off of PXE, the PXE BIOS eats up a chunk of memory for its internal data and structures. Since we rebooted via int 19, using the 'reboot' command in the loader resulted in that memory not being reclaimed by the BIOS. Thus, after a few PXE boots, the system was out of lower memory. 3) Catch any int 19 calls made by a BTX client or a user pressing Ctrl-Alt-Delete and shutdown BTX and reboot the machine cleanly. This fixes Ctrl-Alt-Delete in the loader and in boot2 instead of presenting the user with a BTX fault. These are the patches I have been using successfuly (only one is necessary): Index: usr/src/sys/boot/i386/btx/btx/btx.s =================================================================== RCS file: /usr/cvs/src/sys/boot/i386/btx/btx/btx.s,v retrieving revision 1.15.2.4 diff -u -r1.15.2.4 btx.s --- usr/src/sys/boot/i386/btx/btx/btx.s 28 Dec 2000 12:08:22 -0000 1.15.2.4 +++ usr/src/sys/boot/i386/btx/btx/btx.s 16 Nov 2003 00:26:28 -0000 @@ -293,7 +293,7 @@ testb $0x1,btx_hdr+0x7 # Reboot? exit.3: jz exit.3 # No movw $0x1234, BDA_BOOT # Do a warm boot - ljmp $0xffff,$0x0 # reboot the machine + ljmp $0xf000,$0xfff0 # reboot the machine # # Set IRQ offsets by reprogramming 8259A PICs. # Index: usr/src/sys/boot/i386/loader/main.c =================================================================== RCS file: /usr/cvs/src/sys/boot/i386/loader/main.c,v retrieving revision 1.17.2.7 diff -u -r1.17.2.7 main.c --- usr/src/sys/boot/i386/loader/main.c 10 Oct 2002 15:53:27 -0000 1.17.2.7 +++ usr/src/sys/boot/i386/loader/main.c 16 Nov 2003 00:26:28 -0000 @@ -35,6 +35,7 @@ #include #include #include +#include #include "bootstrap.h" #include "libi386/libi386.h" @@ -238,6 +239,13 @@ (devsw[i]->dv_cleanup)(); printf("Rebooting...\n"); + +#if !defined(BROKEN_KEYBOARD_RESET) + isa_outb(IO_KBD + 4, 0xFE); + delay(1000000); + printf("Keyboard reset failed; exiting...\n"); +#endif + delay(1000000); __exit(0); } From owner-freebsd-hackers@FreeBSD.ORG Sat Nov 15 19:11:25 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 6A17916A4CE; Sat, 15 Nov 2003 19:11:25 -0800 (PST) Received: from gateway.soekris.com (adsl-68-122-44-73.dsl.pltn13.pacbell.net [68.122.44.73]) by mx1.FreeBSD.org (Postfix) with ESMTP id 3566243F75; Sat, 15 Nov 2003 19:11:24 -0800 (PST) (envelope-from soren@soekris.com) Received: from soekris.com (1.4.soekris.com [192.168.1.4] (may be forged)) by gateway.soekris.com (8.11.6/8.11.6) with ESMTP id hAG3ITu00792; Sat, 15 Nov 2003 19:18:30 -0800 (PST) (envelope-from soren@soekris.com) Message-ID: <3FB6EB4D.8050901@soekris.com> Date: Sat, 15 Nov 2003 19:13:17 -0800 From: Soren Kristensen Organization: Soekris Engineering User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.4) Gecko/20030624 Netscape/7.1 (ax) X-Accept-Language: en-us, en, da MIME-Version: 1.0 To: Adrian Steinmann References: <32365.1068624044@critter.freebsd.dk> <3FB281B4.5060105@soekris.com> <200311160131.CAA21864@marabu.marabu.ch> In-Reply-To: <200311160131.CAA21864@marabu.marabu.ch> Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit cc: Poul-Henning Kamp cc: hackers@freebsd.org cc: msmith@freebsd.org Subject: Re: BTX loader reboot on Soekris comBIOS1.22 fails (patches forbtx.s and loader/main.c enclosed) X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 16 Nov 2003 03:11:25 -0000 Hi Adrian, Adrian Steinmann wrote: > > In the BTX loader, the reboot command simply exits the loader, and > end up in exit near line 252 in /usr/src/sys/boot/i386/btx/btx/btx.s > which disables paging, flushes TLB, switches to real mode, flags a > warm boot (writes 0x1234 to 0x472) and then jumps to the BIOS reboot > handler: > - ljmp $0xffff,$0x0 # reboot the machine > > however in various literature it is mentioned that $0xf000,$0xfff0 > is bound to work better on most platforms, so I tried > + ljmp $0xf000,$0xfff0 # reboot the machine > > which indeed works! (OpenBSD, for example, uses ljmp $0xf000,$0xfff0). The reason is that on some hardware (t.ex the Geode) there need to be work done early on in the BIOS to enable access to the BIOS in low memory before that first far jump, and therefore the first jump is not a far jump as on the original PC, but a near jump. Having the segment set at FFFF can screw up that first near jump.... So the ljmp $0xf000,$0xfff0 would be the best way, but since my BIOS patches F000:FFF0 after copying the BIOS from flash to ram, I could also change my near jump to a far jump to increase compatibility.... Regards, Soren From owner-freebsd-hackers@FreeBSD.ORG Sat Nov 15 22:14:38 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id D140B16A4CE for ; Sat, 15 Nov 2003 22:14:38 -0800 (PST) Received: from smtp.omnis.com (smtp.omnis.com [216.239.128.26]) by mx1.FreeBSD.org (Postfix) with ESMTP id 22B4D43FEA for ; Sat, 15 Nov 2003 22:14:38 -0800 (PST) (envelope-from wes@softweyr.com) Received: from softweyr.homeunix.net (66-91-236-204.san.rr.com [66.91.236.204]) by smtp-relay.omnis.com (Postfix) with ESMTP id 6FEC45B687; Sat, 15 Nov 2003 22:14:23 -0800 (PST) From: Wes Peters Organization: Softweyr To: Clifton Royston , Wilko Bulte Date: Sat, 15 Nov 2003 22:14:35 -0800 User-Agent: KMail/1.5.4 References: <20031114113705.D5759@tikitechnologies.com> <20031114214813.GA8188@freebie.xs4all.nl> <20031114125719.E5759@tikitechnologies.com> In-Reply-To: <20031114125719.E5759@tikitechnologies.com> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200311152214.35765.wes@softweyr.com> cc: hackers@freebsd.org Subject: Re: Observations on make release process? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 16 Nov 2003 06:14:38 -0000 On Friday 14 November 2003 02:57 pm, Clifton Royston wrote: > On Fri, Nov 14, 2003 at 10:48:13PM +0100, Wilko Bulte wrote: > > On Fri, Nov 14, 2003 at 11:37:05AM -1000, Clifton Royston wrote: > > > Is this as good a list as any for observations on the FreeBSD > > > "make release" process? I can't see any other list that fits the > > > subject. > > > > Did you dig into http://www.freebsd.org/releng/#docs ? > > Oh yes, that was one of my "bibles" so far, especially > > ld.html> > > along with "man release" and some other notes I've found on the web > like: > > > > Here's one minor inaccuracy (or at any rate inadequacy) I've found in > "man release" and the above pages: Patches or additions to existing documentation, or even just providing text to one of our many dedicated doco contributors, would be greatly appreciated. What can you do for FreeBSD today? ;^) -- Where am I, and what am I doing in this handbasket? Wes Peters wes@softweyr.com