From owner-freebsd-fs@FreeBSD.ORG Wed Jan 21 10:49:15 2004 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 2CD1516A4CE for ; Wed, 21 Jan 2004 10:49:15 -0800 (PST) Received: from mail2.dbitech.ca (radius.wavefire.com [64.141.13.252]) by mx1.FreeBSD.org (Postfix) with SMTP id B6E4343D41 for ; Wed, 21 Jan 2004 10:49:09 -0800 (PST) (envelope-from darcy@wavefire.com) Received: (qmail 23028 invoked from network); 21 Jan 2004 19:31:30 -0000 Received: from dbitech.wavefire.com (HELO 64.141.15.253) (darcy@64.141.15.253) by radius.wavefire.com with SMTP; 21 Jan 2004 19:31:30 -0000 From: Darcy Buskermolen Organization: Wavefire Technologies Corp. To: Robert Watson Date: Wed, 21 Jan 2004 10:49:10 -0800 User-Agent: KMail/1.5.4 References: In-Reply-To: MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200401211049.10168.darcy@wavefire.com> cc: Greg 'groggy' Lehey cc: freebsd-fs@freebsd.org Subject: Re: 32k directory limit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Jan 2004 18:49:15 -0000 On January 21, 2004 10:34 am, Robert Watson wrote: > On Wed, 21 Jan 2004, Darcy Buskermolen wrote: > > Problem is some brain dead software (to which I don't have source) > > creating these dirs all under one dir and not nesting them in a way to > > ensure that the 32k number isn't broken. > > The largest number of files (not directories) I have in a single directory > appears to be about 1.1 million. Other than the link count, there's no > real reason there couldn't be more, although you might well bump into > other scalability limits (I have to remember not to let ls sort the > directory listing for that directory, for example). Changing the link > count would be a binary layout change, however. We have more reserve > fields in the UFS2 inode, and it might well not be hard to experiment > with. But we'd need to be very careful if deploying that change more > broadly. I wouldn't be against trying/testing such a solution/hack in my environment any hints/patches would be most usefull. > > Robert N M Watson FreeBSD Core Team, TrustedBSD Projects > robert@fledge.watson.org Senior Research Scientist, McAfee Research > > > On January 20, 2004 06:28 pm, Greg 'groggy' Lehey wrote: > > > On Friday, 16 January 2004 at 12:05:53 -0800, Darcy Buskermolen wrote: > > > > Is there a way i can bump up the limit of 32k directories in a > > > > directory on either 4.9 or 5.2 ? > > > > > > I don't think so. It's really the link count that's biting you, and > > > it's a signed 16 bit number. FWIW, System V limits to 1000. > > > > > > Why do you want that many directories? UNIX directories aren't > > > designed to be that big, whether the entries point to files or > > > directories. > > > > > > Greg > > > -- > > > See complete headers for address and phone numbers. > > > > -- > > Darcy Buskermolen > > Wavefire Technologies Corp. > > ph: 250.717.0200 > > fx: 250.763.1759 > > http://www.wavefire.com > > > > _______________________________________________ > > freebsd-fs@freebsd.org mailing list > > http://lists.freebsd.org/mailman/listinfo/freebsd-fs > > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" > > _______________________________________________ > freebsd-fs@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" -- Darcy Buskermolen Wavefire Technologies Corp. ph: 250.717.0200 fx: 250.763.1759 http://www.wavefire.com