From owner-freebsd-questions Fri Jan 3 6: 9:50 2003 Delivered-To: freebsd-questions@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 24E5737B401 for ; Fri, 3 Jan 2003 06:09:49 -0800 (PST) Received: from mailsrv.otenet.gr (mailsrv.otenet.gr [195.170.0.5]) by mx1.FreeBSD.org (Postfix) with ESMTP id 110A543EE5 for ; Fri, 3 Jan 2003 06:09:46 -0800 (PST) (envelope-from keramida@ceid.upatras.gr) Received: from gothmog.gr (patr530-a084.otenet.gr [212.205.215.84]) by mailsrv.otenet.gr (8.12.6/8.12.6) with ESMTP id h03E9a4V026430; Fri, 3 Jan 2003 16:09:37 +0200 (EET) Received: from gothmog.gr (gothmog [127.0.0.1]) by gothmog.gr (8.12.6/8.12.6) with ESMTP id h03E9a8U004587; Fri, 3 Jan 2003 16:09:36 +0200 (EET) (envelope-from keramida@ceid.upatras.gr) Received: (from giorgos@localhost) by gothmog.gr (8.12.6/8.12.6/Submit) id h034jc54003366; Fri, 3 Jan 2003 06:45:38 +0200 (EET) (envelope-from keramida@ceid.upatras.gr) Date: Fri, 3 Jan 2003 06:45:38 +0200 From: Giorgos Keramidas To: MikeM Cc: freebsd-questions@FreeBSD.ORG Subject: Re: Lots of files in a directory Message-ID: <20030103044538.GB3132@gothmog.gr> References: <20030102084356.R18514-100000@atlas.home> <200301021213290839.0A719772@home.24cl.com> <200301020901270548.09C1C68B@sentry.24cl.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <200301021213290839.0A719772@home.24cl.com> <200301020901270548.09C1C68B@sentry.24cl.com> Sender: owner-freebsd-questions@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.ORG On 2003-01-02 09:01, MikeM wrote: > I'm considering setting up my server as a mirror site for the freedb.org > lookup database. Unfortunately, I've seem to have run into a stumbling > block. The server app requires over 250,000 files in a single directory. > Each file is about 2k in size. On 2003-01-02 12:13, MikeM wrote: > On 1/2/03 at 8:58 AM Mikko Ty?l?j?rvi wrote: > > It can be argued that the application is poorly designed... > > There's no arguing. It *is* poorly designed. I would have used a > hash to spread the files across multiple directories. > Unfortunately, I didn't design it. You are probably hitting the limit of fragments that are allowed on a filesystem and "time optimization" becomes "space optimization". Are you getting entries in your system logs like the following? optimization changed from TIME to SPACE - Giorgos To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-questions" in the body of the message