Skip site navigation (1)Skip section navigation (2)
Date:      Thu, 02 Jan 2003 12:13:29 -0500
From:      "MikeM" <myraq@mgm51.com>
To:        freebsd-questions@FreeBSD.ORG
Subject:   Re: Lots of files in a directory
Message-ID:  <200301021213290839.0A719772@home.24cl.com>
In-Reply-To: <20030102084356.R18514-100000@atlas.home>
References:  <20030102084356.R18514-100000@atlas.home>

next in thread | previous in thread | raw e-mail | index | archive | help
On 1/2/03 at 8:58 AM Mikko Ty=F6l=E4j=E4rvi wrote:

|On Thu, 2 Jan 2003, MikeM wrote:
|
|> On 1/2/03 at 3:13 PM Roman Neuhauser wrote:
|>
|> |# MyRaQ@mgm51.com / 2003-01-02 09:01:27 -0500:
|> |> I'm considering setting up my server as a mirror site for the
|> |> freedb.org lookup database.  Unfortunately, I've seem to have 
|> |> run into a stumbling block.  The server app requires over 
|> |> 250,000 files in a single directory. Each file is about 2k 
|> |> in size.
|
|It can be argued that the application is poorly designed...

There's no arguing.  It *is* poorly designed.   I would have used a hash to
spread the files across multiple directories.   Unfortunately, I didn't
design it.


|
|> I already have UFS_DIRHASH specified in my kernel config file.  :-(
|
|Maybe you can tweak some sysctls:
|
|  atlas% sysctl -a | grep dirhash
|  vfs.ufs.dirhash_minsize: 2560
|  vfs.ufs.dirhash_maxmem: 2097152
|  vfs.ufs.dirhash_mem: 795239
|  vfs.ufs.dirhash_docheck: 0
|
|Try playing with with "vfs.ufs.dirhash_maxmem".  I suppose it has to
|be at least as large as the size of the Directory From Hell.

Thanks, I'll give them a try.



|...
|It would probably be better to patch the dang server to use a
|multi-level directory structure instead.


That thought has crossed my mind.

Many thanks for the assist.


To Unsubscribe: send mail to majordomo@FreeBSD.org
with "unsubscribe freebsd-questions" in the body of the message




Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?200301021213290839.0A719772>