From owner-freebsd-current@FreeBSD.ORG  Tue Jun 15 21:39:36 2004
Return-Path: <owner-freebsd-current@FreeBSD.ORG>
Delivered-To: freebsd-current@freebsd.org
Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125])
	by hub.freebsd.org (Postfix) with ESMTP id 156D616A4CE
	for <freebsd-current@freebsd.org>;
	Tue, 15 Jun 2004 21:39:36 +0000 (GMT)
Received: from bremen.shuttle.de (bremen.shuttle.de [194.95.249.251])
	by mx1.FreeBSD.org (Postfix) with ESMTP id 7B03A43D1D
	for <freebsd-current@freebsd.org>;
	Tue, 15 Jun 2004 21:39:35 +0000 (GMT)
	(envelope-from schweikh@schweikhardt.net)
Received: by bremen.shuttle.de (Postfix, from userid 10)
	id C257E3BB77; Tue, 15 Jun 2004 23:39:30 +0200 (CEST)
Received: from hal9000.schweikhardt.net (localhost [127.0.0.1])
	i5FIH59b059871;	Tue, 15 Jun 2004 20:17:05 +0200 (CEST)
	(envelope-from schweikh@hal9000.schweikhardt.net)
Received: (from schweikh@localhost)i5FIH5hd059853;
	Tue, 15 Jun 2004 20:17:05 +0200 (CEST)	(envelope-from schweikh)
Date: Tue, 15 Jun 2004 20:17:05 +0200
From: Jens Schweikhardt <schweikh@schweikhardt.net>
To: Eugene <el2000@km.ru>
Message-ID: <20040615181705.GA42947@schweikhardt.net>
References: <40CEFAA8.00B9A6.08476@e-post02.e-se.ru>
Mime-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <40CEFAA8.00B9A6.08476@e-post02.e-se.ru>
User-Agent: Mutt/1.5.6i
cc: freebsd-current@freebsd.org
Subject: Re: Storing a lot of little files
X-BeenThere: freebsd-current@freebsd.org
X-Mailman-Version: 2.1.1
Precedence: list
List-Id: Discussions about the use of FreeBSD-current
	<freebsd-current.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-current>,
	<mailto:freebsd-current-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-current>
List-Post: <mailto:freebsd-current@freebsd.org>
List-Help: <mailto:freebsd-current-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-current>,
	<mailto:freebsd-current-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Tue, 15 Jun 2004 21:39:36 -0000

I'm just brainstorming here, but...

#   I need to store a lot (hundreds of millions) of very little files (from 8 bytes
#   to 50K) in my filesystem.
#   What's the best way to optimize it?

What about not using a file system at all, but a database that maps
file names to contents? I'm not sure how well dbm(3) scales, or other
similar "simple" databases, but it might prove workable.

Regards,

	Jens
-- 
Jens Schweikhardt http://www.schweikhardt.net/
SIGSIG -- signature too long (core dumped)