Date: Mon, 4 Feb 2008 18:08:18 -0800 From: Doug Hardie <bc979@lafn.org> To: Olivier Nicole <on@cs.ait.ac.th> Cc: freebsd-questions@freebsd.org Subject: Re: Problem with makemap and hash tables Message-ID: <1E7F8770-4E0A-4B6A-842F-9B6D6321E5D7@lafn.org> In-Reply-To: <200802050127.m151Ro3r087662@banyan.cs.ait.ac.th> References: <200802050127.m151Ro3r087662@banyan.cs.ait.ac.th>
next in thread | previous in thread | raw e-mail | index | archive | help
On Feb 4, 2008, at 17:27, Olivier Nicole wrote: > Hi, > > I am having problem with /usr/sbin/makemap hash on huge databases > under FreeBSD 5.5 and 6.3 while it is working on 4.11. > > By huge I mean around 380,000 lines in the /etc/mail/access file. > > After approximately 375,000 lines added into access.db I get: > > makemap: access.db: line 375135: key abcd.efgh: put error: > Operation not permitted > > and no more line will add. > > I know that having 380,000 REJECT rules in access.db may not be the > best choice, but it is easy and it was working si far (still works > under 4.11). > > Did anything changed in makemap since 4.11? Any limit in the size of > the DB? > > It seems that my message yesterday was zapped by SpamAssassin (because > I included names of infamous spamers as part of my examplke), so I > rewrote it. I am just under 300K lines in that map at present. While I have always wondered where hash was going to break, I hadn't found the limit yet. However, the time to build the hash table is extremely large with that many entries. I ran some tests a couple months ago using btree for the map type (subject was 'Map size'). I didn't test over 300K entries, but it sure built the maps a whole lot faster. You might try that and see if it builds or not.
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?1E7F8770-4E0A-4B6A-842F-9B6D6321E5D7>