From owner-freebsd-questions Wed Jan 15 13:22:12 2003 Delivered-To: freebsd-questions@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 5CCAD37B405 for ; Wed, 15 Jan 2003 13:22:08 -0800 (PST) Received: from rwcrmhc51.attbi.com (rwcrmhc51.attbi.com [204.127.198.38]) by mx1.FreeBSD.org (Postfix) with ESMTP id B0B5A43EB2 for ; Wed, 15 Jan 2003 13:22:07 -0800 (PST) (envelope-from freebsd-questions-local@be-well.no-ip.com) Received: from be-well.ilk.org (lowellg.ne.client2.attbi.com[24.147.188.198]) by rwcrmhc51.attbi.com (rwcrmhc51) with ESMTP id <2003011521220705100pm578e>; Wed, 15 Jan 2003 21:22:07 +0000 Received: from be-well.ilk.org (lowellg.ne.client2.attbi.com [24.147.188.198] (may be forged)) by be-well.ilk.org (8.12.6/8.12.6) with ESMTP id h0FLM68O025362; Wed, 15 Jan 2003 16:22:06 -0500 (EST) (envelope-from freebsd-questions-local@be-well.no-ip.com) Received: (from lowell@localhost) by be-well.ilk.org (8.12.6/8.12.6/Submit) id h0FLM5Mp025359; Wed, 15 Jan 2003 16:22:05 -0500 (EST) X-Authentication-Warning: be-well.ilk.org: lowell set sender to freebsd-questions-local@be-well.ilk.org using -f To: Tom Parquette Cc: freebsd-questions@FreeBSD.ORG Subject: Re: port/ftp/mirror-2.9 "Out of memory!" message--some progress References: <3E1D0198.9040104@twcny.rr.com> <44wule9gfy.fsf@be-well.ilk.org> <3E24D198.6070409@twcny.rr.com> From: Lowell Gilbert Date: 15 Jan 2003 16:22:05 -0500 In-Reply-To: <3E24D198.6070409@twcny.rr.com> Message-ID: <448yxmhzwi.fsf@be-well.ilk.org> Lines: 44 User-Agent: Gnus/5.09 (Gnus v5.9.0) Emacs/21.2 MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Sender: owner-freebsd-questions@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.ORG Tom Parquette writes: > Lowell Gilbert wrote: > > Tom Parquette writes: > > > >>I'm getting an "Out of memory!" message from the mirror > >>(/usr/ports/ftp/mirror-2.9) port trying to update a large archive. > >>I've tried a number of things but I can't resolve this. > >>Any suggestions? > > hitting a limits(1) limit? > > > Lowell, > I've been playing with this on and off for a few days. > Your question, I think, put me onto something. > I've been rerunning the mirror command with top running. > mirror fails with the memory size around 520m consistantly. > Limits gives me a datasize limit of 524288kb. (Close enough for me!) > I've come to the conclusion that the man page would benefit from some > examples. I've been trying to raise the datasize limit but it does > not seem to take. > > Example: limits -B -d 4g mirror.sh... still blows up with memory > values, from top, around 520m (give or take a little.) > > You've gotten me looking in the right area. All I have to do now is > get the override to work. Can anybody provide any insights on how to > actually do this? You need to change the maximum limit; this is best done by modifying login.conf(5) (and rebuilding the database). One of the uses of these limits is as a security issue, so the user can't raise the limits above the given maximum level themselves. At .5GB, though, you may be hitting a kernel limit; I know that MAXDSIZ defaults to something like 128MB. Getting to 4GB on a 32-bit machine is probably not practical anyway. I'd recommend using something more efficient than mirror, or at least figuring a way to break the replication up into smaller pieces. A half-gigabyte is a ludicrous amount of memory space to be using for any such task. [I kind of suspect a memory leak in the application, based on those numbers.] Good luck. To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-questions" in the body of the message