From owner-freebsd-questions@FreeBSD.ORG Wed Feb 6 02:10:55 2008 Return-Path: Delivered-To: freebsd-questions@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 41C3A16A417 for ; Wed, 6 Feb 2008 02:10:55 +0000 (UTC) (envelope-from lachlan@lkla.org) Received: from paul.kawaguchichurch.org (pd5e374.sitmff01.ap.so-net.ne.jp [202.213.227.116]) by mx1.freebsd.org (Postfix) with ESMTP id E91BD13C44B for ; Wed, 6 Feb 2008 02:10:54 +0000 (UTC) (envelope-from lachlan@lkla.org) Received: from sm.lkla.org (localhost [127.0.0.1]) by paul.kawaguchichurch.org (8.14.2/8.14.2) with ESMTP id m162ArvO022310; Wed, 6 Feb 2008 11:10:53 +0900 (JST) (envelope-from lachlan@lkla.org) Received: from 137.153.0.34 (SquirrelMail authenticated user lachlan) by sm.lkla.org with HTTP; Wed, 6 Feb 2008 11:10:53 +0900 (JST) Message-ID: <6669.137.153.0.34.1202263853.squirrel@sm.lkla.org> In-Reply-To: <94136a2c0802050423k2b8ebb9es58c7619e8e9de3ef@mail.gmail.com> References: <1153.137.153.0.37.1202210274.squirrel@sm.lkla.org> <94136a2c0802050423k2b8ebb9es58c7619e8e9de3ef@mail.gmail.com> Date: Wed, 6 Feb 2008 11:10:53 +0900 (JST) From: "Lachlan Michael" To: "Zbigniew Szalbot" User-Agent: SquirrelMail/1.4.13 MIME-Version: 1.0 Content-Type: text/plain;charset=iso-2022-jp Content-Transfer-Encoding: 8bit X-Priority: 3 (Normal) Importance: Normal Cc: freebsd-questions Subject: Re: Memory Error using Mailman on FreeBSD. How to debug? X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: lachlan@lkla.org List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 06 Feb 2008 02:10:55 -0000 > Barry just answered on Mailman list saying that the memory fault may > be in Python for that matter.... Thanks for forwarding that mail. If it's a python problem I'm probably in big trouble, but since I can't find evidence of other having the same problem with such small attachments (and as noted on the Mailman list it completely gums up the works for ALL lists) I'm still inclined to believe this is failure on my part, rather than a general error. Lachlan > [quote] >> Now to just work out the root cause of the memory errors ... > > It's important to remember that Python's email parsing code sucks the > entire message text into memory and keeps large attachments in memory > after parsing too. There could be a number of problems associated > with this, including a memory leak that causes the raw text to be kept > even after parsing, or that the attachment is just to big to be kept > in memory after parsing. > > There have been talks over the years about how to modify the email > package's api's so that it would be possible to store large > attachments in a separate file outside of core memory, but this has > yet to be done. Now would be a good time to look into it again, if we > have any hopes of getting something like this into Python 2.6 and > 3.0. However, this isn't the right place to discuss such changes -- > those should happen on Python's email sig: > http://www.python.org/sigs/email-sig > > Cheers, > - -Barry > [/quote] > > Zbigniew Szalbot