From owner-freebsd-virtualization@FreeBSD.ORG  Wed Nov 27 20:46:10 2013
Return-Path: <owner-freebsd-virtualization@FreeBSD.ORG>
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
 (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 0A9F7A86;
 Wed, 27 Nov 2013 20:46:10 +0000 (UTC)
Received: from mail-lb0-x235.google.com (mail-lb0-x235.google.com
 [IPv6:2a00:1450:4010:c04::235])
 (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
 (No client certificate requested)
 by mx1.freebsd.org (Postfix) with ESMTPS id C9E992723;
 Wed, 27 Nov 2013 20:45:24 +0000 (UTC)
Received: by mail-lb0-f181.google.com with SMTP id q8so5552617lbi.26
 for <multiple recipients>; Wed, 27 Nov 2013 12:45:19 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
 h=mime-version:sender:in-reply-to:references:date:message-id:subject
 :from:to:cc:content-type;
 bh=vSFmaNO2nqArQYqtiHd8AMgdgDD0uSiK2eSTXpHwtK8=;
 b=iPau9u2rPYEG/o0r23YKBq82B4aCgRdJDqpZnnixKtSlwBR8WZtFLBQQ7Ge57t3nnE
 9rKZah6M5+YNYUuDvNwb+X9JHeKnKfGWkFIewN1ND6/CutdavqgTlWVck0d8dCp0+aQ7
 60vomK+CkKnYhGvBAxk/HULq1Kt0ySVZc0LABkYnn0Zo2Usv32e/bZKLQqkNUBeYPIHk
 xm36YIFv/ypMVbnkHhtcRAFsWAGw+My+oGVxLPzSJKU9EYc4CoB0OzbHbI8CMdOOX9uu
 qE+gtw/w3admvDsnHj0xWo4GmoywFmAhCWRgBmMg3NDYAmDz4f1fAilJRbVRfaX8g3pd
 rSNQ==
MIME-Version: 1.0
X-Received: by 10.152.26.131 with SMTP id l3mr2654771lag.29.1385585119662;
 Wed, 27 Nov 2013 12:45:19 -0800 (PST)
Sender: crodr001@gmail.com
Received: by 10.112.120.232 with HTTP; Wed, 27 Nov 2013 12:45:19 -0800 (PST)
In-Reply-To: <CAJ-VmonPZosKJ7dySRhCMPb0USsmaH9JNzNOZz_T0Z=8NPxNhw@mail.gmail.com>
References: <CAG=rPVc4dYcXXjSy+TV_GhrxKqszQ8JF5B56tUPQN-QmuDv7NA@mail.gmail.com>
 <CAJ-VmonPZosKJ7dySRhCMPb0USsmaH9JNzNOZz_T0Z=8NPxNhw@mail.gmail.com>
Date: Wed, 27 Nov 2013 12:45:19 -0800
X-Google-Sender-Auth: mxJVFwM22M8_T11jtZOaY08zCRk
Message-ID: <CAG=rPVf=u7t3o0mzHys5Kw9XAGJRv-pFpEr7GCOYYZb0FgSFDQ@mail.gmail.com>
Subject: Re: VIMAGE: Freed UMA keg was not empty
From: Craig Rodrigues <rodrigc@FreeBSD.org>
To: Adrian Chadd <adrian@freebsd.org>
Content-Type: text/plain; charset=ISO-8859-1
X-Content-Filtered-By: Mailman/MimeDel 2.1.16
Cc: thierry.herbelot@free.fr,
 "freebsd-virtualization@freebsd.org" <freebsd-virtualization@freebsd.org>
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.16
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 <freebsd-virtualization.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-virtualization>, 
 <mailto:freebsd-virtualization-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-virtualization/>
List-Post: <mailto:freebsd-virtualization@freebsd.org>
List-Help: <mailto:freebsd-virtualization-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization>, 
 <mailto:freebsd-virtualization-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Wed, 27 Nov 2013 20:46:10 -0000

On Wed, Nov 27, 2013 at 2:05 AM, Adrian Chadd <adrian@freebsd.org> wrote:
>
> Well, the first step is figuring out which UMA zones are actually
> problematic. Isn't it logging which zones aren't empty?



The error messages on the console look like this:

Freed UMA keg was not empty (203 items).  Lost 1 pages of memory.
Freed UMA keg was not empty (36 items).  Lost 2 pages of memory.



That doesn't really tell which UMA zone isn't empty.

Is there some technqiue to figure this out?  I tried "vmstat -z" and

"vmstat -m", but while those gave clues, it didn't point to which UMA zone
was leaking.


Is there some other technique or tool that I can use?

--

Craig