From owner-freebsd-fs@FreeBSD.ORG Wed Sep 29 19:16:04 2010 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 412BC10656E8 for ; Wed, 29 Sep 2010 19:16:04 +0000 (UTC) (envelope-from torbjoern@gmail.com) Received: from mail-bw0-f54.google.com (mail-bw0-f54.google.com [209.85.214.54]) by mx1.freebsd.org (Postfix) with ESMTP id BD5DD8FC1E for ; Wed, 29 Sep 2010 19:16:03 +0000 (UTC) Received: by bwz15 with SMTP id 15so1072774bwz.13 for ; Wed, 29 Sep 2010 12:16:02 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:received:date:message-id :subject:from:to:content-type; bh=XUH5HffCLJhDQyb5xz7dTxdRBBpyL3nKpOelLEq5dIA=; b=P0BtylrISKyE1al/fR6xvkpdAPc2dYJaM5TIIL7Y2ZiaL3yGb/2XeA2YfyK3Ncmc5p g9Q2kdYDGr1pHnbM02HmxDuWX6LzygQ+zQ23Av3hVWUG9jDo2BGl9dbJDMPIPz8KXH4d hdjucdxQ2l1dyKkL4ZNdvZKr9u89w4eUJHfEc= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:date:message-id:subject:from:to:content-type; b=v/fKO7Rpv8ITm+SZGhzCEbt/X5NKX20KxHFY1ZYs+O36o/XViXi95fWfnBRR+72g36 CMZzOD/5nQXM5ZqSfaWShQOMyO+2ElDlUTmXi7hdIA0GZZWej1MlimWJY6macyohHf3m iitFQewETX1BJlJGmR0edKvNn7RyK+uOjZMkE= MIME-Version: 1.0 Received: by 10.204.65.145 with SMTP id j17mr1451833bki.209.1285785998249; Wed, 29 Sep 2010 11:46:38 -0700 (PDT) Received: by 10.204.71.138 with HTTP; Wed, 29 Sep 2010 11:46:38 -0700 (PDT) Date: Wed, 29 Sep 2010 20:46:38 +0200 Message-ID: From: Torbjorn Kristoffersen To: freebsd-fs@freebsd.org Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Subject: Strange ZFS problem, filesystem claims to be full when clearly not full X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 29 Sep 2010 19:16:04 -0000 I have a ZFS "tank" called tpool, the server runs a couple of jails (each with a zfs filesystem). There is a problem with one of these filesystems. First, its disk usage as shown in ``df -h'': ... tpool/rb.org 100G 95G 4.6G 95% /jails/rb.org ... The command ``zfs list'' shows the same: .. tpool/rb.org 95.4G 4.56G 95.4G /jails/rb.org .. However, there is a very mysterious problem somewhere. Something inside this jail is eating diskspace, but we can't find any directories that is actually taking the diskspace. We first suspected either fetchmail or spamassassin of causing a lot of space to be used, since some of their directories were huge. (These were later deleted, and which is why you see that 4.6GB is now available, before that 0GB was available). However, we can't find *any trace* of an actual directory or file that is taking all the spac.e Take this for instance: outsidejail# du -sh rb.org 43G rb.org How can this be? df and zfs are showing that the entire drive is nearly full, yet I can't find any directory that is actually taking all this space. I've carefully looked through every single directory within the jail trying to find something that's taking all that space, but to no avail. ---- My system stats: # uname -a FreeBSD grim 8.1-RELEASE FreeBSD 8.1-RELEASE #0: Mon Jul 19 02:36:49 UTC 2010 root@mason.cse.buffalo.edu:/usr/obj/usr/src/sys/GENERIC amd64 # zpool get version tpool NAME PROPERTY VALUE SOURCE tpool version 14 default # zpool status pool: tpool state: ONLINE scrub: none requested config: NAME STATE READ WRITE CKSUM tpool ONLINE 0 0 0 mirror ONLINE 0 0 0 ad4s1d ONLINE 0 0 0 ad6s1d ONLINE 0 0 0 errors: No known data errors [ Note that I've also done a scrub recently ] ----