From owner-freebsd-fs@freebsd.org Sun Jun 5 21:00:23 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C4500B6A813 for ; Sun, 5 Jun 2016 21:00:23 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 9FCB2113E for ; Sun, 5 Jun 2016 21:00:23 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u55L01CX043750 for ; Sun, 5 Jun 2016 21:00:23 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <201606052100.u55L01CX043750@kenobi.freebsd.org> From: bugzilla-noreply@FreeBSD.org To: freebsd-fs@FreeBSD.org Subject: Problem reports for freebsd-fs@FreeBSD.org that need special attention Date: Sun, 05 Jun 2016 21:00:23 +0000 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 05 Jun 2016 21:00:23 -0000 To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- New | 203492 | mount_unionfs -o below causes panic Open | 136470 | [nfs] Cannot mount / in read-only, over NFS Open | 139651 | [nfs] mount(8): read-only remount of NFS volume d Open | 144447 | [zfs] sharenfs fsunshare() & fsshare_main() non f 4 problems total for which you should take action. From owner-freebsd-fs@freebsd.org Mon Jun 6 14:21:41 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D17AEB6D37E for ; Mon, 6 Jun 2016 14:21:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id C28561D72 for ; Mon, 6 Jun 2016 14:21:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u56ELf9K054862 for ; Mon, 6 Jun 2016 14:21:41 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 209158] node / npm triggering zfs rename deadlock Date: Mon, 06 Jun 2016 14:21:41 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: avg@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 06 Jun 2016 14:21:41 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D209158 --- Comment #28 from Andriy Gapon --- (In reply to Doug Luce from comment #27) Thank you very much again for testing and reporting! Your testing is a valuable data point for further work on this patch. Probably I'll now invite more ZFS / FS people to discuss and review the pat= ch and we'll see how it goes. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Tue Jun 7 20:43:42 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 41086B6E993 for ; Tue, 7 Jun 2016 20:43:42 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 31C3614A9 for ; Tue, 7 Jun 2016 20:43:42 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u57KhfDp026091 for ; Tue, 7 Jun 2016 20:43:42 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 139715] [zfs] vfs.numvnodes leak on busy zfs Date: Tue, 07 Jun 2016 20:43:41 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: unspecified X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mi@ALDAN.algebra.com X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 07 Jun 2016 20:43:42 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D139715 Mikhail T. changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |mi@ALDAN.algebra.com --- Comment #6 from Mikhail T. --- Sorry, is this still a problem with FreeBSD-10.x and/or 11.x? Thanks! --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Wed Jun 8 15:11:27 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BF94FB6F2BD for ; Wed, 8 Jun 2016 15:11:27 +0000 (UTC) (envelope-from 0101015530915938-9ea92b67-8927-42c9-93d2-60a6aa88b55e-000000@us-west-2.amazonses.com) Received: from a27-24.smtp-out.us-west-2.amazonses.com (a27-24.smtp-out.us-west-2.amazonses.com [54.240.27.24]) (using TLSv1 with cipher ECDHE-RSA-AES128-SHA (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id A706418CD for ; Wed, 8 Jun 2016 15:11:27 +0000 (UTC) (envelope-from 0101015530915938-9ea92b67-8927-42c9-93d2-60a6aa88b55e-000000@us-west-2.amazonses.com) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/simple; s=gdwg2y3kokkkj5a55z2ilkup5wp5hhxx; d=amazonses.com; t=1465398679; h=Date:From:Reply-To:To:Message-ID:Subject:MIME-Version:Content-Type:Feedback-ID; bh=rOBey1Dnwso3sGmyl+NyPuVi2o+9b/aDKKwJfhxCO+4=; b=n+SwtvPiLkEuVaCjzQImKJ8MirUKbMV7gg2GjjuM/YUqtkC0taVLKshdmHlBeiRT NwTRr+O9VC3C8pIy+FNkBpAaj+6iQjfTb7ceTs66pqRwQxOT7i2rrq+oK7X4T5eYESh mmlmwqjfaMo1333ewsNz5wjsN1yf4JfKEOdxqkD8= Date: Wed, 8 Jun 2016 15:11:19 +0000 From: Mobile SMS Marketing Reply-To: chiboost@gmx.com To: freebsd-fs@freebsd.org Message-ID: <0101015530915938-9ea92b67-8927-42c9-93d2-60a6aa88b55e-000000@us-west-2.amazonses.com> Subject: The best tool for start up business X-SES-Outgoing: 2016.06.08-54.240.27.24 Feedback-ID: 1.us-west-2.Vf7+6T1oCxZiDF9K+T6XVAfo0K8BvnF5/zkSxKEtH30=:AmazonSES MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.22 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 08 Jun 2016 15:11:27 -0000 From owner-freebsd-fs@freebsd.org Thu Jun 9 10:26:21 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E61C1AEF484 for ; Thu, 9 Jun 2016 10:26:21 +0000 (UTC) (envelope-from richard@bader-muenchen.de) Received: from gate1.bader-muenchen.de (gate1.bader-muenchen.de [213.179.151.243]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 58DF511DC for ; Thu, 9 Jun 2016 10:26:20 +0000 (UTC) (envelope-from richard@bader-muenchen.de) Received: from [192.168.16.40] (vpn-ex0.bader.loc [192.168.16.40]) by gate1.bader-muenchen.de (8.15.2/8.15.2) with ESMTP id u59ACwtK058328; Thu, 9 Jun 2016 12:12:58 +0200 (CEST) (envelope-from richard@bader-muenchen.de) To: freebsd-fs@freebsd.org Cc: richard@bader-muenchen.de From: richard bader Subject: disk space not freed when deleting files in null_mounted filesystem Message-ID: <2e11d942-0856-7ce4-56ef-3774046f8df8@bader-muenchen.de> Date: Thu, 9 Jun 2016 12:13:08 +0200 User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.1.1 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 09 Jun 2016 10:26:22 -0000 Hello, i've a filesystem mounted with mount_nullfs. When i delete a large file in this filesystem, the space on the disk is not freed. The space becomes freed when i unmount the filesystem. to reproduce this: root@main2:/tmp # mkdir lnk src root@main2:/tmp # mount_nullfs src lnk root@main2:/tmp # mount | grep lnk /tmp/src on /tmp/lnk (nullfs, local) root@main2:/tmp # df -h . Filesystem Size Used Avail Capacity Mounted on /dev/ada0p2 58G 40G 13G 75% / root@main2:/tmp # dd if=/dev/zero of=lnk/foo bs=1G count=3 3+0 records in 3+0 records out 3221225472 bytes transferred in 7.856793 secs (409992411 bytes/sec) root@main2:/tmp # df -h . Filesystem Size Used Avail Capacity Mounted on /dev/ada0p2 58G 43G 10G 80% / root@main2:/tmp # rm lnk/foo root@main2:/tmp # df -h . Filesystem Size Used Avail Capacity Mounted on /dev/ada0p2 58G 43G 10G 80% / root@main2:/tmp # umount /tmp/lnk root@main2:/tmp # df -h . Filesystem Size Used Avail Capacity Mounted on /dev/ada0p2 58G 40G 13G 75% / my system: root@main2:/tmp # uname -a FreeBSD main2.bader.loc 10.2-RELEASE-p18 FreeBSD 10.2-RELEASE-p18 #8 r301112: Wed Jun 1 11:08:24 CEST 2016 root@main2.bader.loc:/usr/obj/usr/src/sys/MYKERNEL amd64 are the any options for mount_nullfs ? best regards richard From owner-freebsd-fs@freebsd.org Thu Jun 9 12:11:36 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7A81BAEE909 for ; Thu, 9 Jun 2016 12:11:36 +0000 (UTC) (envelope-from pho@holm.cc) Received: from relay01.pair.com (relay01.pair.com [209.68.5.15]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 5646D1E0E for ; Thu, 9 Jun 2016 12:11:36 +0000 (UTC) (envelope-from pho@holm.cc) Received: from x2.osted.lan (87-58-223-204-dynamic.dk.customer.tdc.net [87.58.223.204]) by relay01.pair.com (Postfix) with ESMTP id 1D70CD0089D; Thu, 9 Jun 2016 08:11:29 -0400 (EDT) Received: from x2.osted.lan (localhost [127.0.0.1]) by x2.osted.lan (8.14.9/8.14.9) with ESMTP id u59CBRkj047093 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Thu, 9 Jun 2016 14:11:27 +0200 (CEST) (envelope-from pho@x2.osted.lan) Received: (from pho@localhost) by x2.osted.lan (8.14.9/8.14.9/Submit) id u59CBRdX047092; Thu, 9 Jun 2016 14:11:27 +0200 (CEST) (envelope-from pho) Date: Thu, 9 Jun 2016 14:11:26 +0200 From: Peter Holm To: richard bader Cc: freebsd-fs@freebsd.org Subject: Re: disk space not freed when deleting files in null_mounted filesystem Message-ID: <20160609121126.GA46828@x2.osted.lan> References: <2e11d942-0856-7ce4-56ef-3774046f8df8@bader-muenchen.de> <20160609112703.GA42321@x2.osted.lan> <92c2f5f8-a5fc-4947-1e65-252543a2569e@bader-muenchen.de> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <92c2f5f8-a5fc-4947-1e65-252543a2569e@bader-muenchen.de> User-Agent: Mutt/1.5.23 (2014-03-12) X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 09 Jun 2016 12:11:36 -0000 On Thu, Jun 09, 2016 at 01:39:45PM +0200, richard bader wrote: > Am 09.06.2016 um 13:27 schrieb Peter Holm: > > On Thu, Jun 09, 2016 at 12:13:08PM +0200, richard bader wrote: > >> Hello, > >> > >> i've a filesystem mounted with mount_nullfs. > >> When i delete a large file in this filesystem, the space on the disk is > >> not freed. > >> The space becomes freed when i unmount the filesystem. > >> > >> > >> to reproduce this: > >> > >> root@main2:/tmp # mkdir lnk src > >> root@main2:/tmp # mount_nullfs src lnk > >> root@main2:/tmp # mount | grep lnk > >> /tmp/src on /tmp/lnk (nullfs, local) > >> root@main2:/tmp # df -h . > >> Filesystem Size Used Avail Capacity Mounted on > >> /dev/ada0p2 58G 40G 13G 75% / > >> root@main2:/tmp # dd if=/dev/zero of=lnk/foo bs=1G count=3 > >> 3+0 records in > >> 3+0 records out > >> 3221225472 bytes transferred in 7.856793 secs (409992411 bytes/sec) > >> root@main2:/tmp # df -h . > >> Filesystem Size Used Avail Capacity Mounted on > >> /dev/ada0p2 58G 43G 10G 80% / > >> root@main2:/tmp # rm lnk/foo > >> root@main2:/tmp # df -h . > >> Filesystem Size Used Avail Capacity Mounted on > >> /dev/ada0p2 58G 43G 10G 80% / > >> root@main2:/tmp # umount /tmp/lnk > >> root@main2:/tmp # df -h . > >> Filesystem Size Used Avail Capacity Mounted on > >> /dev/ada0p2 58G 40G 13G 75% / > >> > >> > >> my system: > >> > >> root@main2:/tmp # uname -a > >> FreeBSD main2.bader.loc 10.2-RELEASE-p18 FreeBSD 10.2-RELEASE-p18 #8 > >> r301112: Wed Jun 1 11:08:24 CEST 2016 > >> root@main2.bader.loc:/usr/obj/usr/src/sys/MYKERNEL amd64 > >> > >> are the any options for mount_nullfs ? > >> > >> best regards > >> > >> richard > >> > > Hello Richard, > > > > I wonder which file system you are using? > > Here's what happens with UFS and current from today: > > > > $ cat -n richard.sh > > 1 #!/bin/sh > > 2 > > 3 uname -a > > 4 mount | grep `df -h /tmp | tail -1 | awk '{print $1}'` > > 5 > > 6 cd /tmp > > 7 rm -rf lnk src > > 8 mkdir lnk src > > 9 mount_nullfs src lnk > > 10 mount | grep lnk > > 11 df -h . > > 12 dd if=/dev/zero of=lnk/foo bs=1G count=3 > > 13 df -h . > > 14 rm lnk/foo > > 15 df -h . > > 16 umount /tmp/lnk > > 17 df -h . > > $ ./richard.sh > > FreeBSD t2.osted.lan 11.0-ALPHA2 FreeBSD 11.0-ALPHA2 #0 r301722: Thu Jun 9 12:09:39 CEST 2016 pho@t2.osted.lan:/usr/src/sys/amd64/compile/PHO amd64 > > /dev/da0p3 on /tmp (ufs, NFS exported, local, soft-updates) > > /tmp/src on /tmp/lnk (nullfs, local) > > Filesystem Size Used Avail Capacity Mounted on > > /dev/da0p3 97G 1,6G 87G 2% /tmp > > 3+0 records in > > 3+0 records out > > 3221225472 bytes transferred in 47.658947 secs (67589102 bytes/sec) > > Filesystem Size Used Avail Capacity Mounted on > > /dev/da0p3 97G 4,6G 84G 5% /tmp > > Filesystem Size Used Avail Capacity Mounted on > > /dev/da0p3 97G 1,6G 87G 2% /tmp > > Filesystem Size Used Avail Capacity Mounted on > > /dev/da0p3 97G 1,6G 87G 2% /tmp > > $ > > > > - Peter > i'm also using ufs. > > root@main2:/tmp # ./richard.sh > FreeBSD main2.bader.loc 10.2-RELEASE-p18 FreeBSD 10.2-RELEASE-p18 #8 > r301112: Wed Jun 1 11:08:24 CEST 2016 > root@main2.bader.loc:/usr/obj/usr/src/sys/MYKERNEL amd64 > /dev/ada0p2 on / (ufs, local, journaled soft-updates) > /tmp/src on /tmp/lnk (nullfs, local) > Filesystem Size Used Avail Capacity Mounted on > /dev/ada0p2 58G 40G 13G 75% / > 3+0 records in > 3+0 records out > 3221225472 bytes transferred in 8.679717 secs (371121023 bytes/sec) > Filesystem Size Used Avail Capacity Mounted on > /dev/ada0p2 58G 43G 10G 80% / > Filesystem Size Used Avail Capacity Mounted on > /dev/ada0p2 58G 43G 10G 80% / > Filesystem Size Used Avail Capacity Mounted on > /dev/ada0p2 58G 40G 13G 75% / > Hmm. I tried again on SU+J but I still do not see any problems on HEAD. I'll build r301112 and see what happens. - Peter From owner-freebsd-fs@freebsd.org Thu Jun 9 12:17:16 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6318BAEE9F4 for ; Thu, 9 Jun 2016 12:17:16 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from kib.kiev.ua (kib.kiev.ua [IPv6:2001:470:d5e7:1::1]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 0CFD610D6 for ; Thu, 9 Jun 2016 12:17:15 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from tom.home (kib@localhost [127.0.0.1]) by kib.kiev.ua (8.15.2/8.15.2) with ESMTPS id u59CH5iF016814 (version=TLSv1 cipher=DHE-RSA-CAMELLIA256-SHA bits=256 verify=NO); Thu, 9 Jun 2016 15:17:05 +0300 (EEST) (envelope-from kostikbel@gmail.com) DKIM-Filter: OpenDKIM Filter v2.10.3 kib.kiev.ua u59CH5iF016814 Received: (from kostik@localhost) by tom.home (8.15.2/8.15.2/Submit) id u59CH5uo016813; Thu, 9 Jun 2016 15:17:05 +0300 (EEST) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: tom.home: kostik set sender to kostikbel@gmail.com using -f Date: Thu, 9 Jun 2016 15:17:05 +0300 From: Konstantin Belousov To: Peter Holm Cc: richard bader , freebsd-fs@freebsd.org Subject: Re: disk space not freed when deleting files in null_mounted filesystem Message-ID: <20160609121705.GB38613@kib.kiev.ua> References: <2e11d942-0856-7ce4-56ef-3774046f8df8@bader-muenchen.de> <20160609112703.GA42321@x2.osted.lan> <92c2f5f8-a5fc-4947-1e65-252543a2569e@bader-muenchen.de> <20160609121126.GA46828@x2.osted.lan> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20160609121126.GA46828@x2.osted.lan> User-Agent: Mutt/1.6.1 (2016-04-27) X-Spam-Status: No, score=-2.0 required=5.0 tests=ALL_TRUSTED,BAYES_00, DKIM_ADSP_CUSTOM_MED,FREEMAIL_FROM,NML_ADSP_CUSTOM_MED autolearn=no autolearn_force=no version=3.4.1 X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on tom.home X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 09 Jun 2016 12:17:16 -0000 On Thu, Jun 09, 2016 at 02:11:26PM +0200, Peter Holm wrote: > On Thu, Jun 09, 2016 at 01:39:45PM +0200, richard bader wrote: > > Am 09.06.2016 um 13:27 schrieb Peter Holm: > > > On Thu, Jun 09, 2016 at 12:13:08PM +0200, richard bader wrote: > > >> Hello, > > >> > > >> i've a filesystem mounted with mount_nullfs. > > >> When i delete a large file in this filesystem, the space on the disk is > > >> not freed. > > >> The space becomes freed when i unmount the filesystem. > > >> > > >> > > >> to reproduce this: > > >> > > >> root@main2:/tmp # mkdir lnk src > > >> root@main2:/tmp # mount_nullfs src lnk > > >> root@main2:/tmp # mount | grep lnk > > >> /tmp/src on /tmp/lnk (nullfs, local) > > >> root@main2:/tmp # df -h . > > >> Filesystem Size Used Avail Capacity Mounted on > > >> /dev/ada0p2 58G 40G 13G 75% / > > >> root@main2:/tmp # dd if=/dev/zero of=lnk/foo bs=1G count=3 > > >> 3+0 records in > > >> 3+0 records out > > >> 3221225472 bytes transferred in 7.856793 secs (409992411 bytes/sec) > > >> root@main2:/tmp # df -h . > > >> Filesystem Size Used Avail Capacity Mounted on > > >> /dev/ada0p2 58G 43G 10G 80% / > > >> root@main2:/tmp # rm lnk/foo > > >> root@main2:/tmp # df -h . > > >> Filesystem Size Used Avail Capacity Mounted on > > >> /dev/ada0p2 58G 43G 10G 80% / > > >> root@main2:/tmp # umount /tmp/lnk > > >> root@main2:/tmp # df -h . > > >> Filesystem Size Used Avail Capacity Mounted on > > >> /dev/ada0p2 58G 40G 13G 75% / > > >> > > >> > > >> my system: > > >> > > >> root@main2:/tmp # uname -a > > >> FreeBSD main2.bader.loc 10.2-RELEASE-p18 FreeBSD 10.2-RELEASE-p18 #8 > > >> r301112: Wed Jun 1 11:08:24 CEST 2016 > > >> root@main2.bader.loc:/usr/obj/usr/src/sys/MYKERNEL amd64 > > >> > > >> are the any options for mount_nullfs ? > > >> > > >> best regards > > >> > > >> richard > > >> > > > Hello Richard, > > > > > > I wonder which file system you are using? > > > Here's what happens with UFS and current from today: > > > > > > $ cat -n richard.sh > > > 1 #!/bin/sh > > > 2 > > > 3 uname -a > > > 4 mount | grep `df -h /tmp | tail -1 | awk '{print $1}'` > > > 5 > > > 6 cd /tmp > > > 7 rm -rf lnk src > > > 8 mkdir lnk src > > > 9 mount_nullfs src lnk > > > 10 mount | grep lnk > > > 11 df -h . > > > 12 dd if=/dev/zero of=lnk/foo bs=1G count=3 > > > 13 df -h . > > > 14 rm lnk/foo > > > 15 df -h . > > > 16 umount /tmp/lnk > > > 17 df -h . > > > $ ./richard.sh > > > FreeBSD t2.osted.lan 11.0-ALPHA2 FreeBSD 11.0-ALPHA2 #0 r301722: Thu Jun 9 12:09:39 CEST 2016 pho@t2.osted.lan:/usr/src/sys/amd64/compile/PHO amd64 > > > /dev/da0p3 on /tmp (ufs, NFS exported, local, soft-updates) > > > /tmp/src on /tmp/lnk (nullfs, local) > > > Filesystem Size Used Avail Capacity Mounted on > > > /dev/da0p3 97G 1,6G 87G 2% /tmp > > > 3+0 records in > > > 3+0 records out > > > 3221225472 bytes transferred in 47.658947 secs (67589102 bytes/sec) > > > Filesystem Size Used Avail Capacity Mounted on > > > /dev/da0p3 97G 4,6G 84G 5% /tmp > > > Filesystem Size Used Avail Capacity Mounted on > > > /dev/da0p3 97G 1,6G 87G 2% /tmp > > > Filesystem Size Used Avail Capacity Mounted on > > > /dev/da0p3 97G 1,6G 87G 2% /tmp > > > $ > > > > > > - Peter > > i'm also using ufs. > > > > root@main2:/tmp # ./richard.sh > > FreeBSD main2.bader.loc 10.2-RELEASE-p18 FreeBSD 10.2-RELEASE-p18 #8 > > r301112: Wed Jun 1 11:08:24 CEST 2016 > > root@main2.bader.loc:/usr/obj/usr/src/sys/MYKERNEL amd64 > > /dev/ada0p2 on / (ufs, local, journaled soft-updates) > > /tmp/src on /tmp/lnk (nullfs, local) > > Filesystem Size Used Avail Capacity Mounted on > > /dev/ada0p2 58G 40G 13G 75% / > > 3+0 records in > > 3+0 records out > > 3221225472 bytes transferred in 8.679717 secs (371121023 bytes/sec) > > Filesystem Size Used Avail Capacity Mounted on > > /dev/ada0p2 58G 43G 10G 80% / > > Filesystem Size Used Avail Capacity Mounted on > > /dev/ada0p2 58G 43G 10G 80% / > > Filesystem Size Used Avail Capacity Mounted on > > /dev/ada0p2 58G 40G 13G 75% / > > > > Hmm. I tried again on SU+J but I still do not see any problems on > HEAD. I'll build r301112 and see what happens. There were several bugs fixed since 10.2 in nullfs. Use -o nocache to disable nullfs vnode caching, which most likely fix it for 10.2. From owner-freebsd-fs@freebsd.org Thu Jun 9 12:24:08 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 23E4AAEEEE4 for ; Thu, 9 Jun 2016 12:24:08 +0000 (UTC) (envelope-from richard@bader-muenchen.de) Received: from gate1.bader-muenchen.de (gate1.bader-muenchen.de [213.179.151.243]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 9E17416F4 for ; Thu, 9 Jun 2016 12:24:07 +0000 (UTC) (envelope-from richard@bader-muenchen.de) Received: from [192.168.16.40] (vpn-ex0.bader.loc [192.168.16.40]) by gate1.bader-muenchen.de (8.15.2/8.15.2) with ESMTP id u59CO0ad062888; Thu, 9 Jun 2016 14:24:03 +0200 (CEST) (envelope-from richard@bader-muenchen.de) Subject: Re: disk space not freed when deleting files in null_mounted filesystem To: Konstantin Belousov References: <2e11d942-0856-7ce4-56ef-3774046f8df8@bader-muenchen.de> <20160609112703.GA42321@x2.osted.lan> <92c2f5f8-a5fc-4947-1e65-252543a2569e@bader-muenchen.de> <20160609121126.GA46828@x2.osted.lan> <20160609121705.GB38613@kib.kiev.ua> Cc: richard@bader-muenchen.de, Peter Holm , freebsd-fs@freebsd.org From: richard bader Message-ID: <833c60c3-7d0f-4177-a7cb-2af2297656d5@bader-muenchen.de> Date: Thu, 9 Jun 2016 14:24:10 +0200 User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.1.1 MIME-Version: 1.0 In-Reply-To: <20160609121705.GB38613@kib.kiev.ua> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 09 Jun 2016 12:24:08 -0000 Am 09.06.2016 um 14:17 schrieb Konstantin Belousov: > On Thu, Jun 09, 2016 at 02:11:26PM +0200, Peter Holm wrote: >> On Thu, Jun 09, 2016 at 01:39:45PM +0200, richard bader wrote: >>> Am 09.06.2016 um 13:27 schrieb Peter Holm: >>>> On Thu, Jun 09, 2016 at 12:13:08PM +0200, richard bader wrote: >>>>> Hello, >>>>> >>>>> i've a filesystem mounted with mount_nullfs. >>>>> When i delete a large file in this filesystem, the space on the disk is >>>>> not freed. >>>>> The space becomes freed when i unmount the filesystem. >>>>> >>>>> >>>>> to reproduce this: >>>>> >>>>> root@main2:/tmp # mkdir lnk src >>>>> root@main2:/tmp # mount_nullfs src lnk >>>>> root@main2:/tmp # mount | grep lnk >>>>> /tmp/src on /tmp/lnk (nullfs, local) >>>>> root@main2:/tmp # df -h . >>>>> Filesystem Size Used Avail Capacity Mounted on >>>>> /dev/ada0p2 58G 40G 13G 75% / >>>>> root@main2:/tmp # dd if=/dev/zero of=lnk/foo bs=1G count=3 >>>>> 3+0 records in >>>>> 3+0 records out >>>>> 3221225472 bytes transferred in 7.856793 secs (409992411 bytes/sec) >>>>> root@main2:/tmp # df -h . >>>>> Filesystem Size Used Avail Capacity Mounted on >>>>> /dev/ada0p2 58G 43G 10G 80% / >>>>> root@main2:/tmp # rm lnk/foo >>>>> root@main2:/tmp # df -h . >>>>> Filesystem Size Used Avail Capacity Mounted on >>>>> /dev/ada0p2 58G 43G 10G 80% / >>>>> root@main2:/tmp # umount /tmp/lnk >>>>> root@main2:/tmp # df -h . >>>>> Filesystem Size Used Avail Capacity Mounted on >>>>> /dev/ada0p2 58G 40G 13G 75% / >>>>> >>>>> >>>>> my system: >>>>> >>>>> root@main2:/tmp # uname -a >>>>> FreeBSD main2.bader.loc 10.2-RELEASE-p18 FreeBSD 10.2-RELEASE-p18 #8 >>>>> r301112: Wed Jun 1 11:08:24 CEST 2016 >>>>> root@main2.bader.loc:/usr/obj/usr/src/sys/MYKERNEL amd64 >>>>> >>>>> are the any options for mount_nullfs ? >>>>> >>>>> best regards >>>>> >>>>> richard >>>>> >>>> Hello Richard, >>>> >>>> I wonder which file system you are using? >>>> Here's what happens with UFS and current from today: >>>> >>>> $ cat -n richard.sh >>>> 1 #!/bin/sh >>>> 2 >>>> 3 uname -a >>>> 4 mount | grep `df -h /tmp | tail -1 | awk '{print $1}'` >>>> 5 >>>> 6 cd /tmp >>>> 7 rm -rf lnk src >>>> 8 mkdir lnk src >>>> 9 mount_nullfs src lnk >>>> 10 mount | grep lnk >>>> 11 df -h . >>>> 12 dd if=/dev/zero of=lnk/foo bs=1G count=3 >>>> 13 df -h . >>>> 14 rm lnk/foo >>>> 15 df -h . >>>> 16 umount /tmp/lnk >>>> 17 df -h . >>>> $ ./richard.sh >>>> FreeBSD t2.osted.lan 11.0-ALPHA2 FreeBSD 11.0-ALPHA2 #0 r301722: Thu Jun 9 12:09:39 CEST 2016 pho@t2.osted.lan:/usr/src/sys/amd64/compile/PHO amd64 >>>> /dev/da0p3 on /tmp (ufs, NFS exported, local, soft-updates) >>>> /tmp/src on /tmp/lnk (nullfs, local) >>>> Filesystem Size Used Avail Capacity Mounted on >>>> /dev/da0p3 97G 1,6G 87G 2% /tmp >>>> 3+0 records in >>>> 3+0 records out >>>> 3221225472 bytes transferred in 47.658947 secs (67589102 bytes/sec) >>>> Filesystem Size Used Avail Capacity Mounted on >>>> /dev/da0p3 97G 4,6G 84G 5% /tmp >>>> Filesystem Size Used Avail Capacity Mounted on >>>> /dev/da0p3 97G 1,6G 87G 2% /tmp >>>> Filesystem Size Used Avail Capacity Mounted on >>>> /dev/da0p3 97G 1,6G 87G 2% /tmp >>>> $ >>>> >>>> - Peter >>> i'm also using ufs. >>> >>> root@main2:/tmp # ./richard.sh >>> FreeBSD main2.bader.loc 10.2-RELEASE-p18 FreeBSD 10.2-RELEASE-p18 #8 >>> r301112: Wed Jun 1 11:08:24 CEST 2016 >>> root@main2.bader.loc:/usr/obj/usr/src/sys/MYKERNEL amd64 >>> /dev/ada0p2 on / (ufs, local, journaled soft-updates) >>> /tmp/src on /tmp/lnk (nullfs, local) >>> Filesystem Size Used Avail Capacity Mounted on >>> /dev/ada0p2 58G 40G 13G 75% / >>> 3+0 records in >>> 3+0 records out >>> 3221225472 bytes transferred in 8.679717 secs (371121023 bytes/sec) >>> Filesystem Size Used Avail Capacity Mounted on >>> /dev/ada0p2 58G 43G 10G 80% / >>> Filesystem Size Used Avail Capacity Mounted on >>> /dev/ada0p2 58G 43G 10G 80% / >>> Filesystem Size Used Avail Capacity Mounted on >>> /dev/ada0p2 58G 40G 13G 75% / >>> >> Hmm. I tried again on SU+J but I still do not see any problems on >> HEAD. I'll build r301112 and see what happens. > There were several bugs fixed since 10.2 in nullfs. Use -o nocache > to disable nullfs vnode caching, which most likely fix it for 10.2. > _______________________________________________ Thanks, with 'mount_nullfs -o nocache src lnk' it works as expected - richard -- Dipl.Ing.Bader Richard GmbH, Helferichstrasse 32, 80999 Muenchen Tel.: +49 89 892205 31 Fax.: +49 89 892205 33 http://www.bader-muenchen.de