From owner-freebsd-fs@freebsd.org Sun Feb 5 03:54:41 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B05E2CCF19D for ; Sun, 5 Feb 2017 03:54:41 +0000 (UTC) (envelope-from ler@lerctr.org) Received: from thebighonker.lerctr.org (thebighonker.lerctr.org [IPv6:2001:470:1f0f:3ad:223:7dff:fe9e:6e8a]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "thebighonker.lerctr.org", Issuer "COMODO RSA Domain Validation Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 897A7913; Sun, 5 Feb 2017 03:54:41 +0000 (UTC) (envelope-from ler@lerctr.org) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lerctr.org; s=lerami; h=In-Reply-To:Content-Type:MIME-Version:References:Message-ID: Subject:Cc:To:From:Date:Sender:Reply-To:Content-Transfer-Encoding:Content-ID: Content-Description:Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc :Resent-Message-ID:List-Id:List-Help:List-Unsubscribe:List-Subscribe: List-Post:List-Owner:List-Archive; bh=ucy1ov1McVEw0YFBLTmeFRAsx97vcmn6XlSwQcEPQFo=; b=WMtjBpqd9BhZdM58rehErASYMv dXdP0ZqO4rFX5YLrXiO0pf8iiKftONo6CyyqSWGm4fvsQ20Bl2K6XNIpJc28pwAIHh8A5MIm2NjFh sOXvlo25NQNGKqsdxVjPwCe+aNmcY4zzYMTINuME1zEUj2NLWFIf7FwQ1jkPbbuAR6/U=; Received: from borg-home.dyn.lerctr.org ([2001:470:1f0f:42c:230:48ff:fef2:299c]:61237 helo=borg.lerctr.org) by thebighonker.lerctr.org with esmtpsa (TLSv1.2:ECDHE-RSA-AES256-GCM-SHA384:256) (Exim 4.88 (FreeBSD)) (envelope-from ) id 1caDuR-000BLa-Vy; Sat, 04 Feb 2017 21:54:40 -0600 Date: Sat, 4 Feb 2017 21:54:39 -0600 From: Larry Rosenman To: Steven Hartland Cc: Larry Rosenman , Freebsd fs Subject: Re: 16.0E ExpandSize? -- New Server Message-ID: <20170205035438.6gc2ybg6otidzpaz@borg.lerctr.org> Mail-Followup-To: Steven Hartland , Larry Rosenman , Freebsd fs References: <22e1bfc5840d972cf93643733682cda1@FreeBSD.org> <8a710dc75c129f58b0372eeaeca575b5@FreeBSD.org> <96534515-4fcb-774e-a599-8d48aec930cd@multiplay.co.uk> <8387d38f-3185-8c07-396b-602c708002a6@multiplay.co.uk> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <8387d38f-3185-8c07-396b-602c708002a6@multiplay.co.uk> User-Agent: NeoMutt/20161126 (1.7.1) X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 05 Feb 2017 03:54:41 -0000 I saw it was accepted upstream. Can it be committed to FreeBSD? On Wed, Feb 01, 2017 at 02:43:51AM +0000, Steven Hartland wrote: > Thanks I've put a PR in upstream to get some eyes on the fix. > https://github.com/openzfs/openzfs/pull/296 > > If no objections are raised to the approach I've used I'll commit the fix to > HEAD too. > > On 01/02/2017 02:31, Larry Rosenman wrote: > > > > no grief that I can see: > > > > borg-new /home/ler $ sudo zdb > > Password: > > zroot: > > version: 5000 > > name: 'zroot' > > state: 0 > > txg: 96143 > > pool_guid: 11945658884309024932 > > hostid: 3619181042 > > hostname: '' > > com.delphix:has_per_vdev_zaps > > vdev_children: 1 > > vdev_tree: > > type: 'root' > > id: 0 > > guid: 11945658884309024932 > > create_txg: 4 > > children[0]: > > type: 'raidz' > > id: 0 > > guid: 7596925654112466913 > > nparity: 1 > > metaslab_array: 42 > > metaslab_shift: 36 > > ashift: 12 > > asize: 11947471798272 > > is_log: 0 > > create_txg: 4 > > com.delphix:vdev_zap_top: 35 > > children[0]: > > type: 'disk' > > id: 0 > > guid: 1443238581175429852 > > path: '/dev/mfid4p4' > > whole_disk: 1 > > DTL: 137 > > create_txg: 4 > > com.delphix:vdev_zap_leaf: 131 > > children[1]: > > type: 'disk' > > id: 1 > > guid: 1865792721003775978 > > path: '/dev/mfid0p4' > > whole_disk: 1 > > DTL: 133 > > create_txg: 4 > > com.delphix:vdev_zap_leaf: 37 > > children[2]: > > type: 'disk' > > id: 2 > > guid: 12541720522827927342 > > path: '/dev/mfid1p4' > > whole_disk: 1 > > DTL: 132 > > create_txg: 4 > > com.delphix:vdev_zap_leaf: 38 > > children[3]: > > type: 'disk' > > id: 3 > > guid: 13053934791777776444 > > path: '/dev/mfid3p4' > > whole_disk: 1 > > DTL: 136 > > create_txg: 4 > > com.delphix:vdev_zap_leaf: 135 > > children[4]: > > type: 'disk' > > id: 4 > > guid: 4432707573898874857 > > path: '/dev/mfid2p4' > > whole_disk: 1 > > DTL: 130 > > create_txg: 4 > > com.delphix:vdev_zap_leaf: 40 > > children[5]: > > type: 'disk' > > id: 5 > > guid: 5106293125005422556 > > path: '/dev/mfid5p4' > > whole_disk: 1 > > DTL: 129 > > create_txg: 4 > > com.delphix:vdev_zap_leaf: 41 > > features_for_read: > > com.delphix:hole_birth > > com.delphix:embedded_data > > borg-new /home/ler $ sudo zpool list -v > > NAME SIZE ALLOC FREE EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT > > zroot 10.8T 94.3G 10.7T - 0% 0% 1.00x ONLINE - > > raidz1 10.8T 94.3G 10.7T - 0% 0% > > mfid4p4 - - - - - - > > mfid0p4 - - - - - - > > mfid1p4 - - - - - - > > mfid3p4 - - - - - - > > mfid2p4 - - - - - - > > mfid5p4 - - - - - - > > borg-new /home/ler $ sudo zpool get all > > NAME PROPERTY VALUE SOURCE > > zroot size 10.8T - > > zroot capacity 0% - > > zroot altroot - default > > zroot health ONLINE - > > zroot guid 11945658884309024932 default > > zroot version - default > > zroot bootfs zroot/ROOT/default local > > zroot delegation on default > > zroot autoreplace off default > > zroot cachefile - default > > zroot failmode wait default > > zroot listsnapshots off default > > zroot autoexpand off default > > zroot dedupditto 0 default > > zroot dedupratio 1.00x - > > zroot free 10.7T - > > zroot allocated 94.3G - > > zroot readonly off - > > zroot comment - default > > zroot expandsize - - > > zroot freeing 0 default > > zroot fragmentation 0% - > > zroot leaked 0 default > > zroot feature@async_destroy enabled local > > zroot feature@empty_bpobj active local > > zroot feature@lz4_compress active local > > zroot feature@multi_vdev_crash_dump enabled local > > zroot feature@spacemap_histogram active local > > zroot feature@enabled_txg active local > > zroot feature@hole_birth active local > > zroot feature@extensible_dataset enabled local > > zroot feature@embedded_data active local > > zroot feature@bookmarks enabled local > > zroot feature@filesystem_limits enabled local > > zroot feature@large_blocks enabled local > > zroot feature@sha512 enabled local > > zroot feature@skein enabled local > > borg-new /home/ler $ > > > > > > > > On 01/31/2017 5:22 pm, Steven Hartland wrote: > > > > > Yep > > > > > > On 31/01/2017 21:49, Larry Rosenman wrote: > > > > > > > > revert the other patch and apply this one? > > > > > > > > > > > > > > > > On 01/31/2017 3:47 pm, Steven Hartland wrote: > > > > > > > > Hmm, looks like there's also a bug in the way vdev_min_asize is > > > > calculated for raidz as it can and has resulted in child > > > > min_asize which won't provided enough space for the parent due > > > > to the use of unrounded integer division. > > > > > > > > 1981411579221 * 6 = 11888469475326 < 11888469475328 > > > > > > > > You should have vdev_min_asize: 1981411579222 for your children. > > > > > > > > Updated patch attached, however calculation still isn't 100% > > > > reversible so may need work, however it does now ensure that the > > > > children will provide enough capacity for min_asize even if all > > > > of them are shrunk to their individual min_asize, which I > > > > believe previously may not have been the case. > > > > > > > > This isn't related to the incorrect EXPANDSZ output, but would > > > > be good if you could confirm it doesn't cause any issues for > > > > your pool given its state. > > > > > > > > On 31/01/2017 21:00, Larry Rosenman wrote: > > > > > > > > borg-new /home/ler $ sudo ./vdev-stats.d > > > > Password: > > > > vdev_path: n/a, vdev_max_asize: 0, vdev_asize: 0, > > > > vdev_min_asize: 0 > > > > vdev_path: n/a, vdev_max_asize: 11947471798272, vdev_asize: > > > > 11947478089728, vdev_min_asize: 11888469475328 > > > > vdev_path: /dev/mfid4p4, vdev_max_asize: 1991245299712, > > > > vdev_asize: 1991245299712, vdev_min_asize: 1981411579221 > > > > vdev_path: /dev/mfid0p4, vdev_max_asize: 1991246348288, > > > > vdev_asize: 1991246348288, vdev_min_asize: 1981411579221 > > > > vdev_path: /dev/mfid1p4, vdev_max_asize: 1991246348288, > > > > vdev_asize: 1991246348288, vdev_min_asize: 1981411579221 > > > > vdev_path: /dev/mfid3p4, vdev_max_asize: 1991247921152, > > > > vdev_asize: 1991247921152, vdev_min_asize: 1981411579221 > > > > vdev_path: /dev/mfid2p4, vdev_max_asize: 1991246348288, > > > > vdev_asize: 1991246348288, vdev_min_asize: 1981411579221 > > > > vdev_path: /dev/mfid5p4, vdev_max_asize: 1991246348288, > > > > vdev_asize: 1991246348288, vdev_min_asize: 1981411579221 > > > > ^C > > > > > > > > borg-new /home/ler $ > > > > > > > > > > > > borg-new /home/ler $ sudo zpool list -v > > > > Password: > > > > NAME SIZE ALLOC FREE EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT > > > > zroot 10.8T 94.3G 10.7T 16.0E 0% 0% 1.00x ONLINE - > > > > raidz1 10.8T 94.3G 10.7T 16.0E 0% 0% > > > > mfid4p4 - - - - - - > > > > mfid0p4 - - - - - - > > > > mfid1p4 - - - - - - > > > > mfid3p4 - - - - - - > > > > mfid2p4 - - - - - - > > > > mfid5p4 - - - - - - > > > > borg-new /home/ler $ > > > > > > > > > > > > On 01/31/2017 2:37 pm, Steven Hartland wrote: > > > > > > > > In that case based on your zpool history I suspect that > > > > the original mfid4p4 was the same size as mfid0p4 > > > > (1991246348288) but its been replaced with a drive which > > > > is (1991245299712), slightly smaller. > > > > > > > > This smaller size results in a max_asize of > > > > 1991245299712 * 6 instead of original 1991246348288* 6. > > > > > > > > Now given the way min_asize (the value used to check if > > > > the device size is acceptable) is rounded to the the > > > > nearest metaslab I believe that replace would be allowed. > > > > https://github.com/freebsd/freebsd/blob/master/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/spa.c#L4947 > > > > > > > > Now the problem is that on open the calculated asize is > > > > only updated if its expanding: > > > > https://github.com/freebsd/freebsd/blob/master/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/vdev.c#L1424 > > > > > > > > The updated dtrace file outputs vdev_min_asize which > > > > should confirm my suspicion about why the replace was > > > > allowed. > > > > > > > > On 31/01/2017 19:05, Larry Rosenman wrote: > > > > > > > > I've replaced some disks due to failure, and some of > > > > the pariition sizes are different. > > > > > > > > > > > > autoexpand is off: > > > > > > > > borg-new /home/ler $ zpool get all zroot > > > > NAME PROPERTY VALUE SOURCE > > > > zroot size 10.8T - > > > > zroot capacity 0% - > > > > zroot altroot - default > > > > zroot health ONLINE - > > > > zroot guid 11945658884309024932 default > > > > zroot version - default > > > > zroot bootfs zroot/ROOT/default local > > > > zroot delegation on default > > > > zroot autoreplace off default > > > > zroot cachefile - default > > > > zroot failmode wait default > > > > zroot listsnapshots off default > > > > zroot autoexpand off default > > > > zroot dedupditto 0 default > > > > zroot dedupratio 1.00x - > > > > zroot free 10.7T - > > > > zroot allocated 94.3G - > > > > zroot readonly off - > > > > zroot comment - default > > > > zroot expandsize 16.0E - > > > > zroot freeing 0 default > > > > zroot fragmentation 0% - > > > > zroot leaked 0 default > > > > zroot feature@async_destroy enabled local > > > > zroot feature@empty_bpobj active local > > > > zroot feature@lz4_compress active local > > > > zroot feature@multi_vdev_crash_dump enabled local > > > > zroot feature@spacemap_histogram active local > > > > zroot feature@enabled_txg active local > > > > zroot feature@hole_birth active local > > > > zroot feature@extensible_dataset enabled local > > > > zroot feature@embedded_data active local > > > > zroot feature@bookmarks enabled local > > > > zroot feature@filesystem_limits enabled local > > > > zroot feature@large_blocks enabled local > > > > zroot feature@sha512 enabled local > > > > zroot feature@skein enabled local > > > > borg-new /home/ler $ > > > > > > > > > > > > borg-new /home/ler $ gpart show > > > > => 40 3905945520 mfid0 GPT (1.8T) > > > > 40 1600 1 efi (800K) > > > > 1640 1024 2 freebsd-boot (512K) > > > > 2664 1432 - free - (716K) > > > > 4096 16777216 3 freebsd-swap (8.0G) > > > > 16781312 3889162240 4 freebsd-zfs (1.8T) > > > > 3905943552 2008 - free - (1.0M) > > > > > > > > => 40 3905945520 mfid1 GPT (1.8T) > > > > 40 1600 1 efi (800K) > > > > 1640 1024 2 freebsd-boot (512K) > > > > 2664 1432 - free - (716K) > > > > 4096 16777216 3 freebsd-swap (8.0G) > > > > 16781312 3889162240 4 freebsd-zfs (1.8T) > > > > 3905943552 2008 - free - (1.0M) > > > > > > > > => 40 3905945520 mfid2 GPT (1.8T) > > > > 40 1600 1 efi (800K) > > > > 1640 1024 2 freebsd-boot (512K) > > > > 2664 1432 - free - (716K) > > > > 4096 16777216 3 freebsd-swap (8.0G) > > > > 16781312 3889162240 4 freebsd-zfs (1.8T) > > > > 3905943552 2008 - free - (1.0M) > > > > > > > > => 40 3905945520 mfid3 GPT (1.8T) > > > > 40 1600 1 efi (800K) > > > > 1640 1024 2 freebsd-boot (512K) > > > > 2664 16777216 3 freebsd-swap (8.0G) > > > > 16779880 3889165680 4 freebsd-zfs (1.8T) > > > > > > > > => 40 3905945520 mfid5 GPT (1.8T) > > > > 40 1600 1 efi (800K) > > > > 1640 1024 2 freebsd-boot (512K) > > > > 2664 1432 - free - (716K) > > > > 4096 16777216 3 freebsd-swap (8.0G) > > > > 16781312 3889162240 4 freebsd-zfs (1.8T) > > > > 3905943552 2008 - free - (1.0M) > > > > > > > > => 40 3905945520 mfid4 GPT (1.8T) > > > > 40 1600 1 efi (800K) > > > > 1640 1024 2 freebsd-boot (512K) > > > > 2664 1432 - free - (716K) > > > > 4096 16777216 3 freebsd-swap (8.0G) > > > > 16781312 3889160192 4 freebsd-zfs (1.8T) > > > > 3905941504 4056 - free - (2.0M) > > > > > > > > borg-new /home/ler $ > > > > > > > > > > > > this system was built last week, and I **CAN** > > > > rebuild it if necessary, but I didn't do anything > > > > strange (so I thought :) ) > > > > > > > > > > > > > > > > > > > > On 01/31/2017 12:30 pm, Steven Hartland wrote: > > > > > > > > Your issue is the reported vdev_max_asize > > > > > vdev_asize: > > > > vdev_max_asize: 11947471798272 > > > > vdev_asize: 11947478089728 > > > > > > > > max asize is smaller than asize by 6291456 > > > > > > > > For raidz1 Xsize should be the smallest disk > > > > Xsize * disks so: > > > > 1991245299712 * 6 = 11947471798272 > > > > > > > > So your max asize looks right but asize looks > > > > too big > > > > > > > > Expand Size is calculated by: > > > > if (vd->vdev_aux == NULL && tvd != NULL && > > > > vd->vdev_max_asize != 0) { > > > > vs->vs_esize = P2ALIGN(vd->vdev_max_asize - > > > > vd->vdev_asize, > > > > 1ULL << tvd->vdev_ms_shift); > > > > } > > > > > > > > So the question is why is asize too big? > > > > > > > > Given you seem to have some random disk sizes do > > > > you have auto expand turned on? > > > > > > > > On 31/01/2017 17:39, Larry Rosenman wrote: > > > > > > > > vdev_path: n/a, vdev_max_asize: > > > > 11947471798272, vdev_asize: 11947478089728 > > > > > > > > > > > > -- Larry Rosenman > > > > http://people.freebsd.org/~ler > > > > > > > > Phone: +1 214-642-9640 E-Mail: > > > > ler@FreeBSD.org > > > > US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281 > > > > > > > > > > > > -- Larry Rosenman http://people.freebsd.org/~ler > > > > > > > > Phone: +1 214-642-9640 E-Mail: > > > > ler@FreeBSD.org > > > > US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281 > > > > > > > > > > > > -- > > > > Larry Rosenman http://people.freebsd.org/~ler > > > > > > > > Phone: +1 214-642-9640 E-Mail: ler@FreeBSD.org > > > > > > > > US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281 > > > > > > -- > > Larry Rosenman http://people.freebsd.org/~ler > > > > Phone: +1 214-642-9640 E-Mail: ler@FreeBSD.org > > > > US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281 > -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 E-Mail: ler@lerctr.org US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281 From owner-freebsd-fs@freebsd.org Sun Feb 5 21:00:53 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 91E97CD211A for ; Sun, 5 Feb 2017 21:00:53 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 7803E1989 for ; Sun, 5 Feb 2017 21:00:53 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v15L01kP016582 for ; Sun, 5 Feb 2017 21:00:53 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <201702052100.v15L01kP016582@kenobi.freebsd.org> From: bugzilla-noreply@FreeBSD.org To: freebsd-fs@FreeBSD.org Subject: Problem reports for freebsd-fs@FreeBSD.org that need special attention Date: Sun, 05 Feb 2017 21:00:53 +0000 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 05 Feb 2017 21:00:53 -0000 To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- New | 203492 | mount_unionfs -o below causes panic Open | 136470 | [nfs] Cannot mount / in read-only, over NFS Open | 139651 | [nfs] mount(8): read-only remount of NFS volume d Open | 140068 | [smbfs] [patch] smbfs does not allow semicolon in Open | 144447 | [zfs] sharenfs fsunshare() & fsshare_main() non f Open | 203419 | solaris assert: (dn->dn_phys->dn_nlevels == 0 && Open | 211491 | System hangs after "Uptime" on reboot with ZFS 7 problems total for which you should take action. From owner-freebsd-fs@freebsd.org Sun Feb 5 23:16:32 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 623C9CD2F79 for ; Sun, 5 Feb 2017 23:16:32 +0000 (UTC) (envelope-from killing@multiplay.co.uk) Received: from mail-wr0-x230.google.com (mail-wr0-x230.google.com [IPv6:2a00:1450:400c:c0c::230]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id BB2DB1141 for ; Sun, 5 Feb 2017 23:16:31 +0000 (UTC) (envelope-from killing@multiplay.co.uk) Received: by mail-wr0-x230.google.com with SMTP id o16so15245982wra.1 for ; Sun, 05 Feb 2017 15:16:31 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=multiplay-co-uk.20150623.gappssmtp.com; s=20150623; h=subject:to:references:from:message-id:date:user-agent:mime-version :in-reply-to; bh=+gIRzp2ACy5SiJ1RKKYv8P3aEF80pPqNC/qcGHrSFJ4=; b=BuMTzCxeRb/8M8QC/WaY44RD3uLPW8PsJz7ceMqliYnFJLkbP+IJIXIOvPn7lE9uNu et7VD4TYlOEpOaBN7H0hivbX5XwkF9tO63I/DMjTwe7J3N5XpAxh6uuYur8RxTGWSMdP EO6QtjlKiClVFsbp0M+KgENiWZou8WlWLrjVBbVSPE9QhOa5jLYu3D2LACbkcDr6FoYN 5pvn2IXkK7qslWypGWFMLnsaKLL5F1e+xynDHzJzzKiFCqRLszNOBNfDJVKU6Xr8j/ix O1fYhMUYAyAX4cfgVNIXA247yM5U4bug5pauoi1SaOvftik3JnpqMTA01hWcuaau3lK1 2l4Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:references:from:message-id:date :user-agent:mime-version:in-reply-to; bh=+gIRzp2ACy5SiJ1RKKYv8P3aEF80pPqNC/qcGHrSFJ4=; b=XMZgvoJ0XGuoXCNvCwBFodpz2hEhDJPoKDHWWnR4T6YI4eTDhH3KkLM4Fzd3R1yqOz jfAexq57W9fvLTaV5kDSfIWesdlid8KuuZEilvn6BxpzVWvmETvFOCHhXJaAJ7C7Dk1y klx5JX5QuFv8KVla85wrLM41SBQ0lF20q+R2NJdEZjBWNniTX7MGFZMLvCBZwCjLfjZ5 WKxKW+oPE9fh5pZnY25tgP4imzhOs/NZJ3CdHdKmJ2pcfuWfCV7bTo44NbkgCmDJd+/J Ct1rgdj0DD2LPzMduSCVF0WVNwdQAbRNZUZesu5hbt+ibF9/JmNKtLHfzqlt04MM/Ru+ 2G/A== X-Gm-Message-State: AIkVDXKvt0a4pWQJ58RznCDYOpP5CZsm3QeK1yInTjmAgY80S+SRXB/rEY/zj/wwwj+KN1bP X-Received: by 10.223.160.14 with SMTP id k14mr7894765wrk.69.1486336588678; Sun, 05 Feb 2017 15:16:28 -0800 (PST) Received: from [10.10.1.58] ([185.97.61.26]) by smtp.gmail.com with ESMTPSA id y145sm9491598wmc.17.2017.02.05.15.16.27 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Sun, 05 Feb 2017 15:16:27 -0800 (PST) Subject: Re: 16.0E ExpandSize? -- New Server To: Larry Rosenman , Freebsd fs References: <22e1bfc5840d972cf93643733682cda1@FreeBSD.org> <8a710dc75c129f58b0372eeaeca575b5@FreeBSD.org> <96534515-4fcb-774e-a599-8d48aec930cd@multiplay.co.uk> <8387d38f-3185-8c07-396b-602c708002a6@multiplay.co.uk> <20170205035438.6gc2ybg6otidzpaz@borg.lerctr.org> From: Steven Hartland Message-ID: <3691c96a-97c4-6bd1-80b5-02cd929cd219@multiplay.co.uk> Date: Sun, 5 Feb 2017 23:16:27 +0000 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.7.0 MIME-Version: 1.0 In-Reply-To: <20170205035438.6gc2ybg6otidzpaz@borg.lerctr.org> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 05 Feb 2017 23:16:32 -0000 Its still actually waiting on review, the merged icon at the bottom was for an unrelated PR which reference mine as they saw the same random test failure as I did. On 05/02/2017 03:54, Larry Rosenman wrote: > I saw it was accepted upstream. Can it be committed to FreeBSD? > > > On Wed, Feb 01, 2017 at 02:43:51AM +0000, Steven Hartland wrote: >> Thanks I've put a PR in upstream to get some eyes on the fix. >> https://github.com/openzfs/openzfs/pull/296 >> >> If no objections are raised to the approach I've used I'll commit the fix to >> HEAD too. >> >> On 01/02/2017 02:31, Larry Rosenman wrote: >>> no grief that I can see: >>> >>> borg-new /home/ler $ sudo zdb >>> Password: >>> zroot: >>> version: 5000 >>> name: 'zroot' >>> state: 0 >>> txg: 96143 >>> pool_guid: 11945658884309024932 >>> hostid: 3619181042 >>> hostname: '' >>> com.delphix:has_per_vdev_zaps >>> vdev_children: 1 >>> vdev_tree: >>> type: 'root' >>> id: 0 >>> guid: 11945658884309024932 >>> create_txg: 4 >>> children[0]: >>> type: 'raidz' >>> id: 0 >>> guid: 7596925654112466913 >>> nparity: 1 >>> metaslab_array: 42 >>> metaslab_shift: 36 >>> ashift: 12 >>> asize: 11947471798272 >>> is_log: 0 >>> create_txg: 4 >>> com.delphix:vdev_zap_top: 35 >>> children[0]: >>> type: 'disk' >>> id: 0 >>> guid: 1443238581175429852 >>> path: '/dev/mfid4p4' >>> whole_disk: 1 >>> DTL: 137 >>> create_txg: 4 >>> com.delphix:vdev_zap_leaf: 131 >>> children[1]: >>> type: 'disk' >>> id: 1 >>> guid: 1865792721003775978 >>> path: '/dev/mfid0p4' >>> whole_disk: 1 >>> DTL: 133 >>> create_txg: 4 >>> com.delphix:vdev_zap_leaf: 37 >>> children[2]: >>> type: 'disk' >>> id: 2 >>> guid: 12541720522827927342 >>> path: '/dev/mfid1p4' >>> whole_disk: 1 >>> DTL: 132 >>> create_txg: 4 >>> com.delphix:vdev_zap_leaf: 38 >>> children[3]: >>> type: 'disk' >>> id: 3 >>> guid: 13053934791777776444 >>> path: '/dev/mfid3p4' >>> whole_disk: 1 >>> DTL: 136 >>> create_txg: 4 >>> com.delphix:vdev_zap_leaf: 135 >>> children[4]: >>> type: 'disk' >>> id: 4 >>> guid: 4432707573898874857 >>> path: '/dev/mfid2p4' >>> whole_disk: 1 >>> DTL: 130 >>> create_txg: 4 >>> com.delphix:vdev_zap_leaf: 40 >>> children[5]: >>> type: 'disk' >>> id: 5 >>> guid: 5106293125005422556 >>> path: '/dev/mfid5p4' >>> whole_disk: 1 >>> DTL: 129 >>> create_txg: 4 >>> com.delphix:vdev_zap_leaf: 41 >>> features_for_read: >>> com.delphix:hole_birth >>> com.delphix:embedded_data >>> borg-new /home/ler $ sudo zpool list -v >>> NAME SIZE ALLOC FREE EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT >>> zroot 10.8T 94.3G 10.7T - 0% 0% 1.00x ONLINE - >>> raidz1 10.8T 94.3G 10.7T - 0% 0% >>> mfid4p4 - - - - - - >>> mfid0p4 - - - - - - >>> mfid1p4 - - - - - - >>> mfid3p4 - - - - - - >>> mfid2p4 - - - - - - >>> mfid5p4 - - - - - - >>> borg-new /home/ler $ sudo zpool get all >>> NAME PROPERTY VALUE SOURCE >>> zroot size 10.8T - >>> zroot capacity 0% - >>> zroot altroot - default >>> zroot health ONLINE - >>> zroot guid 11945658884309024932 default >>> zroot version - default >>> zroot bootfs zroot/ROOT/default local >>> zroot delegation on default >>> zroot autoreplace off default >>> zroot cachefile - default >>> zroot failmode wait default >>> zroot listsnapshots off default >>> zroot autoexpand off default >>> zroot dedupditto 0 default >>> zroot dedupratio 1.00x - >>> zroot free 10.7T - >>> zroot allocated 94.3G - >>> zroot readonly off - >>> zroot comment - default >>> zroot expandsize - - >>> zroot freeing 0 default >>> zroot fragmentation 0% - >>> zroot leaked 0 default >>> zroot feature@async_destroy enabled local >>> zroot feature@empty_bpobj active local >>> zroot feature@lz4_compress active local >>> zroot feature@multi_vdev_crash_dump enabled local >>> zroot feature@spacemap_histogram active local >>> zroot feature@enabled_txg active local >>> zroot feature@hole_birth active local >>> zroot feature@extensible_dataset enabled local >>> zroot feature@embedded_data active local >>> zroot feature@bookmarks enabled local >>> zroot feature@filesystem_limits enabled local >>> zroot feature@large_blocks enabled local >>> zroot feature@sha512 enabled local >>> zroot feature@skein enabled local >>> borg-new /home/ler $ >>> >>> >>> >>> On 01/31/2017 5:22 pm, Steven Hartland wrote: >>> >>>> Yep >>>> >>>> On 31/01/2017 21:49, Larry Rosenman wrote: >>>>> revert the other patch and apply this one? >>>>> >>>>> >>>>> >>>>> On 01/31/2017 3:47 pm, Steven Hartland wrote: >>>>> >>>>> Hmm, looks like there's also a bug in the way vdev_min_asize is >>>>> calculated for raidz as it can and has resulted in child >>>>> min_asize which won't provided enough space for the parent due >>>>> to the use of unrounded integer division. >>>>> >>>>> 1981411579221 * 6 = 11888469475326 < 11888469475328 >>>>> >>>>> You should have vdev_min_asize: 1981411579222 for your children. >>>>> >>>>> Updated patch attached, however calculation still isn't 100% >>>>> reversible so may need work, however it does now ensure that the >>>>> children will provide enough capacity for min_asize even if all >>>>> of them are shrunk to their individual min_asize, which I >>>>> believe previously may not have been the case. >>>>> >>>>> This isn't related to the incorrect EXPANDSZ output, but would >>>>> be good if you could confirm it doesn't cause any issues for >>>>> your pool given its state. >>>>> >>>>> On 31/01/2017 21:00, Larry Rosenman wrote: >>>>> >>>>> borg-new /home/ler $ sudo ./vdev-stats.d >>>>> Password: >>>>> vdev_path: n/a, vdev_max_asize: 0, vdev_asize: 0, >>>>> vdev_min_asize: 0 >>>>> vdev_path: n/a, vdev_max_asize: 11947471798272, vdev_asize: >>>>> 11947478089728, vdev_min_asize: 11888469475328 >>>>> vdev_path: /dev/mfid4p4, vdev_max_asize: 1991245299712, >>>>> vdev_asize: 1991245299712, vdev_min_asize: 1981411579221 >>>>> vdev_path: /dev/mfid0p4, vdev_max_asize: 1991246348288, >>>>> vdev_asize: 1991246348288, vdev_min_asize: 1981411579221 >>>>> vdev_path: /dev/mfid1p4, vdev_max_asize: 1991246348288, >>>>> vdev_asize: 1991246348288, vdev_min_asize: 1981411579221 >>>>> vdev_path: /dev/mfid3p4, vdev_max_asize: 1991247921152, >>>>> vdev_asize: 1991247921152, vdev_min_asize: 1981411579221 >>>>> vdev_path: /dev/mfid2p4, vdev_max_asize: 1991246348288, >>>>> vdev_asize: 1991246348288, vdev_min_asize: 1981411579221 >>>>> vdev_path: /dev/mfid5p4, vdev_max_asize: 1991246348288, >>>>> vdev_asize: 1991246348288, vdev_min_asize: 1981411579221 >>>>> ^C >>>>> >>>>> borg-new /home/ler $ >>>>> >>>>> >>>>> borg-new /home/ler $ sudo zpool list -v >>>>> Password: >>>>> NAME SIZE ALLOC FREE EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT >>>>> zroot 10.8T 94.3G 10.7T 16.0E 0% 0% 1.00x ONLINE - >>>>> raidz1 10.8T 94.3G 10.7T 16.0E 0% 0% >>>>> mfid4p4 - - - - - - >>>>> mfid0p4 - - - - - - >>>>> mfid1p4 - - - - - - >>>>> mfid3p4 - - - - - - >>>>> mfid2p4 - - - - - - >>>>> mfid5p4 - - - - - - >>>>> borg-new /home/ler $ >>>>> >>>>> >>>>> On 01/31/2017 2:37 pm, Steven Hartland wrote: >>>>> >>>>> In that case based on your zpool history I suspect that >>>>> the original mfid4p4 was the same size as mfid0p4 >>>>> (1991246348288) but its been replaced with a drive which >>>>> is (1991245299712), slightly smaller. >>>>> >>>>> This smaller size results in a max_asize of >>>>> 1991245299712 * 6 instead of original 1991246348288* 6. >>>>> >>>>> Now given the way min_asize (the value used to check if >>>>> the device size is acceptable) is rounded to the the >>>>> nearest metaslab I believe that replace would be allowed. >>>>> https://github.com/freebsd/freebsd/blob/master/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/spa.c#L4947 >>>>> >>>>> Now the problem is that on open the calculated asize is >>>>> only updated if its expanding: >>>>> https://github.com/freebsd/freebsd/blob/master/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/vdev.c#L1424 >>>>> >>>>> The updated dtrace file outputs vdev_min_asize which >>>>> should confirm my suspicion about why the replace was >>>>> allowed. >>>>> >>>>> On 31/01/2017 19:05, Larry Rosenman wrote: >>>>> >>>>> I've replaced some disks due to failure, and some of >>>>> the pariition sizes are different. >>>>> >>>>> >>>>> autoexpand is off: >>>>> >>>>> borg-new /home/ler $ zpool get all zroot >>>>> NAME PROPERTY VALUE SOURCE >>>>> zroot size 10.8T - >>>>> zroot capacity 0% - >>>>> zroot altroot - default >>>>> zroot health ONLINE - >>>>> zroot guid 11945658884309024932 default >>>>> zroot version - default >>>>> zroot bootfs zroot/ROOT/default local >>>>> zroot delegation on default >>>>> zroot autoreplace off default >>>>> zroot cachefile - default >>>>> zroot failmode wait default >>>>> zroot listsnapshots off default >>>>> zroot autoexpand off default >>>>> zroot dedupditto 0 default >>>>> zroot dedupratio 1.00x - >>>>> zroot free 10.7T - >>>>> zroot allocated 94.3G - >>>>> zroot readonly off - >>>>> zroot comment - default >>>>> zroot expandsize 16.0E - >>>>> zroot freeing 0 default >>>>> zroot fragmentation 0% - >>>>> zroot leaked 0 default >>>>> zroot feature@async_destroy enabled local >>>>> zroot feature@empty_bpobj active local >>>>> zroot feature@lz4_compress active local >>>>> zroot feature@multi_vdev_crash_dump enabled local >>>>> zroot feature@spacemap_histogram active local >>>>> zroot feature@enabled_txg active local >>>>> zroot feature@hole_birth active local >>>>> zroot feature@extensible_dataset enabled local >>>>> zroot feature@embedded_data active local >>>>> zroot feature@bookmarks enabled local >>>>> zroot feature@filesystem_limits enabled local >>>>> zroot feature@large_blocks enabled local >>>>> zroot feature@sha512 enabled local >>>>> zroot feature@skein enabled local >>>>> borg-new /home/ler $ >>>>> >>>>> >>>>> borg-new /home/ler $ gpart show >>>>> => 40 3905945520 mfid0 GPT (1.8T) >>>>> 40 1600 1 efi (800K) >>>>> 1640 1024 2 freebsd-boot (512K) >>>>> 2664 1432 - free - (716K) >>>>> 4096 16777216 3 freebsd-swap (8.0G) >>>>> 16781312 3889162240 4 freebsd-zfs (1.8T) >>>>> 3905943552 2008 - free - (1.0M) >>>>> >>>>> => 40 3905945520 mfid1 GPT (1.8T) >>>>> 40 1600 1 efi (800K) >>>>> 1640 1024 2 freebsd-boot (512K) >>>>> 2664 1432 - free - (716K) >>>>> 4096 16777216 3 freebsd-swap (8.0G) >>>>> 16781312 3889162240 4 freebsd-zfs (1.8T) >>>>> 3905943552 2008 - free - (1.0M) >>>>> >>>>> => 40 3905945520 mfid2 GPT (1.8T) >>>>> 40 1600 1 efi (800K) >>>>> 1640 1024 2 freebsd-boot (512K) >>>>> 2664 1432 - free - (716K) >>>>> 4096 16777216 3 freebsd-swap (8.0G) >>>>> 16781312 3889162240 4 freebsd-zfs (1.8T) >>>>> 3905943552 2008 - free - (1.0M) >>>>> >>>>> => 40 3905945520 mfid3 GPT (1.8T) >>>>> 40 1600 1 efi (800K) >>>>> 1640 1024 2 freebsd-boot (512K) >>>>> 2664 16777216 3 freebsd-swap (8.0G) >>>>> 16779880 3889165680 4 freebsd-zfs (1.8T) >>>>> >>>>> => 40 3905945520 mfid5 GPT (1.8T) >>>>> 40 1600 1 efi (800K) >>>>> 1640 1024 2 freebsd-boot (512K) >>>>> 2664 1432 - free - (716K) >>>>> 4096 16777216 3 freebsd-swap (8.0G) >>>>> 16781312 3889162240 4 freebsd-zfs (1.8T) >>>>> 3905943552 2008 - free - (1.0M) >>>>> >>>>> => 40 3905945520 mfid4 GPT (1.8T) >>>>> 40 1600 1 efi (800K) >>>>> 1640 1024 2 freebsd-boot (512K) >>>>> 2664 1432 - free - (716K) >>>>> 4096 16777216 3 freebsd-swap (8.0G) >>>>> 16781312 3889160192 4 freebsd-zfs (1.8T) >>>>> 3905941504 4056 - free - (2.0M) >>>>> >>>>> borg-new /home/ler $ >>>>> >>>>> >>>>> this system was built last week, and I **CAN** >>>>> rebuild it if necessary, but I didn't do anything >>>>> strange (so I thought :) ) >>>>> >>>>> >>>>> >>>>> >>>>> On 01/31/2017 12:30 pm, Steven Hartland wrote: >>>>> >>>>> Your issue is the reported vdev_max_asize > >>>>> vdev_asize: >>>>> vdev_max_asize: 11947471798272 >>>>> vdev_asize: 11947478089728 >>>>> >>>>> max asize is smaller than asize by 6291456 >>>>> >>>>> For raidz1 Xsize should be the smallest disk >>>>> Xsize * disks so: >>>>> 1991245299712 * 6 = 11947471798272 >>>>> >>>>> So your max asize looks right but asize looks >>>>> too big >>>>> >>>>> Expand Size is calculated by: >>>>> if (vd->vdev_aux == NULL && tvd != NULL && >>>>> vd->vdev_max_asize != 0) { >>>>> vs->vs_esize = P2ALIGN(vd->vdev_max_asize - >>>>> vd->vdev_asize, >>>>> 1ULL << tvd->vdev_ms_shift); >>>>> } >>>>> >>>>> So the question is why is asize too big? >>>>> >>>>> Given you seem to have some random disk sizes do >>>>> you have auto expand turned on? >>>>> >>>>> On 31/01/2017 17:39, Larry Rosenman wrote: >>>>> >>>>> vdev_path: n/a, vdev_max_asize: >>>>> 11947471798272, vdev_asize: 11947478089728 >>>>> >>>>> >>>>> -- Larry Rosenman >>>>> http://people.freebsd.org/~ler >>>>> >>>>> Phone: +1 214-642-9640 E-Mail: >>>>> ler@FreeBSD.org >>>>> US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281 >>>>> >>>>> >>>>> -- Larry Rosenman http://people.freebsd.org/~ler >>>>> >>>>> Phone: +1 214-642-9640 E-Mail: >>>>> ler@FreeBSD.org >>>>> US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281 >>>>> >>>>> >>>>> -- >>>>> Larry Rosenman http://people.freebsd.org/~ler >>>>> >>>>> Phone: +1 214-642-9640 E-Mail: ler@FreeBSD.org >>>>> >>>>> US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281 >>> >>> -- >>> Larry Rosenman http://people.freebsd.org/~ler >>> >>> Phone: +1 214-642-9640 E-Mail: ler@FreeBSD.org >>> >>> US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281 From owner-freebsd-fs@freebsd.org Tue Feb 7 14:08:51 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BDE5ECD5899 for ; Tue, 7 Feb 2017 14:08:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id AE02C1F83 for ; Tue, 7 Feb 2017 14:08:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v17E8kq7074194 for ; Tue, 7 Feb 2017 14:08:51 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 199189] SWAP on ZFS can crash server Date: Tue, 07 Feb 2017 14:08:46 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: deadelk@deadelk.name X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 07 Feb 2017 14:08:51 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D199189 deadelk@deadelk.name changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |deadelk@deadelk.name --- Comment #23 from deadelk@deadelk.name --- confirm that swaping to zfs with default sysctl is a bad idea in production= ...=20 just run perl-script and look to 'top' in another vty --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Tue Feb 7 14:10:40 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id CA792CD5924 for ; Tue, 7 Feb 2017 14:10:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id BA8E5E2 for ; Tue, 7 Feb 2017 14:10:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v17EAdjE078968 for ; Tue, 7 Feb 2017 14:10:40 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 199189] SWAP on ZFS can crash server Date: Tue, 07 Feb 2017 14:10:40 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: deadelk@deadelk.name X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 07 Feb 2017 14:10:40 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D199189 --- Comment #24 from deadelk@deadelk.name --- (In reply to deadelk from comment #23) freebsd11=20 time taken to kill the app is about 5 minutes --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Tue Feb 7 14:38:43 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A393ACD5F28 for ; Tue, 7 Feb 2017 14:38:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 939C01295 for ; Tue, 7 Feb 2017 14:38:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v17Ech8B059600 for ; Tue, 7 Feb 2017 14:38:43 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 199189] SWAP on ZFS can crash server Date: Tue, 07 Feb 2017 14:38:43 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: deadelk@deadelk.name X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 07 Feb 2017 14:38:43 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D199189 --- Comment #25 from deadelk@deadelk.name --- (In reply to deadelk from comment #24) you can try to lower ARC=20 i think it's too much to take all memory for ARC by default=20 why??? for what???=20 vfs.zfs.arc_max=3D"512M" just working identically (speed) on 1GB RAM server and on 8GB RAM server --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Tue Feb 7 22:01:54 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BE88ECD5D33 for ; Tue, 7 Feb 2017 22:01:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id AE6871C4C for ; Tue, 7 Feb 2017 22:01:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v17M1s70017498 for ; Tue, 7 Feb 2017 22:01:54 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 216178] ZFS ARC and L2ARC are unrealistically large, maybe after r307265 Date: Tue, 07 Feb 2017 22:01:54 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: avg@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 07 Feb 2017 22:01:54 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D216178 --- Comment #3 from Andriy Gapon --- Lev, I couldn't reproduce your problem using FreeBSD head and a similar configuration (raidz + l2arc) and couldn't reproduce the problem with L2ARC accounting as much I tried. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Tue Feb 7 22:04:14 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C89F2CD5E03 for ; Tue, 7 Feb 2017 22:04:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id B809D1EBB for ; Tue, 7 Feb 2017 22:04:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v17M4ETF023006 for ; Tue, 7 Feb 2017 22:04:14 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 216364] ZFS ARC cache is duplicating data? The cache size gets bigger then the pool. Date: Tue, 07 Feb 2017 22:04:14 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: 11.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: avg@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 07 Feb 2017 22:04:14 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D216364 Andriy Gapon changed: What |Removed |Added ---------------------------------------------------------------------------- Status|New |Open CC| |avg@FreeBSD.org --- Comment #3 from Andriy Gapon --- I was able to reproduce the symptoms where the reported ARC size could grow beyond the RAM size and the pool size. I think I see an accounting leak in= the code. I will offer a patch later. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Tue Feb 7 22:06:41 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 86EB0CD5EBB for ; Tue, 7 Feb 2017 22:06:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 6FBE51FA3 for ; Tue, 7 Feb 2017 22:06:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v17M6eGs027311 for ; Tue, 7 Feb 2017 22:06:41 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 216364] ZFS ARC cache is duplicating data? The cache size gets bigger then the pool. Date: Tue, 07 Feb 2017 22:06:41 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: 11.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: avg@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 07 Feb 2017 22:06:41 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D216364 --- Comment #4 from Andriy Gapon --- (In reply to k_georgiev from comment #0) Just to clarify, does your pool contain a cache (l2arc) device? There could be more than one problem. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Wed Feb 8 09:19:40 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DEF94CD5474 for ; Wed, 8 Feb 2017 09:19:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id CE80B19C6 for ; Wed, 8 Feb 2017 09:19:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v189JejU017431 for ; Wed, 8 Feb 2017 09:19:40 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 216364] ZFS ARC cache is duplicating data? The cache size gets bigger then the pool. Date: Wed, 08 Feb 2017 09:19:40 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: 11.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: k_georgiev@deltanews.bg X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 08 Feb 2017 09:19:41 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D216364 --- Comment #5 from k_georgiev@deltanews.bg --- No,=20 No cache device, no log device. It is a VMware virtual machine if that should matter. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Wed Feb 8 09:50:29 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D4EDFCD5EB6 for ; Wed, 8 Feb 2017 09:50:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id C48DF10FE for ; Wed, 8 Feb 2017 09:50:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v189oTx4092551 for ; Wed, 8 Feb 2017 09:50:29 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 216364] ZFS ARC cache is duplicating data? The cache size gets bigger then the pool. Date: Wed, 08 Feb 2017 09:50:29 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: 11.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: avg@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 08 Feb 2017 09:50:29 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D216364 --- Comment #6 from Andriy Gapon --- (In reply to k_georgiev from comment #5) Another question, do you have any filesystems with compression enabled in t= he pool? Could you please capture output of sysctl kstat.zfs.misc.arcstats next time= you see this large ARC size? --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Wed Feb 8 10:28:13 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A9D76CD5C19 for ; Wed, 8 Feb 2017 10:28:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 98503B6A for ; Wed, 8 Feb 2017 10:28:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v18ASD5p011905 for ; Wed, 8 Feb 2017 10:28:13 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 216364] ZFS ARC cache is duplicating data? The cache size gets bigger then the pool. Date: Wed, 08 Feb 2017 10:28:13 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: 11.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: k_georgiev@deltanews.bg X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 08 Feb 2017 10:28:13 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D216364 --- Comment #7 from k_georgiev@deltanews.bg --- Hello,=20 There's a compression stats: for i in `zfs list |awk -F ' ' '{print $1}' |grep -v NAME`; do zfs get compression $i |tail -n 1; zfs get compressratio $i |tail -n 1; echo '----------' ; done; zroot compression lz4 local zroot compressratio 3.74x - ---------- zroot/ROOT compression lz4 inherited from zroot zroot/ROOT compressratio 1.89x - ---------- zroot/ROOT/default compression lz4 inherited from zroot zroot/ROOT/default compressratio 1.89x - ---------- zroot/tmp compression lz4 inherited from zroot zroot/tmp compressratio 4.57x - ---------- zroot/usr compression lz4 inherited from zroot zroot/usr compressratio 2.37x - ---------- zroot/usr/home compression lz4 inherited from zroot zroot/usr/home compressratio 1.01x - ---------- zroot/usr/ports compression lz4 inherited from zroot zroot/usr/ports compressratio 2.23x - ---------- zroot/usr/src compression lz4 inherited from zroot zroot/usr/src compressratio 2.46x - ---------- zroot/var compression lz4 inherited from zroot zroot/var compressratio 6.53x - ---------- zroot/var/audit compression lz4 inherited from zroot zroot/var/audit compressratio 1.00x - ---------- zroot/var/crash compression lz4 inherited from zroot zroot/var/crash compressratio 1.05x - ---------- zroot/var/log compression lz4 inherited from zroot zroot/var/log compressratio 6.64x - ---------- zroot/var/mail compression lz4 inherited from zroot zroot/var/mail compressratio 1.00x - ---------- zroot/var/tmp compression lz4 inherited from zroot zroot/var/tmp compressratio 1.50x - ---------- Currently the cache size is not larger than the pool size, but it is still a lot larger than the allocated data so I don't know if this will do the job = for you. This is the current situation: root@varnish:~ # zpool list NAME SIZE ALLOC FREE EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT zroot 5.97G 2.87G 3.10G - 73% 48% 1.00x ONLINE - ARC: 5730M Total, 75M MFU, 5242M MRU, 1060K Anon, 22M Header, 391M Other And the statistics you requested: root@varnish:~ # sysctl kstat.zfs.misc.arcstats=20 kstat.zfs.misc.arcstats.demand_hit_predictive_prefetch: 1139 kstat.zfs.misc.arcstats.sync_wait_for_async: 97 kstat.zfs.misc.arcstats.arc_meta_min: 975210240 kstat.zfs.misc.arcstats.arc_meta_max: 719384968 kstat.zfs.misc.arcstats.arc_meta_limit: 3900840960 kstat.zfs.misc.arcstats.arc_meta_used: 719067792 kstat.zfs.misc.arcstats.duplicate_reads: 2495 kstat.zfs.misc.arcstats.duplicate_buffers_size: 0 kstat.zfs.misc.arcstats.duplicate_buffers: 0 kstat.zfs.misc.arcstats.memory_throttle_count: 0 kstat.zfs.misc.arcstats.l2_write_buffer_list_null_iter: 0 kstat.zfs.misc.arcstats.l2_write_buffer_list_iter: 0 kstat.zfs.misc.arcstats.l2_write_buffer_bytes_scanned: 0 kstat.zfs.misc.arcstats.l2_write_pios: 0 kstat.zfs.misc.arcstats.l2_write_buffer_iter: 0 kstat.zfs.misc.arcstats.l2_write_full: 0 kstat.zfs.misc.arcstats.l2_write_not_cacheable: 1 kstat.zfs.misc.arcstats.l2_write_io_in_progress: 0 kstat.zfs.misc.arcstats.l2_write_in_l2: 0 kstat.zfs.misc.arcstats.l2_write_spa_mismatch: 0 kstat.zfs.misc.arcstats.l2_write_passed_headroom: 0 kstat.zfs.misc.arcstats.l2_write_trylock_fail: 0 kstat.zfs.misc.arcstats.l2_padding_needed: 0 kstat.zfs.misc.arcstats.l2_compress_failures: 0 kstat.zfs.misc.arcstats.l2_compress_zeros: 0 kstat.zfs.misc.arcstats.l2_compress_successes: 0 kstat.zfs.misc.arcstats.l2_hdr_size: 0 kstat.zfs.misc.arcstats.l2_asize: 0 kstat.zfs.misc.arcstats.l2_size: 0 kstat.zfs.misc.arcstats.l2_io_error: 0 kstat.zfs.misc.arcstats.l2_cksum_bad: 0 kstat.zfs.misc.arcstats.l2_abort_lowmem: 0 kstat.zfs.misc.arcstats.l2_cdata_free_on_write: 0 kstat.zfs.misc.arcstats.l2_free_on_write: 0 kstat.zfs.misc.arcstats.l2_evict_l1cached: 0 kstat.zfs.misc.arcstats.l2_evict_reading: 0 kstat.zfs.misc.arcstats.l2_evict_lock_retry: 0 kstat.zfs.misc.arcstats.l2_writes_lock_retry: 0 kstat.zfs.misc.arcstats.l2_writes_error: 0 kstat.zfs.misc.arcstats.l2_writes_done: 0 kstat.zfs.misc.arcstats.l2_writes_sent: 0 kstat.zfs.misc.arcstats.l2_write_bytes: 0 kstat.zfs.misc.arcstats.l2_read_bytes: 0 kstat.zfs.misc.arcstats.l2_rw_clash: 0 kstat.zfs.misc.arcstats.l2_feeds: 0 kstat.zfs.misc.arcstats.l2_misses: 0 kstat.zfs.misc.arcstats.l2_hits: 0 kstat.zfs.misc.arcstats.mfu_ghost_evictable_metadata: 0 kstat.zfs.misc.arcstats.mfu_ghost_evictable_data: 0 kstat.zfs.misc.arcstats.mfu_ghost_size: 0 kstat.zfs.misc.arcstats.mfu_evictable_metadata: 11820032 kstat.zfs.misc.arcstats.mfu_evictable_data: 66081280 kstat.zfs.misc.arcstats.mfu_size: 78476800 kstat.zfs.misc.arcstats.mru_ghost_evictable_metadata: 0 kstat.zfs.misc.arcstats.mru_ghost_evictable_data: 0 kstat.zfs.misc.arcstats.mru_ghost_size: 0 kstat.zfs.misc.arcstats.mru_evictable_metadata: 95819264 kstat.zfs.misc.arcstats.mru_evictable_data: 5226756608 kstat.zfs.misc.arcstats.mru_size: 5500123136 kstat.zfs.misc.arcstats.anon_evictable_metadata: 0 kstat.zfs.misc.arcstats.anon_evictable_data: 0 kstat.zfs.misc.arcstats.anon_size: 1070080 kstat.zfs.misc.arcstats.other_size: 409599856 kstat.zfs.misc.arcstats.metadata_size: 286570496 kstat.zfs.misc.arcstats.data_size: 5293100032 kstat.zfs.misc.arcstats.hdr_size: 22897440 kstat.zfs.misc.arcstats.size: 6012167824 kstat.zfs.misc.arcstats.c_max: 15603363840 kstat.zfs.misc.arcstats.c_min: 1950420480 kstat.zfs.misc.arcstats.c: 15603363840 kstat.zfs.misc.arcstats.p: 7801681920 kstat.zfs.misc.arcstats.hash_chain_max: 3 kstat.zfs.misc.arcstats.hash_chains: 1290 kstat.zfs.misc.arcstats.hash_collisions: 156194 kstat.zfs.misc.arcstats.hash_elements_max: 79495 kstat.zfs.misc.arcstats.hash_elements: 79489 kstat.zfs.misc.arcstats.evict_l2_skip: 0 kstat.zfs.misc.arcstats.evict_l2_ineligible: 2048 kstat.zfs.misc.arcstats.evict_l2_eligible: 67584 kstat.zfs.misc.arcstats.evict_l2_cached: 0 kstat.zfs.misc.arcstats.evict_not_enough: 0 kstat.zfs.misc.arcstats.evict_skip: 1 kstat.zfs.misc.arcstats.mutex_miss: 0 kstat.zfs.misc.arcstats.deleted: 8 kstat.zfs.misc.arcstats.allocated: 9883033 kstat.zfs.misc.arcstats.mfu_ghost_hits: 0 kstat.zfs.misc.arcstats.mfu_hits: 6223489 kstat.zfs.misc.arcstats.mru_ghost_hits: 0 kstat.zfs.misc.arcstats.mru_hits: 1746472 kstat.zfs.misc.arcstats.prefetch_metadata_misses: 9869 kstat.zfs.misc.arcstats.prefetch_metadata_hits: 13974 kstat.zfs.misc.arcstats.prefetch_data_misses: 89 kstat.zfs.misc.arcstats.prefetch_data_hits: 1 kstat.zfs.misc.arcstats.demand_metadata_misses: 3949342 kstat.zfs.misc.arcstats.demand_metadata_hits: 7185451 kstat.zfs.misc.arcstats.demand_data_misses: 123344 kstat.zfs.misc.arcstats.demand_data_hits: 784508 kstat.zfs.misc.arcstats.misses: 4082644 kstat.zfs.misc.arcstats.hits: 7983934 Hope this helps Thanks --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Wed Feb 8 11:10:59 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 635FECD655F for ; Wed, 8 Feb 2017 11:10:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 49A331E07 for ; Wed, 8 Feb 2017 11:10:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v18BAxnJ035343 for ; Wed, 8 Feb 2017 11:10:59 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 216364] ZFS ARC cache is duplicating data? The cache size gets bigger then the pool. Date: Wed, 08 Feb 2017 11:10:59 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: 11.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: k_georgiev@deltanews.bg X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 08 Feb 2017 11:10:59 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D216364 --- Comment #8 from k_georgiev@deltanews.bg --- Hello again,=20 If it will be useful now I got the cache size larger than the pool, this is= the current status: ARC: 7713M Total, 1950M MFU, 5343M MRU, 746K Anon, 26M Header, 394M Other And again the statistics you requested: root@varnish:/tmp # sysctl kstat.zfs.misc.arcstats kstat.zfs.misc.arcstats.demand_hit_predictive_prefetch: 1139 kstat.zfs.misc.arcstats.sync_wait_for_async: 97 kstat.zfs.misc.arcstats.arc_meta_min: 975210240 kstat.zfs.misc.arcstats.arc_meta_max: 728642168 kstat.zfs.misc.arcstats.arc_meta_limit: 3900840960 kstat.zfs.misc.arcstats.arc_meta_used: 717771648 kstat.zfs.misc.arcstats.duplicate_reads: 2495 kstat.zfs.misc.arcstats.duplicate_buffers_size: 0 kstat.zfs.misc.arcstats.duplicate_buffers: 0 kstat.zfs.misc.arcstats.memory_throttle_count: 0 kstat.zfs.misc.arcstats.l2_write_buffer_list_null_iter: 0 kstat.zfs.misc.arcstats.l2_write_buffer_list_iter: 0 kstat.zfs.misc.arcstats.l2_write_buffer_bytes_scanned: 0 kstat.zfs.misc.arcstats.l2_write_pios: 0 kstat.zfs.misc.arcstats.l2_write_buffer_iter: 0 kstat.zfs.misc.arcstats.l2_write_full: 0 kstat.zfs.misc.arcstats.l2_write_not_cacheable: 1 kstat.zfs.misc.arcstats.l2_write_io_in_progress: 0 kstat.zfs.misc.arcstats.l2_write_in_l2: 0 kstat.zfs.misc.arcstats.l2_write_spa_mismatch: 0 kstat.zfs.misc.arcstats.l2_write_passed_headroom: 0 kstat.zfs.misc.arcstats.l2_write_trylock_fail: 0 kstat.zfs.misc.arcstats.l2_padding_needed: 0 kstat.zfs.misc.arcstats.l2_compress_failures: 0 kstat.zfs.misc.arcstats.l2_compress_zeros: 0 kstat.zfs.misc.arcstats.l2_compress_successes: 0 kstat.zfs.misc.arcstats.l2_hdr_size: 0 kstat.zfs.misc.arcstats.l2_asize: 0 kstat.zfs.misc.arcstats.l2_size: 0 kstat.zfs.misc.arcstats.l2_io_error: 0 kstat.zfs.misc.arcstats.l2_cksum_bad: 0 kstat.zfs.misc.arcstats.l2_abort_lowmem: 0 kstat.zfs.misc.arcstats.l2_cdata_free_on_write: 0 kstat.zfs.misc.arcstats.l2_free_on_write: 0 kstat.zfs.misc.arcstats.l2_evict_l1cached: 0 kstat.zfs.misc.arcstats.l2_evict_reading: 0 kstat.zfs.misc.arcstats.l2_evict_lock_retry: 0 kstat.zfs.misc.arcstats.l2_writes_lock_retry: 0 kstat.zfs.misc.arcstats.l2_writes_error: 0 kstat.zfs.misc.arcstats.l2_writes_done: 0 kstat.zfs.misc.arcstats.l2_writes_sent: 0 kstat.zfs.misc.arcstats.l2_write_bytes: 0 kstat.zfs.misc.arcstats.l2_read_bytes: 0 kstat.zfs.misc.arcstats.l2_rw_clash: 0 kstat.zfs.misc.arcstats.l2_feeds: 0 kstat.zfs.misc.arcstats.l2_misses: 0 kstat.zfs.misc.arcstats.l2_hits: 0 kstat.zfs.misc.arcstats.mfu_ghost_evictable_metadata: 0 kstat.zfs.misc.arcstats.mfu_ghost_evictable_data: 0 kstat.zfs.misc.arcstats.mfu_ghost_size: 0 kstat.zfs.misc.arcstats.mfu_evictable_metadata: 12150272 kstat.zfs.misc.arcstats.mfu_evictable_data: 65606144 kstat.zfs.misc.arcstats.mfu_size: 78327808 kstat.zfs.misc.arcstats.mru_ghost_evictable_metadata: 0 kstat.zfs.misc.arcstats.mru_ghost_evictable_data: 0 kstat.zfs.misc.arcstats.mru_ghost_size: 0 kstat.zfs.misc.arcstats.mru_evictable_metadata: 94340096 kstat.zfs.misc.arcstats.mru_evictable_data: 5329829888 kstat.zfs.misc.arcstats.mru_size: 5601754112 kstat.zfs.misc.arcstats.anon_evictable_metadata: 0 kstat.zfs.misc.arcstats.anon_evictable_data: 0 kstat.zfs.misc.arcstats.anon_size: 939520 kstat.zfs.misc.arcstats.other_size: 409772864 kstat.zfs.misc.arcstats.metadata_size: 284930560 kstat.zfs.misc.arcstats.data_size: 5396353536 kstat.zfs.misc.arcstats.hdr_size: 23068224 kstat.zfs.misc.arcstats.size: 6114125184 kstat.zfs.misc.arcstats.c_max: 15603363840 kstat.zfs.misc.arcstats.c_min: 1950420480 kstat.zfs.misc.arcstats.c: 15603363840 kstat.zfs.misc.arcstats.p: 7801681920 kstat.zfs.misc.arcstats.hash_chain_max: 3 kstat.zfs.misc.arcstats.hash_chains: 1313 kstat.zfs.misc.arcstats.hash_collisions: 159594 kstat.zfs.misc.arcstats.hash_elements_max: 95175 kstat.zfs.misc.arcstats.hash_elements: 80080 kstat.zfs.misc.arcstats.evict_l2_skip: 0 kstat.zfs.misc.arcstats.evict_l2_ineligible: 2048 kstat.zfs.misc.arcstats.evict_l2_eligible: 67584 kstat.zfs.misc.arcstats.evict_l2_cached: 0 kstat.zfs.misc.arcstats.evict_not_enough: 0 kstat.zfs.misc.arcstats.evict_skip: 1 kstat.zfs.misc.arcstats.mutex_miss: 0 kstat.zfs.misc.arcstats.deleted: 8 kstat.zfs.misc.arcstats.allocated: 10092961 kstat.zfs.misc.arcstats.mfu_ghost_hits: 0 kstat.zfs.misc.arcstats.mfu_hits: 6988925 kstat.zfs.misc.arcstats.mru_ghost_hits: 0 kstat.zfs.misc.arcstats.mru_hits: 1778668 kstat.zfs.misc.arcstats.prefetch_metadata_misses: 9879 kstat.zfs.misc.arcstats.prefetch_metadata_hits: 13990 kstat.zfs.misc.arcstats.prefetch_data_misses: 89 kstat.zfs.misc.arcstats.prefetch_data_hits: 1 kstat.zfs.misc.arcstats.demand_metadata_misses: 3994929 kstat.zfs.misc.arcstats.demand_metadata_hits: 7237192 kstat.zfs.misc.arcstats.demand_data_misses: 124103 kstat.zfs.misc.arcstats.demand_data_hits: 1530399 kstat.zfs.misc.arcstats.misses: 4129000 kstat.zfs.misc.arcstats.hits: 8781582 --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Wed Feb 8 11:12:30 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9C140CD66D7 for ; Wed, 8 Feb 2017 11:12:30 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 8BD5A187 for ; Wed, 8 Feb 2017 11:12:30 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v18BCTpJ045936 for ; Wed, 8 Feb 2017 11:12:30 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 216364] ZFS ARC cache is duplicating data? The cache size gets bigger then the pool. Date: Wed, 08 Feb 2017 11:12:29 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: 11.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: avg@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 08 Feb 2017 11:12:30 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D216364 --- Comment #9 from Andriy Gapon --- (In reply to k_georgiev from comment #7) I haven't done any calculations, but it's quite possible that you are not having any problem. You are comparing the size of the data on disk where s= ome of it is rather well compressed with the size of the data in ARC where the = data is uncompressed (and after the compressed ARC support was added, a cached buffer could be compressed, uncompressed or both). Check what zfs get logicalused zroot gives you. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Wed Feb 8 11:20:02 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C3535CD6741 for ; Wed, 8 Feb 2017 11:20:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id A506A2D5 for ; Wed, 8 Feb 2017 11:20:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v18BK28H058234 for ; Wed, 8 Feb 2017 11:20:02 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 216364] ZFS ARC cache is duplicating data? The cache size gets bigger then the pool. Date: Wed, 08 Feb 2017 11:20:02 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: 11.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: k_georgiev@deltanews.bg X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 08 Feb 2017 11:20:02 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D216364 --- Comment #10 from k_georgiev@deltanews.bg --- root@varnish:/tmp # zfs get logicalused zroot=20 NAME PROPERTY VALUE SOURCE zroot logicalused 9.52G - --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Wed Feb 8 13:09:05 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B1CA0CD6181 for ; Wed, 8 Feb 2017 13:09:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id A1990BA4 for ; Wed, 8 Feb 2017 13:09:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v18D95PZ055181 for ; Wed, 8 Feb 2017 13:09:05 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 216178] ZFS ARC and L2ARC are unrealistically large, maybe after r307265 Date: Wed, 08 Feb 2017 13:09:05 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: lev@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 08 Feb 2017 13:09:05 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D216178 --- Comment #4 from Lev A. Serebryakov --- I could provide any additional information, including dumping kernel struct= ures with debugger and such. Now it shows: % zpool list -v NAME SIZE ALLOC FREE EXPANDSZ FRAG CAP DEDUP HEALTH=20 ALTROOT zroot 39.9G 14.6G 25.3G - 49% 36% 1.00x ONLINE - gpt/root 39.9G 14.6G 25.3G - 49% 36% zstor 13.6T 9.01T 4.62T - 24% 66% 1.00x ONLINE - raidz1 13.6T 9.01T 4.62T - 24% 66% ada1 - - - - - - ada2 - - - - - - ada3 - - - - - - ada4 - - - - - - ada5 - - - - - - cache - - - - - - gpt/l2arc 185G 1.05T 16.0E - 0% 581% % which looks completely unrealistic, as it is more than 4x compression! --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Wed Feb 8 13:25:36 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 68816CD674D for ; Wed, 8 Feb 2017 13:25:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4C16D170E for ; Wed, 8 Feb 2017 13:25:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v18DPaOi000930 for ; Wed, 8 Feb 2017 13:25:36 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 216178] ZFS ARC and L2ARC are unrealistically large, maybe after r307265 Date: Wed, 08 Feb 2017 13:25:36 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: avg@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 08 Feb 2017 13:25:36 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D216178 --- Comment #5 from Andriy Gapon --- (In reply to Lev A. Serebryakov from comment #4) It has nothing to do with compression that the numbers are for the physical= / actual space on disk. It's a problem with the space accounting. I am not sure if the bad accounting and the checksum errors have the same c= ause or if the checksum errors somehow cause the bad accounting. Is there a chance that you could use a different disk for the cache device? --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Wed Feb 8 13:34:19 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C127ACD6C19 for ; Wed, 8 Feb 2017 13:34:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id B0E721D0E for ; Wed, 8 Feb 2017 13:34:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v18DYJ1Y026332 for ; Wed, 8 Feb 2017 13:34:19 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 216178] ZFS ARC and L2ARC are unrealistically large, maybe after r307265 Date: Wed, 08 Feb 2017 13:34:19 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: lev@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 08 Feb 2017 13:34:19 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D216178 --- Comment #6 from Lev A. Serebryakov --- I could use another 750 EVO disk, whole 120GB one instead of partition on 250GB, in day or two (I'm waiting for additional HBA right now!). Maybe, checksum errors is result of TRIM errors? Now this SSD doesn't have = any quirks in our (FreeBSD) sources, but its "big brothers" (like 850 EVO and 8= 50 PRO) are marked with "no TRIM with NCQ" (see discussion about this SSD and = its quirks here: https://reviews.freebsd.org/D9478). But ZFS (zroot pool) on sa= me device (other partition) doesn't show any errors, I've checked it with "scr= ub". --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Wed Feb 8 13:39:59 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DB0CBCD6DF8 for ; Wed, 8 Feb 2017 13:39:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id CADA6214 for ; Wed, 8 Feb 2017 13:39:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v18DdxWv034011 for ; Wed, 8 Feb 2017 13:39:59 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 216178] ZFS ARC and L2ARC are unrealistically large, maybe after r307265 Date: Wed, 08 Feb 2017 13:39:59 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: avg@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 08 Feb 2017 13:40:00 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D216178 --- Comment #7 from Andriy Gapon --- (In reply to Lev A. Serebryakov from comment #6) Hard to tell. To be honest the TRIM code for L2ARC is rather useless. I wo= uld remove it altogether to exclude its effects. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Wed Feb 8 13:42:59 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A8DF4CD6005 for ; Wed, 8 Feb 2017 13:42:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 988108A5 for ; Wed, 8 Feb 2017 13:42:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v18DgxxU046696 for ; Wed, 8 Feb 2017 13:42:59 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 216364] ZFS ARC cache is duplicating data? The cache size gets bigger then the pool. Date: Wed, 08 Feb 2017 13:42:59 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: 11.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: k_georgiev@deltanews.bg X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 08 Feb 2017 13:42:59 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D216364 --- Comment #11 from k_georgiev@deltanews.bg --- Hmm, As I look at the compress ration there is no more than 3x except for the /var/log where it's 6x.=20 I'm not sure if this X is multiply, or percentage. If it' percentage then i= t's very low and almost no data is compressed.=20 If it's multiply then it may be possible that all is fine, however this is quite fresh FreeBSD install with only installed Varnish software and few mo= re packages that can't be more than few megabytes. No user data, or databases = is stored there. I can't believe that fresh install takes close to 10G. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Thu Feb 9 06:06:33 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E11B9CD7A6D for ; Thu, 9 Feb 2017 06:06:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id D0E48E0 for ; Thu, 9 Feb 2017 06:06:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v1966X9u041244 for ; Thu, 9 Feb 2017 06:06:33 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 216886] ZFS with aclinherit and aclmode set to passthrough adds an extra default ACLs Date: Thu, 09 Feb 2017 06:06:33 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 09 Feb 2017 06:06:34 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D216886 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|freebsd-bugs@FreeBSD.org |freebsd-fs@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Thu Feb 9 06:07:19 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id F321DCD7BDF for ; Thu, 9 Feb 2017 06:07:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id E2FA5287 for ; Thu, 9 Feb 2017 06:07:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v1967J2L071993 for ; Thu, 9 Feb 2017 06:07:19 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 216881] zpool detach hangs if autoexpand is set to on. Date: Thu, 09 Feb 2017 06:07:20 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 09 Feb 2017 06:07:20 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D216881 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|freebsd-bugs@FreeBSD.org |freebsd-fs@FreeBSD.org CC|freebsd-amd64@FreeBSD.org | --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Thu Feb 9 14:30:16 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 668BDCD7EDE for ; Thu, 9 Feb 2017 14:30:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 565291CF6 for ; Thu, 9 Feb 2017 14:30:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v19EUGwS015106 for ; Thu, 9 Feb 2017 14:30:16 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 216178] ZFS ARC and L2ARC are unrealistically large, maybe after r307265 Date: Thu, 09 Feb 2017 14:30:16 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: ben.rubson@gmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 09 Feb 2017 14:30:16 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D216178 Ben RUBSON changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |ben.rubson@gmail.com --- Comment #8 from Ben RUBSON --- I also faced this "16.0E" issue (without compression enabled) : https://www.illumos.org/issues/7410 --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Thu Feb 9 17:17:04 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 21D8DCD72DB for ; Thu, 9 Feb 2017 17:17:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 1169A1EFA for ; Thu, 9 Feb 2017 17:17:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v19HH0dK087389 for ; Thu, 9 Feb 2017 17:17:03 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 216939] A buffer underflow in the ZFS implementation of vop_vptocnp VFS method Date: Thu, 09 Feb 2017 17:17:00 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.3-STABLE X-Bugzilla-Keywords: patch X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 09 Feb 2017 17:17:04 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D216939 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|freebsd-bugs@FreeBSD.org |freebsd-fs@FreeBSD.org Keywords| |patch --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Fri Feb 10 02:52:56 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DBBE2CD8F2F for ; Fri, 10 Feb 2017 02:52:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id CBABD144A for ; Fri, 10 Feb 2017 02:52:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v1A2quOc019960 for ; Fri, 10 Feb 2017 02:52:56 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 212861] [tmpfs] uchg files can be removed by root Date: Fri, 10 Feb 2017 02:52:56 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: commit-hook@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Feb 2017 02:52:57 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D212861 --- Comment #8 from commit-hook@freebsd.org --- A commit references this bug: Author: ngie Date: Fri Feb 10 02:51:54 UTC 2017 New revision: 313514 URL: https://svnweb.freebsd.org/changeset/base/313514 Log: MFC r307190,r307196,r307204,r307205: r307190: Skip :uchg on FreeBSD Unfortunately removing files with uchg set always succeeds with root on FreeBSD. Unfortunately running the test as an unprivileged user isn't doa= ble because mounting tmpfs requires root PR: 212861 r307196: Port contrib/netbsd-tests/fs/tmpfs/h_tools.c to FreeBSD - Add inttypes.h #include for PRId64 macro - Use FreeBSD's copy of getfh(2), which doesn't include a `fh_size` parameter. Use sizeof(fhandle_t) instead as the size of fhp is always fixed as fhandle_t, unlike NetBSD's copy of fhp, which is void*. r307204: Expect :large to fail on FreeBSD FreeBSD doesn't appear to validate large -o size values like NetBSD does PR: 212862 r307205: Change atf_skip call to atf_expect_fail to make it clear that a failure is expected PR: 212861 Suggested by: jmmv Changes: _U stable/10/ stable/10/contrib/netbsd-tests/fs/tmpfs/h_tools.c stable/10/contrib/netbsd-tests/fs/tmpfs/t_mount.sh stable/10/contrib/netbsd-tests/fs/tmpfs/t_remove.sh --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Fri Feb 10 02:53:00 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 308ABCD8F61 for ; Fri, 10 Feb 2017 02:53:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 183F71458 for ; Fri, 10 Feb 2017 02:53:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v1A2qxOu021556 for ; Fri, 10 Feb 2017 02:52:59 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 212861] [tmpfs] uchg files can be removed by root Date: Fri, 10 Feb 2017 02:53:00 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: commit-hook@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Feb 2017 02:53:00 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D212861 --- Comment #9 from commit-hook@freebsd.org --- A commit references this bug: Author: ngie Date: Fri Feb 10 02:51:54 UTC 2017 New revision: 313514 URL: https://svnweb.freebsd.org/changeset/base/313514 Log: MFC r307190,r307196,r307204,r307205: r307190: Skip :uchg on FreeBSD Unfortunately removing files with uchg set always succeeds with root on FreeBSD. Unfortunately running the test as an unprivileged user isn't doa= ble because mounting tmpfs requires root PR: 212861 r307196: Port contrib/netbsd-tests/fs/tmpfs/h_tools.c to FreeBSD - Add inttypes.h #include for PRId64 macro - Use FreeBSD's copy of getfh(2), which doesn't include a `fh_size` parameter. Use sizeof(fhandle_t) instead as the size of fhp is always fixed as fhandle_t, unlike NetBSD's copy of fhp, which is void*. r307204: Expect :large to fail on FreeBSD FreeBSD doesn't appear to validate large -o size values like NetBSD does PR: 212862 r307205: Change atf_skip call to atf_expect_fail to make it clear that a failure is expected PR: 212861 Suggested by: jmmv Changes: _U stable/10/ stable/10/contrib/netbsd-tests/fs/tmpfs/h_tools.c stable/10/contrib/netbsd-tests/fs/tmpfs/t_mount.sh stable/10/contrib/netbsd-tests/fs/tmpfs/t_remove.sh --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Fri Feb 10 07:22:25 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 228BBCD1B26 for ; Fri, 10 Feb 2017 07:22:25 +0000 (UTC) (envelope-from dpchrist@holgerdanske.com) Received: from holgerdanske.com (holgerdanske.com [IPv6:2001:470:0:19b::b869:801b]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.he.net", Issuer "GeoTrust SSL CA - G4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 126C4104B for ; Fri, 10 Feb 2017 07:22:25 +0000 (UTC) (envelope-from dpchrist@holgerdanske.com) Received: from ::ffff:99.100.19.101 ([99.100.19.101]) by holgerdanske.com with ESMTPSA (AES128-SHA:SSLv3:Kx=RSA:Au=RSA:Enc=AES(128):Mac=SHA1) (SMTP-AUTH username dpchrist@holgerdanske.com, mechanism PLAIN) for ; Thu, 9 Feb 2017 23:22:19 -0800 Subject: Fwd: Re: FreeBSD 11 and 4+ GB files on optical disc References: <20170210031741.3d4348f6.freebsd@edvax.de> To: freebsd-fs@freebsd.org From: David Christensen X-Forwarded-Message-Id: <20170210031741.3d4348f6.freebsd@edvax.de> Message-ID: <4b4145c4-1381-0b95-0e06-46affbb6d851@holgerdanske.com> Date: Thu, 9 Feb 2017 23:22:23 -0800 User-Agent: Mozilla/5.0 (X11; FreeBSD i386; rv:45.0) Gecko/20100101 Thunderbird/45.6.0 MIME-Version: 1.0 In-Reply-To: <20170210031741.3d4348f6.freebsd@edvax.de> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Feb 2017 07:22:25 -0000 freebsd-fs: I have a computer with: dpchrist@freebsd:/usr/home/dpchrist $ freebsd-version 11.0-RELEASE-p7 dpchrist@freebsd:/usr/home/dpchrist $ uname -a FreeBSD freebsd 11.0-RELEASE-p1 FreeBSD 11.0-RELEASE-p1 #0 r306420: Thu Sep 29 03:40:55 UTC 2016 root@releng2.nyi.freebsd.org:/usr/obj/usr/src/sys/GENERIC i386 I've been creating DVD and BD discs with files larger than 4 GB on Linux. I can read them fine on Linux and Microsoft Windows. But, I can't read them correctly on FreeBSD. Apparently, this is a feature. Is there software I can install so that I can access 4+ GB files on optical discs? TIA, David -------- Forwarded Message -------- Subject: Re: FreeBSD 11 and 4+ GB files on optical disc Date: Fri, 10 Feb 2017 03:17:41 +0100 From: Polytropon ... To: David Christensen ... CC: freebsd-questions@... On Thu, 9 Feb 2017 17:51:34 -0800, David Christensen wrote: > On 02/09/17 15:55, Polytropon wrote: > > Thanks for the reply. > > > > On Thu, 9 Feb 2017 15:04:13 -0800, David Christensen wrote: > >> I periodically create archive files on Debian 7, encrypt the archive, > >> create checksum files, burn the archive and checksum files to optical > >> disc, and then verify the contents of the disc. > > > > So I can assume you're using ISO-9660 as the file system for > > the optical disc - a very important aspect you never mentioned. :-) > > dpchrist@freebsd:/usr/home/dpchrist $ mount | grep /dev/cd0 > /dev/cd0 on /media/HOLGERDANSKE_COM (cd9660, local, nosuid, read-only) Exactly my assumption. :-) > >> I suspect that FreeBSD is having problems because the archive file is > >> larger than 4 GB (?). > > > > Well, if you accurately consider the file size conversion ... > > Check what the file system specification says ... > > So what you're seeing (file appearing twice) exactly matches > > the assumption that mkisofs is creating a "split entry" for a > > source file that the ISO-9660 file system cannot contain due > > to a size limitation. > > I created the disc on Linux, and have been creating discs just like it > for several years. I guess Linux hides the "split entries"; it "just > works". That is correct, but keep in mind it's an extension to the specification, so not really "standard" to do so. ISO-9660 has a file size limitation. > When I browse the disc using Vista 32-bit, Windows Explorer shows the > files on the disc correctly. It seems to support that extension. However, FreeBSD's ISO-9660 implementation seems to be more strict... > > Don't use ISO-9660. Use tar as a file system (or better, instead > > of a file system). You can write it to the DVD like this: > > > > % growisofs -dvd-compat -Z /dev/dvd=2017.01.tar > > > > And read (restore) it like this: > > > > % tar xvf /dev/dvd > > > > The advantage: No size limitation imposed by ISO-9660.Additional security: "There are no files on the DVD!" ;-) > > That is not security; that is incompatibility. Sometimes, incompatibility _is_ security. ;-) > This is an archive disc. I have created many such discs over the years. > I need to be able to browse and read them on as many platforms as > possible. That's why tar isn't that bad: Every significant system has the only two parts needed to access such disk: first the ability to read raw data from the device, second an implementation of the tar program. Even though it might sound stupid, this mechanism works with any media (from floppy, optical discs, tape, hard disks, USB sticks) and on almost every operating system (Linux, BSD, Solaris, IRIX, AIX, HP-UX, also on DOS, and with Linux tools being available on "Windows", even there). Of course you need to process the file sequencially, but that is not a big deal because you have created .tar files anyway. The downside is that you do not really have logical _files_ (no .tar file on the media, but media itself is a .tar "file"), which might be a problem for archiving tasks. > How do I browse and read 4+ GB files on optical discs (DVD, BD) > correctly on FreeBSD? By using FreeBSD 11, you're already using the most recent version of the ISO 9660 VFS driver. I suggest you ask a specific question on the freebsd-fs@ mailing list. Maybe there is userland support (maybe through FUSE) for extensions that allow files bigger than the specification. -- Polytropon Magdeburg, Germany Happy FreeBSD user since 4.0 Andra moi ennepe, Mousa, ... From owner-freebsd-fs@freebsd.org Fri Feb 10 09:16:39 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A1A7ECD9E9F for ; Fri, 10 Feb 2017 09:16:39 +0000 (UTC) (envelope-from gljennjohn@gmail.com) Received: from mail-wr0-x236.google.com (mail-wr0-x236.google.com [IPv6:2a00:1450:400c:c0c::236]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 544DEF83 for ; Fri, 10 Feb 2017 09:16:39 +0000 (UTC) (envelope-from gljennjohn@gmail.com) Received: by mail-wr0-x236.google.com with SMTP id o16so103097545wra.1 for ; Fri, 10 Feb 2017 01:16:39 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=date:from:to:cc:subject:message-id:in-reply-to:references:reply-to :mime-version:content-transfer-encoding; bh=L5z8XDHvXhYBcd7dXs2K+23t4DVZQ6LBzWvl8x8DSTU=; b=czXWieuO6Uqtg6veiQzZlIjKDgvxP+zJnbbPBanV0JAUrWdAhVpmAUnpxefNbxsZtu sMzCYcCwFIC/vqZaO07519BCVAScoUnsVAxdTcDzaoY+P5LBKi9DcVa0lg+4cuvR7wF9 etwpVVqUnlWP58/mjSO3Pz/6oJ/BxY3FnePkbKZ+KtiPAXc/ieqfPFHGSyAUvVlj35P+ 9bPpHhwPnu6tNK6uSo7CDns0AsVIE+dzd+Ex7j2GlA28kwVp+K/gZTDak0C+m8qTltQc yI0vBf5u2zXn3tsSnrF4+zbWdEuH+IKAnKf5AXp3gv8WM7krjCnzUUgS75hVYJgoaL5E NBEg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:in-reply-to :references:reply-to:mime-version:content-transfer-encoding; bh=L5z8XDHvXhYBcd7dXs2K+23t4DVZQ6LBzWvl8x8DSTU=; b=mTkLjsSmWvYCVu/zZMw2bvI8bBWh9nSCwpU9vIwAwR1O20jHTDGNzYFDLrrYzpXbeX 9rtp3ilDoNhxUi0gBP3TGwNQaVDuztZsypP+3r/X4BSHw7OeRnQKN+DXSLwEsnB4mTwn hYml0xJy+knWAFzBAMTcT8oMB69lQakDqGigiBLur/5SMveEV/Y0JbjRWvHVYSZ1/P/c uRLQqGfdboM+VUiwCWi9MdC8ZRpkCVlM8rJBivWUd+tZEx+3G7mbBciaQHKgAzgPYR3D 40abig2UCVGDFIwEhojs21j/97awZjrJMbV7QP20uirhMao6wKDjLI84t0ULtkwePNmi 2tLw== X-Gm-Message-State: AMke39muJIb0BD2p1kM/nGX43yqcG/euxoOJjvwquKX8OTE/3ifnAsg5d0NyrIMJhnZMXg== X-Received: by 10.223.138.220 with SMTP id z28mr6731170wrz.26.1486718196417; Fri, 10 Feb 2017 01:16:36 -0800 (PST) Received: from ernst.home (p578E1D95.dip0.t-ipconnect.de. [87.142.29.149]) by smtp.gmail.com with ESMTPSA id e72sm559815wma.16.2017.02.10.01.16.35 (version=TLS1_2 cipher=ECDHE-RSA-CHACHA20-POLY1305 bits=256/256); Fri, 10 Feb 2017 01:16:35 -0800 (PST) Date: Fri, 10 Feb 2017 10:16:33 +0100 From: Gary Jennejohn To: David Christensen Cc: freebsd-fs@freebsd.org Subject: Re: FreeBSD 11 and 4+ GB files on optical disc Message-ID: <20170210101633.4d5da7df@ernst.home> In-Reply-To: <4b4145c4-1381-0b95-0e06-46affbb6d851@holgerdanske.com> References: <20170210031741.3d4348f6.freebsd@edvax.de> <4b4145c4-1381-0b95-0e06-46affbb6d851@holgerdanske.com> Reply-To: gljennjohn@gmail.com X-Mailer: Claws Mail 3.14.1 (GTK+ 2.24.29; amd64-portbld-freebsd12.0) MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Feb 2017 09:16:39 -0000 On Thu, 9 Feb 2017 23:22:23 -0800 David Christensen wrote: > freebsd-fs: > > I have a computer with: > > dpchrist@freebsd:/usr/home/dpchrist $ freebsd-version > 11.0-RELEASE-p7 > > dpchrist@freebsd:/usr/home/dpchrist $ uname -a > FreeBSD freebsd 11.0-RELEASE-p1 FreeBSD 11.0-RELEASE-p1 #0 r306420: Thu Sep 29 03:40:55 UTC 2016 root@releng2.nyi.freebsd.org:/usr/obj/usr/src/sys/GENERIC i386 > > > I've been creating DVD and BD discs with files larger than 4 GB on Linux. I can read them fine on Linux and Microsoft Windows. But, I can't read them correctly on FreeBSD. > > > Apparently, this is a feature. > No, it's an option. Look for UDF in /sys/conf/NOTES. There's also /usr/ports/sysutils/udfclient, but I'd be inclined to use the kernel options. I've had UDF in my kernel for years. > > Is there software I can install so that I can access 4+ GB files on optical discs? > > > TIA, > > David > > > > -------- Forwarded Message -------- > Subject: Re: FreeBSD 11 and 4+ GB files on optical disc > Date: Fri, 10 Feb 2017 03:17:41 +0100 > From: Polytropon ... > To: David Christensen ... > CC: freebsd-questions@... > > On Thu, 9 Feb 2017 17:51:34 -0800, David Christensen wrote: > > On 02/09/17 15:55, Polytropon wrote: > > > > Thanks for the reply. > > > > > > > On Thu, 9 Feb 2017 15:04:13 -0800, David Christensen wrote: > > >> I periodically create archive files on Debian 7, encrypt the archive, > > >> create checksum files, burn the archive and checksum files to optical > > >> disc, and then verify the contents of the disc. > > > > > > So I can assume you're using ISO-9660 as the file system for > > > the optical disc - a very important aspect you never mentioned. :-) > > > > dpchrist@freebsd:/usr/home/dpchrist $ mount | grep /dev/cd0 > > /dev/cd0 on /media/HOLGERDANSKE_COM (cd9660, local, nosuid, read-only) > > Exactly my assumption. :-) > > > > > >> I suspect that FreeBSD is having problems because the archive file is > > >> larger than 4 GB (?). > > > > > > Well, if you accurately consider the file size conversion ... > > > Check what the file system specification says ... > > > So what you're seeing (file appearing twice) exactly matches > > > the assumption that mkisofs is creating a "split entry" for a > > > source file that the ISO-9660 file system cannot contain due > > > to a size limitation. > > > > I created the disc on Linux, and have been creating discs just like it > > for several years. I guess Linux hides the "split entries"; it "just > > works". > > That is correct, but keep in mind it's an extension to the > specification, so not really "standard" to do so. ISO-9660 > has a file size limitation. > > > > > When I browse the disc using Vista 32-bit, Windows Explorer shows the > > files on the disc correctly. > > It seems to support that extension. However, FreeBSD's ISO-9660 > implementation seems to be more strict... > > > > > > Don't use ISO-9660. Use tar as a file system (or better, instead > > > of a file system). You can write it to the DVD like this: > > > > > > % growisofs -dvd-compat -Z /dev/dvd=2017.01.tar > > > > > > And read (restore) it like this: > > > > > > % tar xvf /dev/dvd > > > > > > The advantage: No size limitation imposed by ISO-9660.Additional security: "There are no files on the DVD!" ;-) > > > > That is not security; that is incompatibility. > > Sometimes, incompatibility _is_ security. ;-) > > > > > This is an archive disc. I have created many such discs over the years. > > I need to be able to browse and read them on as many platforms as > > possible. > > That's why tar isn't that bad: Every significant system has > the only two parts needed to access such disk: first the > ability to read raw data from the device, second an implementation > of the tar program. Even though it might sound stupid, this > mechanism works with any media (from floppy, optical discs, > tape, hard disks, USB sticks) and on almost every operating > system (Linux, BSD, Solaris, IRIX, AIX, HP-UX, also on DOS, > and with Linux tools being available on "Windows", even there). > > Of course you need to process the file sequencially, but that > is not a big deal because you have created .tar files anyway. > The downside is that you do not really have logical _files_ > (no .tar file on the media, but media itself is a .tar "file"), > which might be a problem for archiving tasks. > > > > > How do I browse and read 4+ GB files on optical discs (DVD, BD) > > correctly on FreeBSD? > > By using FreeBSD 11, you're already using the most recent > version of the ISO 9660 VFS driver. I suggest you ask a > specific question on the freebsd-fs@ mailing list. Maybe > there is userland support (maybe through FUSE) for extensions > that allow files bigger than the specification. > > > -- > Polytropon > Magdeburg, Germany > Happy FreeBSD user since 4.0 > Andra moi ennepe, Mousa, ... > > _______________________________________________ > freebsd-fs@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" -- Gary Jennejohn From owner-freebsd-fs@freebsd.org Fri Feb 10 15:11:34 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D394FCD8BE2 for ; Fri, 10 Feb 2017 15:11:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id C36891B40 for ; Fri, 10 Feb 2017 15:11:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v1AFBYc0047333 for ; Fri, 10 Feb 2017 15:11:34 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 205708] Kernel panic possibly happening while adding/removing/listing ZFS snapshot Date: Fri, 10 Feb 2017 15:11:34 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.2-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: avg@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Feb 2017 15:11:34 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D205708 --- Comment #8 from Andriy Gapon --- Has the submitter or anyone else experienced this problem again? Especially, with FreeBSD newer than 10.2? (e.g. 10.3, 11.0, stable/10, stable/11). --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Fri Feb 10 15:17:09 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 42EB1CD8E0C for ; Fri, 10 Feb 2017 15:17:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 32CCB1D2C for ; Fri, 10 Feb 2017 15:17:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v1AFH71n059829 for ; Fri, 10 Feb 2017 15:17:09 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 216881] zpool detach hangs if autoexpand is set to on. Date: Fri, 10 Feb 2017 15:17:08 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: avg@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Feb 2017 15:17:09 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D216881 Andriy Gapon changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |mav@FreeBSD.org --- Comment #1 from Andriy Gapon --- FreeBSD 11.0 was released before the fix. You should see the fix in 11.1 or you can switch to stable/11 now. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Fri Feb 10 15:22:55 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 02DA6CD931F for ; Fri, 10 Feb 2017 15:22:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id E4B28FF7 for ; Fri, 10 Feb 2017 15:22:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v1AFMr9E078251 for ; Fri, 10 Feb 2017 15:22:54 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 200592] panic: solaris assert: zilog_is_dirty(zilog) || spa_freeze_txg(zilog->zl_spa) != UINT64_MAX, file: /release/usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zil.c, line: 1060 Date: Fri, 10 Feb 2017 15:22:54 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: avg@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: avg@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Feb 2017 15:22:55 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D200592 Andriy Gapon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|freebsd-fs@FreeBSD.org |avg@FreeBSD.org --- Comment #4 from Andriy Gapon --- Can anyone reproduce this problem using recent FreeBSD head (r309250 or new= er) or stable/11? --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Fri Feb 10 15:45:42 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 47AB5CD9BF4 for ; Fri, 10 Feb 2017 15:45:42 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 376AF316 for ; Fri, 10 Feb 2017 15:45:42 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v1AFjg0J034798 for ; Fri, 10 Feb 2017 15:45:42 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 216881] zpool detach hangs if autoexpand is set to on. Date: Fri, 10 Feb 2017 15:45:42 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: jmc-freebsd2@milibyte.co.uk X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Feb 2017 15:45:42 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D216881 --- Comment #2 from Mike Clarke --- Thanks. I'll wait for 11.1. In the meantime switching off autoexpand is OK as a workaround. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Fri Feb 10 15:46:29 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7F276CD9C41 for ; Fri, 10 Feb 2017 15:46:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 6410F795 for ; Fri, 10 Feb 2017 15:46:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v1AFkTIf036143 for ; Fri, 10 Feb 2017 15:46:29 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 216881] zpool detach hangs if autoexpand is set to on. Date: Fri, 10 Feb 2017 15:46:29 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: jmc-freebsd2@milibyte.co.uk X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: resolution bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Feb 2017 15:46:29 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D216881 Mike Clarke changed: What |Removed |Added ---------------------------------------------------------------------------- Resolution|--- |FIXED Status|New |Closed --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Fri Feb 10 16:13:02 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 979E3CD97DE for ; Fri, 10 Feb 2017 16:13:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 807AAC01 for ; Fri, 10 Feb 2017 16:13:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v1AGD20M022470 for ; Fri, 10 Feb 2017 16:13:02 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 216881] zpool detach hangs if autoexpand is set to on. Date: Fri, 10 Feb 2017 16:13:02 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: smh@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Feb 2017 16:13:02 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D216881 Steven Hartland changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |smh@FreeBSD.org --- Comment #3 from Steven Hartland --- For reference do you know the particular commit which fixed this Andriy? --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Fri Feb 10 16:19:18 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D0E3FCD994B for ; Fri, 10 Feb 2017 16:19:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id C0BB3E3D for ; Fri, 10 Feb 2017 16:19:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v1AGJI8S032085 for ; Fri, 10 Feb 2017 16:19:18 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 216881] zpool detach hangs if autoexpand is set to on. Date: Fri, 10 Feb 2017 16:19:18 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: avg@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Feb 2017 16:19:18 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D216881 --- Comment #4 from Andriy Gapon --- I believe that it was base r308055. Alexander, could you please confirm? --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Fri Feb 10 16:26:29 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 91B0CCD9DA6 for ; Fri, 10 Feb 2017 16:26:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 8120C149D for ; Fri, 10 Feb 2017 16:26:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v1AGQTML050063 for ; Fri, 10 Feb 2017 16:26:29 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 216881] zpool detach hangs if autoexpand is set to on. Date: Fri, 10 Feb 2017 16:26:29 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: mav@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Feb 2017 16:26:29 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D216881 --- Comment #5 from Alexander Motin --- (In reply to Andriy Gapon from comment #4) It was fixed from two different sides: r308051 and r308055. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Fri Feb 10 17:41:16 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2059DCD8650 for ; Fri, 10 Feb 2017 17:41:16 +0000 (UTC) (envelope-from dpchrist@holgerdanske.com) Received: from holgerdanske.com (holgerdanske.com [184.105.128.27]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.he.net", Issuer "GeoTrust SSL CA - G4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 1182EB3E for ; Fri, 10 Feb 2017 17:41:15 +0000 (UTC) (envelope-from dpchrist@holgerdanske.com) Received: from ::ffff:99.100.19.101 ([99.100.19.101]) by holgerdanske.com with ESMTPSA (AES128-SHA:SSLv3:Kx=RSA:Au=RSA:Enc=AES(128):Mac=SHA1) (SMTP-AUTH username dpchrist@holgerdanske.com, mechanism PLAIN) for ; Fri, 10 Feb 2017 09:41:11 -0800 Subject: Re: FreeBSD 11 and 4+ GB files on optical disc To: freebsd-fs@freebsd.org References: <20170210031741.3d4348f6.freebsd@edvax.de> <4b4145c4-1381-0b95-0e06-46affbb6d851@holgerdanske.com> <20170210101633.4d5da7df@ernst.home> From: David Christensen Message-ID: <7827d6b5-dc0f-21a9-873d-6356986485a5@holgerdanske.com> Date: Fri, 10 Feb 2017 09:41:14 -0800 User-Agent: Mozilla/5.0 (X11; FreeBSD i386; rv:45.0) Gecko/20100101 Thunderbird/45.6.0 MIME-Version: 1.0 In-Reply-To: <20170210101633.4d5da7df@ernst.home> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Feb 2017 17:41:16 -0000 On 02/10/17 01:16, Gary Jennejohn wrote: Thanks for the reply. :-) > On Thu, 9 Feb 2017 23:22:23 -0800 > David Christensen wrote: >> I've been creating DVD and BD discs with files larger than 4 GB on Linux. I can read them fine on Linux and Microsoft Windows. But, I can't read them correctly on FreeBSD. >> Apparently, this is a feature. > No, it's an option. Look for UDF in /sys/conf/NOTES. toor@freebsd:/root # less /sys/conf/NOTES # NOTES -- Lines that can be cut/pasted into kernel and hints configs. ... # FILESYSTEM OPTIONS ... # The rest are optional: ... options UDF #Universal Disk Format I am running the stock kernel. RTFM: https://www.freebsd.org/doc/en_US.ISO8859-1/books/handbook/kernelconfig.html Check the kernel configuration: toor@freebsd:/root # egrep 'option.+UDF' /usr/src/sys/i386/conf/GENERIC It appears UDF is not included in the i386 GENERIC kernel. While I should be able to figure out how to build a custom kernel, but these are archive discs and I would prefer a solution that works OOTB. Failing that, with minimum additional software/ effort. > There's also /usr/ports/sysutils/udfclient, but I'd be inclined to use > the kernel options. I've had UDF in my kernel for years. I've been using packages: toor@freebsd:/root # pkg search udfclient udfclient-0.7.5_1 Tools for UDF filesystem toor@freebsd:/root/freebsd.holgerdanske.com # pkg install udfclient ... toor@freebsd:/root # /etc/periodic/weekly/310.locate ... toor@freebsd:/root # makewhatis RTFM -- nope: toor@freebsd:/root # man udfclient No manual entry for udfclient Look for udfclient files: toor@freebsd:/root # locate udfclient /usr/local/bin/udfclient /usr/ports/sysutils/udfclient /usr/ports/sysutils/udfclient/Makefile /usr/ports/sysutils/udfclient/distinfo /usr/ports/sysutils/udfclient/files /usr/ports/sysutils/udfclient/files/patch-uscsi_subr.c /usr/ports/sysutils/udfclient/pkg-descr /var/cache/pkg/udfclient-0.7.5_1-96e70f06e7.txz /var/cache/pkg/udfclient-0.7.5_1.txz Try online help -- not for noobs: toor@freebsd:/root # udfclient --help udfclient: illegal option -- - Usage: udfclient [options] devicename [devicename]*) -u level UDF system verbose level -r range use only selected sessions like -3,5,7 or 6- -W allow writing (temporary flag) -F force mount writable when marked dirty (use with cause) -b blocksize use alternative sectorsize; use only on files/discs -D debug/verbose SCSI command errors -s byteswap read sectors (for PVRs) STFW -- like an FTP client, eh? http://freecode.com/projects/udfclient WAG: toor@freebsd:/root # umount /dev/cd0 Close Thunar. Eject disc. Insert disc. toor@freebsd:/root # udfclient /dev/cd0 bufcache thread initialising Opening device /dev/cd0 UDF Dump of disc in device /dev/cd0 UDF sessions : No No Resulting list of alive sets : UDF volume sets marked alive : Directory listing of / UDF working directory is / Current FS working directory /root UDF> help Selected commands available (use " pair for filenames with spaces) : ls [file | dir] lists the UDF directory cd [dir] change current UDF directory lcd [dir] change current directory lls lists current directory pwd display current directories free display free space on disc get source [dest] retrieve a file / directory from disc mget (file | dir)* retrieve set of files / directories put source [dest] write a file / directory to disc mput (file | dir)* write a set of files / directories trunc file length trunc file to length mkdir dir create directory rm (file | dir)* delete set of files / directories mv source dest rename a file (limited) sync sync filingsystem quit exits program exit alias for quit UDF> ls Directory listing of / UDF> sync UDF> ls Directory listing of / UDF> free Can only report free space in UDF mountpoints UDF> quit Closing discs It appears udfclient can't see the DVD contents (?). David From owner-freebsd-fs@freebsd.org Fri Feb 10 18:23:03 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 90438CD9426 for ; Fri, 10 Feb 2017 18:23:03 +0000 (UTC) (envelope-from dpchrist@holgerdanske.com) Received: from holgerdanske.com (holgerdanske.com [IPv6:2001:470:0:19b::b869:801b]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.he.net", Issuer "GeoTrust SSL CA - G4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 7FDD1879 for ; Fri, 10 Feb 2017 18:23:03 +0000 (UTC) (envelope-from dpchrist@holgerdanske.com) Received: from ::ffff:99.100.19.101 ([99.100.19.101]) by holgerdanske.com with ESMTPSA (AES128-SHA:SSLv3:Kx=RSA:Au=RSA:Enc=AES(128):Mac=SHA1) (SMTP-AUTH username dpchrist@holgerdanske.com, mechanism PLAIN) for ; Fri, 10 Feb 2017 10:23:00 -0800 From: David Christensen Subject: Re: [dm-crypt] crypetsetup and GPT partitions To: freebsd-fs@freebsd.org References: <1f86c8f792254594b9f2de8706b05a38@useimail1301.ATL.CW.LOCAL> <6c94de98-9eb1-98d8-a916-1a554eb5b56c@holgerdanske.com> <20170210090753.GQ5418@yeono.kjorling.se> <2a5021f8-ef04-46fd-3696-fde01d5c7ea2@holgerdanske.com> <364af67e-05ca-2527-37a9-c157174ce1b6@whgl.uni-frankfurt.de> Message-ID: <1e0634d6-c880-7282-0f49-c4d96c3dfc2d@holgerdanske.com> Date: Fri, 10 Feb 2017 10:23:02 -0800 User-Agent: Mozilla/5.0 (X11; FreeBSD i386; rv:45.0) Gecko/20100101 Thunderbird/45.6.0 MIME-Version: 1.0 In-Reply-To: <364af67e-05ca-2527-37a9-c157174ce1b6@whgl.uni-frankfurt.de> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Feb 2017 18:23:03 -0000 On 02/10/17 08:22, Sven Eschenberg wrote: > Am 10.02.2017 um 17:05 schrieb David Christensen: >> On 02/10/17 01:07, Michael Kjörling wrote: >>> On 10 Feb 2017 00:15 -0800, from dpchrist@holgerdanske.com (David >>> Christensen): >>>> The available space of the LUKS mapped device is going to be smaller >>>> than the partition size. On one of my 3 TB drives, it's about ~44 >>>> GB smaller (~1.6%). The LUKS meta-data is going to be in there, >>>> including the header. >>> >>> That doesn't make sense. The LUKS header is a shade over 1 MiB, >>> depending on the specific options (the FAQ has details). The size of >>> the header isn't related to the size of the container. Something else >>> is going on in your case. >> >> Here's the data: >> >> 2017-02-10 07:38:40 root@cd2533 ~ >> # parted /dev/sda u s p >> Model: ATA ST3000DM001-1ER1 (scsi) >> Disk /dev/sda: 5860533168s >> Sector size (logical/physical): 512B/4096B >> Partition Table: gpt >> >> Number Start End Size File system Name Flags >> 1 2048s 5860532223s 5860530176s primary >> >> 2017-02-10 07:40:57 root@cd2533 ~ >> # df | egrep 'File|mnt' >> Filesystem 1K-blocks Used Available Use% Mounted on >> /dev/mapper/i3000d_crypt 2884281560 848596104 1889172304 31% /mnt/i3000d >> >> >> Here's the math: >> >> 5860530176 s / (2 s/kB) - 2884281560 kB >> = 2930265088 kB - 2884281560 kB >> = 45983528 kB >> ~= 44905.8 MB > That's the size of the filesystem afterall. D'oh! > Lookt at blockdev --report to see the blockdev sizes (i.e. physical > disk, partition, crypt device). RTFM blockdev(8): 2017-02-10 10:01:08 root@cd2533 ~ # blockdev --report /dev/sda /dev/sda1 /dev/mapper/i3000d_crypt RO RA SSZ BSZ StartSec Size Device rw 256 512 4096 0 3000592982016 /dev/sda rw 256 512 4096 2048 3000591450112 /dev/sda1 rw 256 512 4096 0 3000589352960 /dev/mapper/i3000d_crypt So, it looks like LUKS consumes: 3000591450112 - 3000589352960 = 2097152 = 2 MB Thanks for the correction. :-) > Check against dmsetup RTFM dmsetup(8): 2017-02-10 10:14:06 root@cd2533 ~ # dmsetup info /dev/mapper/i3000d_crypt Name: i3000d_crypt State: ACTIVE Read Ahead: 256 Tables present: LIVE Open count: 1 Event number: 1 Major, minor: 254, 2 Number of targets: 1 UUID: CRYPT-LUKS1--i3000d_crypt_unformatted > --table RTFM dmsetup(8), the --table option requires a value. WAG: 2017-02-10 10:14:17 root@cd2533 ~ # dmsetup info --table LIVE /dev/mapper/i3000d_crypt Name: i3000d_crypt State: ACTIVE Read Ahead: 256 Tables present: LIVE Open count: 1 Event number: 1 Major, minor: 254, 2 Number of targets: 1 UUID: CRYPT-LUKS1--i3000d_crypt_unformatted I'm not sure what I am checking... David From owner-freebsd-fs@freebsd.org Fri Feb 10 18:46:41 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4D851CD99EB for ; Fri, 10 Feb 2017 18:46:41 +0000 (UTC) (envelope-from fjwcash@gmail.com) Received: from mail-qk0-x22f.google.com (mail-qk0-x22f.google.com [IPv6:2607:f8b0:400d:c09::22f]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 0F69F14EE for ; Fri, 10 Feb 2017 18:46:41 +0000 (UTC) (envelope-from fjwcash@gmail.com) Received: by mail-qk0-x22f.google.com with SMTP id u25so48545694qki.2 for ; Fri, 10 Feb 2017 10:46:41 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=iKpyIRH7VtZpS9JiqMoYDu8aHCz71/2eppUCp7fnfGk=; b=kYDOuzNvJdvTta0CISknnhybGFb/Hh5mOF69wKbMQ2evTDmZT0/3WP8X8QGNIe+zE9 1gmJkwAr4XfHP+4ATJBkWMNaSoP9XIgnAbeC7b2gEaaYwqCu0MTRXpcXBFSIEZ813iQn 2jfd0RaOcCqqKt8k8QxTQrjTQeeZwX31lEQXBfK5YYm/ZRV8kjZ2mYuomoa9/0YwG7Py qLUmIlBN/xY9yNjfeQnwkUUUHb5eV6/+TUFVFVUmpOVg79pZpc3UjAmBqPe/P+DvqX6C +aaeTJT9ytn4pSwgVao+x5k+IU4Jfrs/ovcC6HZrmlRuJ6EPakTV90ik4XHKaKbhtcqN Pb0Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=iKpyIRH7VtZpS9JiqMoYDu8aHCz71/2eppUCp7fnfGk=; b=s5fLCUpHytpO4tk6w8J79D4Z6ujrHgMHD7x1V6Rktw3oyYkj1jegPuqGid/B0YHnBf fpbT+9DTTWpgh4E4H30uavt6IChq/ZX5jjgSFU06d7gO1xgey44aOecH92rvKr5ysN62 /r9i0yz9YdmOzOkrI8XVSIorMOUu93LCfdfMW6sPIP+n9JPH5Cg3cIHDWp1LDAW+pMyR 6d5smAEsABga9gjfYTCtdFO1Gm2gLMI/ySJYHlJdOiyPdv4VRFAyL1iNBEa4D+txPgOp z9+z5RoyjSPi7lPpZYDEY1zGhGK0pYWsFG9IY4WVFGjUm4UQ6KppPOqWpgG71YCIn9KF 33uw== X-Gm-Message-State: AMke39ngamRDlRDH5vzjaWY2kCnjWSa4bCr9mSZgVNyQ39AWh2Zk/4KWmhMGEATE8fMJqombxplQtBKEzWp+Pg== X-Received: by 10.55.203.213 with SMTP id u82mr9129275qkl.10.1486752400183; Fri, 10 Feb 2017 10:46:40 -0800 (PST) MIME-Version: 1.0 Received: by 10.140.28.202 with HTTP; Fri, 10 Feb 2017 10:46:39 -0800 (PST) In-Reply-To: <7827d6b5-dc0f-21a9-873d-6356986485a5@holgerdanske.com> References: <20170210031741.3d4348f6.freebsd@edvax.de> <4b4145c4-1381-0b95-0e06-46affbb6d851@holgerdanske.com> <20170210101633.4d5da7df@ernst.home> <7827d6b5-dc0f-21a9-873d-6356986485a5@holgerdanske.com> From: Freddie Cash Date: Fri, 10 Feb 2017 10:46:39 -0800 Message-ID: Subject: Re: FreeBSD 11 and 4+ GB files on optical disc To: David Christensen Cc: FreeBSD Filesystems Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Feb 2017 18:46:41 -0000 # kldload udf # mount -t udf /dev/cd0 /mnt You RTFM'd the wrong M. ;) Pretty much every option can be loaded as a module at runtime nowadays. I found this by doing a simple: # ls /boot/kernel/*udf* There's also a mount_udf(8) man page to read through. There are some limitations to UDF in FreeBSD, though. It's not the latest version, and I don't think you can write to it (although it's been a long time since I've used UDF). But you should definitely be able to mount and read files from UDF-formatted DVDs. Maybe even Blu-Ray, although I've never attached a BD-ROM drive to a computer of any kind. -- Freddie Cash fjwcash@gmail.com From owner-freebsd-fs@freebsd.org Fri Feb 10 20:31:39 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BC1ACCD9995 for ; Fri, 10 Feb 2017 20:31:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id ABDB7175F for ; Fri, 10 Feb 2017 20:31:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v1AKVdtw019703 for ; Fri, 10 Feb 2017 20:31:39 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 216964] boot1.efi: can't boot from ZFS on 4kn HDD Date: Fri, 10 Feb 2017 20:31:39 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Feb 2017 20:31:39 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D216964 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|freebsd-bugs@FreeBSD.org |freebsd-fs@FreeBSD.org CC|freebsd-amd64@FreeBSD.org | --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Sat Feb 11 22:42:15 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 410E8CDBF93 for ; Sat, 11 Feb 2017 22:42:15 +0000 (UTC) (envelope-from universite@ukr.net) Received: from frv191.fwdcdn.com (frv191.fwdcdn.com [212.42.77.191]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 03B701F68 for ; Sat, 11 Feb 2017 22:42:14 +0000 (UTC) (envelope-from universite@ukr.net) Received: from [10.10.1.26] (helo=frv197.fwdcdn.com) by frv191.fwdcdn.com with esmtp ID 1ccg5U-0002oh-RW for freebsd-fs@freebsd.org; Sun, 12 Feb 2017 00:24:12 +0200 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=ukr.net; s=ffe; h=Content-Transfer-Encoding:Content-Type:MIME-Version:Message-Id:To: Subject:From:Date:Sender:Reply-To:Cc:Content-ID:Content-Description: Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID: In-Reply-To:References:List-Id:List-Help:List-Unsubscribe:List-Subscribe: List-Post:List-Owner:List-Archive; bh=IzdL7WIM7dA+Dpkjy2JABukk1HpjAp5NYnprwm6CFjw=; b=bNnSbKKNtKAkQE2VdrV+n2zhCj 6jCAcb5zen7AtoEiHyVAQS25wlFrYLgSRlCIJhDvrzSmOi4w66AFzKWTX2w8yT65herP3xVqqO8se 7oFoViWcNpr5ZjzWuqzK6xsDAOthOw5npMg37jR+sWLTW61xzY0PNFpArWYsk3ZJQERk=; Received: from [10.10.10.34] (helo=frv34.fwdcdn.com) by frv197.fwdcdn.com with smtp ID 1ccg5M-000EJ8-EA for freebsd-fs@freebsd.org; Sun, 12 Feb 2017 00:24:04 +0200 Date: Sun, 12 Feb 2017 00:24:04 +0200 From: Vladislav Prodan Subject: There were errors in the log during boot - g_dev_taste: make_dev_p() failed (gp->name=ada0s1, error=17) To: freebsd-fs@freebsd.org X-Mailer: mail.ukr.net 5.0 Message-Id: <1486850938.76323789.nbh6hthn@frv34.fwdcdn.com> Received: from universite@ukr.net by frv34.fwdcdn.com; Sun, 12 Feb 2017 00:24:04 +0200 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: binary Content-Disposition: inline X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 11 Feb 2017 22:42:15 -0000 Hello. I have a server: FreeBSD 11.0-STABLE #1 r313648: Sat Feb 11 22:48:45 EET 2017 root@wally2-bras:/usr/obj/usr/src/sys/BRAS amd64 After adding GEOM options in the config of kernel: ... # Geom options: options GEOM_AES # Don't use, use GEOM_BDE options GEOM_BDE # Disk encryption. options GEOM_BSD # BSD disklabels options GEOM_CACHE # Disk cache. options GEOM_CONCAT # Disk concatenation. options GEOM_ELI # Disk encryption. options GEOM_FOX # Redundant path mitigation options GEOM_GATE # Userland services. options GEOM_JOURNAL # Journaling. options GEOM_LABEL # Providers labelization. options GEOM_LINUX_LVM # Linux LVM2 volumes options GEOM_MBR # DOS/MBR partitioning options GEOM_MIRROR # Disk mirroring. options GEOM_MULTIPATH # Disk multipath options GEOM_NOP # Test class. options GEOM_PART_APM # Apple partitioning options GEOM_PART_BSD # BSD disklabel options GEOM_PART_BSD64 # BSD disklabel64 options GEOM_PART_EBR # Extended Boot Records options GEOM_PART_EBR_COMPAT # Backward compatible partition names options GEOM_PART_GPT # GPT partitioning options GEOM_PART_LDM # Logical Disk Manager options GEOM_PART_MBR # MBR partitioning options GEOM_PART_PC98 # PC-9800 disk partitioning options GEOM_PART_VTOC8 # SMI VTOC8 disk label options GEOM_PC98 # NEC PC9800 partitioning options GEOM_RAID # Soft RAID functionality. options GEOM_RAID3 # RAID3 functionality. options GEOM_SHSEC # Shared secret. options GEOM_STRIPE # Disk striping. options GEOM_SUNLABEL # Sun/Solaris partitioning options GEOM_UZIP # Read-only compressed disks options GEOM_VINUM # Vinum logical volume manager options GEOM_VIRSTOR # Virtual storage. options GEOM_VOL # Volume names from UFS superblock options GEOM_ZERO # Performance testing helper. ... There were errors in the log during boot: ... Feb 11 20:30:55 wally2-bras kernel: Trying to mount root from ufs:/dev/ada0s1a [rw]... Feb 11 20:30:55 wally2-bras kernel: g_dev_taste: make_dev_p() failed (gp->name=ada0s1, error=17) Feb 11 20:30:55 wally2-bras kernel: g_dev_taste: make_dev_p() failed (gp->name=diskid/DISK-CVTR54150561056FGNs1, error=17) Feb 11 20:30:55 wally2-bras kernel: GEOM: ada0s1a: invalid disklabel. Feb 11 20:30:55 wally2-bras kernel: g_dev_taste: make_dev_p() failed (gp->name=ada0s1a, error=17) Feb 11 20:30:55 wally2-bras kernel: g_dev_taste: make_dev_p() failed (gp->name=ada0s1b, error=17) Feb 11 20:30:55 wally2-bras kernel: g_dev_taste: make_dev_p() failed (gp->name=ada0s1a, error=17) Feb 11 20:30:55 wally2-bras kernel: GEOM: ada0s1a: invalid disklabel. Feb 11 20:30:55 wally2-bras kernel: g_dev_taste: make_dev_p() failed (gp->name=ada0s1b, error=17) Feb 11 20:30:55 wally2-bras kernel: g_dev_taste: make_dev_p() failed (gp->name=ada0s1c, error=17) Feb 11 20:30:55 wally2-bras kernel: g_dev_taste: make_dev_p() failed (gp->name=ada0s1a, error=17) Feb 11 20:30:55 wally2-bras kernel: g_dev_taste: make_dev_p() failed (gp->name=ada0s1b, error=17) Feb 11 20:30:55 wally2-bras kernel: GEOM: diskid/DISK-CVTR54150561056FGNs1a: invalid disklabel. Feb 11 20:30:55 wally2-bras kernel: g_dev_taste: make_dev_p() failed (gp->name=diskid/DISK-CVTR54150561056FGNs1a, error=17) Feb 11 20:30:55 wally2-bras kernel: g_dev_taste: make_dev_p() failed (gp->name=diskid/DISK-CVTR54150561056FGNs1b, error=17) Feb 11 20:30:55 wally2-bras kernel: g_dev_taste: make_dev_p() failed (gp->name=diskid/DISK-CVTR54150561056FGNs1a, error=17) Feb 11 20:30:55 wally2-bras kernel: GEOM: diskid/DISK-CVTR54150561056FGNs1a: invalid disklabel. Feb 11 20:30:55 wally2-bras kernel: g_dev_taste: make_dev_p() failed (gp->name=diskid/DISK-CVTR54150561056FGNs1b, error=17) Feb 11 20:30:55 wally2-bras kernel: g_dev_taste: make_dev_p() failed (gp->name=diskid/DISK-CVTR54150561056FGNs1c, error=17) Feb 11 20:30:55 wally2-bras kernel: g_dev_taste: make_dev_p() failed (gp->name=diskid/DISK-CVTR54150561056FGNs1a, error=17) Feb 11 20:30:55 wally2-bras kernel: g_dev_taste: make_dev_p() failed (gp->name=diskid/DISK-CVTR54150561056FGNs1b, error=17) Feb 11 20:30:55 wally2-bras kernel: GEOM: ufsid/587895734db55341: invalid disklabel. Feb 11 20:30:55 wally2-bras kernel: g_dev_taste: make_dev_p() failed (gp->name=ada0s1ca, error=17) Feb 11 20:30:55 wally2-bras kernel: g_dev_taste: make_dev_p() failed (gp->name=ada0s1cb, error=17) Feb 11 20:30:55 wally2-bras kernel: g_dev_taste: make_dev_p() failed (gp->name=ada0s1aa, error=17) Feb 11 20:30:55 wally2-bras kernel: g_dev_taste: make_dev_p() failed (gp->name=ada0s1ab, error=17) Feb 11 20:30:55 wally2-bras kernel: g_dev_taste: make_dev_p() failed (gp->name=ada0s1ac, error=17) Feb 11 20:30:55 wally2-bras kernel: g_dev_taste: make_dev_p() failed (gp->name=diskid/DISK-CVTR54150561056FGNs1ca, error=17) Feb 11 20:30:55 wally2-bras kernel: g_dev_taste: make_dev_p() failed (gp->name=diskid/DISK-CVTR54150561056FGNs1cb, error=17) Feb 11 20:30:55 wally2-bras kernel: g_dev_taste: make_dev_p() failed (gp->name=diskid/DISK-CVTR54150561056FGNs1aa, error=17) Feb 11 20:30:55 wally2-bras kernel: g_dev_taste: make_dev_p() failed (gp->name=diskid/DISK-CVTR54150561056FGNs1ab, error=17) Feb 11 20:30:55 wally2-bras kernel: g_dev_taste: make_dev_p() failed (gp->name=diskid/DISK-CVTR54150561056FGNs1ac, error=17) Feb 11 20:30:55 wally2-bras kernel: GEOM: ada0s1a: invalid disklabel. Feb 11 20:30:55 wally2-bras kernel: GEOM: ufsid/587895734db55341: invalid disklabel. ... SSD drive marks out through bsdinstall. For some reason, then do not create field rawuuid and label... # gpart show => 0 109051904 ada0s1c BSD (52G) 0 102760448 1 freebsd-ufs (49G) 102760448 5451776 2 freebsd-swap (2.6G) 108212224 839680 - free - (410M) # gpart list Geom name: ada0s1c modified: false state: OK fwheads: 16 fwsectors: 63 last: 109051903 first: 0 entries: 8 scheme: BSD Providers: 1. Name: ada0s1ca Mediasize: 52613349376 (49G) Sectorsize: 512 Stripesize: 4096 Stripeoffset: 0 Mode: r0w0e0 rawtype: 7 length: 52613349376 offset: 0 type: freebsd-ufs index: 1 end: 102760447 start: 0 2. Name: ada0s1cb Mediasize: 2791309312 (2.6G) Sectorsize: 512 Stripesize: 4096 Stripeoffset: 0 Mode: r0w0e0 rawtype: 1 length: 2791309312 offset: 52613349376 type: freebsd-swap index: 2 end: 108212223 start: 102760448 Consumers: 1. Name: ada0s1c Mediasize: 55834574848 (52G) Sectorsize: 512 Stripesize: 4096 Stripeoffset: 0 Mode: r0w0e0 How to remove these errors? Thanks! -- Vladislav V. Prodan System & Network Administrator support.od.ua