From owner-freebsd-questions@freebsd.org Tue Aug 31 06:47:05 2021 Return-Path: Delivered-To: freebsd-questions@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id AA536666EC4 for ; Tue, 31 Aug 2021 06:47:05 +0000 (UTC) (envelope-from dpchrist@holgerdanske.com) Received: from holgerdanske.com (holgerdanske.com [IPv6:2001:470:0:19b::b869:801b]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "holgerdanske.com", Issuer "holgerdanske.com" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4GzHmS0tqZz3kGW for ; Tue, 31 Aug 2021 06:47:04 +0000 (UTC) (envelope-from dpchrist@holgerdanske.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=holgerdanske.com; s=nov-20210719-112354; t=1630392415; bh=m9ji4YSxVh/XFlRhdmw16/sbOgXYptbsQ+az6BqjbIA=; h=Received:From:Subject:To:References:Message-ID:Date:User-Agent: MIME-Version:In-Reply-To:Content-Type:Content-Language: Content-Transfer-Encoding; b=ERWxkGWkkrcvdO5Kqfzv/cImoidhuC0dcknxZDZ6PIzzY+iU2x+/TsCLg1GYnUCjz FRxdVPId3eStdzKh6//SOZd5T3XG9UI2b8ZLI+KCRAMNOJw8xVMVOs9Vpapo4WzbJT w822sb9EhqxkW6L6wkf8zkBjxfPjl+uSRyOWPtOknxPYQjdxJ1SP6XbsSrEjFNoOF0 fH0sQtNdCV1wmSDCSIrqteSq9dNhC1z9/IBKh2pnTE5ZVBi1z/msw9GPgj/bPN5JuX PBRbC0/uFTE8Gj2We2+aaFBL0tIP1pLntqyKq7m7diX9ncAMfssy8kmPC0jMf9U2PC cxoIqslp8kpvAcMd5DXP/PRMarVIzEIbdHwmNjNYGHBTC1AsoZJ80Kx2JcT7pEpaxH VNsYdezYh9KIZogoOdP2xu9ElgW3tqYJWSRGN92VRbhXIqd1VPbbcXrVtwUGpC/ViO O4V4ISw0ihrrlrILBbEAWPq7e+zOVzS5NP81Y35b0gjdK4Q96VlFZ0iekO9nU9w9OA Wptak3P0mqZ2YB+UMamF0EXvTGLXM2/OxdeRPehCnf0oWxlBcGa2UrO/j4cT02alox NKoFhxHsOcDIxN3ufXcqmEEb8MYHAXfde5W1FpGE+4zHhgkCn64snYdElzudPLsYSd xOlAxCxCNruK7LD0cJw6JM8E= Received: from 99.100.19.101 (99-100-19-101.lightspeed.frokca.sbcglobal.net [99.100.19.101]) by holgerdanske.com with ESMTPSA (TLS_AES_128_GCM_SHA256:TLSv1.3:Kx=any:Au=any:Enc=AESGCM(128):Mac=AEAD) (SMTP-AUTH username dpchrist@holgerdanske.com, mechanism PLAIN) for ; Mon, 30 Aug 2021 23:46:55 -0700 From: David Christensen Subject: Re: FreeBSD 12.2-RELEASE-p9 trim (ZFS, not OpenZFS): open failed: /dev/ada0: Operation not permitted To: freebsd-questions@freebsd.org References: <5a1ae42f-d0f7-beb9-fb21-a83e7e8fe06d@gmail.com> <6832fcb4-42d1-efc9-e2cb-7e2df606d8ce@gmail.com> Message-ID: <3d4df331-9795-fd58-d246-3793b0b8690d@holgerdanske.com> Date: Mon, 30 Aug 2021 23:46:54 -0700 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:78.0) Gecko/20100101 Thunderbird/78.13.0 MIME-Version: 1.0 In-Reply-To: <6832fcb4-42d1-efc9-e2cb-7e2df606d8ce@gmail.com> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: 4GzHmS0tqZz3kGW X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=holgerdanske.com header.s=nov-20210719-112354 header.b=ERWxkGWk; dmarc=pass (policy=none) header.from=holgerdanske.com; spf=pass (mx1.freebsd.org: domain of dpchrist@holgerdanske.com designates 2001:470:0:19b::b869:801b as permitted sender) smtp.mailfrom=dpchrist@holgerdanske.com X-Spamd-Result: default: False [-3.30 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[holgerdanske.com:s=nov-20210719-112354]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+a:november.he.net]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-questions@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; DKIM_TRACE(0.00)[holgerdanske.com:+]; DMARC_POLICY_ALLOW(-0.50)[holgerdanske.com,none]; NEURAL_HAM_SHORT(-0.30)[-0.296]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:6939, ipnet:2001:470::/32, country:US]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-questions]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 31 Aug 2021 06:47:05 -0000 On 8/30/21 7:46 PM, Graham Perrin wrote: > On 31/08/2021 02:06, David Christensen wrote: >> On 8/30/21 2:16 AM, Graham Perrin wrote: >>> On 30/08/2021 08:45, David Christensen wrote: >>> >>>> … created with FreeBSD-12.1-RELEASE-amd64-memstick on a USB flash >>>> drive with ZFS boot, encrypted swap, and encrypted ZFS root. >>>> ZFS kernel module is loaded: >>>> >>>> 2021-08-30 00:30:42 toor@f3 ~ >>>> # kldstat >>>> Id Refs Address                Size Name >>>>  1   23 0xffffffff80200000  227ae98 kernel >>>>  2    1 0xffffffff8247c000    1e7b0 geom_eli.ko >>>>  3    2 0xffffffff8249b000     a448 opensolaris.ko >>>>  4    1 0xffffffff824a8000     ee98 aesni.ko >>>>  5    1 0xffffffff824b7000   3bad38 zfs.ko >>>>  6    1 0xffffffff82872000    27c00 geom_mirror.ko >>>>  7    1 0xffffffff8289a000    27ce8 fuse.ko >>>>  8    1 0xffffffff82b21000      acf mac_ntpd.ko >> I installed the package "openzfs": >> 2021-08-30 18:01:18 toor@f2 ~ >> # zpool trim bootpool 2>&1 | head -n 1 >> unrecognized command 'trim' >> 2021-08-30 18:01:22 toor@f2 ~ >> # kldload openzfs >> kldload: an error occurred while loading module openzfs. Please check >> dmesg(8) for more details. >> >> 2021-08-30 18:02:10 toor@f2 ~ >> # dmesg | tail -n 2 >> interface zfsctrl.1 already present in the KLD 'zfs.ko'! >> linker_load_file: /boot/modules/openzfs.ko - unsupported file type > % pkg query %M openzfs openzfs-kmod > > > % > > – strange; openzfs-kmod should probably have a package message. I also get no output: 2021-08-30 23:40:44 toor@f2 ~ # pkg query %M openzfs openzfs-kmod But the packages are there: 2021-08-30 23:42:17 toor@f2 ~ # pkg query %n openzfs openzfs-kmod openzfs openzfs-kmod > /boot/loader.conf can be edited to include: > > zfs_load="NO" > openzfs_load="YES" 2021-08-30 23:42:35 toor@f2 ~ # grep -i zfs /boot/loader.conf vfs.root.mountfrom="zfs:f2_zroot/ROOT/default" zpool_cache_type="/boot/zfs/zpool.cache" zpool_cache_name="/boot/zfs/zpool.cache" zfs_load="YES" > – HOWEVER I recommend creating then activating a new boot environment > before doing so (and before any future update to 12.0-RELEASE). Given > the possibility of the pre-packaged kernel module not working, be > prepared to build and install from ports. I do packages. > (If the module will not load, you'll be unable to boot. If this happens, > you can boot a good environment then use `bectl mount` to temporarily > access the affected environment, then revert the two lines in its > loader.conf.) > > If the pool will require an upgrade, for what you'd like to do with > TRIM, be extremely cautious about upgrading a FreeBSD 12 boot pool. I wanted to do a trim before taking an image, to reduce the image size. I guess I'll just throw hard drives are the problem for now. Thank you for your suggestions. :-) David