From owner-freebsd-questions@freebsd.org Tue Aug 31 02:47:04 2021 Return-Path: Delivered-To: freebsd-questions@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 5231966310F for ; Tue, 31 Aug 2021 02:47:04 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Received: from mail-wm1-x32c.google.com (mail-wm1-x32c.google.com [IPv6:2a00:1450:4864:20::32c]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4GzBRW3QKtz3HFV for ; Tue, 31 Aug 2021 02:47:03 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Received: by mail-wm1-x32c.google.com with SMTP id c8-20020a7bc008000000b002e6e462e95fso814318wmb.2 for ; Mon, 30 Aug 2021 19:47:03 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=subject:to:references:from:message-id:date:user-agent:mime-version :in-reply-to:content-transfer-encoding:content-language; bh=MnYmRjlRCKWGr+v82QR2MAikFoeSOj7bYAWodzyode4=; b=paFgR6YTP3yVD8whsWwvPyvQbz9dLT7GPC70bSXzgaRbVhIMRc+fgX263QbLiqUOMk Bq03YxihhVLawEO+piGJouVkWH3Z4pdleyqXg3b6wGg6tG/H7UtKpMfJIUP2t0G4eiy6 dYM97HRvGdSHKwD5LLo3cnjCjmEVV3FAgYc5GCV3aJUhU7RGgEuP51JubyOECN4Hrobd QmK1kfvQxgeQF14XCrdoswiDKOCtRZ6KMaqnD1Dw4vpc5KcorZ8La0iPU4FlhZCLpSzN pKVTFj4azfP933wI5E2G1CSWVMUT1Beg3a9x8hSIErIjBmpwIeF7mOzYq/VC6RRSzC6Q xsOQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-transfer-encoding :content-language; bh=MnYmRjlRCKWGr+v82QR2MAikFoeSOj7bYAWodzyode4=; b=o6L6m4Zj0RMjujnHBTc1EhqULZsOcMXZHxtq8KsiHjb1iC0oNYszaubrhBpl9U6w+5 zZ/hXFfWIgKk9lXJav3TofW/qiwAkUXYCPhICvec6MUdRWlkr0UwrPPLldCpAxnofbcN FgAYItZ9pTAYUSCyYtjcXhZ3D2geSLIwHUKZqyjRbjpB2pXh3knpuL0sd84Ya4mS2ZY1 uf3FQ1bxYBlJ1/xD9DR2WMiONrQQgo1nNfcestHR9zZP6B84F3fD2T5Ze4FVZXj+fg6l oeaJvFoMxmcxL1EIQ+QtG5DMSI5XgYU8SOJ2sbdNX93oovGcwRcw7s98TSF60U/zTRtA 69bQ== X-Gm-Message-State: AOAM530mWUTyekfP1hJcyv1S9GDuhzszc/6N5l0bCol8zP1iW7TGTXIL T2dPdfQKodZb/ApCuTZ9dbpR0WAAtTip9Q== X-Google-Smtp-Source: ABdhPJxWx4mk5vdfE2iIABzTToUDzcRgnUrli0N0PElCYX5U6A0DC9gI2A2SPbLFyYRClvJpsDkF+g== X-Received: by 2002:a1c:21c3:: with SMTP id h186mr1768528wmh.186.1630378020924; Mon, 30 Aug 2021 19:47:00 -0700 (PDT) Received: from ?IPv6:2001:470:1f1c:a0::2? (tunnel642390-pt.tunnel.tserv1.lon2.ipv6.he.net. [2001:470:1f1c:a0::2]) by smtp.gmail.com with ESMTPSA id r16sm13190340wrg.71.2021.08.30.19.47.00 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Mon, 30 Aug 2021 19:47:00 -0700 (PDT) Subject: Re: FreeBSD 12.2-RELEASE-p9 trim (ZFS, not OpenZFS): open failed: /dev/ada0: Operation not permitted To: freebsd-questions@freebsd.org References: <5a1ae42f-d0f7-beb9-fb21-a83e7e8fe06d@gmail.com> From: Graham Perrin Message-ID: <6832fcb4-42d1-efc9-e2cb-7e2df606d8ce@gmail.com> Date: Tue, 31 Aug 2021 03:46:59 +0100 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:78.0) Gecko/20100101 Thunderbird/78.13.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Content-Language: en-GB X-Rspamd-Queue-Id: 4GzBRW3QKtz3HFV X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=paFgR6YT; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of grahamperrin@gmail.com designates 2a00:1450:4864:20::32c as permitted sender) smtp.mailfrom=grahamperrin@gmail.com X-Spamd-Result: default: False [-4.00 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-questions@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::32c:from]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-questions] X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 31 Aug 2021 02:47:04 -0000 On 31/08/2021 02:06, David Christensen wrote: > On 8/30/21 2:16 AM, Graham Perrin wrote: >> On 30/08/2021 08:45, David Christensen wrote: >> >>> … created with FreeBSD-12.1-RELEASE-amd64-memstick on a USB flash >>> drive with ZFS boot, encrypted swap, and encrypted ZFS root. >>> >>> >>>> If so: with or without OpenZFS kernel module? >>> >>> >>> ZFS kernel module is loaded: >>> >>> 2021-08-30 00:30:42 toor@f3 ~ >>> # kldstat >>> Id Refs Address                Size Name >>>  1   23 0xffffffff80200000  227ae98 kernel >>>  2    1 0xffffffff8247c000    1e7b0 geom_eli.ko >>>  3    2 0xffffffff8249b000     a448 opensolaris.ko >>>  4    1 0xffffffff824a8000     ee98 aesni.ko >>>  5    1 0xffffffff824b7000   3bad38 zfs.ko >>>  6    1 0xffffffff82872000    27c00 geom_mirror.ko >>>  7    1 0xffffffff8289a000    27ce8 fuse.ko >>>  8    1 0xffffffff82b21000      acf mac_ntpd.ko >>> >>> … >> >> >> Thanks. Simply installing sysutils/openzfs will get you a relevant >> manual page: >> >> man 8 zpool-trim >> >> – and `zpool trim` (alone) will run (tested in VirtualBox), however: >> _without_ an OpenZFS-enabled boot, I'd be wary of specifying a pool >> to be trimmed. Here be dragons? > > > Thank you for the response.  :-) > > > I installed the package "openzfs": > > 2021-08-30 17:54:40 toor@f2 ~ > # pkg install -y openzfs > Updating FreeBSD repository catalogue... > FreeBSD repository is up to date. > All repositories are up to date. > The following 2 package(s) will be affected (of 0 checked): > > New packages to be INSTALLED: >     openzfs: 2021062100 >     openzfs-kmod: 2021062100 > > Number of packages to be installed: 2 > > The process will require 22 MiB more space. > 4 MiB to be downloaded. > [1/2] Fetching openzfs-2021062100.txz: 100%    3 MiB 365.1kB/s 00:08 > [2/2] Fetching openzfs-kmod-2021062100.txz: 100%    1 MiB 1.2MB/s 00:01 > Checking integrity... done (0 conflicting) > [1/2] Installing openzfs-kmod-2021062100... > [1/2] Extracting openzfs-kmod-2021062100: 100% > [2/2] Installing openzfs-2021062100... > [2/2] Extracting openzfs-2021062100: 100% > > > The man page is there: > > 2021-08-30 18:00:33 toor@f2 ~ > # man zpool-trim | head -n 7 > ZPOOL-TRIM(8)           FreeBSD System Manager's Manual ZPOOL-TRIM(8) > > NAME >      zpool-trim - initiate TRIM of free space in ZFS storage pool > > SYNOPSIS >      zpool trim [-dw] [-r rate] [-c|-s] pool [device] > > > When I try to trim a pool that is on an SSD: > > 2021-08-30 18:01:18 toor@f2 ~ > # zpool trim bootpool 2>&1 | head -n 1 > unrecognized command 'trim' > > > When I try to load the kernel module: > > 2021-08-30 18:01:22 toor@f2 ~ > # kldload openzfs > kldload: an error occurred while loading module openzfs. Please check > dmesg(8) for more details. > > 2021-08-30 18:02:10 toor@f2 ~ > # dmesg | tail -n 2 > interface zfsctrl.1 already present in the KLD 'zfs.ko'! > linker_load_file: /boot/modules/openzfs.ko - unsupported file type > > > zpool-trim(8) mentions an "autotrim" property, but my pool does not > seem to have it: > > 2021-08-30 18:03:14 toor@f2 ~ > # zpool get all bootpool | grep -i trim > > > Suggestions? > > > David % pkg query %M openzfs openzfs-kmod % – strange; openzfs-kmod should probably have a package message. /boot/loader.conf can be edited to include: zfs_load="NO" openzfs_load="YES" – HOWEVER I recommend creating then activating a new boot environment before doing so (and before any future update to 12.0-RELEASE). Given the possibility of the pre-packaged kernel module not working, be prepared to build and install from ports. (If the module will not load, you'll be unable to boot. If this happens, you can boot a good environment then use `bectl mount` to temporarily access the affected environment, then revert the two lines in its loader.conf.) If the pool will require an upgrade, for what you'd like to do with TRIM, be extremely cautious about upgrading a FreeBSD 12 boot pool.