From owner-freebsd-fs@freebsd.org Sun Mar 7 02:21:20 2021 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 6152B554B0B for ; Sun, 7 Mar 2021 02:21:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4DtQFX27Wqz3hnX for ; Sun, 7 Mar 2021 02:21:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 4924C554565; Sun, 7 Mar 2021 02:21:20 +0000 (UTC) Delivered-To: fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 48E6C554A23 for ; Sun, 7 Mar 2021 02:21:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DtQFX1Y4gz3hlH for ; Sun, 7 Mar 2021 02:21:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 285996804 for ; Sun, 7 Mar 2021 02:21:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 1272LKMo083897 for ; Sun, 7 Mar 2021 02:21:20 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 1272LKx8083896 for fs@FreeBSD.org; Sun, 7 Mar 2021 02:21:20 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 254058] zfs doesn't set mnt_time aka RootOnZFS doesn't work without RTC Date: Sun, 07 Mar 2021 02:21:20 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 07 Mar 2021 02:21:20 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254058 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |fs@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Sun Mar 7 17:25:43 2021 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 4C6F456D4A1 for ; Sun, 7 Mar 2021 17:25:43 +0000 (UTC) (envelope-from tech-lists@zyxst.net) Received: from out4-smtp.messagingengine.com (out4-smtp.messagingengine.com [66.111.4.28]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4DtpK22d9Dz3HpN for ; Sun, 7 Mar 2021 17:25:42 +0000 (UTC) (envelope-from tech-lists@zyxst.net) Received: from compute1.internal (compute1.nyi.internal [10.202.2.41]) by mailout.nyi.internal (Postfix) with ESMTP id 2F77E5C00A5 for ; Sun, 7 Mar 2021 12:25:41 -0500 (EST) Received: from mailfrontend1 ([10.202.2.162]) by compute1.internal (MEProxy); Sun, 07 Mar 2021 12:25:41 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=zyxst.net; h= date:from:to:subject:message-id:mime-version:content-type; s= fm2; bh=GJ1FgJRfK0Vq0OA0c1Sx/D98chNY7Jr4n6O876rjnb8=; b=qY3DrRDk Okb/BAPbxM3tJ04x1WIQKaQFKJ9JYmGM04uUI0Lm98xqRdqCxwIz8wlpJP6paLSh Zls4FXj3fGKbMOtfBePm1U0Jq2SBBc+ODa80m7cYuHvTmViVfzqAqDlIMR8a2T89 42Oe8tE1mF9QhXNy163klsAbVwb4GXqlRw2oLaE+AvZ8gh6RD3Vl9fU/48+Kfr7T Dr98BmkQAX5VD9gz6cTLZGl9mBSw/RCI/xwrC5XQ84TBotXOGUjpdnNJWq1G19Zx dfVapiExlyVgRZBDF7a0gYPAIqNJyy29RuaIdE9pawSt15BWsw5xsgBb+RR/JID+ MbV8EGLDIFYZKQ== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-type:date:from:message-id :mime-version:subject:to:x-me-proxy:x-me-proxy:x-me-sender :x-me-sender:x-sasl-enc; s=fm2; bh=GJ1FgJRfK0Vq0OA0c1Sx/D98chNY7 Jr4n6O876rjnb8=; b=LnMH166xs+JQVOtvDPR9Vud8MZaw36Nyo7d2hJCnmyUy7 q8DzhUjJbCp2hAKjZTIBfkBFD8zJVzP0gyil54riuWYS3QjThxVC+kN8FsaWzVTC si1tehPLSynA5w+UIrsSBi8uStuCYnL2fSd+ukowpGL5ZqFFoyVV8pOoKaeMRo/3 LIG7nG3zx1ciZNC0t2JvB0SVhKsCgU5S34QFJ87ZKU2QS/peDs7mN2VYm6eHdFHO Ju5kvEClZkzxN7/oT1fDtHJv9ITJdzdGPnDDTmkwhKlBOMe/WC4rL1mBWU1Ht2Yz mJ/JGndsADTKofAUE1a0S6BvmbA1aSryex2N61AHA== X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeduledruddutddgledtucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpeffhffvuffkgggtugesghdtreertd dtvdenucfhrhhomhepthgvtghhqdhlihhsthhsuceothgvtghhqdhlihhsthhsseiihiig shhtrdhnvghtqeenucggtffrrghtthgvrhhnpeevgffhffdtfeekleelhedtjeelvdfhvd egieejveffgfduvdfhteegjeeujeeuieenucfkphepkedvrdejtddrledurddutddunecu vehluhhsthgvrhfuihiivgeptdenucfrrghrrghmpehmrghilhhfrhhomhepthgvtghhqd hlihhsthhsseiihiigshhtrdhnvght X-ME-Proxy: Received: from ceres.local (fws.zyxst.net [82.70.91.101]) by mail.messagingengine.com (Postfix) with ESMTPA id B169424005A for ; Sun, 7 Mar 2021 12:25:40 -0500 (EST) Date: Sun, 7 Mar 2021 17:25:38 +0000 From: tech-lists To: freebsd-fs@freebsd.org Subject: adding another disk to an existing vdev Message-ID: Mail-Followup-To: freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="986QUtUKuqhMGXCb" Content-Disposition: inline X-Rspamd-Queue-Id: 4DtpK22d9Dz3HpN X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=zyxst.net header.s=fm2 header.b=qY3DrRDk; dkim=pass header.d=messagingengine.com header.s=fm2 header.b=LnMH166x; dmarc=none; spf=pass (mx1.freebsd.org: domain of tech-lists@zyxst.net designates 66.111.4.28 as permitted sender) smtp.mailfrom=tech-lists@zyxst.net X-Spamd-Result: default: False [-5.70 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; RWL_MAILSPIKE_GOOD(0.00)[66.111.4.28:from]; R_SPF_ALLOW(-0.20)[+ip4:66.111.4.28]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[4]; DKIM_TRACE(0.00)[zyxst.net:+,messagingengine.com:+]; NEURAL_HAM_SHORT(-1.00)[-1.000]; SIGNED_PGP(-2.00)[]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[66.111.4.28:from]; ASN(0.00)[asn:11403, ipnet:66.111.4.0/24, country:US]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_IN_DNSWL_LOW(-0.10)[66.111.4.28:from]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[zyxst.net:s=fm2,messagingengine.com:s=fm2]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; DMARC_NA(0.00)[zyxst.net]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[66.111.4.28:from:127.0.2.255]; MAILMAN_DEST(0.00)[freebsd-fs] X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 07 Mar 2021 17:25:43 -0000 --986QUtUKuqhMGXCb Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Hi, Say there are 4 identical disks in total. Three of them are in an already-existing raidz1-0 vdev. Can I add this fourth disk to the vdev? Will it still be a raidz1-0 vdev? Will I need to eg resilver/scrub/anything else ? There are some answers for this question being "no" but these are from a decade ago. Is it possible now? Context is recent stable/12. The context can be changed if required. thanks, --=20 J. --986QUtUKuqhMGXCb Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEE8n3tWhxW11Ccvv9/s8o7QhFzNAUFAmBFDIoACgkQs8o7QhFz NAVDfg//dSSBAA8JcZx3ATZWpc0bOxPRvTPJKaa6IHfSIdTVFUfVMaifn+ZP1ZE7 6jOfELa0GxODfyD3TK7GUXnrVw6AmjK2uYe91koUAki25aihQCBAp5RCGRQuou3j pUCPDecD0r8RxUxJNlb3/rPQeaqAeAI9E8+lAPRxQoOwkhB+ZEdnjr53clxaC6wo Zt5mOnXc7k/lqWxp791ELidijyZRwsnhTY2KfLiMNiLLwoVNhJHXjhB3Sh4Czexz bD9gglwVTNdaAdbc90kVs2l6Gnfik9NstNn3dCQdT4rDwwibmiiIfuOdk9wxhuH1 Hb+sAp83kmNU+I42fipZEn2kUbsUj9Ra3SF6ufXRxn3079aE3J3ePGGfxoeuYfwq 7RsxgbvQOWG2lrZkiClkDZSZsI+t4oc2kIaTz5CPb9BGoTDtjyzQCrYcBUauvxlm XuGLZgUacnXcBMEYNNdHVyb8JUM3HX/BMG1e7F5D6PStdHP1Vz/8ZldLz6ER93Nf aHWyJK1QRi/nO5i6/aSW/d/indEn1D0zWnHQdQfI5fofhyEwkQ1Nh16z1z7rShv+ z4rfHeipsUyd9p1JMeFwuK1k/eGYFVeNXUstBLpwDT7uV1V1Rl68afWiskunr15K gocMyjlTq2kW3XlPJRStWy9bIy7upiLf0/33HZ09YZygyDEGZX4= =a1rJ -----END PGP SIGNATURE----- --986QUtUKuqhMGXCb-- From owner-freebsd-fs@freebsd.org Sun Mar 7 17:49:53 2021 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 7B59156DBF0 for ; Sun, 7 Mar 2021 17:49:53 +0000 (UTC) (envelope-from fjwcash@gmail.com) Received: from mail-qt1-x82f.google.com (mail-qt1-x82f.google.com [IPv6:2607:f8b0:4864:20::82f]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Dtprw1C7yz3KLs for ; Sun, 7 Mar 2021 17:49:51 +0000 (UTC) (envelope-from fjwcash@gmail.com) Received: by mail-qt1-x82f.google.com with SMTP id o1so5868216qta.13 for ; Sun, 07 Mar 2021 09:49:51 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=ZdN+sw9Sh5H3c6kkvNJnasyHG6/qxh/sDcbapluZlZI=; b=NAXAqfUGZJpa1awIiAg67pzHjzZOQeQ/kutJSZgUCZXzcsV86HwF/FaL27L6GSQ9hv +Lre8QCnfsXVRY4NIYUxftRRp1s7ThFgahiyvq4Hc2fZLgUPf9fgU/fkLjGhpyUCKOKE yUKmpDm0fJPowNSoJ6SNEj3XNsimwlHZ+Tkgjbksaxi29Opqh5/W4smJI9QrHQZ6f74L ziutE0fT0PF7mdT3JbqGR43S4l/UX0SZP1RHwE1xDG97/CQs3hdVoF7k6zA8gAylqKrl sWx2wGErhs/uUUhocvH1FJ3C6uEkoq+cjXef/9K6ljbLXPO3dA6PpamK/FA7IgcrWaUw D0jw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=ZdN+sw9Sh5H3c6kkvNJnasyHG6/qxh/sDcbapluZlZI=; b=jMAtz9LSxsV5NEk9l6h5zrMXRYKakrn/XjKtkpzVWYWUB9W/Ml0nYoT/9XE9/cXHN8 tr1drlO37Dv1LsWzHyDT6WTXfxGc1w9QtGO+TseRUA6l52oI6kA0IUGWVe9w3yUq++IG pdQBXNPhbwQLN38Lyjd0JLyA/jH8Jwlt0B4R0+vHn919DXwM1h1Ij57lRYq+b6XaQLDb cYFymQbGM6fuNjbRh+anXNcTyfEnJj7FVP5SzlTV8iEdgHPPWby+v1LFTj2iXbh4pOP+ 7jwP5ebeFwyr6csjTsAqbLFkUUGddjp+P56tN5ARGz/onLZtHhr8gvg5o8QXo/+bFs8q dcQA== X-Gm-Message-State: AOAM533vTo1rmj3rO+69h8lLyaeSL1p2TazdbvApIw3RZqopDGKnFdtC IoyNaqEQtU6jj2kSyhs68Z7tHqgjfxQyU+YuOIUTOfh1 X-Google-Smtp-Source: ABdhPJwqdTy6ZnDRU489ETXDbaFDN7oJjYZIr4XqyDja4dT7Qk+Oi2kJxAuPplfhug2ECpIMU9spfFGu9ExG+g2wd14= X-Received: by 2002:ac8:5a8a:: with SMTP id c10mr17965836qtc.30.1615139389743; Sun, 07 Mar 2021 09:49:49 -0800 (PST) MIME-Version: 1.0 References: In-Reply-To: From: Freddie Cash Date: Sun, 7 Mar 2021 09:49:38 -0800 Message-ID: Subject: Re: adding another disk to an existing vdev To: FreeBSD Filesystems X-Rspamd-Queue-Id: 4Dtprw1C7yz3KLs X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=NAXAqfUG; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of fjwcash@gmail.com designates 2607:f8b0:4864:20::82f as permitted sender) smtp.mailfrom=fjwcash@gmail.com X-Spamd-Result: default: False [-4.00 / 15.00]; FREEMAIL_FROM(0.00)[gmail.com]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RBL_DBL_DONT_QUERY_IPS(0.00)[2607:f8b0:4864:20::82f:from]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[2607:f8b0:4864:20::82f:from:127.0.2.255]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::82f:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-fs] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 07 Mar 2021 17:49:53 -0000 On Sun., Mar. 7, 2021, 9:25 a.m. tech-lists, wrote: > Hi, > > Say there are 4 identical disks in total. Three of them are in an > already-existing raidz1-0 vdev. > > Can I add this fourth disk to the vdev? Will it still be a raidz1-0 > vdev? > > Will I need to eg resilver/scrub/anything else ? > > There are some answers for this question being "no" but these are from a > decade ago. Is it possible now? > > Context is recent stable/12. The context can be changed if required. > No, you cannot extend a raidz vdev by adding disks to it. The number of drives in a raidz vdev is fixed at creation time. Cheers, Freddie Typos due to smartphone keyboard. > From owner-freebsd-fs@freebsd.org Sun Mar 7 21:00:03 2021 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id CC1B5573B94 for ; Sun, 7 Mar 2021 21:00:03 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4Dtv4M5BPCz3n17 for ; Sun, 7 Mar 2021 21:00:03 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: by mailman.nyi.freebsd.org (Postfix) id B204F573AB4; Sun, 7 Mar 2021 21:00:03 +0000 (UTC) Delivered-To: fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id B1C9F573B93 for ; Sun, 7 Mar 2021 21:00:03 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Dtv4M4gYkz3n16 for ; Sun, 7 Mar 2021 21:00:03 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 93AE71CBE1 for ; Sun, 7 Mar 2021 21:00:03 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 127L03qh094107 for ; Sun, 7 Mar 2021 21:00:03 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 127L03h9094106 for fs@FreeBSD.org; Sun, 7 Mar 2021 21:00:03 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202103072100.127L03h9094106@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 7 Mar 2021 21:00:03 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 07 Mar 2021 21:00:03 -0000 To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- New | 203492 | mount_unionfs -o below causes panic Open | 144447 | [zfs] sharenfs fsunshare() & fsshare_main() non f Open | 211491 | System hangs after "Uptime" on reboot with ZFS Open | 221909 | [ZFS] Add a sysctl to toggle send_corrupt_data Open | 237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w Open | 240831 | zfs: Panic during snapshot on 12.1-STABLE r352648 Open | 243973 | [zfs] rollback segmentation fault Open | 244656 | zfs: resilver doesn't provide enough information Open | 244692 | gjournal: Does not support TRIM Open | 244899 | [PATCH] zfs: xattr on a symlink target > 136 caus Open | 251035 | [zfs] Allow 64 bit ZFS to support 32 bit ioctls ( 11 problems total for which you should take action. From owner-freebsd-fs@freebsd.org Mon Mar 8 19:42:21 2021 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 46A38555590 for ; Mon, 8 Mar 2021 19:42:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4DvTJF1J0Zz3NX6 for ; Mon, 8 Mar 2021 19:42:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 2C7D8555454; Mon, 8 Mar 2021 19:42:21 +0000 (UTC) Delivered-To: fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 2C4745553D5 for ; Mon, 8 Mar 2021 19:42:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DvTJF0jPPz3NP6 for ; Mon, 8 Mar 2021 19:42:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 095866AEA for ; Mon, 8 Mar 2021 19:42:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 128JgKkX009042 for ; Mon, 8 Mar 2021 19:42:20 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 128JgKMT009041 for fs@FreeBSD.org; Mon, 8 Mar 2021 19:42:20 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 244048] mksnap_ffs hangs machine (12.1 regression over 11.3) Date: Mon, 08 Mar 2021 19:42:21 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.2-RELEASE X-Bugzilla-Keywords: regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: ml@netfence.it X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 08 Mar 2021 19:42:21 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D244048 --- Comment #20 from ml@netfence.it --- (In reply to Kirk McKusick from comment #19) I guess so. If data is gone and filenames too (including in snapshots), there should be nothing private remaining. Right? Meanwhile I made another test: I reverted back to 11.x and saw that it's now giving the same troubles as 12.x and 13.0 do. So my conclusion is that snapshotting/deleting snapshots on 12.x has already messed the disk in a way that fsck doesn't even detect, but hangs the machi= ne on some operations. Probably this is less useful than I hoped: while it would be nice to have a= way to fix this image, this cannot be used to reproduce the corruption on deman= d, since it's already ruined. Maybe seeing what the trouble is can give some h= int? IOW I hoped to have pinpointed the situation when the trouble starts, but i= t's not immediately evident and I'm already past it :( --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Mon Mar 8 23:22:19 2021 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 8EFB655D4B6 for ; Mon, 8 Mar 2021 23:22:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4DvZB33TkQz4Rdm for ; Mon, 8 Mar 2021 23:22:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 773CF55D78A; Mon, 8 Mar 2021 23:22:19 +0000 (UTC) Delivered-To: fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 7705455D73C for ; Mon, 8 Mar 2021 23:22:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DvZB32qVBz4Rbl for ; Mon, 8 Mar 2021 23:22:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 5424B1196F for ; Mon, 8 Mar 2021 23:22:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 128NMJtD020723 for ; Mon, 8 Mar 2021 23:22:19 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 128NMJtb020722 for fs@FreeBSD.org; Mon, 8 Mar 2021 23:22:19 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 244048] mksnap_ffs hangs machine (12.1 regression over 11.3) Date: Mon, 08 Mar 2021 23:22:19 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.2-RELEASE X-Bugzilla-Keywords: regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 08 Mar 2021 23:22:19 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D244048 --- Comment #21 from Kirk McKusick --- (In reply to ml from comment #20) Having an image that reliably causes the hang when you remove a snapshot wi= ll be useful. Either it will demonstrate a corruption that should be detected = by fsck in which case I can fix fsck or it will show a kernel bug which we can hopefully track down and fix. While this may not fix the whole problem, it should certainly get us a step of the way. I will contact you directly about how to get the image to me so that you ca= n do a direct transfer to my development lab and not have to transit it through = the freebsd.org infrastructure. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Wed Mar 10 04:38:37 2021 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id DA85357CC4B for ; Wed, 10 Mar 2021 04:38:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4DwK8Y5h84z4Twq for ; Wed, 10 Mar 2021 04:38:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id C2D7A57CB7A; Wed, 10 Mar 2021 04:38:37 +0000 (UTC) Delivered-To: fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C2A1457CE86 for ; Wed, 10 Mar 2021 04:38:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DwK8Y5308z4V4M for ; Wed, 10 Mar 2021 04:38:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 9FFB6A66 for ; Wed, 10 Mar 2021 04:38:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12A4cbPQ080381 for ; Wed, 10 Mar 2021 04:38:37 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12A4cbRe080380 for fs@FreeBSD.org; Wed, 10 Mar 2021 04:38:37 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 254177] When ZFS is recognized, An i386 machine with a lot of memory hangs. Date: Wed, 10 Mar 2021 04:38:37 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 10 Mar 2021 04:38:37 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254177 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |fs@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Wed Mar 10 05:03:43 2021 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 7C6BF57D8A4 for ; Wed, 10 Mar 2021 05:03:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4DwKjW2vnRz4WbY for ; Wed, 10 Mar 2021 05:03:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 63D0557D67F; Wed, 10 Mar 2021 05:03:43 +0000 (UTC) Delivered-To: fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 6398057D8A3 for ; Wed, 10 Mar 2021 05:03:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DwKjW2FWKz4Wcp for ; Wed, 10 Mar 2021 05:03:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 409E817A8 for ; Wed, 10 Mar 2021 05:03:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12A53h9u092564 for ; Wed, 10 Mar 2021 05:03:43 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12A53hMJ092563 for fs@FreeBSD.org; Wed, 10 Mar 2021 05:03:43 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 254152] [zfs] can not boot with option rewind Date: Wed, 10 Mar 2021 05:03:43 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: loader, mountroot X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 10 Mar 2021 05:03:43 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254152 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|standards@FreeBSD.org |fs@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Wed Mar 10 20:25:20 2021 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 5D0C657688F for ; Wed, 10 Mar 2021 20:25:20 +0000 (UTC) (envelope-from mohdarif.khan@gmail.com) Received: from mail-qk1-x72a.google.com (mail-qk1-x72a.google.com [IPv6:2607:f8b0:4864:20::72a]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Dwk8v0NRwz4d3x for ; Wed, 10 Mar 2021 20:25:18 +0000 (UTC) (envelope-from mohdarif.khan@gmail.com) Received: by mail-qk1-x72a.google.com with SMTP id l132so18301984qke.7 for ; Wed, 10 Mar 2021 12:25:18 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=YGJNuKX/YKOTdTeQV9kop8tYeOgqJUoV5am/fIYNlWg=; b=ZmlvITLIGeVinEaTIBLHREINlgdDo4FK5qrTWh6wIwiIon/Fr2bbxT+IjCwb2hIcKP h8M3SSM+r9LMztWYon04YGCNTlPi/KaHb7NXw5sNfR4VIDyLETVmZLwLHIZ/e4vyv+/m fgogDlsxR7F6jOlWWMdCajn0bnNrhoby7WQDeAxlBif3liNJ0kgtuFY8cU9bls8zSrUf M6mxKdE+nJc+3NNs6DrQlr5rS8Zt1yZ60nUwnS0i8v2bT9rN7/zeZHpz9jWgswHfU/tv wc0C2x2gHAge1qqNtVSL+Mvo++uVYcDqkJGnnPOlvugQ9YBXztVnWaDg9Xy+rPhrSGns oCJw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=YGJNuKX/YKOTdTeQV9kop8tYeOgqJUoV5am/fIYNlWg=; b=ajgU8VHs8TN3Ns8dLOIISjchFCmKiWHQQUdbkxK0+P+23j3vBdx75SXzPZzDhrBw/O 07iDzZCfOJeWoVL7Kh90BMLnmphQ1EAJw/vROA9HYHhLfLWP/I/yb3609zv5bqvpt+nQ hPTRGbBp6y0/5A8NohEHR0SKKbHYMYRpralUEBDG4oVB03RJZH993ZAEkn9Hh/94Jf8w b4Z16fv0+3JJu2kwOR4SCsunTVf7HK03ZnhRQVzi5EaP+1XsGNTAYonkZYEa+ADy82s7 8MDJn6W6t3YpGFcNSKIXzUnCQ4/o6yJt7y/oP9y2qnm3vxFHlZjc436YhA9r610xvjGM N/Zw== X-Gm-Message-State: AOAM530+cOnIx0SplgNWZd707qBFzOsnW85xIyM2gC85P8VA3UOxqD3/ fZdHOfQei1VxHHURnid1C+lvH/NZsPCP4sE7WBZIrMG3Y3HaYA== X-Google-Smtp-Source: ABdhPJzT/ddRVzIpNf8+rjUIb2kS10Na9W0pfqo7tPyyEq9X7QpqAHXjp3ULntQNUGLIDd/CT0oz1v4653xVSI6LLoM= X-Received: by 2002:a37:a44:: with SMTP id 65mr4323200qkk.479.1615407917972; Wed, 10 Mar 2021 12:25:17 -0800 (PST) MIME-Version: 1.0 From: Arif Khan Date: Thu, 11 Mar 2021 01:55:06 +0530 Message-ID: Subject: Data corruption with freebsd VM resets To: freebsd-fs@freebsd.org X-Rspamd-Queue-Id: 4Dwk8v0NRwz4d3x X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=ZmlvITLI; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of mohdarifkhan@gmail.com designates 2607:f8b0:4864:20::72a as permitted sender) smtp.mailfrom=mohdarifkhan@gmail.com X-Spamd-Result: default: False [-4.00 / 15.00]; FREEMAIL_FROM(0.00)[gmail.com]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; TO_DN_NONE(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RBL_DBL_DONT_QUERY_IPS(0.00)[2607:f8b0:4864:20::72a:from]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; TAGGED_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[2607:f8b0:4864:20::72a:from:127.0.2.255]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::72a:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-fs] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 10 Mar 2021 20:25:20 -0000 Hi All, I am facing a strange issue with freebsd 11.4. The sync() or O_SYNC flag not working if we reset the box (un graceful shutdown) within 45 seconds. The data written to file is lost. However the same thing works in 8.4 atleast initial few lines are written. main(*int* argc, *char* **argv) { *int* sz; *int* i; *int* count = atoi(argv[*1*]); *int* fd_sync = open(*"foo_sync"*, O_CREAT|O_RDWR | O_APPEND| O_SYNC, *0* *644*); *int* fd_nosync = open(*"foo_nosync"*, O_CREAT|O_RDWR | O_APPEND, *0**644*); *if* (fd_sync < *0* || fd_nosync < *0*) { perror(*"r1"*); exit(*1*); } *for* (i=*0*; i < count;i++) { sz = write(fd_sync, *"hello geeks**\n**"*, strlen(*"hello geeks**\n**"* )); sz = write(fd_nosync, *"hello geeks**\n**"*, strlen(*"hello geeks**\n**"* )); } close(fd_sync); close(fd_nosync); } This work effectively if we have kern.cam.ada.write_cache: 0 Is there a way I can get some few lines written when running sync(). -- thanks & regards Arif From owner-freebsd-fs@freebsd.org Thu Mar 11 03:23:37 2021 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 71C625ADC4E for ; Thu, 11 Mar 2021 03:23:37 +0000 (UTC) (envelope-from joe@via.net) Received: from smtp3.via.net (smtp3.via.net [157.22.3.7]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "via.net", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DwvRX32rYz3jps for ; Thu, 11 Mar 2021 03:23:36 +0000 (UTC) (envelope-from joe@via.net) Received: from mail.via.net (mail.via.net [157.22.3.34]) by smtp3.via.net (8.15.2/8.14.1-VIANET) with ESMTPS id 12B3NYAe012491 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Wed, 10 Mar 2021 19:23:34 -0800 (PST) X-Virus-Status: Clean X-Virus-Scanned: clamav-milter 0.97.3 at smtp3.via.net Received: from [209.81.2.65] ([209.81.2.65]) by mail.via.net (8.15.2/8.14.1-VIANET) with ESMTP id 12B3NXLp014294 for ; Wed, 10 Mar 2021 19:23:34 -0800 (PST) From: joe mcguckin Mime-Version: 1.0 (Mac OS X Mail 13.4 \(3608.120.23.2.4\)) Subject: How to mount ExFAT USB drive Message-Id: Date: Wed, 10 Mar 2021 19:23:23 -0800 To: freebsd-fs@freebsd.org X-Mailer: Apple Mail (2.3608.120.23.2.4) X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.4.3 (smtp3.via.net [157.22.3.7]); Wed, 10 Mar 2021 19:23:34 -0800 (PST) X-Rspamd-Queue-Id: 4DwvRX32rYz3jps X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of joe@via.net designates 157.22.3.7 as permitted sender) smtp.mailfrom=joe@via.net X-Spamd-Result: default: False [-2.84 / 15.00]; MID_RHS_MATCH_FROM(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[157.22.3.7:from]; FREEFALL_USER(0.00)[joe]; FROM_HAS_DN(0.00)[]; MV_CASE(0.50)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[157.22.3.7:from:127.0.2.255]; RCVD_COUNT_THREE(0.00)[3]; ARC_NA(0.00)[]; R_SPF_ALLOW(-0.20)[+MX]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.94)[-0.941]; DMARC_NA(0.00)[via.net]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:7091, ipnet:157.22.0.0/16, country:US]; RCVD_TLS_LAST(0.00)[]; MAILMAN_DEST(0.00)[freebsd-fs]; RCVD_IN_DNSWL_LOW(-0.10)[157.22.3.7:from] Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 11 Mar 2021 03:23:37 -0000 I have a 5G portable USB drive, Apple reports is as an ExFAT drive. How do I mount it on FreeBSD? I=E2=80=99ve tried the following: mount -v -t msdosfs /dev/da30p2 /t and I get the following error: /dev/diskid # mount -v -t msdosfs /dev/da30p2 /t mount_msdosfs: /dev/da30p2: Invalid argument /dev/gpt/gproot on / (ufs, local, soft-updates, writes: sync 33173 async = 3728577, reads: sync 154542 async 7901, fsid f1a571568d889ee3) # gpart list Geom name: da30 modified: false state: OK fwheads: 255 fwsectors: 63 last: 9767541133 first: 34 entries: 128 scheme: GPT Providers: 1. Name: da30p1 Mediasize: 209715200 (200M) Sectorsize: 512 Stripesize: 4096 Stripeoffset: 0 Mode: r0w0e0 efimedia: HD(1,GPT,f20455b7-8d0e-4572-a9f5-606e76f17eca,0x28,0x64000) rawuuid: f20455b7-8d0e-4572-a9f5-606e76f17eca rawtype: c12a7328-f81f-11d2-ba4b-00a0c93ec93b label: EFI System Partition length: 209715200 offset: 20480 type: efi index: 1 end: 409639 start: 40 2. Name: da30p2 Mediasize: 5000770093056 (4.5T) Sectorsize: 512 Stripesize: 4096 Stripeoffset: 0 Mode: r0w0e0 efimedia: = HD(2,GPT,bf8062f3-aa81-4080-b5e2-ae402b4561f2,0x64800,0x2462a9000) rawuuid: bf8062f3-aa81-4080-b5e2-ae402b4561f2 rawtype: ebd0a0a2-b9e5-4433-87c0-68b6b72699c7 label: (null) length: 5000770093056 offset: 210763776 type: ms-basic-data index: 2 end: 9767540735 start: 411648 Consumers: 1. Name: da30 Mediasize: 5000981077504 (4.5T) Sectorsize: 512 Stripesize: 4096 Stripeoffset: 0 Mode: r0w0e0 # dmesg ugen7.2: at usbus7 umass0 on uhub7 umass0: on = usbus7 umass0: SCSI over Bulk-Only; quirks =3D 0xc101 umass0:7:0: Attached to scbus7 da30 at umass-sim0 bus 0 scbus7 target 0 lun 0 da30: Fixed Direct Access SPC-4 SCSI device da30: Serial Number 00000000NABANLJ9 da30: 40.000MB/s transfers da30: 4769307MB (9767541167 512 byte sectors) da30: quirks=3D0x2 Joe McGuckin ViaNet Communications joe@via.net 650-207-0372 cell 650-213-1302 office 650-969-2124 fax From owner-freebsd-fs@freebsd.org Thu Mar 11 03:35:11 2021 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id B23FF5AE1F2 for ; Thu, 11 Mar 2021 03:35:11 +0000 (UTC) (envelope-from joe@via.net) Received: from smtp1.via.net (smtp1.via.net [157.22.3.5]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "via.net", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Dwvht57Q7z3kZq for ; Thu, 11 Mar 2021 03:35:10 +0000 (UTC) (envelope-from joe@via.net) Received: from mail.via.net (mail.via.net [157.22.3.34]) by smtp1.via.net (8.15.2/8.14.1-VIANET) with ESMTPS id 12B3Z850023522 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Wed, 10 Mar 2021 19:35:09 -0800 (PST) X-Virus-Status: Clean X-Virus-Scanned: clamav-milter 0.97.3 at smtp1.via.net Received: from [209.81.2.65] ([209.81.2.65]) by mail.via.net (8.15.2/8.14.1-VIANET) with ESMTP id 12B3Z858025580 for ; Wed, 10 Mar 2021 19:35:08 -0800 (PST) From: joe mcguckin Mime-Version: 1.0 (Mac OS X Mail 13.4 \(3608.120.23.2.4\)) Subject: Auto mounting usb media? Message-Id: Date: Wed, 10 Mar 2021 19:34:58 -0800 To: freebsd-fs@freebsd.org X-Mailer: Apple Mail (2.3608.120.23.2.4) X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.4.3 (smtp1.via.net [157.22.3.5]); Wed, 10 Mar 2021 19:35:09 -0800 (PST) X-Rspamd-Queue-Id: 4Dwvht57Q7z3kZq X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of joe@via.net designates 157.22.3.5 as permitted sender) smtp.mailfrom=joe@via.net X-Spamd-Result: default: False [-1.86 / 15.00]; R_SPF_ALLOW(-0.20)[+MX:c]; MV_CASE(0.50)[]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; NEURAL_HAM_SHORT(-0.96)[-0.963]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RBL_DBL_DONT_QUERY_IPS(0.00)[157.22.3.5:from]; ASN(0.00)[asn:7091, ipnet:157.22.0.0/16, country:US]; R_DKIM_NA(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_IN_DNSWL_LOW(-0.10)[157.22.3.5:from]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FREEFALL_USER(0.00)[joe]; SUBJECT_ENDS_QUESTION(1.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; DMARC_NA(0.00)[via.net]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[157.22.3.5:from:127.0.2.255]; RCVD_TLS_LAST(0.00)[]; MAILMAN_DEST(0.00)[freebsd-fs] Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 11 Mar 2021 03:35:11 -0000 Can freebsd automatically mount usb media with filesystems? Like the way = OS X auto mounts flash keys, usb drives and=20 various flash based media (CF cards, etc). Thanks, Joe Joe McGuckin ViaNet Communications joe@via.net 650-207-0372 cell 650-213-1302 office 650-969-2124 fax From owner-freebsd-fs@freebsd.org Thu Mar 11 04:05:19 2021 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E07F35AF9FD for ; Thu, 11 Mar 2021 04:05:19 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-qt1-x834.google.com (mail-qt1-x834.google.com [IPv6:2607:f8b0:4864:20::834]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DwwMg1Q2Qz3mhm for ; Thu, 11 Mar 2021 04:05:18 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: by mail-qt1-x834.google.com with SMTP id r14so222765qtt.7 for ; Wed, 10 Mar 2021 20:05:18 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=RbWluLDtuYAaYaU7qGioLL+RvsSvp5H3DuTEXypWDOs=; b=wR9c4lx4AnPpJxQVrWnaKZle3UJ6dsv5KL8nKKXlCiIppIzydYXG7zRTiEEccUPsze e3MkImjlPlLxTKL90bkbR1bmf0+njz3EvPNqTF25S55GZvfPycNzyWOo3lP65njJhlAz Js0Do/yUoLsEqKauA1bBY4wunOkS+c85NYQaWaDxTTwR0727uYigKzraup9U3uA7648e k5JhuQut0OCoPs3TB5bLFTGyFhCGPxs26SUAmOKw6K9BENoy+liyaB2NmGptpSepJCoX kACQf2e6pSS3ypK09WpRxfXgVKdl2OpQnqj9fGWEj5EVIOSKIXshwqdLXYJadSOB4peG qWRg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=RbWluLDtuYAaYaU7qGioLL+RvsSvp5H3DuTEXypWDOs=; b=dGrPiEhX2S7cPbTgL+E2wUWAHIt0571M6rM36UcBOreih/cVxXRcCNQS4HYfWGrewH cFw0+Dxrh8tBVjPV4OJ8iyZUa59t248/77SPks1caQHPxtNFww01fdzwtfczFnrCVPOw amudqCcaNUyjHniY4RDnNlhSfttyNBUVsWEdZNEnsxSR3k5h8++0ehBI2TtKFC3pQNuC 31Sb3HooOrKe0KQVIzUqMznbd77RF2potNW2YJDGqyTvNfTt01uevqK8wHCR/rRmnmVH vKfegJYd4Auy5NL5gsEJVk25dBwDin9xx9MjnI6bH0yeOLAoV/zOtTb13FcAzbuw/rEz OF+Q== X-Gm-Message-State: AOAM532YjvaQsFVSnOoJkhwnfk+nuIc+SWZavjSVJD/MEyyaa0xz2GZk aHoqxmRqEIVkECEim0btYWtODumRhwZG8JPChhgCAn0SN+yBXdBE X-Google-Smtp-Source: ABdhPJzo4K4vJE0bK6ITssuf0ftcaveRti6Zp4alTN43OCHEjS6k3V/NBJnbb2ggCYsJOEHdzzuwqVZ8Ag1iOnbOfrc= X-Received: by 2002:a05:622a:1c9:: with SMTP id t9mr5813542qtw.244.1615435518230; Wed, 10 Mar 2021 20:05:18 -0800 (PST) MIME-Version: 1.0 References: In-Reply-To: From: Warner Losh Date: Wed, 10 Mar 2021 21:05:07 -0700 Message-ID: Subject: Re: Auto mounting usb media? To: joe mcguckin Cc: FreeBSD FS X-Rspamd-Queue-Id: 4DwwMg1Q2Qz3mhm X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=bsdimp-com.20150623.gappssmtp.com header.s=20150623 header.b=wR9c4lx4; dmarc=none; spf=none (mx1.freebsd.org: domain of wlosh@bsdimp.com has no SPF policy when checking 2607:f8b0:4864:20::834) smtp.mailfrom=wlosh@bsdimp.com X-Spamd-Result: default: False [-2.00 / 15.00]; RCVD_TLS_ALL(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[bsdimp-com.20150623.gappssmtp.com:s=20150623]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[2607:f8b0:4864:20::834:from]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; DMARC_NA(0.00)[bsdimp.com]; SPAMHAUS_ZRD(0.00)[2607:f8b0:4864:20::834:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[bsdimp-com.20150623.gappssmtp.com:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::834:from]; NEURAL_HAM_SHORT(-1.00)[-1.000]; R_SPF_NA(0.00)[no SPF record]; FORGED_SENDER(0.30)[imp@bsdimp.com,wlosh@bsdimp.com]; MIME_TRACE(0.00)[0:+,1:+,2:~]; SUBJECT_ENDS_QUESTION(1.00)[]; RCVD_COUNT_TWO(0.00)[2]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[imp@bsdimp.com,wlosh@bsdimp.com]; MAILMAN_DEST(0.00)[freebsd-fs] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 11 Mar 2021 04:05:19 -0000 On Wed, Mar 10, 2021, 8:35 PM joe mcguckin wrote: > Can freebsd automatically mount usb media with filesystems? Like the way > OS X auto mounts flash keys, usb drives and > various flash based media (CF cards, etc). > Yes. The kernel generates GEOM events after geom is done tasting the device. You can use this to drive a script that will mount things. I kinda think you need a fuse module to read exfat, speaking of other mail, but it's been a while. There's a port/pkg for whatever you need: exfat-utils-1.3.0 Utilities to create, check, label and dump exFAT filesystem fusefs-exfat-1.3.0 Full-featured exFAT FS implementation as a FUSE module Warner Thanks, > > Joe > > > Joe McGuckin > ViaNet Communications > > joe@via.net > 650-207-0372 cell > 650-213-1302 office > 650-969-2124 fax > > > > _______________________________________________ > freebsd-fs@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" > From owner-freebsd-fs@freebsd.org Thu Mar 11 08:44:27 2021 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 8D05D56E649 for ; Thu, 11 Mar 2021 08:44:27 +0000 (UTC) (envelope-from infoomatic@gmx.at) Received: from mout.gmx.net (mout.gmx.net [212.227.17.20]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mout.gmx.net", Issuer "TeleSec ServerPass Class 2 CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Dx2Yj66X0z4W92 for ; Thu, 11 Mar 2021 08:44:25 +0000 (UTC) (envelope-from infoomatic@gmx.at) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=gmx.net; s=badeba3b8450; t=1615452263; bh=VZEqK/OWyYJa8OsJwZW2zeuANZYc7cpRY15aZAYa3LE=; h=X-UI-Sender-Class:Subject:To:References:From:Date:In-Reply-To; b=SpQbDJonpkKuvi/iXU0walm3GZEYJcfUt4RHXUYhUt0LiUdwZrFB3bSoWk++G720B y/T7JFMZrD1UHxQ6rfQfqKnJcXo6u6zqzmKLBsXuh94fWgrJi8apNO/t1GMxCIiVWn tnDxIgW6pU9WVSLVbhCsKsPboLJfTWOQCOBx2QD4= X-UI-Sender-Class: 01bb95c1-4bf8-414a-932a-4f6e2808ef9c Received: from [192.168.1.2] ([178.114.237.45]) by mail.gmx.net (mrgmx104 [212.227.17.168]) with ESMTPSA (Nemesis) id 1Mg6Zq-1lxABl0XPC-00hgve for ; Thu, 11 Mar 2021 09:44:23 +0100 Subject: Re: How to mount ExFAT USB drive To: freebsd-fs@freebsd.org References: From: Infoomatic Message-ID: <7e8c39f5-8ba4-5987-fdc3-f1aeaeee26d2@gmx.at> Date: Thu, 11 Mar 2021 09:42:35 +0100 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:78.0) Gecko/20100101 Thunderbird/78.8.1 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: quoted-printable Content-Language: en-US X-Provags-ID: V03:K1:7O+DNPNwfBay/dNGPtJf2M0FQ8mUnmzXDIRcF1E2I+V3pSTD1fl ZbbWD54mAEyKksO4FGLHzcxzXx1OtpB/h9MUWOA1fwiNp5tDdPFMYr8x0SaqwoTDqsQzjcG AbEHhnkM6YHnO/1gQR9XeYWOt6e7Gwxh8VIh5Sz+mTFozKtIZ1iQhu/etQ3DrfbTKMWyI8v j/UzzSskBCDwq4aYvT7LQ== X-Spam-Flag: NO X-UI-Out-Filterresults: notjunk:1;V03:K0:ga3LSXK/NH8=:sI1GugEs7duYtXR2RJi2xT 9hrjsuDF1xNDXJ8uR/bWR6cEOTAbSmGkAY2M0zPmZKQmVkEZLoZi0ErFDP+vy7ZEB4eZOwmc6 hJk1I7vcih3BcAQQbOOE7ZfX6Ep3HCvGcB1CqGRLYDv9XotkpI74l/sn7Ftq9OtKNNByzOa9b gADdVPMCpfZmmlbPHQ31rCZXFf7YkJumnmraIXj3VRze9gNxxgCRaftTl5+8mf9EPvUp02GX4 U6ZEHLUpp/wkmv+NPempCh1afzS8RbE8jNZztFqKSiBCW2doTV3qQBHG4vZKc9g34R3ulG4Xl U0x7wly+4Ww4QgMHiQ7ZLdOkpvX/lNOITRzVfLs8xsKuBghCVuSKn+puF8+043szEO3fffSha C+QxlvVunGwF43cu6KyGvFOtLhOvpK7RQmli2gGUny2viS2PcnrpbZLpd+0F30mn+KRvb/PQC ciOuGiIsMSJyUmHIB0n09OubrdERhWNpO8I8xcufk+7dZ++N1Io4M+co7pEqv63+44PlhROcU UHOMxn7kF8PF2q65vyU8nk90qfjLDJ7Z93SKibqVT/0KX649/T7BnLE6yxTFcnvOETtn383k6 VYkvZD7EhV4G1OSTfjpEzcLBRH/6s46LT/r/PxN8J+ZhFodYTDPLI4VZdOEAzZa8nxI+a2CME lzb9KvHk1rlTlJ5Wj4XmofmnZR9ahUrRHUd78xbwcwxoiM4teiVdKGLSmlB0bjM8T1FPG6hO+ oEdCPCyDwIYjl2YQYDa7esdmWbfz8+kSA3ZTWO9cH+rCeIStMdlwHL/xk2K/kab6q6p8b0TlQ 9KkMMApbFe6KMIrpbjjro5ChEGSHKYTLvaro/GBtm/DiOimyqdE6toyTBwDiuT1Fr6/9BuHBi CtkB7B0cb9Zp1um0g+lg== X-Rspamd-Queue-Id: 4Dx2Yj66X0z4W92 X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmx.net header.s=badeba3b8450 header.b=SpQbDJon; dmarc=pass (policy=none) header.from=gmx.at; spf=pass (mx1.freebsd.org: domain of infoomatic@gmx.at designates 212.227.17.20 as permitted sender) smtp.mailfrom=infoomatic@gmx.at X-Spamd-Result: default: False [-4.10 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; FREEMAIL_FROM(0.00)[gmx.at]; R_SPF_ALLOW(-0.20)[+ip4:212.227.17.0/27]; TO_DN_NONE(0.00)[]; DKIM_TRACE(0.00)[gmx.net:+]; DMARC_POLICY_ALLOW(-0.50)[gmx.at,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; RCVD_IN_DNSWL_LOW(-0.10)[212.227.17.20:from]; FROM_EQ_ENVFROM(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[212.227.17.20:from]; FREEMAIL_ENVFROM(0.00)[gmx.at]; MID_RHS_MATCH_FROM(0.00)[]; ASN(0.00)[asn:8560, ipnet:212.227.0.0/16, country:DE]; MIME_TRACE(0.00)[0:+]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[gmx.net:s=badeba3b8450]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[212.227.17.20:from:127.0.2.255]; RWL_MAILSPIKE_POSSIBLE(0.00)[212.227.17.20:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-fs] X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 11 Mar 2021 08:44:27 -0000 I installed exfat-utils and fusefs-exfat and mount my devices like this: mount.exfat /dev/da2s1 /mnt/sdcard On 11.03.21 04:23, joe mcguckin wrote: > I have a 5G portable USB drive, Apple reports is as an ExFAT drive. > > How do I mount it on FreeBSD? I=E2=80=99ve tried the following: > > mount -v -t msdosfs /dev/da30p2 /t > > and I get the following error: > > /dev/diskid # mount -v -t msdosfs /dev/da30p2 /t > mount_msdosfs: /dev/da30p2: Invalid argument > /dev/gpt/gproot on / (ufs, local, soft-updates, writes: sync 33173 async= 3728577, reads: sync 154542 async 7901, fsid f1a571568d889ee3) > > # gpart list > > > > Geom name: da30 > modified: false > state: OK > fwheads: 255 > fwsectors: 63 > last: 9767541133 > first: 34 > entries: 128 > scheme: GPT > Providers: > 1. Name: da30p1 > Mediasize: 209715200 (200M) > Sectorsize: 512 > Stripesize: 4096 > Stripeoffset: 0 > Mode: r0w0e0 > efimedia: HD(1,GPT,f20455b7-8d0e-4572-a9f5-606e76f17eca,0x28,0x64000= ) > rawuuid: f20455b7-8d0e-4572-a9f5-606e76f17eca > rawtype: c12a7328-f81f-11d2-ba4b-00a0c93ec93b > label: EFI System Partition > length: 209715200 > offset: 20480 > type: efi > index: 1 > end: 409639 > start: 40 > 2. Name: da30p2 > Mediasize: 5000770093056 (4.5T) > Sectorsize: 512 > Stripesize: 4096 > Stripeoffset: 0 > Mode: r0w0e0 > efimedia: HD(2,GPT,bf8062f3-aa81-4080-b5e2-ae402b4561f2,0x64800,0x24= 62a9000) > rawuuid: bf8062f3-aa81-4080-b5e2-ae402b4561f2 > rawtype: ebd0a0a2-b9e5-4433-87c0-68b6b72699c7 > label: (null) > length: 5000770093056 > offset: 210763776 > type: ms-basic-data > index: 2 > end: 9767540735 > start: 411648 > Consumers: > 1. Name: da30 > Mediasize: 5000981077504 (4.5T) > Sectorsize: 512 > Stripesize: 4096 > Stripeoffset: 0 > Mode: r0w0e0 > > # dmesg > > ugen7.2: at usbus7 > umass0 on uhub7 > umass0: on usb= us7 > umass0: SCSI over Bulk-Only; quirks =3D 0xc101 > umass0:7:0: Attached to scbus7 > da30 at umass-sim0 bus 0 scbus7 target 0 lun 0 > da30: Fixed Direct Access SPC-4 SCSI device > da30: Serial Number 00000000NABANLJ9 > da30: 40.000MB/s transfers > da30: 4769307MB (9767541167 512 byte sectors) > da30: quirks=3D0x2 > > Joe McGuckin > ViaNet Communications > > joe@via.net > 650-207-0372 cell > 650-213-1302 office > 650-969-2124 fax > > > > _______________________________________________ > freebsd-fs@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" From owner-freebsd-fs@freebsd.org Thu Mar 11 09:35:11 2021 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id A8F0C570AEE for ; Thu, 11 Mar 2021 09:35:11 +0000 (UTC) (envelope-from ronald-lists@klop.ws) Received: from smtp-relay-int.realworks.nl (smtp-relay-int.realworks.nl [194.109.157.24]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Dx3hH0ydkz4bD6 for ; Thu, 11 Mar 2021 09:35:11 +0000 (UTC) (envelope-from ronald-lists@klop.ws) Date: Thu, 11 Mar 2021 10:35:08 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=klop.ws; s=rw2; t=1615455309; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=+8h/zvsA3jqcM/XYg0qGm59UVqEJZmfFmBXCiQsdmWM=; b=wgnQbeFN18XHZOai5v2dFD1a1HMM0JanZtHpIQgSD41HX1pg2C7MbrYkAIIwwPlVaa44wK cTLMkh88gdilr0A8Dr6zxFyYmqJ23xXfTXCUY3KufsPJms3AsTRt2oAa71NcWHWi4L4/Tg riZmkKzlbgUHO4tNrEa7zHNa8UqeeTekcHtsVSfLxT+UBAgAJLyCm+CwvsY0dKy4aKsgNq glOAnAeYRkCAeAcTRVgCGunYOt9bS9fMdk8Ab451MBsIrWkxkoafWrQfXapya8eKfwatne YsrJIa2WuZdSLJHub3f/NNIvWIDMrbbdif8eboZM20WIP31RgFVKWrYukHSnjw== From: Ronald Klop To: Warner Losh Cc: joe mcguckin , FreeBSD FS Message-ID: <952274224.13.1615455308043@localhost> In-Reply-To: References: Subject: Re: Auto mounting usb media? MIME-Version: 1.0 X-Mailer: Realworks (551.2.89c726ce8c6) Importance: Normal X-Priority: 3 (Normal) X-Rspamd-Queue-Id: 4Dx3hH0ydkz4bD6 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=klop.ws header.s=rw2 header.b=wgnQbeFN; dmarc=pass (policy=none) header.from=klop.ws; spf=pass (mx1.freebsd.org: domain of ronald-lists@klop.ws designates 194.109.157.24 as permitted sender) smtp.mailfrom=ronald-lists@klop.ws X-Spamd-Result: default: False [-2.37 / 15.00]; ARC_NA(0.00)[]; RWL_MAILSPIKE_VERYGOOD(0.00)[194.109.157.24:from]; R_DKIM_ALLOW(-0.20)[klop.ws:s=rw2]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+ip4:194.109.157.0/24:c]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[klop.ws:+]; DMARC_POLICY_ALLOW(-0.50)[klop.ws,none]; HAS_X_PRIO_THREE(0.00)[3]; RCVD_IN_DNSWL_NONE(0.00)[194.109.157.24:from]; NEURAL_HAM_SHORT(-0.87)[-0.865]; RCVD_COUNT_ZERO(0.00)[0]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; SUBJECT_ENDS_QUESTION(1.00)[]; ASN(0.00)[asn:3265, ipnet:194.109.0.0/16, country:NL]; MID_RHS_NOT_FQDN(0.50)[]; MAILMAN_DEST(0.00)[freebsd-fs] Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 11 Mar 2021 09:35:11 -0000 Van: Warner Losh Datum: donderdag, 11 maart 2021 05:05 Aan: joe mcguckin CC: FreeBSD FS Onderwerp: Re: Auto mounting usb media? > > On Wed, Mar 10, 2021, 8:35 PM joe mcguckin wrote: > > > Can freebsd automatically mount usb media with filesystems? Like the way > > OS X auto mounts flash keys, usb drives and > > various flash based media (CF cards, etc). > > > > Yes. The kernel generates GEOM events after geom is done tasting the > device. You can use this to drive a script that will mount things. > > I kinda think you need a fuse module to read exfat, speaking of other mail, > but it's been a while. There's a port/pkg for whatever you need: > > exfat-utils-1.3.0 Utilities to create, check, label and dump > exFAT filesystem > fusefs-exfat-1.3.0 Full-featured exFAT FS implementation as a > FUSE module > > Warner > > > > Thanks, > > > > Joe > > > > > > Joe McGuckin > > ViaNet Communications > > > > joe@via.net > > 650-207-0372 cell > > 650-213-1302 office > > 650-969-2124 fax > > > > > > > > _______________________________________________ > > freebsd-fs@freebsd.org mailing list > > https://lists.freebsd.org/mailman/listinfo/freebsd-fs > > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" > > > _______________________________________________ > freebsd-fs@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" > > > Hi, This plus automountd should do the trick. Never used it myself so I can't help in the details. Regards, Ronald. From owner-freebsd-fs@freebsd.org Thu Mar 11 17:49:37 2021 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id B2E0B57CE06 for ; Thu, 11 Mar 2021 17:49:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4DxGfn4T9xz3Ph5 for ; Thu, 11 Mar 2021 17:49:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 9794757CB40; Thu, 11 Mar 2021 17:49:37 +0000 (UTC) Delivered-To: fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 9758B57CD41 for ; Thu, 11 Mar 2021 17:49:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DxGfn3rYCz3PYK for ; Thu, 11 Mar 2021 17:49:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 72FE71100 for ; Thu, 11 Mar 2021 17:49:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12BHnbNm021048 for ; Thu, 11 Mar 2021 17:49:37 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12BHnbXu021047 for fs@FreeBSD.org; Thu, 11 Mar 2021 17:49:37 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 254152] [zfs] can not boot with option rewind Date: Thu, 11 Mar 2021 17:49:37 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: loader, mountroot X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: oshogbo@freebsd.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: oshogbo@freebsd.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 11 Mar 2021 17:49:37 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254152 Mariusz Zaborski changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|fs@FreeBSD.org |oshogbo@freebsd.org Status|New |In Progress --- Comment #1 from Mariusz Zaborski --- When I was up-streaming the change to OpenZFS somehow, I didn't upstream the whole FreeBSD part. When the merge between the OpenZFS and FreeBSD happened -the code responsible for the parsing rewind option was removed. This patch should fix your problem: https://github.com/openzfs/zfs/pull/117= 30 --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Thu Mar 11 14:14:31 2021 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 060E8577F6D for ; Thu, 11 Mar 2021 14:14:31 +0000 (UTC) (envelope-from kamalpr@gmail.com) Received: from mail-pl1-x634.google.com (mail-pl1-x634.google.com [IPv6:2607:f8b0:4864:20::634]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Dx9tY63yFz4sTB for ; Thu, 11 Mar 2021 14:14:29 +0000 (UTC) (envelope-from kamalpr@gmail.com) Received: by mail-pl1-x634.google.com with SMTP id e2so4994614pld.9 for ; Thu, 11 Mar 2021 06:14:29 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:reply-to:from:date:message-id:subject:to; bh=ErIuitPAnsQu8IEBVln0JVnoFWXNE36amPzpCqP5UHo=; b=s2s8caYFcHgq0W80oADiipDTNRJdGV5UBeUK4ZStbE7GQvfRrnVaxcUhryKrpStU6v tutm8oe1zJOJWSIuVhIkXeLQtCAEtffr4RslAWwMRAFxUtd0WYsu2VHrBR6zwMDyYKhv kmSxzXcYNyUOT2QwLoG1HxsFPAV5yHmFt7Ld6Cts7XV8UYkBalDlTggnwK+c2HPxIlSt JdRaGnAUGzqVNCBfMGFjMXu72Ss16Pu6j7Q5QPyS5RxL/PJMmUi/5ERVBk5MvHdCDqKY 02rp+XT40w2LpDdo1GOb4n0lz80kSNdqRldkCWX0uvGTD48AMzl3BUaXJofH2ZcAlEzG SO1w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:reply-to:from:date:message-id :subject:to; bh=ErIuitPAnsQu8IEBVln0JVnoFWXNE36amPzpCqP5UHo=; b=eDFpFN+AYLoPDN2YePco5SKUZBiIurNWm8aJ0EEKrOmJ39DFUlR95rH7JMcz/hptOz PvW4oOeBNL/G1p+mQpSLRUOWjheLvMqN54hvZJZEgr/0WFgqOp5sDZdqX2AV0lXk4R21 Onf1Bmzi8UQfU9cZvUmrCr15KT2SZeAEEfYe9GGLgjOEpHNvr0h6SVKKP33nLfTSuoBS fAW74UZVshggXVnM1AaYRrrlORIxi95RnUfIhm0RaLMxv16E23eudY1opitpLFXFqZ2t q88M/nxh4oisnC5PmrG8UTYBphNskZCte6t+VhXFNlfsEoTfwgOWd6OupzaDGvPEsOxM wSqw== X-Gm-Message-State: AOAM531mnOZJFSzJs26OvrqVa3cLDgMwteOvk5CPW821KVZNx0RZW3B9 1XpGdhZ9J+glTDaM3fwLCbBYmDcydEMQAjq5DIpaU2k= X-Google-Smtp-Source: ABdhPJwOGvgOdp49h/KNaDkvN5bWp2vmm96mrBdE0EAHy03prokNLKaYAHx0/RgXCGNFnYpxMmogBVsSBqlXwF5HsSE= X-Received: by 2002:a17:90b:92:: with SMTP id bb18mr8940753pjb.40.1615472068033; Thu, 11 Mar 2021 06:14:28 -0800 (PST) MIME-Version: 1.0 Reply-To: kamalpr@gmail.com From: "Kamal R. Prasad" Date: Thu, 11 Mar 2021 19:44:17 +0530 Message-ID: Subject: map fd to filename in kgdb To: freebsd-fs@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4Dx9tY63yFz4sTB X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=s2s8caYF; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of kamalpr@gmail.com designates 2607:f8b0:4864:20::634 as permitted sender) smtp.mailfrom=kamalpr@gmail.com X-Spamd-Result: default: False [-3.93 / 15.00]; HAS_REPLYTO(0.00)[kamalpr@gmail.com]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; REPLYTO_ADDR_EQ_FROM(0.00)[]; TO_DN_NONE(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-0.93)[-0.928]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RBL_DBL_DONT_QUERY_IPS(0.00)[2607:f8b0:4864:20::634:from]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; FREEMAIL_REPLYTO(0.00)[gmail.com]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[2607:f8b0:4864:20::634:from:127.0.2.255]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::634:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-fs] X-Mailman-Approved-At: Thu, 11 Mar 2021 18:56:38 +0000 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 11 Mar 2021 14:14:31 -0000 hello how can I map fd to filename in kgdb when investigating a. crash? thanks -kamal From owner-freebsd-fs@freebsd.org Fri Mar 12 05:16:24 2021 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 5D2B056E3A5 for ; Fri, 12 Mar 2021 05:16:24 +0000 (UTC) (envelope-from kamalpr@gmail.com) Received: from mail-wm1-x32c.google.com (mail-wm1-x32c.google.com [IPv6:2a00:1450:4864:20::32c]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DxYvC4qvHz4pwB for ; Fri, 12 Mar 2021 05:16:23 +0000 (UTC) (envelope-from kamalpr@gmail.com) Received: by mail-wm1-x32c.google.com with SMTP id t5-20020a1c77050000b029010e62cea9deso14406732wmi.0 for ; Thu, 11 Mar 2021 21:16:23 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:reply-to:from:date:message-id:subject:to; bh=tVEfvwiQx+WSSCqfMvVMF9lxSg0e3I6UjtzIwmGJv1A=; b=DMDwtVyjCZ9Z4UA7hoqPX6IevXQVxNVtmtvcnt4PjCL9Z7mHzp5wHIuXtjZ3yZmaoR u/IXNgQbiZbobXyQkE6OJ2+rvQAyNUKqQ8F9uZYk4ThIGuoQSBDjxzt+CcPzym8Kk64j 6vlzoGAW7u1p8PsCbThvP5EjRqtt1ahxoIcAs+KALR2oWsGlLObt4i9dXShS74qzHqTd oWEtauyigrmTG3OWeLFKiszwLQ6OkRXhx+wtRNVdIZ9q9Sa12rwwnH5+saMMf63ckbKP 9n6nM/T9QCq+NzjQ7+5M9cTQBg5xujeyxZreQ52A77gbxbOzJDHllURNgzwpPz5OBygp zOrg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:reply-to:from:date:message-id :subject:to; bh=tVEfvwiQx+WSSCqfMvVMF9lxSg0e3I6UjtzIwmGJv1A=; b=l8J3Kaq3TCfYCegcsvgTLGS/JkGARIXMAbdWTYGuvEjE1dttQH6PnCE9BuDrUAUbCg X33bi+5Thr9mQMRQSxDZnvhWAjtWVdc6iAE9Su3UlBfUvCfDBF91FtUfN1pbqQBXRvW6 i4UItddogPrY+oTvTTZwbDcvaV+WDiFhZmA2FPZh8O0Zsw2/3fU6mVrtP/cnVXzVsSoK vtmUgqy56EvVq/KguK5jIoReBDT6YxnjybOzQrQVje96jthp5gOD0zzOMFDNZHcbOZ2h IeI0JuQHQh4X+WDf5MnuJNCDyrRGR13qyUMaiIDuApLTGpUrslmQCRhHk2PQVZoAY815 cUmQ== X-Gm-Message-State: AOAM5326vyvyO4CZ0L3xqDWkExHK+eLRMvKgWEEriEBUcCBGWbE+02QO UHrSFgg7IjjG74e0wwvG+AdjheTXB5kdYcqIEOz/LE93yZwy X-Google-Smtp-Source: ABdhPJwpfxjGWJGjrR0rsZlhc4zFyc5czhBU5ee4dPjmXQwISecZho+tj8dJiURCpAaef1hz2GSG3Qgaenq0f2eElRA= X-Received: by 2002:a7b:c931:: with SMTP id h17mr11400046wml.4.1615526181892; Thu, 11 Mar 2021 21:16:21 -0800 (PST) MIME-Version: 1.0 Reply-To: kamalpr@gmail.com From: "Kamal R. Prasad" Date: Fri, 12 Mar 2021 10:46:10 +0530 Message-ID: Subject: query To: freebsd-fs@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4DxYvC4qvHz4pwB X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=DMDwtVyj; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of kamalpr@gmail.com designates 2a00:1450:4864:20::32c as permitted sender) smtp.mailfrom=kamalpr@gmail.com X-Spamd-Result: default: False [-3.67 / 15.00]; HAS_REPLYTO(0.00)[kamalpr@gmail.com]; FREEMAIL_FROM(0.00)[gmail.com]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; REPLYTO_ADDR_EQ_FROM(0.00)[]; TO_DN_NONE(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-0.67)[-0.672]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RBL_DBL_DONT_QUERY_IPS(0.00)[2a00:1450:4864:20::32c:from]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; FREEMAIL_REPLYTO(0.00)[gmail.com]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[2a00:1450:4864:20::32c:from:127.0.2.255]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::32c:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-fs] X-Mailman-Approved-At: Fri, 12 Mar 2021 08:03:51 +0000 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 12 Mar 2021 05:16:24 -0000 hello, I had posted a query https://lists.freebsd.org/pipermail/freebsd-fs/2021-March/028808.html I found out that if in the bios, I set the console to access freebsd console and not the hypervisor, the problem is seen. Looking at the crash, I found that some of the deadlocked threads are trying to do a name() on /var/dblogin-locks as shown below. is there any process which can hold up this file and/or is there a setting that can be done to prevent this deadlock? thanks -kamal From owner-freebsd-fs@freebsd.org Fri Mar 12 18:57:58 2021 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 9E2635AA2E5 for ; Fri, 12 Mar 2021 18:57:58 +0000 (UTC) (envelope-from alexander.lochmann@tu-dortmund.de) Received: from unimail.uni-dortmund.de (mx1.hrz.uni-dortmund.de [129.217.128.51]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "unimail.tu-dortmund.de", Issuer "DFN-Verein Global Issuing CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Dxw794LBgz4kXQ for ; Fri, 12 Mar 2021 18:57:57 +0000 (UTC) (envelope-from alexander.lochmann@tu-dortmund.de) Received: from [192.168.111.102] (p4fd97a57.dip0.t-ipconnect.de [79.217.122.87]) (authenticated bits=0) by unimail.uni-dortmund.de (8.16.1/8.16.1) with ESMTPSA id 12CIvson024280 (version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NOT) for ; Fri, 12 Mar 2021 19:57:54 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=tu-dortmund.de; s=unimail; t=1615575474; bh=qUJ8LUx7BgrWXlfspLIo9wsndlopGS0c1TpaokKHzxE=; h=To:From:Subject:Date; b=U386HjWwBTv/5TRkQ4OsUNIaqAzgu9qAOkkZc/oAaBbUb7fh6f0ASyZ3LSx5gm/RW v8P9AyADPe4uqztkPtxLN0R+MeMJw+EyMomyzS30cHP1r9klE7oRFy4tW3NYKxvRHc hy/PwOaGap9Vipn9Q1bPnzKhWFTFsZH6594zgbjs= To: freebsd-fs@freebsd.org From: Alexander Lochmann Subject: [RFC] Understanding the locking of struct buf Message-ID: <49130618-349a-bfc7-6d26-0c3763904dc5@tu-dortmund.de> Date: Fri, 12 Mar 2021 19:57:54 +0100 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:78.0) Gecko/20100101 Thunderbird/78.7.1 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: 4Dxw794LBgz4kXQ X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=tu-dortmund.de header.s=unimail header.b=U386HjWw; dmarc=none; spf=pass (mx1.freebsd.org: domain of alexander.lochmann@tu-dortmund.de designates 129.217.128.51 as permitted sender) smtp.mailfrom=alexander.lochmann@tu-dortmund.de X-Spamd-Result: default: False [-5.20 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; RWL_MAILSPIKE_GOOD(0.00)[129.217.128.51:from]; R_SPF_ALLOW(-0.20)[+ip4:129.217.128.0/24]; TO_DN_NONE(0.00)[]; RCVD_DKIM_ARC_DNSWL_MED(-0.50)[]; RCVD_IN_DNSWL_MED(-0.20)[129.217.128.51:from]; DKIM_TRACE(0.00)[tu-dortmund.de:+]; NEURAL_HAM_SHORT(-1.00)[-1.000]; RECEIVED_SPAMHAUS_PBL(0.00)[79.217.122.87:received]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:680, ipnet:129.217.0.0/16, country:DE]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[tu-dortmund.de:s=unimail]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; DMARC_NA(0.00)[tu-dortmund.de]; RCPT_COUNT_ONE(0.00)[1]; DWL_DNSWL_LOW(-1.00)[tu-dortmund.de:dkim]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-fs] X-Mailman-Approved-At: Fri, 12 Mar 2021 19:29:36 +0000 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 12 Mar 2021 18:57:58 -0000 Hi folks! According to the definition [1], any access to a struct buf is protected by a lock: 1) Are there exceptions to those locking rules for reading and/or writing a member? E.g. any read is permitted without a lock being held. Can b_bcount, for example, be read without a lock? 2) In vfs_bio.c, for example, the BUF_KERNPROC macro is used to move ownership of a buf.b_lock to the kernel. In _lockmgr_disown() [2] WITNESS_UNLOCK() is called to emulate an unlock. So, shouldn't be there a WITNESS_LOCK() for that lock? Otherwise, the Witness system might complain about the upcoming unlock. 3) Is the function brelse()/bqrelse() considered to be a destruction function? Hence, no lock (buf.b_lock) is needed within this function to access a struct buf. Thanks! Regards, Alex [1] https://github.com/freebsd/freebsd-src/blob/main/sys/sys/buf.h#L99 [2] https://github.com/freebsd/freebsd-src/blob/main/sys/kern/kern_lock.c#L1616 [3] https://github.com/freebsd/freebsd-src/blob/main/sys/sys/buf.h#L387 -- Technische Universität Dortmund Alexander Lochmann PGP key: 0xBC3EF6FD Otto-Hahn-Str. 16 phone: +49.231.7556141 D-44227 Dortmund fax: +49.231.7556116 http://ess.cs.tu-dortmund.de/Staff/al From owner-freebsd-fs@freebsd.org Sat Mar 13 03:30:41 2021 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 582345B7BAF for ; Sat, 13 Mar 2021 03:30:41 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from kib.kiev.ua (kib.kiev.ua [IPv6:2001:470:d5e7:1::1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Dy7Vm2ZV3z3pZs for ; Sat, 13 Mar 2021 03:30:39 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from tom.home (kib@localhost [127.0.0.1]) by kib.kiev.ua (8.16.1/8.16.1) with ESMTPS id 12D3UQ1v001367 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Sat, 13 Mar 2021 05:30:29 +0200 (EET) (envelope-from kostikbel@gmail.com) DKIM-Filter: OpenDKIM Filter v2.10.3 kib.kiev.ua 12D3UQ1v001367 Received: (from kostik@localhost) by tom.home (8.16.1/8.16.1/Submit) id 12D3UPTm001361; Sat, 13 Mar 2021 05:30:25 +0200 (EET) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: tom.home: kostik set sender to kostikbel@gmail.com using -f Date: Sat, 13 Mar 2021 05:30:25 +0200 From: Konstantin Belousov To: Alexander Lochmann Cc: freebsd-fs@freebsd.org Subject: Re: [RFC] Understanding the locking of struct buf Message-ID: References: <49130618-349a-bfc7-6d26-0c3763904dc5@tu-dortmund.de> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <49130618-349a-bfc7-6d26-0c3763904dc5@tu-dortmund.de> X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED,BAYES_00, DKIM_ADSP_CUSTOM_MED,FORGED_GMAIL_RCVD,FREEMAIL_FROM, NML_ADSP_CUSTOM_MED autolearn=no autolearn_force=no version=3.4.4 X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on tom.home X-Rspamd-Queue-Id: 4Dy7Vm2ZV3z3pZs X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=fail reason="No valid SPF, No valid DKIM" header.from=gmail.com (policy=none); spf=softfail (mx1.freebsd.org: 2001:470:d5e7:1::1 is neither permitted nor denied by domain of kostikbel@gmail.com) smtp.mailfrom=kostikbel@gmail.com X-Spamd-Result: default: False [-1.97 / 15.00]; RCVD_TLS_ALL(0.00)[]; ARC_NA(0.00)[]; DMARC_POLICY_SOFTFAIL(0.10)[gmail.com : No valid SPF, No valid DKIM,none]; NEURAL_HAM_MEDIUM(-0.16)[-0.159]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; NEURAL_HAM_LONG(-0.90)[-0.898]; MIME_GOOD(-0.10)[text/plain]; HAS_XAW(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[2001:470:d5e7:1::1:from]; R_SPF_SOFTFAIL(0.00)[~all]; SPAMHAUS_ZRD(0.00)[2001:470:d5e7:1::1:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-0.92)[-0.917]; RCPT_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:6939, ipnet:2001:470::/32, country:US]; MIME_TRACE(0.00)[0:+]; MAILMAN_DEST(0.00)[freebsd-fs]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 13 Mar 2021 03:30:41 -0000 On Fri, Mar 12, 2021 at 07:57:54PM +0100, Alexander Lochmann wrote: > Hi folks! > > According to the definition [1], any access to a struct buf is protected > by a lock: > 1) Are there exceptions to those locking rules for reading and/or > writing a member? > E.g. any read is permitted without a lock being held. > Can b_bcount, for example, be read without a lock? Sure you can read it without lock. Question is, what do you intent to do with this information. Buffers used to track io requests for vnodes, that is, buffers appearing on bufobj dirty/clean queues, are type-stable, so you are guaranteed that the memory is not reused for something else. On the other hand, only buffer lock guarantees that the buffer identity, i.e. (vnode, range) for data described by the buffer, is valid. > > 2) In vfs_bio.c, for example, the BUF_KERNPROC macro is used to move > ownership of a buf.b_lock to the kernel. > In _lockmgr_disown() [2] WITNESS_UNLOCK() is called to emulate an > unlock. So, shouldn't be there a WITNESS_LOCK() for that lock? > Otherwise, the Witness system might complain about the upcoming unlock. Are you reporting a bug or just asking about LK_KERNPROC. Lockmgr (kern_lock.c)is careful enough to handle LK_KERNPROC owner specially. In particular, it does not report unlock of such lock to witness. > > 3) Is the function brelse()/bqrelse() considered to be a destruction > function? As I said above, buffers are type-stable, they are not destructed. brelse/bqrelse relinguish ownership of the buffer by the calling thread. After that, buffer typically goes to corresponding queue of unlocked clean or dirty buffer, from where it could be picked up or reclaimed to represent a different buffer. > Hence, no lock (buf.b_lock) is needed within this function to access a > struct buf. The buffer lock is required for call to brelse (and bqrelse). As noted, buffer lock represents an ownership of the buffer. It is typically obtained when the thread calls bread(9), which returns valid and locked buffer. Then caller do whatever he needed, then it is either brelse() if the buffer is clean, or some variant of bwrite() if buffer become dirty. Buffer lock is taken somewhere in bread() and released in brelse/bwrite, from the PoV of the consumer of the buffer cache. Actual interactions are usually more complex, due to a lot of features grown in the buffer cache for 40+ years, but the main principle remained the same, thread that owns the buffer owns its lock. From owner-freebsd-fs@freebsd.org Sat Mar 13 12:59:26 2021 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 4AFA5576BEB for ; Sat, 13 Mar 2021 12:59:26 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from kib.kiev.ua (kib.kiev.ua [IPv6:2001:470:d5e7:1::1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4DyN705MCjz4r8w for ; Sat, 13 Mar 2021 12:59:24 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from tom.home (kib@localhost [127.0.0.1]) by kib.kiev.ua (8.16.1/8.16.1) with ESMTPS id 12DCxG3f041777 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Sat, 13 Mar 2021 14:59:19 +0200 (EET) (envelope-from kostikbel@gmail.com) DKIM-Filter: OpenDKIM Filter v2.10.3 kib.kiev.ua 12DCxG3f041777 Received: (from kostik@localhost) by tom.home (8.16.1/8.16.1/Submit) id 12DCxGfR041776; Sat, 13 Mar 2021 14:59:16 +0200 (EET) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: tom.home: kostik set sender to kostikbel@gmail.com using -f Date: Sat, 13 Mar 2021 14:59:16 +0200 From: Konstantin Belousov To: Alexander Lochmann Cc: freebsd-fs@freebsd.org Subject: Re: [RFC] Understanding the locking of struct buf Message-ID: References: <49130618-349a-bfc7-6d26-0c3763904dc5@tu-dortmund.de> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED,BAYES_00, DKIM_ADSP_CUSTOM_MED,FORGED_GMAIL_RCVD,FREEMAIL_FROM, NML_ADSP_CUSTOM_MED autolearn=no autolearn_force=no version=3.4.4 X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on tom.home X-Rspamd-Queue-Id: 4DyN705MCjz4r8w X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=fail reason="No valid SPF, No valid DKIM" header.from=gmail.com (policy=none); spf=softfail (mx1.freebsd.org: 2001:470:d5e7:1::1 is neither permitted nor denied by domain of kostikbel@gmail.com) smtp.mailfrom=kostikbel@gmail.com X-Spamd-Result: default: False [-2.98 / 15.00]; ARC_NA(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[2001:470:d5e7:1::1:from]; DMARC_POLICY_SOFTFAIL(0.10)[gmail.com : No valid SPF, No valid DKIM,none]; RCVD_TLS_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; NEURAL_HAM_LONG(-0.98)[-0.979]; MIME_GOOD(-0.10)[text/plain]; HAS_XAW(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_SPF_SOFTFAIL(0.00)[~all:c]; SPAMHAUS_ZRD(0.00)[2001:470:d5e7:1::1:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-0.999]; RCPT_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:6939, ipnet:2001:470::/32, country:US]; MIME_TRACE(0.00)[0:+]; MAILMAN_DEST(0.00)[freebsd-fs]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 13 Mar 2021 12:59:26 -0000 On Sat, Mar 13, 2021 at 01:03:59PM +0100, Alexander Lochmann wrote: > > > On 13.03.21 04:30, Konstantin Belousov wrote: > >> E.g. any read is permitted without a lock being held. > >> Can b_bcount, for example, be read without a lock? > > Sure you can read it without lock. Question is, what do you intent to do > > with this information. > We're performing lock analysis on the FreeBSD kernel, and I want > understand what kind of general assumptions are made. > In the Linux kernel, for example, every word-sized value is considered > to be read without a lock if consistency doesn't matter. What consistency? If you are talking about multithreading memory model as expected by the FreeBSD kernel, look at atomic(9). It has assumptions like atomicity of naturally-aligned word-sized integer accesses written out explicitly. > In FreeBSD, do I have to use lock X in any case except Y and Z? > Or is it the other way round: Do I need no lock at all except for case X > and Y? I do not understand this question(?). > > > Are you reporting a bug or just asking about LK_KERNPROC. Lockmgr > > (kern_lock.c)is careful enough to handle LK_KERNPROC owner specially. In > > particular, it does not report unlock of such lock to witness. > First of all, I want to understand how things in FreeBSD work. > >From what I understand now: When setting up an asynchronous IO request, > buf.b_lock is taken by thread X. Later on LK_KERNPROC is used to hand > over the ownership to the kernel. The lock itself is still acquired. The lock is acquired in the sense that nobody else can take the buffer' lock until the call to lockmgr(LK_RELEASE). But from this point, there is no thread owning the lock. Consider that the lock was converted to the 1-counting semaphore. > The completion of the IO job is performed in the kernel's context, which > releases buf.b_lock in brelse(). The completion for async IO is performed in the context of some other thread, typically either geom io up thread, or direct completion thread of some disk driver. This is why this somewhat strange LK_KERNPROC business is needed at all. For sync IO, that thread only signals original thread that io completed. In this case, no LK_KERNPROC trick is performed. > So there is no explicit lock call in the latter context, is it? No lock call, but there is an unlock. > > However, I think there is indeed a call to WITNESS_UNLOCK() in > __lockmgr_disown(): > https://github.com/freebsd/freebsd-src/blob/main/sys/kern/kern_lock.c#L1641 > > For the following stack trace, we observe several writes to buf.b_bcount > without any lock held. > xpt_done_td > xpt_done_process > adadone > g_disk_done > g_io_devliver > g_std_done > g_io_deliver > g_std_done > g_io_deliver > g_vfs_done > bufdone > ffs_backgroundwritedone > bufdine > brelse Assuming you wrote the stack bottom-up, this is exactly what I wrote above: xpt_done_td is CAM IO completion thread, and it performs actions after hw informed that io request (bio) was completed. > allocbuf When brelse() notes that buffer was marked as 'no cache', it demolishes the buffer right after async io finishes. Perhaps this is the case that you observed. > > There are several reasons for those observations: > a) Due to the call to WITNESS_UNLOCK() in __lockmgr_disown(), which we > instrumented, our approach assumes no lock is held. > b) Our instrumentation missed a lock call. > c) Down the path describes above, no locks are held at all. > d) Something else.... > Can you pls shed some light on our observation? > > - Alex > > -- > Technische Universität Dortmund > Alexander Lochmann PGP key: 0xBC3EF6FD > Otto-Hahn-Str. 16 phone: +49.231.7556141 > D-44227 Dortmund fax: +49.231.7556116 > http://ess.cs.tu-dortmund.de/Staff/al From owner-freebsd-fs@freebsd.org Sat Mar 13 16:32:13 2021 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 8803457BEF4 for ; Sat, 13 Mar 2021 16:32:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4DySrY3FZ0z53ry for ; Sat, 13 Mar 2021 16:32:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 6DBC757BBAD; Sat, 13 Mar 2021 16:32:13 +0000 (UTC) Delivered-To: fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 6D86B57BCAE for ; Sat, 13 Mar 2021 16:32:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DySrY2cHmz53gj for ; Sat, 13 Mar 2021 16:32:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4D0E16104 for ; Sat, 13 Mar 2021 16:32:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12DGWDc7039907 for ; Sat, 13 Mar 2021 16:32:13 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12DGWDnF039906 for fs@FreeBSD.org; Sat, 13 Mar 2021 16:32:13 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 254210] 13.0-RC1: jail: nullfs: deleted files does not free up space Date: Sat, 13 Mar 2021 16:32:13 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: kevans@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: jail@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 13 Mar 2021 16:32:13 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254210 Kyle Evans changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |fs@FreeBSD.org, | |kevans@freebsd.org --- Comment #1 from Kyle Evans --- Let's loop in fs as well, since this is at the intersection of jails and filesystems. --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-fs@freebsd.org Sat Mar 13 18:06:03 2021 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id EA58D57E23E for ; Sat, 13 Mar 2021 18:06:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4DyVwq676rz59KS for ; Sat, 13 Mar 2021 18:06:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id D02E357E34D; Sat, 13 Mar 2021 18:06:03 +0000 (UTC) Delivered-To: fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id CED2857E0E0 for ; Sat, 13 Mar 2021 18:06:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DyVwq5FDmz59V9 for ; Sat, 13 Mar 2021 18:06:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id A633971C7 for ; Sat, 13 Mar 2021 18:06:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12DI63iY084183 for ; Sat, 13 Mar 2021 18:06:03 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12DI63VA084182 for fs@FreeBSD.org; Sat, 13 Mar 2021 18:06:03 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 254210] 13.0-RC1: jail: nullfs: deleted files does not free up space Date: Sat, 13 Mar 2021 18:06:03 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: kib@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: jail@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 13 Mar 2021 18:06:04 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254210 Konstantin Belousov changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |kib@FreeBSD.org --- Comment #2 from Konstantin Belousov --- Add "nocache" option to both nullfs mounts. --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-fs@freebsd.org Sat Mar 13 12:04:03 2021 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 510A8575B17 for ; Sat, 13 Mar 2021 12:04:03 +0000 (UTC) (envelope-from alexander.lochmann@tu-dortmund.de) Received: from unimail.uni-dortmund.de (mx1.hrz.uni-dortmund.de [129.217.128.51]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "unimail.tu-dortmund.de", Issuer "DFN-Verein Global Issuing CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DyLv64HQ7z4nlP for ; Sat, 13 Mar 2021 12:04:02 +0000 (UTC) (envelope-from alexander.lochmann@tu-dortmund.de) Received: from [192.168.111.103] (p2e513b89.dip0.t-ipconnect.de [46.81.59.137]) (authenticated bits=0) by unimail.uni-dortmund.de (8.16.1/8.16.1) with ESMTPSA id 12DC3xe3027099 (version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NOT); Sat, 13 Mar 2021 13:03:59 +0100 (CET) To: Konstantin Belousov Cc: freebsd-fs@freebsd.org References: <49130618-349a-bfc7-6d26-0c3763904dc5@tu-dortmund.de> From: Alexander Lochmann Subject: Re: [RFC] Understanding the locking of struct buf Message-ID: Date: Sat, 13 Mar 2021 13:03:59 +0100 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:78.0) Gecko/20100101 Thunderbird/78.7.1 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: 4DyLv64HQ7z4nlP X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of alexander.lochmann@tu-dortmund.de designates 129.217.128.51 as permitted sender) smtp.mailfrom=alexander.lochmann@tu-dortmund.de X-Spamd-Result: default: False [-3.50 / 15.00]; RCVD_TLS_ALL(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:129.217.128.0/24]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[tu-dortmund.de]; ARC_NA(0.00)[]; RWL_MAILSPIKE_GOOD(0.00)[129.217.128.51:from]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_MED(-0.20)[129.217.128.51:from]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-1.00)[-0.997]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:680, ipnet:129.217.0.0/16, country:DE]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-fs]; RECEIVED_SPAMHAUS_PBL(0.00)[46.81.59.137:received] X-Mailman-Approved-At: Sat, 13 Mar 2021 18:22:34 +0000 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 13 Mar 2021 12:04:03 -0000 On 13.03.21 04:30, Konstantin Belousov wrote: >> E.g. any read is permitted without a lock being held. >> Can b_bcount, for example, be read without a lock? > Sure you can read it without lock. Question is, what do you intent to do > with this information. We're performing lock analysis on the FreeBSD kernel, and I want understand what kind of general assumptions are made. In the Linux kernel, for example, every word-sized value is considered to be read without a lock if consistency doesn't matter. In FreeBSD, do I have to use lock X in any case except Y and Z? Or is it the other way round: Do I need no lock at all except for case X and Y? > Are you reporting a bug or just asking about LK_KERNPROC. Lockmgr > (kern_lock.c)is careful enough to handle LK_KERNPROC owner specially. In > particular, it does not report unlock of such lock to witness. First of all, I want to understand how things in FreeBSD work. >From what I understand now: When setting up an asynchronous IO request, buf.b_lock is taken by thread X. Later on LK_KERNPROC is used to hand over the ownership to the kernel. The lock itself is still acquired. The completion of the IO job is performed in the kernel's context, which releases buf.b_lock in brelse(). So there is no explicit lock call in the latter context, is it? However, I think there is indeed a call to WITNESS_UNLOCK() in __lockmgr_disown(): https://github.com/freebsd/freebsd-src/blob/main/sys/kern/kern_lock.c#L1641 For the following stack trace, we observe several writes to buf.b_bcount without any lock held. xpt_done_td xpt_done_process adadone g_disk_done g_io_devliver g_std_done g_io_deliver g_std_done g_io_deliver g_vfs_done bufdone ffs_backgroundwritedone bufdine brelse allocbuf There are several reasons for those observations: a) Due to the call to WITNESS_UNLOCK() in __lockmgr_disown(), which we instrumented, our approach assumes no lock is held. b) Our instrumentation missed a lock call. c) Down the path describes above, no locks are held at all. d) Something else.... Can you pls shed some light on our observation? - Alex -- Technische Universität Dortmund Alexander Lochmann PGP key: 0xBC3EF6FD Otto-Hahn-Str. 16 phone: +49.231.7556141 D-44227 Dortmund fax: +49.231.7556116 http://ess.cs.tu-dortmund.de/Staff/al From owner-freebsd-fs@freebsd.org Sat Mar 13 16:29:42 2021 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 9EA7D57B779 for ; Sat, 13 Mar 2021 16:29:42 +0000 (UTC) (envelope-from alexander.lochmann@tu-dortmund.de) Received: from unimail.uni-dortmund.de (mx1.hrz.uni-dortmund.de [129.217.128.51]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "unimail.tu-dortmund.de", Issuer "DFN-Verein Global Issuing CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DySnd6WCGz53n3 for ; Sat, 13 Mar 2021 16:29:41 +0000 (UTC) (envelope-from alexander.lochmann@tu-dortmund.de) Received: from [192.168.111.102] (p2e513b89.dip0.t-ipconnect.de [46.81.59.137]) (authenticated bits=0) by unimail.uni-dortmund.de (8.16.1/8.16.1) with ESMTPSA id 12DGTdLd004960 (version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NOT); Sat, 13 Mar 2021 17:29:39 +0100 (CET) To: Konstantin Belousov Cc: freebsd-fs@freebsd.org References: <49130618-349a-bfc7-6d26-0c3763904dc5@tu-dortmund.de> From: Alexander Lochmann Subject: Re: [RFC] Understanding the locking of struct buf Message-ID: <48913698-d2e8-9721-ee1a-4828a9265e55@tu-dortmund.de> Date: Sat, 13 Mar 2021 17:29:39 +0100 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:78.0) Gecko/20100101 Thunderbird/78.7.1 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Language: de-DE Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: 4DySnd6WCGz53n3 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of alexander.lochmann@tu-dortmund.de designates 129.217.128.51 as permitted sender) smtp.mailfrom=alexander.lochmann@tu-dortmund.de X-Spamd-Result: default: False [-3.50 / 15.00]; RCVD_TLS_ALL(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:129.217.128.0/24]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[tu-dortmund.de]; ARC_NA(0.00)[]; RWL_MAILSPIKE_GOOD(0.00)[129.217.128.51:from]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_MED(-0.20)[129.217.128.51:from]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-1.00)[-0.999]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:680, ipnet:129.217.0.0/16, country:DE]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-fs]; RECEIVED_SPAMHAUS_PBL(0.00)[46.81.59.137:received] X-Mailman-Approved-At: Sat, 13 Mar 2021 18:22:46 +0000 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 13 Mar 2021 16:29:42 -0000 On 13.03.21 13:59, Konstantin Belousov wrote: > What consistency? If you are talking about multithreading memory model > as expected by the FreeBSD kernel, look at atomic(9). It has assumptions > like atomicity of naturally-aligned word-sized integer accesses written > out explicitly. > Yeah, I think that's what I meant. Thx! In sys/sys/buf.h, it says "All fields are protected by the buffer lock except those marked [...]". How does this fit together with atomic(9)? If I had to implement some extension to vfs_bio.c, for example, I would follow those locking rules without knowing that I may access some fields without any lock. Shouldn't that particular piece of documentation be updated? For example: b_bcount /* w: b_lock, r: no lock needed */ >> In FreeBSD, do I have to use lock X in any case except Y and Z? >> Or is it the other way round: Do I need no lock at all except for case X >> and Y? > I do not understand this question(?). > I'm sry. Maybe my question is just nuts.>> >>> Are you reporting a bug or just asking about LK_KERNPROC. Lockmgr >>> (kern_lock.c)is careful enough to handle LK_KERNPROC owner specially. In >>> particular, it does not report unlock of such lock to witness. >> First of all, I want to understand how things in FreeBSD work. >> >From what I understand now: When setting up an asynchronous IO request, >> buf.b_lock is taken by thread X. Later on LK_KERNPROC is used to hand >> over the ownership to the kernel. The lock itself is still acquired. > The lock is acquired in the sense that nobody else can take the buffer' > lock until the call to lockmgr(LK_RELEASE). So can we safely assume, for our analysis, that the b_lock is still acquired during bufdone and the other related fns? But from this point, there > is no thread owning the lock. Consider that the lock was converted to > the 1-counting semaphore.I'm not sure. What do you mean bei 1-counting semaphore? > >> The completion of the IO job is performed in the kernel's context, which >> releases buf.b_lock in brelse(). > The completion for async IO is performed in the context of some other > thread, typically either geom io up thread, or direct completion thread > of some disk driver. This is why this somewhat strange LK_KERNPROC > business is needed at all. > > For sync IO, that thread only signals original thread that io completed. > In this case, no LK_KERNPROC trick is performed. > That is clear to me. >> So there is no explicit lock call in the latter context, is it? > No lock call, but there is an unlock. Are you talking about BUF_UNLOCK()? > Assuming you wrote the stack bottom-up, this is exactly what I wrote above: > xpt_done_td is CAM IO completion thread, and it performs actions after hw > informed that io request (bio) was completed. > Thx. >> allocbuf > When brelse() notes that buffer was marked as 'no cache', it demolishes > the buffer right after async io finishes. Perhaps this is the case that > you observed. Yeah, but maybe our approach is just inaccurate. Due to the WITNESS_UNLOCK() call in __lockmgr_disown(), we assume the b_lock has already been released. - Alex -- Technische Universität Dortmund Alexander Lochmann PGP key: 0xBC3EF6FD Otto-Hahn-Str. 16 phone: +49.231.7556141 D-44227 Dortmund fax: +49.231.7556116 http://ess.cs.tu-dortmund.de/Staff/al From owner-freebsd-fs@freebsd.org Sat Mar 13 20:23:49 2021 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 2062E5AA1C0 for ; Sat, 13 Mar 2021 20:23:49 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4DyYzn0CKWz3MNS for ; Sat, 13 Mar 2021 20:23:49 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 06FDE5AA148; Sat, 13 Mar 2021 20:23:49 +0000 (UTC) Delivered-To: fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 06BAB5AA06B for ; Sat, 13 Mar 2021 20:23:49 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DyYzm6f5Xz3MNR for ; Sat, 13 Mar 2021 20:23:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id D79D1111AB for ; Sat, 13 Mar 2021 20:23:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 12DKNmmX054702 for ; Sat, 13 Mar 2021 20:23:48 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 12DKNmJX054701 for fs@FreeBSD.org; Sat, 13 Mar 2021 20:23:48 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 254210] 13.0-RC1: jail: nullfs: deleted files does not free up space Date: Sat, 13 Mar 2021 20:23:49 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: rashey@superbox.pl X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: jail@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 13 Mar 2021 20:23:49 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254210 --- Comment #3 from rashey@superbox.pl --- (In reply to Konstantin Belousov from comment #2) It is not documented and mount -t nullfs does not indicate that the option = is used but it work. One of the jails is working as file server and there is a lot of read operations. Should I worry about hard disk head contention? --=20 You are receiving this mail because: You are on the CC list for the bug.=