From owner-freebsd-fs@freebsd.org Sun Feb 11 19:06:14 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A59C9F0EA8C for ; Sun, 11 Feb 2018 19:06:14 +0000 (UTC) (envelope-from esr@mail.hebrew.edu) Received: from mail-qk0-x231.google.com (mail-qk0-x231.google.com [IPv6:2607:f8b0:400d:c09::231]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CAC38599B for ; Sun, 11 Feb 2018 19:06:13 +0000 (UTC) (envelope-from esr@mail.hebrew.edu) Received: by mail-qk0-x231.google.com with SMTP id n188so16072015qkn.11 for ; Sun, 11 Feb 2018 11:06:13 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=mail-hebrew-edu.20150623.gappssmtp.com; s=20150623; h=mime-version:sender:from:date:message-id:subject:to; bh=rBfH84E4pm1bzGdDH+hkKRDLvflqI6TwB5YJm+V5h58=; b=f/2tB4uWqtxRECQ5kEvh+JmEshyyz8Efmhqhltxd0p3MUH4bE0jmSR2uJXVjjmy2I9 qtNjF4c1a483nYaW5ozOO0+gUqBPKKDFdCTkQF30QmcauOfZsXCx3dMs8r6CzEj1dAEA KKITlDAGN6csosr+SJLhl5tH3qumEV8O9Y9185Eb37VVzM21jGaBV5OU/0tfVIQXuiTV n2e+Tiih1jzPqY3nyhELlNhLnaDZ6R7CTkPl4+mGbJpKsxQgDEGmkjKVDx9mvDxQB+Eb tPqipsL9I33p5wHfp9j6e9CGwuB5X8FAUtV32qc+ZeebA9pnFfVeettv1pgeqEzk9A53 qdHg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:sender:from:date:message-id:subject :to; bh=rBfH84E4pm1bzGdDH+hkKRDLvflqI6TwB5YJm+V5h58=; b=IB7r9IND5fZHjuIGB/P/kiIVGqmhGpYc5NVEMBajaLP/JveI2nVMq0z13sZ6iVU7U8 ueTgoePqvwYMWIY9IfqacFSFmRMbslQ69w9E6e87BpNV9CVL/HDEnBrGO7Gd90tbcpLZ fMSNHQkp+U91ofLGLnI6BtvEd87ECKhOvDopEhK/D0MNwnEgD/LxBSYBETep5PzrEFAm Zi61PeOmjISPxIkZVoT9HFR2RfqmICNwZLAGenGCYy05zUduD7N8WhRAWaHyfnzv6g19 o1isu9GuZ+AzscuRXwPi1ouyPc2EM2FHbZvAJdu1Jf+PcuMtjF9K9rIqaX8ZfL6cCYP9 Bx9w== X-Gm-Message-State: APf1xPALF7CQLN+0NXHVsjj7shSOxJHraVBFO9X8YLpumulAUUJ7hgsa sdfC+tpSNoW+KxvO649sKQBgUMZlbGNvoAM1N2yOnuXZ X-Google-Smtp-Source: AH8x227W02hGE2+w69bKeq7DsZAK4BXtoYOrdg+e+4/NSLlwJrxZfyavBmCfCNEHfE9WiD1FHnGXd1jlnLoIsWZNzjY= X-Received: by 10.55.92.133 with SMTP id q127mr14011953qkb.225.1518375973236; Sun, 11 Feb 2018 11:06:13 -0800 (PST) MIME-Version: 1.0 Sender: esr@mail.hebrew.edu Received: by 10.12.196.5 with HTTP; Sun, 11 Feb 2018 11:06:12 -0800 (PST) From: "E.S. Rosenberg" Date: Sun, 11 Feb 2018 21:06:12 +0200 X-Google-Sender-Auth: z-n4yTrij4AP3y4jSHBi-OFD3PI Message-ID: Subject: raw filesystem counters To: freebsd-fs@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.25 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 11 Feb 2018 19:06:15 -0000 Hi, Hopefully I'm not asking something that has been answered thousands of times, I did search but did not find. Is there any way to access raw disk counters similar to those found on Linux in: /sys/class/block//stat Preferably also by accessing such a virtual file and not by using iostat / zpool iostat which are already pre-processing counters and need to be run constantly to get accurate real-time estimates. So far I have not stumbled upon the right sysctl key to get these counters (and TBH as said before I'd much rather read a "file" then run a command though that matters less as long as the counters are raw). Background: I'm trying to get a better idea of what is going on with our IO, I would like to push the counters into Zabbix and maybe other data analysis software later so I prefer raw counters that can then be processed by whatever software we are using. Thanks! Eli From owner-freebsd-fs@freebsd.org Mon Feb 12 04:52:18 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0A5BBF16E2E for ; Mon, 12 Feb 2018 04:52:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 450257DD34 for ; Mon, 12 Feb 2018 04:52:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 964E415BF3 for ; Mon, 12 Feb 2018 04:52:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w1C4qGNB080942 for ; Mon, 12 Feb 2018 04:52:16 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w1C4qG7C080941 for freebsd-fs@FreeBSD.org; Mon, 12 Feb 2018 04:52:16 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 225423] panic: softdep_deallocate_dependencies: dangling deps Date: Mon, 12 Feb 2018 04:52:16 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: deepak.ukey@microsemi.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 12 Feb 2018 04:52:18 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D225423 --- Comment #8 from Deepak Ukey --- (In reply to Kirk McKusick from comment #7) Hi, I am using following version: FreeBSD pmc 11.0-RELEASE-p1 FreeBSD 11.0-RELEASE-p1 #0: Mon Jan 29 09:08:26= IST 2018 root@pmc:/usr/obj/usr/src/sys/GENERIC amd64 Regards, Deepak --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Mon Feb 12 05:55:47 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id EE66CF1B846 for ; Mon, 12 Feb 2018 05:55:46 +0000 (UTC) (envelope-from peter@rulingia.com) Received: from vps.rulingia.com (vps.rulingia.com [103.243.244.15]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.rulingia.com", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 391BE81047 for ; Mon, 12 Feb 2018 05:55:45 +0000 (UTC) (envelope-from peter@rulingia.com) Received: from server.rulingia.com (ppp59-167-167-3.static.internode.on.net [59.167.167.3]) by vps.rulingia.com (8.15.2/8.15.2) with ESMTPS id w1C5tCRQ036205 (version=TLSv1.2 cipher=DHE-RSA-CHACHA20-POLY1305 bits=256 verify=OK); Mon, 12 Feb 2018 16:55:19 +1100 (AEDT) (envelope-from peter@rulingia.com) X-Bogosity: Ham, spamicity=0.000000 Received: from server.rulingia.com (localhost.rulingia.com [127.0.0.1]) by server.rulingia.com (8.15.2/8.15.2) with ESMTPS id w1C5t5ZM020171 (version=TLSv1.2 cipher=ECDHE-RSA-CHACHA20-POLY1305 bits=256 verify=NO); Mon, 12 Feb 2018 16:55:05 +1100 (AEDT) (envelope-from peter@server.rulingia.com) Received: (from peter@localhost) by server.rulingia.com (8.15.2/8.15.2/Submit) id w1C5t5Pf020170; Mon, 12 Feb 2018 16:55:05 +1100 (AEDT) (envelope-from peter) Date: Mon, 12 Feb 2018 16:55:05 +1100 From: Peter Jeremy To: "E.S. Rosenberg" Cc: freebsd-fs@freebsd.org Subject: Re: raw filesystem counters Message-ID: <20180212055505.GD3353@server.rulingia.com> References: MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="SO98HVl1bnMOfKZd" Content-Disposition: inline In-Reply-To: X-PGP-Key: http://www.rulingia.com/keys/peter.pgp User-Agent: Mutt/1.9.2 (2017-12-15) X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 12 Feb 2018 05:55:47 -0000 --SO98HVl1bnMOfKZd Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On 2018-Feb-11 21:06:12 +0200, "E.S. Rosenberg" wrote: >Is there any way to access raw disk counters similar to those found on >Linux in: >/sys/class/block//stat > >Preferably also by accessing such a virtual file and not by using iostat / >zpool iostat which are already pre-processing counters and need to be run >constantly to get accurate real-time estimates. For the raw disk data, have a look at the statistics functions in libgeom(3). You can use the source code for gstat(8) to get a better idea how to drive it. I don't know of any published API for vdev-level ZFS statistics and, unfortunately, "zpool iostat" only supports "humanized" output, which makes it difficult to use them as input to further monitoring. There are some ARC statistics under sysctl kstat.zfs.misc --=20 Peter Jeremy --SO98HVl1bnMOfKZd Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQKTBAEBCgB9FiEE7rKYbDBnHnTmXCJ+FqWXoOSiCzQFAlqBLDlfFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldEVF QjI5ODZDMzA2NzFFNzRFNjVDMjI3RTE2QTU5N0EwRTRBMjBCMzQACgkQFqWXoOSi CzQW3Q//byUbsp5vTLG4100YEVDNT31D2KJelfhTMtQ6/BlWGJ29nGukoRLVoFh8 L3Kj7YjD/tfYUx7u0QA/kAjtcBvteO5i7Tsif1v8SZ2WekydMzf2Yu5+o9jVYlDy Nb7bUOguLvdt7JLx89k63/ilpANXcnxEu4upM/N+YLR1hu3D9CiutjEqHcaExTd3 LEbZt5Fs3eYzIJUUn7OZftRemsea+a4l9cxBPjMnGzEHz3XIHgsYgehQInWeue+4 tIKnrY5z/i2lk0zuZ63xPw2+cgNRwz1veL+orTqwZNHM50Z4R77sTY9gaSY0jkNZ dfgj7fYQwrtmryefOX+o9L/v+kYf6p52FjodSmGkwtTlis8uWfRpQPxODYgRI9mH YkaL95n2IJFsC7y6YI/ThbaYMcO29eRTPL21YhSd3+/xtCge+z8rYK52fKVLrDMr 39MiU9kg+fova/bUM0OxfUYQ0lEnEq4BSnxc3kaW9vdjfY1WKXizBVYqoEMCzPUi 5AuUUa9VRV7cryldUhCIRZyH1oCIO0uqFoUqCX0+D8ho6a5PptpMni+yzoPe6Zlu LvX+wmxv/tgpaD8a4KDx5IBFB0dv9gRR5Iuyx4FpP14klcn0AMztkUA8pKncR7ou nUq1qc8I7XBnilpIfa1NI1GL/jL2Xu+uo8zaJzOmChTPIndJxeQ= =A0KW -----END PGP SIGNATURE----- --SO98HVl1bnMOfKZd-- From owner-freebsd-fs@freebsd.org Mon Feb 12 09:07:16 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E2C14F0516A for ; Mon, 12 Feb 2018 09:07:16 +0000 (UTC) (envelope-from agapon@gmail.com) Received: from mail-lf0-f43.google.com (mail-lf0-f43.google.com [209.85.215.43]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 5B9E46872F for ; Mon, 12 Feb 2018 09:07:16 +0000 (UTC) (envelope-from agapon@gmail.com) Received: by mail-lf0-f43.google.com with SMTP id f137so19450459lfe.4 for ; Mon, 12 Feb 2018 01:07:16 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:cc:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=HgMvPmEJIm/7H2WCEEIbEw/xyZizY2WzGa50xj2bQL4=; b=Id1Lm7z9+pEd+FxUoOZx21MTC8Wh2kPW0n16qL78T/4PaJCAM57mPySXfraBTcHW4g 5bKTnnpIsjZP5ISlUNEmGz/6E8WbyoUHwOnvxUwJSWx2OPTSiIzdqrmC0EUGLsVmtAMN OX48OdFLpu5c4lVK1BfzYSzCw8Z0PCGu/IDE6pfFJ/++pulLefCR9RiXxYyX7uKBKAAs dWW5RYohhzXjEVZyVO1xaPIKDjpGn2LcGEqi65rxjBrzqs9vMTHzeHhVxruVcFHQCObP 21aJKXUEa5ABW/mjrVTR4XDamWKlAoOeP6ShAY2fQQLm4lE5+u/onAGrdPz/zjj02AWp P4Sg== X-Gm-Message-State: APf1xPC5+gmpXoH71RQPa+cfetCiStDRyf1yzg39omuEWts/Y0FqSP0w ENn5ACbe4rMu0d067A0OtkODsfzZUU0= X-Google-Smtp-Source: AH8x224dewWArJC3uT2qanNxuHXY7M22ATUo78QT7ILMwRgVyeRqUjmye/2alZGKHFMLPww+Kc3D8A== X-Received: by 10.25.167.85 with SMTP id q82mr7109838lfe.112.1518426429191; Mon, 12 Feb 2018 01:07:09 -0800 (PST) Received: from [192.168.0.88] (east.meadow.volia.net. [93.72.151.96]) by smtp.googlemail.com with ESMTPSA id q133sm687433lfe.60.2018.02.12.01.07.08 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Mon, 12 Feb 2018 01:07:08 -0800 (PST) Subject: Re: raw filesystem counters To: Peter Jeremy , "E.S. Rosenberg" Cc: freebsd-fs@freebsd.org References: <20180212055505.GD3353@server.rulingia.com> From: Andriy Gapon Message-ID: <7e201ce9-6162-ae5e-ea54-6f98cf2dd29f@FreeBSD.org> Date: Mon, 12 Feb 2018 11:07:07 +0200 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:52.0) Gecko/20100101 Thunderbird/52.6.0 MIME-Version: 1.0 In-Reply-To: <20180212055505.GD3353@server.rulingia.com> Content-Type: text/plain; charset=windows-1252 Content-Language: en-US Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 12 Feb 2018 09:07:17 -0000 On 12/02/2018 07:55, Peter Jeremy wrote: > On 2018-Feb-11 21:06:12 +0200, "E.S. Rosenberg" wrote: >> Is there any way to access raw disk counters similar to those found on >> Linux in: >> /sys/class/block//stat >> >> Preferably also by accessing such a virtual file and not by using iostat / >> zpool iostat which are already pre-processing counters and need to be run >> constantly to get accurate real-time estimates. > > For the raw disk data, have a look at the statistics functions in > libgeom(3). You can use the source code for gstat(8) to get a better idea > how to drive it. Or maybe devstat(3). > I don't know of any published API for vdev-level ZFS statistics and, > unfortunately, "zpool iostat" only supports "humanized" output, which makes > it difficult to use them as input to further monitoring. There are some > ARC statistics under sysctl kstat.zfs.misc > -- Andriy Gapon From owner-freebsd-fs@freebsd.org Mon Feb 12 10:09:08 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 17B27F0A150 for ; Mon, 12 Feb 2018 10:09:08 +0000 (UTC) (envelope-from brde@optusnet.com.au) Received: from mail104.syd.optusnet.com.au (mail104.syd.optusnet.com.au [211.29.132.246]) by mx1.freebsd.org (Postfix) with ESMTP id 896976B43F; Mon, 12 Feb 2018 10:09:06 +0000 (UTC) (envelope-from brde@optusnet.com.au) Received: from [192.168.0.102] (c110-21-101-228.carlnfd1.nsw.optusnet.com.au [110.21.101.228]) by mail104.syd.optusnet.com.au (Postfix) with ESMTPS id CEC26423AF7; Mon, 12 Feb 2018 21:08:57 +1100 (AEDT) Date: Mon, 12 Feb 2018 21:08:57 +1100 (EST) From: Bruce Evans X-X-Sender: bde@besplex.bde.org To: Andriy Gapon cc: Peter Jeremy , "E.S. Rosenberg" , freebsd-fs@freebsd.org Subject: Re: raw filesystem counters In-Reply-To: <7e201ce9-6162-ae5e-ea54-6f98cf2dd29f@FreeBSD.org> Message-ID: <20180212202830.I1446@besplex.bde.org> References: <20180212055505.GD3353@server.rulingia.com> <7e201ce9-6162-ae5e-ea54-6f98cf2dd29f@FreeBSD.org> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed X-Optus-CM-Score: 0 X-Optus-CM-Analysis: v=2.2 cv=DIX/22Fb c=1 sm=1 tr=0 a=PalzARQSbocsUSjMRkwAPg==:117 a=PalzARQSbocsUSjMRkwAPg==:17 a=kj9zAlcOel0A:10 a=7TI6GPq0Z6fxhZEkPZkA:9 a=CjuIK1q_8ugA:10 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 12 Feb 2018 10:09:08 -0000 On Mon, 12 Feb 2018, Andriy Gapon wrote: > On 12/02/2018 07:55, Peter Jeremy wrote: >> On 2018-Feb-11 21:06:12 +0200, "E.S. Rosenberg" wrote: >>> Is there any way to access raw disk counters similar to those found on >>> Linux in: >>> /sys/class/block//stat >>> >>> Preferably also by accessing such a virtual file and not by using iostat / >>> zpool iostat which are already pre-processing counters and need to be run >>> constantly to get accurate real-time estimates. >> >> For the raw disk data, have a look at the statistics functions in >> libgeom(3). You can use the source code for gstat(8) to get a better idea >> how to drive it. geom is too hard to use (try using sysctl kern.geom.con* without a utility to parse it), and doesn't keep its own statistics anyway. gstat(8) actually uses devstat(3) to do most of the work. > Or maybe devstat(3). devstat(3 is about the only usuable method. It never uses geom (except geom in the kernel calls devstat(9) to record things for devstat(3). systat(1) and vmstat(1) use devstat(3) and never use geom. As an example of geom being too hard to use, gstat(8) doesn't work on freefall. It fails in geom_stats_open() and exits with the encrypted error message "No such file or directory". This might be a permissions problem. systat(1) and vmstat(1) have no problems finding a useful list of devices using non-geom methods (mainly devstat_getdevs(3)). >> I don't know of any published API for vdev-level ZFS statistics and, >> unfortunately, "zpool iostat" only supports "humanized" output, which makes >> it difficult to use them as input to further monitoring. There are some >> ARC statistics under sysctl kstat.zfs.misc zfs is also missing support for the per-file-system sync and async write and read statistics that are printed by mount -v if available. The mount -v statistics do a bit more than count these 4 things separately. devstat only has device-level granularity so it can't split or combine or stack devices like geom can. mount -v statistics give splitting at the file system level. "humanized" output is parsable in theory (even by humans) provided it has suffixes to give the units. Bruce From owner-freebsd-fs@freebsd.org Mon Feb 12 13:06:39 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1C634F18CBF for ; Mon, 12 Feb 2018 13:06:39 +0000 (UTC) (envelope-from ronald-lists@klop.ws) Received: from smarthost1.greenhost.nl (smarthost1.greenhost.nl [195.190.28.92]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id AD3837353F; Mon, 12 Feb 2018 13:06:38 +0000 (UTC) (envelope-from ronald-lists@klop.ws) Received: from smtp.greenhost.nl ([213.108.110.112]) by smarthost1.greenhost.nl with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.84_2) (envelope-from ) id 1elDYk-0004mV-KB; Mon, 12 Feb 2018 13:50:15 +0100 Content-Type: text/plain; charset=iso-8859-15; format=flowed; delsp=yes To: "Peter Jeremy" , "E.S. Rosenberg" , "Andriy Gapon" Cc: freebsd-fs@freebsd.org Subject: Re: raw filesystem counters References: <20180212055505.GD3353@server.rulingia.com> <7e201ce9-6162-ae5e-ea54-6f98cf2dd29f@FreeBSD.org> Date: Mon, 12 Feb 2018 13:50:13 +0100 MIME-Version: 1.0 Content-Transfer-Encoding: 7bit From: "Ronald Klop" Message-ID: In-Reply-To: <7e201ce9-6162-ae5e-ea54-6f98cf2dd29f@FreeBSD.org> User-Agent: Opera Mail/1.0 (Win32) X-Authenticated-As-Hash: bdb49c4ff80bd276e321aade33e76e02752072e2 X-Virus-Scanned: by clamav at smarthost1.samage.net X-Spam-Level: / X-Spam-Score: -0.2 X-Spam-Status: No, score=-0.2 required=5.0 tests=ALL_TRUSTED, BAYES_50 autolearn=disabled version=3.4.0 X-Scan-Signature: 0ccaee305be983877c9e38c09cbf8ec4 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 12 Feb 2018 13:06:39 -0000 On Mon, 12 Feb 2018 10:07:07 +0100, Andriy Gapon wrote: > On 12/02/2018 07:55, Peter Jeremy wrote: >> On 2018-Feb-11 21:06:12 +0200, "E.S. Rosenberg" >> wrote: >>> Is there any way to access raw disk counters similar to those found on >>> Linux in: >>> /sys/class/block//stat >>> >>> Preferably also by accessing such a virtual file and not by using >>> iostat / >>> zpool iostat which are already pre-processing counters and need to be >>> run >>> constantly to get accurate real-time estimates. >> >> For the raw disk data, have a look at the statistics functions in >> libgeom(3). You can use the source code for gstat(8) to get a better >> idea >> how to drive it. > > Or maybe devstat(3). Or dtrace? >> I don't know of any published API for vdev-level ZFS statistics and, >> unfortunately, "zpool iostat" only supports "humanized" output, which >> makes >> it difficult to use them as input to further monitoring. There are some >> ARC statistics under sysctl kstat.zfs.misc >> > From owner-freebsd-fs@freebsd.org Mon Feb 12 17:57:31 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id AA2B5F0D21E for ; Mon, 12 Feb 2018 17:57:31 +0000 (UTC) (envelope-from evelyn.ortiz@leadsinsights-boosters.com) Received: from mail-pg0-x230.google.com (mail-pg0-x230.google.com [IPv6:2607:f8b0:400e:c05::230]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 236E282264 for ; Mon, 12 Feb 2018 17:57:30 +0000 (UTC) (envelope-from evelyn.ortiz@leadsinsights-boosters.com) Received: by mail-pg0-x230.google.com with SMTP id e11so2048404pgq.12 for ; Mon, 12 Feb 2018 09:57:30 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=leadsinsights-boosters-com.20150623.gappssmtp.com; s=20150623; h=from:to:references:in-reply-to:subject:date:message-id:mime-version :thread-index:content-language; bh=yYx5lT0/PDPZPmqJV9oG7JQBak33JLlWMwmrcqhQ4gw=; b=yrcSVZQ4WoCeyMnQAtA6wQrLF0P2+EIDdaM51kUcRRjmhCB0ODclbX1GzT02ktO6Q2 rvp88hkppFB1evyhzHCOc3xP+MplEwp9FfwHxGJbb4h9RDJUcWloNyMCtbnC5Spw5rmA eaLvCNvHusKxA6eccKeQguFShK37GK1gtXc1RAXwoqE+Amd4DgQXsSS4Defv7CF8v5sA hKqjNB6oPJZXxEjkDm6MliecPIAJLV4Ivam8wTLYhmy35wIarg/R2XLCfkS5PynN/Lpm +ZYQc6Xidw2M+VF/OFjL7qH53lF5vSyKqdV54tvFogcKPZKo27AXfmK7VxbFr6we4KSO JG8w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:references:in-reply-to:subject:date :message-id:mime-version:thread-index:content-language; bh=yYx5lT0/PDPZPmqJV9oG7JQBak33JLlWMwmrcqhQ4gw=; b=KNtllPQZArxAVuhRmtlN+tYkzS+Hxw1UEv2tJo7TiVcvt/QM3gpL93KtepXuh3DaSg DDZ7EzfA/CtmkdBx+VbjBM55DiURcAWXw4Or6hsW4BsM/TFDSsuqfm3LCG9exbnFTGa1 3/aMlTKoxS2V+ID0eNEly4Z0maQAl6Jv73ZC14cH4HfDbIBuNtfiwncO+u6OvqQ3GDe6 3DPgmhtSfjroBU0Em9iHC33vQ1VKQKduuM39oQIDdzzER+dLhL6wvwKVm2pfGS3KJx/2 bweCeYHowhmzM+XbgA6fjbVoIO5EZQRq/wsKgr8BDSYqm52O/FhZxoHbF5eAztXbMOQZ BrOA== X-Gm-Message-State: APf1xPBnS0X69wkN4UF84rl59TsjGLCogR21+25Xvu93RGe/hx5ZZDtp YCt6Wl/Nv7H61sWafbOOT2lMuYUn X-Google-Smtp-Source: AH8x224xQbr2lcjkLm1VclnDoxmhM7W/3TZai2GNTmregIEJ27abzKwv0aJ0Y60J7KPFro5kAjU8FA== X-Received: by 10.99.189.1 with SMTP id a1mr2962279pgf.189.1518458248944; Mon, 12 Feb 2018 09:57:28 -0800 (PST) Received: from sunnyPC ([103.210.134.229]) by smtp.gmail.com with ESMTPSA id o1sm22574448pgn.6.2018.02.12.09.57.27 for (version=TLS1 cipher=ECDHE-RSA-AES128-SHA bits=128/128); Mon, 12 Feb 2018 09:57:28 -0800 (PST) From: "Evelyn Ortiz" To: References: In-Reply-To: Subject: RE: Amusement Expo 2018 Attendees List? Date: Mon, 12 Feb 2018 12:57:22 -0500 Message-ID: <15ff01d3a42a$f2010090$d60301b0$@leadsinsights-boosters.com> MIME-Version: 1.0 X-Mailer: Microsoft Outlook 14.0 Thread-Index: AdOewY/z5k/BOmlBS5OZ0DketE6uOQFaV1Ng Content-Language: en-us Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.25 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 12 Feb 2018 17:57:31 -0000 Hi, Hope you doing well. This follow email is to check if you had a chance to review my previous email sent which explains about our list services and others for new business prospects. Thanks for your precious time. I would really appreciate if you can reply with your questions or queries. I look forward to your response. Best Regards Evelyn From: Evelyn Ortiz [mailto:evelyn.ortiz@leadsinsights-boosters.com] Sent: Monday, February 05, 2018 3:45 PM To: 'freebsd-fs@freebsd.org' Subject: Amusement Expo 2018 Attendees List? Hi, Would you be interested in acquiring the Amusement Expo 2018(International Amusement Expo 2018) Attendees List for your marketing and promotion activities? When: 27 February - 01 March 2018. Where: Las Vegas, NV, USA. Number of attendees: 3,000 Confirmed Attendees. Attendees Lists include:- Company Name, Contact Name, Title, Address, Web Site, Phone Number, Fax Number, Verified E-mail Address, Employee Size, Revenue size, SIC Code, Industry Type, NAICS Code, E-mail verification result. Please let me know your interest, so that i could send you the pricing. Thank you and I look forward to hear from you. Regards, Evelyn Ortiz Marketing Consultant Disclaimer: We have clearly mentioned the source email id, also clearly mentioned the subject line and there is no misleading information of any form. We have found your email address through our marketing efforts on the web, if you are not interested, please reply with "Remove" in the subject line and we will ensure that you do not receive any further promotional email from our end. From owner-freebsd-fs@freebsd.org Mon Feb 12 18:42:08 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3CF13F10D80 for ; Mon, 12 Feb 2018 18:42:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id F32B484AA3 for ; Mon, 12 Feb 2018 18:42:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 4B2641CF7D for ; Mon, 12 Feb 2018 18:42:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w1CIg7bl026188 for ; Mon, 12 Feb 2018 18:42:07 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w1CIg7TP026187 for freebsd-fs@FreeBSD.org; Mon, 12 Feb 2018 18:42:07 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 225423] panic: softdep_deallocate_dependencies: dangling deps Date: Mon, 12 Feb 2018 18:42:07 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 12 Feb 2018 18:42:08 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D225423 --- Comment #9 from Kirk McKusick --- (In reply to Deepak Ukey from comment #8) What are you doing to cause this panic? More specifically what do I need to do to reproduce the panic. Based on the back-trace it appears that you are removing a disk from an act= ive filesystem. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Mon Feb 12 20:09:27 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 93FCCF1864F for ; Mon, 12 Feb 2018 20:09:27 +0000 (UTC) (envelope-from eborisch@gmail.com) Received: from mail-wm0-x230.google.com (mail-wm0-x230.google.com [IPv6:2a00:1450:400c:c09::230]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 0FD7C6B165 for ; Mon, 12 Feb 2018 20:09:27 +0000 (UTC) (envelope-from eborisch@gmail.com) Received: by mail-wm0-x230.google.com with SMTP id 141so12134982wme.3 for ; Mon, 12 Feb 2018 12:09:27 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=MLcgJR0t2uiNtH5dnEqps8e9zToxRULGtQa81OxH6SI=; b=KiPPDcjaDRJx6sg2iNBJANLAoSHNx/3z+rFISt2iLEq+zX/YnqkzHLHN2Y9/wU+FyN mqmYY8YinCUn76KLcFJu52k/mkr5MaMxniMNxVU4V8hrtktuFLyoi+woBqsHI6hACiFA D+HeJouYwfvKUzraw5yNbbPlsdxVvpa5u4NBhmuTEs7jL/OKOaKwVCxGpQW47dynu8hi UsKzO+8dB6PiaR799vlEkrXVZcMCYuOrkvYSNCP4l03iPzXmwthPnz0Tp/Mj5Udgc9WX 9X69V58mAFOGnUu7EtedlsyTMFuaMX225laEZHg+JC3kv/0h04yGesC703Sv+fFC3Slx Z2gg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=MLcgJR0t2uiNtH5dnEqps8e9zToxRULGtQa81OxH6SI=; b=ad4vxw8YfizGwlr0K8vvY5hNv4+b0qCDk382j6+2DPxW5TSONLfkGMcphu/rulz9Oj et05AmtbuXRh/LDODXjsXiDTRDlsQS31AKKp+jV88chKGfKzHsBSPWqNmHtZjA0L0EXR y1koISYHqiZuAAypOyOmvjm8Qf9tUCYJdrQEMT9CiwUu2Au0Z+ODvzZwgSnT1bCLsuBY vb7gH9XUZquYAJgooavv2l2FettaiC5p9lwrcUR4sLyrlSvNKlnY2C5dfjcLgiQVTtQk CS38EfHDTuadRH1PMUM27Evg2wikTlaiXV1XuGb+zydyYru0vanxhTZEvjHKMuSSquRl nQWg== X-Gm-Message-State: APf1xPDnF0cUgehESgcAYEaSKTKyCtwZQpyfAEKuB5ejNkPFcl1UaAK8 uZJ1A1uw+l6sPKqoYjzmyhHNgE2BpG2BLW8Dosw= X-Google-Smtp-Source: AH8x2265MM3Wgv3YGhgbE7fxggWkOUWBE9cm/c+pjnJZIKYnxZI8SWF79wT1SQRSDmajId7aMELLajb8N61kihFc10o= X-Received: by 10.28.31.212 with SMTP id f203mr4103421wmf.122.1518466165113; Mon, 12 Feb 2018 12:09:25 -0800 (PST) MIME-Version: 1.0 Received: by 10.28.96.10 with HTTP; Mon, 12 Feb 2018 12:09:24 -0800 (PST) In-Reply-To: References: From: "Eric A. Borisch" Date: Mon, 12 Feb 2018 14:09:24 -0600 Message-ID: Subject: Re: raw filesystem counters To: "E.S. Rosenberg" Cc: freebsd-fs@freebsd.org Content-Type: text/plain; charset="UTF-8" X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 12 Feb 2018 20:09:27 -0000 On Sun, Feb 11, 2018 at 1:06 PM, E.S. Rosenberg wrote: > Hi, > Hopefully I'm not asking something that has been answered thousands of > times, I did search but did not find. > > Is there any way to access raw disk counters similar to those found on > Linux in: > /sys/class/block//stat > > Preferably also by accessing such a virtual file and not by using iostat / > zpool iostat which are already pre-processing counters and need to be run > constantly to get accurate real-time estimates. > > So far I have not stumbled upon the right sysctl key to get these counters > (and TBH as said before I'd much rather read a "file" then run a command > though that matters less as long as the counters are raw). > > Background: I'm trying to get a better idea of what is going on with our > IO, I would like to push the counters into Zabbix and maybe other data > analysis software later so I prefer raw counters that can then be processed > by whatever software we are using. > > Thanks! > Eli iostat -Ixd dev0 [dev1 ..] Gives from-boot cumulative values; these can be shoved (with minimal awk processing) into Zabbix and pre-processed to "change per second" on the Zabbix server. Read/write ops/bytes as well as some other interesting stats. - Eric From owner-freebsd-fs@freebsd.org Tue Feb 13 00:22:16 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 40F85F0742B for ; Tue, 13 Feb 2018 00:22:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id CFFF17688D for ; Tue, 13 Feb 2018 00:22:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 0E3C81FF3D for ; Tue, 13 Feb 2018 00:22:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w1D0ME25064703 for ; Tue, 13 Feb 2018 00:22:14 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w1D0MENI064702 for freebsd-fs@FreeBSD.org; Tue, 13 Feb 2018 00:22:14 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 225795] panic: found unreferenced mountpoint when accessing and unmounting snapshots in parallel Date: Tue, 13 Feb 2018 00:22:15 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 13 Feb 2018 00:22:16 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D225795 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|freebsd-bugs@FreeBSD.org |freebsd-fs@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Tue Feb 13 05:06:15 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7341DF21021 for ; Tue, 13 Feb 2018 05:06:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 0B6C984306 for ; Tue, 13 Feb 2018 05:06:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 45726226A8 for ; Tue, 13 Feb 2018 05:06:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w1D56E8o035068 for ; Tue, 13 Feb 2018 05:06:14 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w1D56ERu035067 for freebsd-fs@FreeBSD.org; Tue, 13 Feb 2018 05:06:14 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 225423] panic: softdep_deallocate_dependencies: dangling deps Date: Tue, 13 Feb 2018 05:06:14 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: deepak.ukey@microsemi.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 13 Feb 2018 05:06:15 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D225423 --- Comment #10 from Deepak Ukey --- (In reply to Kirk McKusick from comment #9) Hi, Setup Details: I have one SATA drive (/dev/da0) attached to Microsemi Storage controller a= nd my OS is on drive attached to AHCI on board controller.=20 Steps to reproduce the issue: 1) Create the GPT partition of drive: #gpart create =E2=80=93s gpt /dev/da0 2)Create the partition: #gpart add =E2=80=93t freebsd-ufs =E2=80=93l gpusrfs =E2=80=93a <512k> /dev= /da0 3)Format it: #newfs =E2=80=93U /dev/da0p1 4)Create the mount directory: #mkdir /mnt/ 5)Mount the drive partition: #mount /dev/ /mnt/ 7)Write the data using dd command: dd if=3D/dev/zero of=3Dtest bs=3D10240 count=3D100000 8) The same time when after starting step 7, remove the drive attached to Microsemi Storage controller.=20 Please let me know if you have any questions. Thanks, Deepak --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Tue Feb 13 19:56:08 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 57E3DF1F33F for ; Tue, 13 Feb 2018 19:56:08 +0000 (UTC) (envelope-from esr@mail.hebrew.edu) Received: from mail-qt0-x235.google.com (mail-qt0-x235.google.com [IPv6:2607:f8b0:400d:c0d::235]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id EFDB06D924 for ; Tue, 13 Feb 2018 19:56:07 +0000 (UTC) (envelope-from esr@mail.hebrew.edu) Received: by mail-qt0-x235.google.com with SMTP id g14so5021322qti.2 for ; Tue, 13 Feb 2018 11:56:07 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=mail-hebrew-edu.20150623.gappssmtp.com; s=20150623; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=otZdbDIZsIGTI1ePJtNkhc9DNYIxrgYGWX/EH6VV0rY=; b=UZBk2gp1b7pYZQpBNUrwHRC2nKAzNLoMqpEW+XAueiWIOlKHRxJtXItUnhBDMV2/rR wu6DPfFHnfSbD7FEwBnaVVokzaEmv6x49W/CNxk/y1UdQl9Q5ByRiLhGSUy47jyRHlW1 kerP+zfyOWhxOd4+0n0+DjIVzuBbj6FLDoYYulD/xIrppMxpplwKVLKo7DDW9PqaYUhu 1OaUWHefa04nNA/zTWbE3tlZEv/2Xsm6z5ErCf4WeUAksv3OjWkdCuaq/IIrg32owWYZ PAFsz8ghADGBKwpMbIm2vLQxv+HdCx6CToGhlmQPpfgg8w86icRSWNYD9k1l3TBSekQb RhQQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=otZdbDIZsIGTI1ePJtNkhc9DNYIxrgYGWX/EH6VV0rY=; b=ji2ypOMAUbqWKcp6kyZplABxWGpxaHyrQcD3+ShJmXFQIeCYr7ql+rPZkf+JiIP1nZ 9mZo2w0dfaKK/FuplMzw+sjs0Wr73n+8P213JfiN16Zy9tSEL24qJdNDbED9B3WXS9ga xtgzS+pENCtFA0mLlewyiFkxprLgaKBcIgJGTvFhsx/0hgFxveZHWFnYCch/7qFwH/96 cBz/WgBRpzbvyj6zvM0CfgmTcqC/X9GMrsOYQMf7Dx1JVTOcWBGFlT6EMiH382Lkkffz MD5POGUpWfszegBO8Dlm8bhDkVL1fnt9YV9JDfrP0DA1WFZagxjcQjSom9M1VUbEUAB8 mpcA== X-Gm-Message-State: APf1xPDfCiA/kqxy9VtHqUkHYvLBGPGXJDXPIcz7knBCtvUz5aHt79Yg KZPifE4tKnKgUKlMuKfrA16psC4XcLQun1ivAGVGbg== X-Google-Smtp-Source: AH8x224CcOVDQ/vnDlYxu0s4lfsukZoAh77UJ1AteVNqmRL6vmM4hQUsg8/JUTNpax2+tan2qv7UR8By9FessNj9IbA= X-Received: by 10.200.44.251 with SMTP id 56mr3923627qtx.55.1518551766876; Tue, 13 Feb 2018 11:56:06 -0800 (PST) MIME-Version: 1.0 Received: by 10.12.196.5 with HTTP; Tue, 13 Feb 2018 11:56:06 -0800 (PST) In-Reply-To: References: From: "E.S. Rosenberg" Date: Tue, 13 Feb 2018 21:56:06 +0200 Message-ID: Subject: Re: raw filesystem counters To: "Eric A. Borisch" Cc: freebsd-fs@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.25 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 13 Feb 2018 19:56:08 -0000 Wow Eric that is exactly what I was looking for! Thanks! Nothing similar exists for ZFS correct? Thanks again, Eli On Mon, Feb 12, 2018 at 10:09 PM, Eric A. Borisch wrote: > On Sun, Feb 11, 2018 at 1:06 PM, E.S. Rosenberg wrote: > > Hi, > > Hopefully I'm not asking something that has been answered thousands of > > times, I did search but did not find. > > > > Is there any way to access raw disk counters similar to those found on > > Linux in: > > /sys/class/block//stat > > > > Preferably also by accessing such a virtual file and not by using iostat > / > > zpool iostat which are already pre-processing counters and need to be run > > constantly to get accurate real-time estimates. > > > > So far I have not stumbled upon the right sysctl key to get these > counters > > (and TBH as said before I'd much rather read a "file" then run a command > > though that matters less as long as the counters are raw). > > > > Background: I'm trying to get a better idea of what is going on with our > > IO, I would like to push the counters into Zabbix and maybe other data > > analysis software later so I prefer raw counters that can then be > processed > > by whatever software we are using. > > > > Thanks! > > Eli > > > iostat -Ixd dev0 [dev1 ..] > > Gives from-boot cumulative values; these can be shoved (with minimal > awk processing) into Zabbix and pre-processed to "change per second" > on the Zabbix server. Read/write ops/bytes as well as some other > interesting stats. > > - Eric > From owner-freebsd-fs@freebsd.org Wed Feb 14 16:39:56 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3FD1BF0CD9D for ; Wed, 14 Feb 2018 16:39:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id A716A80F9B for ; Wed, 14 Feb 2018 16:39:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id E0E5F15510 for ; Wed, 14 Feb 2018 16:39:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w1EGds6h086484 for ; Wed, 14 Feb 2018 16:39:54 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w1EGds2I086483 for freebsd-fs@FreeBSD.org; Wed, 14 Feb 2018 16:39:54 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 209571] ZFS and NVMe performing poorly. TRIM requests stall I/O activity Date: Wed, 14 Feb 2018 16:39:53 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.3-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: nevans@talkpoint.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 14 Feb 2018 16:39:56 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D209571 Nick Evans changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |nevans@talkpoint.com --- Comment #5 from Nick Evans --- Seeing the same on 11.0-RELEASE-p6 using a Samsung 960 EVO NVME. I've stopp= ed my (extremely slow) copy to the drive and this background traffic continues. tty nvd0 da0 da1 cpu tin tout KB/t tps MB/s KB/t tps MB/s KB/t tps MB/s us ni sy in id 0 150 32.00 456 14.25 0.00 0 0.00 0.00 0 0.00 0 0 0 0 1= 00 0 493 32.00 455 14.22 0.00 0 0.00 0.00 0 0.00 0 0 0 0 1= 00 0 151 32.00 454 14.18 0.00 0 0.00 0.00 0 0.00 0 0 0 0 1= 00 0 164 32.00 455 14.21 0.00 0 0.00 0.00 0 0.00 0 0 0 0 1= 00 I've seen this on another system with Intel 750 PCIe cards but if I remember right it seemed to handle the background trim better. It's been a while sin= ce I tested it though. Both systems are test boxes so I can test any changes nee= ded and can move them to whatever base system versions are needed. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Wed Feb 14 17:10:21 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9538BF0F28B for ; Wed, 14 Feb 2018 17:10:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 1AA6082904 for ; Wed, 14 Feb 2018 17:10:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 3F32A15960 for ; Wed, 14 Feb 2018 17:10:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w1EHAKfw072402 for ; Wed, 14 Feb 2018 17:10:20 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w1EHAKBG072401 for freebsd-fs@FreeBSD.org; Wed, 14 Feb 2018 17:10:20 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 153142] [zfs] ls -l outputs `ls: ./.zfs: Operation not supported' Date: Wed, 14 Feb 2018 17:10:20 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 8.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: asomers@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: DUPLICATE X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: asomers@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc resolution assigned_to bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 14 Feb 2018 17:10:21 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D153142 Alan Somers changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |asomers@FreeBSD.org Resolution|--- |DUPLICATE Assignee|freebsd-fs@FreeBSD.org |asomers@FreeBSD.org Status|Open |Closed --- Comment #11 from Alan Somers --- Fixed for real by r329265 . *** This bug has been marked as a duplicate of bug 225793 *** --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Wed Feb 14 18:18:53 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7BD57F1483A for ; Wed, 14 Feb 2018 18:18:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 191B686267 for ; Wed, 14 Feb 2018 18:18:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 6897316361 for ; Wed, 14 Feb 2018 18:18:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w1EIIqc3024552 for ; Wed, 14 Feb 2018 18:18:52 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w1EIIqCo024551 for freebsd-fs@FreeBSD.org; Wed, 14 Feb 2018 18:18:52 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 209571] NVMe performing poorly. TRIM requests stall I/O activity Date: Wed, 14 Feb 2018 18:18:50 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.3-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: cem@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc short_desc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 14 Feb 2018 18:18:53 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D209571 Conrad Meyer changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |cem@freebsd.org Summary|ZFS and NVMe performing |NVMe performing poorly. |poorly. TRIM requests stall |TRIM requests stall I/O |I/O activity |activity --- Comment #6 from Conrad Meyer --- I see the exact same problem with TRIM, Samsung 960 EVO, and UFS. Part of the problem is consumer controller (960 EVO) doing a bad job with T= RIM. Part of the problem is nvd does not coalesces TRIMs. Part of the problem is cam_iosched separates out and prioritizes TRIM over all other IO; see cam_iosched_next_bio(). (Separating out is useful for coalescing, but we d= on't actually coalesce yet.) I observed iostat showing non-zero queue depths and long IO latencies with = TRIM enabled (960 EVO). With TRIM disabled, qdepth was at most ever 1 and IO latency fell drastically under the same workload. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Wed Feb 14 20:27:23 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8B7F4F1D9DA for ; Wed, 14 Feb 2018 20:27:23 +0000 (UTC) (envelope-from ronald-lists@klop.ws) Received: from smarthost1.greenhost.nl (smarthost1.greenhost.nl [195.190.28.92]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 288EF6B9F6 for ; Wed, 14 Feb 2018 20:27:22 +0000 (UTC) (envelope-from ronald-lists@klop.ws) Received: from smtp.greenhost.nl ([213.108.110.112]) by smarthost1.greenhost.nl with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.84_2) (envelope-from ) id 1em3e6-00039E-Re; Wed, 14 Feb 2018 21:27:15 +0100 Content-Type: text/plain; charset=utf-8; format=flowed; delsp=yes To: "Eric A. Borisch" , "E.S. Rosenberg" Cc: freebsd-fs@freebsd.org Subject: Re: raw filesystem counters References: Date: Wed, 14 Feb 2018 21:16:15 +0100 MIME-Version: 1.0 Content-Transfer-Encoding: 7bit From: "Ronald Klop" Message-ID: In-Reply-To: User-Agent: Opera Mail/12.16 (FreeBSD) X-Authenticated-As-Hash: 398f5522cb258ce43cb679602f8cfe8b62a256d1 X-Virus-Scanned: by clamav at smarthost1.samage.net X-Spam-Level: / X-Spam-Score: -0.2 X-Spam-Status: No, score=-0.2 required=5.0 tests=ALL_TRUSTED, BAYES_50 autolearn=disabled version=3.4.0 X-Scan-Signature: 3ced5df4177ef3a93a84b902ce7c160e X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 14 Feb 2018 20:27:23 -0000 Maybe start following this developer also: https://twitter.com/freebsdfrau/status/963589688278724608 Regards, Ronald. On Tue, 13 Feb 2018 20:56:06 +0100, E.S. Rosenberg wrote: > Wow Eric that is exactly what I was looking for! > Thanks! > Nothing similar exists for ZFS correct? > Thanks again, > Eli > > On Mon, Feb 12, 2018 at 10:09 PM, Eric A. Borisch > wrote: > >> On Sun, Feb 11, 2018 at 1:06 PM, E.S. Rosenberg >> wrote: >> > Hi, >> > Hopefully I'm not asking something that has been answered thousands of >> > times, I did search but did not find. >> > >> > Is there any way to access raw disk counters similar to those found on >> > Linux in: >> > /sys/class/block//stat >> > >> > Preferably also by accessing such a virtual file and not by using >> iostat >> / >> > zpool iostat which are already pre-processing counters and need to be >> run >> > constantly to get accurate real-time estimates. >> > >> > So far I have not stumbled upon the right sysctl key to get these >> counters >> > (and TBH as said before I'd much rather read a "file" then run a >> command >> > though that matters less as long as the counters are raw). >> > >> > Background: I'm trying to get a better idea of what is going on with >> our >> > IO, I would like to push the counters into Zabbix and maybe other data >> > analysis software later so I prefer raw counters that can then be >> processed >> > by whatever software we are using. >> > >> > Thanks! >> > Eli >> >> >> iostat -Ixd dev0 [dev1 ..] >> >> Gives from-boot cumulative values; these can be shoved (with minimal >> awk processing) into Zabbix and pre-processed to "change per second" >> on the Zabbix server. Read/write ops/bytes as well as some other >> interesting stats. >> >> - Eric >> > _______________________________________________ > freebsd-fs@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" From owner-freebsd-fs@freebsd.org Wed Feb 14 22:02:39 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A5CEFF00104 for ; Wed, 14 Feb 2018 22:02:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 467AF6FEC6 for ; Wed, 14 Feb 2018 22:02:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 89262183C1 for ; Wed, 14 Feb 2018 22:02:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w1EM2cdH098352 for ; Wed, 14 Feb 2018 22:02:38 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w1EM2cDD098351 for freebsd-fs@FreeBSD.org; Wed, 14 Feb 2018 22:02:38 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 209571] NVMe performing poorly. TRIM requests stall I/O activity Date: Wed, 14 Feb 2018 22:02:37 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.3-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: nevans@talkpoint.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 14 Feb 2018 22:02:39 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D209571 --- Comment #7 from Nick Evans --- So is some immediate relief as simple as reordering the trim option in cam_iosched_next_bio to prioritize normal I/O over trim? At least for now? --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Wed Feb 14 23:34:43 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id AB43EF064C2 for ; Wed, 14 Feb 2018 23:34:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 3D092734B0 for ; Wed, 14 Feb 2018 23:34:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 6F3E119043 for ; Wed, 14 Feb 2018 23:34:42 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w1ENYgvb037970 for ; Wed, 14 Feb 2018 23:34:42 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w1ENYgQv037969 for freebsd-fs@FreeBSD.org; Wed, 14 Feb 2018 23:34:42 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 209571] NVMe performing poorly. TRIM requests stall I/O activity Date: Wed, 14 Feb 2018 23:34:42 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.3-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: imp@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 14 Feb 2018 23:34:43 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D209571 --- Comment #8 from Warner Losh --- Only if you are using nda, which most people aren't. It doesn't exist in 10= or 11 (well, until last week). It's not turned on by default in 12. So talking about cam_ioschded and nvd in the same breath misunderstands the problem. nvd doesn't collapse trims and that's the problem there. It doesn't use CAM at all so no tweaks to cam_iosched is going to help because it's completely unused. nda, on the other hand, has the collapsing trim issue and the priority inversion issue cem points out. I've been tweaking the code to reduce trim priority as well as collapse trims, but that won't help nvd. I = have no plans on doing anything with nvd. So if you are using nvd, the whole problem is lack of trim collapsing. If y= ou are using nda, that problem is compounded by the I/O scheduler. I should ha= ve a fix for nda by the end of next week. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Thu Feb 15 14:47:10 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 57E2DF23A63 for ; Thu, 15 Feb 2018 14:47:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4448B7BEF4 for ; Thu, 15 Feb 2018 14:47:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 6B73120F75 for ; Thu, 15 Feb 2018 14:47:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w1FEl8sf045969 for ; Thu, 15 Feb 2018 14:47:08 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w1FEl8ur045967 for freebsd-fs@FreeBSD.org; Thu, 15 Feb 2018 14:47:08 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 223803] zio_done() panic on system with cache devices Date: Thu, 15 Feb 2018 14:47:07 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.3-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: commit-hook@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 15 Feb 2018 14:47:10 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D223803 --- Comment #10 from commit-hook@freebsd.org --- A commit references this bug: Author: avg Date: Thu Feb 15 14:46:30 UTC 2018 New revision: 329314 URL: https://svnweb.freebsd.org/changeset/base/329314 Log: MFV r329313: 8857 zio_remove_child() panic due to already destroyed parent zio illumos/illumos-gate@d6e1c446d7897003fd9fd36ef5aa7da350b7f6af =20 https://github.com/illumos/illumos-gate/commit/d6e1c446d7897003fd9fd36ef5aa= 7da350b7f6af https://www.illumos.org/issues/8857 I had an OS panic on one of our servers: ffffff01809128c0 vpanic() ffffff01809128e0 mutex_panic+0x58(fffffffffb94c904, ffffff597dde7f80) ffffff0180912950 mutex_vector_enter+0x347(ffffff597dde7f80) ffffff01809129b0 zio_remove_child+0x50(ffffff597dde7c58, ffffff32bd901a= c0, ffffff3373370908) ffffff0180912a40 zio_done+0x390(ffffff32bd901ac0) ffffff0180912a70 zio_execute+0x78(ffffff32bd901ac0) ffffff0180912b30 taskq_thread+0x2d0(ffffff33bae44140) ffffff0180912b40 thread_start+8() It panicked here: http://src.illumos.org/source/xref/illumos-gate/usr/src/uts/common/fs/z= fs/ zio.c#430 pio->io_lock is DEAD, thus a panic. Further analysis shows the "pio" (parent zio of "cio") has already been destroyed. Reviewed by: Matthew Ahrens Reviewed by: Andriy Gapon Reviewed by: Youzhong Yang Approved by: Dan McDonald Author: George Wilson PR: 223803 Tested by: shiva.bhanujan@quorum.com MFC after: 2 weeks Changes: _U head/sys/cddl/contrib/opensolaris/ head/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/sys/zio.h head/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Thu Feb 15 14:57:11 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 90D3BF2452E for ; Thu, 15 Feb 2018 14:57:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 0FAEF7C6F9 for ; Thu, 15 Feb 2018 14:57:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 55154210E6 for ; Thu, 15 Feb 2018 14:57:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w1FEvAuC072058 for ; Thu, 15 Feb 2018 14:57:10 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w1FEvA8H072057 for freebsd-fs@FreeBSD.org; Thu, 15 Feb 2018 14:57:10 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 223803] zio_done() panic on system with cache devices Date: Thu, 15 Feb 2018 14:57:09 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.3-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: avg@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: avg@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc bug_status assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 15 Feb 2018 14:57:11 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D223803 Andriy Gapon changed: What |Removed |Added ---------------------------------------------------------------------------- CC|avg@FreeBSD.org |freebsd-fs@FreeBSD.org Status|New |In Progress Assignee|freebsd-fs@FreeBSD.org |avg@FreeBSD.org --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Thu Feb 15 15:18:30 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 45A45F00B72 for ; Thu, 15 Feb 2018 15:18:30 +0000 (UTC) (envelope-from sarah.parker@proofdot.com) Received: from IND01-BO1-obe.outbound.protection.outlook.com (mail-bo1ind01hn0201.outbound.protection.outlook.com [104.47.101.201]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "Microsoft IT TLS CA 4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 359307D51A for ; Thu, 15 Feb 2018 15:18:29 +0000 (UTC) (envelope-from sarah.parker@proofdot.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=NETORGFT3391454.onmicrosoft.com; s=selector1-proofdot-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=LmbVmR9dkeIwlFBix5XoZPBXDaZTQPYspTkKcLDzzMw=; b=iXJNv+Yss1ETF+NSrxMm53WPNo9x8pc76Hj4kjrlRmeWV50gDVT2OjI/q0TYOp7BvK0my4HboZ7vCBD1tjY/ahaiM2lPuaAtzuJ2Gdrdl6Z7AnneQih/vR1ZKPbdCFDBmAGodOQQU0YTDAVfJDz2PFg/QfmjgmQH+JZvS8Rjb5I= Authentication-Results: spf=none (sender IP is ) smtp.mailfrom=sarah.parker@proofdot.com; Received: from SR (125.99.255.106) by PN1PR01MB0461.INDPRD01.PROD.OUTLOOK.COM (10.164.141.22) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P256) id 15.20.506.18; Thu, 15 Feb 2018 15:18:23 +0000 From: "sarah parker" To: Subject: B2B Decision Makers List Date: Thu, 15 Feb 2018 20:48:02 +0530 Message-ID: MIME-Version: 1.0 X-Mailer: Microsoft Outlook 15.0 Thread-Index: AdOmb46W/9XKS9LZT+2jBpa42587gg== Content-Language: en-us X-Originating-IP: [125.99.255.106] X-ClientProxiedBy: MA1PR01CA0113.INDPRD01.PROD.OUTLOOK.COM (10.174.56.157) To PN1PR01MB0461.INDPRD01.PROD.OUTLOOK.COM (10.164.141.22) X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 9368f8d4-56ab-41e8-007f-08d574875b16 X-Microsoft-Antispam: UriScan:; BCL:0; PCL:0; RULEID:(7020095)(4652020)(7021125)(4534165)(7022125)(4603075)(4627221)(201702281549075)(7048125)(7024125)(7027125)(7028125)(7023125)(5600026)(4604075)(2017052603307)(7153060)(7193020); SRVR:PN1PR01MB0461; X-Microsoft-Exchange-Diagnostics: 1; PN1PR01MB0461; 3:p9PREfV+RUT0Xf6FkGFbaSyQMf0iUqb78gHVXdhTLJF0rI/oPZ0ffAJGkUE6LkRx9jBOU9DUI3pNsNx8myg3Kz5Zl6lHqPLT6HwSNZjlDmgdtHHFEUp/iPxhiK4CvGcVc5jaPlJMZQ/nbDxMUVk9pKmIZOxD57QvCkxUAvTDAssOV4eB711amu5aDoK+1hGzOXQ1hE+PHXkeqlVAKG2l6gLi6npb6/tVDuLO5fD4x5CH5K3d27HrJPT8ozzFMvle; 25:I2L6xMzjp0YO8IBVvz2K95h++QCw+LSibuStGf5ImuECrw1K+3nUclap8PDMv5TUgeQ+IOpvhWlGt3bQtzR5Q/gEBqYts+6ixOL9R/2XPw2/Zu8Jp0hBK72xmrwxPIAk4ty4W/BO252PpnnydEO9LTcWZ4HQexMj1XOVEpl5kTdWnB8QdltncwW1vr1ZFyamTa0FSimlAykT1J21KPijXZC85MfyU1VKqAu3q2FHp35xm2Yu4KJtj6M4+2RyHVxmYNAWIk0QFnOraNTLA90+Inf+Qdfl+v5R+lrjMti0ew/Ot0g2vZbjevmi5hb7m1QOSmEEyOllf0HHY2CPvlWENQ==; 31:EVK94DjipF4sfHFamzgDKAu8ZiHROh9VQJAp4I8xaX0rkuVe4D2uD7wrR1l57eAAark7pHc7xDVUQGm/C43WqtALEa9XIkCyPSNEHgLkkZJStcm8HmHgSQuzUJR35M9BqxSxSKPRyuutczCVXVSemsmCjqQ4AiTUQ35Gt4pFAdCXIZ1mw4/fWDVS5z7/ebet9RHY22hKsRIjjVQrA0/E0TvqlVrU/7iwLz9kgRfjswA= X-MS-TrafficTypeDiagnostic: PN1PR01MB0461: X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:(28532068793085)(206333022235701)(21748063052155); X-Exchange-Antispam-Report-CFA-Test: BCL:0; PCL:0; RULEID:(6040501)(2401047)(8121501046)(5005006)(3231101)(944501161)(3002001)(10201501046)(93006095)(93001095)(6041288)(2016111802025)(20161123560045)(20161123564045)(20161123562045)(20161123558120)(6043046)(6072148)(201708071742011); SRVR:PN1PR01MB0461; BCL:0; PCL:0; RULEID:; SRVR:PN1PR01MB0461; X-Microsoft-Exchange-Diagnostics: 1; PN1PR01MB0461; 4:JGXBvVooeihOHCNMT22CwJsNrInaKAdrBpu2f5Zl2NsQGub/RVFtofmAOahnvViPVHFRuANeclIvxdaMcU/GhQwgGkr4N4cXhcuDObXwrt+biSB+lRB/DbYbybrvenUK7mMheq7BH32/5WCcdJKHSKJ1dHC6x2I5SzySICQvpGDFhR4D495q2hXqKWyNNhtCuZjVQBHmIaG80uZPUlWT2WeqnmRplsko5M7zxPMl0brhI2EnKz+twE0mmRC4338N/7Tl433DzEUbOg+WnWrAFbOyGczTcpfyXSFyNTppYg18Og0nz61v/AMLE5m/uwKIBgTckj5FdVZR8fca8fd8g/PJQo/qnDsYJQPeEbF/IcbPg+xPlVYG/iRUsmVUuUW+ X-Forefront-PRVS: 058441C12A X-Forefront-Antispam-Report: SFV:SPM; SFS:(10019020)(346002)(366004)(39380400002)(376002)(396003)(39860400002)(189003)(199004)(386003)(4743002)(5660300001)(102836004)(6666003)(2351001)(16526019)(6116002)(186003)(26005)(6916009)(54896002)(53936002)(3846002)(6306002)(790700001)(6486002)(66066001)(106356001)(25786009)(9406002)(9326002)(50226002)(68736007)(478600001)(86362001)(270700001)(6496006)(88246002)(45080400002)(97736004)(260700001)(8676002)(84326002)(36756003)(2906002)(9476002)(7826002)(8936002)(7736002)(81166006)(81156014)(16586007)(626008)(61296003)(71636004)(316002)(105586002)(52116002)(7520500002)(48640200003); DIR:OUT; SFP:1501; SCL:5; SRVR:PN1PR01MB0461; H:SR; FPR:; SPF:None; PTR:InfoNoRecords; MX:1; A:1; LANG:en; Received-SPF: None (protection.outlook.com: proofdot.com does not designate permitted sender hosts) X-Microsoft-Exchange-Diagnostics: =?us-ascii?Q?1; PN1PR01MB0461; 23:krdSTXC1eWPonV8E4yRAJv4EN3nXCdrR7dU0K4bJr?= =?us-ascii?Q?LI7cOwktZdEuG3YwoNyp9Gtqpijx34LzmxHgLaGw/YaTvzQBJ5dayEUcz5OA?= =?us-ascii?Q?xY9K88YZnHGx2DXUdUDppF5cHGdv6QEWI2V7gxAXf/Vkz3tgAv8TccQH9qL3?= =?us-ascii?Q?Zz7HLAcWapNRekQ57R8LCEB4E+xFyUkrKMC2HSwPicGFVtjD2/m+Hlc6jpkD?= =?us-ascii?Q?VzSw3aaQPB5oLPE0tz+BHL6ISzLrwaQUtjpDRN+mw4a2yVgucIAJQIVGE2so?= =?us-ascii?Q?AO9m3x+4Ci7A/mJjR48FVg7niSDz73UARhO+wzcl12aiDTwzvJbwdibwmcl4?= =?us-ascii?Q?AuECcKkSCzkPa5gI/tY4M/vT4rId2Cll/ItBX0oTFEGC8NN4ug7IJ/jU38JN?= =?us-ascii?Q?aqiEO6FyOE0ypsYGU5NiYxUCWf6KBlAOqGEoM1y/RzV5OgTzep9AbNNXuvpW?= =?us-ascii?Q?MQAKaw6/G0ld0s/ogBEZsvkfq1SaDtrQiy8RcokLfPzzoPS7u5btUw8ung0e?= =?us-ascii?Q?ocI3joSNRwWzc/XZY21F86NZFDG6HDG96lsJB80PkNT1kAnfHAG3jbGDELZQ?= =?us-ascii?Q?gobyd+6SJuf9Gsa//LJ1/1GmHKxq7tAisGv9lK25tccztFdAUa2O91kMz3bS?= =?us-ascii?Q?40nGAmJ36pmiP1mIzX3My808kQsOGOUdGh3chg4sA3nSCMbc41k3yMCXGZvx?= =?us-ascii?Q?vJWU/sh6nzvYwRB5BLypjC8q83k2lslWcwoIIdXcdtMupBUHHNaf35b2gLTk?= =?us-ascii?Q?RRAiC4hhr5uTJTPiraAYbWDnjeMbeiBxOGLRWzu9MB99ONme6NimpihiG4E1?= =?us-ascii?Q?ocVNWyuAEGb1mDnyz3daoUVuFNgdJlDBUakHASB0ZWIbB+sUylgpNZdI93Km?= =?us-ascii?Q?fGnLB3OHgbdbnBhkzOCSyCLdFlsCBCBpNFP9pE/o2qnGzR9HtgYP+JCOfByl?= =?us-ascii?Q?tWWGcE/T4oYUyU0qeROv8nPpi7bhKxzbULLbU/8NqmVJdKPs+0UkUHbObuX9?= =?us-ascii?Q?cyVL0EHeu6Ub7pk210P1pxl6jPE1rm29G1aPSWUQ+RRSElwFQy9ChC/SKNH5?= =?us-ascii?Q?GdrqHeerXvFOeerbsrbY6zxPOQadf//zSC1RQQrzMmtsFakU1S+FImmY2Bjo?= =?us-ascii?Q?m2puMknOrbwMKDpwgnBpBmqwwmlMUvV/4xBTTCBqMCPoBWu8tlIDqKI1HMSM?= =?us-ascii?Q?GS3HLVkJ3qmk4RjvElrBoc9QFWrgeVIFA7WsaajbFYUXsmT0Cmt6iQNEm9hG?= =?us-ascii?Q?IB7Mp4/kJ32VREHXR/S6+Mz+MYV8C+wUVkt6VnqVCUWI8WEuwI1zNjxPqWKn?= =?us-ascii?Q?OhlqhC/cOjl73EABEYSoUBojsVACdc7vdKMM4UhZaeCw0/t0HMUvNqT8RbgT?= =?us-ascii?Q?KVDpaVPzL+ET07lyvbbQMSGZ+k=3D?= X-Microsoft-Exchange-Diagnostics: 1; PN1PR01MB0461; 6:UFKHfJv8OTnhSdihYr/AmVkLbQ2E6g5pPhB+NKUhw13YuTh4Xuxq7g0bgD0n1lg2VppbTlQqab09RDXauDo6QvdV/d2SPSYDbTmNnMWFaRJXI0OGaQy2eIIoNi2opZ6UxW5BsUheKc385YeGa/nb4gK/VAguyN91isYAHxNJn8WwU1b4cK1Kp1xEoWqIPFK+leDM7CtJJMgkd+tZZeFXJJ6pCvP62MSYmpGYjw/qQpjqxWFEU8SXHrHp8een31Un3SggueEGj5t7vRpIE7UHzLSl0SEinVwxfECHW7niGqrnQQBuNMRMipzAhDoROl3GmhIQF2S+zQTA/DzOli9acWG8T0aEsgkGgMCsCqbVxyI=; 5:mP6y4E7jCDcNsmOcIk1cISM20ZHNF2kzzZwWGC5nnbvun81UNhnQeTLaomyHhBY4imoLlHY6QUu6+7BZqysR85TJ0+SvEuAqyptytpNDVIr1FB9Y3+Xbx5hxxiWTUqC+ObGSUH4TQV0/bSKEVMIghfpkJtvS3r5ynciaMfm5bn4=; 24:4wfRt5nKkcX4NP9rrj/nHXQ1ybu1cwogJ/wiYlhrXsmq9EUE/z/c0NYaSWsjKSe5BnWm8Wry3+YQ0y+qqJq35A==; 7:ZiLtcoEaUL4WxLabYOcerBxqbA2Z539nMz1CQrIwzTZFHqLMFtvn9dH4UIU1V06lpdDztinsx2TeWUxpr4BS9fQ93E/TLQ54yc96foU5IjQsihZXeRnPCL9rSw+sGaek4yD26RIHzqrXffomfRc4ztmjnfGOnEzHwm2UatMrUMAd0SVsvN070LV2tOA34L0O9jJ60hGPaS7KOokKqeLTqFON1ORCw+PkaKAG75zbzrqVJ1iBqJi9gCp6ADQ/qyZi SpamDiagnosticOutput: 1:22 X-OriginatorOrg: proofdot.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 15 Feb 2018 15:18:23.9118 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: 9368f8d4-56ab-41e8-007f-08d574875b16 X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: e6770ff3-1fee-46be-8f1f-528758499d83 X-MS-Exchange-Transport-CrossTenantHeadersStamped: PN1PR01MB0461 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.25 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 15 Feb 2018 15:18:30 -0000 Hi, Would you be interested in Decision Makers List contact information for your marketing campaigns? If you looking for particular titles from your target geography, please let me know and I will get back to you with more information regarding the same. Information Fields: Company Name, Website, First Name, Last Name, Job Title, Phone Number, Business Email, Postal Address, Zip Code, SIC Code, Revenue Size, Employee Size, Industry, and many more. Technology Based Lists: Salesforce.com, Oracle, SAP, IBM, Microsoft, PeopleSoft, JD Edwards, SIEBEL, Sage, Adobe, Linux, VMware, Teradata, Dell, etc. Industry Specific: Healthcare, Telecom, manufacturing, Oil & Gas, Pharmacy, Software, Retail, Real Estate, Construction, Energy, Government, Banking, Legal, Transportation, Wholesale, Agriculture, Business Service, Marketing, Education, Hospitality And Media Internet. Please review and let me know your thoughts. Appreciate your time and look forward to hear from you. Thanks, Sarah Parker Database Consultant |Tech Business Point | List acquisition | Technology Lists | Email/Data Appending | Search Engine Optimization | To Opt Out, please reply with Leave Out in the Subject Line. From owner-freebsd-fs@freebsd.org Fri Feb 16 21:49:49 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E60E4F15721 for ; Fri, 16 Feb 2018 21:49:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 82729741C0 for ; Fri, 16 Feb 2018 21:49:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id C1774118C6 for ; Fri, 16 Feb 2018 21:49:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w1GLnlSN015206 for ; Fri, 16 Feb 2018 21:49:47 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w1GLnl80015205 for freebsd-fs@FreeBSD.org; Fri, 16 Feb 2018 21:49:47 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 225960] zfs: g_access leak when unmounting UFS on a zvol Date: Fri, 16 Feb 2018 21:49:47 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: avg@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-geom@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 16 Feb 2018 21:49:49 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D225960 Andriy Gapon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|freebsd-bugs@FreeBSD.org |freebsd-geom@FreeBSD.org CC| |avg@FreeBSD.org, | |freebsd-fs@FreeBSD.org --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-fs@freebsd.org Sat Feb 17 07:52:05 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E4DDFF17FF1 for ; Sat, 17 Feb 2018 07:52:04 +0000 (UTC) (envelope-from anti_spam256@yahoo.ca) Received: from sonic317-22.consmr.mail.gq1.yahoo.com (sonic317-22.consmr.mail.gq1.yahoo.com [98.137.66.148]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 6D7D36D159 for ; Sat, 17 Feb 2018 07:52:03 +0000 (UTC) (envelope-from anti_spam256@yahoo.ca) X-YMail-OSG: 7gvGVHgVM1mWCj10VNqIoj8ZzhaGMfVT1Wc_mWk8i5ANG8cVLeHoyXgkqu2iCf7 1baXUDtZ0m77nnj16tuoBzx5PDwav9g3vmW65wPLRF2ZtXNTVbRpU1VPY9nU7Ao5Id2wII_JcRZB ddGsqbcwcYYTG2m.f0jmICDey8NtLfb62xp9u6usaas0ZTj2MhdVxEO1gK3hJM9RJJgaQi.NG4ci HNTkmnFKus5RTo_qpxCQp6eaK2DXrvaESgt7rCnvI9wPIY4jTRtU8Y9YRF29sPFeKul4lpsUxBcw qH82BRuojh7LxAtUyRPkQLjPRNXg8st3WSlo1gY9l7ZVP.uRktROCUtfALrdeciACvIb0NaPi8i9 jfAjq.VVu86L7tdyQOcD4Lfd3IcVR2NdCNSQCUoQEGqLaYIzgjlRtELziEtasg21tCwdpnbMBtN_ Dpu0NkR7Q8a_AfcvhpE2ey.0xwcCWutuU0ZjWO_Rd7mvpTnjYFTDrQlu40A-- Received: from sonic.gate.mail.ne1.yahoo.com by sonic317.consmr.mail.gq1.yahoo.com with HTTP; Sat, 17 Feb 2018 07:51:57 +0000 Date: Sat, 17 Feb 2018 07:41:49 +0000 (UTC) From: James Phillips Reply-To: James Phillips To: Message-ID: <366879496.203508.1518853309719@mail.yahoo.com> Subject: ZFS trashed by bad import MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit References: <366879496.203508.1518853309719.ref@mail.yahoo.com> X-Mailer: WebService/1.1.11419 YahooMailBasic Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:37.0) Gecko/20100101 Firefox/37.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 17 Feb 2018 07:52:05 -0000 Was considering posting this on the forum: but the rules on topic selection suggested really specific things should be on the mailing list. Short version (reconstructed from notes): On a fresh 11.1 install: # zpool import -> shows list of available pools, including degraded striped mirror. # zpool import -f 8255478166520290766 granny # zpool status (any zpool command cause same error): internal error: failed to initialize ZFS library Upon reboot, I was not able to switch VT consoles or log in. Tried telling the BIOS to boot from my old installation (granny), and it failed after kernel device detection. *Background*: Granny was originally a 160GB ZFS mirrored with FreeBSD 10. I later expanded the pool with a mirrored pair of 80GB drives. I had successfully tested booting with a simulated controller failure. (each mirror was on a different disk controller + all drives had a boot partition set) About a week ago, one of my drives appeared to fail: (ada1:ata2:0:1:0): Error 5. retries exhausted GEOM_ELI: g_eli_read_done() failed (error=5) label/granny3p1.eli[READ(offset=32083968, lengt... swap_pager: I/O error - pagein failed; blkno 2367129, size 4096, erro 5 va_fault: pager read error, pid 91969 (xfdesktop) (ada1:ata2:0:1:0): READ_DMA. ACB: c8 00 32 9b 00 40 00 00 00 00 18 00 (ada1:ata2:0:1:0): CAM status: ATA Status Error (ada1:ata2:0:1:0): ATA status: 51 (DRDY SERV ERR), error: 40 (UNC ) (ada1:ata2:0:1:0): RES: 51 40 42 9b 00 00 00 00 00 08 (ada1:ata2:0:1:0): Retrying command (ada1:ata2:0:1:0): READ_DMA. ACB: c8 00 32 9b 00 40 00 00 00 00 18 00 ... I was able to (temporarily) use my computer again by pulling one of the IDE cables. (by luck guessed which side the first time -- did not notice the label above until I typed this.) Was a little surprised it was not the drive re-certified by manufacturer software after throwing errors (years ago). I decided to resolve the problem by moving to a ZFS mirror on a pair of 2TB drives. Incidentally, I accidentally deleted pkg while trying to update the ports collection, so decided a fresh BSD 11 install may be a good idea as well. *Confounding variables*: While pulling the defective half of the mirror, I tentatively ruled heat death due to dust build up on air intake. However, I also noticed the Northbridge heatsink was loose due to a broken clip. Because my "real" machine (with ECC RAM even) is going to be delayed at least a week, I decided to do a temporary board swap with an older machine I had laying around. This machine was overclocked by under-volting, and pushing thermal limits of the CPU (while under-clocking RAM), then backing off a bit to tolerate summer heat. I mention the over-clocking because the system failed to boot properly after installation. I bumped the voltage a little, but it may have had to do with BIOS Booting from an unexpected drive instead. (the 2TB disks were seen as ad2 and ad3). The Over-clock was stable when that machine went in storage around a year ago. However it is now in a case with a different PSU (same wattage, more efficient), and more drives. Tried all the ZFS options in the BSD 11 install wizard: 2 disk mirror 4k sectors - GPT partition Encrypted disks - 50GB swap (large for the memory: 3200MB) Mirror swap - Encrypt swap -> Note: granny only had encrypted (non mirrored) swap: could not get encrypted striping to work. System hardening: - clean /tmp on startup - disable opening sylogd network socket At the time of the failure, I was running mprime (prime95) in the back-ground, and periodically monitoring CPU temperature and fan speed. This implies that ZFS had only ~1600MB to work with (3200MB-1600MB used by mprime) *Next Steps*: 1. image all 4 drives (one at a time) onto a third 2TB drive with the System Rescue CD and dd-rescue. 2. Try to import the degraded mirror with a BSD live DVD (and re-export if successful, I guess) Depending on results of step 2: - find machine with ECC RAM, put granny3 on a fresh drive, and tell ZFS to scrub? - copy over boot partitions that may have been clobbered by BSD 11 install? If all else fails, I did do a full export in the last 90 days. Regards, James Phillips Note: not subscribed to the list. From owner-freebsd-fs@freebsd.org Sat Feb 17 16:33:31 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8F909F1E0D1 for ; Sat, 17 Feb 2018 16:33:31 +0000 (UTC) (envelope-from anti_spam256@yahoo.ca) Received: from sonic307-9.consmr.mail.gq1.yahoo.com (sonic307-9.consmr.mail.gq1.yahoo.com [98.137.64.33]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 1C668882F2 for ; Sat, 17 Feb 2018 16:33:30 +0000 (UTC) (envelope-from anti_spam256@yahoo.ca) X-YMail-OSG: u8Z3F4UVM1k01eiF7msCQJbg4gcrNR6SHJ2i2.bexuy4UhG255wikxCJVz4vsQ2 1cs.AqpW5lUzsH7Q8jw9Vy6i8RtVFSB6uqMmVdDiWO3szT0DSEHs4p3yS4cFyH21QA2aJCK6aaZ2 hPvSvaLVc1Ocry2LRoSPhdffIQGjbofRZqClyeM7USm.B3f31hrn0MAAtoaces64dyU4SdaHbYSn oNNbW7yJN1RRKWe5438eXqryF_qFEKJuJuRtHRNkV_65jNq2ic98vcQ_Hez7R9Yh3ZCht_U_KAcK C5s6.pABjw26WhzTiegucERoQMQ_2jwoB5kwjddAx7TF7r0iPh_EeLMMVo6eqRRS8YLM7X_Z3rYT Aj9_sBzaO_hNG41Gnrh_XgUOwNkvVtGSfeamZKBsE_Z799leQM.BdF606NX1X5Wj7ccLWijY5BqS g4SAB3RTDpJ4Asbf2dtgdR75rNPp2DE38Mjhe0oN67ar7XRS5MF.R9jBgiOgGUZajSlC2JtPwgTS V Received: from sonic.gate.mail.ne1.yahoo.com by sonic307.consmr.mail.gq1.yahoo.com with HTTP; Sat, 17 Feb 2018 16:33:23 +0000 Date: Sat, 17 Feb 2018 16:33:21 +0000 (UTC) From: James Phillips Reply-To: James Phillips To: Andriy Gapon Cc: Message-ID: <7336017.290096.1518885201320@mail.yahoo.com> Subject: Re: ZFS trashed by bad import MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable References: <7336017.290096.1518885201320.ref@mail.yahoo.com> X-Mailer: WebService/1.1.11419 YahooMailBasic Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:37.0) Gecko/20100101 Firefox/37.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 17 Feb 2018 16:33:31 -0000 -------------------------------------------- On Sat, 2/17/18, Andriy Gapon wrote: Subject: Re: ZFS trashed by bad import To: "James Phillips" Received: Saturday, February 17, 2018, 2:46 PM =20 On 17/02/2018 09:41, James Phillips via freebsd-fs wrote: > # zpool import=C2=A0 -> shows list of available pools, including degraded striped mirror. > # zpool import -f 8255478166520290766 granny > # zpool status (any zpool command cause same error): >=C2=A0 =C2=A0 =C2=A0 internal error: failed to initialize ZFS library =20 Not sure if this is what happened, but it looks like the pool might have a filesystem with mountpoint set to / and it got mounted over the real / after import. So, you might have a mismatch between userland and kernel that causes the further issues. =20 --=20 Andriy Gapon =20 I did import by number because the zroot label conflicted. -james From owner-freebsd-fs@freebsd.org Sat Feb 17 17:50:25 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9536CF239DD for ; Sat, 17 Feb 2018 17:50:25 +0000 (UTC) (envelope-from agapon@gmail.com) Received: from mail-lf0-f67.google.com (mail-lf0-f67.google.com [209.85.215.67]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 0EB3F8B4A6 for ; Sat, 17 Feb 2018 17:50:24 +0000 (UTC) (envelope-from agapon@gmail.com) Received: by mail-lf0-f67.google.com with SMTP id f136so8027701lff.8 for ; Sat, 17 Feb 2018 09:50:24 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:cc:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=s52doV7t6jT66eBTr5t9RQWQCq2WEov8yWZVEpvkZL0=; b=beZnhTgbT4pLU40ptcXmhDEO6DNu57V3kNLkZKex/mEWodRbHNbuqZcZ4BU70jTCbL nBcxqkxUpJIbEbEW95WVEpmVt3Mz3lJlj3NNfCxaCPKIuUPm54P41pzSAgKnCnoiSY73 np0DSIe+2iAb/V+jgKhUgd02fbcpKZxnF3zJO6xUsPLtd4JyzfZ2tVOE6kRZAaBZ9EnD daSnex9kNJgZmWebodktYq0iPKqA/G/TVZDqCbUZOn3yvuoDVh18+2ZT7JGAEhKKvv4y /S6wlVLlvoEbOyw805/lLYeGKIV8pnztaGNlks/4q/bzhsMy9gjhfCmXs5gMrR9tui7c dXNg== X-Gm-Message-State: APf1xPDpHwtfBM+p1/zAc8i7pDZ3PUwSHbxOcyQ7j+w4/bnJXcWy+Tgu AKCnI88pZZ/DvqtynVZSac82YV/R X-Google-Smtp-Source: AH8x225Sya7HyD10dJwiGKckL/Rp1qJjIAfNnqOLw1I1Yw8CYlVYM8lp+c2jm7XmatJ0pF3zLbfePg== X-Received: by 10.25.74.205 with SMTP id x196mr6940390lfa.46.1518889822536; Sat, 17 Feb 2018 09:50:22 -0800 (PST) Received: from [192.168.0.88] (east.meadow.volia.net. [93.72.151.96]) by smtp.googlemail.com with ESMTPSA id b86sm2185854lff.65.2018.02.17.09.50.20 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Sat, 17 Feb 2018 09:50:21 -0800 (PST) Subject: Re: ZFS trashed by bad import To: James Phillips Cc: freebsd-fs@FreeBSD.org References: <7336017.290096.1518885201320.ref@mail.yahoo.com> <7336017.290096.1518885201320@mail.yahoo.com> From: Andriy Gapon Message-ID: <6e6fb440-3db5-ad01-83ca-201e8ae6553a@FreeBSD.org> Date: Sat, 17 Feb 2018 19:50:19 +0200 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:52.0) Gecko/20100101 Thunderbird/52.6.0 MIME-Version: 1.0 In-Reply-To: <7336017.290096.1518885201320@mail.yahoo.com> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 17 Feb 2018 17:50:25 -0000 On 17/02/2018 18:33, James Phillips wrote: > > -------------------------------------------- > On Sat, 2/17/18, Andriy Gapon wrote: > > Subject: Re: ZFS trashed by bad import > To: "James Phillips" > Received: Saturday, February 17, 2018, 2:46 PM > > On 17/02/2018 09:41, James > Phillips via freebsd-fs wrote: > > # zpool import  -> > shows list of available pools, including degraded striped > mirror. > > # zpool import -f > 8255478166520290766 granny > > # zpool > status (any zpool command cause same error): > >      internal error: failed to > initialize ZFS library > > Not sure if this is what happened, but it looks > like the pool might have a > filesystem with > mountpoint set to / and it got mounted over the real / after > import. > So, you might have a mismatch > between userland and kernel that causes the > further issues. > > I did import by number because the zroot label conflicted. This is not directly related. It's better to import a new pool using -R (altroot) option, so that it does not interfere with the already mounted filesystems and you can examine and modify it. -- Andriy Gapon