From owner-freebsd-stable@freebsd.org Tue Feb 28 03:21:48 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DCB95CF08B9 for ; Tue, 28 Feb 2017 03:21:48 +0000 (UTC) (envelope-from markmi@dsl-only.net) Received: from asp.reflexion.net (outbound-mail-210-89.reflexion.net [208.70.210.89]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 9DF5A797 for ; Tue, 28 Feb 2017 03:21:48 +0000 (UTC) (envelope-from markmi@dsl-only.net) Received: (qmail 29151 invoked from network); 28 Feb 2017 03:21:40 -0000 Received: from unknown (HELO mail-cs-01.app.dca.reflexion.local) (10.81.19.1) by 0 (rfx-qmail) with SMTP; 28 Feb 2017 03:21:40 -0000 Received: by mail-cs-01.app.dca.reflexion.local (Reflexion email security v8.30.0) with SMTP; Mon, 27 Feb 2017 22:21:41 -0500 (EST) Received: (qmail 1440 invoked from network); 28 Feb 2017 03:21:40 -0000 Received: from unknown (HELO iron2.pdx.net) (69.64.224.71) by 0 (rfx-qmail) with (AES256-SHA encrypted) SMTP; 28 Feb 2017 03:21:40 -0000 Received: from [192.168.1.111] (c-67-170-167-181.hsd1.or.comcast.net [67.170.167.181]) by iron2.pdx.net (Postfix) with ESMTPSA id 06F4AEC7822; Mon, 27 Feb 2017 19:21:39 -0800 (PST) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 10.2 \(3259\)) Subject: arm64 vs. jemalloc and swapping in and out, sh/su examples: being swapped out leads to later Failed assertion: "tsd_booted" after being swapped in Message-Id: <6A5AE299-8594-45CC-A801-F0B1125BB042@dsl-only.net> Date: Mon, 27 Feb 2017 19:21:39 -0800 Cc: FreeBSD-STABLE Mailing List , jasone@FreeBSD.org, Shawn Webb To: freebsd-arm , FreeBSD Current X-Mailer: Apple Mail (2.3259) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Feb 2017 03:21:49 -0000 [I've added a variant of this material to bugzilla 217138.] I've reduced the testing context to the following type of example (no longer involving buildworld buildkernel): # sh # sh # sh . . . # sh (So a bunch of nested sh's in an ssh session that will have most swapped out. I happened to have done this under 2 users for the example material below: in one I did an su first. Plus I had another session without such a nesting but with an su: this is the one were I ran stress.) After forcing these to mostly swap out (see below) I used ^D or exit exit a currently interactive one. Then the rest of the swapped out ones from the nesting get the tsd_booted failure. So, for example: # stress -m 1 --vm-bytes 1536M The context is a PINE64+ with 2GB of RAM. The above was enough in my context to cause the needed swapouts: # ps -aOuser,flags PID USER F TT STAT TIME COMMAND 688 root 4102 u0 IWs 0:00.00 login [pam] (login) 689 root 10004002 u0 I+ 0:00.06 -sh (sh) 72611 markmi 4002 0 IWs 0:00.00 -sh (sh) 72613 markmi 4002 0 IW 0:00.00 sh 72614 markmi 4002 0 IW 0:00.00 sh 72615 markmi 4002 0 IW 0:00.00 sh 72616 markmi 4002 0 IW 0:00.00 sh 72617 markmi 4002 0 IW 0:00.00 sh 72618 markmi 4002 0 IW 0:00.00 sh 72619 markmi 4002 0 IW 0:00.00 sh 72620 markmi 4002 0 IW 0:00.00 sh 72621 markmi 4002 0 IW 0:00.00 sh 72622 markmi 4002 0 IW 0:00.00 sh 72623 markmi 4002 0 IW 0:00.00 sh 72624 markmi 4002 0 IW 0:00.00 sh 72625 markmi 4002 0 IW 0:00.00 sh 72626 markmi 10004002 0 I+ 0:00.01 sh 167 markmi 4002 1 IWs 0:00.00 -sh (sh) 169 root 4102 1 IW 0:00.00 su 170 root 4002 1 IW 0:00.00 su (sh) 171 root 4002 1 IW 0:00.00 sh 172 root 4002 1 IW 0:00.00 sh 173 root 4002 1 IW 0:00.00 sh 174 root 4002 1 IW 0:00.00 sh 175 root 4002 1 IW 0:00.00 sh 176 root 4002 1 IW 0:00.00 sh 177 root 4002 1 IW 0:00.00 sh 178 root 4002 1 IW 0:00.00 sh 179 root 10004002 1 I+ 0:00.01 sh 60961 root 4002 2 IW 0:00.00 stress -m 1 --vm-bytes 1536M 60962 root 10000002 2 R 0:29.41 stress -m 1 --vm-bytes 1536M 60964 root 10004002 2 R+ 0:00.01 ps -aOuser,flags 82389 markmi 4002 2 IWs 0:00.00 -sh (sh) 82391 root 4102 2 IW 0:00.00 su 82392 root 10004002 2 S 0:00.22 su (sh) So with that swapped out context established: (The markmi user case of nested sh's:) $ ^D: = /usr/src/contrib/jemalloc/include/jemalloc/internal/tsd.h:687: Failed = assertion: "tsd_booted" : = /usr/src/contrib/jemalloc/include/jemalloc/internal/tsd.h:687: Failed = assertion: "tsd_booted" : = /usr/src/contrib/jemalloc/include/jemalloc/internal/tsd.h:687: Failed = assertion: "tsd_booted" : = /usr/src/contrib/jemalloc/include/jemalloc/internal/tsd.h:687: Failed = assertion: "tsd_booted" : = /usr/src/contrib/jemalloc/include/jemalloc/internal/tsd.h:687: Failed = assertion: "tsd_booted" : = /usr/src/contrib/jemalloc/include/jemalloc/internal/tsd.h:687: Failed = assertion: "tsd_booted" : = /usr/src/contrib/jemalloc/include/jemalloc/internal/tsd.h:687: Failed = assertion: "tsd_booted" : = /usr/src/contrib/jemalloc/include/jemalloc/internal/tsd.h:687: Failed = assertion: "tsd_booted" : = /usr/src/contrib/jemalloc/include/jemalloc/internal/tsd.h:687: Failed = assertion: "tsd_booted" : = /usr/src/contrib/jemalloc/include/jemalloc/internal/tsd.h:687: Failed = assertion: "tsd_booted" : = /usr/src/contrib/jemalloc/include/jemalloc/internal/tsd.h:687: Failed = assertion: "tsd_booted" : = /usr/src/contrib/jemalloc/include/jemalloc/internal/tsd.h:687: Failed = assertion: "tsd_booted" : = /usr/src/contrib/jemalloc/include/jemalloc/internal/tsd.h:687: Failed = assertion: "tsd_booted" : = /usr/src/contrib/jemalloc/include/jemalloc/internal/tsd.h:687: Failed = assertion: "tsd_booted" (The su'd user case of nested sh's:) # ^D: = /usr/src/contrib/jemalloc/include/jemalloc/internal/tsd.h:687: Failed = assertion: "tsd_booted" : = /usr/src/contrib/jemalloc/include/jemalloc/internal/tsd.h:687: Failed = assertion: "tsd_booted" : = /usr/src/contrib/jemalloc/include/jemalloc/internal/tsd.h:687: Failed = assertion: "tsd_booted" : = /usr/src/contrib/jemalloc/include/jemalloc/internal/tsd.h:687: Failed = assertion: "tsd_booted" : = /usr/src/contrib/jemalloc/include/jemalloc/internal/tsd.h:687: Failed = assertion: "tsd_booted" : = /usr/src/contrib/jemalloc/include/jemalloc/internal/tsd.h:687: Failed = assertion: "tsd_booted" : = /usr/src/contrib/jemalloc/include/jemalloc/internal/tsd.h:687: Failed = assertion: "tsd_booted" : = /usr/src/contrib/jemalloc/include/jemalloc/internal/tsd.h:687: Failed = assertion: "tsd_booted" : = /usr/src/contrib/jemalloc/include/jemalloc/internal/tsd.h:687: Failed = assertion: "tsd_booted" : = /usr/src/contrib/jemalloc/include/jemalloc/internal/tsd.h:687: Failed = assertion: "tsd_booted" The one without the deeply nested sh's (but an su): # exit : = /usr/src/contrib/jemalloc/include/jemalloc/internal/tsd.h:687: Failed = assertion: "tsd_booted" So far I've not gotten such without having had the failing processes having been swapped-out at some point before failure. # ls -ltTU /var/crash/ total 589220 -rw------- 1 markmi wheel 4718592 Feb 27 18:31:00 2017 sh.82389.core -rw------- 1 root wheel 4812800 Feb 27 18:30:59 2017 su.82391.core -rw------- 1 markmi wheel 4718592 Feb 27 18:20:35 2017 sh.72611.core -rw------- 1 markmi wheel 4718592 Feb 27 18:20:34 2017 sh.72613.core -rw------- 1 markmi wheel 4718592 Feb 27 18:20:34 2017 sh.72614.core -rw------- 1 markmi wheel 4718592 Feb 27 18:20:33 2017 sh.72615.core -rw------- 1 markmi wheel 4718592 Feb 27 18:20:32 2017 sh.72616.core -rw------- 1 markmi wheel 4718592 Feb 27 18:20:31 2017 sh.72617.core -rw------- 1 markmi wheel 4718592 Feb 27 18:20:30 2017 sh.72618.core -rw------- 1 markmi wheel 4718592 Feb 27 18:20:29 2017 sh.72619.core -rw------- 1 markmi wheel 4718592 Feb 27 18:20:28 2017 sh.72620.core -rw------- 1 markmi wheel 4718592 Feb 27 18:20:28 2017 sh.72621.core -rw------- 1 markmi wheel 4718592 Feb 27 18:20:27 2017 sh.72622.core -rw------- 1 markmi wheel 4718592 Feb 27 18:20:26 2017 sh.72623.core -rw------- 1 markmi wheel 4718592 Feb 27 18:20:25 2017 sh.72624.core -rw------- 1 markmi wheel 4718592 Feb 27 18:20:24 2017 sh.72625.core -rw------- 1 markmi wheel 4718592 Feb 27 18:20:20 2017 sh.167.core -rw------- 1 root wheel 4718592 Feb 27 18:20:19 2017 sh.170.core -rw------- 1 root wheel 4718592 Feb 27 18:20:18 2017 sh.171.core -rw------- 1 root wheel 4718592 Feb 27 18:20:17 2017 sh.172.core -rw------- 1 root wheel 4718592 Feb 27 18:20:16 2017 sh.173.core -rw------- 1 root wheel 4718592 Feb 27 18:20:16 2017 sh.174.core -rw------- 1 root wheel 4718592 Feb 27 18:20:15 2017 sh.175.core -rw------- 1 root wheel 4718592 Feb 27 18:20:14 2017 sh.176.core -rw------- 1 root wheel 4718592 Feb 27 18:20:13 2017 sh.177.core -rw------- 1 root wheel 4718592 Feb 27 18:20:12 2017 sh.178.core . . . (from prior investigative activity) . . . Note it was about 10 minutes after the two nested examples before I existed the one that only had the su --at which point it detected the Failed assertion: "tsd_booted" as well (su and sh, su first). In other experiments I found that it was when buildworld activity caused swapping out of the failing processes that there were the later failures. I can not claim swapping out and back in is the only context with issues but it has been true of every such failure that I've looked at since I made this discovery. My context has a USB SSD for the root filesystem and the swap parition. =3D=3D=3D Mark Millard markmi at dsl-only.net From owner-freebsd-stable@freebsd.org Tue Feb 28 03:56:01 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 37F31CEFA50 for ; Tue, 28 Feb 2017 03:56:01 +0000 (UTC) (envelope-from markmi@dsl-only.net) Received: from asp.reflexion.net (outbound-mail-210-89.reflexion.net [208.70.210.89]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id F0964211 for ; Tue, 28 Feb 2017 03:56:00 +0000 (UTC) (envelope-from markmi@dsl-only.net) Received: (qmail 31905 invoked from network); 28 Feb 2017 03:58:12 -0000 Received: from unknown (HELO mail-cs-01.app.dca.reflexion.local) (10.81.19.1) by 0 (rfx-qmail) with SMTP; 28 Feb 2017 03:58:12 -0000 Received: by mail-cs-01.app.dca.reflexion.local (Reflexion email security v8.30.0) with SMTP; Mon, 27 Feb 2017 22:55:59 -0500 (EST) Received: (qmail 6455 invoked from network); 28 Feb 2017 03:55:58 -0000 Received: from unknown (HELO iron2.pdx.net) (69.64.224.71) by 0 (rfx-qmail) with (AES256-SHA encrypted) SMTP; 28 Feb 2017 03:55:58 -0000 Received: from [192.168.1.111] (c-67-170-167-181.hsd1.or.comcast.net [67.170.167.181]) by iron2.pdx.net (Postfix) with ESMTPSA id 3419CEC8BAF; Mon, 27 Feb 2017 19:55:58 -0800 (PST) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 10.2 \(3259\)) Subject: Re: arm64 vs. jemalloc and swapping in and out, sh/su examples: being swapped out leads to later Failed assertion: "tsd_booted" after being swapped in From: Mark Millard In-Reply-To: <6A5AE299-8594-45CC-A801-F0B1125BB042@dsl-only.net> Date: Mon, 27 Feb 2017 19:55:57 -0800 Cc: FreeBSD-STABLE Mailing List , jasone@FreeBSD.org, Shawn Webb Content-Transfer-Encoding: quoted-printable Message-Id: <41A51B66-4290-48E0-A3E3-AEB809B2748D@dsl-only.net> References: <6A5AE299-8594-45CC-A801-F0B1125BB042@dsl-only.net> To: freebsd-arm , FreeBSD Current X-Mailer: Apple Mail (2.3259) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Feb 2017 03:56:01 -0000 On 2017-Feb-27, at 7:21 PM, Mark Millard wrote: > [I've added a variant of this material to bugzilla 217138.] >=20 > I've reduced the testing context to the following > type of example (no longer involving buildworld > buildkernel): >=20 > # sh > # sh > # sh > . . . > # sh >=20 > (So a bunch of nested sh's in an ssh session that > will have most swapped out. I happened to have > done this under 2 users for the example material > below: in one I did an su first. Plus I had another > session without such a nesting but with an su: this > is the one were I ran stress.) >=20 > After forcing these to mostly swap out (see below) > I used ^D or exit exit a currently interactive one. > Then the rest of the swapped out ones from the > nesting get the tsd_booted failure. >=20 > So, for example: >=20 > # stress -m 1 --vm-bytes 1536M >=20 > The context is a PINE64+ with 2GB of RAM. The above > was enough in my context to cause the needed swapouts: >=20 > # ps -aOuser,flags > PID USER F TT STAT TIME COMMAND > 688 root 4102 u0 IWs 0:00.00 login [pam] (login) > 689 root 10004002 u0 I+ 0:00.06 -sh (sh) > 72611 markmi 4002 0 IWs 0:00.00 -sh (sh) > 72613 markmi 4002 0 IW 0:00.00 sh > 72614 markmi 4002 0 IW 0:00.00 sh > 72615 markmi 4002 0 IW 0:00.00 sh > 72616 markmi 4002 0 IW 0:00.00 sh > 72617 markmi 4002 0 IW 0:00.00 sh > 72618 markmi 4002 0 IW 0:00.00 sh > 72619 markmi 4002 0 IW 0:00.00 sh > 72620 markmi 4002 0 IW 0:00.00 sh > 72621 markmi 4002 0 IW 0:00.00 sh > 72622 markmi 4002 0 IW 0:00.00 sh > 72623 markmi 4002 0 IW 0:00.00 sh > 72624 markmi 4002 0 IW 0:00.00 sh > 72625 markmi 4002 0 IW 0:00.00 sh > 72626 markmi 10004002 0 I+ 0:00.01 sh > 167 markmi 4002 1 IWs 0:00.00 -sh (sh) > 169 root 4102 1 IW 0:00.00 su > 170 root 4002 1 IW 0:00.00 su (sh) > 171 root 4002 1 IW 0:00.00 sh > 172 root 4002 1 IW 0:00.00 sh > 173 root 4002 1 IW 0:00.00 sh > 174 root 4002 1 IW 0:00.00 sh > 175 root 4002 1 IW 0:00.00 sh > 176 root 4002 1 IW 0:00.00 sh > 177 root 4002 1 IW 0:00.00 sh > 178 root 4002 1 IW 0:00.00 sh > 179 root 10004002 1 I+ 0:00.01 sh > 60961 root 4002 2 IW 0:00.00 stress -m 1 --vm-bytes 1536M > 60962 root 10000002 2 R 0:29.41 stress -m 1 --vm-bytes 1536M > 60964 root 10004002 2 R+ 0:00.01 ps -aOuser,flags > 82389 markmi 4002 2 IWs 0:00.00 -sh (sh) > 82391 root 4102 2 IW 0:00.00 su > 82392 root 10004002 2 S 0:00.22 su (sh) >=20 > So with that swapped out context established: >=20 > (The markmi user case of nested sh's:) >=20 > $ ^D: = /usr/src/contrib/jemalloc/include/jemalloc/internal/tsd.h:687: Failed = assertion: "tsd_booted" > : = /usr/src/contrib/jemalloc/include/jemalloc/internal/tsd.h:687: Failed = assertion: "tsd_booted" > : = /usr/src/contrib/jemalloc/include/jemalloc/internal/tsd.h:687: Failed = assertion: "tsd_booted" > : = /usr/src/contrib/jemalloc/include/jemalloc/internal/tsd.h:687: Failed = assertion: "tsd_booted" > : = /usr/src/contrib/jemalloc/include/jemalloc/internal/tsd.h:687: Failed = assertion: "tsd_booted" > : = /usr/src/contrib/jemalloc/include/jemalloc/internal/tsd.h:687: Failed = assertion: "tsd_booted" > : = /usr/src/contrib/jemalloc/include/jemalloc/internal/tsd.h:687: Failed = assertion: "tsd_booted" > : = /usr/src/contrib/jemalloc/include/jemalloc/internal/tsd.h:687: Failed = assertion: "tsd_booted" > : = /usr/src/contrib/jemalloc/include/jemalloc/internal/tsd.h:687: Failed = assertion: "tsd_booted" > : = /usr/src/contrib/jemalloc/include/jemalloc/internal/tsd.h:687: Failed = assertion: "tsd_booted" > : = /usr/src/contrib/jemalloc/include/jemalloc/internal/tsd.h:687: Failed = assertion: "tsd_booted" > : = /usr/src/contrib/jemalloc/include/jemalloc/internal/tsd.h:687: Failed = assertion: "tsd_booted" > : = /usr/src/contrib/jemalloc/include/jemalloc/internal/tsd.h:687: Failed = assertion: "tsd_booted" > : = /usr/src/contrib/jemalloc/include/jemalloc/internal/tsd.h:687: Failed = assertion: "tsd_booted" >=20 >=20 > (The su'd user case of nested sh's:) >=20 > # ^D: = /usr/src/contrib/jemalloc/include/jemalloc/internal/tsd.h:687: Failed = assertion: "tsd_booted" > : = /usr/src/contrib/jemalloc/include/jemalloc/internal/tsd.h:687: Failed = assertion: "tsd_booted" > : = /usr/src/contrib/jemalloc/include/jemalloc/internal/tsd.h:687: Failed = assertion: "tsd_booted" > : = /usr/src/contrib/jemalloc/include/jemalloc/internal/tsd.h:687: Failed = assertion: "tsd_booted" > : = /usr/src/contrib/jemalloc/include/jemalloc/internal/tsd.h:687: Failed = assertion: "tsd_booted" > : = /usr/src/contrib/jemalloc/include/jemalloc/internal/tsd.h:687: Failed = assertion: "tsd_booted" > : = /usr/src/contrib/jemalloc/include/jemalloc/internal/tsd.h:687: Failed = assertion: "tsd_booted" > : = /usr/src/contrib/jemalloc/include/jemalloc/internal/tsd.h:687: Failed = assertion: "tsd_booted" > : = /usr/src/contrib/jemalloc/include/jemalloc/internal/tsd.h:687: Failed = assertion: "tsd_booted" > : = /usr/src/contrib/jemalloc/include/jemalloc/internal/tsd.h:687: Failed = assertion: "tsd_booted" >=20 > The one without the deeply nested sh's (but an su): >=20 > # exit > : = /usr/src/contrib/jemalloc/include/jemalloc/internal/tsd.h:687: Failed = assertion: "tsd_booted" >=20 > So far I've not gotten such without having had the failing > processes having been swapped-out at some point before failure. >=20 >=20 > # ls -ltTU /var/crash/ > total 589220 > -rw------- 1 markmi wheel 4718592 Feb 27 18:31:00 2017 = sh.82389.core > -rw------- 1 root wheel 4812800 Feb 27 18:30:59 2017 = su.82391.core > -rw------- 1 markmi wheel 4718592 Feb 27 18:20:35 2017 = sh.72611.core > -rw------- 1 markmi wheel 4718592 Feb 27 18:20:34 2017 = sh.72613.core > -rw------- 1 markmi wheel 4718592 Feb 27 18:20:34 2017 = sh.72614.core > -rw------- 1 markmi wheel 4718592 Feb 27 18:20:33 2017 = sh.72615.core > -rw------- 1 markmi wheel 4718592 Feb 27 18:20:32 2017 = sh.72616.core > -rw------- 1 markmi wheel 4718592 Feb 27 18:20:31 2017 = sh.72617.core > -rw------- 1 markmi wheel 4718592 Feb 27 18:20:30 2017 = sh.72618.core > -rw------- 1 markmi wheel 4718592 Feb 27 18:20:29 2017 = sh.72619.core > -rw------- 1 markmi wheel 4718592 Feb 27 18:20:28 2017 = sh.72620.core > -rw------- 1 markmi wheel 4718592 Feb 27 18:20:28 2017 = sh.72621.core > -rw------- 1 markmi wheel 4718592 Feb 27 18:20:27 2017 = sh.72622.core > -rw------- 1 markmi wheel 4718592 Feb 27 18:20:26 2017 = sh.72623.core > -rw------- 1 markmi wheel 4718592 Feb 27 18:20:25 2017 = sh.72624.core > -rw------- 1 markmi wheel 4718592 Feb 27 18:20:24 2017 = sh.72625.core > -rw------- 1 markmi wheel 4718592 Feb 27 18:20:20 2017 sh.167.core > -rw------- 1 root wheel 4718592 Feb 27 18:20:19 2017 sh.170.core > -rw------- 1 root wheel 4718592 Feb 27 18:20:18 2017 sh.171.core > -rw------- 1 root wheel 4718592 Feb 27 18:20:17 2017 sh.172.core > -rw------- 1 root wheel 4718592 Feb 27 18:20:16 2017 sh.173.core > -rw------- 1 root wheel 4718592 Feb 27 18:20:16 2017 sh.174.core > -rw------- 1 root wheel 4718592 Feb 27 18:20:15 2017 sh.175.core > -rw------- 1 root wheel 4718592 Feb 27 18:20:14 2017 sh.176.core > -rw------- 1 root wheel 4718592 Feb 27 18:20:13 2017 sh.177.core > -rw------- 1 root wheel 4718592 Feb 27 18:20:12 2017 sh.178.core > . . . (from prior investigative activity) . . . >=20 > Note it was about 10 minutes after the two nested examples before I > existed the one that only had the su --at which point it detected > the Failed assertion: "tsd_booted" as well (su and sh, su first). >=20 >=20 > In other experiments I found that it was when buildworld activity > caused swapping out of the failing processes that there were the > later failures. >=20 >=20 >=20 > I can not claim swapping out and back in is the only context > with issues but it has been true of every such failure that > I've looked at since I made this discovery. >=20 > My context has a USB SSD for the root filesystem and the swap > parition. I was careless and did not list context details for the FreeBSD on the PINE64+ for the examples used: # uname -apKU FreeBSD pine64 12.0-CURRENT FreeBSD 12.0-CURRENT r313999M arm64 = aarch64 1200021 1200021 -r313999's buildworld was built without MALLOC_PRODUCTION. I've done no = tailoring of jemalloc behavior. It has a non-debug kernel build in use. I've not been using/testing stable/11 but from what I understand it likely has the same status as head (12) for the Failed assertion: "tsd_booted" notices/aborts. The evidence is that process-memory is trashed and so likely continued operation of any previously swapped-out processes is unreliable. =3D=3D=3D Mark Millard markmi at dsl-only.net From owner-freebsd-stable@freebsd.org Tue Feb 28 07:47:39 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id ED1FBCF19A6; Tue, 28 Feb 2017 07:47:39 +0000 (UTC) (envelope-from phk@phk.freebsd.dk) Received: from phk.freebsd.dk (phk.freebsd.dk [130.225.244.222]) by mx1.freebsd.org (Postfix) with ESMTP id B5E075E0; Tue, 28 Feb 2017 07:47:39 +0000 (UTC) (envelope-from phk@phk.freebsd.dk) Received: from critter.freebsd.dk (unknown [192.168.55.3]) by phk.freebsd.dk (Postfix) with ESMTP id 97854273C2; Tue, 28 Feb 2017 07:47:37 +0000 (UTC) Received: from critter.freebsd.dk (localhost [127.0.0.1]) by critter.freebsd.dk (8.15.2/8.15.2) with ESMTP id v1S7lZr7091405; Tue, 28 Feb 2017 07:47:36 GMT (envelope-from phk@phk.freebsd.dk) To: Mark Millard cc: freebsd-arm , FreeBSD Current , FreeBSD-STABLE Mailing List , jasone@FreeBSD.org, Shawn Webb Subject: Re: arm64 vs. jemalloc and swapping in and out, sh/su examples: being swapped out leads to later Failed assertion: "tsd_booted" after being swapped in In-reply-to: <41A51B66-4290-48E0-A3E3-AEB809B2748D@dsl-only.net> From: "Poul-Henning Kamp" References: <6A5AE299-8594-45CC-A801-F0B1125BB042@dsl-only.net> <41A51B66-4290-48E0-A3E3-AEB809B2748D@dsl-only.net> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-ID: <91403.1488268055.1@critter.freebsd.dk> Content-Transfer-Encoding: quoted-printable Date: Tue, 28 Feb 2017 07:47:35 +0000 Message-ID: <91404.1488268055@critter.freebsd.dk> X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Feb 2017 07:47:40 -0000 -------- In message <41A51B66-4290-48E0-A3E3-AEB809B2748D@dsl-only.net>, Mark Milla= rd writes: >The evidence is that process-memory is trashed and so likely continued >operation of any previously swapped-out processes is unreliable. I can confirm process corruption on RPi3 as of r313567. -- = Poul-Henning Kamp | UNIX since Zilog Zeus 3.20 phk@FreeBSD.ORG | TCP/IP since RFC 956 FreeBSD committer | BSD since 4.3-tahoe = Never attribute to malice what can adequately be explained by incompetence= . From owner-freebsd-stable@freebsd.org Wed Mar 1 01:01:04 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B5D50CF20BE for ; Wed, 1 Mar 2017 01:01:04 +0000 (UTC) (envelope-from prvs=02331596ec=ari@ish.com.au) Received: from fish.ish.com.au (202-161-115-54.static.tpgi.com.au [202.161.115.54]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 7D790DED for ; Wed, 1 Mar 2017 01:01:03 +0000 (UTC) (envelope-from prvs=02331596ec=ari@ish.com.au) Received: from ip-136.ish.com.au ([203.29.62.136]:52654) by fish.ish.com.au with esmtpsa (TLSv1.2:DHE-RSA-AES128-SHA:128) (Exim 4.82_1-5b7a7c0-XX) (envelope-from ) id 1cisau-0000a5-1p for freebsd-stable@freebsd.org; Wed, 01 Mar 2017 11:58:16 +1100 To: freebsd-stable From: Aristedes Maniatis Subject: CARP forcing failover Message-ID: Date: Wed, 1 Mar 2017 11:58:13 +1100 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:45.0) Gecko/20100101 Thunderbird/45.7.1 MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="FIB0n9UMiQ5g87f9oRhhxrnjCxN3q7B45" X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 01 Mar 2017 01:01:04 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --FIB0n9UMiQ5g87f9oRhhxrnjCxN3q7B45 Content-Type: multipart/mixed; boundary="dW0clSgju8NbpbR1wrbSTgcd6eJHkklb6"; protected-headers="v1" From: Aristedes Maniatis To: freebsd-stable Message-ID: Subject: CARP forcing failover --dW0clSgju8NbpbR1wrbSTgcd6eJHkklb6 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable I have a pair network gateway boxes running FreeBSD 11 and pf. Upstream r= uns VRRP to provide redundant links, one to each gateway. Internally I'm = using CARP for failover. All works well, but I find that manually failing over the link is a bit c= omplicated. In short I have this: em0: flags=3D8943 metric = 0 mtu 1500 media: Ethernet autoselect (100baseTX ) status: active carp: BACKUP vhid 1 advbase 1 advskew 50 igb0: flags=3D8943 metric= 0 mtu 1500 media: Ethernet autoselect (1000baseT ) status: active carp: BACKUP vhid 2 advbase 1 advskew 50 igb0.2: flags=3D8943 metr= ic 0 mtu 1500 status: active vlan: 2 vlanpcp: 0 parent interface: igb0 carp: BACKUP vhid 3 advbase 1 advskew 50 groups: vlan That's two internal vlans and one external network. Each interface has it= s own vhid since that's the advice I had in the past. Now, what command can I type that I could run remotely (SSH over the em0 = link) to force all the CARP addresses simultaneously to decrease the advs= kew and become MASTER. Alternatively I could run something on the MASTER = to make it BACKUP. Everything I've done so far is one command per interfa= ce which has got me in trouble before as I manage to accidentally remove = my own access to the box before I'm done. Cheers Ari please cc me. --=20 --------------------------> Aristedes Maniatis CEO, ish https://www.ish.com.au GPG fingerprint CBFB 84B4 738D 4E87 5E5C 5EFA EF6A 7D2E 3E49 102A --dW0clSgju8NbpbR1wrbSTgcd6eJHkklb6-- --FIB0n9UMiQ5g87f9oRhhxrnjCxN3q7B45 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- iEYEARECAAYFAli2HKYACgkQ72p9Lj5JECqwlQCfStZyQE4khxiIKcWy4BfJoFeg MLEAn38ykZSpXqin+25QnYuRnoOTYKQM =H//8 -----END PGP SIGNATURE----- --FIB0n9UMiQ5g87f9oRhhxrnjCxN3q7B45-- From owner-freebsd-stable@freebsd.org Wed Mar 1 01:04:29 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9E132CF2265 for ; Wed, 1 Mar 2017 01:04:29 +0000 (UTC) (envelope-from fjwcash@gmail.com) Received: from mail-qk0-x234.google.com (mail-qk0-x234.google.com [IPv6:2607:f8b0:400d:c09::234]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 5953A1B6 for ; Wed, 1 Mar 2017 01:04:29 +0000 (UTC) (envelope-from fjwcash@gmail.com) Received: by mail-qk0-x234.google.com with SMTP id n186so45706382qkb.3 for ; Tue, 28 Feb 2017 17:04:29 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=nUb3JElOAlaOk/LkpL4XvrAX9VTO2vFJN5pR8q4CGVw=; b=Z68x4QPdH2ZVrNAXH7ZS6p9Ep8ozuqWKFNNTVzMMqku+DMkAizkaeqmz2EtNpV1HRP 6iIUBVG7XMQQDdufx1ud5vBpCWsEq1MQfj+3/miqIVChY6hv4+HUGAPCOYefMpNxVmNZ ClAchsyJ90pGYsz3W+wKHujYECIfWNHX2xnp7+9mJGNtrcw70VPNEJtXkaNxYKXedCp+ 49rrYbI0lJm4zN0/L0Vnow9aq9iN1p4HUzKuPONyRHIi7mESWYaiinMW7g1AEO6LnJ4p GOgSYJu4D6V+nzQLHKaLVbb5N3Bfqvae0PB+NbWbNeuXL9xSw/OOJlAhXoqnjhK5BZ0u UDuw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=nUb3JElOAlaOk/LkpL4XvrAX9VTO2vFJN5pR8q4CGVw=; b=MloKYZlU5iTLJiO5EEZm/TOcRz6a+5JsWxfUf7XpFVyx6hI/SZRLfPiXHxSVjztf8M FHdWnNYwV1Mkkd2R7wRJc2uWG5a4gzdf7KlfG9FgqtEbKXMdGkp/4qbH6mkRelQtpZhJ GotA84WZZxxRB307KHVsQ10WuALTo9qt5TmQ+OGg85cO23HoUPRe5FxNTRvXCnyyB+FW 2pPO4Aqw6nT8GG4KwY9HtMNTQ4VTznU4gPWF7k4GG2FF3UGicfU2M+X2Eh/sD6/3rkm+ LeEP1moR3tdx2oFvPqef3PGjYFC8bWsz9IkQ9uFTZktFhiSAAPb5bWI3lXEzlq4Qgbkt 91BA== X-Gm-Message-State: AMke39nQ8++/FgUW2BhoK2ufUF0F5LHCCeBw8lKvsMyGanlDMhh72C2syKIaPhMJHUd4MCrK0Cp8b/L1d6oaWw== X-Received: by 10.237.34.59 with SMTP id n56mr6722798qtc.231.1488330268379; Tue, 28 Feb 2017 17:04:28 -0800 (PST) MIME-Version: 1.0 Received: by 10.140.28.202 with HTTP; Tue, 28 Feb 2017 17:04:27 -0800 (PST) Received: by 10.140.28.202 with HTTP; Tue, 28 Feb 2017 17:04:27 -0800 (PST) In-Reply-To: References: From: Freddie Cash Date: Tue, 28 Feb 2017 17:04:27 -0800 Message-ID: Subject: Re: CARP forcing failover To: Aristedes Maniatis Cc: FreeBSD Stable Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 01 Mar 2017 01:04:29 -0000 Do you have the preemption sysctl enabled? That will fail-over all carp interfaces when any one fails. "sysctl -a | grep carp" I'm pretty sure there's also an ifconfig command to force the state as either master or backup. Check the man page. On Feb 28, 2017 5:01 PM, "Aristedes Maniatis" wrote: > I have a pair network gateway boxes running FreeBSD 11 and pf. Upstream > runs VRRP to provide redundant links, one to each gateway. Internally I'm > using CARP for failover. > > All works well, but I find that manually failing over the link is a bit > complicated. In short I have this: > > em0: flags=8943 metric 0 > mtu 1500 > media: Ethernet autoselect (100baseTX ) > status: active > carp: BACKUP vhid 1 advbase 1 advskew 50 > igb0: flags=8943 metric 0 > mtu 1500 > media: Ethernet autoselect (1000baseT ) > status: active > carp: BACKUP vhid 2 advbase 1 advskew 50 > igb0.2: flags=8943 metric > 0 mtu 1500 > status: active > vlan: 2 vlanpcp: 0 parent interface: igb0 > carp: BACKUP vhid 3 advbase 1 advskew 50 > groups: vlan > > That's two internal vlans and one external network. Each interface has its > own vhid since that's the advice I had in the past. > > Now, what command can I type that I could run remotely (SSH over the em0 > link) to force all the CARP addresses simultaneously to decrease the > advskew and become MASTER. Alternatively I could run something on the > MASTER to make it BACKUP. Everything I've done so far is one command per > interface which has got me in trouble before as I manage to accidentally > remove my own access to the box before I'm done. > > Cheers > Ari > > please cc me. > > -- > --------------------------> > Aristedes Maniatis > CEO, ish > https://www.ish.com.au > GPG fingerprint CBFB 84B4 738D 4E87 5E5C 5EFA EF6A 7D2E 3E49 102A > > From owner-freebsd-stable@freebsd.org Wed Mar 1 01:10:10 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id F2887CF2412 for ; Wed, 1 Mar 2017 01:10:10 +0000 (UTC) (envelope-from prvs=02331596ec=ari@ish.com.au) Received: from fish.ish.com.au (202-161-115-54.static.tpgi.com.au [202.161.115.54]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id B29B23C6 for ; Wed, 1 Mar 2017 01:10:10 +0000 (UTC) (envelope-from prvs=02331596ec=ari@ish.com.au) Received: from ip-136.ish.com.au ([203.29.62.136]:52865) by fish.ish.com.au with esmtpsa (TLSv1.2:DHE-RSA-AES128-SHA:128) (Exim 4.82_1-5b7a7c0-XX) (envelope-from ) id 1cismM-0001nB-2X; Wed, 01 Mar 2017 12:10:06 +1100 Subject: Re: CARP forcing failover To: Freddie Cash References: Cc: FreeBSD Stable From: Aristedes Maniatis Message-ID: <513164a2-1a73-dd03-2feb-43fa53dd1b88@ish.com.au> Date: Wed, 1 Mar 2017 12:10:04 +1100 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:45.0) Gecko/20100101 Thunderbird/45.7.1 MIME-Version: 1.0 In-Reply-To: Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="30db6BTRCR2timlbPCMmLXdDqn24lwTnu" X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 01 Mar 2017 01:10:11 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --30db6BTRCR2timlbPCMmLXdDqn24lwTnu Content-Type: multipart/mixed; boundary="0PxOqHSkE9frGv67TISx5FN20CXFL64eF"; protected-headers="v1" From: Aristedes Maniatis To: Freddie Cash Cc: FreeBSD Stable Message-ID: <513164a2-1a73-dd03-2feb-43fa53dd1b88@ish.com.au> Subject: Re: CARP forcing failover References: In-Reply-To: --0PxOqHSkE9frGv67TISx5FN20CXFL64eF Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Yes, the automatic failover is great and works perfectly to bring all int= erfaces over at once. But to manually force a failover I need to change t= he advskew one interface at a time with ifconfig. Ari On 1/3/17 12:04pm, Freddie Cash wrote: > Do you have the preemption sysctl enabled? That will fail-over all carp= interfaces when any one fails. >=20 > "sysctl -a | grep carp" >=20 > I'm pretty sure there's also an ifconfig command to force the state as = either master or backup. Check the man page. >=20 >=20 > On Feb 28, 2017 5:01 PM, "Aristedes Maniatis" > wrote: >=20 > I have a pair network gateway boxes running FreeBSD 11 and pf. Upst= ream runs VRRP to provide redundant links, one to each gateway. Internall= y I'm using CARP for failover. >=20 > All works well, but I find that manually failing over the link is a= bit complicated. In short I have this: >=20 > em0: flags=3D8943 m= etric 0 mtu 1500 > media: Ethernet autoselect (100baseTX ) > status: active > carp: BACKUP vhid 1 advbase 1 advskew 50 > igb0: flags=3D8943 = metric 0 mtu 1500 > media: Ethernet autoselect (1000baseT ) > status: active > carp: BACKUP vhid 2 advbase 1 advskew 50 > igb0.2: flags=3D8943 metric 0 mtu 1500 > status: active > vlan: 2 vlanpcp: 0 parent interface: igb0 > carp: BACKUP vhid 3 advbase 1 advskew 50 > groups: vlan >=20 > That's two internal vlans and one external network. Each interface = has its own vhid since that's the advice I had in the past. >=20 > Now, what command can I type that I could run remotely (SSH over th= e em0 link) to force all the CARP addresses simultaneously to decrease th= e advskew and become MASTER. Alternatively I could run something on the M= ASTER to make it BACKUP. Everything I've done so far is one command per i= nterface which has got me in trouble before as I manage to accidentally r= emove my own access to the box before I'm done. >=20 > Cheers > Ari >=20 > please cc me. >=20 > -- > --------------------------> > Aristedes Maniatis > CEO, ish > https://www.ish.com.au > GPG fingerprint CBFB 84B4 738D 4E87 5E5C 5EFA EF6A 7D2E 3E49 102A >=20 --=20 --------------------------> Aristedes Maniatis CEO, ish https://www.ish.com.au GPG fingerprint CBFB 84B4 738D 4E87 5E5C 5EFA EF6A 7D2E 3E49 102A --0PxOqHSkE9frGv67TISx5FN20CXFL64eF-- --30db6BTRCR2timlbPCMmLXdDqn24lwTnu Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- iEYEARECAAYFAli2H2wACgkQ72p9Lj5JECrr2wCfbqmLQZFi/hcTMX2fkXlParBZ FLYAniJVcrF4WhCYHSyPE8wiXW00Atti =Im+c -----END PGP SIGNATURE----- --30db6BTRCR2timlbPCMmLXdDqn24lwTnu-- From owner-freebsd-stable@freebsd.org Wed Mar 1 01:22:46 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D6A84CF2A1B for ; Wed, 1 Mar 2017 01:22:46 +0000 (UTC) (envelope-from allbery.b@gmail.com) Received: from mail-oi0-x231.google.com (mail-oi0-x231.google.com [IPv6:2607:f8b0:4003:c06::231]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id A0663FF4 for ; Wed, 1 Mar 2017 01:22:46 +0000 (UTC) (envelope-from allbery.b@gmail.com) Received: by mail-oi0-x231.google.com with SMTP id 62so15202284oih.2 for ; Tue, 28 Feb 2017 17:22:46 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=j0NKW/i96Sm/AaNDGQ0DfPAJQ0fca4/RZ6eBM0EfKVw=; b=cQfqSYCXqWc+Au3IbjjSvEps20+g0U+7VY1pyA7i8XldZeA+Lu3cKPePbarAawyUYA OJIu4YwShXz1Q8yw04rQI4KgUbOOpP4yRxXqQv6phTmAew3UgtPz6ghl7F1GGSWis0UK jdZDHa3EOCfdbDO8gh9rVv60s9dPRvhlwjFa2OzqV4Qkxlk8f+X1S45k6HK88+I0+oH3 nwdC5imEW9u+gKgQ/jm7dN2ap86TbvyTPwc5F3sNH5/dISSQq4V1ZHCDnXapdCZ8shdL qFk6batdCVD7o5PzTK9aNflnvrXgLcLoXm/wfrdgohDjzxIiWdNhzCUvejcs33RYmxJr ccWQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=j0NKW/i96Sm/AaNDGQ0DfPAJQ0fca4/RZ6eBM0EfKVw=; b=SkripGxhLCQRpD+ws1Fp1IWmrH3imXLJyg4viOcztyet8YC2rKGhNQ3GIEAXAA6GVO rp44GnqkI8Ai7TVdo/rIW8+RYXk4iPDkmxt3Bvq26mbyri10Wn7ys7zLBlGwmIuL+UYE RKvp1G05YMsGJvACubHvva5AqNRJmG/aukEiJtl4D9IL+fI84hHS7YBr55GVPEsZtEk7 zhXscKwd3HBoGHDAuyy46hyZ6N82nBd7bezY98OIZJxH4RiiwGNoG3NirY6hKfioIrlh +aSSl5jZnm9ophAMTXXVrIJKN3sXoh4ac4FjIHuyaqghz/9uUS/lzJNaAOaWcWep1huI Nz4A== X-Gm-Message-State: AMke39lMr9fS+oeNHZ1im7tFPDhkw7DcSLjoEat45tUjt1p96f6ZwxeXX5JV/NSyvJuLuRcnxVaa8G8I+ViFFg== X-Received: by 10.202.58.69 with SMTP id h66mr2580131oia.30.1488331365826; Tue, 28 Feb 2017 17:22:45 -0800 (PST) MIME-Version: 1.0 Received: by 10.74.83.196 with HTTP; Tue, 28 Feb 2017 17:22:45 -0800 (PST) In-Reply-To: References: From: Brandon Allbery Date: Tue, 28 Feb 2017 20:22:45 -0500 Message-ID: Subject: Re: CARP forcing failover To: Aristedes Maniatis Cc: freebsd-stable Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 01 Mar 2017 01:22:46 -0000 On Tue, Feb 28, 2017 at 7:58 PM, Aristedes Maniatis wrote: > Now, what command can I type that I could run remotely (SSH over the em0 > link) The first thing you might want to look at is screen / tmux. -- brandon s allbery kf8nh sine nomine associates allbery.b@gmail.com ballbery@sinenomine.net unix, openafs, kerberos, infrastructure, xmonad http://sinenomine.net From owner-freebsd-stable@freebsd.org Wed Mar 1 03:31:58 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0971CCF26C5 for ; Wed, 1 Mar 2017 03:31:58 +0000 (UTC) (envelope-from fjwcash@gmail.com) Received: from mail-qk0-x22b.google.com (mail-qk0-x22b.google.com [IPv6:2607:f8b0:400d:c09::22b]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id B32BFC50 for ; Wed, 1 Mar 2017 03:31:57 +0000 (UTC) (envelope-from fjwcash@gmail.com) Received: by mail-qk0-x22b.google.com with SMTP id n127so51059716qkf.0 for ; Tue, 28 Feb 2017 19:31:57 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=QMbSCk98QEZXqGPSJ/c981+bOra5+AdtLLGd0jlsD2A=; b=VCaPIZE+rcq8tXF0KwuJR3r9cN1alvPSwV/d2QIU81WcQZr9K3esNW76G86HQ2FJse axpg1Yh9+X8nb44Om+eflMc5MGp8rYJ4vzjlCCVpFw/6fr+0d2fPWwBr4WHbWajW3T4Y 9kY7QvcoYsuY8mGjfoEuT28hOUzL9B/j76cXpQ4DDDUferteqjHLZEs0QI7KU/IKxReL t6e0ZEcShtXS55HWjYbtTdPWC/6ncrWa3fqBTTR0USQ6IllOG7bQRF4jmzZEYfXYC6gU c2rHTOF93q/vyH019vK83JFMi6aKBMGKbxAt+ifn7p3g6QM5ApPmkVrlo4H+MT5W1rz0 figQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=QMbSCk98QEZXqGPSJ/c981+bOra5+AdtLLGd0jlsD2A=; b=FaTCGCPdxyNMyjqHOyEKT4O461qJDtpYFRgHRqHxmCdFur/Fz+YDgK3+DEbuv63Fvf NtbzUIwtXOZo13FJZWUCzSrmuY9GlWRK6o/JzD5vsukQuoiLDtfQyBhsn/YRoP6DYOUH ZvZ9b3GylLulkGpaO5lTgiVJf1PSGGsRAz9R2/75649NCGI5Xij1cEZgDskdCgweKAfE 22GKhV0StMXBUGp0vNt5KWWby3f9YVDxgnKxyesg1ep9Yc5xiD7lFWJ6BlFDkTUiWobc TiGCs5kDMRhp+hq5ZfrrNA19xQ+7zBxqwMfnCyaS1405FVH7GM68Izq0oDMz33CV3QY4 b6EA== X-Gm-Message-State: AMke39lNRNoZxlHZWTrXcjlqzOIQJZ7t7EaiA9h5UuP1d57e9lcKSVKkzRqgJgWf/4vzkr+uVcA5vSTvooevZg== X-Received: by 10.237.59.194 with SMTP id s2mr6862964qte.199.1488339116865; Tue, 28 Feb 2017 19:31:56 -0800 (PST) MIME-Version: 1.0 Received: by 10.140.28.202 with HTTP; Tue, 28 Feb 2017 19:31:56 -0800 (PST) Received: by 10.140.28.202 with HTTP; Tue, 28 Feb 2017 19:31:56 -0800 (PST) In-Reply-To: <513164a2-1a73-dd03-2feb-43fa53dd1b88@ish.com.au> References: <513164a2-1a73-dd03-2feb-43fa53dd1b88@ish.com.au> From: Freddie Cash Date: Tue, 28 Feb 2017 19:31:56 -0800 Message-ID: Subject: Re: CARP forcing failover To: Aristedes Maniatis Cc: FreeBSD Stable Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 01 Mar 2017 03:31:58 -0000 Doesn't "ifconfig vhid XX state master" do what you want? It forces that vhid over to master, which should preempt the other interfaces to switch as well. One command. On Feb 28, 2017 5:10 PM, "Aristedes Maniatis" wrote: > Yes, the automatic failover is great and works perfectly to bring all > interfaces over at once. But to manually force a failover I need to change > the advskew one interface at a time with ifconfig. > > Ari > > > On 1/3/17 12:04pm, Freddie Cash wrote: > > Do you have the preemption sysctl enabled? That will fail-over all carp > interfaces when any one fails. > > > > "sysctl -a | grep carp" > > > > I'm pretty sure there's also an ifconfig command to force the state as > either master or backup. Check the man page. > > > > > > On Feb 28, 2017 5:01 PM, "Aristedes Maniatis" ari@ish.com.au>> wrote: > > > > I have a pair network gateway boxes running FreeBSD 11 and pf. > Upstream runs VRRP to provide redundant links, one to each gateway. > Internally I'm using CARP for failover. > > > > All works well, but I find that manually failing over the link is a > bit complicated. In short I have this: > > > > em0: flags=8943 > metric 0 mtu 1500 > > media: Ethernet autoselect (100baseTX ) > > status: active > > carp: BACKUP vhid 1 advbase 1 advskew 50 > > igb0: flags=8943 > metric 0 mtu 1500 > > media: Ethernet autoselect (1000baseT ) > > status: active > > carp: BACKUP vhid 2 advbase 1 advskew 50 > > igb0.2: flags=8943 > metric 0 mtu 1500 > > status: active > > vlan: 2 vlanpcp: 0 parent interface: igb0 > > carp: BACKUP vhid 3 advbase 1 advskew 50 > > groups: vlan > > > > That's two internal vlans and one external network. Each interface > has its own vhid since that's the advice I had in the past. > > > > Now, what command can I type that I could run remotely (SSH over the > em0 link) to force all the CARP addresses simultaneously to decrease the > advskew and become MASTER. Alternatively I could run something on the > MASTER to make it BACKUP. Everything I've done so far is one command per > interface which has got me in trouble before as I manage to accidentally > remove my own access to the box before I'm done. > > > > Cheers > > Ari > > > > please cc me. > > > > -- > > --------------------------> > > Aristedes Maniatis > > CEO, ish > > https://www.ish.com.au > > GPG fingerprint CBFB 84B4 738D 4E87 5E5C 5EFA EF6A 7D2E 3E49 102A > > > > -- > --------------------------> > Aristedes Maniatis > CEO, ish > https://www.ish.com.au > GPG fingerprint CBFB 84B4 738D 4E87 5E5C 5EFA EF6A 7D2E 3E49 102A > > From owner-freebsd-stable@freebsd.org Wed Mar 1 04:56:15 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5C144CF28AE for ; Wed, 1 Mar 2017 04:56:15 +0000 (UTC) (envelope-from prvs=02331596ec=ari@ish.com.au) Received: from fish.ish.com.au (202-161-115-54.static.tpgi.com.au [202.161.115.54]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 1D0D885B for ; Wed, 1 Mar 2017 04:56:13 +0000 (UTC) (envelope-from prvs=02331596ec=ari@ish.com.au) Received: from ip-136.ish.com.au ([203.29.62.136]:56819) by fish.ish.com.au with esmtpsa (TLSv1.2:DHE-RSA-AES128-SHA:128) (Exim 4.82_1-5b7a7c0-XX) (envelope-from ) id 1ciwIy-0002sn-2q; Wed, 01 Mar 2017 15:56:00 +1100 Subject: Re: CARP forcing failover To: Freddie Cash References: <513164a2-1a73-dd03-2feb-43fa53dd1b88@ish.com.au> Cc: FreeBSD Stable From: Aristedes Maniatis Message-ID: <2b6ecb94-b53f-5ae8-a842-d897e515380a@ish.com.au> Date: Wed, 1 Mar 2017 15:55:58 +1100 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:45.0) Gecko/20100101 Thunderbird/45.7.1 MIME-Version: 1.0 In-Reply-To: Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="mnQNRbMOpGkAVsBtt2HpNC2qpUABvUftP" X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 01 Mar 2017 04:56:15 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --mnQNRbMOpGkAVsBtt2HpNC2qpUABvUftP Content-Type: multipart/mixed; boundary="ktHoKe7r23f2DIFHn3I9JgNsPnG3lk8fO"; protected-headers="v1" From: Aristedes Maniatis To: Freddie Cash Cc: FreeBSD Stable Message-ID: <2b6ecb94-b53f-5ae8-a842-d897e515380a@ish.com.au> Subject: Re: CARP forcing failover References: <513164a2-1a73-dd03-2feb-43fa53dd1b88@ish.com.au> In-Reply-To: --ktHoKe7r23f2DIFHn3I9JgNsPnG3lk8fO Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable My experience is that it doesn't cause them all the failover, even though= an interface going down does cause them all to failover with the pre-emp= tion feature enabled. Ari On 1/3/17 2:31pm, Freddie Cash wrote: > Doesn't "ifconfig vhid XX state master" do what you want? It forces tha= t vhid over to master, which should preempt the other interfaces to switc= h as well. >=20 > One command. >=20 > On Feb 28, 2017 5:10 PM, "Aristedes Maniatis" > wrote: >=20 > Yes, the automatic failover is great and works perfectly to bring a= ll interfaces over at once. But to manually force a failover I need to ch= ange the advskew one interface at a time with ifconfig. >=20 > Ari >=20 >=20 > On 1/3/17 12:04pm, Freddie Cash wrote: > > Do you have the preemption sysctl enabled? That will fail-over al= l carp interfaces when any one fails. > > > > "sysctl -a | grep carp" > > > > I'm pretty sure there's also an ifconfig command to force the sta= te as either master or backup. Check the man page. > > > > > > On Feb 28, 2017 5:01 PM, "Aristedes Maniatis" >> wro= te: > > > > I have a pair network gateway boxes running FreeBSD 11 and pf= =2E Upstream runs VRRP to provide redundant links, one to each gateway. I= nternally I'm using CARP for failover. > > > > All works well, but I find that manually failing over the lin= k is a bit complicated. In short I have this: > > > > em0: flags=3D8943 metric 0 mtu 1500 > > media: Ethernet autoselect (100baseTX ) > > status: active > > carp: BACKUP vhid 1 advbase 1 advskew 50 > > igb0: flags=3D8943 metric 0 mtu 1500 > > media: Ethernet autoselect (1000baseT ) > > status: active > > carp: BACKUP vhid 2 advbase 1 advskew 50 > > igb0.2: flags=3D8943 metric 0 mtu 1500 > > status: active > > vlan: 2 vlanpcp: 0 parent interface: igb0 > > carp: BACKUP vhid 3 advbase 1 advskew 50 > > groups: vlan > > > > That's two internal vlans and one external network. Each inte= rface has its own vhid since that's the advice I had in the past. > > > > Now, what command can I type that I could run remotely (SSH o= ver the em0 link) to force all the CARP addresses simultaneously to decre= ase the advskew and become MASTER. Alternatively I could run something on= the MASTER to make it BACKUP. Everything I've done so far is one command= per interface which has got me in trouble before as I manage to accident= ally remove my own access to the box before I'm done. > > > > Cheers > > Ari > > > > please cc me. > > > > -- > > --------------------------> > > Aristedes Maniatis > > CEO, ish > > https://www.ish.com.au > > GPG fingerprint CBFB 84B4 738D 4E87 5E5C 5EFA EF6A 7D2E 3E49= 102A > > >=20 > -- > --------------------------> > Aristedes Maniatis > CEO, ish > https://www.ish.com.au > GPG fingerprint CBFB 84B4 738D 4E87 5E5C 5EFA EF6A 7D2E 3E49 102A >=20 --=20 --------------------------> Aristedes Maniatis CEO, ish https://www.ish.com.au GPG fingerprint CBFB 84B4 738D 4E87 5E5C 5EFA EF6A 7D2E 3E49 102A --ktHoKe7r23f2DIFHn3I9JgNsPnG3lk8fO-- --mnQNRbMOpGkAVsBtt2HpNC2qpUABvUftP Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- iEYEARECAAYFAli2VF4ACgkQ72p9Lj5JECq1xQCeKywT8lsslD1vozTVdt6/lSO4 B7sAn15uG5+XPoSm3waLCvNBjfp50Rw0 =1u+s -----END PGP SIGNATURE----- --mnQNRbMOpGkAVsBtt2HpNC2qpUABvUftP-- From owner-freebsd-stable@freebsd.org Wed Mar 1 10:33:41 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 130FBCF34FC for ; Wed, 1 Mar 2017 10:33:41 +0000 (UTC) (envelope-from markus.gebert@hostpoint.ch) Received: from mail.adm.hostpoint.ch (mail.adm.hostpoint.ch [IPv6:2a00:d70:0:a::e0]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id D0A7F5E7 for ; Wed, 1 Mar 2017 10:33:40 +0000 (UTC) (envelope-from markus.gebert@hostpoint.ch) Received: from [2001:1620:2013:1:507a:7fc7:24af:e9e7] (port=56785) by mail.adm.hostpoint.ch with esmtpsa (TLSv1.2:ECDHE-RSA-AES256-GCM-SHA384:256) (Exim 4.88 (FreeBSD)) (envelope-from ) id 1cj1Zf-000M7y-T3; Wed, 01 Mar 2017 11:33:35 +0100 Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 10.2 \(3259\)) Subject: Re: CARP forcing failover From: Markus Gebert In-Reply-To: Date: Wed, 1 Mar 2017 11:33:33 +0100 Cc: freebsd-stable Content-Transfer-Encoding: quoted-printable Message-Id: References: To: Aristedes Maniatis X-Mailer: Apple Mail (2.3259) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 01 Mar 2017 10:33:41 -0000 > On 1 Mar 2017, at 01:58, Aristedes Maniatis wrote: >=20 > I have a pair network gateway boxes running FreeBSD 11 and pf. = Upstream runs VRRP to provide redundant links, one to each gateway. = Internally I'm using CARP for failover. >=20 > All works well, but I find that manually failing over the link is a = bit complicated. In short I have this: >=20 > em0: flags=3D8943 = metric 0 mtu 1500 > media: Ethernet autoselect (100baseTX ) > status: active > carp: BACKUP vhid 1 advbase 1 advskew 50 > igb0: flags=3D8943 = metric 0 mtu 1500 > media: Ethernet autoselect (1000baseT ) > status: active > carp: BACKUP vhid 2 advbase 1 advskew 50 > igb0.2: flags=3D8943 = metric 0 mtu 1500 > status: active > vlan: 2 vlanpcp: 0 parent interface: igb0 > carp: BACKUP vhid 3 advbase 1 advskew 50 > groups: vlan >=20 > That's two internal vlans and one external network. Each interface has = its own vhid since that's the advice I had in the past. >=20 > Now, what command can I type that I could run remotely (SSH over the = em0 link) to force all the CARP addresses simultaneously to decrease the = advskew and become MASTER. Alternatively I could run something on the = MASTER to make it BACKUP. Everything I've done so far is one command per = interface which has got me in trouble before as I manage to accidentally = remove my own access to the box before I'm done. You may look into this sysctl: # sysctl -d net.inet.carp.demotion net.inet.carp.demotion: Adjust demotion factor (skew of advskew) Its value gets changed automatically if some event occurs (look into = net.inet.carp.ifdown_demotion_factor, = net.inet.carp.senderr_demotion_factor, net.pfsync.carp_demotion_factor), = but you may also control it manually. A positive value value will = increase the advskew of _all_ CARP announcements (on the wire, not = visible with ifconfig IIRC) and therefore reduce the priority of the = node. A negative value will of course do the opposite. Like this you can = raise/lower the advskew above/below the other node and trigger a = failover. net.inet.carp.preempt must be 1 on both nodes for this to have = an immediate effect. Beware that net.inet.carp.demotion expects _relative_ values when = altered through the sysctl interface. So 'sysctl = net.inet.carp.demotion=3D100' will increase its current value by 100 and = 'sysctl net.inet.carp.demotion=3D-100' will decrease its current value = by 100. Markus From owner-freebsd-stable@freebsd.org Wed Mar 1 11:37:02 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 49571CF358B for ; Wed, 1 Mar 2017 11:37:02 +0000 (UTC) (envelope-from joh.hendriks@gmail.com) Received: from mail-wm0-x232.google.com (mail-wm0-x232.google.com [IPv6:2a00:1450:400c:c09::232]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id DCD47FF6 for ; Wed, 1 Mar 2017 11:37:01 +0000 (UTC) (envelope-from joh.hendriks@gmail.com) Received: by mail-wm0-x232.google.com with SMTP id v77so33801155wmv.0 for ; Wed, 01 Mar 2017 03:37:01 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=to:from:subject:message-id:date:user-agent:mime-version :content-transfer-encoding; bh=cBheEZof3AGmYUtURqVHDWA27q8vtDsHG6Nzywr90D0=; b=bxz61Hhr9mwCI8tZ9NQC2XzvUFZzfzppCj23+R5lXNd1DrGawp/1dsiBHkS5+Bn92N JbDMQqCPS/bKfQ/XeV5ABM7fnP5QqjtxlndynnZaATXSy6zbQLBjqTotZw721XLB8R2h yjn/qeXz5i8RX7fBJvJZZ/7oPd6LAgXt2fa3WIgqCD5wzyvY8dnhoJGWIUVmR+Ci0z2w g8qW1wweXOEd+VEBaDO0smtsxecdGkeQ7sTKuqjY2h2m//1TpnP+GNYcKTweV+DrBa3z 4z7kAoB7I+K+KSfC+fUjzw8VtsWSPsAsRnTDdal4c8qHqk5rEvUwnYS2dMNpKceFbLgB Ebzw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:to:from:subject:message-id:date:user-agent :mime-version:content-transfer-encoding; bh=cBheEZof3AGmYUtURqVHDWA27q8vtDsHG6Nzywr90D0=; b=Iamu7T0YYlbgIlEndrEyQ2vkxqVTPkf3HCuhOQK0moGngtUro0ZrjHYEIY2Y3L7xbD XHgNF6zzOd4AA+dcxNM0igPrBJb9YOnti6Gf/wt4mMzLelJ2FYpahooz9ZfmxNQx9/mc fJYUZGLErtWWZ8GrlwtbnbeiXnD1n8hJlCjVrSPB/kPrB2iIHgE71ARySK/1OM+/phw8 fv3/ZsOJuIBs4fuir+DmNdbYuaUgkhgQP2XZs50FnT9lc+fEgrGVjVK18lK0aOXBDPyT ps/k1H9SBHYhQdT6nfBHUKolBxBqFEnrf8j/rL8dIpc9pjSlRbugEAt7phKWxF/fkMiz HBjg== X-Gm-Message-State: AMke39lvlFcDg2i6J0GvmAy4961F4wEiaxYNdQvmQUcTj84khR/dd6VaTmUGvXGzu6XG/g== X-Received: by 10.28.195.197 with SMTP id t188mr651323wmf.61.1488368218000; Wed, 01 Mar 2017 03:36:58 -0800 (PST) Received: from Johans-MacBook-Air-2.local (92-111-79-242.static.chello.nl. [92.111.79.242]) by smtp.googlemail.com with ESMTPSA id b58sm6274255wra.47.2017.03.01.03.36.56 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Wed, 01 Mar 2017 03:36:56 -0800 (PST) To: freebsd-stable From: Johan Hendriks Subject: ZFS: vdev state changed Message-ID: Date: Wed, 1 Mar 2017 12:36:55 +0100 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:45.0) Gecko/20100101 Thunderbird/45.7.1 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 01 Mar 2017 11:37:02 -0000 Hello all, I have a supermicro server with 6 2TB disk in a raidz2. The board is a X10SRH-CLN4F with the onboard controller in IT mode. a LSI SAS 3008 When I run a scrub I see the following in my /var/log/messages. Feb 28 14:38:43 storage ZFS: vdev state changed, pool_guid=11524425987729653385 vdev_guid=5999117663424576930 Feb 28 14:38:43 storage ZFS: vdev state changed, pool_guid=11524425987729653385 vdev_guid=16120005883624137112 Feb 28 14:38:43 storage ZFS: vdev state changed, pool_guid=11524425987729653385 vdev_guid=13065484892788124863 Feb 28 14:38:43 storage ZFS: vdev state changed, pool_guid=11524425987729653385 vdev_guid=2891285306045195488 Feb 28 14:38:44 storage ZFS: vdev state changed, pool_guid=11524425987729653385 vdev_guid=14130839665489078743 Feb 28 14:38:44 storage ZFS: vdev state changed, pool_guid=11524425987729653385 vdev_guid=5801351408685715658 I do not see this on other machines. Also everything looks normal and the scrub runs fine. Can I found out what is causing this? regards Johan From owner-freebsd-stable@freebsd.org Wed Mar 1 14:07:03 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DA31ECEE7D6 for ; Wed, 1 Mar 2017 14:07:03 +0000 (UTC) (envelope-from lutz@donnerhacke.de) Received: from annwfn.iks-jena.de (annwfn-eth.iks-jena.de [IPv6:2001:4bd8:0:104:20a:e4ff:fe80:3138]) (using TLSv1 with cipher AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 7D5A9AA3 for ; Wed, 1 Mar 2017 14:07:03 +0000 (UTC) (envelope-from lutz@donnerhacke.de) X-SMTP-Sender: IPv6:2001:4bd8:59:1:172:27:107:102 Received: from lyoness (lyoness.intern.iks-service.de [IPv6:2001:4bd8:59:1:172:27:107:102]) by annwfn.iks-jena.de (8.14.9/8.14.1) with ESMTP id v21E6kbx028481; Wed, 1 Mar 2017 15:06:50 +0100 From: "Lutz Donnerhacke" To: Cc: Subject: Re: CARP forcing failover Date: Wed, 1 Mar 2017 15:06:46 +0100 Message-ID: <000001d29295$1260ec90$3722c5b0$@donnerhacke.de> MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable X-Mailer: Microsoft Outlook 15.0 Thread-Index: AdKSlQ8et6UbuWEtQV28Tzu40YmLJg== Content-Language: de X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 01 Mar 2017 14:07:03 -0000 > igb0.2: flags=3D8943 = metric 0 mtu 1500 > status: active > vlan: 2 vlanpcp: 0 parent interface: igb0 > carp: BACKUP vhid 3 advbase 1 advskew 50 > groups: vlan >=20 > That's two internal vlans and one external network. Each interface has = its > own vhid since that's the advice I had in the past. >=20 > Now, what command can I type that I could run remotely (SSH over the = em0 > link) to force all the CARP addresses simultaneously to decrease the = advskew > and become MASTER. Alternatively I could run something on the MASTER = to make > it BACKUP. Everything I've done so far is one command per interface = which has > got me in trouble before as I manage to accidentally remove my own = access to > the box before I'm done. You have to provide the correct subset of the parameters to change the = behaviour without changing the other properties. # ifconfig igb0.2 vhid 3 advbase 1 advskew 250 pass 'xxxx' This will change the parameters for the vhid 3 on the interface igb0.2 = only. But the change will cover *all* vhid parameters, so if you left some = off, they will vanish. Of course, you are free to use multiple IPs per interface using the = "alias" option. It does work even for carp instances. VHIDs needs to be unique per layer2 segment, because they are used as = selectors for the kernel code to validate the CARP packet. Please note, that VRRP/HSRP/GLBP may use the same packet format as CARP, = so their VHIDs should be different from yours. From owner-freebsd-stable@freebsd.org Wed Mar 1 19:56:44 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D582ECF3A37 for ; Wed, 1 Mar 2017 19:56:44 +0000 (UTC) (envelope-from Terence.Telkamp@dell.com) Received: from esa6.dell-outbound.iphmx.com (esa6.dell-outbound.iphmx.com [68.232.149.229]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.dell-outbound.iphmx.com", Issuer "Go Daddy Secure Certificate Authority - G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id AEEE4357 for ; Wed, 1 Mar 2017 19:56:44 +0000 (UTC) (envelope-from Terence.Telkamp@dell.com) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=dell.com; i=@dell.com; q=dns/txt; s=smtpout; t=1488398204; x=1519934204; h=from:to:subject:date:message-id: content-transfer-encoding:mime-version; bh=yMxVj/8OQYU5SwfyqMfGDu8iEirHrw/QfcTtSfTrCqU=; b=dpajoLnPRTPjeufAIUH5stTWIDWLFJKfX40xUwYO7bYoIHXzTi+KV+et m6NZQngxeHDe32WiWk/kg24cNaBjeDx1n3RqfgMwOtTZVqpxd6iVbjoo1 G4MFnnnIlNijKLZMHPX7pXKIcqfbbtAC9jLaeFUbf1mS2fbrw8SuHx/uf Y=; Received: from esa3.dell-outbound2.iphmx.com ([68.232.154.63]) by esa6.dell-outbound.iphmx.com with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 01 Mar 2017 13:55:35 -0600 From: Received: from ausxipps306.us.dell.com ([143.166.148.156]) by esa3.dell-outbound2.iphmx.com with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 02 Mar 2017 01:51:22 +0600 X-LoopCount0: from 10.175.216.249 X-IronPort-AV: E=Sophos;i="5.35,227,1484028000"; d="scan'208";a="83110517" To: Subject: Updating from 10.2 to 11.0 fails integrity check Thread-Topic: Updating from 10.2 to 11.0 fails integrity check Thread-Index: AQHSksXJbmyvGEMvXkSkMJxO30f8Eg== Date: Wed, 1 Mar 2017 19:55:33 +0000 Message-ID: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-exchange-transport-fromentityheader: Hosted x-originating-ip: [10.156.103.254] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 01 Mar 2017 19:56:44 -0000 Hi, I'm trying to update from 10.20 to 11.0 and am failing: $ sudo freebsd-update -r 11.0-RELEASE upgrade Looking up update.FreeBSD.org mirrors... 4 mirrors found. Fetching metadata signature for 10.2-RELEASE from update6.freebsd.org... do= ne. Fetching metadata index... done. Inspecting system... done. The following components of FreeBSD seem to be installed: kernel/generic src/src world/base world/games world/lib32 The following components of FreeBSD do not seem to be installed: world/doc Does this look reasonable (y/n)? y Fetching metadata signature for 11.0-RELEASE from update6.freebsd.org... do= ne. Fetching metadata index... done. The update metadata is correctly signed, but failed an integrity check. Cowardly refusing to proceed any further. Can any one give me some ideas as to why the integrity check is failing?= From owner-freebsd-stable@freebsd.org Wed Mar 1 20:01:04 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id CBF7CCF3C11 for ; Wed, 1 Mar 2017 20:01:04 +0000 (UTC) (envelope-from lists@opsec.eu) Received: from home.opsec.eu (home.opsec.eu [IPv6:2001:14f8:200::1]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 90D8E90B for ; Wed, 1 Mar 2017 20:01:04 +0000 (UTC) (envelope-from lists@opsec.eu) Received: from pi by home.opsec.eu with local (Exim 4.87 (FreeBSD)) (envelope-from ) id 1cjAQs-000M8j-6C; Wed, 01 Mar 2017 21:01:06 +0100 Date: Wed, 1 Mar 2017 21:01:06 +0100 From: Kurt Jaeger To: Terence.Telkamp@dell.com Cc: freebsd-stable@freebsd.org Subject: Re: Updating from 10.2 to 11.0 fails integrity check Message-ID: <20170301200106.GB13006@home.opsec.eu> References: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 01 Mar 2017 20:01:04 -0000 Hi! > I'm trying to update from 10.20 to 11.0 and am failing: > > $ sudo freebsd-update -r 11.0-RELEASE upgrade > Looking up update.FreeBSD.org mirrors... 4 mirrors found. > Fetching metadata signature for 10.2-RELEASE from update6.freebsd.org... done. > Fetching metadata index... done. > Inspecting system... done. > > The following components of FreeBSD seem to be installed: > kernel/generic src/src world/base world/games world/lib32 > > The following components of FreeBSD do not seem to be installed: > world/doc > > Does this look reasonable (y/n)? y > > Fetching metadata signature for 11.0-RELEASE from update6.freebsd.org... done. > Fetching metadata index... done. > > The update metadata is correctly signed, but > failed an integrity check. > Cowardly refusing to proceed any further. > > > Can any one give me some ideas as to why the integrity check is failing? Please update to 10.2p first. It provides a new freebsd-update which correctly calculates some metadata for you to update to 11.0 after that. -- pi@opsec.eu +49 171 3101372 3 years to go ! From owner-freebsd-stable@freebsd.org Thu Mar 2 21:21:43 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 78877CF500D for ; Thu, 2 Mar 2017 21:21:43 +0000 (UTC) (envelope-from megan.wilson@digitalhubcentre.com) Received: from IND01-MA1-obe.outbound.protection.outlook.com (mail-ma1ind01on0136.outbound.protection.outlook.com [104.47.100.136]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "Microsoft IT SSL SHA2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 9D322D89 for ; Thu, 2 Mar 2017 21:21:41 +0000 (UTC) (envelope-from megan.wilson@digitalhubcentre.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=NETORGFT2188519.onmicrosoft.com; s=selector1-digitalhubcentre-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=OJ39c1/QZgI/PaykeQoymcpa0yxhblGz/fZNOoJvP3w=; b=FrpH4HRcj4NhLEOq1VD/5Cpw7C7WWrL6J8vs3KrgiVg9f9TDGgW69m3PtjwNyCsqhqPHil3JYz5voLjBcaSe+IVYu1l9SRgFGFpokNjaF1Tg8Jtf8xjln/nMikLLtkEH1W9vWYnfdgCm3i1hLAs4PoA3sbR7J/U8Um33VHZCF8o= Received: from PN1PR01MB0494.INDPRD01.PROD.OUTLOOK.COM (10.164.141.140) by PN1PR01MB0496.INDPRD01.PROD.OUTLOOK.COM (10.164.141.142) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P384) id 15.1.933.12; Thu, 2 Mar 2017 21:21:38 +0000 Received: from PN1PR01MB0494.INDPRD01.PROD.OUTLOOK.COM ([10.164.141.140]) by PN1PR01MB0494.INDPRD01.PROD.OUTLOOK.COM ([10.164.141.140]) with mapi id 15.01.0933.020; Thu, 2 Mar 2017 21:21:38 +0000 From: Megan Wilson To: "freebsd-stable@freebsd.org" Subject: Compliance & Risk Management Lead Approach Thread-Topic: Compliance & Risk Management Lead Approach Thread-Index: AdKTmqLuJxm6ytzHT9KzFz3ZzWiMuA== Date: Thu, 2 Mar 2017 21:19:50 +0000 Message-ID: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: freebsd.org; dkim=none (message not signed) header.d=none;freebsd.org; dmarc=none action=none header.from=digitalhubcentre.com; x-originating-ip: [2405:204:5487:e50:d1ef:795:2875:a157] x-ms-office365-filtering-correlation-id: e6653ed2-023e-4458-9848-08d461b21cdb x-microsoft-antispam: UriScan:; BCL:0; PCL:0; RULEID:(22001)(201702085551020); SRVR:PN1PR01MB0496; x-microsoft-exchange-diagnostics: 1; PN1PR01MB0496; 7:UPg8DT+/BvYdjJ4vABvxVSpAeUz+XaSmaJcvSlkjh51LDle90o/Bvf5sRHlt4LxWc98diyV1J1q3mlsf7XU3bFF5YGP5yP2tiiP0cAd5UAQlHABGF7RExFtMVt+zndx3OLoVNr6rNk3XBQ6MzkFxRBwDnl4L8VGTzUMUT/bLmHxHS/oeExYawH3pgzfGwUIDrcf7J0GxRNWCbB13c3WsSXHtdjQ/1c3Fg3uTqOD9h5oZj9J5yscSDwicQ4dM1S+WxwfSwG8n8aVIgoAs/6hYRHyzMEnqP538stSLuN1Jz2N2a4mHN0CKbTizcayI0esRqE+Ns1VJ3RpgJKM2U1MIQQ== x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:(192374486261705)(21748063052155); x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(6040375)(2401047)(8121501046)(5005006)(10201501046)(3002001)(6041248)(20161123558025)(20161123560025)(2016111802025)(20161123564025)(20161123562025)(20161123555025)(6072148)(6043046); SRVR:PN1PR01MB0496; BCL:0; PCL:0; RULEID:; SRVR:PN1PR01MB0496; x-forefront-prvs: 023495660C x-forefront-antispam-report: SFV:NSPM; SFS:(10019020)(7916002)(39450400003)(39840400002)(39410400002)(39850400002)(209900001)(122556002)(450100001)(790700001)(92566002)(102836003)(6116002)(81166006)(9326002)(55016002)(7736002)(9406002)(9686003)(9476002)(8936002)(6306002)(236005)(77096006)(74316002)(5640700003)(54896002)(54356999)(7906003)(5630700001)(2900100001)(50986999)(6436002)(6506006)(18717965001)(606005)(5660300001)(2501003)(86362001)(33656002)(7066003)(3660700001)(2906002)(110136004)(3280700002)(8676002)(53936002)(6916009)(189998001)(38730400002)(7696004)(6666003)(2351001)(67040200001)(202454002)(6606295002); DIR:OUT; SFP:1102; SCL:1; SRVR:PN1PR01MB0496; H:PN1PR01MB0494.INDPRD01.PROD.OUTLOOK.COM; FPR:; SPF:None; MLV:ovr; PTR:InfoNoRecords; LANG:en; spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM MIME-Version: 1.0 X-OriginatorOrg: digitalhubcentre.com X-MS-Exchange-CrossTenant-originalarrivaltime: 02 Mar 2017 21:19:50.0716 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: af156f56-f83f-4026-964f-e22301ec5c44 X-MS-Exchange-Transport-CrossTenantHeadersStamped: PN1PR01MB0496 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 02 Mar 2017 21:21:43 -0000 Hi, Would you be interested in an email leads of Compliance & Risk Management E= xecutives with vast background in security research and investigations, We = can help you reach out to. Title includes: ? Intelligence Analyst ? Financial Examiner ? Criminologist ? Security Manager ? Fire Investigator ? Private Investigator ? Customs Agent ? Crime Laboratory Analyst ? Crime Scene Investigator ? supervisor, loss prevention officers ? Chief Risk Officer ? VP of Risk Management ? Director of Risk Management ? Risk Manager ? Compliance Officer ? Customs Compliance Officer ? IT Compliance Manager ? Corporate Compliance Manager The list comes with complete contact information like Contact name, Email a= ddress, Title, Company name, Phone number, Mailing address, etc. I'd be happy to send over few sample records on your request, and set up a = time to discuss further. If there is someone else in your organization that I need to speak with, I'= d be grateful if you would forward this email to the appropriate contact an= d help me with the introduction. If this is not relevant to you, please reply back with your Target Market, = we have all types of target markets available. Best Regards, Megan Wilson From owner-freebsd-stable@freebsd.org Fri Mar 3 21:33:41 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 54954CF782E for ; Fri, 3 Mar 2017 21:33:41 +0000 (UTC) (envelope-from amarat@li.ru) Received: from fallback1.mail.ru (fallback1.mail.ru [94.100.181.184]) by mx1.freebsd.org (Postfix) with ESMTP id 59F5716BD for ; Fri, 3 Mar 2017 21:33:37 +0000 (UTC) (envelope-from amarat@li.ru) Received: from smtp29.i.mail.ru (smtp29.i.mail.ru [94.100.177.89]) by fallback1.mail.ru (mPOP.Fallback_MX) with ESMTP id 5675A8BF35F9 for ; Fri, 3 Mar 2017 20:31:26 +0300 (MSK) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=mail.ru; s=mail2; h=Content-Type:MIME-Version:Date:Message-ID:Subject:From:To; bh=Ra4mLpuDOlxHJN+brZsWYFC5HCAiLXDaIAw03PQ82u0=; b=h7MnCqB7zSMr/Nqn70K//ZSgsNW5rU9xpab+m2Cwg5Vtmo3GRAJrcINHvYF9lBdPPNvWJNpcbarMqbGMGjuEBfe3OAZIrvGf+sjm2fAk7ZrxsvN1YpuvPX9ZMg64S0e7pQZ+4+dYEcLWbQtdbPXvuHJowwfJ72nvYG4kQSMLDqE=; Received: from [46.42.129.11] (port=57692 helo=zealot.ksu.ru) by smtp29.i.mail.ru with esmtpa (envelope-from ) id 1cjr2z-0004vt-D1 for freebsd-stable@freebsd.org; Fri, 03 Mar 2017 20:31:18 +0300 To: freebsd-stable@freebsd.org From: "Marat N.Afanasyev" Subject: iostat and fusefs Message-ID: <99ba594d-03bf-2d5d-dd33-7ad239399729@li.ru> Date: Fri, 3 Mar 2017 20:31:16 +0300 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:49.0) Gecko/20100101 Firefox/49.0 SeaMonkey/2.46 MIME-Version: 1.0 Content-Type: multipart/signed; protocol="application/pkcs7-signature"; micalg=sha-256; boundary="------------ms080101040102090400050903" Authentication-Results: smtp29.i.mail.ru; auth=pass smtp.auth=amarat@li.ru smtp.mailfrom=amarat@li.ru X-7FA49CB5: 0D63561A33F958A559F2540A1C36A15E21ACAF057337EBDCF8DA61E7404150649F18ECD7E95F35E929AFE063DF4C541CF463F914DF7610B012479ED34334DD8B0BF2EBBBDD9D6B0FB14D6A2BAF581BDFBDAD6C7F3747799A X-Mailru-Sender: 9880D4BADB750DDB106DCB8B627E51B7BCB41EFD2EBBF8F4A5068BC8F78DE477906C06D823840E0B7D4D5372EC3A0C1DC77752E0C033A69ED9772CD210233664E7FF0ACF69979172344D0B6F51A8929E0DA7A0AF5A3A8387 X-Mras: OK X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 03 Mar 2017 21:33:41 -0000 This is a cryptographically signed message in MIME format. --------------ms080101040102090400050903 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: quoted-printable hello! I've accidently ran iostat while write to fuse filesystem was in=20 progress and was shocked when I've seen that, according to iostat, each=20 and any write op to fuse fs leads to one read op. i.e. if I have ~100=20 write op/s to fuse then I have exatcly ~100 read op/s from the same=20 fuse. Is this a bug in iostat or in fuse? da2: Removable Direct Access SPC-4 SCSI devic= e # mount.exfat /dev/da2s1 /mnt/1 FUSE exfat 1.2.4 # dd if=3D/dev/zero of=3D/mnt/1/test1280m.fil bs=3D1m count=3D1280 ^C179+0 records in 178+0 records out 186646528 bytes transferred in 29.778425 secs (6267844 bytes/sec) # iostat -xzdw10 da2 extended device statistics device r/s w/s kr/s kw/s ms/r ms/w ms/o ms/t qlen=20 %b da2 79 79 5068.7 5075.1 3 11 0 7 1 = 78 extended device statistics device r/s w/s kr/s kw/s ms/r ms/w ms/o ms/t qlen=20 %b da2 99 99 6373.4 6392.5 3 11 0 7 0 = 95 extended device statistics device r/s w/s kr/s kw/s ms/r ms/w ms/o ms/t qlen=20 %b da2 95 95 6118.5 6092.9 3 11 0 7 2 = 95 extended device statistics device r/s w/s kr/s kw/s ms/r ms/w ms/o ms/t qlen=20 %b da2 12 12 793.6 793.6 3 14 0 8 0 = 15 the same can be seen if I use ntfs-3g no other app is using da2. --=20 SY, Marat --------------ms080101040102090400050903 Content-Type: application/pkcs7-signature; name="smime.p7s" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="smime.p7s" Content-Description: S/MIME Cryptographic Signature MIAGCSqGSIb3DQEHAqCAMIACAQExDzANBglghkgBZQMEAgEFADCABgkqhkiG9w0BBwEAAKCC Cs8wggTlMIIDzaADAgECAhBVgZ2vXT9CFdRn/bSHBL2jMA0GCSqGSIb3DQEBCwUAMHUxCzAJ BgNVBAYTAklMMRYwFAYDVQQKEw1TdGFydENvbSBMdGQuMSkwJwYDVQQLEyBTdGFydENvbSBD ZXJ0aWZpY2F0aW9uIEF1dGhvcml0eTEjMCEGA1UEAxMaU3RhcnRDb20gQ2xhc3MgMSBDbGll bnQgQ0EwHhcNMTYwODI4MTQzNjMwWhcNMTkxMTI4MTQzNjMwWjA0MRUwEwYDVQQDDAxhbWFy YXRAbGkucnUxGzAZBgkqhkiG9w0BCQEWDGFtYXJhdEBsaS5ydTCCASIwDQYJKoZIhvcNAQEB BQADggEPADCCAQoCggEBAMsyvB6v1iLdeb1wA3cNKOHZasvFJo8ewkv0YPnWm8GJhw6jUezo XaBKVwlyhw2IdWNmmobl6B3SXII/IB68+TKPFDqjnSxxwnUP4NSMLGfWDk8zJxKLBf+nwMHD KUu82Rjfm/BmAmf+uKsN8V/ozn0jiPuhzrzz+PR0pZMFpAxok/bIFFmSv6KTyGDlPPndbxBm J7V++pSPnGhHVBwP3zBl8F759ygnuExnfe6UiuZ+4bsGdWummkkPWeFggtmOa8eCCxzcSRaB XjyrKmNORKn94dvppeRrdG0O4RNCvTBeV6wR6bofvxoLxV26QRDfHpMegYh8iQcJyjDSTyxn cAMCAwEAAaOCAbAwggGsMA4GA1UdDwEB/wQEAwIEsDAdBgNVHSUEFjAUBggrBgEFBQcDAgYI KwYBBQUHAwQwCQYDVR0TBAIwADAdBgNVHQ4EFgQUbNowUeBsdAi1ELkDuANZrRQFa/0wHwYD VR0jBBgwFoAUJIFsOWG+SQ+PtxtGK8kotSdIbWgwbwYIKwYBBQUHAQEEYzBhMCQGCCsGAQUF BzABhhhodHRwOi8vb2NzcC5zdGFydHNzbC5jb20wOQYIKwYBBQUHMAKGLWh0dHA6Ly9haWEu c3RhcnRzc2wuY29tL2NlcnRzL3NjYS5jbGllbnQxLmNydDA4BgNVHR8EMTAvMC2gK6Aphido dHRwOi8vY3JsLnN0YXJ0c3NsLmNvbS9zY2EtY2xpZW50MS5jcmwwFwYDVR0RBBAwDoEMYW1h cmF0QGxpLnJ1MCMGA1UdEgQcMBqGGGh0dHA6Ly93d3cuc3RhcnRzc2wuY29tLzBHBgNVHSAE QDA+MDwGCysGAQQBgbU3AQIFMC0wKwYIKwYBBQUHAgEWH2h0dHBzOi8vd3d3LnN0YXJ0c3Ns LmNvbS9wb2xpY3kwDQYJKoZIhvcNAQELBQADggEBAC5GwlX7QtNA7w46KGWcjppAkmW5rtuL A7NI1KlneDws3qJz7zRYT+DeqBnts8U7qHNFqvKWC58W+THrFppZtp8i7rbdQGoa/tZoQxGR dKLR77x1ZtldhlpgsYtAARH/eMISKk8slUZABQxLaz3jAAOiCzAaMG7jQ/c5HHkM17b26hTU 3D5SeF/e9/whtourqZAYBVYztY6i77r/X/rws4LOHDn3wmXsCQTTrynkLSzTBbmakmdSnKdt UJl+2OCpRugRu1F4nM0lEYMH4SOVRQSWatdVgkXhtpT6S83kiMQngI7DTG9NT+q9lRHcHTxi dwwP3FDtVCKPg8vg044E7FIwggXiMIIDyqADAgECAhBrp4p9CteI1lEK+Vnk57ThMA0GCSqG SIb3DQEBCwUAMH0xCzAJBgNVBAYTAklMMRYwFAYDVQQKEw1TdGFydENvbSBMdGQuMSswKQYD VQQLEyJTZWN1cmUgRGlnaXRhbCBDZXJ0aWZpY2F0ZSBTaWduaW5nMSkwJwYDVQQDEyBTdGFy dENvbSBDZXJ0aWZpY2F0aW9uIEF1dGhvcml0eTAeFw0xNTEyMTYwMTAwMDVaFw0zMDEyMTYw MTAwMDVaMHUxCzAJBgNVBAYTAklMMRYwFAYDVQQKEw1TdGFydENvbSBMdGQuMSkwJwYDVQQL EyBTdGFydENvbSBDZXJ0aWZpY2F0aW9uIEF1dGhvcml0eTEjMCEGA1UEAxMaU3RhcnRDb20g Q2xhc3MgMSBDbGllbnQgQ0EwggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQC9fdr3 w6J9g/Zbgv3bW1+uHht1wLUZr5gkrLtXedg17AkefMyUGwrQdvwObhajcVmnKVxhrUwkZPXR AwZZosRHfEIi5FH7x6SV/8Sp5lZEuiMnvMFG2MzLA84J6Ws5T4NfXZ0qn4TPgnr3X2vPVS51 M7Ua9nIJgn8jvTra4eyyQzxvuA/GZwKg7VQfDCmCS+kICslYYWgXOMt2xlsSslxLce0CGWRs T8EpMyt1iDflSjXZIsE7m1uTyHaKZspMLyIyz6mySu8j8BWWHpChNNeTrFuhVfrOAyDPFJVU vKZCLKBhibTLloyy+LatoWELrjdI4a8StZY8+dIR9t4APXGzAgMBAAGjggFkMIIBYDAOBgNV HQ8BAf8EBAMCAQYwHQYDVR0lBBYwFAYIKwYBBQUHAwIGCCsGAQUFBwMEMBIGA1UdEwEB/wQI MAYBAf8CAQAwMgYDVR0fBCswKTAnoCWgI4YhaHR0cDovL2NybC5zdGFydHNzbC5jb20vc2Zz Y2EuY3JsMGYGCCsGAQUFBwEBBFowWDAkBggrBgEFBQcwAYYYaHR0cDovL29jc3Auc3RhcnRz c2wuY29tMDAGCCsGAQUFBzAChiRodHRwOi8vYWlhLnN0YXJ0c3NsLmNvbS9jZXJ0cy9jYS5j cnQwHQYDVR0OBBYEFCSBbDlhvkkPj7cbRivJKLUnSG1oMB8GA1UdIwQYMBaAFE4L7xqkQFul F2mHMMo0aEPQQa7yMD8GA1UdIAQ4MDYwNAYEVR0gADAsMCoGCCsGAQUFBwIBFh5odHRwOi8v d3d3LnN0YXJ0c3NsLmNvbS9wb2xpY3kwDQYJKoZIhvcNAQELBQADggIBAIvj94fsAYuErQ8B Aluc4SMnIwS9NPBwAm5SH9uh2NCXTq7im61g7F1LIiNI/+wq37fUuaMbz4g7VarKQTgf8ubs 0p7NZWcIe7Bvem2AWaXBsxsaRTYw5kG3DN8pd1hSEUuFoTa7DmNeFe8tiK1BrL3rbA/m48jp 4AiFXgvxprJrW7izsyetOrRHPbkW4Y07v29MdhaPv3u1JELyszXqOzjIYo4sWlC8iDQXwgSW /ntvWy2n4LuiaozlCfXl149tKeqvwlvrla2Yklue/quWp9j9ou4T/OY0CXMuY+B8wNK0ohd2 D4ShgFlMSjzAFRoHGKF81snTr2d1A7Ew02oF6UQyCkC2aNNsK5cWOojBar5c7HplX9aHYUCZ ouxIeU28SONJAxnATgR4cJ2jrpmYSz/kliUJ46S6UpVDo/ebn9c6PaM/XtDYCCaM/7XX6wc3 s++sbQ7CtCn1Ax7df6ufQbwyO0V+oFa9H0KAsjHMzcwk3EV2B2NLatidKE/m7G+rB9m+FlVg IiSp0mGlg43QO9Kh1+JqvTCIzv2bJJkmPMLQJNuKKwHNL8F4GGp6jbAV+WL+LDeGfVcq8DHS 3LrD+xyYEXQBiqZEdiPVOMxLDSUCXsDO0uCWpaNQ8j6y6S9p0xE/Ga0peVLadVHhqf9nXqKa xnr358VgfrxzUIrvOaOjMYIDzDCCA8gCAQEwgYkwdTELMAkGA1UEBhMCSUwxFjAUBgNVBAoT DVN0YXJ0Q29tIEx0ZC4xKTAnBgNVBAsTIFN0YXJ0Q29tIENlcnRpZmljYXRpb24gQXV0aG9y aXR5MSMwIQYDVQQDExpTdGFydENvbSBDbGFzcyAxIENsaWVudCBDQQIQVYGdr10/QhXUZ/20 hwS9ozANBglghkgBZQMEAgEFAKCCAhMwGAYJKoZIhvcNAQkDMQsGCSqGSIb3DQEHATAcBgkq hkiG9w0BCQUxDxcNMTcwMzAzMTczMTE2WjAvBgkqhkiG9w0BCQQxIgQgnyL3X0+if3iOffeg 0xlnFr0OmEW2HYT6VviUeQcLqcgwbAYJKoZIhvcNAQkPMV8wXTALBglghkgBZQMEASowCwYJ YIZIAWUDBAECMAoGCCqGSIb3DQMHMA4GCCqGSIb3DQMCAgIAgDANBggqhkiG9w0DAgIBQDAH BgUrDgMCBzANBggqhkiG9w0DAgIBKDCBmgYJKwYBBAGCNxAEMYGMMIGJMHUxCzAJBgNVBAYT AklMMRYwFAYDVQQKEw1TdGFydENvbSBMdGQuMSkwJwYDVQQLEyBTdGFydENvbSBDZXJ0aWZp Y2F0aW9uIEF1dGhvcml0eTEjMCEGA1UEAxMaU3RhcnRDb20gQ2xhc3MgMSBDbGllbnQgQ0EC EFWBna9dP0IV1Gf9tIcEvaMwgZwGCyqGSIb3DQEJEAILMYGMoIGJMHUxCzAJBgNVBAYTAklM MRYwFAYDVQQKEw1TdGFydENvbSBMdGQuMSkwJwYDVQQLEyBTdGFydENvbSBDZXJ0aWZpY2F0 aW9uIEF1dGhvcml0eTEjMCEGA1UEAxMaU3RhcnRDb20gQ2xhc3MgMSBDbGllbnQgQ0ECEFWB na9dP0IV1Gf9tIcEvaMwDQYJKoZIhvcNAQEBBQAEggEAl1fHg6FU8agmE9LW6kKXMS73EhxV MPfz6HUpgHOBCnW6PRkN8YTcUV/LkSMKD2O5CSBZJjNtKALwPH+h3LOjDrCd9dT1JWTTGxRY Sn/u7PS5NY/cDjG33nhP4px+drOk3idwLcjvovKbK4wbVSSXrxGWoZpHy7SX7wwz8g4Xu4Lm hBeYEYIzD9fId0z1Ck31yLOofY4P/btmWQt7qTrPR5NW093qfBA5oOJ3dw5fAgVHVsTMtBUZ oBTOpj6XpSODmEapKrU1tp+hTEdYprmKgK8h1huS9H9HTEnXjJl6wcXUJJdAAS4XBitTLnR5 zeVL+TmjE2rg293tU57I5OcpqwAAAAAAAA== --------------ms080101040102090400050903-- From owner-freebsd-stable@freebsd.org Sat Mar 4 11:50:33 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 57FDECF7094 for ; Sat, 4 Mar 2017 11:50:33 +0000 (UTC) (envelope-from pi@FreeBSD.org) Received: from mailman.ysv.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4970E1DF4 for ; Sat, 4 Mar 2017 11:50:33 +0000 (UTC) (envelope-from pi@FreeBSD.org) Received: by mailman.ysv.freebsd.org (Postfix) id 45CB2CF7093; Sat, 4 Mar 2017 11:50:33 +0000 (UTC) Delivered-To: stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 45721CF7091 for ; Sat, 4 Mar 2017 11:50:33 +0000 (UTC) (envelope-from pi@FreeBSD.org) Received: from home.opsec.eu (home.opsec.eu [IPv6:2001:14f8:200::1]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 103F11DF3 for ; Sat, 4 Mar 2017 11:50:33 +0000 (UTC) (envelope-from pi@FreeBSD.org) Received: from pi by home.opsec.eu with local (Exim 4.87 (FreeBSD)) (envelope-from ) id 1ck8Cn-0006ON-Lr for stable@freebsd.org; Sat, 04 Mar 2017 12:50:33 +0100 Date: Sat, 4 Mar 2017 12:50:33 +0100 From: Kurt Jaeger To: stable@freebsd.org Subject: How to copy ACLs on ZFS with tar ? Message-ID: <20170304115033.GF13006@home.opsec.eu> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 04 Mar 2017 11:50:33 -0000 Hi! I have a file with the following ACL (in fact, a whole tree with files like that): srv$ getfacl myfile # file: myfile # owner: myuser # group: domain-users group:myuser:rw-p--aARWcCo-:-------:allow group@:rw-p--a-R-c---:-------:allow everyone@:rw-p--a-R-c---:-------:allow How do I copy this file or the tree with tar, while preserving the ACLs ? Or do I have to use something else ? -- pi@opsec.eu +49 171 3101372 3 years to go ! From owner-freebsd-stable@freebsd.org Sat Mar 4 13:37:15 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9F9E5CF9D7E for ; Sat, 4 Mar 2017 13:37:15 +0000 (UTC) (envelope-from etnapierala@gmail.com) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 7DCA01220 for ; Sat, 4 Mar 2017 13:37:15 +0000 (UTC) (envelope-from etnapierala@gmail.com) Received: by mailman.ysv.freebsd.org (Postfix) id 79F9CCF9D7D; Sat, 4 Mar 2017 13:37:15 +0000 (UTC) Delivered-To: stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 799ABCF9D7C for ; Sat, 4 Mar 2017 13:37:15 +0000 (UTC) (envelope-from etnapierala@gmail.com) Received: from mail-wr0-x233.google.com (mail-wr0-x233.google.com [IPv6:2a00:1450:400c:c0c::233]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 2EE81121F; Sat, 4 Mar 2017 13:37:15 +0000 (UTC) (envelope-from etnapierala@gmail.com) Received: by mail-wr0-x233.google.com with SMTP id u108so89744609wrb.3; Sat, 04 Mar 2017 05:37:14 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=sender:mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=1KeezSp6xfBeYigVGmp+6zkJwywRdxbC1gjhE74fgIA=; b=i1ssoDw+4RWvnLBHgaHunhK7ZLec0/BpkjCCTnXfvJ2BUkOkFl0Oew+9YapWUXYK4Q r2/AeC3sThyscyUz0c8rp5kFV+H9goxdf812F+HQYdN7P93I9oWdsPyFSknSRbZigW3m ep8+YuLjtqTq2a2v6WmnUkVE2UrGQ913xwrAft1Q5428RJg2tloqSkynBnro9W98A/IH 24PMqq5cBiSRRlV3CkM4EVIIT0SsVY4uqMvmdaRqIzMhWRdAS64iNzGT03vhXuuc3p5i SDKs1EMZlv6N8bNLoMRLwfAie37RICbbFEgODrdbdDVS7UbRebM2Xtbo49xfmOBv14pM 4AGg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:mime-version:subject:from:in-reply-to :date:cc:content-transfer-encoding:message-id:references:to; bh=1KeezSp6xfBeYigVGmp+6zkJwywRdxbC1gjhE74fgIA=; b=mMfQEvh4WR/pJOhObMU0ntPnM0k1Qj2s3x+wKjwr6zq/gWV+KM386fGS5R9JixamWs gDlZhHDYAYveijAy3NLXUHidAQxyphOe6+eQyHTyEi+Q5eBd0nkV4Dp/VBS5mmiXrsX/ hza7SwwUk/rEGhZsR1h/XmzmLQukOwnfHTxxswmLUxREO2rlsDFnrS/bCpXfJudAeQYw 5dFFhsP8OLPNBTS7D5I3rlsKZ483neKa33v25E6sutH7dLlawiygbYWAAY2IOvAO+E2e TQNMsVkf2a4jnXu6R89BiXgLtjSSYirzuNoKnj8yoMReSu9WrWvNPKYy3xMlGsjhPnRe LXNQ== X-Gm-Message-State: AMke39nwV86nkJRq0+00F5G1nI8MbaARBz8V3NqQJliALeA1QIN3ysPDqV1d6dc6xfFiVg== X-Received: by 10.223.133.1 with SMTP id 1mr6991947wrh.200.1488634632370; Sat, 04 Mar 2017 05:37:12 -0800 (PST) Received: from [10.31.231.248] ([148.252.128.129]) by smtp.gmail.com with ESMTPSA id x193sm7051121wme.23.2017.03.04.05.37.11 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Sat, 04 Mar 2017 05:37:11 -0800 (PST) Sender: =?UTF-8?Q?Edward_Tomasz_Napiera=C5=82a?= Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (1.0) Subject: Re: How to copy ACLs on ZFS with tar ? From: =?utf-8?Q?Edward_Tomasz_Napiera=C5=82a?= X-Mailer: iPhone Mail (14D27) In-Reply-To: <20170304115033.GF13006@home.opsec.eu> Date: Sat, 4 Mar 2017 13:37:10 +0000 Cc: stable@freebsd.org Content-Transfer-Encoding: 7bit Message-Id: <7E014FF3-6D2D-4397-B81A-07B87DA904F3@FreeBSD.org> References: <20170304115033.GF13006@home.opsec.eu> To: Kurt Jaeger X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 04 Mar 2017 13:37:15 -0000 > On 4 Mar 2017, at 11:50, Kurt Jaeger wrote: > > Hi! > > I have a file with the following ACL (in fact, a whole tree with files > like that): > > srv$ getfacl myfile > # file: myfile > # owner: myuser > # group: domain-users > group:myuser:rw-p--aARWcCo-:-------:allow > group@:rw-p--a-R-c---:-------:allow > everyone@:rw-p--a-R-c---:-------:allow > > How do I copy this file or the tree with tar, while preserving the ACLs ? > Or do I have to use something else ? Not sure about tar, but plain "cp -p" should do the trick. From owner-freebsd-stable@freebsd.org Sat Mar 4 15:13:37 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B71F3CF20DF for ; Sat, 4 Mar 2017 15:13:37 +0000 (UTC) (envelope-from pi@FreeBSD.org) Received: from mailman.ysv.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id A6C6E142A for ; Sat, 4 Mar 2017 15:13:37 +0000 (UTC) (envelope-from pi@FreeBSD.org) Received: by mailman.ysv.freebsd.org (Postfix) id A3366CF20DE; Sat, 4 Mar 2017 15:13:37 +0000 (UTC) Delivered-To: stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A04AACF20DD for ; Sat, 4 Mar 2017 15:13:37 +0000 (UTC) (envelope-from pi@FreeBSD.org) Received: from home.opsec.eu (home.opsec.eu [IPv6:2001:14f8:200::1]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 5CE4A1423; Sat, 4 Mar 2017 15:13:37 +0000 (UTC) (envelope-from pi@FreeBSD.org) Received: from pi by home.opsec.eu with local (Exim 4.87 (FreeBSD)) (envelope-from ) id 1ckBNK-0008yt-3E; Sat, 04 Mar 2017 16:13:38 +0100 Date: Sat, 4 Mar 2017 16:13:38 +0100 From: Kurt Jaeger To: Edward Tomasz Napiera??a Cc: Kurt Jaeger , stable@freebsd.org Subject: Re: How to copy ACLs on ZFS with tar ? Message-ID: <20170304151338.GH13006@home.opsec.eu> References: <20170304115033.GF13006@home.opsec.eu> <7E014FF3-6D2D-4397-B81A-07B87DA904F3@FreeBSD.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <7E014FF3-6D2D-4397-B81A-07B87DA904F3@FreeBSD.org> X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 04 Mar 2017 15:13:37 -0000 Hi! > > I have a file with the following ACL (in fact, a whole tree with files > > like that): > > > > srv$ getfacl myfile > > # file: myfile > > # owner: myuser > > # group: domain-users > > group:myuser:rw-p--aARWcCo-:-------:allow > > group@:rw-p--a-R-c---:-------:allow > > everyone@:rw-p--a-R-c---:-------:allow > > > > How do I copy this file or the tree with tar, while preserving the ACLs ? > > Or do I have to use something else ? > > Not sure about tar, but plain "cp -p" should do the trick. This worked fine. Thanks! Shouldn't tar work, too ? According to this commit to libarchive: https://github.com/libarchive/libarchive/commit/59e3c3919b66cc1f1a59a9c32307befe015f40e8 it will be supported soon. -- pi@opsec.eu +49 171 3101372 3 years to go !