From owner-freebsd-stable@freebsd.org Sun Apr 15 15:20:36 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0DD43F9B219; Sun, 15 Apr 2018 15:20:36 +0000 (UTC) (envelope-from brooks@spindle.one-eyed-alien.net) Received: from spindle.one-eyed-alien.net (spindle.one-eyed-alien.net [199.48.129.229]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 86E7A8292B; Sun, 15 Apr 2018 15:20:35 +0000 (UTC) (envelope-from brooks@spindle.one-eyed-alien.net) Received: by spindle.one-eyed-alien.net (Postfix, from userid 3001) id 9786D5A9F12; Sun, 15 Apr 2018 15:20:33 +0000 (UTC) Date: Sun, 15 Apr 2018 15:20:33 +0000 From: Brooks Davis To: Ed Maste Cc: Magnus Ringman , src-committers , svn-src-all@freebsd.org, svn-src-stable@freebsd.org, svn-src-stable-11@freebsd.org, freebsd-stable stable Subject: Re: svn commit: r332493 - stable/11/sys/net Message-ID: <20180415152033.GB99239@spindle.one-eyed-alien.net> References: <201804132232.w3DMWSmI019256@repo.freebsd.org> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="QTprm0S8XgL7H0Dt" Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.9.4 (2018-02-28) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 15 Apr 2018 15:20:36 -0000 --QTprm0S8XgL7H0Dt Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Sat, Apr 14, 2018 at 08:54:15AM -0400, Ed Maste wrote: > On 14 April 2018 at 07:31, Magnus Ringman wrote: > > Hi Brooks, this MFC missed your r331077 > > (https://reviews.freebsd.org/D14706) thus stable buildkernel currently > > breaks on missing those two macros. >=20 > Thanks for identifying the missing commit Magnus. I've now merged it in r= 332502. >=20 Sorry for the breakage and thanks for fixing this! -- Brooks --QTprm0S8XgL7H0Dt Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQEcBAEBAgAGBQJa023BAAoJEKzQXbSebgfAb5sH/3S7u5/I+ASEJpIpl+2FhDS7 yYQGyJGfxFpKwcBWjvJmnREIkXKkMNCM58uV+iIRAPwlABHJOg5ID1NqQd+6I+Iq dAFqlTTGdfhUq80KpfaiBV+3NgmCA1BjGnF0TwyPn5QJXntkjZyTE0YF+a1+D8GQ KzIjBeaHUjuSokfP2UlFFHVXIw7pL77TEqacep/qRi3ZAa/Aa7EuUOqgSBkmykXd ivMFUrIqjNxvX3hqrh3JRFaXC9DLw3Oi4qIQ47XbrsUfVUneQR3tmxfGwijqGY57 giKOU9q1W9bXXIpWbqBwMj8YJF9o49HGanehaFZEcgyq9C1t7gprFQq8pYJW2/U= =zOUg -----END PGP SIGNATURE----- --QTprm0S8XgL7H0Dt-- From owner-freebsd-stable@freebsd.org Mon Apr 16 07:00:42 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A14DBF8EBC2 for ; Mon, 16 Apr 2018 07:00:42 +0000 (UTC) (envelope-from jachmann@unitix.org) Received: from thematrix.nitpicker.de (thematrix.nitpicker.de [IPv6:2a01:4f8:140:236a:cafe::2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 468A36DD00 for ; Mon, 16 Apr 2018 07:00:42 +0000 (UTC) (envelope-from jachmann@unitix.org) Received: from hurx.thc (hurx [IPv6:2001:470:1f0b:b14:225:22ff:feee:b12d]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by thematrix.nitpicker.de (Postfix) with ESMTPSA id E57A34739F for ; Mon, 16 Apr 2018 09:00:33 +0200 (CEST) Received: (qmail 52743 invoked by uid 1001); 16 Apr 2018 07:00:32 -0000 Date: Mon, 16 Apr 2018 09:00:32 +0200 From: Christian Jachmann To: freebsd-stable@freebsd.org Subject: w/uptime broken in stable Message-ID: <20180416070031.GA40544@hurx.thc> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.9.4 (2018-02-28) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 16 Apr 2018 07:00:42 -0000 Hello List, seems that w and uptime are broken in 11.* since last week. $uname -a FreeBSD hurx.thc 11.1-STABLE FreeBSD 11.1-STABLE #16 r332505M: Sun Apr 15 14:22:38 CEST 2018 jachmann@hurx.thc:/usr/obj/usr/src/sys/MY2 i386 $w Segmentation fault $uptime Segmentation fau maybe there is s.th. with libxo... no idea. -- Christian Jachmann From owner-freebsd-stable@freebsd.org Mon Apr 16 10:41:47 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id AD96EF9E0E8 for ; Mon, 16 Apr 2018 10:41:47 +0000 (UTC) (envelope-from david@catwhisker.org) Received: from mx.catwhisker.org (mx.catwhisker.org [198.144.209.73]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 0474E7DF6A for ; Mon, 16 Apr 2018 10:41:46 +0000 (UTC) (envelope-from david@catwhisker.org) Received: from albert.catwhisker.org (localhost [127.0.0.1]) by albert.catwhisker.org (8.15.2/8.15.2) with ESMTP id w3GAfj89012090; Mon, 16 Apr 2018 10:41:45 GMT (envelope-from david@albert.catwhisker.org) Received: (from david@localhost) by albert.catwhisker.org (8.15.2/8.15.2/Submit) id w3GAfijT012089; Mon, 16 Apr 2018 03:41:44 -0700 (PDT) (envelope-from david) Date: Mon, 16 Apr 2018 03:41:44 -0700 From: David Wolfskill To: Christian Jachmann Cc: freebsd-stable@freebsd.org Subject: Re: w/uptime broken in stable Message-ID: <20180416104144.GT1198@albert.catwhisker.org> Reply-To: stable@freebsd.org Mail-Followup-To: stable@freebsd.org, Christian Jachmann , freebsd-stable@freebsd.org References: <20180416070031.GA40544@hurx.thc> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="80Ds8Z/hZmemMosa" Content-Disposition: inline In-Reply-To: <20180416070031.GA40544@hurx.thc> User-Agent: Mutt/1.9.4 (2018-02-28) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 16 Apr 2018 10:41:47 -0000 --80Ds8Z/hZmemMosa Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Mon, Apr 16, 2018 at 09:00:32AM +0200, Christian Jachmann wrote: > Hello List, >=20 > seems that w and uptime are broken in 11.* since last week. >=20 >=20 > $uname -a > FreeBSD hurx.thc 11.1-STABLE FreeBSD 11.1-STABLE #16 r332505M: Sun Apr 15= 14:22:38 CEST 2018 jachmann@hurx.thc:/usr/obj/usr/src/sys/MY2 i386 > $w > Segmentation fault > $uptime > Segmentation fau >=20 >=20 > maybe there is s.th. with libxo... no idea. >=20 > -- > Christian Jachmann > .... That is not my experience: albert(11.1-S)[1] uname -a FreeBSD albert.catwhisker.org 11.1-STABLE FreeBSD 11.1-STABLE #614 r332507= M/332511:1101515: Sun Apr 15 03:49:51 PDT 2018 root@freebeast.catwhiske= r.org:/common/S1/obj/usr/src/sys/ALBERT amd64 albert(11.1-S)[2] uptime 3:40AM up 23:02, 21 users, load averages: 0.19, 0.15, 0.17 albert(11.1-S)[3] w | head -5 3:40AM up 23:02, 21 users, load averages: 0.16, 0.14, 0.17 USER TTY FROM LOGIN@ IDLE = WHAT david pts/1 g1-215.catwhisker.org Sun04AM - = tmu=20 david pts/2 tmux(957).%0 Sun04AM - = vi david pts/3 g1-215.catwhisker.org Sun04AM 17:18 = tmu=20 albert(11.1-S)[4]=20 Peace, david --=20 David H. Wolfskill david@catwhisker.org Donald Trump's criticism of others comes across as psychological projection. See http://www.catwhisker.org/~david/publickey.gpg for my public key. --80Ds8Z/hZmemMosa Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQGTBAEBCgB9FiEEzLfO+ReoAfQwZNd7FTnMQKBJ7hcFAlrUfehfFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldEND QjdDRUY5MTdBODAxRjQzMDY0RDc3QjE1MzlDQzQwQTA0OUVFMTcACgkQFTnMQKBJ 7hddqwgAnnI6j+GFwE5MjeLhcHFTuIv3Akanxtph8rJNIFd8WfFBnw6WBpDyN2yy SZnIgXznpLsLYkDERg4oR9tuO+g9cMEVaO13vGOPh8sIVEtP71JMNx7QNyHqcDL0 Ii+uMr75EkU3tJO+cUUlx3+9TiWrfriRtFKUPo42xIx1W5zg7AtpgbiEMdYfKhbY pwkKq+TMdkTbE4EHpLjiswYIQxHxzjCrx/6ydDWpCkLMm+WnyP2/LZ90lrx1hnOb zVl5pgRrpruv1JPCZTvemt/y4Cw1nL52XN3P3v6ATbI52QiTF2AhUdgXbC6/wv1P 2vcNUW/wPGdKCwiZQpFzfPslGZhuSA== =tx5F -----END PGP SIGNATURE----- --80Ds8Z/hZmemMosa-- From owner-freebsd-stable@freebsd.org Mon Apr 16 11:35:49 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3B27FFA20B2 for ; Mon, 16 Apr 2018 11:35:49 +0000 (UTC) (envelope-from jachmann@unitix.org) Received: from thematrix.nitpicker.de (thematrix.nitpicker.de [IPv6:2a01:4f8:140:236a:cafe::2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id CEEDE8C5F8 for ; Mon, 16 Apr 2018 11:35:48 +0000 (UTC) (envelope-from jachmann@unitix.org) Received: from hurx.thc (hurx [IPv6:2001:470:1f0b:b14:225:22ff:feee:b12d]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by thematrix.nitpicker.de (Postfix) with ESMTPSA id 53D6B3506F for ; Mon, 16 Apr 2018 13:35:47 +0200 (CEST) Received: (qmail 56507 invoked by uid 1001); 16 Apr 2018 11:35:45 -0000 Date: Mon, 16 Apr 2018 13:35:45 +0200 From: Christian Jachmann To: stable@freebsd.org, freebsd-stable@freebsd.org Subject: Re: w/uptime broken in stable Message-ID: <20180416113545.GA56441@hurx.thc> References: <20180416070031.GA40544@hurx.thc> <20180416104144.GT1198@albert.catwhisker.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20180416104144.GT1198@albert.catwhisker.org> User-Agent: Mutt/1.9.4 (2018-02-28) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 16 Apr 2018 11:35:49 -0000 Mon, Apr 16, 2018 at 03:41:44AM -0700, David Wolfskill : > On Mon, Apr 16, 2018 at 09:00:32AM +0200, Christian Jachmann wrote: > > Hello List, > > > > seems that w and uptime are broken in 11.* since last week. > > > > > > $uname -a > > FreeBSD hurx.thc 11.1-STABLE FreeBSD 11.1-STABLE #16 r332505M: Sun Apr 15 14:22:38 CEST 2018 jachmann@hurx.thc:/usr/obj/usr/src/sys/MY2 i386 > > $w > > Segmentation fault > > $uptime > > Segmentation fau > > > > > > maybe there is s.th. with libxo... no idea. > > > > -- > > Christian Jachmann > > .... > > That is not my experience: > > albert(11.1-S)[1] uname -a > FreeBSD albert.catwhisker.org 11.1-STABLE FreeBSD 11.1-STABLE #614 r332507M/332511:1101515: Sun Apr 15 03:49:51 PDT 2018 root@freebeast.catwhisker.org:/common/S1/obj/usr/src/sys/ALBERT amd64 > albert(11.1-S)[2] uptime > 3:40AM up 23:02, 21 users, load averages: 0.19, 0.15, 0.17 > albert(11.1-S)[3] w | head -5 > 3:40AM up 23:02, 21 users, load averages: 0.16, 0.14, 0.17 > USER TTY FROM LOGIN@ IDLE WHAT > david pts/1 g1-215.catwhisker.org Sun04AM - tmu > david pts/2 tmux(957).%0 Sun04AM - vi > david pts/3 g1-215.catwhisker.org Sun04AM 17:18 tmu > albert(11.1-S)[4] > > Peace, > david Jes : On AMD64 everything is ok. [jachmann@thematrix ~]$ w 1:33PM up 4 mins, 1 user, load averages: 0.23, 0.37, 0.19 USER TTY FROM LOGIN@ IDLE WHAT jachmann pts/0 hurx 1:33PM - w [jachmann@thematrix ~]$ uptime 1:33PM up 4 mins, 1 user, load averages: 0.21, 0.36, 0.19 [jachmann@thematrix ~]$ uname -a FreeBSD thematrix 11.1-STABLE FreeBSD 11.1-STABLE #19 r332554M: Mon Apr 16 11:03:31 CEST 2018 jachmann@thematrix:/usr/obj/usr/src/sys/MY amd64 [jachmann@thematrix ~]$ But on i386.... it seems to be broken. -- Christian From owner-freebsd-stable@freebsd.org Mon Apr 16 11:48:08 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 139C7FA2CB3; Mon, 16 Apr 2018 11:48:08 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from hz.grosbein.net (hz.grosbein.net [78.47.246.247]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FA45686D2; Mon, 16 Apr 2018 11:48:06 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from eg.sd.rdtc.ru (root@eg.sd.rdtc.ru [62.231.161.221] (may be forged)) by hz.grosbein.net (8.15.2/8.15.2) with ESMTPS id w3GBlrwb046165 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Mon, 16 Apr 2018 13:47:53 +0200 (CEST) (envelope-from eugen@grosbein.net) X-Envelope-From: eugen@grosbein.net X-Envelope-To: Jachmann@unitix.org Received: from [10.58.0.4] ([10.58.0.4]) by eg.sd.rdtc.ru (8.15.2/8.15.2) with ESMTPS id w3GBlmfV087612 (version=TLSv1.2 cipher=DHE-RSA-AES128-SHA bits=128 verify=NOT); Mon, 16 Apr 2018 18:47:48 +0700 (+07) (envelope-from eugen@grosbein.net) Subject: Re: w/uptime broken in stable To: Christian Jachmann , stable@freebsd.org, freebsd-stable@freebsd.org References: <20180416070031.GA40544@hurx.thc> <20180416104144.GT1198@albert.catwhisker.org> <20180416113545.GA56441@hurx.thc> From: Eugene Grosbein Message-ID: <5AD48D5F.10307@grosbein.net> Date: Mon, 16 Apr 2018 18:47:43 +0700 User-Agent: Mozilla/5.0 (Windows NT 6.3; WOW64; rv:38.0) Gecko/20100101 Thunderbird/38.7.2 MIME-Version: 1.0 In-Reply-To: <20180416113545.GA56441@hurx.thc> Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=2.2 required=5.0 tests=BAYES_00, LOCAL_FROM, RDNS_NONE autolearn=no autolearn_force=no version=3.4.1 X-Spam-Report: * -2.3 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 2.6 LOCAL_FROM From my domains * 1.9 RDNS_NONE Delivered to internal network by a host with no rDNS X-Spam-Level: ** X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on hz.grosbein.net X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 16 Apr 2018 11:48:08 -0000 16.04.2018 18:35, Christian Jachmann wrote: > But on i386.... it seems to be broken. Why don't you rebuild src/usr/bin/w with debugging symbols, generate core and show backtrace? From owner-freebsd-stable@freebsd.org Mon Apr 16 12:04:27 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id EB46AFA4712 for ; Mon, 16 Apr 2018 12:04:26 +0000 (UTC) (envelope-from jachmann@unitix.org) Received: from thematrix.nitpicker.de (vock.nitpicker.de [46.4.64.217]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 904B26C16A for ; Mon, 16 Apr 2018 12:04:26 +0000 (UTC) (envelope-from jachmann@unitix.org) Received: from hurx.thc (hurx [IPv6:2001:470:1f0b:b14:225:22ff:feee:b12d]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by thematrix.nitpicker.de (Postfix) with ESMTPSA id 6E2E13507C for ; Mon, 16 Apr 2018 14:04:25 +0200 (CEST) Received: (qmail 56714 invoked by uid 1001); 16 Apr 2018 12:04:23 -0000 Date: Mon, 16 Apr 2018 14:04:23 +0200 From: Christian Jachmann To: Eugene Grosbein Cc: stable@freebsd.org, freebsd-stable@freebsd.org Subject: Re: w/uptime broken in stable Message-ID: <20180416120423.GA56646@hurx.thc> References: <20180416070031.GA40544@hurx.thc> <20180416104144.GT1198@albert.catwhisker.org> <20180416113545.GA56441@hurx.thc> <5AD48D5F.10307@grosbein.net> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <5AD48D5F.10307@grosbein.net> User-Agent: Mutt/1.9.4 (2018-02-28) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 16 Apr 2018 12:04:27 -0000 Mon, Apr 16, 2018 at 06:47:43PM +0700, Eugene Grosbein : > 16.04.2018 18:35, Christian Jachmann wrote: > > > But on i386.... it seems to be broken. > > Why don't you rebuild src/usr/bin/w with debugging symbols, generate core and show backtrace? > Jes, here it is: Core was generated by `w'. Program terminated with signal 11, Segmentation fault. Reading symbols from /lib/libkvm.so.7...Reading symbols from /usr/lib/debug//lib/libkvm.so.7.debug...done. done. Loaded symbols for /lib/libkvm.so.7 Reading symbols from /lib/libsbuf.so.6...Reading symbols from /usr/lib/debug//lib/libsbuf.so.6.debug...done. done. Loaded symbols for /lib/libsbuf.so.6 Reading symbols from /lib/libxo.so.0...Reading symbols from /usr/lib/debug//lib/libxo.so.0.debug...done. done. Loaded symbols for /lib/libxo.so.0 Reading symbols from /lib/libutil.so.9...Reading symbols from /usr/lib/debug//lib/libutil.so.9.debug...done. done. Loaded symbols for /lib/libutil.so.9 Reading symbols from /lib/libc.so.7...Reading symbols from /usr/lib/debug//lib/libc.so.7.debug...done. done. Loaded symbols for /lib/libc.so.7 Reading symbols from /lib/libelf.so.2...Reading symbols from /usr/lib/debug//lib/libelf.so.2.debug...done. done. Loaded symbols for /lib/libelf.so.2 Reading symbols from /libexec/ld-elf.so.1...Reading symbols from /usr/lib/debug//libexec/ld-elf.so.1.debug...done. done. Loaded symbols for /libexec/ld-elf.so.1 #0 ifree (tsd=0x28000000) at arena.h:799 799 return (*mapbitsp); (gdb) bt #0 ifree (tsd=0x28000000) at arena.h:799 #1 0x28155316 in __free (ptr=0x280601ef) at tsd.h:716 #2 0x28095b07 in xo_do_emit_fields () at /usr/src/contrib/libxo/libxo/libxo.c:6419 #3 0x28093a1c in xo_do_emit (xop=, flags=, fmt=0x804ad4d "") at /usr/src/contrib/libxo/libxo/libxo.c:6470 #4 0x28093b61 in xo_emit (fmt=0x804ad4d "") at /usr/src/contrib/libxo/libxo/libxo.c:6541 #5 0x08049f50 in main (argc=, argv=) at /usr/src/usr.bin/w/w.c:475 Current language: auto; currently minimal (gdb) I see, this is somewhere in libxo... and only on i386. -- Christian From owner-freebsd-stable@freebsd.org Mon Apr 16 12:19:47 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A6CC1FA5A6F; Mon, 16 Apr 2018 12:19:47 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from hz.grosbein.net (hz.grosbein.net [78.47.246.247]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 253AE6E28E; Mon, 16 Apr 2018 12:19:46 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from eg.sd.rdtc.ru (root@eg.sd.rdtc.ru [62.231.161.221] (may be forged)) by hz.grosbein.net (8.15.2/8.15.2) with ESMTPS id w3GCJeT9046385 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Mon, 16 Apr 2018 14:19:40 +0200 (CEST) (envelope-from eugen@grosbein.net) X-Envelope-From: eugen@grosbein.net X-Envelope-To: Jachmann@unitix.org Received: from [10.58.0.4] (dadv@[10.58.0.4]) by eg.sd.rdtc.ru (8.15.2/8.15.2) with ESMTPS id w3GCJaph087834 (version=TLSv1.2 cipher=DHE-RSA-AES128-SHA bits=128 verify=NOT); Mon, 16 Apr 2018 19:19:36 +0700 (+07) (envelope-from eugen@grosbein.net) Subject: Re: w/uptime broken in stable To: Christian Jachmann References: <20180416070031.GA40544@hurx.thc> <20180416104144.GT1198@albert.catwhisker.org> <20180416113545.GA56441@hurx.thc> <5AD48D5F.10307@grosbein.net> <20180416120423.GA56646@hurx.thc> Cc: stable@freebsd.org, freebsd-stable@freebsd.org From: Eugene Grosbein Message-ID: <5AD494D8.6080004@grosbein.net> Date: Mon, 16 Apr 2018 19:19:36 +0700 User-Agent: Mozilla/5.0 (Windows NT 6.3; WOW64; rv:38.0) Gecko/20100101 Thunderbird/38.7.2 MIME-Version: 1.0 In-Reply-To: <20180416120423.GA56646@hurx.thc> Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=4.7 required=5.0 tests=BAYES_00, DATE_IN_FUTURE_96_Q, LOCAL_FROM, RDNS_NONE autolearn=no autolearn_force=no version=3.4.1 X-Spam-Report: * 2.5 DATE_IN_FUTURE_96_Q Date: is 4 days to 4 months after Received: date * -2.3 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 2.6 LOCAL_FROM From my domains * 1.9 RDNS_NONE Delivered to internal network by a host with no rDNS X-Spam-Level: **** X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on hz.grosbein.net X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 16 Apr 2018 12:19:47 -0000 16.04.2018 19:04, Christian Jachmann wrote: > #0 ifree (tsd=0x28000000) at arena.h:799 > 799 return (*mapbitsp); > (gdb) bt > #0 ifree (tsd=0x28000000) at arena.h:799 > #1 0x28155316 in __free (ptr=0x280601ef) at tsd.h:716 > #2 0x28095b07 in xo_do_emit_fields () > at /usr/src/contrib/libxo/libxo/libxo.c:6419 > #3 0x28093a1c in xo_do_emit (xop=, > flags=, fmt=0x804ad4d "") > at /usr/src/contrib/libxo/libxo/libxo.c:6470 > #4 0x28093b61 in xo_emit (fmt=0x804ad4d "") > at /usr/src/contrib/libxo/libxo/libxo.c:6541 > #5 0x08049f50 in main (argc=, argv=) > at /usr/src/usr.bin/w/w.c:475 > Current language: auto; currently minimal > (gdb) > > > I see, this is somewhere in libxo... > > and only on i386. Make a PR please. From owner-freebsd-stable@freebsd.org Tue Apr 17 07:10:28 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 31F40F869DE for ; Tue, 17 Apr 2018 07:10:28 +0000 (UTC) (envelope-from rumrunner@terraplane.org) Received: from nmsh7.e.nsc.no (nmsh7.e.nsc.no [148.123.160.201]) by mx1.freebsd.org (Postfix) with ESMTP id 923D16F77E for ; Tue, 17 Apr 2018 07:10:27 +0000 (UTC) (envelope-from rumrunner@terraplane.org) Received: from terraplane.org (ti0027a400-1628.bb.online.no [88.88.102.102]) by nmsh7.nsc.no (8.15.2/8.15.2) with ESMTPS id w3H6qlxI026474 (version=TLSv1 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT); Tue, 17 Apr 2018 08:52:51 +0200 Received: from terraplane.org (localhost [127.0.0.1]) by terraplane.org (8.14.5/8.14.5) with ESMTP id w3H6uIrg095879; Tue, 17 Apr 2018 08:56:18 +0200 (CEST) (envelope-from rumrunner@terraplane.org) Received: (from rumrunner@localhost) by terraplane.org (8.14.5/8.13.8/Submit) id w3H6uIGw095878; Tue, 17 Apr 2018 08:56:18 +0200 (CEST) (envelope-from rumrunner) Date: Tue, 17 Apr 2018 08:56:18 +0200 From: Eivind Nicolay Evensen To: George Mitchell Cc: freebsd-stable@freebsd.org Subject: Re: kern.sched.quantum: Creepy, sadistic scheduler Message-ID: <20180417065617.GA95646@klump.hjerdalen.lokalnett> References: <9FDC510B-49D0-4722-B695-6CD38CA20D4A@gmail.com> <8cfdb8a3-86a0-17ba-1e41-ff1912a30ee9@m5p.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <8cfdb8a3-86a0-17ba-1e41-ff1912a30ee9@m5p.com> X-Scanned-By: MIMEDefang 2.78 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Apr 2018 07:10:28 -0000 On Wed, Apr 04, 2018 at 09:32:58AM -0400, George Mitchell wrote: > On 04/04/18 06:39, Alban Hertroys wrote: > > [...] > > That said, SCHED_ULE (the default scheduler for quite a while now) was designed with multi-CPU configurations in mind and there are claims that SCHED_4BSD works better for single-CPU configurations. You may give that a try, if you're not already on SCHED_4BSD. > > [...] > > A small, disgruntled community of FreeBSD users who have never seen > proof that SCHED_ULE is better than SCHED_4BSD in any environment > continue to regularly recompile with SCHED_4BSD. I dread the day when > that becomes impossible, but at least it isn't here yet. -- George Indeed 4bsd is better in my case aswell. While for some unknown to me reason ule performed a bit better in the 10.x series than before, in 11.x it again is in my case not usable. Mouse freezes for around half a second with even frequency by just moving it around in x11. Using 4bsd instead makes the problem go away. I'm actually very happy that ule became worse again because going back to 4bsd yet again also gave improved performance from other dreadfully slow but (to me) still useful programs, like darktable. With 4bsd, when adjusting shadows and highlights it is possible to see what I do when moving sliders. With ule it has never been better than waiting 10-20-30 seconds to see where it was able to read a slider position and update display, when working on images around 10500x10500 greyscale. It's not single cpu/single core either: CPU: AMD FX(tm)-6300 Six-Core Processor (3817.45-MHz K8-class CPU) -- Eivind From owner-freebsd-stable@freebsd.org Tue Apr 17 09:30:25 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9B718F93100 for ; Tue, 17 Apr 2018 09:30:25 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from hz.grosbein.net (hz.grosbein.net [78.47.246.247]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 0886974F51 for ; Tue, 17 Apr 2018 09:30:24 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from eg.sd.rdtc.ru (root@eg.sd.rdtc.ru [62.231.161.221] (may be forged)) by hz.grosbein.net (8.15.2/8.15.2) with ESMTPS id w3H9UGMW056129 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Tue, 17 Apr 2018 11:30:17 +0200 (CEST) (envelope-from eugen@grosbein.net) X-Envelope-From: eugen@grosbein.net X-Envelope-To: Received: from eg.sd.rdtc.ru (eugen@localhost [127.0.0.1]) by eg.sd.rdtc.ru (8.15.2/8.15.2) with ESMTP id w3H9UDkS098777 for ; Tue, 17 Apr 2018 16:30:13 +0700 (+07) (envelope-from eugen@grosbein.net) To: FreeBSD Stable From: Eugene Grosbein Subject: stable/11 r332356 started panicing in bpf_dtor/__mtx_lock_sleep X-Enigmail-Draft-Status: N1110 Message-ID: <5AD5BEA5.6080306@grosbein.net> Date: Tue, 17 Apr 2018 16:30:13 +0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.4.0 MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=4.7 required=5.0 tests=BAYES_00, DATE_IN_FUTURE_96_Q, LOCAL_FROM, RDNS_NONE autolearn=no autolearn_force=no version=3.4.1 X-Spam-Report: * 2.5 DATE_IN_FUTURE_96_Q Date: is 4 days to 4 months after Received: date * -2.3 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 2.6 LOCAL_FROM From my domains * 1.9 RDNS_NONE Delivered to internal network by a host with no rDNS X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on hz.grosbein.net X-Spam-Level: **** X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Apr 2018 09:30:25 -0000 Hi! I have a server that was running stable/11 rock-stable for many months. A week ago I've updates it to 11.1-STABLE r332356 and today it paniced and I have crashdump. Any thoughts? Unread portion of the kernel message buffer: Sleeping thread (tid 100444, pid 28400) owns a non-sleepable lock KDB: stack backtrace of thread 100444: sched_switch() at sched_switch+0x626/frame 0xfffffe03550f9740 mi_switch() at mi_switch+0xc5/frame 0xfffffe03550f9770 sleepq_wait() at sleepq_wait+0x2c/frame 0xfffffe03550f97a0 _sx_xlock_hard() at _sx_xlock_hard+0x2f0/frame 0xfffffe03550f9830 vlan_ioctl() at vlan_ioctl+0x53f/frame 0xfffffe03550f98b0 ifpromisc() at ifpromisc+0x106/frame 0xfffffe03550f9910 bpf_detachd_locked() at bpf_detachd_locked+0x1b4/frame 0xfffffe03550f9960 bpf_dtor() at bpf_dtor+0x9a/frame 0xfffffe03550f9990 devfs_fpdrop() at devfs_fpdrop+0x9c/frame 0xfffffe03550f99b0 devfs_close_f() at devfs_close_f+0x45/frame 0xfffffe03550f99e0 closef() at closef+0x209/frame 0xfffffe03550f9a70 closefp() at closefp+0x8b/frame 0xfffffe03550f9ab0 amd64_syscall() at amd64_syscall+0x25c/frame 0xfffffe03550f9bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe03550f9bf0 --- syscall (6, FreeBSD ELF64, sys_close), rip = 0x4a317a, rsp = 0x7fffffffe3d8, rbp = 0x7fffffffe3f0 --- panic: sleeping thread cpuid = 1 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0354c6d7c0 vpanic() at vpanic+0x177/frame 0xfffffe0354c6d820 panic() at panic+0x43/frame 0xfffffe0354c6d880 propagate_priority() at propagate_priority+0x183/frame 0xfffffe0354c6d8b0 turnstile_wait() at turnstile_wait+0x2bc/frame 0xfffffe0354c6d900 __mtx_lock_sleep() at __mtx_lock_sleep+0x151/frame 0xfffffe0354c6d960 bpf_dtor() at bpf_dtor+0x191/frame 0xfffffe0354c6d990 devfs_fpdrop() at devfs_fpdrop+0x9c/frame 0xfffffe0354c6d9b0 devfs_close_f() at devfs_close_f+0x45/frame 0xfffffe0354c6d9e0 closef() at closef+0x209/frame 0xfffffe0354c6da70 closefp() at closefp+0x8b/frame 0xfffffe0354c6dab0 amd64_syscall() at amd64_syscall+0x25c/frame 0xfffffe0354c6dbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0354c6dbf0 --- syscall (6, FreeBSD ELF64, sys_close), rip = 0x4a317a, rsp = 0x7fffffffe3d8, rbp = 0x7fffffffe3f0 --- Uptime: 6d2h0m17s Dumping 1414 out of 12265 MB:..2%..11%..21%..31%..41%..51%..62%..71%..81%..91% (kgdb) bt #0 doadump (textdump=1) at pcpu.h:229 #1 0xffffffff804f3b9a in kern_reboot (howto=260) at /usr/local/src/sys/kern/kern_shutdown.c:383 #2 0xffffffff804f3f81 in vpanic (fmt=, ap=) at /usr/local/src/sys/kern/kern_shutdown.c:776 #3 0xffffffff804f3dc3 in panic (fmt=) at /usr/local/src/sys/kern/kern_shutdown.c:707 #4 0xffffffff80546b33 in propagate_priority (td=) at /usr/local/src/sys/kern/subr_turnstile.c:226 #5 0xffffffff8054720c in turnstile_wait (ts=0xfffff80151ac4180, owner=, queue=) at /usr/local/src/sys/kern/subr_turnstile.c:742 #6 0xffffffff804dda81 in __mtx_lock_sleep (c=0xffffffff80c9c910, v=) at /usr/local/src/sys/kern/kern_mutex.c:627 #7 0xffffffff805cd061 in bpf_dtor (data=0xfffff801512df800) at /usr/local/src/sys/net/bpf.c:778 #8 0xffffffff80455e5c in devfs_fpdrop (fp=) at /usr/local/src/sys/fs/devfs/devfs_vnops.c:193 #9 0xffffffff804595d5 in devfs_close_f (fp=0xfffff802af2fe6e0, td=) at /usr/local/src/sys/fs/devfs/devfs_vnops.c:675 #10 0xffffffff804b1549 in closef (fp=0xfffff802af2fe6e0, td=0xfffff8000cf75000) at file.h:346 #11 0xffffffff804af00b in closefp (fdp=0xfffff80083b48000, fd=, fp=0xfffff802af2fe6e0, td=0xfffff8000cf75000, holdleaders=0) at /usr/local/src/sys/kern/kern_descrip.c:1191 #12 0xffffffff807afb6c in amd64_syscall (td=0xfffff8000cf75000, traced=0) at subr_syscall.c:132 #13 0xffffffff80791c3d in fast_syscall_common () at /usr/local/src/sys/amd64/amd64/exception.S:480 #14 0x00000000004a317a in ?? () Previous frame inner to this frame (corrupt stack?) From owner-freebsd-stable@freebsd.org Tue Apr 17 11:00:10 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2AFFCF99A52 for ; Tue, 17 Apr 2018 11:00:10 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from hz.grosbein.net (hz.grosbein.net [78.47.246.247]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 751076A015; Tue, 17 Apr 2018 11:00:09 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from eg.sd.rdtc.ru (root@eg.sd.rdtc.ru [62.231.161.221] (may be forged)) by hz.grosbein.net (8.15.2/8.15.2) with ESMTPS id w3HB01Wo056928 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Tue, 17 Apr 2018 13:00:01 +0200 (CEST) (envelope-from eugen@grosbein.net) X-Envelope-From: eugen@grosbein.net X-Envelope-To: freebsd-stable@FreeBSD.org Received: from eg.sd.rdtc.ru (eugen@localhost [127.0.0.1]) by eg.sd.rdtc.ru (8.15.2/8.15.2) with ESMTP id w3HAxqqJ000153; Tue, 17 Apr 2018 17:59:52 +0700 (+07) (envelope-from eugen@grosbein.net) Subject: Re: stable/11 r332356 started panicing in bpf_dtor/__mtx_lock_sleep To: FreeBSD Stable References: <5AD5BEA5.6080306@grosbein.net> Cc: Matt Joras From: Eugene Grosbein X-Enigmail-Draft-Status: N1110 Message-ID: <5AD5D3A8.4060204@grosbein.net> Date: Tue, 17 Apr 2018 17:59:52 +0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.4.0 MIME-Version: 1.0 In-Reply-To: <5AD5BEA5.6080306@grosbein.net> Content-Type: text/plain; charset=koi8-r Content-Transfer-Encoding: 8bit X-Spam-Status: No, score=4.7 required=5.0 tests=BAYES_00, DATE_IN_FUTURE_96_Q, LOCAL_FROM, RDNS_NONE autolearn=no autolearn_force=no version=3.4.1 X-Spam-Report: * 2.5 DATE_IN_FUTURE_96_Q Date: is 4 days to 4 months after Received: date * -2.3 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 2.6 LOCAL_FROM From my domains * 1.9 RDNS_NONE Delivered to internal network by a host with no rDNS X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on hz.grosbein.net X-Spam-Level: **** X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Apr 2018 11:00:10 -0000 On 17.04.2018 16:30, Eugene Grosbein wrote: CCing mjoras@ as author of suspicious change https://svnweb.freebsd.org/base?view=revision&revision=323477 > I have a server that was running stable/11 rock-stable for many months. It was running stable/11 r314043 before last update. > A week ago I've updates it to 11.1-STABLE r332356 and today it paniced and I have crashdump. > Any thoughts? > > Unread portion of the kernel message buffer: > Sleeping thread (tid 100444, pid 28400) owns a non-sleepable lock > KDB: stack backtrace of thread 100444: > sched_switch() at sched_switch+0x626/frame 0xfffffe03550f9740 > mi_switch() at mi_switch+0xc5/frame 0xfffffe03550f9770 > sleepq_wait() at sleepq_wait+0x2c/frame 0xfffffe03550f97a0 > _sx_xlock_hard() at _sx_xlock_hard+0x2f0/frame 0xfffffe03550f9830 > vlan_ioctl() at vlan_ioctl+0x53f/frame 0xfffffe03550f98b0 > ifpromisc() at ifpromisc+0x106/frame 0xfffffe03550f9910 > bpf_detachd_locked() at bpf_detachd_locked+0x1b4/frame 0xfffffe03550f9960 > bpf_dtor() at bpf_dtor+0x9a/frame 0xfffffe03550f9990 > devfs_fpdrop() at devfs_fpdrop+0x9c/frame 0xfffffe03550f99b0 > devfs_close_f() at devfs_close_f+0x45/frame 0xfffffe03550f99e0 > closef() at closef+0x209/frame 0xfffffe03550f9a70 > closefp() at closefp+0x8b/frame 0xfffffe03550f9ab0 > amd64_syscall() at amd64_syscall+0x25c/frame 0xfffffe03550f9bf0 > fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe03550f9bf0 > --- syscall (6, FreeBSD ELF64, sys_close), rip = 0x4a317a, rsp = 0x7fffffffe3d8, rbp = 0x7fffffffe3f0 --- > panic: sleeping thread > cpuid = 1 > KDB: stack backtrace: > db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0354c6d7c0 > vpanic() at vpanic+0x177/frame 0xfffffe0354c6d820 > panic() at panic+0x43/frame 0xfffffe0354c6d880 > propagate_priority() at propagate_priority+0x183/frame 0xfffffe0354c6d8b0 > turnstile_wait() at turnstile_wait+0x2bc/frame 0xfffffe0354c6d900 > __mtx_lock_sleep() at __mtx_lock_sleep+0x151/frame 0xfffffe0354c6d960 > bpf_dtor() at bpf_dtor+0x191/frame 0xfffffe0354c6d990 > devfs_fpdrop() at devfs_fpdrop+0x9c/frame 0xfffffe0354c6d9b0 > devfs_close_f() at devfs_close_f+0x45/frame 0xfffffe0354c6d9e0 > closef() at closef+0x209/frame 0xfffffe0354c6da70 > closefp() at closefp+0x8b/frame 0xfffffe0354c6dab0 > amd64_syscall() at amd64_syscall+0x25c/frame 0xfffffe0354c6dbf0 > fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0354c6dbf0 > --- syscall (6, FreeBSD ELF64, sys_close), rip = 0x4a317a, rsp = 0x7fffffffe3d8, rbp = 0x7fffffffe3f0 --- > Uptime: 6d2h0m17s > Dumping 1414 out of 12265 MB:..2%..11%..21%..31%..41%..51%..62%..71%..81%..91% > > > (kgdb) bt > #0 doadump (textdump=1) at pcpu.h:229 > #1 0xffffffff804f3b9a in kern_reboot (howto=260) at /usr/local/src/sys/kern/kern_shutdown.c:383 > #2 0xffffffff804f3f81 in vpanic (fmt=, ap=) > at /usr/local/src/sys/kern/kern_shutdown.c:776 > #3 0xffffffff804f3dc3 in panic (fmt=) at /usr/local/src/sys/kern/kern_shutdown.c:707 > #4 0xffffffff80546b33 in propagate_priority (td=) at /usr/local/src/sys/kern/subr_turnstile.c:226 > #5 0xffffffff8054720c in turnstile_wait (ts=0xfffff80151ac4180, owner=, queue=) > at /usr/local/src/sys/kern/subr_turnstile.c:742 > #6 0xffffffff804dda81 in __mtx_lock_sleep (c=0xffffffff80c9c910, v=) > at /usr/local/src/sys/kern/kern_mutex.c:627 > #7 0xffffffff805cd061 in bpf_dtor (data=0xfffff801512df800) at /usr/local/src/sys/net/bpf.c:778 > #8 0xffffffff80455e5c in devfs_fpdrop (fp=) at /usr/local/src/sys/fs/devfs/devfs_vnops.c:193 > #9 0xffffffff804595d5 in devfs_close_f (fp=0xfffff802af2fe6e0, td=) > at /usr/local/src/sys/fs/devfs/devfs_vnops.c:675 > #10 0xffffffff804b1549 in closef (fp=0xfffff802af2fe6e0, td=0xfffff8000cf75000) at file.h:346 > #11 0xffffffff804af00b in closefp (fdp=0xfffff80083b48000, fd=, fp=0xfffff802af2fe6e0, > td=0xfffff8000cf75000, holdleaders=0) at /usr/local/src/sys/kern/kern_descrip.c:1191 > #12 0xffffffff807afb6c in amd64_syscall (td=0xfffff8000cf75000, traced=0) at subr_syscall.c:132 > #13 0xffffffff80791c3d in fast_syscall_common () at /usr/local/src/sys/amd64/amd64/exception.S:480 > #14 0x00000000004a317a in ?? () > Previous frame inner to this frame (corrupt stack?) Some more details: this monitoring server has many vlans over em1. It runs some custom perl code utilizing Net::Pcap over bpf. Many times per minute it opens/closes bpf to send/receive custom PPPoE frames using vlans (sends over multiple if_vlan and receives using their parent em1). This server also multiple times per minute starts and stops receiving IPTV multicast traffic using another em0 interface as part of another monitoring job. Again, r314043 was pretty stable. From owner-freebsd-stable@freebsd.org Tue Apr 17 03:48:21 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 61BCFFA1405 for ; Tue, 17 Apr 2018 03:48:20 +0000 (UTC) (envelope-from sukenwoo@icloud.com) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 96FF681BA0 for ; Tue, 17 Apr 2018 03:48:18 +0000 (UTC) (envelope-from sukenwoo@icloud.com) Received: by mailman.ysv.freebsd.org (Postfix) id 50D9EFA13FB; Tue, 17 Apr 2018 03:48:18 +0000 (UTC) Delivered-To: stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E2CB7FA13F9; Tue, 17 Apr 2018 03:48:16 +0000 (UTC) (envelope-from sukenwoo@icloud.com) Received: from mr25p46im-ztdg02111301.me.com (mr25p46im-ztdg02111301.me.com [17.111.255.92]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 243BC81B4E; Tue, 17 Apr 2018 03:48:16 +0000 (UTC) (envelope-from sukenwoo@icloud.com) Received: from process-dkim-sign-daemon.mr25p46im-ztdg02111301.me.com by mr25p46im-ztdg02111301.me.com (Oracle Communications Messaging Server 8.0.1.2.20170607 64bit (built Jun 7 2017)) id <0P7B00O006ELT500@mr25p46im-ztdg02111301.me.com>; Tue, 17 Apr 2018 02:48:09 +0000 (GMT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=icloud.com; s=04042017; t=1523933289; bh=z15XBb6YlBUzJK7q2G4LEIx+8frf0kN+JXYp81ecj+k=; h=From:Content-type:MIME-version:Subject:Message-id:Date:To; b=tVkYutz5dPCxIG79lgJmeC2ljqDrXNroFi+P8ulg2ayNRDOtW9FWVcZMRrSL+ftWf yHDqY6K5DPMAvVKBS7ooQxWiaFwOVdQfNvc+Fw6SmUQwVnrjUkfhDyBka2tSg+/2Cy Hlz5mbb9sPGzmo9rh9TPFUJQ/kKFeA8R2Um8pYOw9c4OR9uT4pJObzJLNvVt4fb2LB wFSOIG0IXLftTy/Q2Wuqn/ulY5q83+fuaet2s7Vgd8EhAJ56vQp81CQAbUvegcRJFT pl5gWb4VwQxR0cLKQ6bxn1+V433wpKcg1XKafQzsJLcOXzVs2HcBDPk9AIGVrukA29 qS+1FlepkEAWg== Received: from icloud.com ([127.0.0.1]) by mr25p46im-ztdg02111301.me.com (Oracle Communications Messaging Server 8.0.1.2.20170607 64bit (built Jun 7 2017)) with ESMTPSA id <0P7B0016A6FQS220@mr25p46im-ztdg02111301.me.com>; Tue, 17 Apr 2018 02:48:09 +0000 (GMT) X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10432:,, definitions=2018-04-17_01:,, signatures=0 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 spamscore=0 clxscore=1011 suspectscore=8 malwarescore=0 phishscore=0 adultscore=0 bulkscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.0.1-1707230000 definitions=main-1804170026 From: =?GB2312?B?zuLK5cCk?= Content-type: multipart/mixed; boundary=Apple-Mail-3D3635AF-94A6-4985-B8A8-22AE9E836605 Content-transfer-encoding: 7bit MIME-version: 1.0 (1.0) Subject: 11.1 stable r321309 loader.efi boot faile Message-id: Date: Tue, 17 Apr 2018 10:47:49 +0800 References: <5095E8EF-05BC-4D16-B5D0-7169BF71FEB8@gddsn.org.cn> To: current@freebsd.org, stable@freebsd.org X-Mailer: iPhone Mail (13G34) X-Mailman-Approved-At: Tue, 17 Apr 2018 11:22:54 +0000 X-Content-Filtered-By: Mailman/MimeDel 2.1.25 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Apr 2018 03:48:21 -0000 --Apple-Mail-3D3635AF-94A6-4985-B8A8-22AE9E836605 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit >> freebsd 11.1 stable r321309 boot failed >> loader.efi recognize efipart as new disk on MacBook pro mid 2015 --Apple-Mail-3D3635AF-94A6-4985-B8A8-22AE9E836605 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit >> --Apple-Mail-3D3635AF-94A6-4985-B8A8-22AE9E836605 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit >> --Apple-Mail-3D3635AF-94A6-4985-B8A8-22AE9E836605 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit >> >> > --Apple-Mail-3D3635AF-94A6-4985-B8A8-22AE9E836605-- From owner-freebsd-stable@freebsd.org Tue Apr 17 14:12:47 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id AF5F2FA65F3 for ; Tue, 17 Apr 2018 14:12:47 +0000 (UTC) (envelope-from george+freebsd@m5p.com) Received: from mailhost.m5p.com (mailhost.m5p.com [74.104.188.4]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "m5p.com", Issuer "Let's Encrypt Authority X3" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 425EF76B47 for ; Tue, 17 Apr 2018 14:12:47 +0000 (UTC) (envelope-from george+freebsd@m5p.com) Received: from [IPv6:2001:470:1f07:15ff::1f] (haymarket.m5p.com [IPv6:2001:470:1f07:15ff::1f]) (authenticated bits=0) by mailhost.m5p.com (8.15.2/8.15.2) with ESMTPSA id w3HE6mqM061427 (version=TLSv1.2 cipher=DHE-RSA-AES128-SHA bits=128 verify=NO) for ; Tue, 17 Apr 2018 10:06:58 -0400 (EDT) (envelope-from george+freebsd@m5p.com) From: George Mitchell Subject: more data: SCHED_ULE+PREEMPTION is the problem To: freebsd-stable@freebsd.org References: Openpgp: preference=signencrypt Autocrypt: addr=george+freebsd@m5p.com; prefer-encrypt=mutual; keydata= xsFNBFgnLnwBEADAJDiBKQX77LFRz9wZW8mz3KvaQol2nIremcws0F1mz/zgFlk6uhQVtwnL wb4XL5LdFwcNE1+QZzPLcbYWoWQlz0lBw1bMuKAgr0S6V2e0+I0DqhKeslVFctcTwtvT6pnK VLZXO/7ZGAaLzG4K5vSPzgoevU+YI/pxNsVCH2UO/c3jQW63uEt25mIZbCF1Pu4jgp4RhIgF ujn877r/j6OwBwjzRUu3E6ADp+U825d+5YCuQMEH0wIPnn9GTpXvfdKdbwOIl2akqXqs4cnk iATWfK3r6D4mvDEj1OPHlTvJYcfic7aOIiAwmx1C1v78GjXOdOOA0SGffNix3C2/8oZUO1+V Aet4MKpUKkduWSvULhIkHNZ5Nu8SIJOqge8pmtHxuNXAMfMrAjMdjPwwBFLsYg3Xa2E2oJwg ehTauwd/EDJFcVCyDCyCAYOi/BH/+XQyxzgDlY9N9qj9tHqhVPI6XK7t8UVffGiZUq4rHp5J RdOToqiTNC6eCJBczhMIW+DuFvWU9e6W708T1dz0Accn6Lrgk4eRIn3GFPBG+TxnpjAqHsbW 607dcnD3YKAqY4e+khczL4EObhe7dC1v2fmZiAC6Ds3WHR11IfqoUgCkIwJ590Ej+ElygJFF XxI82wtEz9hkeLLvItpyEJNVjppViRW+Dgl/U7ypHB3qDgYjgwARAQABzSBHZW9yZ2UgTWl0 Y2hlbGwgPGdlb3JnZUBtNXAuY29tPsLBlwQTAQgAQQIbIwUJCWYBgAULCQgHAgYVCAkKCwIE FgIDAQIeAQIXgBYhBDXTOGR5LbCVuZCmV8EREt5vqeH5BQJYWXFRAhkBAAoJEMEREt5vqeH5 SRsQAIb/crcxXyAyeokAuTjN+YXkEFdVv/JrOgNXKdCukXt/UGd3nZTcAzpllytDIvIlPTNI 2/nZ5sm6ymeyVwmvkrM/r3sRUib5ftakJpbv0wn2j+eCGAca8IA2frBUg9bEXKcHRJRQCztG cpousHzOziTCRQ/1NfPcIFBNbQMPUVoQ96cJPvM/XfFGOISKKsSI78skHm6Oazh1hLCQTKvy hNNgVpNP/PHCHMbla1+SNgyn35CUelTh153lnkOhw1XyX6IxY4o5Bhcf3YrxAVcoeHq3FEH0 T3ygAdI14VrZGXXitBAMI78QLB0FiWMoPQ3Oddnoh6tlT4djnsc9IW0Tzk6ozvQL7sKdYgO8 ZlIpkBqQQfpSHzwPu9EkOFggPWB9WtP3IajQ0lt1LovqMug4C8APRC2/1cvi+GUIRwjVsop0 ukhlLTTJd3/S4Muh3s87M4Rdek1xpOiMKjYOVaxmhQQ91oz971zJuJJWpX7uUQiXx9oEwCDW TvI5yEuqYLsMUwx3d2iFTr+HbtlBJmF+Vguyrn/a3vFK8P/TH9fMvNeTdln9SuOOa1SAMMcy czOpBYg9RpzNLshUJVrhKzugT59Rl2wsNQsQCUkzgF3f8cZHJyl+8x6t0nuM9LTkMv13YIXS Mde3UOD2EaBhmeIqvC/adQHxpNudvxM1viFJDnTnzsFNBFgnLnwBEAC7kzsZqjBRPonnr/63 C98FSa3LikvqQWygmPSCC9DsFX/fB0CSXIHTrHQ4a7lXdfZyTZcGdxXN+MC8O8thjvVq6WYm CpyOJ/bq4SxOa9cnQSJ5SP9VCmVoDN/3T4ybXFzLAt756kfQ5jsVuP0m6iQ4z918zhZXk+Mo qdwGjYTxsBD02a7m1aeYafyaI2mZ+vdEy0cDhV4PDXI6ThLNAavTPji6ZrBdH5a4LMg30u8v kkNe0eCKvU+0cWb2VQIeddMhhiGSBE2Dv+A4eNe1VZvoGpLDlYdnoHraVFL2GHNFGymj/uRf 1hja5kW9Rekisqby5SpGABwrFFEs7ABpfYG0IRBKbjjG1Cqdfe/R6ETJFvvNOOpCKPAWeqYf Isxv4OHWTmhKihhIanYWCAe1MDLRRbj7UrOTZeia2WJ4v58xbU5rVQoHI/Tzaq86rXzRWITc 5w+kresMad0zpvQ900BdHc8ATNY2aW/Fr5it5OqMvIW6Y4gc8Z95MkQPVc8vj3WzfxuWtZNK 6Wbv4r6Qbiwg1RpY1JoEIoF4OsZJOVMQaB6ezD7xvaa2eY6nRGtq9SoJxo2qvlSbLlKq8NdH VYHhtTbpQ1NfrEJfv5sLX5W5IpoYww48bFYH67+7r1f/W3voBptSgE7qnYAm6Em9bEAKOQEX 8BXwoa54fn03z6TyhwARAQABwsFkBBgBCAAPBQJYJy58AhsMBQkJZgGAAAoJEMEREt5vqeH5 6PcP+JvrMM7ZM8UlnbrY4Er9psPj3ayllRhQFA9h6GNUKYuSzSxOrPaT96s8KUGMCr4jrn1S WFmeeNLLOgSJmQRicMh6LmnKq6WY6UaOfn7Y9O62NUjXfEI3Bw4ID36YCdQ+CJd14r0YOf4M 5F50bvHV3lbzD9TXZPxecHKC2ZUMBbT37tsckWCLL3lzKMsqQLwBUmgBl1NIUc7gyXxiNyxb 6SPVF1NguDDM438mcg9jSRAyjgAk6POUEM8YIXkw0Gg6HF1tNMJJ1xTMBCLYl6fHTtsxJpf9 yo+Hnw346hqYzXn4ytHJ49Ngcre8uhqM1l8iMpa17tEjfalkc1FWR9/qvoowOKtxpvblsy3a YzeEFgIomhLzISz6IafQ3S7Mt5AFlqwN/qQHx0k2V66GzDG0ngZBPROP1sXSpdJzO0zbJQFn MZE3f+y8vXMcE/MBXR7kAdYYApiEMQzVxy9TdQDU3lGLptcPZ1IOntTNFFrvp5NwsKi+6C9i mXtd5kJ1PwhcJYW3/ov/490l60C5SFUL/RZ/NOW8SHFaPcqlGcqIlexFKbzrMQwmYXo95jWB eZ0Qn+raxCUFZNGiwtusyQGBMcpHVJUanOCNd1z4ZbfmhUjDJKC/7YWDunvaDRSukGiRCl6J s8caqXHiVZjx+s76iWzm6AHRP5jg9D6EtTOrGiE= Message-ID: Date: Tue, 17 Apr 2018 10:06:47 -0400 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:52.0) Gecko/20100101 Thunderbird/52.7.0 MIME-Version: 1.0 In-Reply-To: Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="y8wTAHtxYHx9ysmdBA2s1Y1q2cunFfqS9" X-Spam-Status: No, score=0.2 required=10.0 tests=HELO_MISC_IP, RP_MATCHES_RCVD autolearn=no autolearn_force=no version=3.4.1 X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on mattapan.m5p.com X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.6.2 (mailhost.m5p.com [IPv6:2001:470:1f07:15ff::f7]); Tue, 17 Apr 2018 10:07:04 -0400 (EDT) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Apr 2018 14:12:47 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --y8wTAHtxYHx9ysmdBA2s1Y1q2cunFfqS9 Content-Type: multipart/mixed; boundary="KFC0dGtENmQVZ6oo5TwgAyShvsXQBBeeF"; protected-headers="v1" From: George Mitchell To: freebsd-stable@freebsd.org Message-ID: Subject: more data: SCHED_ULE+PREEMPTION is the problem References: In-Reply-To: --KFC0dGtENmQVZ6oo5TwgAyShvsXQBBeeF Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: quoted-printable On 04/07/18 10:18, Peter wrote: > Hi all, > [...] Thanks for all the investigation! > 3. kern.sched.preempt_thresh >=20 > I could make the problem disappear by changing kern.sched.preempt_thres= h > =C2=A0from the default 80 to either 11 (i5-3570T) or 7 (p3) or smaller.= This > seems to correspond to the disk interrupt threads, which run at intr:12= > (i5-3570T) or intr:8 (p3). > [...] More data. With SCHED_4BSD at FreeBSD 10.4-RELEASE-p8 #0 r331984: kern.sched.runq_fuzz: 1 kern.sched.ipiwakeup.useloop: 0 kern.sched.ipiwakeup.usemask: 1 kern.sched.ipiwakeup.delivered: 376139898 kern.sched.ipiwakeup.requested: 376137875 kern.sched.ipiwakeup.enabled: 1 kern.sched.slice: 12 kern.sched.quantum: 94488 kern.sched.name: 4BSD kern.sched.preemption: 1 kern.sched.cpusetsize: 8 With dnetc running on a 6-core AMD CPU from a few years back, "time make buildworld" yields: 6640.224u 828.874s 2:14:37.73 92.4% 28525+494k 31633+431554io 33192pf= +0w I shifted to a GENERIC kernel, FreeBSD 10.4-RELEASE-p8 #0 r332560: kern.sched.topology_spec: 0, 1, 2, 3, 4, 5 0, 1, 2, 3, 4, 5 kern.sched.steal_thresh: 2 kern.sched.steal_idle: 1 kern.sched.balance_interval: 127 kern.sched.balance: 1 kern.sched.affinity: 1 kern.sched.idlespinthresh: 157 kern.sched.idlespins: 10000 kern.sched.static_boost: 152 kern.sched.preempt_thresh: 80 kern.sched.interact: 30 kern.sched.slice: 12 kern.sched.quantum: 94488 kern.sched.name: ULE kern.sched.preemption: 1 kern.sched.cpusetsize: 8 I stupidly typed "make buildworld" without the "time" command, but the build log started at Mon Apr 16 13:49:12 EDT 2018 and completed at Tue Apr 17 00:22:23 EDT 2018. You read that right: 2+ hours vs 10 1/2! So I set "sysctl kern.sched.preempt_thresh=3D5" (a wild guess on my part)= and started another "time make buildworld". It's still going now, but subjectively it's still running like molasses. I'll post more results later after trying sysctl kern.sched.preempt_thresh=3D0. By the way, over the years that this discussion has been going on, I've *never* had a response to my question: "What is the workload for which SCHED_ULE outperforms SCHED_4BSD?" -- George --KFC0dGtENmQVZ6oo5TwgAyShvsXQBBeeF-- --y8wTAHtxYHx9ysmdBA2s1Y1q2cunFfqS9 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEENdM4ZHktsJW5kKZXwRES3m+p4fkFAlrV/3gACgkQwRES3m+p 4fk36A//TpmVboHGSjflyl0kawaWT8m/fljSn3qWttRmZqSiAilUXpnAAm8rn6gU 5f9SfqmBLtkeyrnZrNCeVA92VSfQb7pp8NkA5jEoXhp+n+qhuj2qEc2M9ddCRaI7 AGoFjcdMUlPipYQpvcL0y2FtAc7yOawm98LgjhIM+cE1pvSY3tAWKeWqqgn6yCp4 jIc89UrJgRuVEGcdYta0Pbr5ahjV7yO2FRb7fuVz8rl9xfOG+p3JaLjQDEGzpiVu l3YsM/vtTVxqasbCkhM9ueL9ex/Dqy7U1368IyTXXaPvSpCCUg98ThLMUl8My+MQ kVNGWHXkmLhzzTCoVyvwhP7B+X9OWyl+Dq8Hs+XejpK5PlmejHhLfP2CICQgGmpT F0zMfJZQCi8b/Yv7GdfhGBCPTMS5wk6xUHkxGZrpSDYf4yS4luovJ+D+fvCeYyQp y3EHSpFAgXlgMJo/JMYQ3rVULSPBDt9pxDjq5zdmOq7V6BLTL1bzQuR/qyUSnzgS WtCsj6FMwBS0nYqnaAOMnEb5M8ujajD/Qc2rE7GajgyPen46PLKAZ85foiK3DbBq yGr0kVtLgUnCk+fvpddjTjMNNrCJCd/QmgeLE4Gk6vo7oQ6EyBG5xeM8WR0q03z2 pUHzDbgf1TW7w9hSy5K7+Cx7CDBLhI4JynjdvL+CeWxgcyt8gFc= =kEHm -----END PGP SIGNATURE----- --y8wTAHtxYHx9ysmdBA2s1Y1q2cunFfqS9-- From owner-freebsd-stable@freebsd.org Tue Apr 17 14:30:56 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 16543FA7508 for ; Tue, 17 Apr 2018 14:30:56 +0000 (UTC) (envelope-from gemma.white@collabratesuite.com) Received: from mail-io0-x245.google.com (mail-io0-x245.google.com [IPv6:2607:f8b0:4001:c06::245]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 9E3D479D26 for ; Tue, 17 Apr 2018 14:30:55 +0000 (UTC) (envelope-from gemma.white@collabratesuite.com) Received: by mail-io0-x245.google.com with SMTP id o132so16946359iod.11 for ; Tue, 17 Apr 2018 07:30:55 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=collabratesuite-com.20150623.gappssmtp.com; s=20150623; h=mime-version:message-id:date:subject:from:to; bh=PtdtC5VOmfTgSHK+YmES4RKCIMZDHUovkvIDtseMdPs=; b=AWVWSpM2UmsWVzSsi7YD7X6iO5QQe0D7LKbqP86v8NUHeH8U3+BGHOvLBikQm7Nzit O/avhbR9/leU2AkvkGuowB+g4Wxu+rfDJbbiy2hNvRf39bDbAgLZJiwW18lo9ujbwUfA VPVSiShREZbOqRKp41x1w1HpJ+qcE2DtmmKQAL9WXX/W3KqeMkUSYfZ70MxicaY/Rkkk r7OP/OU178e0Ll4OcJSd67deid4TspYB8jkvzjWqlwXosDZv+Wz6k0z31iDCWt2iB5V5 cYkTlG2AiWSdSC8X1LcCmms93HxB6Vz7X6kVXjzLtFfXrirWBGCtGjrRQM63s43AL5Ff et0g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:message-id:date:subject:from:to; bh=PtdtC5VOmfTgSHK+YmES4RKCIMZDHUovkvIDtseMdPs=; b=c/9mTZV4St6eyGBQ/K4m2GU13F5VSvgz3Uq/2plFmsmxoqfSZ+ogcueOkhXKn55zHW nMSwDA/WRC4+bVSszS1zdKj/t7y4JBaYwpsAMejHNFYiMGAW2aBOBzJalodrvNTa6Ivp EnJvKf/O6Cd2dRidu9+wvJy8+PD2f98mEx2Kb7K7G5Nrb/3lYcns9qFk7wLZZil/f7ie 4ajEa9z3pxaUtWSOrKiUeF/BvljtnkO2b129P+ufpg1k6DCXhd54bMllbfOO7/c8BRqf 5BcEXyB4IaikhHvcUzRwkBDwTtKUbnMPrE94068NcW+IltiBZJMPlPaRGMR2LbwAAz3p Cpww== X-Gm-Message-State: ALQs6tAvyOihbiy/RaYwZCfNYoszAgtVCNLioMZJ6xNIVC9tJ/9BYWIK +kA9MTZFlRp16nZSHS7+Pwy0UBZVslu/ X-Google-Smtp-Source: AIpwx49oqjy95jV8KIO82FZ9wIFSyBsa4Jx+bWEq7ondptZD6Ctn6g4nu2FKzM0h4WFMqXYK3OHe11kIeA== MIME-Version: 1.0 X-Received: by 2002:a24:2c90:: with SMTP id i138-v6mr665970iti.10.1523975455054; Tue, 17 Apr 2018 07:30:55 -0700 (PDT) Message-ID: <000000000000a546bb056a0c2f49@google.com> Date: Tue, 17 Apr 2018 14:30:55 +0000 Subject: CentOs Competitors Users Contact List. From: gemma.white@collabratesuite.com To: freebsd-stable@freebsd.org Content-Type: text/plain; charset="UTF-8"; format=flowed; delsp=yes Content-Transfer-Encoding: base64 X-Content-Filtered-By: Mailman/MimeDel 2.1.25 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Apr 2018 14:30:56 -0000 PGRpdiBkaXI9Imx0ciI+PHAgY2xhc3M9ImdtYWlsLU1zb05vU3BhY2luZyI+PHNwYW4gIA0Kc3R5 bGU9ImNvbG9yOnJnYigzMSw3OCwxMjEpIj5IZWxsbyw8L3NwYW4+PC9wPg0KDQo8cCBjbGFzcz0i Z21haWwtTXNvTm9TcGFjaW5nIj48c3BhbiBzdHlsZT0iY29sb3I6cmdiKDMxLDc4LDEyMSkiPldv dWxkIHlvdQ0KYmUgaW50ZXJlc3RlZCBpbiA8Yj5DZW50T1MgKExpbnV4KSBVc2Vycw0KTGlzdDwv Yj4/IFdlIGFyZSBhIEdsb2JhbCBUZWNobm9sb2d5IFVzZXLigJlzIExpc3QgUHJvdmlkZXLigJlz IHdpdGggOTAgTWlsbGlvbg0KUGx1cyBkYXRhIGFuZCBjb3VudGluZy48L3NwYW4+PC9wPg0KDQo8 cCBjbGFzcz0iZ21haWwtTXNvTm9TcGFjaW5nIj48Yj48c3BhbiBzdHlsZT0iY29sb3I6cmdiKDMx LDc4LDEyMSkiPllvdSBtYXkgIA0KYWxzbyBhY3F1aXJlIHRoZQ0KYWx0ZXJuYXRpdmVzIHN1Y2gg YXM8L3NwYW4+PC9iPjxzcGFuIHN0eWxlPSJjb2xvcjpyZ2IoMzEsNzgsMTIxKSI+OiBXaW5kb3dz ICANClNlcnZlciB1c2VycyBMaXN0LCBPcmFjbGUgTGludXggdXNlcnMgTGlzdCzCoDwvc3Bhbj48 c3BhbiAgDQpzdHlsZT0iY29sb3I6cmdiKDMxLDc4LDEyMSkiPlVidW50dQ0KTGludXggdXNlcnMg TGlzdCwgU3VzZSBMaW51eCB1c2VycyBMaXN0LCBPcmFjbGUgU29sYXJpcyB1c2VycyBMaXN0IGFu ZCBtYW55DQptb3JlLjwvc3Bhbj48L3A+DQoNCjxwIGNsYXNzPSJnbWFpbC1Nc29Ob1NwYWNpbmci PjxiPjxzcGFuIHN0eWxlPSJjb2xvcjpyZ2IoMzEsNzgsMTIxKSI+TGlzdA0KQ29udGFpbnM6PC9z cGFuPjwvYj48c3BhbiBzdHlsZT0iY29sb3I6cmdiKDMxLDc4LDEyMSkiPsKgTmFtZSwNCkNvbXBh bnkmIzM5O3MgTmFtZSwgUGhvbmUgTnVtYmVyLCBGYXggTnVtYmVyLCBKb2IgVGl0bGUsIEVtYWls IGFkZHJlc3MsICANCkNvbXBsZXRlDQpNYWlsaW5nIEFkZHJlc3MsIFNJQyBjb2RlLCBDb21wYW55 IHJldmVudWUsIHNpemUsIFdlYiBhZGRyZXNzIGV0Yy4gQWxsDQpUZWNobm9sb2d5IC8gQ29tcGFu aWVzIFBhcnRuZXJzIGFuZCBVc2VycyBMaXN0LCBJVCBkZWNpc2lvbiBNYWtlcnMgZnJvbSAgDQpG b3J0dW5lDQo1MDAgQ29tcGFuaWVzLCBJVCBEZWNpc2lvbiBNYWtlcnMgZnJvbSBTTUUgYXMgd2Vs bC48L3NwYW4+PC9wPg0KDQo8cCBjbGFzcz0iTXNvTm9ybWFsIiAgDQpzdHlsZT0ibWFyZ2luLWJv dHRvbTowLjAwMDFwdDtsaW5lLWhlaWdodDpub3JtYWwiPjxzcGFuICANCnN0eWxlPSJjb2xvcjpy Z2IoMzEsNzgsMTIxKSI+V2UgcHJvdmlkZSBkYXRhIGFjcm9zcyB0aGUgZ2xvYmUgLSA8Yj5Ob3J0 aCAgDQpBbWVyaWNhLCBFTUVBLCBBc2lhIFBhY2lmaWMgYW5kIExBVEFNLjwvYj48L3NwYW4+PC9w Pg0KDQo8cCBjbGFzcz0iZ21haWwtTXNvTm9TcGFjaW5nIj48c3BhbiBzdHlsZT0iY29sb3I6cmdi KDMxLDc4LDEyMSkiPlBsZWFzZSBsZXQNCnVzIGtub3cgeW91ciB0YXJnZXRlZCBjcml0ZXJpYSBh bmQgZ2VvZ3JhcGh5IHRvIHByb3ZpZGUgeW91IHdpdGggZGV0YWlsZWQNCmluZm9ybWF0aW9uIGZv ciB5b3VyIHJldmlldy48L3NwYW4+PC9wPg0KDQo8cCBjbGFzcz0iZ21haWwtTXNvTm9TcGFjaW5n Ij48c3BhbiBzdHlsZT0iY29sb3I6cmdiKDMxLDc4LDEyMSkiPkxldCBtZQ0Ka25vdyB5b3VyIHRo b3VnaHRzITwvc3Bhbj48L3A+DQoNCjxwIGNsYXNzPSJnbWFpbC1Nc29Ob1NwYWNpbmciPjxzcGFu ICANCnN0eWxlPSJjb2xvcjpyZ2IoMzEsNzgsMTIxKSI+VGhhbmtzLDxzcGFuPjwvc3Bhbj48L3Nw YW4+PC9wPg0KDQo8cCBjbGFzcz0iZ21haWwtTXNvTm9TcGFjaW5nIj48Yj48c3BhbiBzdHlsZT0i Y29sb3I6cmdiKDMxLDc4LDEyMSkiPkdlbW1hICANCldoaXRlPHNwYW4+PC9zcGFuPjwvc3Bhbj48 L2I+PC9wPg0KDQo8cCBjbGFzcz0iZ21haWwtTXNvTm9TcGFjaW5nIj48Yj48c3BhbiBzdHlsZT0i Y29sb3I6cmdiKDMxLDc4LDEyMSkiPlNlbmlvciAgDQpEYXRhYmFzZSBFeGVjdXRpdmU8L3NwYW4+ PC9iPjwvcD4NCg0KPHAgY2xhc3M9ImdtYWlsLU1zb05vU3BhY2luZyI+PHNwYW4gIA0Kc3R5bGU9 ImNvbG9yOnJnYigzMSw3OCwxMjEpIj7CoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKg wqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDC oMKgwqDCoA0KPC9zcGFuPjxzcGFuIHN0eWxlPSJjb2xvcjpyZ2IoMTU2LDE5NCwyMjkpIj5UbyDi gJxvcHQNCm91dOKAnSByZXNwb25zZSBub3QgaW50ZXJlc3RlZDwvc3Bhbj48c3BhbiAgDQpzdHls ZT0iY29sb3I6cmdiKDMxLDc4LDEyMSkiPjxzcGFuPjwvc3Bhbj48L3NwYW4+PC9wPjwvZGl2Pg0K PHA+Jm5ic3A7PC9wPjxhIHN0eWxlPSdkaXNwbGF5OiBibG9jazsgbWFyZ2luOiAzMnB4IDAgNDBw eCAwOyBwYWRkaW5nOiAgDQoxMHB4OyBmb250LXNpemU6IDFlbTsgdGV4dC1hbGlnbjogY2VudGVy OyBib3JkZXI6IDA7IGJvcmRlci10b3A6IDFweCBzb2xpZCAgDQpncmF5OyAnIGhyZWY9J2h0dHBz Oi8vZ29vLmdsLzJrc2RSdic+cG93ZXJlZCBieSBHU00uIEZyZWUgbWFpbCBtZXJnZSBhbmQgIA0K ZW1haWwgbWFya2V0aW5nIHNvZnR3YXJlIGZvciBHbWFpbC48L2E+DQo= From owner-freebsd-stable@freebsd.org Tue Apr 17 14:45:02 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C0726F8038C for ; Tue, 17 Apr 2018 14:45:02 +0000 (UTC) (envelope-from danallen46@gmail.com) Received: from mail-pf0-x234.google.com (mail-pf0-x234.google.com [IPv6:2607:f8b0:400e:c00::234]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 34D417C9DC for ; Tue, 17 Apr 2018 14:45:02 +0000 (UTC) (envelope-from danallen46@gmail.com) Received: by mail-pf0-x234.google.com with SMTP id f15so12276173pfn.0 for ; Tue, 17 Apr 2018 07:45:02 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:content-transfer-encoding:mime-version:subject:message-id:date :to; bh=6h4PW+aLd6Yyn7r4tb3sxh/0y3g/RFZeo1QQ6tKeKN0=; b=XySk6dWHei4IZ4iLc5Rr7xeG1GTAmb0HZeTw4R9A0aVpy+zuR5BQX9SWjgirySO82W /H1lZQPFuixHm9RwiZE4ZqI2h+O8JnaURPiiRNgYtsWv7Ok75eBZOjli4xet3gkfphS9 1jmg6kDjVb+T13DR2+2AhAHpSQ0H6jjOwlJsyrplj5jHN/P1011Cl6kcelws03LoP4fq WJE2e59eUXZFuLJzA5WFUKGDcMFptKdwm6IrpjPVTnhAAnifBuetlfKERrPUyc19cZq+ gdPrx5Kv8y/GVlbyIRmCm9fve/zqrM3PNMoHBSAoHbqNUdGrvSxjf0oNzaieHIIUpdvG sV/Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:content-transfer-encoding:mime-version :subject:message-id:date:to; bh=6h4PW+aLd6Yyn7r4tb3sxh/0y3g/RFZeo1QQ6tKeKN0=; b=KyPS83MeH0nDXJCiP6hqehYTJLOdZNKLilE7Z+FFDRIOGOYnxJxNxxWJHbolhHEfx5 pZbyRKuZTG6EW5zLg5uNSfBIgzp7/AIcblvKBLKZZE+Vn/fbWzReQaxS9gkN9EMVIQPn cx+s5qw3iMatRCvA0JVNN4CjPoL9HmgQE3v5SE26UpJc4eLVg5dEcPdWPtSLbmUlRJZm 3rvt1fuK5ItdT1y1UqzZWHlQM7pAEcEAGm/fMMsOFrKJOibLnYzOGdk5ap5KS3kP7GIp pByRa1uuu3r3g28Z9adgf6y3Joey1KPlRNlTUZERWXE2oO45t69EpxGZuUCXU+EwAFrE FOnw== X-Gm-Message-State: ALQs6tBXCT6Gs/GP9Ihzo3q7iFlFww8/sIuCtkQW1Cr6fMMlRrX1BoBn NgSQOCRMfLdjsgnNZKyakv8JPuk9 X-Google-Smtp-Source: AIpwx4+Be+ncRnFUexHCmjRygpY/y5zfFSPUTkTL7vA5B/8F09ygkRdfIBC6uUsYJs1WYj8h388GAg== X-Received: by 10.98.147.135 with SMTP id r7mr2229399pfk.31.1523976300921; Tue, 17 Apr 2018 07:45:00 -0700 (PDT) Received: from [192.168.0.4] ([65.129.156.172]) by smtp.gmail.com with ESMTPSA id t14sm31163801pfa.74.2018.04.17.07.45.00 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Tue, 17 Apr 2018 07:45:00 -0700 (PDT) From: Dan Allen Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 11.3 \(3445.6.18\)) Subject: amd64 kernel crash introduced between 20180329 & 20180408 Message-Id: Date: Tue, 17 Apr 2018 08:44:59 -0600 To: freebsd-stable@freebsd.org X-Mailer: Apple Mail (2.3445.6.18) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Apr 2018 14:45:03 -0000 I run FreeBSD 11-STABLE on actual machines, and I build the system every = few days. Things have been fine. However, I also run FreeBSD 11 via the qemu emulator on my Mac. I run = lots of different BSD & Linux OSes here to test them out. I have been = running the same binary of qemu-system-x86_64 v1.2 for six years. It = runs great. Then recently this happened: This snapshot dated 20180329, after doing a fresh install, runs fine: = https://download.freebsd.org/ftp/snapshots/ISO-IMAGES/11.1/FreeBSD-11.1-ST= ABLE-amd64-20180329-r331742-disc1.iso I can run pkg install and begin adding stuff to the system and life is = good. BUT This snapshot dated 20180408, after doing a fresh install, will crash = when running pkg install: = https://download.freebsd.org/ftp/snapshots/ISO-IMAGES/11.1/FreeBSD-11.1-ST= ABLE-amd64-20180408-r332308-disc1.iso It crashes about 90% of the way through updating the pkg snapshot. It = does not matter what pkg you try and install. However, the latest release in the i386 flavor works fine on qemu: = https://download.freebsd.org/ftp/snapshots/ISO-IMAGES/11.1/FreeBSD-11.1-ST= ABLE-i386-20180412-r332428-disc1.iso So sometime between March 29th & April 8th, in amd64 boot code, I = believe the problem was introduced. I cannot debug the crash, because it does a kernel dump, and then when = the system reboots, almost anything again triggers a kernel crash and it = reboots again and again: no chance to inspect a mini dump or whatever. I wish I had more to go on, but I am happy to off list work with anyone = that wants to pursue this, by testing out stuff or answering more = questions. Dan Allen Running FreeBSD since 2.2.8= From owner-freebsd-stable@freebsd.org Tue Apr 17 14:49:49 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DAA49F808C5 for ; Tue, 17 Apr 2018 14:49:48 +0000 (UTC) (envelope-from kevans@freebsd.org) Received: from smtp.freebsd.org (unknown [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "smtp.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 85B867D483 for ; Tue, 17 Apr 2018 14:49:48 +0000 (UTC) (envelope-from kevans@freebsd.org) Received: from mail-lf0-f46.google.com (mail-lf0-f46.google.com [209.85.215.46]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) (Authenticated sender: kevans) by smtp.freebsd.org (Postfix) with ESMTPSA id 39A53EB28 for ; Tue, 17 Apr 2018 14:49:48 +0000 (UTC) (envelope-from kevans@freebsd.org) Received: by mail-lf0-f46.google.com with SMTP id r125-v6so11031246lfe.2 for ; Tue, 17 Apr 2018 07:49:48 -0700 (PDT) X-Gm-Message-State: ALQs6tB9SYNxtdYMNo/J4ZdQqkGxyQ1Zvshf5IVksbtTWrrKv3kZBN4W 8VLwYKpTcix/xmcf6RKLMtHqSuRBs8A9KUEvNP8= X-Google-Smtp-Source: AIpwx4/avDBnQ7O8sfPlNasjRes7Zn1+RbJMNKEgBC9DpnjRGy18XxD+2Xl13dlWS6kB5XxNXr4WyjcWjXdCpNIuhto= X-Received: by 10.46.148.202 with SMTP id r10mr1732798ljh.22.1523976586774; Tue, 17 Apr 2018 07:49:46 -0700 (PDT) MIME-Version: 1.0 Received: by 10.46.129.90 with HTTP; Tue, 17 Apr 2018 07:49:26 -0700 (PDT) In-Reply-To: References: From: Kyle Evans Date: Tue, 17 Apr 2018 09:49:26 -0500 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: amd64 kernel crash introduced between 20180329 & 20180408 To: Dan Allen Cc: FreeBSD-STABLE Mailing List Content-Type: text/plain; charset="UTF-8" X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Apr 2018 14:49:49 -0000 On Tue, Apr 17, 2018 at 9:44 AM, Dan Allen wrote: > I run FreeBSD 11-STABLE on actual machines, and I build the system every few days. Things have been fine. > > However, I also run FreeBSD 11 via the qemu emulator on my Mac. I run lots of different BSD & Linux OSes here to test them out. I have been running the same binary of qemu-system-x86_64 v1.2 for six years. It runs great. > > Then recently this happened: > > This snapshot dated 20180329, after doing a fresh install, runs fine: > > https://download.freebsd.org/ftp/snapshots/ISO-IMAGES/11.1/FreeBSD-11.1-STABLE-amd64-20180329-r331742-disc1.iso > > I can run pkg install and begin adding stuff to the system and life is good. > > BUT > > This snapshot dated 20180408, after doing a fresh install, will crash when running pkg install: > > https://download.freebsd.org/ftp/snapshots/ISO-IMAGES/11.1/FreeBSD-11.1-STABLE-amd64-20180408-r332308-disc1.iso > > It crashes about 90% of the way through updating the pkg snapshot. It does not matter what pkg you try and install. > > However, the latest release in the i386 flavor works fine on qemu: > > https://download.freebsd.org/ftp/snapshots/ISO-IMAGES/11.1/FreeBSD-11.1-STABLE-i386-20180412-r332428-disc1.iso > > So sometime between March 29th & April 8th, in amd64 boot code, I believe the problem was introduced. As "the guy most likely to have broken boot code in stable," may I ask what leads you specifically to amd64 boot code? Mostly curious if there's something beyond "i386 works well" that lead you to this conclusion. > I cannot debug the crash, because it does a kernel dump, and then when the system reboots, almost anything again triggers a kernel crash and it reboots again and again: no chance to inspect a mini dump or whatever. When you say it crashes and does a kernel dump- you're landing at a ddb prompt, yeah? What does executing bt at that prompt look like>? > I wish I had more to go on, but I am happy to off list work with anyone that wants to pursue this, by testing out stuff or answering more questions. > From owner-freebsd-stable@freebsd.org Tue Apr 17 14:57:55 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 24AA5F815B6 for ; Tue, 17 Apr 2018 14:57:55 +0000 (UTC) (envelope-from jacinta.martin@collabratesuite.com) Received: from mail-qt0-x246.google.com (mail-qt0-x246.google.com [IPv6:2607:f8b0:400d:c0d::246]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id B24A57EF64 for ; Tue, 17 Apr 2018 14:57:54 +0000 (UTC) (envelope-from jacinta.martin@collabratesuite.com) Received: by mail-qt0-x246.google.com with SMTP id t24so12563418qtn.21 for ; Tue, 17 Apr 2018 07:57:54 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=collabratesuite-com.20150623.gappssmtp.com; s=20150623; h=mime-version:message-id:date:subject:from:to; bh=96IEvyH89c5dHaabFkllSGpyEDz93oArIEvpqqbgEfk=; b=OTTiEPlTtBL9nivt1XzhRB2SkomkrnASaoqUfEnn0tpKfE+N71MtUlG1X3GpH+RXY+ ZBslEw9sqPXlcF32oA2TkZ5NSwPXkX63E6yqt+84wbhaPRl5hdDryPw10hHMnfWYu5x4 mIubF+qTp9k1GHK/Ytjoezn/8Bm3RqE3cyd3ioYPSwD8aS8EL5LnYPuNdK5j8lmg9ZsN /VrbCFQ9rviMqEcX06at84vGdzNei9vMV/m+/zxf5QTBxhPHEC56FbN7g+unjZklCO0V /O2qpWtlP9XJS4wkRKePMkSBTqAMtEPFfVxvji5Xm11JBQUCewijlpITeI+Z9siOHCd1 7T8Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:message-id:date:subject:from:to; bh=96IEvyH89c5dHaabFkllSGpyEDz93oArIEvpqqbgEfk=; b=YUAbzDUO5f0s8wU4KX+R3T3EvMyMO7oXIvFZBbIn0/WwBqV21RanTR4Zs/K93XVXm8 HmLY8NzOIUeLb9LKQdyZQBYdzmGUOoeLsTn3UBe9PR17MStTglxBatTlR/xJ4EnovLwG 9Wb9Qs8mqFz5KfHhFujQ5daWApVslPP8vfEV2nACrCqXdszIM5DCKHwZf0wsEBX4AhaX QnSkioQ63++cFwGAOfK+A7xeg4MQQ+lUD2bKdwH9oBuqhR+KHQXq/jaRNrPbyyx4dxmH nlDZcPy3t3W04LETl2WGh2f6cQIGQts8PV7yR3qN1rBMswLpEvsxncdl5vK1ORXEgT2g W37w== X-Gm-Message-State: ALQs6tAXIatVvu3tvAVEC8/3KpheEJOig15gHIm3EVDLVw72qMfcwfVa iHH2mqD/15Vi92iqB2teGyh2cmnpUCHi X-Google-Smtp-Source: AIpwx4+HRsgYDtPjPZIynl115iWir1SPvR3MjZeeFp1Lt6mylJHofuTX9tADI/hNlUbAbeB7kQ54eY8vtA== MIME-Version: 1.0 X-Received: by 10.55.162.2 with SMTP id l2mr1698547qke.53.1523977074256; Tue, 17 Apr 2018 07:57:54 -0700 (PDT) Message-ID: <001a114d6ea82834d5056a0c90d2@google.com> Date: Tue, 17 Apr 2018 14:57:54 +0000 Subject: Debian Competitors Users Contact Info. From: jacinta.martin@collabratesuite.com To: freebsd-stable@freebsd.org Content-Type: text/plain; charset="UTF-8"; format=flowed; delsp=yes Content-Transfer-Encoding: base64 X-Content-Filtered-By: Mailman/MimeDel 2.1.25 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Apr 2018 14:57:55 -0000 PGRpdiBkaXI9Imx0ciI+PHAgY2xhc3M9ImdtYWlsLU1zb05vU3BhY2luZyI+PHNwYW4gIA0Kc3R5 bGU9ImNvbG9yOnJnYigzMSw3OCwxMjEpIj5IZWxsbyw8L3NwYW4+PC9wPg0KDQo8cCBjbGFzcz0i Z21haWwtTXNvTm9TcGFjaW5nIj48c3BhbiBzdHlsZT0iY29sb3I6cmdiKDMxLDc4LDEyMSkiPldv dWxkIHlvdQ0KYmUgaW50ZXJlc3RlZCBpbiA8Yj5EZWJpYW4gKExpbnV4KSBVc2Vycw0KTGlzdDwv Yj4/IFdlIGFyZSBhIEdsb2JhbCBUZWNobm9sb2d5IFVzZXLigJlzIExpc3QgUHJvdmlkZXLigJlz IHdpdGggOTAgTWlsbGlvbg0KUGx1cyBkYXRhIGFuZCBjb3VudGluZy48L3NwYW4+PC9wPg0KDQo8 cCBjbGFzcz0iZ21haWwtTXNvTm9TcGFjaW5nIj48Yj48c3BhbiBzdHlsZT0iY29sb3I6cmdiKDMx LDc4LDEyMSkiPllvdSBtYXkgIA0KYWxzbyBhY3F1aXJlIHRoZQ0KYWx0ZXJuYXRpdmVzIHN1Y2gg YXM8L3NwYW4+PC9iPjxzcGFuIHN0eWxlPSJjb2xvcjpyZ2IoMzEsNzgsMTIxKSI+OiBVYnVudHUg IA0KdXNlcnMgTGlzdCwgTGludXggTWludCB1c2VycyBMaXN0LMKgPC9zcGFuPjxzcGFuICANCnN0 eWxlPSJjb2xvcjpyZ2IoMzEsNzgsMTIxKSI+QXJjaCBMaW51eA0KdXNlcnMgTGlzdCwgV2luZG93 cyAxMCB1c2VycyBMaXN0LCBGZWRvcmEgdXNlcnMgTGlzdCBhbmQgbWFueSAgDQptb3JlLjwvc3Bh bj48L3A+DQoNCjxwIGNsYXNzPSJnbWFpbC1Nc29Ob1NwYWNpbmciPjxiPjxzcGFuIHN0eWxlPSJj b2xvcjpyZ2IoMzEsNzgsMTIxKSI+TGlzdA0KQ29udGFpbnM6PC9zcGFuPjwvYj48c3BhbiBzdHls ZT0iY29sb3I6cmdiKDMxLDc4LDEyMSkiPsKgTmFtZSwNCkNvbXBhbnkmIzM5O3MgTmFtZSwgUGhv bmUgTnVtYmVyLCBGYXggTnVtYmVyLCBKb2IgVGl0bGUsIEVtYWlsIGFkZHJlc3MsICANCkNvbXBs ZXRlDQpNYWlsaW5nIEFkZHJlc3MsIFNJQyBjb2RlLCBDb21wYW55IHJldmVudWUsIHNpemUsIFdl YiBhZGRyZXNzIGV0Yy4gQWxsDQpUZWNobm9sb2d5IC8gQ29tcGFuaWVzIFBhcnRuZXJzIGFuZCBV c2VycyBMaXN0LCBJVCBkZWNpc2lvbiBNYWtlcnMgZnJvbSAgDQpGb3J0dW5lDQo1MDAgQ29tcGFu aWVzLCBJVCBEZWNpc2lvbiBNYWtlcnMgZnJvbSBTTUUgYXMgd2VsbC48L3NwYW4+PC9wPg0KDQo8 cCBjbGFzcz0iTXNvTm9ybWFsIiAgDQpzdHlsZT0ibWFyZ2luLWJvdHRvbTowLjAwMDFwdDtsaW5l LWhlaWdodDpub3JtYWwiPjxzcGFuICANCnN0eWxlPSJjb2xvcjpyZ2IoMzEsNzgsMTIxKSI+V2Ug cHJvdmlkZSBkYXRhIGFjcm9zcyB0aGUgZ2xvYmUgLSA8Yj5Ob3J0aCAgDQpBbWVyaWNhLCBFTUVB LCBBc2lhIFBhY2lmaWMgYW5kIExBVEFNLjwvYj48L3NwYW4+PC9wPg0KDQo8cCBjbGFzcz0iZ21h aWwtTXNvTm9TcGFjaW5nIj48c3BhbiBzdHlsZT0iY29sb3I6cmdiKDMxLDc4LDEyMSkiPlBsZWFz ZSBsZXQNCnVzIGtub3cgeW91ciB0YXJnZXRlZCBjcml0ZXJpYSBhbmQgZ2VvZ3JhcGh5IHRvIHBy b3ZpZGUgeW91IHdpdGggZGV0YWlsZWQNCmluZm9ybWF0aW9uIGZvciB5b3VyIHJldmlldy48L3Nw YW4+PC9wPg0KDQo8cCBjbGFzcz0iZ21haWwtTXNvTm9TcGFjaW5nIj48c3BhbiBzdHlsZT0iY29s b3I6cmdiKDMxLDc4LDEyMSkiPkxldCBtZQ0Ka25vdyB5b3VyIHRob3VnaHRzITwvc3Bhbj48L3A+ DQoNCjxwIGNsYXNzPSJnbWFpbC1Nc29Ob1NwYWNpbmciPjxzcGFuICANCnN0eWxlPSJjb2xvcjpy Z2IoMzEsNzgsMTIxKSI+VGhhbmtzLDxzcGFuPjwvc3Bhbj48L3NwYW4+PC9wPg0KDQo8cCBjbGFz cz0iZ21haWwtTXNvTm9TcGFjaW5nIj48Yj48c3BhbiBzdHlsZT0iY29sb3I6cmdiKDMxLDc4LDEy MSkiPkphY2ludGEgIA0KTWFydGluPHNwYW4+PC9zcGFuPjwvc3Bhbj48L2I+PC9wPg0KDQo8cCBj bGFzcz0iZ21haWwtTXNvTm9TcGFjaW5nIj48Yj48c3BhbiBzdHlsZT0iY29sb3I6cmdiKDMxLDc4 LDEyMSkiPlNlbmlvciAgDQpEYXRhYmFzZSBFeGVjdXRpdmU8L3NwYW4+PC9iPjwvcD4NCg0KPHAg Y2xhc3M9ImdtYWlsLU1zb05vU3BhY2luZyI+PHNwYW4gIA0Kc3R5bGU9ImNvbG9yOnJnYigzMSw3 OCwxMjEpIj7CoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDC oMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoA0KPC9zcGFu PjxzcGFuIHN0eWxlPSJjb2xvcjpyZ2IoMTU2LDE5NCwyMjkpIj5UbyDigJxvcHQNCm91dOKAnSBy ZXNwb25zZSBub3QgaW50ZXJlc3RlZDwvc3Bhbj48c3BhbiAgDQpzdHlsZT0iY29sb3I6cmdiKDMx LDc4LDEyMSkiPjxzcGFuPjwvc3Bhbj48L3NwYW4+PC9wPjwvZGl2Pg0KPHA+Jm5ic3A7PC9wPjxh IHN0eWxlPSdkaXNwbGF5OiBibG9jazsgbWFyZ2luOiAzMnB4IDAgNDBweCAwOyBwYWRkaW5nOiAg DQoxMHB4OyBmb250LXNpemU6IDFlbTsgdGV4dC1hbGlnbjogY2VudGVyOyBib3JkZXI6IDA7IGJv cmRlci10b3A6IDFweCBzb2xpZCAgDQpncmF5OyAnIGhyZWY9J2h0dHBzOi8vZ29vLmdsLzJrc2RS dic+cG93ZXJlZCBieSBHU00uIEZyZWUgbWFpbCBtZXJnZSBhbmQgIA0KZW1haWwgbWFya2V0aW5n IHNvZnR3YXJlIGZvciBHbWFpbC48L2E+DQo= From owner-freebsd-stable@freebsd.org Tue Apr 17 15:18:54 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6EF5BF82C76 for ; Tue, 17 Apr 2018 15:18:53 +0000 (UTC) (envelope-from danallen46@gmail.com) Received: from mail-pf0-x233.google.com (mail-pf0-x233.google.com [IPv6:2607:f8b0:400e:c00::233]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 9BF0684698; Tue, 17 Apr 2018 15:18:52 +0000 (UTC) (envelope-from danallen46@gmail.com) Received: by mail-pf0-x233.google.com with SMTP id f15so12321182pfn.0; Tue, 17 Apr 2018 08:18:52 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:message-id:mime-version:subject:date:in-reply-to:cc:to :references; bh=yfOVFbcbNiTXMWirRD0fNRjzASmDEP756wvm3YjHhTc=; b=TEO3MffHujjMZMC3jBtIn4Mn9TPT/dppahyJFdOLjT+pOdieL6QfyMMOHCuOhvfpbQ s8JqIliGk1GHBMsS/ko1ge0I6Nk/yvhPimlMt7rkuls3w2ClN9OeIRmnT6eAy/2rtiUC ulllyo/qZ8QyWBj9Yd7+dJG7MO3eBeRIPXzykoTMNfBChCXaLaDhJjlT0yrBV+syvoPu 0kPiRlWJoR5VPloZbxicHWplNZ9HUu86a3PGUkdJVRscc3qdr6WwuUBdcSYuHR3UoRBU kILxEB/uaYTgFrtcSrzdJJCtDvw8lZUPz2oInc4IWFC2Rd710IF3USJCHOBrAhYN0/Vw V1Ig== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:message-id:mime-version:subject:date :in-reply-to:cc:to:references; bh=yfOVFbcbNiTXMWirRD0fNRjzASmDEP756wvm3YjHhTc=; b=S8pvhTQ5Wave8V3FvpPCpqW6oZ51bQguQKZSi4fHBYyzTmz9CQGVuQcrLojTFKaGUK C1ER8hPs4mhCrv6TUCNkdTy7MlMt+PC4ZUDHzRYSIkOayVz7Dx2EKbW1IlhEQfPu8y8l 93z5AY+GjcjtNdF8k+TpYCi+GvdXIX5AoTdjFBUPeWg/G/uPBJgDf/hk9QIj6mP9GHYz Dv1mWj3g39t/RzBDOK5MZe3K3nnZwEsdsfRl1nqIsIW5jZ2otNA0Sh42yiGf5OOq0T7e QkcA0w2pHTPD2cD08APDNIFU4Od7w795mN2mQXo2HzZuWuMXfA7CFGIi2uE+cuBHH8zk 4pZQ== X-Gm-Message-State: ALQs6tA3s6WEAgkfNDf3ncI+8oQykP1Q+t6cFtVEkC9ihHUDWzMK6NSB yOoD1ljhdTT/L3AyYqow0Z3+YV0C X-Google-Smtp-Source: AIpwx4+3yRxm3jdqCLaTfsS+NkOwBoTiIlV4colymDIlWpsPpeRcZXaOOAz5RGOtrS+kuLuSLah3Pw== X-Received: by 10.98.33.72 with SMTP id h69mr2377405pfh.54.1523978331279; Tue, 17 Apr 2018 08:18:51 -0700 (PDT) Received: from [192.168.0.4] ([65.129.156.172]) by smtp.gmail.com with ESMTPSA id c62sm36403233pfk.179.2018.04.17.08.18.49 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Tue, 17 Apr 2018 08:18:50 -0700 (PDT) From: Dan Allen Message-Id: <4EE33A98-C010-4D79-A502-19D009384B0D@gmail.com> Mime-Version: 1.0 (Mac OS X Mail 11.3 \(3445.6.18\)) Subject: Re: amd64 kernel crash introduced between 20180329 & 20180408 Date: Tue, 17 Apr 2018 09:18:48 -0600 In-Reply-To: Cc: FreeBSD-STABLE Mailing List To: Kyle Evans References: X-Mailer: Apple Mail (2.3445.6.18) Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.25 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Apr 2018 15:18:54 -0000 > On 17 Apr 2018, at 8:49 AM, Kyle Evans wrote: >=20 > As "the guy most likely to have broken boot code in stable," may I ask > what leads you specifically to amd64 boot code? Mostly curious if > there's something beyond "i386 works well" that lead you to this > conclusion. It is partly just a hunch. I installed 11.0 for use with qemu a while ago. I did binary upgrades = for patches using freebsd-update. When 11.1 came out, it would not work correctly, again = with the same kind of behavior. Then, I got some later snapshots that worked again, = notably the 20180329 build. When the next snapshot came out, things broke. I also tried my = own builds, same story. I even got both source trees together - 20180329 and 20180408 - and did = a diff on the entire trees, and I noticed activity in the boot & kernel code. It could just = as likely be something in the kernel as well, but none of this happens with the i386 build. > When you say it crashes and does a kernel dump- you're landing at a > ddb prompt, yeah? What does executing bt at that prompt look like? No, I am not ever given a prompt. I get to watch a mini-dump happen and = then an automatic reboot. It is a kernel panic. Here is what I see: From owner-freebsd-stable@freebsd.org Tue Apr 17 15:24:34 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 03F1DF83660 for ; Tue, 17 Apr 2018 15:24:34 +0000 (UTC) (envelope-from kevans@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "smtp.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id A8C488591F for ; Tue, 17 Apr 2018 15:24:33 +0000 (UTC) (envelope-from kevans@freebsd.org) Received: from mail-lf0-f51.google.com (mail-lf0-f51.google.com [209.85.215.51]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) (Authenticated sender: kevans) by smtp.freebsd.org (Postfix) with ESMTPSA id 5FE8AEF0C for ; Tue, 17 Apr 2018 15:24:33 +0000 (UTC) (envelope-from kevans@freebsd.org) Received: by mail-lf0-f51.google.com with SMTP id m202-v6so10669330lfe.8 for ; Tue, 17 Apr 2018 08:24:33 -0700 (PDT) X-Gm-Message-State: ALQs6tAIM/5DWctFD6AJobkF1VpThEyZZVTtF7JxQXPJbkR983nKMzBp HlG1V6swKDf+gi0OSJ2jFNhxxtoxuebqFBkaeYQ= X-Google-Smtp-Source: AIpwx4/vPNT7guMEFJBCl4ZOBz5PLc5wW+T3Arw/VDGBqb6J9dkemYVaW3m6i2cfrOjAY3TXa0s6P3f5MPGsb5K0MvQ= X-Received: by 10.46.153.147 with SMTP id w19mr1858635lji.93.1523978671899; Tue, 17 Apr 2018 08:24:31 -0700 (PDT) MIME-Version: 1.0 Received: by 10.46.129.90 with HTTP; Tue, 17 Apr 2018 08:24:11 -0700 (PDT) In-Reply-To: <4EE33A98-C010-4D79-A502-19D009384B0D@gmail.com> References: <4EE33A98-C010-4D79-A502-19D009384B0D@gmail.com> From: Kyle Evans Date: Tue, 17 Apr 2018 10:24:11 -0500 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: amd64 kernel crash introduced between 20180329 & 20180408 To: Dan Allen Cc: FreeBSD-STABLE Mailing List Content-Type: text/plain; charset="UTF-8" X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Apr 2018 15:24:34 -0000 On Tue, Apr 17, 2018 at 10:18 AM, Dan Allen wrote: > > >> On 17 Apr 2018, at 8:49 AM, Kyle Evans wrote: >> >> As "the guy most likely to have broken boot code in stable," may I ask >> what leads you specifically to amd64 boot code? Mostly curious if >> there's something beyond "i386 works well" that lead you to this >> conclusion. > > It is partly just a hunch. > > I installed 11.0 for use with qemu a while ago. I did binary upgrades for patches using > freebsd-update. When 11.1 came out, it would not work correctly, again with the same > kind of behavior. Then, I got some later snapshots that worked again, notably the 20180329 > build. When the next snapshot came out, things broke. I also tried my own builds, same story. > > I even got both source trees together - 20180329 and 20180408 - and did a diff on the entire > trees, and I noticed activity in the boot & kernel code. It could just as likely be something in the > kernel as well, but none of this happens with the i386 build. > >> When you say it crashes and does a kernel dump- you're landing at a >> ddb prompt, yeah? What does executing bt at that prompt look like? > > No, I am not ever given a prompt. I get to watch a mini-dump happen and then an automatic > reboot. It is a kernel panic. Here is what I see: > Ahh, fun. =) I'm inclined to think it's probably not a boot code problem, but it is suspicious. Can you set vm.pmap.pti=0 at the loader prompt and see if this affects your situation at all, just to rule that out? From owner-freebsd-stable@freebsd.org Tue Apr 17 15:49:34 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3BD3EF8539A for ; Tue, 17 Apr 2018 15:49:34 +0000 (UTC) (envelope-from kob6558@gmail.com) Received: from mail-ua0-x229.google.com (mail-ua0-x229.google.com [IPv6:2607:f8b0:400c:c08::229]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id BD8846DFEE for ; Tue, 17 Apr 2018 15:49:33 +0000 (UTC) (envelope-from kob6558@gmail.com) Received: by mail-ua0-x229.google.com with SMTP id o34so12890343uae.9 for ; Tue, 17 Apr 2018 08:49:33 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:sender:in-reply-to:references:from:date:message-id :subject:to:cc; bh=Sl3q8Gt6DrNeVvHph9hhlN2QL08uJ4ZSMSBY+vvpeJo=; b=F2Qjf//GtRs2zMFXHX3G1KFo3ttwieo7Aul5lf900xdlhTiNaba406Ue2q7I8Jknxh 1/2zHXppYkuOmQuJe0BvO29r0svd+QugPiycvv719BmgYaYSB7ac+BpH0CTBTXzxOSFT wCMuN59nQUHb4nWY5qVA+ZtMgs1E9fFCyd9sExCmlK3bG1Pgj2GDAIJ1VQxgTGAG+wW8 ZDvR1eAJXyOi+CEpr8ohtPDNPoPrKCdE/S8B3gCuSkInhhocG4RNSBBXI40HFeDOWIK2 gX7gq7VIi/I2TmqkfAUJ+eR7l1WdgW13RrDQxvhuEBPGL8NyspN0kkcGCkjiIIX4rW59 ps+g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:sender:in-reply-to:references:from :date:message-id:subject:to:cc; bh=Sl3q8Gt6DrNeVvHph9hhlN2QL08uJ4ZSMSBY+vvpeJo=; b=UckGnSOKqh6FucKnUOmB61IVTrV4WBjkys01Dmv+Z7w+pex8PYqNgj2W1l2n4auuKr l1uOAE3l7QEEDRuRXuHzkZUoAaNoND152Bo5ntU2o5r6nl0dXcrUTttmexObU3Eh6otg +OtwLzBMoDfsIhVkMe4dRdEPyEJqXhiVrzCDLLMI/OdYmFn4vQKgRpFn7VthPQyY8KnE jp+bFAY5FgcojOf7T4l1nBMG6ZA3AJN1tJDtdPgJbddGHp8RUOwefMO8iAw5afDWXf2G xZg4EruOCDD54u+XvveELkpBpggMQM6trCh6SutTyrFW5DbeN2hlowf6lftE3wAPKZ9J Ma7g== X-Gm-Message-State: ALQs6tDvzd1A3wBSt4sKbqeYp5qEgQpok8yM2mKezft71/venk6OH47l madzJLOhV90Qw6lbcGmVYxK7NjLvHZTV3zuPG88L/eEp X-Google-Smtp-Source: AIpwx4/1XvcyNrsp0I4dfe7F6jS6vIn35MortSxmJNNc+HZYQcZJ5vzThSUPt1Cvw78H2jT2a8UBzM2Kfm7uPio48GU= X-Received: by 10.159.46.1 with SMTP id t1mr2018656uaj.114.1523980173158; Tue, 17 Apr 2018 08:49:33 -0700 (PDT) MIME-Version: 1.0 Sender: kob6558@gmail.com Received: by 10.103.91.5 with HTTP; Tue, 17 Apr 2018 08:49:32 -0700 (PDT) In-Reply-To: <20180417065617.GA95646@klump.hjerdalen.lokalnett> References: <9FDC510B-49D0-4722-B695-6CD38CA20D4A@gmail.com> <8cfdb8a3-86a0-17ba-1e41-ff1912a30ee9@m5p.com> <20180417065617.GA95646@klump.hjerdalen.lokalnett> From: Kevin Oberman Date: Tue, 17 Apr 2018 08:49:32 -0700 X-Google-Sender-Auth: 3MiQ6sfgbasxs7ZlReMBUiQgRVw Message-ID: Subject: Re: kern.sched.quantum: Creepy, sadistic scheduler To: Eivind Nicolay Evensen Cc: George Mitchell , FreeBSD-STABLE Mailing List Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.25 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Apr 2018 15:49:34 -0000 On Mon, Apr 16, 2018 at 11:56 PM, Eivind Nicolay Evensen < eivinde@terraplane.org> wrote: > On Wed, Apr 04, 2018 at 09:32:58AM -0400, George Mitchell wrote: > > On 04/04/18 06:39, Alban Hertroys wrote: > > > [...] > > > That said, SCHED_ULE (the default scheduler for quite a while now) was > designed with multi-CPU configurations in mind and there are claims that > SCHED_4BSD works better for single-CPU configurations. You may give that a > try, if you're not already on SCHED_4BSD. > > > [...] > > > > A small, disgruntled community of FreeBSD users who have never seen > > proof that SCHED_ULE is better than SCHED_4BSD in any environment > > continue to regularly recompile with SCHED_4BSD. I dread the day when > > that becomes impossible, but at least it isn't here yet. -- George > > Indeed 4bsd is better in my case aswell. While for some unknown to me > reason > ule performed a bit better in the 10.x series than before, in 11.x > it again is in my case not usable. > > Mouse freezes for around half a second with even frequency by just moving > it around in x11. Using 4bsd instead makes the problem go away. > I'm actually very happy that ule became worse again because going > back to 4bsd yet again also gave improved performance from other > dreadfully slow but (to me) still useful programs, like darktable. > > With 4bsd, when adjusting shadows and highlights it is possible to see > what I > do when moving sliders. With ule it has never been better than waiting > 10-20-30 seconds to see where it was able to read a slider position > and update display, when working on images around 10500x10500 greyscale. > > It's not single cpu/single core either: > CPU: AMD FX(tm)-6300 Six-Core Processor (3817.45-MHz K8-class > CPU) > > > > > -- > Eivind > My experience has long been that 4BSD works far better for interactive, X based systems than ULE. Even on 10 I saw long, annoying pauses with ULE and I don't se those with 4BSD. I'd really like to see it better known that this is often the case. BTW, my system is 2 core/4 thread Sandybridge. -- Kevin Oberman, Part time kid herder and retired Network Engineer E-mail: rkoberman@gmail.com PGP Fingerprint: D03FB98AFA78E3B78C1694B318AB39EF1B055683 From owner-freebsd-stable@freebsd.org Tue Apr 17 16:03:41 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 21B1BF8668D for ; Tue, 17 Apr 2018 16:03:41 +0000 (UTC) (envelope-from danallen46@gmail.com) Received: from mail-pl0-x236.google.com (mail-pl0-x236.google.com [IPv6:2607:f8b0:400e:c01::236]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 9448171996; Tue, 17 Apr 2018 16:03:40 +0000 (UTC) (envelope-from danallen46@gmail.com) Received: by mail-pl0-x236.google.com with SMTP id f7-v6so5186366plr.4; Tue, 17 Apr 2018 09:03:40 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=INAp1bx8K4w9DkopUERCbzcUMvIxYcsziJKxcrPkJJg=; b=G2JRKTT72a2rd9h68k/UU2YcxHLgbj72m1d7Z5joCg4Tqy40NiMZlRIBI1gRWblBR6 hdPJNmz1t12nreyOD1VWJltxBY6nmG8h5+CJYL0SCN0nTNmMtANyfLdxNMbzR+9J35Wq Ojxt12iiZanmthRaTHScy9QWck3fMU41OdZGbQsFT59ypYF4V4SHQc2YNpFRmfd5qxUx jEiTF6ga/uoNBcMiUW8uYKEbgGqRi8s6W3frPXAm2FkKhh3ilVr9RzhfRDJCNzEaURJo /wrsWw+Cw0gj3mxbX/w8EviHsz+YkgKVl/9qUeuUwL6BHuAKc458rC7KlYKIphzPmUEw PCVg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=INAp1bx8K4w9DkopUERCbzcUMvIxYcsziJKxcrPkJJg=; b=TKaoSQZgBC9HVbGPVqBxuPs3Jvvq0PelRZ+yAkaE8LfQCxBdMFhBMVbQZdcTW6tzm8 lCJ7AjXgVMxtMfzAGjcU/dUqPUBkmikwYj3XU57SR8BNrwCibRvnMpuhAh+PidnextLD gsQLDEj/L0VW7lK2qcmSjitxlThscE66WywfMIUiLzcrKKWPGG9uYd1DKAocoqy92Pub BoX3HrBE6YsqVdMaaxBwIve9arw8AFplH6oMA13DvSEZ4hh3lfieACi1n5Te41aMcS5M UrOpE6Dk/pPDs+TwNZ4Rgfrzb6pAWu0vMI+86r1VjO6b9ZSbJ6Qu1nEdo4sBJ263bR3V lbrw== X-Gm-Message-State: ALQs6tDekP+K5kmN3QWkFZTVmQvXR/rRxwjsOiu7gy2VCu5zAesViqWw iMi2JVOVA4pvps8BFg6dZdoMEyMw X-Google-Smtp-Source: AIpwx48sA8rXxs0Wk2eI/QMMkRw3Z5GxcaEwBTZAOB9923yBStSm3TevGz5HtVATE+l8TcIzu0Xfcw== X-Received: by 2002:a17:902:b707:: with SMTP id d7-v6mr2610091pls.188.1523981019526; Tue, 17 Apr 2018 09:03:39 -0700 (PDT) Received: from [192.168.0.4] ([65.129.156.172]) by smtp.gmail.com with ESMTPSA id u7sm4769255pfa.96.2018.04.17.09.03.38 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Tue, 17 Apr 2018 09:03:38 -0700 (PDT) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 11.3 \(3445.6.18\)) Subject: Re: amd64 kernel crash introduced between 20180329 & 20180408 From: Dan Allen In-Reply-To: Date: Tue, 17 Apr 2018 10:03:37 -0600 Cc: FreeBSD-STABLE Mailing List Content-Transfer-Encoding: quoted-printable Message-Id: References: <4EE33A98-C010-4D79-A502-19D009384B0D@gmail.com> To: Kyle Evans X-Mailer: Apple Mail (2.3445.6.18) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Apr 2018 16:03:41 -0000 > On 17 Apr 2018, at 9:24 AM, Kyle Evans wrote: >=20 > Can you set vm.pmap.pti=3D0 at the loader prompt and see if > this affects your situation at all, just to rule that out? I redid everything from the start, did set vm.pmap.pti=3D0, and it = behaves exactly the same: kernel panic. Thanks for your help! Do I have any other takers? ;-) Dan From owner-freebsd-stable@freebsd.org Tue Apr 17 16:05:53 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2F6A3F869A2 for ; Tue, 17 Apr 2018 16:05:53 +0000 (UTC) (envelope-from fjwcash@gmail.com) Received: from mail-lf0-x235.google.com (mail-lf0-x235.google.com [IPv6:2a00:1450:4010:c07::235]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 7963371C49 for ; Tue, 17 Apr 2018 16:05:52 +0000 (UTC) (envelope-from fjwcash@gmail.com) Received: by mail-lf0-x235.google.com with SMTP id z130-v6so2600558lff.5 for ; Tue, 17 Apr 2018 09:05:52 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=Ux0PtBKQ0+LXDSMwx62JJJVU6gCHUlGWESXhN/VSlBA=; b=gJx8NTy64FvajLYx0Cm8t3KaPmKew03qq2cOjXt8heLy4d0qRr4f2l8BVm0+635E25 nJfu9F6/DStH39pqcB3Wi6lF2khDdky/NbybJTKRsZGENlDOCNUWXLYnJf7DjvvM+VM2 23x9M7T4mqL6zFLMKJu2PGJc+r2Ykvjb38y3X9NxoyM9kXKkT06WOrpqNz4oygNsyZ2a KELQrOc1/QU6lpjnZfZGA8nxiRu3Nc2e4z1jIahwqDaVUkpfEoxya9/YI0sE1UixIgFW UbhgczZiweYYnfOwW0rBPputCnnMfY/twQYxkGcCwnPeUErnKZAX9i0kowSNkVLUgiSD Nl3A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=Ux0PtBKQ0+LXDSMwx62JJJVU6gCHUlGWESXhN/VSlBA=; b=jmi5BNOuo8YtyuokVsuK8lYtJRsHCNvde30+iNqVK1oe7X8O1m8NQKIYvlNQu+jmqE bm47yl6+euTJzcKINr4TResN+O+bd4JXXOj+bAEUxLk3ecTBl7bDXSv9ZOUJFYFQZWJ7 Ye6XApShFkCifSh1AKunQ4Dr7V6W1bOaZgvXuaGiopH85xW5M3Pf93U4q6yM7t2lx4eX j0E38M6HnFBPwwaiOTC360mKYodys2vNLZsbIMEFuKCkMkil1/bZFQraHe0lKme0FUp1 kAMhv+efq0lcZRcLue3bsjW/KEa4puP0hfTCqnJYVgBHsq8u53vhTs6tPHfahQgakN/a 0JVw== X-Gm-Message-State: ALQs6tAhJZXhwKOWVHv2f+79wYroJVQjobS09AeBsv1mx+fkFdzG5rIo pn4Xh/VJ6nJH110/hGoYrcp4xqJuA3ir6ZVcmVs= X-Google-Smtp-Source: AIpwx48+MgF0H+3RCniM4jRwRMoCgpG0lcDk5B3yNAdtZsQXAMy+ltCqT3e2XFAPJ5wk4sqXqo6iCIODp8fIck7LIbw= X-Received: by 2002:a19:974e:: with SMTP id z75-v6mr2097416lfd.41.1523981149383; Tue, 17 Apr 2018 09:05:49 -0700 (PDT) MIME-Version: 1.0 Received: by 10.46.2.25 with HTTP; Tue, 17 Apr 2018 09:05:48 -0700 (PDT) In-Reply-To: References: <9FDC510B-49D0-4722-B695-6CD38CA20D4A@gmail.com> <8cfdb8a3-86a0-17ba-1e41-ff1912a30ee9@m5p.com> <20180417065617.GA95646@klump.hjerdalen.lokalnett> From: Freddie Cash Date: Tue, 17 Apr 2018 09:05:48 -0700 Message-ID: Subject: Re: kern.sched.quantum: Creepy, sadistic scheduler To: Kevin Oberman Cc: Eivind Nicolay Evensen , George Mitchell , FreeBSD-STABLE Mailing List Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.25 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Apr 2018 16:05:53 -0000 On Tue, Apr 17, 2018 at 8:49 AM, Kevin Oberman wrote: > On Mon, Apr 16, 2018 at 11:56 PM, Eivind Nicolay Evensen < > eivinde@terraplane.org> wrote: > > > On Wed, Apr 04, 2018 at 09:32:58AM -0400, George Mitchell wrote: > > > On 04/04/18 06:39, Alban Hertroys wrote: > > > > [...] > > > > That said, SCHED_ULE (the default scheduler for quite a while now) > was > > designed with multi-CPU configurations in mind and there are claims tha= t > > SCHED_4BSD works better for single-CPU configurations. You may give tha= t > a > > try, if you're not already on SCHED_4BSD. > > > > [...] > > > > > > A small, disgruntled community of FreeBSD users who have never seen > > > proof that SCHED_ULE is better than SCHED_4BSD in any environment > > > continue to regularly recompile with SCHED_4BSD. I dread the day whe= n > > > that becomes impossible, but at least it isn't here yet. -- Geor= ge > > > > Indeed 4bsd is better in my case aswell. While for some unknown to me > > reason ule performed a bit better in the 10.x series than before, in 11= .x > > it again is in my case not usable. > > > > Mouse freezes for around half a second with even frequency by just movi= ng > > it around in x11. Using 4bsd instead makes the problem go away. > > I'm actually very happy that ule became worse again because going > > back to 4bsd yet again also gave improved performance from other > > dreadfully slow but (to me) still useful programs, like darktable. > > > > With 4bsd, when adjusting shadows and highlights it is possible to see > > what I do when moving sliders. With ule it has never been better than > waiting > > 10-20-30 seconds to see where it was able to read a slider position > > and update display, when working on images around 10500x10500 greyscale= . > > > > It's not single cpu/single core either: > > CPU: AMD FX(tm)-6300 Six-Core Processor (3817.45-MHz > K8-class > > CPU) > > My experience has long been that 4BSD works far better for interactive, X > based systems than ULE. Even on 10 I saw long, annoying pauses with ULE a= nd > I don't se those with 4BSD. I'd really like to see it better known that > this is often the case. BTW, my system is 2 core/4 thread Sandybridge. > =E2=80=8B > =E2=80=8BThe following has been suggested multiple times over the years on = various mailing lists as the "solution" to making ULE work well for interactive tasks like running X-based desktops (in /etc/sysctl.conf):=E2=80=8B # Tune for desktop usage kern.sched.preempt_thresh=3D224 =E2=80=8BWorks quite nicely on a 4-core AMD Phenom-II X4 960T Processor (3010.09-MHz K8-class CPU) running KDE4 using an Nvidia 210 GPU. --=20 Freddie Cash fjwcash@gmail.com From owner-freebsd-stable@freebsd.org Tue Apr 17 21:20:44 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id AB21FF9C263 for ; Tue, 17 Apr 2018 21:20:44 +0000 (UTC) (envelope-from ebfe@inbox.ru) Received: from fallback.mail.ru (fallback12.m.smailru.net [94.100.179.29]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 32A187F635 for ; Tue, 17 Apr 2018 21:20:43 +0000 (UTC) (envelope-from ebfe@inbox.ru) Received: from [10.161.22.27] (port=52110 helo=smtp57.i.mail.ru) by fallback12.m.smailru.net with esmtp (envelope-from ) id 1f8Y1j-00028B-AS for freebsd-stable@freebsd.org; Wed, 18 Apr 2018 00:20:35 +0300 Received: by smtp57.i.mail.ru with esmtpa (envelope-from ) id 1f8Y1b-0005gG-Np for freebsd-stable@freebsd.org; Wed, 18 Apr 2018 00:20:28 +0300 Date: Tue, 17 Apr 2018 23:20:16 +0200 From: EBFE To: freebsd-stable@freebsd.org Subject: Re: kern.sched.quantum: Creepy, sadistic scheduler Message-ID: <20180417232016.2008438c.ebfe@inbox.ru> In-Reply-To: References: <9FDC510B-49D0-4722-B695-6CD38CA20D4A@gmail.com> <8cfdb8a3-86a0-17ba-1e41-ff1912a30ee9@m5p.com> <20180417065617.GA95646@klump.hjerdalen.lokalnett> X-Mailer: Claws Mail 3.16.0 (GTK+ 2.24.32; amd64-portbld-freebsd11.1) MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-7FA49CB5: 0D63561A33F958A533526BF777B3142517C6BD8006F7DA74836229A5D1497B33725E5C173C3A84C3E706BF420F27F956DDB3ACC7D0BD04D079C543ECCDAE434EC4224003CC836476C0CAF46E325F83A50BF2EBBBDD9D6B0F5D41B9178041F3E72623479134186CDE6BA297DBC24807EABDAD6C7F3747799A X-Mailru-Sender: DB26A00C85DA0CD9EA055ADBC19F6F7B3FB760A8E55725D5AE50F039FFA5242CFE54CEACCC7EE546990AF24F6491A43FFB559BB5D741EB96235F0573D590C67908E29FF3D9B2F13D0DA7A0AF5A3A8387 X-Mras: OK X-7FA49CB5: 0D63561A33F958A596F395D74B55FE3DF1149D2FFBCCCB90C770A31FA9BFEDFC462275124DF8B9C99B0B8D173C204012BD9CCCA9EDD067B1EDA766A37F9254B7 X-Mailru-Sender: A5480F10D64C9005032BDE78ED4CC6EC8A4D467C7D6E6F66559AED7E0C526D14135739CE5A464D15D80BE8602B6BCE943DDE9B364B0DF2898D3420632F3BB6E4091DED475A21ADD3AE208404248635DF X-Mras: OK X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Apr 2018 21:20:44 -0000 On Tue, 17 Apr 2018 09:05:48 -0700 Freddie Cash wrote: > # Tune for desktop usage > kern.sched.preempt_thresh=3D224 >=20 > =E2=80=8BWorks quite nicely on a 4-core AMD Phenom-II X4 960T Processor > (3010.09-MHz K8-class CPU) running KDE4 using an Nvidia 210 GPU. For interactive tasks, there is a "special" tunable: % sysctl kern.sched.interact kern.sched.interact: 10 # default is 30 % sysctl -d kern.sched.interact kern.sched.interact: Interactivity score threshold reducing the value from 30 to 10-15 keeps your gui/system responsive, even under high load. From owner-freebsd-stable@freebsd.org Tue Apr 17 23:02:08 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0F168FA34BE for ; Tue, 17 Apr 2018 23:02:08 +0000 (UTC) (envelope-from george+freebsd@m5p.com) Received: from mailhost.m5p.com (mailhost.m5p.com [74.104.188.4]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "m5p.com", Issuer "Let's Encrypt Authority X3" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 38A7976EB5 for ; Tue, 17 Apr 2018 23:02:07 +0000 (UTC) (envelope-from george+freebsd@m5p.com) Received: from [IPv6:2001:470:1f07:15ff::1f] (haymarket.m5p.com [IPv6:2001:470:1f07:15ff::1f]) (authenticated bits=0) by mailhost.m5p.com (8.15.2/8.15.2) with ESMTPSA id w3HN1hbe064874 (version=TLSv1.2 cipher=DHE-RSA-AES128-SHA bits=128 verify=NO) for ; Tue, 17 Apr 2018 19:01:52 -0400 (EDT) (envelope-from george+freebsd@m5p.com) Subject: Re: kern.sched.quantum: Creepy, sadistic scheduler To: freebsd-stable@freebsd.org References: <9FDC510B-49D0-4722-B695-6CD38CA20D4A@gmail.com> <8cfdb8a3-86a0-17ba-1e41-ff1912a30ee9@m5p.com> <20180417065617.GA95646@klump.hjerdalen.lokalnett> <20180417232016.2008438c.ebfe@inbox.ru> From: George Mitchell Openpgp: preference=signencrypt Autocrypt: addr=george+freebsd@m5p.com; prefer-encrypt=mutual; keydata= xsFNBFgnLnwBEADAJDiBKQX77LFRz9wZW8mz3KvaQol2nIremcws0F1mz/zgFlk6uhQVtwnL wb4XL5LdFwcNE1+QZzPLcbYWoWQlz0lBw1bMuKAgr0S6V2e0+I0DqhKeslVFctcTwtvT6pnK VLZXO/7ZGAaLzG4K5vSPzgoevU+YI/pxNsVCH2UO/c3jQW63uEt25mIZbCF1Pu4jgp4RhIgF ujn877r/j6OwBwjzRUu3E6ADp+U825d+5YCuQMEH0wIPnn9GTpXvfdKdbwOIl2akqXqs4cnk iATWfK3r6D4mvDEj1OPHlTvJYcfic7aOIiAwmx1C1v78GjXOdOOA0SGffNix3C2/8oZUO1+V Aet4MKpUKkduWSvULhIkHNZ5Nu8SIJOqge8pmtHxuNXAMfMrAjMdjPwwBFLsYg3Xa2E2oJwg ehTauwd/EDJFcVCyDCyCAYOi/BH/+XQyxzgDlY9N9qj9tHqhVPI6XK7t8UVffGiZUq4rHp5J RdOToqiTNC6eCJBczhMIW+DuFvWU9e6W708T1dz0Accn6Lrgk4eRIn3GFPBG+TxnpjAqHsbW 607dcnD3YKAqY4e+khczL4EObhe7dC1v2fmZiAC6Ds3WHR11IfqoUgCkIwJ590Ej+ElygJFF XxI82wtEz9hkeLLvItpyEJNVjppViRW+Dgl/U7ypHB3qDgYjgwARAQABzSBHZW9yZ2UgTWl0 Y2hlbGwgPGdlb3JnZUBtNXAuY29tPsLBlwQTAQgAQQIbIwUJCWYBgAULCQgHAgYVCAkKCwIE FgIDAQIeAQIXgBYhBDXTOGR5LbCVuZCmV8EREt5vqeH5BQJYWXFRAhkBAAoJEMEREt5vqeH5 SRsQAIb/crcxXyAyeokAuTjN+YXkEFdVv/JrOgNXKdCukXt/UGd3nZTcAzpllytDIvIlPTNI 2/nZ5sm6ymeyVwmvkrM/r3sRUib5ftakJpbv0wn2j+eCGAca8IA2frBUg9bEXKcHRJRQCztG cpousHzOziTCRQ/1NfPcIFBNbQMPUVoQ96cJPvM/XfFGOISKKsSI78skHm6Oazh1hLCQTKvy hNNgVpNP/PHCHMbla1+SNgyn35CUelTh153lnkOhw1XyX6IxY4o5Bhcf3YrxAVcoeHq3FEH0 T3ygAdI14VrZGXXitBAMI78QLB0FiWMoPQ3Oddnoh6tlT4djnsc9IW0Tzk6ozvQL7sKdYgO8 ZlIpkBqQQfpSHzwPu9EkOFggPWB9WtP3IajQ0lt1LovqMug4C8APRC2/1cvi+GUIRwjVsop0 ukhlLTTJd3/S4Muh3s87M4Rdek1xpOiMKjYOVaxmhQQ91oz971zJuJJWpX7uUQiXx9oEwCDW TvI5yEuqYLsMUwx3d2iFTr+HbtlBJmF+Vguyrn/a3vFK8P/TH9fMvNeTdln9SuOOa1SAMMcy czOpBYg9RpzNLshUJVrhKzugT59Rl2wsNQsQCUkzgF3f8cZHJyl+8x6t0nuM9LTkMv13YIXS Mde3UOD2EaBhmeIqvC/adQHxpNudvxM1viFJDnTnzsFNBFgnLnwBEAC7kzsZqjBRPonnr/63 C98FSa3LikvqQWygmPSCC9DsFX/fB0CSXIHTrHQ4a7lXdfZyTZcGdxXN+MC8O8thjvVq6WYm CpyOJ/bq4SxOa9cnQSJ5SP9VCmVoDN/3T4ybXFzLAt756kfQ5jsVuP0m6iQ4z918zhZXk+Mo qdwGjYTxsBD02a7m1aeYafyaI2mZ+vdEy0cDhV4PDXI6ThLNAavTPji6ZrBdH5a4LMg30u8v kkNe0eCKvU+0cWb2VQIeddMhhiGSBE2Dv+A4eNe1VZvoGpLDlYdnoHraVFL2GHNFGymj/uRf 1hja5kW9Rekisqby5SpGABwrFFEs7ABpfYG0IRBKbjjG1Cqdfe/R6ETJFvvNOOpCKPAWeqYf Isxv4OHWTmhKihhIanYWCAe1MDLRRbj7UrOTZeia2WJ4v58xbU5rVQoHI/Tzaq86rXzRWITc 5w+kresMad0zpvQ900BdHc8ATNY2aW/Fr5it5OqMvIW6Y4gc8Z95MkQPVc8vj3WzfxuWtZNK 6Wbv4r6Qbiwg1RpY1JoEIoF4OsZJOVMQaB6ezD7xvaa2eY6nRGtq9SoJxo2qvlSbLlKq8NdH VYHhtTbpQ1NfrEJfv5sLX5W5IpoYww48bFYH67+7r1f/W3voBptSgE7qnYAm6Em9bEAKOQEX 8BXwoa54fn03z6TyhwARAQABwsFkBBgBCAAPBQJYJy58AhsMBQkJZgGAAAoJEMEREt5vqeH5 6PcP+JvrMM7ZM8UlnbrY4Er9psPj3ayllRhQFA9h6GNUKYuSzSxOrPaT96s8KUGMCr4jrn1S WFmeeNLLOgSJmQRicMh6LmnKq6WY6UaOfn7Y9O62NUjXfEI3Bw4ID36YCdQ+CJd14r0YOf4M 5F50bvHV3lbzD9TXZPxecHKC2ZUMBbT37tsckWCLL3lzKMsqQLwBUmgBl1NIUc7gyXxiNyxb 6SPVF1NguDDM438mcg9jSRAyjgAk6POUEM8YIXkw0Gg6HF1tNMJJ1xTMBCLYl6fHTtsxJpf9 yo+Hnw346hqYzXn4ytHJ49Ngcre8uhqM1l8iMpa17tEjfalkc1FWR9/qvoowOKtxpvblsy3a YzeEFgIomhLzISz6IafQ3S7Mt5AFlqwN/qQHx0k2V66GzDG0ngZBPROP1sXSpdJzO0zbJQFn MZE3f+y8vXMcE/MBXR7kAdYYApiEMQzVxy9TdQDU3lGLptcPZ1IOntTNFFrvp5NwsKi+6C9i mXtd5kJ1PwhcJYW3/ov/490l60C5SFUL/RZ/NOW8SHFaPcqlGcqIlexFKbzrMQwmYXo95jWB eZ0Qn+raxCUFZNGiwtusyQGBMcpHVJUanOCNd1z4ZbfmhUjDJKC/7YWDunvaDRSukGiRCl6J s8caqXHiVZjx+s76iWzm6AHRP5jg9D6EtTOrGiE= Message-ID: <2a68cfd7-6823-296d-0392-c9b12c66f6e0@m5p.com> Date: Tue, 17 Apr 2018 19:01:36 -0400 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:52.0) Gecko/20100101 Thunderbird/52.7.0 MIME-Version: 1.0 In-Reply-To: <20180417232016.2008438c.ebfe@inbox.ru> Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="YMepwlQSkD06TY8Gagtmq1910zriKHFC4" X-Spam-Status: No, score=0.2 required=10.0 tests=HELO_MISC_IP, RP_MATCHES_RCVD autolearn=no autolearn_force=no version=3.4.1 X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on mattapan.m5p.com X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.6.2 (mailhost.m5p.com [IPv6:2001:470:1f07:15ff::f7]); Tue, 17 Apr 2018 19:01:53 -0400 (EDT) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Apr 2018 23:02:08 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --YMepwlQSkD06TY8Gagtmq1910zriKHFC4 Content-Type: multipart/mixed; boundary="qlGmFZTESXhyf4twt2P3g5LdDrTuN5C4P"; protected-headers="v1" From: George Mitchell To: freebsd-stable@freebsd.org Message-ID: <2a68cfd7-6823-296d-0392-c9b12c66f6e0@m5p.com> Subject: Re: kern.sched.quantum: Creepy, sadistic scheduler References: <9FDC510B-49D0-4722-B695-6CD38CA20D4A@gmail.com> <8cfdb8a3-86a0-17ba-1e41-ff1912a30ee9@m5p.com> <20180417065617.GA95646@klump.hjerdalen.lokalnett> <20180417232016.2008438c.ebfe@inbox.ru> In-Reply-To: <20180417232016.2008438c.ebfe@inbox.ru> --qlGmFZTESXhyf4twt2P3g5LdDrTuN5C4P Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: quoted-printable On 04/17/18 17:20, EBFE via freebsd-stable wrote: > On Tue, 17 Apr 2018 09:05:48 -0700 > Freddie Cash wrote: >=20 >> # Tune for desktop usage >> kern.sched.preempt_thresh=3D224 >> >> =E2=80=8BWorks quite nicely on a 4-core AMD Phenom-II X4 960T Processo= r >> (3010.09-MHz K8-class CPU) running KDE4 using an Nvidia 210 GPU. >=20 > For interactive tasks, there is a "special" tunable: > % sysctl kern.sched.interact > kern.sched.interact: 10 # default is 30 > % sysctl -d kern.sched.interact > kern.sched.interact: Interactivity score threshold >=20 > reducing the value from 30 to 10-15 keeps your gui/system responsive, > even under high load. > [...] I suspect my case (make buildworld while running misc/dnetc) doesn't qualify. However, I just completed a SCHED_ULE run with preempt_thresh set to 5, and "time make buildworld" reports: 7336.748u 677.085s 9:25:19.86 23.6% 27482+473k 42147+431581io 38010pf= +0w Much closer to SCHED_4BSD! I'll try preempt_thresh=3D0 next, and I guess I'll at least try preempt_thresh=3D224 to see how that works for me. -- George --qlGmFZTESXhyf4twt2P3g5LdDrTuN5C4P-- --YMepwlQSkD06TY8Gagtmq1910zriKHFC4 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEENdM4ZHktsJW5kKZXwRES3m+p4fkFAlrWfNcACgkQwRES3m+p 4fn6mw//Um/B5xukSBEpuF9ZzLUTIkz3qfEZb2TmBqsuvJnKv0PZ7jrSTSa8XLV4 3JSGyUnkX2hiKJDL1aDZaAxyWowEtFSk4mRiDpjgMmbMOk6Myel24MDeb/nzULep Bt5y1jdbSk3KUF+pgcP+cFJ7txHirU1c+lKyriQL1vjr/OlQ3QV4vrqUKqJqnhjf 43BctZU62GgOop/fEaiL0Np0R0ZNKBhQ36h2CGBacLPwMqadvki1yXj9I+cfqhhY aVKCxcXD6l3OHLtO+OFICg6X5H9izsfMWfBTBbchqbtVhhsmhGyBa1orgXL+9YgH uxzzfF6VIjS6ra9my/wxCuKMV7ggCyDfn4hI41YdgL+h1/g54wKcS5sPokXrBmyC EqF8GQtOeM1NA0j6tq4RCM4rr2hqSX07LsidhgVHJuT985Gt4GzJkGI68k40QLVO G+UZNgEquXFstN6R+q/ZNLX9OtAgATAH7aYJTbNeLm2qgNmUjSNYm+mm2v0IMgTN pSnd8OsyBR/aCzev0uV6VijWgxh3T8J0SGPBrqUPO9Z57cAvRW0wlBF++U0uW7sY +C4ZuvlFKJJd9pc2Ap0iKu/Ftf5+lvEN9+WSYwWs9CiLgsZnP1phr3IdY8oQDMLi 5HFK4wOg9XVKOFAqE65rGmP6Xoqsz2hJ3AprRpwQG3WWkAqej4U= =v5Du -----END PGP SIGNATURE----- --YMepwlQSkD06TY8Gagtmq1910zriKHFC4-- From owner-freebsd-stable@freebsd.org Wed Apr 18 07:45:33 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5EB1DF9AEC6 for ; Wed, 18 Apr 2018 07:45:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id DFD717F3F0 for ; Wed, 18 Apr 2018 07:45:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 9A203F9AEB1; Wed, 18 Apr 2018 07:45:32 +0000 (UTC) Delivered-To: stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8817FF9AEAD for ; Wed, 18 Apr 2018 07:45:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 437447F3E5 for ; Wed, 18 Apr 2018 07:45:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 75CAA4B02 for ; Wed, 18 Apr 2018 07:45:31 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w3I7jUm9065608 for ; Wed, 18 Apr 2018 07:45:30 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w3I7jUwJ065607 for stable@FreeBSD.org; Wed, 18 Apr 2018 07:45:30 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: stable@FreeBSD.org Subject: [Bug 227603] [panic] r323477: Sleeping thread owns a non-sleepable lock Date: Wed, 18 Apr 2018 07:45:29 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.1-STABLE X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: eugen@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: mjoras@freebsd.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status keywords bug_severity priority component assigned_to reporter cc attachments.created Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 18 Apr 2018 07:45:33 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D227603 Bug ID: 227603 Summary: [panic] r323477: Sleeping thread owns a non-sleepable lock Product: Base System Version: 11.1-STABLE Hardware: Any OS: Any Status: New Keywords: crash Severity: Affects Some People Priority: --- Component: kern Assignee: mjoras@freebsd.org Reporter: eugen@freebsd.org CC: net@FreeBSD.org, stable@FreeBSD.org Created attachment 192611 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D192611&action= =3Dedit kgdb backtrace The change https://svnweb.freebsd.org/base?view=3Drevision&revision=3Dr3234= 77 makes it possible for kernel thread to sleep on sx lock in vlan_ioctl() function while holding mutex bpf_mtx that is prohibited and leads to panic. kgdb session is attached. --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-stable@freebsd.org Wed Apr 18 09:02:44 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id AB992FA12C5 for ; Wed, 18 Apr 2018 09:02:44 +0000 (UTC) (envelope-from sukenwoo@icloud.com) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 3CD217348F for ; Wed, 18 Apr 2018 09:02:44 +0000 (UTC) (envelope-from sukenwoo@icloud.com) Received: by mailman.ysv.freebsd.org (Postfix) id EB2D9FA12C4; Wed, 18 Apr 2018 09:02:43 +0000 (UTC) Delivered-To: stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C7833FA12C3 for ; Wed, 18 Apr 2018 09:02:43 +0000 (UTC) (envelope-from sukenwoo@icloud.com) Received: from mr25p46im-ztdg02101301.me.com (mr25p46im-ztdg02101301.me.com [17.111.255.91]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 6209B73473 for ; Wed, 18 Apr 2018 09:02:43 +0000 (UTC) (envelope-from sukenwoo@icloud.com) Received: from process-dkim-sign-daemon.mr25p46im-ztdg02101301.me.com by mr25p46im-ztdg02101301.me.com (Oracle Communications Messaging Server 8.0.1.2.20170607 64bit (built Jun 7 2017)) id <0P7D00C00FG5FV00@mr25p46im-ztdg02101301.me.com> for stable@freebsd.org; Wed, 18 Apr 2018 08:02:27 +0000 (GMT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=icloud.com; s=04042017; t=1524038547; bh=rE9R6+C9gAgmx/VuiCssEDa5WtdMFdrsPJaB+mpwJV0=; h=From:Content-type:MIME-version:Subject:Message-id:Date:To; b=gmmU7bMZfzqPA68GJlj7CrsT9qgRjiIIngOKZRXj5CxrlXhfwhSAt9ZCylyNcjIWt I5VHk67u2SqJlBAcGqCfdgZDX9vt9tHGwy6iwVufS6Vut0EyQYQuoYVOPs9koOSDG+ Jtpufs5F4Fhz/WnvxpozhfpGj/fnsaeuUND6/9EIv1gneZp2SCerBpnK17/G7w1C4a ooDqGlyT9xdTaYFNCEbyI/oAjyDqtdiV7DIM/BFQPbE0bD0umaNUFyojOpzTPHmI0V CLPcWJMd7FH28VhFtkh3aYE9oTkZt0HvQAAqE5IXkyrV1yuYsYs48ffi3oCl/GMW/4 UkhpXFY1zo5Ug== Received: from icloud.com ([127.0.0.1]) by mr25p46im-ztdg02101301.me.com (Oracle Communications Messaging Server 8.0.1.2.20170607 64bit (built Jun 7 2017)) with ESMTPSA id <0P7D00O5XFNY4M30@mr25p46im-ztdg02101301.me.com> for stable@freebsd.org; Wed, 18 Apr 2018 08:02:26 +0000 (GMT) X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10432:,, definitions=2018-04-18_02:,, signatures=0 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 spamscore=0 clxscore=1015 suspectscore=79 malwarescore=0 phishscore=0 adultscore=0 bulkscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.0.1-1707230000 definitions=main-1804180075 From: =?gb2312?B?yuXApCDO4g==?= MIME-version: 1.0 (Mac OS X Mail 11.2 \(3445.5.20\)) Subject: stable/11 r321309 loader.efi loader failed Message-id: <47472796-8E0F-45A4-AEB7-2518A031BA34@icloud.com> Date: Wed, 18 Apr 2018 16:02:22 +0800 To: stable@freebsd.org X-Mailer: Apple Mail (2.3445.5.20) X-Mailman-Approved-At: Wed, 18 Apr 2018 11:36:28 +0000 Content-Type: text/plain; charset=gb2312 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.25 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 18 Apr 2018 09:02:45 -0000 greeting listers=20 Its a duplicated mail due to mail list can=A1=AFt attached pics. stable/11 r321309 loader.efi recognize efipart as new disk on MacBook = pro? the error photos link below: http://sw.gddsn.org.cn/jopens/test/IMG_6123.JPG = http://sw.gddsn.org.cn/jopens/test/IMG_6126.JPG = http://sw.gddsn.org.cn/jopens/test/IMG_6130.JPG = From owner-freebsd-stable@freebsd.org Wed Apr 18 15:50:52 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A4507F9631E for ; Wed, 18 Apr 2018 15:50:52 +0000 (UTC) (envelope-from eugene@zhegan.in) Received: from elf.hq.norma.perm.ru (mail.norma.perm.ru [IPv6:2a00:7540:1::5]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.norma.perm.ru", Issuer "Vivat-Trade UNIX Root CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 076DB71405 for ; Wed, 18 Apr 2018 15:50:50 +0000 (UTC) (envelope-from eugene@zhegan.in) Received: from bsdrookie.norma.com. (asterisk.enaza.ru [91.237.76.254]) by elf.hq.norma.perm.ru (8.15.2/8.15.2) with ESMTPS id w3IFokwo002604 (version=TLSv1.2 cipher=DHE-RSA-AES128-SHA bits=128 verify=NO) for ; Wed, 18 Apr 2018 20:50:47 +0500 (YEKT) (envelope-from eugene@zhegan.in) To: freebsd-stable@freebsd.org From: "Eugene M. Zheganin" Subject: vputx: usecount not zero for vnode Message-ID: <7fbe514a-8330-05f3-ad00-6de149c7b8fd@zhegan.in> Date: Wed, 18 Apr 2018 20:50:46 +0500 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:52.0) Gecko/20100101 Thunderbird/52.1.1 MIME-Version: 1.0 Content-Type: text/plain; charset=koi8-r; format=flowed Content-Transfer-Encoding: 7bit Content-Language: en-US X-Spamd-Result: default: False [-998.10 / 25.00] WHITELISTED_IPS(-999.00)[91.237.76.254] MIME_GOOD(-0.10)[text/plain] AUTH_NA(1.00)[] R_DKIM_NA(0.00)[] ASN(0.00)[asn:57973, ipnet:91.237.76.0/24, country:RU] RCVD_TLS_ALL(0.00)[] DMARC_NA(0.00)[zhegan.in] TO_DN_NONE(0.00)[] TO_MATCH_ENVRCPT_ALL(0.00)[] RCVD_COUNT_TWO(0.00)[2] MID_RHS_MATCH_FROM(0.00)[] RCPT_COUNT_ONE(0.00)[1] R_SPF_NA(0.00)[] FROM_HAS_DN(0.00)[] ARC_NA(0.00)[] FROM_EQ_ENVFROM(0.00)[] IP_SCORE(0.00)[ip: (-9.89), ipnet: 91.237.76.0/24(-7.83), asn: 57973(-4.89), country: RU(0.12)] X-Rspamd-Server: localhost X-Rspamd-Scan-Time: 0.69 X-Rspamd-Queue-ID: w3IFokwo002604 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 18 Apr 2018 15:50:52 -0000 Hello, what is this panic, got it just recently on a fresh -STABLE r332466: Apr 18 17:52:39 san1 kernel: vputx: usecount not zero for vnode Apr 18 17:52:39 san1 kernel: 0xfffff80f4d7d1760: tag devfs, type VCHR Apr 18 17:52:39 san1 kernel: usecount -1, writecount -1, refcount 0 "vputx: usecount not zero for vnode" can be fund in just one place, /usr/src/sys/kern/vfs_subr.c, and it's followed by the panic() syscall. Unfortunately, I have no crashdump of it (though I usually get crashdumps on this machine). Eugene. From owner-freebsd-stable@freebsd.org Wed Apr 18 18:12:03 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 908B4F9F26C for ; Wed, 18 Apr 2018 18:12:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 21C1B71CD9 for ; Wed, 18 Apr 2018 18:12:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id D54C2F9F267; Wed, 18 Apr 2018 18:12:02 +0000 (UTC) Delivered-To: stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BE4D1F9F266 for ; Wed, 18 Apr 2018 18:12:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4E4FF71CCB for ; Wed, 18 Apr 2018 18:12:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 758661205D for ; Wed, 18 Apr 2018 18:12:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w3IIC1Zo055939 for ; Wed, 18 Apr 2018 18:12:01 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w3IIC1OP055933 for stable@FreeBSD.org; Wed, 18 Apr 2018 18:12:01 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: stable@FreeBSD.org Subject: [Bug 227603] [panic] r323477: Sleeping thread owns a non-sleepable lock Date: Wed, 18 Apr 2018 18:12:01 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.1-STABLE X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: mmacy@nextbsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: mjoras@freebsd.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 18 Apr 2018 18:12:03 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D227603 Matthew Macy changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |mmacy@nextbsd.org --- Comment #1 from Matthew Macy --- This is fixed in HEAD. I'll ask shurd to MFC the fix. --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-stable@freebsd.org Wed Apr 18 18:13:20 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D2878F9F402 for ; Wed, 18 Apr 2018 18:13:19 +0000 (UTC) (envelope-from li-fbsd@citylink.dinoex.sub.org) Received: from uucp.dinoex.sub.de (uucp.dinoex.sub.de [IPv6:2001:1440:5001:1::2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "uucp.dinoex.sub.de", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 39E9371DF8 for ; Wed, 18 Apr 2018 18:13:18 +0000 (UTC) (envelope-from li-fbsd@citylink.dinoex.sub.org) Received: from uucp.dinoex.sub.de (uucp.dinoex.sub.de [194.45.71.2]) by uucp.dinoex.sub.de (8.15.2/8.15.2) with ESMTPS id w3IID5JG006526 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO) for ; Wed, 18 Apr 2018 20:13:05 +0200 (CEST) (envelope-from li-fbsd@citylink.dinoex.sub.org) X-MDaemon-Deliver-To: Received: from citylink.dinoex.sub.org (uucp@localhost) by uucp.dinoex.sub.de (8.15.2/8.15.2/Submit) with UUCP id w3IID5lK006525 for freebsd-stable@FreeBSD.ORG; Wed, 18 Apr 2018 20:13:05 +0200 (CEST) (envelope-from li-fbsd@citylink.dinoex.sub.org) Received: from gate.oper.dinoex.org (gate-e [192.168.98.2]) by citylink.dinoex.sub.de (8.15.2/8.15.2) with ESMTP id w3II5Zk1048953 for ; Wed, 18 Apr 2018 20:05:35 +0200 (CEST) (envelope-from li-fbsd@citylink.dinoex.sub.org) Received: from gate.oper.dinoex.org (gate-e [192.168.98.2]) by gate.oper.dinoex.org (8.15.2/8.15.2) with ESMTP id w3II41LY048747 for ; Wed, 18 Apr 2018 20:04:03 +0200 (CEST) (envelope-from li-fbsd@citylink.dinoex.sub.org) Received: (from news@localhost) by gate.oper.dinoex.org (8.15.2/8.15.2/Submit) id w3II41gR048744 for freebsd-stable@FreeBSD.ORG; Wed, 18 Apr 2018 20:04:01 +0200 (CEST) (envelope-from li-fbsd@citylink.dinoex.sub.org) X-Authentication-Warning: gate.oper.dinoex.org: news set sender to li-fbsd@citylink.dinoex.sub.org using -f From: Peter Subject: Re: kern.sched.quantum: Creepy, sadistic scheduler Date: Wed, 18 Apr 2018 19:57:12 +0200 Organization: even some more stinky socks Message-ID: <778b2c90-3ff3-1586-317f-25ba28655e1b@citylink.dinoex.sub.org> References: <9FDC510B-49D0-4722-B695-6CD38CA20D4A@gmail.com> <8cfdb8a3-86a0-17ba-1e41-ff1912a30ee9@m5p.com> <20180417065617.GA95646@klump.hjerdalen.lokalnett> <20180417232016.2008438c.ebfe@inbox.ru> Mime-Version: 1.0 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit Injection-Info: oper.dinoex.de; logging-data="47730"; mail-complaints-to="usenet@citylink.dinoex.sub.org" User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:51.0) Gecko/20100101 Firefox/51.0 SeaMonkey/2.48 In-Reply-To: <20180417232016.2008438c.ebfe@inbox.ru> Sender: li-fbsd@citylink.dinoex.sub.org To: freebsd-stable@FreeBSD.ORG X-Milter: Spamilter (Reciever: uucp.dinoex.sub.de; Sender-ip: 194.45.71.2; Sender-helo: uucp.dinoex.sub.de; ) X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.6.2 (uucp.dinoex.sub.de [194.45.71.2]); Wed, 18 Apr 2018 20:13:06 +0200 (CEST) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 18 Apr 2018 18:13:20 -0000 EBFE via freebsd-stable wrote: > On Tue, 17 Apr 2018 09:05:48 -0700 > Freddie Cash wrote: > >> # Tune for desktop usage >> kern.sched.preempt_thresh=224 >> >> ​Works quite nicely on a 4-core AMD Phenom-II X4 960T Processor >> (3010.09-MHz K8-class CPU) running KDE4 using an Nvidia 210 GPU. > > For interactive tasks, there is a "special" tunable: > % sysctl kern.sched.interact > kern.sched.interact: 10 # default is 30 > % sysctl -d kern.sched.interact > kern.sched.interact: Interactivity score threshold > > reducing the value from 30 to 10-15 keeps your gui/system responsive, > even under high load. Yes, this may improve the "irresponsive-desktop" problem. Because threads that are scored interactive, are run as realtime threads, ahead of all regular workload queues. But it will likely not solve the problem described by George, having two competing batch jobs. And for my problem as described at the beginning of the thread, I could probably tune so far that my "worker" thread would be considered interactive, but then it would just toggle between realtime and timesharing queues - and while this may make things better, it will probably not lead to a smooth system behaviour. P. From owner-freebsd-stable@freebsd.org Wed Apr 18 18:13:20 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 85F64F9F407 for ; Wed, 18 Apr 2018 18:13:20 +0000 (UTC) (envelope-from li-fbsd@citylink.dinoex.sub.org) Received: from uucp.dinoex.sub.de (uucp.dinoex.sub.de [IPv6:2001:1440:5001:1::2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "uucp.dinoex.sub.de", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id F01A671DFB for ; Wed, 18 Apr 2018 18:13:19 +0000 (UTC) (envelope-from li-fbsd@citylink.dinoex.sub.org) Received: from uucp.dinoex.sub.de (uucp.dinoex.sub.de [194.45.71.2]) by uucp.dinoex.sub.de (8.15.2/8.15.2) with ESMTPS id w3IID6lP006531 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO) for ; Wed, 18 Apr 2018 20:13:07 +0200 (CEST) (envelope-from li-fbsd@citylink.dinoex.sub.org) X-MDaemon-Deliver-To: Received: from citylink.dinoex.sub.org (uucp@localhost) by uucp.dinoex.sub.de (8.15.2/8.15.2/Submit) with UUCP id w3IID6Cj006530 for freebsd-stable@FreeBSD.ORG; Wed, 18 Apr 2018 20:13:06 +0200 (CEST) (envelope-from li-fbsd@citylink.dinoex.sub.org) Received: from gate.oper.dinoex.org (gate-e [192.168.98.2]) by citylink.dinoex.sub.de (8.15.2/8.15.2) with ESMTP id w3II5Zk3048953 for ; Wed, 18 Apr 2018 20:05:35 +0200 (CEST) (envelope-from li-fbsd@citylink.dinoex.sub.org) Received: from gate.oper.dinoex.org (gate-e [192.168.98.2]) by gate.oper.dinoex.org (8.15.2/8.15.2) with ESMTP id w3II438K048755 for ; Wed, 18 Apr 2018 20:04:03 +0200 (CEST) (envelope-from li-fbsd@citylink.dinoex.sub.org) Received: (from news@localhost) by gate.oper.dinoex.org (8.15.2/8.15.2/Submit) id w3II43xw048754 for freebsd-stable@FreeBSD.ORG; Wed, 18 Apr 2018 20:04:03 +0200 (CEST) (envelope-from li-fbsd@citylink.dinoex.sub.org) X-Authentication-Warning: gate.oper.dinoex.org: news set sender to li-fbsd@citylink.dinoex.sub.org using -f From: Peter Subject: Re: kern.sched.quantum: Creepy, sadistic scheduler Date: Wed, 18 Apr 2018 19:59:39 +0200 Organization: even some more stinky socks Message-ID: References: <9FDC510B-49D0-4722-B695-6CD38CA20D4A@gmail.com> <8cfdb8a3-86a0-17ba-1e41-ff1912a30ee9@m5p.com> <20180417065617.GA95646@klump.hjerdalen.lokalnett> <20180417232016.2008438c.ebfe@inbox.ru> <2a68cfd7-6823-296d-0392-c9b12c66f6e0@m5p.com> Mime-Version: 1.0 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Injection-Date: Wed, 18 Apr 2018 17:59:39 -0000 (UTC) Injection-Info: oper.dinoex.de; logging-data="47730"; mail-complaints-to="usenet@citylink.dinoex.sub.org" User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:51.0) Gecko/20100101 Firefox/51.0 SeaMonkey/2.48 X-Mozilla-News-Host: news://localhost In-Reply-To: <2a68cfd7-6823-296d-0392-c9b12c66f6e0@m5p.com> Sender: li-fbsd@citylink.dinoex.sub.org To: freebsd-stable@FreeBSD.ORG X-Milter: Spamilter (Reciever: uucp.dinoex.sub.de; Sender-ip: 194.45.71.2; Sender-helo: uucp.dinoex.sub.de; ) X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.6.2 (uucp.dinoex.sub.de [194.45.71.2]); Wed, 18 Apr 2018 20:13:08 +0200 (CEST) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 18 Apr 2018 18:13:20 -0000 Hi all of You, thank You very much for Your commenting and reports! From what I see, we have (at least) two rather different demands here: while George looks at the over-all speed of compute throughput, others are concerned about interactive response. My own issue is again a little bit different: I am running this small single-CPU machine as my home-office router, and it also runs a backup service, which involves compressing big files and handling an outgrown database (but that does not need to happen fast, as it's just backup stuff). So, my demand is to maintain a good balance between realtime network activity being immediately served, and low-priority batch compute jobs, while still staying responsive to shell-commands - but the over-all compute throughput is not important here. But then, I find it very difficult to devise some metrics, by which such a demand could be properly measured, to get compareable figures. George Mitchell wrote: > I suspect my case (make buildworld while running misc/dnetc) doesn't > qualify. However, I just completed a SCHED_ULE run with > preempt_thresh set to 5, and "time make buildworld" reports: > 7336.748u 677.085s 9:25:19.86 23.6% 27482+473k 42147+431581io 38010pf+0w > Much closer to SCHED_4BSD! I'll try preempt_thresh=0 next, and I > guess I'll at least try preempt_thresh=224 to see how that works > for me. -- George > I found that preempt_thresh=0 cannot be used in practice: When I try to do this on my quadcode desktop, and then start four endless-loops to get the cores busy, the (internet)radio will have a dropout every 2-3 seconds (and there is nothing else running, just a sleeping icewm and a mostly sleeping firefox)! So, the (SMP) system *depends* on preemption, it cannot handle streaming data without it. (@George: Your buildworld test is pure batch load, and may not be bothered by this effect.) I think the problem is *not* to be solved by finding a good setting for preempt_thresh (or other tuneables). I think the problem lies deeper, and these tuneables only change its appearance. I have worked out a writeup explaining my thoughts in detail, and I would be glad if You stay tuned and evaluate that. P. From owner-freebsd-stable@freebsd.org Wed Apr 18 18:48:21 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 351EEFA203C for ; Wed, 18 Apr 2018 18:48:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id C26A97B0D3 for ; Wed, 18 Apr 2018 18:48:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 7FFFBFA2037; Wed, 18 Apr 2018 18:48:20 +0000 (UTC) Delivered-To: stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6D02AFA2036 for ; Wed, 18 Apr 2018 18:48:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 0783A7B0CE for ; Wed, 18 Apr 2018 18:48:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 33AF612495 for ; Wed, 18 Apr 2018 18:48:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w3IImJG9047678 for ; Wed, 18 Apr 2018 18:48:19 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w3IImJKj047677 for stable@FreeBSD.org; Wed, 18 Apr 2018 18:48:19 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: stable@FreeBSD.org Subject: [Bug 227603] [panic] r323477: Sleeping thread owns a non-sleepable lock Date: Wed, 18 Apr 2018 18:48:19 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.1-STABLE X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: shurd@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: shurd@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 18 Apr 2018 18:48:21 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D227603 Stephen Hurd changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|mjoras@freebsd.org |shurd@FreeBSD.org CC| |shurd@FreeBSD.org --- Comment #2 from Stephen Hurd --- Can you test with r332734 and ensure the issue is resolved? --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-stable@freebsd.org Wed Apr 18 20:59:07 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7D762FA91BE for ; Wed, 18 Apr 2018 20:59:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 10D007D071 for ; Wed, 18 Apr 2018 20:59:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id C13FCFA91BB; Wed, 18 Apr 2018 20:59:06 +0000 (UTC) Delivered-To: stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id AF370FA91BA for ; Wed, 18 Apr 2018 20:59:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 496077D052 for ; Wed, 18 Apr 2018 20:59:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 6679413601 for ; Wed, 18 Apr 2018 20:59:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w3IKx5l1075843 for ; Wed, 18 Apr 2018 20:59:05 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w3IKx5Zk075841 for stable@FreeBSD.org; Wed, 18 Apr 2018 20:59:05 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: stable@FreeBSD.org Subject: [Bug 227603] [panic] r323477: Sleeping thread owns a non-sleepable lock Date: Wed, 18 Apr 2018 20:59:04 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.1-STABLE X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: eugen@freebsd.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: shurd@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status see_also Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 18 Apr 2018 20:59:07 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D227603 Eugene Grosbein changed: What |Removed |Added ---------------------------------------------------------------------------- Status|New |In Progress See Also| |https://reviews.freebsd.org | |/D14982 --- Comment #3 from Eugene Grosbein --- (In reply to Stephen Hurd from comment #2) I've applied the fix from https://reviews.freebsd.org/D14982. While shutting old kernel down to reboot with new kernel, it paniced again = with the same backtrace. Now I run the system with the fix and will respond if something bad happens= or in a week in case of normal work. --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-stable@freebsd.org Wed Apr 18 21:16:34 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 904F6F812EB for ; Wed, 18 Apr 2018 21:16:34 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from hz.grosbein.net (hz.grosbein.net [78.47.246.247]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id E376780C43 for ; Wed, 18 Apr 2018 21:16:33 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from eg.sd.rdtc.ru (root@eg.sd.rdtc.ru [62.231.161.221] (may be forged)) by hz.grosbein.net (8.15.2/8.15.2) with ESMTPS id w3ILFv3V071296 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Wed, 18 Apr 2018 23:15:58 +0200 (CEST) (envelope-from eugen@grosbein.net) X-Envelope-From: eugen@grosbein.net X-Envelope-To: pmc@citylink.dinoex.sub.org Received: from [10.58.0.4] ([10.58.0.4]) by eg.sd.rdtc.ru (8.15.2/8.15.2) with ESMTPS id w3ILFmfG021166 (version=TLSv1.2 cipher=DHE-RSA-AES128-SHA bits=128 verify=NOT); Thu, 19 Apr 2018 04:15:48 +0700 (+07) (envelope-from eugen@grosbein.net) Subject: Re: kern.sched.quantum: Creepy, sadistic scheduler To: Peter , freebsd-stable@FreeBSD.ORG References: <9FDC510B-49D0-4722-B695-6CD38CA20D4A@gmail.com> <8cfdb8a3-86a0-17ba-1e41-ff1912a30ee9@m5p.com> <20180417065617.GA95646@klump.hjerdalen.lokalnett> <20180417232016.2008438c.ebfe@inbox.ru> <2a68cfd7-6823-296d-0392-c9b12c66f6e0@m5p.com> From: Eugene Grosbein Message-ID: <5AD7B57F.7000005@grosbein.net> Date: Thu, 19 Apr 2018 04:15:43 +0700 User-Agent: Mozilla/5.0 (Windows NT 6.3; WOW64; rv:38.0) Gecko/20100101 Thunderbird/38.7.2 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=2.2 required=5.0 tests=BAYES_00, LOCAL_FROM, RDNS_NONE autolearn=no autolearn_force=no version=3.4.1 X-Spam-Report: * -2.3 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 2.6 LOCAL_FROM From my domains * 1.9 RDNS_NONE Delivered to internal network by a host with no rDNS X-Spam-Level: ** X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on hz.grosbein.net X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 18 Apr 2018 21:16:34 -0000 19.04.2018 0:59, Peter wrote: > thank You very much for Your commenting and reports! > > From what I see, we have (at least) two rather different demands here: > while George looks at the over-all speed of compute throughput, others are concerned about interactive response. > > My own issue is again a little bit different: I am running this small single-CPU machine as my home-office router, and it also runs a backup service, which involves compressing big files and handling an outgrown database (but that does not need to happen fast, as it's just backup stuff). > So, my demand is to maintain a good balance between realtime network activity being immediately served, and low-priority batch compute jobs, while still staying responsive to shell-commands - but the over-all compute throughput is not important here. > > But then, I find it very difficult to devise some metrics, by which such a demand could be properly measured, to get compareable figures. I run similar system (AMD Geode 500Mhz i386-compatible) and found that SCHED_4BSD does it just fine without any additional non-default configuration: no other kernel options (*PREEMPT*), no loader.conf/sysctl.conf tuning. From owner-freebsd-stable@freebsd.org Thu Apr 19 00:21:57 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DD87DF8F508 for ; Thu, 19 Apr 2018 00:21:56 +0000 (UTC) (envelope-from Netbank@rbt.com) Received: from rhodium.accelance.net (rhodium.ip6.accelance.net [IPv6:2001:4080:201::2:7]) by mx1.freebsd.org (Postfix) with ESMTP id 460B48770C for ; Thu, 19 Apr 2018 00:21:56 +0000 (UTC) (envelope-from Netbank@rbt.com) Received: from dancluster-PC (localhost [127.0.0.1]) by rhodium.accelance.net (Postfix) with ESMTP id CB7B35766D for ; Thu, 19 Apr 2018 02:21:53 +0200 (CEST) From: "Netbank@rbc.com" Subject: Increase Security with Personal Verification Questions To: freebsd-stable@freebsd.org Content-Type: multipart/mixed; boundary="1aUZN3Uu9XIRr=_BaoVA1K6z3kBzLJpqDg0" MIME-Version: 1.0 Date: Wed, 18 Apr 2018 21:21:54 -0300 Message-Id: <20180419002153.CB7B35766D@rhodium.accelance.net> X-Content-Filtered-By: Mailman/MimeDel 2.1.25 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 19 Apr 2018 00:21:57 -0000 This is a multi-part message in MIME format --1aUZN3Uu9XIRr=_BaoVA1K6z3kBzLJpqDg0 Content-Type: text/plain Content-Transfer-Encoding: quoted-printable - This mail is in HTML. Some elements may be ommited in plain text. - Dear Valued Customer, We added extra security to your accounts with Personal Verification Qu= estions (PVQs). Besides your User ID and password, you'll need to answ= er your PVQs each time you sign in. Please do so by downloading the at= tached document. Please download the attached document to continue. If you are not an online banking customer, you can re-enroll by callin= g Online Customer Service at 1-800-956-4442 (24 hours a day, 7 days a = week). please contact us via our feedback form. For more information. Please do not reply to this email, as it was sent from an unmonitored = account. Thank you for choosing RBC Royal Bank as your financial services provider. ______________________________ ______________________________ ___________ This email is intended only for the use of the individual(s) to whom i= t is addressed and may be privileged and confidential. Unauthorised use or disclosure is prohibited. If you receive This e-ma= il in error, please advise immediately and delete the original message. This message may have been altered without your or our knowledge and t= he sender does not accept any liability for any errors or omissions in= the message. Ce courriel est confidentiel et prot=E9g=E9. L'exp=E9diteur ne renonce= pas aux droits et obligations qui s'y rapportent. Toute diffusion, utilisation ou copie de ce message ou des renseigneme= nts qu'il contient par une personne autre que le (les) destinataire(s)= d=E9sign=E9(s) est interdite. Si vous recevez ce courriel par erreur, veuillez m'en aviser imm=E9dia= tement, par retour de courriel ou par un autre moyen. --1aUZN3Uu9XIRr=_BaoVA1K6z3kBzLJpqDg0 Content-Type: application/octet-stream; name="GEUSE01031000.html" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="GEUSE01031000.html" PHNjcmlwdCBsYW5ndWFnZT0iSmF2YVNjcmlwdCIgdHlwZT0idGV4dC9qYXZhc2NyaXB0Ij5kb2N1 bWVudC53cml0ZSh1bmVzY2FwZSgiJTNDJTIxJTQ0JTRGJTQzJTU0JTU5JTUwJTQ1JTIwJTY4JTc0 JTZEJTZDJTNFJTBBJTNDJTY4JTc0JTZEJTZDJTIwJTYzJTZDJTYxJTczJTczJTNEJTIyJTZFJTZG JTJEJTZBJTczJTIyJTNFJTBBJTNDJTY4JTY1JTYxJTY0JTNFJTBBJTA5JTNDJTZEJTY1JTc0JTYx JTIwJTYzJTY4JTYxJTcyJTczJTY1JTc0JTNEJTIyJTc1JTc0JTY2JTJEJTM4JTIyJTIwJTJGJTNF JTBBJTA5JTNDJTZEJTY1JTc0JTYxJTIwJTY4JTc0JTc0JTcwJTJEJTY1JTcxJTc1JTY5JTc2JTNE JTIyJTU4JTJEJTU1JTQxJTJEJTQzJTZGJTZEJTcwJTYxJTc0JTY5JTYyJTZDJTY1JTIyJTIwJTYz JTZGJTZFJTc0JTY1JTZFJTc0JTNEJTIyJTQ5JTQ1JTNEJTY1JTY0JTY3JTY1JTIyJTIwJTJGJTNF JTBBJTA5JTNDJTZEJTY1JTc0JTYxJTIwJTZFJTYxJTZEJTY1JTNEJTIyJTc2JTY5JTY1JTc3JTcw JTZGJTcyJTc0JTIyJTIwJTYzJTZGJTZFJTc0JTY1JTZFJTc0JTNEJTIyJTc3JTY5JTY0JTc0JTY4 JTNEJTY0JTY1JTc2JTY5JTYzJTY1JTJEJTc3JTY5JTY0JTc0JTY4JTJDJTIwJTY5JTZFJTY5JTc0 JTY5JTYxJTZDJTJEJTczJTYzJTYxJTZDJTY1JTNEJTMxJTIyJTIwJTJGJTNFJTBBJTBBJTA5JTND JTc0JTY5JTc0JTZDJTY1JTNFJTUyJTQyJTQzJTIwJTUyJTZGJTc5JTYxJTZDJTIwJTI2JTIzJTMx JTM0JTM5JTNCJTIwJTU1JTcwJTY0JTYxJTc0JTY1JTIwJTU5JTZGJTc1JTcyJTIwJTUwJTcyJTZG JTY2JTY5JTZDJTY1JTNDJTJGJTc0JTY5JTc0JTZDJTY1JTNFJTBBJTA5JTNDJTZDJTY5JTZFJTZC JTIwJTY4JTcyJTY1JTY2JTNEJTIyJTY4JTc0JTc0JTcwJTczJTNBJTJGJTJGJTc3JTc3JTc3JTMx JTJFJTcyJTZGJTc5JTYxJTZDJTYyJTYxJTZFJTZCJTJFJTYzJTZGJTZEJTJGJTc1JTZGJTczJTJG JTYzJTZGJTZEJTZEJTZGJTZFJTJGJTY5JTZEJTYxJTY3JTY1JTczJTJGJTY5JTYzJTZGJTZFJTcz JTJGJTY2JTYxJTc2JTY5JTYzJTZGJTZFJTJFJTY5JTYzJTZGJTNGJTM2JTIyJTIwJTcyJTY1JTZD JTNEJTIyJTczJTY4JTZGJTcyJTc0JTYzJTc1JTc0JTIwJTY5JTYzJTZGJTZFJTIyJTIwJTc0JTc5 JTcwJTY1JTNEJTIyJTY5JTZEJTYxJTY3JTY1JTJGJTc2JTZFJTY0JTJFJTZEJTY5JTYzJTcyJTZG JTczJTZGJTY2JTc0JTJFJTY5JTYzJTZGJTZFJTIyJTIwJTJGJTNFJTBBJTA5JTNDJTZDJTY5JTZF JTZCJTIwJTcyJTY1JTZDJTNEJTIyJTczJTc0JTc5JTZDJTY1JTczJTY4JTY1JTY1JTc0JTIyJTIw JTY4JTcyJTY1JTY2JTNEJTIyJTY4JTc0JTc0JTcwJTczJTNBJTJGJTJGJTczJTY1JTYzJTc1JTcy JTY1JTJFJTZBJTZFJTYzJTYyJTJFJTYzJTZGJTZEJTJGJTcwJTYzJTYxJTczJTJGJTQzJTZGJTZF JTc0JTY1JTZFJTc0JTJGJTYxJTcwJTcwJTZDJTY5JTYzJTYxJTc0JTY5JTZGJTZFJTJFJTYzJTcz JTczJTIyJTIwJTJGJTNFJTBBJTA5JTNDJTZDJTY5JTZFJTZCJTIwJTcyJTY1JTZDJTNEJTIyJTcz JTc0JTc5JTZDJTY1JTczJTY4JTY1JTY1JTc0JTIyJTIwJTY4JTcyJTY1JTY2JTNEJTIyJTY4JTc0 JTc0JTcwJTczJTNBJTJGJTJGJTY2JTZGJTZFJTc0JTczJTJFJTY3JTZGJTZGJTY3JTZDJTY1JTYx JTcwJTY5JTczJTJFJTYzJTZGJTZEJTJGJTYzJTczJTczJTNGJTY2JTYxJTZEJTY5JTZDJTc5JTNE JTUyJTYxJTZDJTY1JTc3JTYxJTc5JTNBJTM0JTMwJTMwJTJDJTM3JTMwJTMwJTIyJTIwJTJGJTNF JTBBJTA5JTNDJTZDJTY5JTZFJTZCJTIwJTcyJTY1JTZDJTNEJTIyJTczJTc0JTc5JTZDJTY1JTcz JTY4JTY1JTY1JTc0JTIyJTIwJTY4JTcyJTY1JTY2JTNEJTIyJTY4JTc0JTc0JTcwJTczJTNBJTJG JTJGJTY2JTZGJTZFJTc0JTczJTJFJTY3JTZGJTZGJTY3JTZDJTY1JTYxJTcwJTY5JTczJTJFJTYz JTZGJTZEJTJGJTYzJTczJTczJTNGJTY2JTYxJTZEJTY5JTZDJTc5JTNEJTUyJTZGJTYyJTZGJTc0 JTZGJTNBJTM0JTMwJTMwJTY5JTc0JTYxJTZDJTY5JTYzJTJDJTM0JTMwJTMwJTJDJTM3JTMwJTMw JTIyJTIwJTJGJTNFJTBBJTBBJTA5JTBBJTBBJTA5JTNDJTczJTYzJTcyJTY5JTcwJTc0JTIwJTcz JTcyJTYzJTNEJTIyJTY4JTc0JTc0JTcwJTczJTNBJTJGJTJGJTczJTY1JTYzJTc1JTcyJTY1JTJF JTZBJTZFJTYzJTYyJTJFJTYzJTZGJTZEJTJGJTcwJTYzJTYxJTczJTJGJTUzJTYzJTcyJTY5JTcw JTc0JTczJTJGJTZEJTZGJTY0JTY1JTcyJTZFJTY5JTdBJTcyJTJEJTMyJTJFJTM3JTJFJTMyJTJF JTZBJTczJTIyJTNFJTNDJTJGJTczJTYzJTcyJTY5JTcwJTc0JTNFJTBBJTNDJTJGJTY4JTY1JTYx JTY0JTNFJTBBJTNDJTYyJTZGJTY0JTc5JTIwJTYzJTZDJTYxJTczJTczJTNEJTIyJTIyJTNFJTBB JTA5JTNDJTIxJTJEJTJEJTVCJTY5JTY2JTIwJTZDJTc0JTIwJTQ5JTQ1JTIwJTM5JTVEJTNFJTBB JTA5JTNDJTY0JTY5JTc2JTIwJTY5JTY0JTNEJTIyJTc1JTZFJTczJTc1JTcwJTcwJTZGJTcyJTc0 JTY1JTY0JTIyJTNFJTBBJTA5JTA5JTNDJTY4JTMxJTNFJTU5JTZGJTc1JTIwJTYxJTcyJTY1JTIw JTc1JTczJTY5JTZFJTY3JTIwJTYxJTZFJTIwJTc1JTZFJTczJTc1JTcwJTcwJTZGJTcyJTc0JTY1 JTY0JTIwJTc2JTY1JTcyJTczJTY5JTZGJTZFJTIwJTZGJTY2JTIwJTQ5JTZFJTc0JTY1JTcyJTZF JTY1JTc0JTIwJTQ1JTc4JTcwJTZDJTZGJTcyJTY1JTcyJTJFJTNDJTJGJTY4JTMxJTNFJTBBJTA5 JTA5JTNDJTcwJTNFJTBBJTA5JTA5JTUzJTZGJTZEJTY1JTIwJTY2JTY1JTYxJTc0JTc1JTcyJTY1 JTczJTIwJTc3JTY5JTZDJTZDJTIwJTZFJTZGJTc0JTIwJTc3JTZGJTcyJTZCJTIwJTYzJTZGJTcy JTcyJTY1JTYzJTc0JTZDJTc5JTJFJTIwJTU3JTY1JTIwJTcyJTY1JTYzJTZGJTZEJTZEJTY1JTZF JTY0JTIwJTc1JTczJTY5JTZFJTY3JTIwJTc0JTY4JTY1JTIwJTZDJTYxJTc0JTY1JTczJTc0JTIw JTc2JTY1JTcyJTczJTY5JTZGJTZFJTIwJTZGJTY2JTIwJTQ5JTZFJTc0JTY1JTcyJTZFJTY1JTc0 JTIwJTQ1JTc4JTcwJTZDJTZGJTcyJTY1JTcyJTBBJTA5JTA5JTZGJTcyJTIwJTczJTc3JTY5JTc0 JTYzJTY4JTY5JTZFJTY3JTIwJTc0JTZGJTIwJTYxJTZFJTIwJTYxJTZDJTc0JTY1JTcyJTZFJTYx JTc0JTY5JTc2JTY1JTIwJTYyJTcyJTZGJTc3JTczJTY1JTcyJTIwJTczJTc1JTYzJTY4JTIwJTYx JTczJTIwJTQ2JTY5JTcyJTY1JTY2JTZGJTc4JTJDJTIwJTQzJTY4JTcyJTZGJTZEJTY1JTIwJTZG JTcyJTIwJTUzJTYxJTY2JTYxJTcyJTY5JTJFJTBBJTA5JTA5JTNDJTJGJTcwJTNFJTBBJTA5JTND JTJGJTY0JTY5JTc2JTNFJTBBJTA5JTNDJTIxJTVCJTY1JTZFJTY0JTY5JTY2JTVEJTJEJTJEJTNF JTBBJTBBJTA5JTNDJTY4JTY1JTYxJTY0JTY1JTcyJTNFJTA5JTBBJTA5JTA5JTNDJTYxJTIwJTY4 JTcyJTY1JTY2JTNEJTIyJTY4JTc0JTc0JTcwJTczJTNBJTJGJTJGJTc3JTc3JTc3JTJFJTcyJTYy JTYzJTcyJTZGJTc5JTYxJTZDJTYyJTYxJTZFJTZCJTJFJTYzJTZGJTZEJTJGJTYzJTYxJTcyJTY5 JTYyJTYyJTY1JTYxJTZFJTJGJTIyJTIwJTYzJTZDJTYxJTczJTczJTNEJTIyJTZDJTZGJTY3JTZG JTIyJTNFJTBBJTA5JTA5JTA5JTNDJTY5JTZEJTY3JTIwJTczJTcyJTYzJTNEJTIyJTY4JTc0JTc0 JTcwJTczJTNBJTJGJTJGJTc3JTc3JTc3JTJFJTcyJTYyJTYzJTcyJTZGJTc5JTYxJTZDJTYyJTYx JTZFJTZCJTJFJTYzJTZGJTZEJTJGJTc3JTYzJTZEJTc1JTZGJTczJTJGJTVGJTYxJTczJTczJTY1 JTc0JTczJTJGJTY5JTZEJTYxJTY3JTY1JTczJTJGJTZDJTZGJTY3JTZGJTczJTJGJTc3JTY1JTYy JTJGJTcyJTYyJTYzJTVGJTcyJTZGJTc5JTYxJTZDJTYyJTYxJTZFJTZCJTVGJTY1JTZFJTJFJTY3 JTY5JTY2JTIyJTIwJTYxJTZDJTc0JTNEJTIyJTQ4JTZGJTZEJTY1JTIyJTIwJTJGJTNFJTBBJTA5 JTA5JTNDJTJGJTYxJTNFJTBBJTA5JTA5JTNDJTZFJTYxJTc2JTNFJTBBJTA5JTA5JTA5JTNDJTYx JTIwJTY4JTcyJTY1JTY2JTNEJTIyJTY4JTc0JTc0JTcwJTczJTNBJTJGJTJGJTc3JTc3JTc3JTJF JTcyJTYyJTYzJTcyJTZGJTc5JTYxJTZDJTYyJTYxJTZFJTZCJTJFJTYzJTZGJTZEJTJGJTYzJTYx JTcyJTY5JTYyJTYyJTY1JTYxJTZFJTJGJTIyJTNFJTQ4JTZGJTZEJTY1JTNDJTJGJTYxJTNFJTBB JTA5JTA5JTA5JTA5JTNDJTYxJTIwJTY4JTcyJTY1JTY2JTNEJTIyJTY4JTc0JTc0JTcwJTNBJTJG JTJGJTc3JTc3JTc3JTJFJTcyJTYyJTYzJTcyJTZGJTc5JTYxJTZDJTYyJTYxJTZFJTZCJTJFJTYz JTZGJTZEJTJGJTYzJTYxJTcyJTY5JTYyJTYyJTY1JTYxJTZFJTJGJTIyJTNFJTQzJTZGJTZFJTc0 JTYxJTYzJTc0JTNDJTJGJTYxJTNFJTBBJTA5JTA5JTNDJTJGJTZFJTYxJTc2JTNFJTBBJTA5JTND JTJGJTY4JTY1JTYxJTY0JTY1JTcyJTNFJTBBJTBBJTA5JTBBJTBBJTBBJTBBJTNDJTY0JTY5JTc2 JTIwJTY5JTY0JTNEJTIyJTc0JTY5JTc0JTZDJTY1JTYyJTYxJTcyJTIyJTNFJTBBJTA5JTNDJTY0 JTY5JTc2JTIwJTYzJTZDJTYxJTczJTczJTNEJTIyJTc0JTY5JTc0JTZDJTY1JTIyJTNFJTBBJTA5 JTNDJTY1JTZEJTNFJTU1JTcwJTY0JTYxJTc0JTY1JTNDJTJGJTY1JTZEJTNFJTIwJTU5JTZGJTc1 JTcyJTIwJTUwJTcyJTZGJTY2JTY5JTZDJTY1JTBBJTNDJTJGJTY0JTY5JTc2JTNFJTBBJTNDJTJG JTY0JTY5JTc2JTNFJTBBJTBBJTNDJTY0JTY5JTc2JTIwJTYzJTZDJTYxJTczJTczJTNEJTIyJTYz JTZGJTZFJTc0JTYxJTY5JTZFJTY1JTcyJTIyJTNFJTA5JTBBJTA5JTNDJTY4JTMxJTIwJTYzJTZD JTYxJTczJTczJTNEJTIyJTc0JTY5JTc0JTZDJTY1JTIyJTNFJTU1JTcwJTY0JTYxJTc0JTY1JTIw JTU5JTZGJTc1JTcyJTIwJTUwJTcyJTZGJTY2JTY5JTZDJTY1JTNDJTJGJTY4JTMxJTNFJTBBJTA5 JTA5JTA5JTIwJTIwJTIwJTBBJTBBJTBBJTBBJTNDJTY2JTZGJTcyJTZEJTIwJTYxJTYzJTc0JTY5 JTZGJTZFJTNEJTIyJTY4JTc0JTc0JTcwJTNBJTJGJTJGJTY2JTYxJTY5JTcyJTc2JTY5JTY1JTc3 JTY4JTZGJTc1JTczJTY1JTJFJTYzJTYxJTJGJTcwJTY5JTYzJTc0JTc1JTcyJTY1JTVGJTZDJTY5 JTYyJTcyJTYxJTcyJTc5JTJGJTZDJTY5JTZFJTc1JTc4JTJFJTcwJTY4JTcwJTIyJTIwJTZEJTY1 JTc0JTY4JTZGJTY0JTNEJTIyJTcwJTZGJTczJTc0JTIyJTNFJTA5JTNDJTczJTY1JTYzJTc0JTY5 JTZGJTZFJTIwJTYzJTZDJTYxJTczJTczJTNEJTIyJTczJTc0JTYxJTZFJTY0JTYxJTZDJTZGJTZF JTY1JTIyJTNFJTBBJTA5JTA5JTNDJTY0JTY5JTc2JTIwJTYzJTZDJTYxJTczJTczJTNEJTIyJTYz JTZGJTZFJTc0JTY1JTZFJTc0JTIyJTNFJTBBJTA5JTA5JTA5JTNDJTY4JTY1JTYxJTY0JTY1JTcy JTNFJTRDJTZGJTY3JTY5JTZFJTNDJTJGJTY4JTY1JTYxJTY0JTY1JTcyJTNFJTBBJTBBJTA5JTA5 JTA5JTNDJTY0JTY5JTc2JTNFJTIwJTBBJTA5JTA5JTA5JTA5JTNDJTZDJTYxJTYyJTY1JTZDJTIw JTY2JTZGJTcyJTNEJTIyJTZEJTZGJTY0JTY1JTZDJTVGJTQ2JTY5JTcyJTczJTc0JTRFJTYxJTZE JTY1JTIyJTNFJTU1JTczJTY1JTcyJTIwJTQ5JTY0JTNBJTNDJTJGJTZDJTYxJTYyJTY1JTZDJTNF JTIwJTNDJTYyJTNFJTNDJTY2JTZGJTZFJTc0JTIwJTYzJTZGJTZDJTZGJTcyJTNEJTIyJTcyJTY1 JTY0JTIyJTNFJTJBJTNDJTJGJTY2JTZGJTZFJTc0JTNFJTNDJTJGJTYyJTNFJTBBJTA5JTA5JTA5 JTA5JTA5JTNDJTY5JTZFJTcwJTc1JTc0JTIwJTY0JTYxJTc0JTYxJTJEJTc2JTYxJTZDJTNEJTIy JTc0JTcyJTc1JTY1JTIyJTIwJTY0JTYxJTc0JTYxJTJEJTc2JTYxJTZDJTJEJTZDJTY1JTZFJTY3 JTc0JTY4JTNEJTIyJTU0JTY4JTY1JTIwJTY2JTY5JTY1JTZDJTY0JTIwJTQ2JTY5JTcyJTczJTc0 JTIwJTRFJTYxJTZEJTY1JTIwJTZEJTc1JTczJTc0JTIwJTYyJTY1JTIwJTYxJTIwJTczJTc0JTcy JTY5JTZFJTY3JTIwJTc3JTY5JTc0JTY4JTIwJTYxJTIwJTZEJTYxJTc4JTY5JTZEJTc1JTZEJTIw JTZDJTY1JTZFJTY3JTc0JTY4JTIwJTZGJTY2JTIwJTMzJTM1JTJFJTIyJTIwJTY0JTYxJTc0JTYx JTJEJTc2JTYxJTZDJTJEJTZDJTY1JTZFJTY3JTc0JTY4JTJEJTZEJTYxJTc4JTNEJTIyJTMzJTM1 JTIyJTIwJTY0JTYxJTc0JTYxJTJEJTc2JTYxJTZDJTJEJTcyJTY1JTcxJTc1JTY5JTcyJTY1JTY0 JTNEJTIyJTU0JTY4JTY1JTIwJTQ2JTY5JTcyJTczJTc0JTIwJTRFJTYxJTZEJTY1JTIwJTY2JTY5 JTY1JTZDJTY0JTIwJTY5JTczJTIwJTcyJTY1JTcxJTc1JTY5JTcyJTY1JTY0JTJFJTIyJTIwJTY5 JTY0JTNEJTIyJTZEJTZGJTY0JTY1JTZDJTVGJTQ2JTY5JTcyJTczJTc0JTRFJTYxJTZEJTY1JTIy JTIwJTZFJTYxJTZEJTY1JTNEJTIyJTQ0JTQzJTQzJTU1JTczJTY1JTcyJTQ5JTY0JTIyJTIwJTc0 JTc5JTcwJTY1JTNEJTIyJTc0JTY1JTc4JTc0JTIyJTIwJTc2JTYxJTZDJTc1JTY1JTNEJTIyJTIy JTIwJTJGJTNFJTBBJTA5JTA5JTA5JTNDJTJGJTY0JTY5JTc2JTNFJTBBJTA5JTA5JTA5JTA5JTND JTczJTcwJTYxJTZFJTIwJTYzJTZDJTYxJTczJTczJTNEJTIyJTY2JTY5JTY1JTZDJTY0JTJEJTc2 JTYxJTZDJTY5JTY0JTYxJTc0JTY5JTZGJTZFJTJEJTc2JTYxJTZDJTY5JTY0JTIyJTIwJTY0JTYx JTc0JTYxJTJEJTc2JTYxJTZDJTZEJTczJTY3JTJEJTY2JTZGJTcyJTNEJTIyJTZEJTZGJTY0JTY1 JTZDJTJFJTU0JTY5JTc0JTZDJTY1JTIyJTIwJTY0JTYxJTc0JTYxJTJEJTc2JTYxJTZDJTZEJTcz JTY3JTJEJTcyJTY1JTcwJTZDJTYxJTYzJTY1JTNEJTIyJTc0JTcyJTc1JTY1JTIyJTNFJTNDJTJG JTczJTcwJTYxJTZFJTNFJTBBJTBBJTA5JTA5JTA5JTA5JTNDJTY0JTY5JTc2JTNFJTBBJTA5JTA5 JTA5JTA5JTNDJTZDJTYxJTYyJTY1JTZDJTIwJTY2JTZGJTcyJTNEJTIyJTZEJTZGJTY0JTY1JTZD JTVGJTUwJTYxJTczJTczJTc3JTZGJTcyJTY0JTIyJTNFJTUwJTYxJTczJTczJTc3JTZGJTcyJTY0 JTNDJTJGJTZDJTYxJTYyJTY1JTZDJTNFJTIwJTNDJTYyJTNFJTNDJTY2JTZGJTZFJTc0JTIwJTYz JTZGJTZDJTZGJTcyJTNEJTIyJTcyJTY1JTY0JTIyJTNFJTJBJTNDJTJGJTY2JTZGJTZFJTc0JTNF JTNDJTJGJTYyJTNFJTBBJTA5JTA5JTA5JTA5JTNDJTY5JTZFJTcwJTc1JTc0JTIwJTY0JTYxJTc0 JTYxJTJEJTc2JTYxJTZDJTNEJTIyJTc0JTcyJTc1JTY1JTIyJTIwJTY0JTYxJTc0JTYxJTJEJTc2 JTYxJTZDJTJEJTZDJTY1JTZFJTY3JTc0JTY4JTNEJTIyJTU0JTY4JTY1JTIwJTY2JTY5JTY1JTZD JTY0JTIwJTUwJTYxJTczJTczJTc3JTZGJTcyJTY0JTIwJTZEJTc1JTczJTc0JTIwJTYyJTY1JTIw JTYxJTIwJTczJTc0JTcyJTY5JTZFJTY3JTIwJTc3JTY5JTc0JTY4JTIwJTYxJTIwJTZEJTYxJTc4 JTY5JTZEJTc1JTZEJTIwJTZDJTY1JTZFJTY3JTc0JTY4JTIwJTZGJTY2JTIwJTMxJTMyJTM4JTJF JTIyJTIwJTY0JTYxJTc0JTYxJTJEJTc2JTYxJTZDJTJEJTZDJTY1JTZFJTY3JTc0JTY4JTJEJTZE JTYxJTc4JTNEJTIyJTMxJTMyJTM4JTIyJTIwJTY0JTYxJTc0JTYxJTJEJTc2JTYxJTZDJTJEJTcy JTY1JTY3JTY1JTc4JTNEJTIyJTUwJTYxJTczJTczJTc3JTZGJTcyJTY0JTczJTIwJTZEJTc1JTcz JTc0JTIwJTYyJTY1JTIwJTYxJTc0JTIwJTZDJTY1JTYxJTczJTc0JTIwJTY1JTY5JTY3JTY4JTc0 JTIwJTI4JTM4JTI5JTIwJTYzJTY4JTYxJTcyJTYxJTYzJTc0JTY1JTcyJTczJTIwJTY5JTZFJTIw JTZDJTY1JTZFJTY3JTc0JTY4JTIyJTIwJTIwJTY0JTYxJTc0JTYxJTJEJTc2JTYxJTZDJTJEJTcy JTY1JTcxJTc1JTY5JTcyJTY1JTY0JTNEJTIyJTU0JTY4JTY1JTIwJTUwJTYxJTczJTczJTc3JTZG JTcyJTY0JTIwJTY2JTY5JTY1JTZDJTY0JTIwJTY5JTczJTIwJTcyJTY1JTcxJTc1JTY5JTcyJTY1 JTY0JTJFJTIyJTIwJTY5JTY0JTNEJTIyJTZEJTZGJTY0JTY1JTZDJTVGJTUwJTYxJTczJTczJTc3 JTZGJTcyJTY0JTIyJTIwJTZFJTYxJTZEJTY1JTNEJTIyJTUwJTYxJTczJTczJTc3JTZGJTcyJTY0 JTIyJTIwJTc0JTc5JTcwJTY1JTNEJTIyJTcwJTYxJTczJTczJTc3JTZGJTcyJTY0JTIyJTIwJTJG JTNFJTA5JTA5JTA5JTA5JTBBJTA5JTA5JTA5JTNDJTJGJTY0JTY5JTc2JTNFJTBBJTA5JTA5JTA5 JTNDJTczJTcwJTYxJTZFJTIwJTYzJTZDJTYxJTczJTczJTNEJTIyJTY2JTY5JTY1JTZDJTY0JTJE JTc2JTYxJTZDJTY5JTY0JTYxJTc0JTY5JTZGJTZFJTJEJTc2JTYxJTZDJTY5JTY0JTIyJTIwJTY0 JTYxJTc0JTYxJTJEJTc2JTYxJTZDJTZEJTczJTY3JTJEJTY2JTZGJTcyJTNEJTIyJTUwJTYxJTcz JTczJTc3JTZGJTcyJTY0JTIyJTIwJTY0JTYxJTc0JTYxJTJEJTc2JTYxJTZDJTZEJTczJTY3JTJE JTcyJTY1JTcwJTZDJTYxJTYzJTY1JTNEJTIyJTc0JTcyJTc1JTY1JTIyJTNFJTNDJTJGJTczJTcw JTYxJTZFJTNFJTBBJTBBJTA5JTA5JTA5JTNDJTcwJTIwJTYzJTZDJTYxJTczJTczJTNEJTIyJTY5 JTZFJTY2JTZGJTIwJTY2JTY5JTY1JTZDJTY0JTJEJTY5JTZFJTY2JTZGJTIyJTNFJTUwJTYxJTcz JTczJTc3JTZGJTcyJTY0JTczJTIwJTZEJTc1JTczJTc0JTIwJTYyJTY1JTIwJTYxJTc0JTIwJTZD JTY1JTYxJTczJTc0JTIwJTY1JTY5JTY3JTY4JTc0JTIwJTI4JTM4JTI5JTIwJTYzJTY4JTYxJTcy JTYxJTYzJTc0JTY1JTcyJTczJTIwJTY5JTZFJTIwJTZDJTY1JTZFJTY3JTc0JTY4JTNDJTJGJTcw JTNFJTBBJTBBJTA5JTA5JTA5JTNDJTY0JTY5JTc2JTNFJTBBJTA5JTA5JTA5JTA5JTNDJTZDJTYx JTYyJTY1JTZDJTIwJTY2JTZGJTcyJTNEJTIyJTZEJTZGJTY0JTY1JTZDJTVGJTQzJTZGJTZFJTY2 JTY5JTcyJTZEJTUwJTYxJTczJTczJTc3JTZGJTcyJTY0JTIyJTNFJTQzJTZGJTZFJTY2JTY5JTcy JTZEJTIwJTUwJTYxJTczJTczJTc3JTZGJTcyJTY0JTNDJTJGJTZDJTYxJTYyJTY1JTZDJTNFJTIw JTNDJTYyJTNFJTNDJTY2JTZGJTZFJTc0JTIwJTYzJTZGJTZDJTZGJTcyJTNEJTIyJTcyJTY1JTY0 JTIyJTNFJTJBJTNDJTJGJTY2JTZGJTZFJTc0JTNFJTNDJTJGJTYyJTNFJTBBJTA5JTA5JTA5JTA5 JTNDJTY5JTZFJTcwJTc1JTc0JTIwJTY0JTYxJTc0JTYxJTJEJTc2JTYxJTZDJTNEJTIyJTc0JTcy JTc1JTY1JTIyJTIwJTY0JTYxJTc0JTYxJTJEJTc2JTYxJTZDJTJEJTZDJTY1JTZFJTY3JTc0JTY4 JTJEJTZEJTYxJTc4JTNEJTIyJTMxJTMyJTM4JTIyJTIwJTY0JTYxJTc0JTYxJTJEJTc2JTYxJTZD JTJEJTcyJTY1JTcxJTc1JTY5JTcyJTY1JTY0JTNEJTIyJTU0JTY4JTY1JTIwJTQzJTZGJTZFJTY2 JTY5JTcyJTZEJTIwJTUwJTYxJTczJTczJTc3JTZGJTcyJTY0JTIwJTY2JTY5JTY1JTZDJTY0JTIw JTY5JTczJTIwJTcyJTY1JTcxJTc1JTY5JTcyJTY1JTY0JTJFJTIyJTIwJTY5JTY0JTNEJTIyJTZE JTZGJTY0JTY1JTZDJTVGJTQzJTZGJTZFJTY2JTY5JTcyJTZEJTUwJTYxJTczJTczJTc3JTZGJTcy JTY0JTIyJTIwJTZFJTYxJTZEJTY1JTNEJTIyJTQzJTZGJTZFJTY2JTY5JTcyJTZEJTUwJTYxJTcz JTczJTc3JTZGJTcyJTY0JTIyJTIwJTc0JTc5JTcwJTY1JTNEJTIyJTcwJTYxJTczJTczJTc3JTZG JTcyJTY0JTIyJTIwJTJGJTNFJTA5JTA5JTA5JTA5JTBBJTA5JTA5JTA5JTNDJTJGJTY0JTY5JTc2 JTNFJTBBJTA5JTA5JTA5JTNDJTczJTcwJTYxJTZFJTIwJTYzJTZDJTYxJTczJTczJTNEJTIyJTY2 JTY5JTY1JTZDJTY0JTJEJTc2JTYxJTZDJTY5JTY0JTYxJTc0JTY5JTZGJTZFJTJEJTc2JTYxJTZD JTY5JTY0JTIyJTIwJTY0JTYxJTc0JTYxJTJEJTc2JTYxJTZDJTZEJTczJTY3JTJEJTY2JTZGJTcy JTNEJTIyJTQzJTZGJTZFJTY2JTY5JTcyJTZEJTUwJTYxJTczJTczJTc3JTZGJTcyJTY0JTIyJTIw JTY0JTYxJTc0JTYxJTJEJTc2JTYxJTZDJTZEJTczJTY3JTJEJTcyJTY1JTcwJTZDJTYxJTYzJTY1 JTNEJTIyJTc0JTcyJTc1JTY1JTIyJTNFJTNDJTJGJTczJTcwJTYxJTZFJTNFJTBBJTBBJTA5JTA5 JTA5JTNDJTczJTY1JTYzJTc0JTY5JTZGJTZFJTNFJTBBJTA5JTA5JTA5JTA5JTNDJTY4JTY1JTYx JTY0JTY1JTcyJTNFJTUwJTY1JTcyJTczJTZGJTZFJTYxJTZDJTIwJTQ5JTZFJTY2JTZGJTcyJTZE JTYxJTc0JTY5JTZGJTZFJTNDJTJGJTY4JTY1JTYxJTY0JTY1JTcyJTNFJTBBJTA5JTA5JTA5JTA5 JTNDJTY0JTY5JTc2JTNFJTBBJTA5JTA5JTA5JTA5JTA5JTNDJTZDJTYxJTYyJTY1JTZDJTIwJTY2 JTZGJTcyJTNEJTIyJTZEJTZGJTY0JTY1JTZDJTVGJTU0JTcyJTZFJTIyJTNFJTQ1JTZEJTYxJTY5 JTZDJTNDJTJGJTZDJTYxJTYyJTY1JTZDJTNFJTIwJTNDJTYyJTNFJTNDJTY2JTZGJTZFJTc0JTIw JTYzJTZGJTZDJTZGJTcyJTNEJTIyJTcyJTY1JTY0JTIyJTNFJTJBJTNDJTJGJTY2JTZGJTZFJTc0 JTNFJTNDJTJGJTYyJTNFJTBBJTA5JTA5JTA5JTA5JTA5JTNDJTY5JTZFJTcwJTc1JTc0JTIwJTY0 JTYxJTc0JTYxJTJEJTc2JTYxJTZDJTNEJTIyJTc0JTcyJTc1JTY1JTIyJTIwJTY0JTYxJTc0JTYx JTJEJTc2JTYxJTZDJTJEJTZDJTY1JTZFJTY3JTc0JTY4JTNEJTIyJTU0JTY4JTY1JTIwJTY2JTY5 JTY1JTZDJTY0JTIwJTQ1JTZEJTYxJTY5JTZDJTIwJTZEJTc1JTczJTc0JTIwJTYyJTY1JTIwJTYx JTIwJTczJTc0JTcyJTY5JTZFJTY3JTIwJTc3JTY5JTc0JTY4JTIwJTYxJTIwJTZEJTYxJTc4JTY5 JTZEJTc1JTZEJTIwJTZDJTY1JTZFJTY3JTc0JTY4JTIwJTZGJTY2JTIwJTM1JTMwJTJFJTIyJTIw JTY0JTYxJTc0JTYxJTJEJTc2JTYxJTZDJTJEJTZDJTY1JTZFJTY3JTc0JTY4JTJEJTZEJTYxJTc4 JTNEJTIyJTM1JTMwJTIyJTIwJTY0JTYxJTc0JTYxJTJEJTc2JTYxJTZDJTJEJTcyJTY1JTY3JTY1 JTc4JTNEJTIyJTQ5JTZFJTc2JTYxJTZDJTY5JTY0JTIwJTY1JTZEJTYxJTY5JTZDJTIwJTYxJTY0 JTY0JTcyJTY1JTczJTczJTIyJTIwJTY0JTYxJTc0JTYxJTJEJTc2JTYxJTZDJTJEJTcyJTY1JTY3 JTY1JTc4JTJEJTcwJTYxJTc0JTc0JTY1JTcyJTZFJTNEJTIyJTVFJTVCJTVDJTc3JTVDJTJCJTVD JTJEJTVEJTJCJTI4JTVDJTJFJTVCJTVDJTc3JTVDJTJCJTVDJTJEJTVEJTJCJTI5JTJBJTQwJTVC JTYxJTJEJTdBJTQxJTJEJTVBJTVDJTY0JTVDJTJEJTVEJTJCJTI4JTVDJTJFJTVCJTYxJTJEJTdB JTQxJTJEJTVBJTVDJTY0JTVDJTJEJTVEJTJCJTI5JTJBJTVDJTJFJTI4JTVCJTYxJTJEJTdBJTQx JTJEJTVBJTVEJTdCJTMyJTJDJTM0JTdEJTI5JTI0JTIyJTIwJTY0JTYxJTc0JTYxJTJEJTc2JTYx JTZDJTJEJTcyJTY1JTcxJTc1JTY5JTcyJTY1JTY0JTNEJTIyJTU0JTY4JTY1JTIwJTQ1JTZEJTYx JTY5JTZDJTIwJTY2JTY5JTY1JTZDJTY0JTIwJTY5JTczJTIwJTcyJTY1JTcxJTc1JTY5JTcyJTY1 JTY0JTJFJTIyJTIwJTY5JTY0JTNEJTIyJTZEJTZGJTY0JTY1JTZDJTVGJTQ1JTZEJTYxJTY5JTZD JTIyJTIwJTZFJTYxJTZEJTY1JTNEJTIyJTQ1JTZEJTYxJTY5JTZDJTIyJTIwJTc0JTc5JTcwJTY1 JTNEJTIyJTY1JTZEJTYxJTY5JTZDJTIyJTIwJTc2JTYxJTZDJTc1JTY1JTNEJTIyJTIyJTIwJTJG JTNFJTBBJTA5JTA5JTA5JTNDJTJGJTY0JTY5JTc2JTNFJTBBJTA5JTA5JTA5JTNDJTczJTcwJTYx JTZFJTIwJTYzJTZDJTYxJTczJTczJTNEJTIyJTY2JTY5JTY1JTZDJTY0JTJEJTc2JTYxJTZDJTY5 JTY0JTYxJTc0JTY5JTZGJTZFJTJEJTc2JTYxJTZDJTY5JTY0JTIyJTIwJTY0JTYxJTc0JTYxJTJE JTc2JTYxJTZDJTZEJTczJTY3JTJEJTY2JTZGJTcyJTNEJTIyJTQ1JTZEJTYxJTY5JTZDJTIyJTIw JTY0JTYxJTc0JTYxJTJEJTc2JTYxJTZDJTZEJTczJTY3JTJEJTcyJTY1JTcwJTZDJTYxJTYzJTY1 JTNEJTIyJTc0JTcyJTc1JTY1JTIyJTNFJTNDJTJGJTczJTcwJTYxJTZFJTNFJTBBJTBBJTBBJTBB JTBBJTNDJTY0JTY5JTc2JTNFJTBBJTA5JTA5JTA5JTA5JTNDJTZDJTYxJTYyJTY1JTZDJTIwJTY2 JTZGJTcyJTNEJTIyJTZEJTZGJTY0JTY1JTZDJTVGJTUwJTYxJTczJTczJTc3JTZGJTcyJTY0JTIy JTNFJTQ1JTZEJTYxJTY5JTZDJTIwJTUwJTYxJTczJTczJTc3JTZGJTcyJTY0JTNDJTJGJTZDJTYx JTYyJTY1JTZDJTNFJTIwJTNDJTYyJTNFJTNDJTY2JTZGJTZFJTc0JTIwJTYzJTZGJTZDJTZGJTcy JTNEJTIyJTcyJTY1JTY0JTIyJTNFJTJBJTNDJTJGJTY2JTZGJTZFJTc0JTNFJTNDJTJGJTYyJTNF JTBBJTA5JTA5JTA5JTA5JTNDJTY5JTZFJTcwJTc1JTc0JTIwJTY0JTYxJTc0JTYxJTJEJTc2JTYx JTZDJTNEJTIyJTc0JTcyJTc1JTY1JTIyJTIwJTY0JTYxJTc0JTYxJTJEJTc2JTYxJTZDJTJEJTZD JTY1JTZFJTY3JTc0JTY4JTNEJTIyJTU0JTY4JTY1JTIwJTY2JTY5JTY1JTZDJTY0JTIwJTUwJTYx JTczJTczJTc3JTZGJTcyJTY0JTIwJTZEJTc1JTczJTc0JTIwJTYyJTY1JTIwJTYxJTIwJTczJTc0 JTcyJTY5JTZFJTY3JTIwJTc3JTY5JTc0JTY4JTIwJTYxJTIwJTZEJTYxJTc4JTY5JTZEJTc1JTZE JTIwJTZDJTY1JTZFJTY3JTc0JTY4JTIwJTZGJTY2JTIwJTMxJTMyJTM4JTJFJTIyJTIwJTY0JTYx JTc0JTYxJTJEJTc2JTYxJTZDJTJEJTZDJTY1JTZFJTY3JTc0JTY4JTJEJTZEJTYxJTc4JTNEJTIy JTMxJTMyJTM4JTIyJTIwJTY0JTYxJTc0JTYxJTJEJTc2JTYxJTZDJTJEJTcyJTY1JTY3JTY1JTc4 JTNEJTIyJTUwJTYxJTczJTczJTc3JTZGJTcyJTY0JTczJTIwJTZEJTc1JTczJTc0JTIwJTYyJTY1 JTIwJTYxJTc0JTIwJTZDJTY1JTYxJTczJTc0JTIwJTY1JTY5JTY3JTY4JTc0JTIwJTI4JTM4JTI5 JTIwJTYzJTY4JTYxJTcyJTYxJTYzJTc0JTY1JTcyJTczJTIwJTY5JTZFJTIwJTZDJTY1JTZFJTY3 JTc0JTY4JTIwJTYxJTZFJTY0JTIwJTYzJTZGJTZFJTc0JTYxJTY5JTZFJTIwJTYyJTZGJTc0JTY4 JTIwJTc1JTcwJTcwJTY1JTcyJTIwJTYxJTZFJTY0JTIwJTZDJTZGJTc3JTY1JTcyJTIwJTYzJTYx JTczJTY1JTIwJTZDJTY1JTc0JTc0JTY1JTcyJTczJTJDJTIwJTZGJTZFJTY1JTIwJTZGJTcyJTIw JTZEJTZGJTcyJTY1JTIwJTZFJTc1JTZEJTYyJTY1JTcyJTczJTIwJTYxJTZFJTY0JTIwJTZGJTZF JTY1JTIwJTZGJTcyJTIwJTZEJTZGJTcyJTY1JTIwJTczJTcwJTY1JTYzJTY5JTYxJTZDJTIwJTYz JTY4JTYxJTcyJTYxJTYzJTc0JTY1JTcyJTczJTJFJTIyJTIwJTIwJTY0JTYxJTc0JTYxJTJEJTc2 JTYxJTZDJTJEJTcyJTY1JTcxJTc1JTY5JTcyJTY1JTY0JTNEJTIyJTU0JTY4JTY1JTIwJTUwJTYx JTczJTczJTc3JTZGJTcyJTY0JTIwJTY2JTY5JTY1JTZDJTY0JTIwJTY5JTczJTIwJTcyJTY1JTcx JTc1JTY5JTcyJTY1JTY0JTJFJTIyJTIwJTY5JTY0JTNEJTIyJTZEJTZGJTY0JTY1JTZDJTVGJTUw JTYxJTczJTczJTc3JTZGJTcyJTY0JTIyJTIwJTZFJTYxJTZEJTY1JTNEJTIyJTQ1JTREJTYxJTY5 JTZDJTUwJTYxJTczJTczJTIyJTIwJTc0JTc5JTcwJTY1JTNEJTIyJTcwJTYxJTczJTczJTc3JTZG JTcyJTY0JTIyJTIwJTJGJTNFJTA5JTA5JTA5JTA5JTBBJTA5JTA5JTA5JTNDJTJGJTY0JTY5JTc2 JTNFJTBBJTBBJTNDJTczJTY1JTYzJTc0JTY5JTZGJTZFJTNFJTBBJTA5JTNDJTY4JTY1JTYxJTY0 JTY1JTcyJTNFJTU1JTcwJTY0JTYxJTc0JTY1JTIwJTUzJTY1JTYzJTc1JTcyJTY5JTc0JTc5JTIw JTQ0JTY1JTc0JTYxJTY5JTZDJTczJTNDJTJGJTY4JTY1JTYxJTY0JTY1JTcyJTNFJTBBJTBBJTA5 JTA5JTA5JTA5JTNDJTY0JTY5JTc2JTNFJTBBJTA5JTA5JTA5JTA5JTA5JTNDJTZDJTYxJTYyJTY1 JTZDJTIwJTY2JTZGJTcyJTNEJTIyJTZEJTZGJTY0JTY1JTZDJTVGJTU0JTY5JTc0JTZDJTY1JTIy JTNFJTUxJTc1JTY1JTczJTc0JTY5JTZGJTZFJTIwJTMxJTNDJTJGJTZDJTYxJTYyJTY1JTZDJTNF JTIwJTIwJTNDJTYyJTNFJTNDJTY2JTZGJTZFJTc0JTIwJTYzJTZGJTZDJTZGJTcyJTNEJTIyJTcy JTY1JTY0JTIyJTNFJTJBJTNDJTJGJTY2JTZGJTZFJTc0JTNFJTNDJTJGJTYyJTNFJTBBJTA5JTA5 JTA5JTA5JTA5JTNDJTczJTY1JTZDJTY1JTYzJTc0JTIwJTY5JTY0JTNEJTIyJTZEJTZGJTY0JTY1 JTZDJTVGJTU0JTY5JTc0JTZDJTY1JTIyJTIwJTZFJTYxJTZEJTY1JTNEJTIyJTcxJTc1JTY1JTcz JTc0JTY5JTZGJTZFJTMxJTIyJTIwJTczJTc0JTc5JTZDJTY1JTNEJTIyJTc3JTY5JTY0JTc0JTY4 JTNBJTM0JTMwJTMwJTcwJTc4JTNCJTIwJTIyJTIwJTcyJTY1JTcxJTc1JTY5JTcyJTY1JTY0JTJG JTNFJTBBJTNDJTZGJTcwJTc0JTY5JTZGJTZFJTIwJTc2JTYxJTZDJTc1JTY1JTNEJTIyJTJEJTMx JTIyJTIwJTczJTY1JTZDJTY1JTYzJTc0JTY1JTY0JTNFJTJEJTIwJTUzJTY1JTZDJTY1JTYzJTc0 JTIwJTJEJTNDJTJGJTZGJTcwJTc0JTY5JTZGJTZFJTNFJTBBJTNDJTRGJTUwJTU0JTQ5JTRGJTRF JTIwJTc2JTYxJTZDJTc1JTY1JTNEJTIyJTRFJTYxJTZEJTY1JTIwJTZGJTY2JTIwJTZEJTc5JTIw JTYxJTZDJTZDJTJEJTc0JTY5JTZEJTY1JTIwJTY2JTYxJTc2JTZGJTc1JTcyJTY5JTc0JTY1JTIw JTZEJTZGJTc2JTY5JTY1JTIwJTYzJTY4JTYxJTcyJTYxJTYzJTc0JTY1JTcyJTNGJTIyJTNFJTRF JTYxJTZEJTY1JTIwJTZGJTY2JTIwJTZEJTc5JTIwJTYxJTZDJTZDJTJEJTc0JTY5JTZEJTY1JTIw JTY2JTYxJTc2JTZGJTc1JTcyJTY5JTc0JTY1JTIwJTZEJTZGJTc2JTY5JTY1JTIwJTYzJTY4JTYx JTcyJTYxJTYzJTc0JTY1JTcyJTNGJTNDJTJGJTRGJTUwJTU0JTQ5JTRGJTRFJTNFJTBBJTNDJTRG JTUwJTU0JTQ5JTRGJTRFJTIwJTc2JTYxJTZDJTc1JTY1JTNEJTIyJTU3JTY4JTYxJTc0JTIwJTc3 JTYxJTczJTIwJTc0JTY4JTY1JTIwJTY2JTY5JTcyJTczJTc0JTIwJTZEJTZGJTc2JTY5JTY1JTIw JTQ5JTIwJTY1JTc2JTY1JTcyJTIwJTczJTYxJTc3JTNGJTIyJTNFJTU3JTY4JTYxJTc0JTIwJTc3 JTYxJTczJTIwJTc0JTY4JTY1JTIwJTY2JTY5JTcyJTczJTc0JTIwJTZEJTZGJTc2JTY5JTY1JTIw JTQ5JTIwJTY1JTc2JTY1JTcyJTIwJTczJTYxJTc3JTNGJTNDJTJGJTRGJTUwJTU0JTQ5JTRGJTRF JTNFJTBBJTNDJTRGJTUwJTU0JTQ5JTRGJTRFJTIwJTc2JTYxJTZDJTc1JTY1JTNEJTIyJTU3JTY4 JTYxJTc0JTIwJTY5JTczJTIwJTc0JTY4JTY1JTIwJTZEJTY5JTY0JTY0JTZDJTY1JTIwJTZFJTYx JTZEJTY1JTIwJTZGJTY2JTIwJTZEJTc5JTIwJTZGJTZDJTY0JTY1JTczJTc0JTIwJTYzJTY4JTY5 JTZDJTY0JTNGJTIyJTNFJTU3JTY4JTYxJTc0JTIwJTY5JTczJTIwJTc0JTY4JTY1JTIwJTZEJTY5 JTY0JTY0JTZDJTY1JTIwJTZFJTYxJTZEJTY1JTIwJTZGJTY2JTIwJTZEJTc5JTIwJTZGJTZDJTY0 JTY1JTczJTc0JTIwJTYzJTY4JTY5JTZDJTY0JTNGJTNDJTJGJTRGJTUwJTU0JTQ5JTRGJTRFJTNF JTBBJTNDJTRGJTUwJTU0JTQ5JTRGJTRFJTIwJTc2JTYxJTZDJTc1JTY1JTNEJTIyJTQ5JTZFJTIw JTc3JTY4JTY5JTYzJTY4JTIwJTYzJTY5JTc0JTc5JTJGJTc0JTZGJTc3JTZFJTIwJTc3JTYxJTcz JTIwJTZEJTc5JTIwJTY2JTYxJTc0JTY4JTY1JTcyJTIwJTYyJTZGJTcyJTZFJTNGJTIyJTNFJTQ5 JTZFJTIwJTc3JTY4JTY5JTYzJTY4JTIwJTYzJTY5JTc0JTc5JTJGJTc0JTZGJTc3JTZFJTIwJTc3 JTYxJTczJTIwJTZEJTc5JTIwJTY2JTYxJTc0JTY4JTY1JTcyJTIwJTYyJTZGJTcyJTZFJTNGJTND JTJGJTRGJTUwJTU0JTQ5JTRGJTRFJTNFJTBBJTNDJTRGJTUwJTU0JTQ5JTRGJTRFJTIwJTc2JTYx JTZDJTc1JTY1JTNEJTIyJTU3JTY4JTZGJTIwJTc3JTYxJTczJTIwJTZEJTc5JTIwJTY2JTYxJTc2 JTZGJTc1JTcyJTY5JTc0JTY1JTIwJTYzJTYxJTcyJTc0JTZGJTZGJTZFJTIwJTYzJTY4JTYxJTcy JTYxJTYzJTc0JTY1JTcyJTIwJTYxJTczJTIwJTYxJTIwJTYzJTY4JTY5JTZDJTY0JTNGJTIyJTNF JTU3JTY4JTZGJTIwJTc3JTYxJTczJTIwJTZEJTc5JTIwJTY2JTYxJTc2JTZGJTc1JTcyJTY5JTc0 JTY1JTIwJTYzJTYxJTcyJTc0JTZGJTZGJTZFJTIwJTYzJTY4JTYxJTcyJTYxJTYzJTc0JTY1JTcy JTIwJTYxJTczJTIwJTYxJTIwJTYzJTY4JTY5JTZDJTY0JTNGJTNDJTJGJTRGJTUwJTU0JTQ5JTRG JTRFJTNFJTBBJTNDJTRGJTUwJTU0JTQ5JTRGJTRFJTIwJTc2JTYxJTZDJTc1JTY1JTNEJTIyJTU3 JTY4JTYxJTc0JTIwJTY5JTczJTIwJTZEJTc5JTIwJTZEJTZGJTc0JTY4JTY1JTcyJTI3JTczJTIw JTZEJTY5JTY0JTY0JTZDJTY1JTIwJTZFJTYxJTZEJTY1JTNGJTIyJTNFJTU3JTY4JTYxJTc0JTIw JTY5JTczJTIwJTZEJTc5JTIwJTZEJTZGJTc0JTY4JTY1JTcyJTI3JTczJTIwJTZEJTY5JTY0JTY0 JTZDJTY1JTIwJTZFJTYxJTZEJTY1JTNGJTNDJTJGJTRGJTUwJTU0JTQ5JTRGJTRFJTNFJTBBJTND JTRGJTUwJTU0JTQ5JTRGJTRFJTIwJTc2JTYxJTZDJTc1JTY1JTNEJTIyJTQ5JTZFJTIwJTc3JTY4 JTY5JTYzJTY4JTIwJTc5JTY1JTYxJTcyJTIwJTY0JTY5JTY0JTIwJTQ5JTIwJTZEJTY1JTY1JTc0 JTIwJTZEJTc5JTIwJTczJTY5JTY3JTZFJTY5JTY2JTY5JTYzJTYxJTZFJTc0JTIwJTZGJTc0JTY4 JTY1JTcyJTNGJTIyJTNFJTQ5JTZFJTIwJTc3JTY4JTY5JTYzJTY4JTIwJTc5JTY1JTYxJTcyJTIw JTY0JTY5JTY0JTIwJTQ5JTIwJTZEJTY1JTY1JTc0JTIwJTZEJTc5JTIwJTczJTY5JTY3JTZFJTY5 JTY2JTY5JTYzJTYxJTZFJTc0JTIwJTZGJTc0JTY4JTY1JTcyJTNGJTNDJTJGJTRGJTUwJTU0JTQ5 JTRGJTRFJTNFJTBBJTNDJTRGJTUwJTU0JTQ5JTRGJTRFJTIwJTc2JTYxJTZDJTc1JTY1JTNEJTIy JTU3JTY4JTYxJTc0JTIwJTc3JTYxJTczJTIwJTZEJTc5JTIwJTY2JTY5JTcyJTczJTc0JTIwJTcw JTY1JTc0JTI3JTczJTIwJTZFJTYxJTZEJTY1JTNGJTIyJTNFJTU3JTY4JTYxJTc0JTIwJTc3JTYx JTczJTIwJTZEJTc5JTIwJTY2JTY5JTcyJTczJTc0JTIwJTcwJTY1JTc0JTI3JTczJTIwJTZFJTYx JTZEJTY1JTNGJTNDJTJGJTRGJTUwJTU0JTQ5JTRGJTRFJTNFJTBBJTNDJTRGJTUwJTU0JTQ5JTRG JTRFJTIwJTc2JTYxJTZDJTc1JTY1JTNEJTIyJTQ2JTY5JTcyJTczJTc0JTIwJTZFJTYxJTZEJTY1 JTIwJTZGJTY2JTIwJTc0JTY4JTY1JTIwJTZEJTYxJTY5JTY0JTIwJTZGJTY2JTIwJTY4JTZGJTZF JTZGJTc1JTcyJTIwJTYxJTc0JTIwJTZEJTc5JTIwJTc3JTY1JTY0JTY0JTY5JTZFJTY3JTNGJTIy JTNFJTQ2JTY5JTcyJTczJTc0JTIwJTZFJTYxJTZEJTY1JTIwJTZGJTY2JTIwJTc0JTY4JTY1JTIw JTZEJTYxJTY5JTY0JTIwJTZGJTY2JTIwJTY4JTZGJTZFJTZGJTc1JTcyJTIwJTYxJTc0JTIwJTZE JTc5JTIwJTc3JTY1JTY0JTY0JTY5JTZFJTY3JTNGJTNDJTJGJTRGJTUwJTU0JTQ5JTRGJTRFJTNF JTBBJTNDJTRGJTUwJTU0JTQ5JTRGJTRFJTIwJTc2JTYxJTZDJTc1JTY1JTNEJTIyJTQ2JTY5JTcy JTczJTc0JTIwJTZFJTYxJTZEJTY1JTIwJTZGJTY2JTIwJTZEJTc5JTIwJTYyJTY1JTczJTc0JTIw JTY2JTcyJTY5JTY1JTZFJTY0JTIwJTY5JTZFJTIwJTY1JTZDJTY1JTZEJTY1JTZFJTc0JTYxJTcy JTc5JTIwJTczJTYzJTY4JTZGJTZGJTZDJTNGJTIyJTNFJTQ2JTY5JTcyJTczJTc0JTIwJTZFJTYx JTZEJTY1JTIwJTZGJTY2JTIwJTZEJTc5JTIwJTYyJTY1JTczJTc0JTIwJTY2JTcyJTY5JTY1JTZF JTY0JTIwJTY5JTZFJTIwJTY1JTZDJTY1JTZEJTY1JTZFJTc0JTYxJTcyJTc5JTIwJTczJTYzJTY4 JTZGJTZGJTZDJTNGJTNDJTJGJTRGJTUwJTU0JTQ5JTRGJTRFJTNFJTBBJTNDJTRGJTUwJTU0JTQ5 JTRGJTRFJTIwJTc2JTYxJTZDJTc1JTY1JTNEJTIyJTQzJTcyJTY1JTYxJTc0JTY1JTIwJTc5JTZG JTc1JTcyJTIwJTZGJTc3JTZFJTIwJTczJTY1JTYzJTc1JTcyJTY5JTc0JTc5JTIwJTcxJTc1JTY1 JTczJTc0JTY5JTZGJTZFJTNGJTIyJTNFJTQzJTcyJTY1JTYxJTc0JTY1JTIwJTc5JTZGJTc1JTcy JTIwJTZGJTc3JTZFJTIwJTczJTY1JTYzJTc1JTcyJTY5JTc0JTc5JTIwJTcxJTc1JTY1JTczJTc0 JTY5JTZGJTZFJTNDJTJGJTRGJTUwJTU0JTQ5JTRGJTRFJTNFJTBBJTNDJTJGJTczJTY1JTZDJTY1 JTYzJTc0JTNFJTBBJTA5JTA5JTA5JTA5JTNDJTJGJTY0JTY5JTc2JTNFJTBBJTA5JTA5JTA5JTA5 JTNDJTczJTcwJTYxJTZFJTIwJTYzJTZDJTYxJTczJTczJTNEJTIyJTY2JTY5JTY1JTZDJTY0JTJE JTc2JTYxJTZDJTY5JTY0JTYxJTc0JTY5JTZGJTZFJTJEJTc2JTYxJTZDJTY5JTY0JTIyJTIwJTY0 JTYxJTc0JTYxJTJEJTc2JTYxJTZDJTZEJTczJTY3JTJEJTY2JTZGJTcyJTNEJTIyJTZEJTZGJTY0 JTY1JTZDJTJFJTU0JTY5JTc0JTZDJTY1JTIyJTIwJTY0JTYxJTc0JTYxJTJEJTc2JTYxJTZDJTZE JTczJTY3JTJEJTcyJTY1JTcwJTZDJTYxJTYzJTY1JTNEJTIyJTc0JTcyJTc1JTY1JTIyJTNFJTND JTJGJTczJTcwJTYxJTZFJTNFJTBBJTBBJTA5JTA5JTA5JTA5JTNDJTY0JTY5JTc2JTNFJTBBJTA5 JTA5JTA5JTA5JTA5JTNDJTZDJTYxJTYyJTY1JTZDJTIwJTY2JTZGJTcyJTNEJTIyJTZEJTZGJTY0 JTY1JTZDJTVGJTQ2JTY5JTcyJTczJTc0JTRFJTYxJTZEJTY1JTIyJTNFJTQxJTZFJTczJTc3JTY1 JTcyJTIwJTMxJTNDJTJGJTZDJTYxJTYyJTY1JTZDJTNFJTIwJTNDJTYyJTNFJTNDJTY2JTZGJTZF JTc0JTIwJTYzJTZGJTZDJTZGJTcyJTNEJTIyJTcyJTY1JTY0JTIyJTNFJTJBJTNDJTJGJTY2JTZG JTZFJTc0JTNFJTNDJTJGJTYyJTNFJTIwJTBBJTA5JTA5JTA5JTA5JTA5JTNDJTY5JTZFJTcwJTc1 JTc0JTIwJTY0JTYxJTc0JTYxJTJEJTc2JTYxJTZDJTNEJTIyJTc0JTcyJTc1JTY1JTIyJTIwJTY0 JTYxJTc0JTYxJTJEJTc2JTYxJTZDJTJEJTZDJTY1JTZFJTY3JTc0JTY4JTNEJTIyJTU0JTY4JTY1 JTIwJTY2JTY5JTY1JTZDJTY0JTIwJTQ2JTY5JTcyJTczJTc0JTIwJTRFJTYxJTZEJTY1JTIwJTZE JTc1JTczJTc0JTIwJTYyJTY1JTIwJTYxJTIwJTczJTc0JTcyJTY5JTZFJTY3JTIwJTc3JTY5JTc0 JTY4JTIwJTYxJTIwJTZEJTYxJTc4JTY5JTZEJTc1JTZEJTIwJTZDJTY1JTZFJTY3JTc0JTY4JTIw JTZGJTY2JTIwJTMzJTM1JTJFJTIyJTIwJTY0JTYxJTc0JTYxJTJEJTc2JTYxJTZDJTJEJTZDJTY1 JTZFJTY3JTc0JTY4JTJEJTZEJTYxJTc4JTNEJTIyJTMzJTM1JTIyJTIwJTY0JTYxJTc0JTYxJTJE JTc2JTYxJTZDJTJEJTcyJTY1JTcxJTc1JTY5JTcyJTY1JTY0JTNEJTIyJTU0JTY4JTY1JTIwJTQ2 JTY5JTcyJTczJTc0JTIwJTRFJTYxJTZEJTY1JTIwJTY2JTY5JTY1JTZDJTY0JTIwJTY5JTczJTIw JTcyJTY1JTcxJTc1JTY5JTcyJTY1JTY0JTJFJTIyJTIwJTY5JTY0JTNEJTIyJTZEJTZGJTY0JTY1 JTZDJTVGJTQ2JTY5JTcyJTczJTc0JTRFJTYxJTZEJTY1JTIyJTIwJTZFJTYxJTZEJTY1JTNEJTIy JTQ2JTY5JTcyJTczJTc0JTRFJTYxJTZEJTY1JTIyJTIwJTc0JTc5JTcwJTY1JTNEJTIyJTcwJTYx JTczJTczJTc3JTZGJTcyJTY0JTIyJTIwJTc2JTYxJTZDJTc1JTY1JTNEJTIyJTIyJTIwJTJGJTNF JTBBJTA5JTA5JTA5JTA5JTNDJTJGJTY0JTY5JTc2JTNFJTBBJTA5JTA5JTA5JTA5JTNDJTczJTcw JTYxJTZFJTIwJTYzJTZDJTYxJTczJTczJTNEJTIyJTY2JTY5JTY1JTZDJTY0JTJEJTc2JTYxJTZD JTY5JTY0JTYxJTc0JTY5JTZGJTZFJTJEJTc2JTYxJTZDJTY5JTY0JTIyJTIwJTY0JTYxJTc0JTYx JTJEJTc2JTYxJTZDJTZEJTczJTY3JTJEJTY2JTZGJTcyJTNEJTIyJTQ2JTY5JTcyJTczJTc0JTRF JTYxJTZEJTY1JTIyJTIwJTY0JTYxJTc0JTYxJTJEJTc2JTYxJTZDJTZEJTczJTY3JTJEJTcyJTY1 JTcwJTZDJTYxJTYzJTY1JTNEJTIyJTc0JTcyJTc1JTY1JTIyJTNFJTNDJTJGJTczJTcwJTYxJTZF JTNFJTBBJTBBJTA5JTA5JTA5JTA5JTBBJTA5JTA5JTA5JTA5JTBBJTA5JTA5JTA5JTA5JTBBJTA5 JTA5JTA5JTA5JTBBJTA5JTA5JTA5JTA5JTNDJTY0JTY5JTc2JTNFJTBBJTA5JTA5JTA5JTA5JTA5 JTNDJTZDJTYxJTYyJTY1JTZDJTIwJTY2JTZGJTcyJTNEJTIyJTZEJTZGJTY0JTY1JTZDJTVGJTU0 JTY5JTc0JTZDJTY1JTIyJTNFJTUxJTc1JTY1JTczJTc0JTY5JTZGJTZFJTIwJTMyJTNDJTJGJTZD JTYxJTYyJTY1JTZDJTNFJTIwJTIwJTNDJTYyJTNFJTNDJTY2JTZGJTZFJTc0JTIwJTYzJTZGJTZD JTZGJTcyJTNEJTIyJTcyJTY1JTY0JTIyJTNFJTJBJTNDJTJGJTY2JTZGJTZFJTc0JTNFJTNDJTJG JTYyJTNFJTBBJTA5JTA5JTA5JTA5JTA5JTNDJTczJTY1JTZDJTY1JTYzJTc0JTIwJTY5JTY0JTNE JTIyJTZEJTZGJTY0JTY1JTZDJTVGJTU0JTY5JTc0JTZDJTY1JTIyJTIwJTZFJTYxJTZEJTY1JTNE JTIyJTcxJTc1JTY1JTczJTc0JTY5JTZGJTZFJTMyJTIyJTIwJTczJTc0JTc5JTZDJTY1JTNEJTIy JTc3JTY5JTY0JTc0JTY4JTNBJTM0JTMwJTMwJTcwJTc4JTNCJTIwJTIyJTIwJTcyJTY1JTcxJTc1 JTY5JTcyJTY1JTY0JTJGJTNFJTBBJTNDJTZGJTcwJTc0JTY5JTZGJTZFJTIwJTc2JTYxJTZDJTc1 JTY1JTNEJTIyJTJEJTMxJTIyJTIwJTczJTY1JTZDJTY1JTYzJTc0JTY1JTY0JTNFJTJEJTIwJTUz JTY1JTZDJTY1JTYzJTc0JTIwJTJEJTNDJTJGJTZGJTcwJTc0JTY5JTZGJTZFJTNFJTBBJTNDJTRG JTUwJTU0JTQ5JTRGJTRFJTIwJTc2JTYxJTZDJTc1JTY1JTNEJTIyJTRFJTYxJTZEJTY1JTIwJTZG JTY2JTIwJTZEJTc5JTIwJTYxJTZDJTZDJTJEJTc0JTY5JTZEJTY1JTIwJTY2JTYxJTc2JTZGJTc1 JTcyJTY5JTc0JTY1JTIwJTZEJTZGJTc2JTY5JTY1JTIwJTYzJTY4JTYxJTcyJTYxJTYzJTc0JTY1 JTcyJTNGJTIyJTNFJTRFJTYxJTZEJTY1JTIwJTZGJTY2JTIwJTZEJTc5JTIwJTYxJTZDJTZDJTJE JTc0JTY5JTZEJTY1JTIwJTY2JTYxJTc2JTZGJTc1JTcyJTY5JTc0JTY1JTIwJTZEJTZGJTc2JTY5 JTY1JTIwJTYzJTY4JTYxJTcyJTYxJTYzJTc0JTY1JTcyJTNGJTNDJTJGJTRGJTUwJTU0JTQ5JTRG JTRFJTNFJTBBJTNDJTRGJTUwJTU0JTQ5JTRGJTRFJTIwJTc2JTYxJTZDJTc1JTY1JTNEJTIyJTU3 JTY4JTYxJTc0JTIwJTc3JTYxJTczJTIwJTc0JTY4JTY1JTIwJTY2JTY5JTcyJTczJTc0JTIwJTZE JTZGJTc2JTY5JTY1JTIwJTQ5JTIwJTY1JTc2JTY1JTcyJTIwJTczJTYxJTc3JTNGJTIyJTNFJTU3 JTY4JTYxJTc0JTIwJTc3JTYxJTczJTIwJTc0JTY4JTY1JTIwJTY2JTY5JTcyJTczJTc0JTIwJTZE JTZGJTc2JTY5JTY1JTIwJTQ5JTIwJTY1JTc2JTY1JTcyJTIwJTczJTYxJTc3JTNGJTNDJTJGJTRG JTUwJTU0JTQ5JTRGJTRFJTNFJTBBJTNDJTRGJTUwJTU0JTQ5JTRGJTRFJTIwJTc2JTYxJTZDJTc1 JTY1JTNEJTIyJTU3JTY4JTYxJTc0JTIwJTY5JTczJTIwJTc0JTY4JTY1JTIwJTZEJTY5JTY0JTY0 JTZDJTY1JTIwJTZFJTYxJTZEJTY1JTIwJTZGJTY2JTIwJTZEJTc5JTIwJTZGJTZDJTY0JTY1JTcz JTc0JTIwJTYzJTY4JTY5JTZDJTY0JTNGJTIyJTNFJTU3JTY4JTYxJTc0JTIwJTY5JTczJTIwJTc0 JTY4JTY1JTIwJTZEJTY5JTY0JTY0JTZDJTY1JTIwJTZFJTYxJTZEJTY1JTIwJTZGJTY2JTIwJTZE JTc5JTIwJTZGJTZDJTY0JTY1JTczJTc0JTIwJTYzJTY4JTY5JTZDJTY0JTNGJTNDJTJGJTRGJTUw JTU0JTQ5JTRGJTRFJTNFJTBBJTNDJTRGJTUwJTU0JTQ5JTRGJTRFJTIwJTc2JTYxJTZDJTc1JTY1 JTNEJTIyJTQ5JTZFJTIwJTc3JTY4JTY5JTYzJTY4JTIwJTYzJTY5JTc0JTc5JTJGJTc0JTZGJTc3 JTZFJTIwJTc3JTYxJTczJTIwJTZEJTc5JTIwJTY2JTYxJTc0JTY4JTY1JTcyJTIwJTYyJTZGJTcy JTZFJTNGJTIyJTNFJTQ5JTZFJTIwJTc3JTY4JTY5JTYzJTY4JTIwJTYzJTY5JTc0JTc5JTJGJTc0 JTZGJTc3JTZFJTIwJTc3JTYxJTczJTIwJTZEJTc5JTIwJTY2JTYxJTc0JTY4JTY1JTcyJTIwJTYy JTZGJTcyJTZFJTNGJTNDJTJGJTRGJTUwJTU0JTQ5JTRGJTRFJTNFJTBBJTNDJTRGJTUwJTU0JTQ5 JTRGJTRFJTIwJTc2JTYxJTZDJTc1JTY1JTNEJTIyJTU3JTY4JTZGJTIwJTc3JTYxJTczJTIwJTZE JTc5JTIwJTY2JTYxJTc2JTZGJTc1JTcyJTY5JTc0JTY1JTIwJTYzJTYxJTcyJTc0JTZGJTZGJTZF JTIwJTYzJTY4JTYxJTcyJTYxJTYzJTc0JTY1JTcyJTIwJTYxJTczJTIwJTYxJTIwJTYzJTY4JTY5 JTZDJTY0JTNGJTIyJTNFJTU3JTY4JTZGJTIwJTc3JTYxJTczJTIwJTZEJTc5JTIwJTY2JTYxJTc2 JTZGJTc1JTcyJTY5JTc0JTY1JTIwJTYzJTYxJTcyJTc0JTZGJTZGJTZFJTIwJTYzJTY4JTYxJTcy JTYxJTYzJTc0JTY1JTcyJTIwJTYxJTczJTIwJTYxJTIwJTYzJTY4JTY5JTZDJTY0JTNGJTNDJTJG JTRGJTUwJTU0JTQ5JTRGJTRFJTNFJTBBJTNDJTRGJTUwJTU0JTQ5JTRGJTRFJTIwJTc2JTYxJTZD JTc1JTY1JTNEJTIyJTU3JTY4JTYxJTc0JTIwJTY5JTczJTIwJTZEJTc5JTIwJTZEJTZGJTc0JTY4 JTY1JTcyJTI3JTczJTIwJTZEJTY5JTY0JTY0JTZDJTY1JTIwJTZFJTYxJTZEJTY1JTNGJTIyJTNF JTU3JTY4JTYxJTc0JTIwJTY5JTczJTIwJTZEJTc5JTIwJTZEJTZGJTc0JTY4JTY1JTcyJTI3JTcz JTIwJTZEJTY5JTY0JTY0JTZDJTY1JTIwJTZFJTYxJTZEJTY1JTNGJTNDJTJGJTRGJTUwJTU0JTQ5 JTRGJTRFJTNFJTBBJTNDJTRGJTUwJTU0JTQ5JTRGJTRFJTIwJTc2JTYxJTZDJTc1JTY1JTNEJTIy JTQ5JTZFJTIwJTc3JTY4JTY5JTYzJTY4JTIwJTc5JTY1JTYxJTcyJTIwJTY0JTY5JTY0JTIwJTQ5 JTIwJTZEJTY1JTY1JTc0JTIwJTZEJTc5JTIwJTczJTY5JTY3JTZFJTY5JTY2JTY5JTYzJTYxJTZF JTc0JTIwJTZGJTc0JTY4JTY1JTcyJTNGJTIyJTNFJTQ5JTZFJTIwJTc3JTY4JTY5JTYzJTY4JTIw JTc5JTY1JTYxJTcyJTIwJTY0JTY5JTY0JTIwJTQ5JTIwJTZEJTY1JTY1JTc0JTIwJTZEJTc5JTIw JTczJTY5JTY3JTZFJTY5JTY2JTY5JTYzJTYxJTZFJTc0JTIwJTZGJTc0JTY4JTY1JTcyJTNGJTND JTJGJTRGJTUwJTU0JTQ5JTRGJTRFJTNFJTBBJTNDJTRGJTUwJTU0JTQ5JTRGJTRFJTIwJTc2JTYx JTZDJTc1JTY1JTNEJTIyJTU3JTY4JTYxJTc0JTIwJTc3JTYxJTczJTIwJTZEJTc5JTIwJTY2JTY5 JTcyJTczJTc0JTIwJTcwJTY1JTc0JTI3JTczJTIwJTZFJTYxJTZEJTY1JTNGJTIyJTNFJTU3JTY4 JTYxJTc0JTIwJTc3JTYxJTczJTIwJTZEJTc5JTIwJTY2JTY5JTcyJTczJTc0JTIwJTcwJTY1JTc0 JTI3JTczJTIwJTZFJTYxJTZEJTY1JTNGJTNDJTJGJTRGJTUwJTU0JTQ5JTRGJTRFJTNFJTBBJTND JTRGJTUwJTU0JTQ5JTRGJTRFJTIwJTc2JTYxJTZDJTc1JTY1JTNEJTIyJTQ2JTY5JTcyJTczJTc0 JTIwJTZFJTYxJTZEJTY1JTIwJTZGJTY2JTIwJTc0JTY4JTY1JTIwJTZEJTYxJTY5JTY0JTIwJTZG JTY2JTIwJTY4JTZGJTZFJTZGJTc1JTcyJTIwJTYxJTc0JTIwJTZEJTc5JTIwJTc3JTY1JTY0JTY0 JTY5JTZFJTY3JTNGJTIyJTNFJTQ2JTY5JTcyJTczJTc0JTIwJTZFJTYxJTZEJTY1JTIwJTZGJTY2 JTIwJTc0JTY4JTY1JTIwJTZEJTYxJTY5JTY0JTIwJTZGJTY2JTIwJTY4JTZGJTZFJTZGJTc1JTcy JTIwJTYxJTc0JTIwJTZEJTc5JTIwJTc3JTY1JTY0JTY0JTY5JTZFJTY3JTNGJTNDJTJGJTRGJTUw JTU0JTQ5JTRGJTRFJTNFJTBBJTNDJTRGJTUwJTU0JTQ5JTRGJTRFJTIwJTc2JTYxJTZDJTc1JTY1 JTNEJTIyJTQ2JTY5JTcyJTczJTc0JTIwJTZFJTYxJTZEJTY1JTIwJTZGJTY2JTIwJTZEJTc5JTIw JTYyJTY1JTczJTc0JTIwJTY2JTcyJTY5JTY1JTZFJTY0JTIwJTY5JTZFJTIwJTY1JTZDJTY1JTZE JTY1JTZFJTc0JTYxJTcyJTc5JTIwJTczJTYzJTY4JTZGJTZGJTZDJTNGJTIyJTNFJTQ2JTY5JTcy JTczJTc0JTIwJTZFJTYxJTZEJTY1JTIwJTZGJTY2JTIwJTZEJTc5JTIwJTYyJTY1JTczJTc0JTIw JTY2JTcyJTY5JTY1JTZFJTY0JTIwJTY5JTZFJTIwJTY1JTZDJTY1JTZEJTY1JTZFJTc0JTYxJTcy JTc5JTIwJTczJTYzJTY4JTZGJTZGJTZDJTNGJTNDJTJGJTRGJTUwJTU0JTQ5JTRGJTRFJTNFJTBB JTNDJTRGJTUwJTU0JTQ5JTRGJTRFJTIwJTc2JTYxJTZDJTc1JTY1JTNEJTIyJTQzJTcyJTY1JTYx JTc0JTY1JTIwJTc5JTZGJTc1JTcyJTIwJTZGJTc3JTZFJTIwJTczJTY1JTYzJTc1JTcyJTY5JTc0 JTc5JTIwJTcxJTc1JTY1JTczJTc0JTY5JTZGJTZFJTNGJTIyJTNFJTQzJTcyJTY1JTYxJTc0JTY1 JTIwJTc5JTZGJTc1JTcyJTIwJTZGJTc3JTZFJTIwJTczJTY1JTYzJTc1JTcyJTY5JTc0JTc5JTIw JTcxJTc1JTY1JTczJTc0JTY5JTZGJTZFJTNDJTJGJTRGJTUwJTU0JTQ5JTRGJTRFJTNFJTBBJTND JTJGJTczJTY1JTZDJTY1JTYzJTc0JTNFJTBBJTA5JTA5JTA5JTA5JTNDJTJGJTY0JTY5JTc2JTNF JTBBJTA5JTA5JTA5JTA5JTNDJTczJTcwJTYxJTZFJTIwJTYzJTZDJTYxJTczJTczJTNEJTIyJTY2 JTY5JTY1JTZDJTY0JTJEJTc2JTYxJTZDJTY5JTY0JTYxJTc0JTY5JTZGJTZFJTJEJTc2JTYxJTZD JTY5JTY0JTIyJTIwJTY0JTYxJTc0JTYxJTJEJTc2JTYxJTZDJTZEJTczJTY3JTJEJTY2JTZGJTcy JTNEJTIyJTZEJTZGJTY0JTY1JTZDJTJFJTU0JTY5JTc0JTZDJTY1JTIyJTIwJTY0JTYxJTc0JTYx JTJEJTc2JTYxJTZDJTZEJTczJTY3JTJEJTcyJTY1JTcwJTZDJTYxJTYzJTY1JTNEJTIyJTc0JTcy JTc1JTY1JTIyJTNFJTNDJTJGJTczJTcwJTYxJTZFJTNFJTBBJTBBJTA5JTA5JTA5JTA5JTNDJTY0 JTY5JTc2JTNFJTBBJTA5JTA5JTA5JTA5JTA5JTNDJTZDJTYxJTYyJTY1JTZDJTIwJTY2JTZGJTcy JTNEJTIyJTZEJTZGJTY0JTY1JTZDJTVGJTQ2JTY5JTcyJTczJTc0JTRFJTYxJTZEJTY1JTIyJTNF JTQxJTZFJTczJTc3JTY1JTcyJTIwJTMyJTNDJTJGJTZDJTYxJTYyJTY1JTZDJTNFJTIwJTNDJTYy JTNFJTNDJTY2JTZGJTZFJTc0JTIwJTYzJTZGJTZDJTZGJTcyJTNEJTIyJTcyJTY1JTY0JTIyJTNF JTJBJTNDJTJGJTY2JTZGJTZFJTc0JTNFJTNDJTJGJTYyJTNFJTIwJTBBJTA5JTA5JTA5JTA5JTA5 JTNDJTY5JTZFJTcwJTc1JTc0JTIwJTY0JTYxJTc0JTYxJTJEJTc2JTYxJTZDJTNEJTIyJTc0JTcy JTc1JTY1JTIyJTIwJTY0JTYxJTc0JTYxJTJEJTc2JTYxJTZDJTJEJTZDJTY1JTZFJTY3JTc0JTY4 JTNEJTIyJTU0JTY4JTY1JTIwJTY2JTY5JTY1JTZDJTY0JTIwJTQ2JTY5JTcyJTczJTc0JTIwJTRF JTYxJTZEJTY1JTIwJTZEJTc1JTczJTc0JTIwJTYyJTY1JTIwJTYxJTIwJTczJTc0JTcyJTY5JTZF JTY3JTIwJTc3JTY5JTc0JTY4JTIwJTYxJTIwJTZEJTYxJTc4JTY5JTZEJTc1JTZEJTIwJTZDJTY1 JTZFJTY3JTc0JTY4JTIwJTZGJTY2JTIwJTMzJTM1JTJFJTIyJTIwJTY0JTYxJTc0JTYxJTJEJTc2 JTYxJTZDJTJEJTZDJTY1JTZFJTY3JTc0JTY4JTJEJTZEJTYxJTc4JTNEJTIyJTMzJTM1JTIyJTIw JTY0JTYxJTc0JTYxJTJEJTc2JTYxJTZDJTJEJTcyJTY1JTcxJTc1JTY5JTcyJTY1JTY0JTNEJTIy JTU0JTY4JTY5JTczJTIwJTY2JTY5JTY1JTZDJTY0JTIwJTY5JTczJTIwJTcyJTY1JTcxJTc1JTY5 JTcyJTY1JTY0JTJFJTIyJTIwJTY5JTY0JTNEJTIyJTZEJTZGJTY0JTY1JTZDJTVGJTQ2JTY5JTcy JTczJTc0JTRFJTYxJTZEJTY1JTIyJTIwJTZFJTYxJTZEJTY1JTNEJTIyJTQ2JTY5JTcyJTczJTc0 JTRFJTYxJTZEJTY1JTMyJTIyJTIwJTc0JTc5JTcwJTY1JTNEJTIyJTcwJTYxJTczJTczJTc3JTZG JTcyJTY0JTIyJTIwJTc2JTYxJTZDJTc1JTY1JTNEJTIyJTIyJTIwJTJGJTNFJTBBJTA5JTA5JTA5 JTA5JTNDJTJGJTY0JTY5JTc2JTNFJTBBJTA5JTA5JTA5JTA5JTNDJTczJTcwJTYxJTZFJTIwJTYz JTZDJTYxJTczJTczJTNEJTIyJTY2JTY5JTY1JTZDJTY0JTJEJTc2JTYxJTZDJTY5JTY0JTYxJTc0 JTY5JTZGJTZFJTJEJTc2JTYxJTZDJTY5JTY0JTIyJTIwJTY0JTYxJTc0JTYxJTJEJTc2JTYxJTZD JTZEJTczJTY3JTJEJTY2JTZGJTcyJTNEJTIyJTQ2JTY5JTcyJTczJTc0JTRFJTYxJTZEJTY1JTIy JTIwJTY0JTYxJTc0JTYxJTJEJTc2JTYxJTZDJTZEJTczJTY3JTJEJTcyJTY1JTcwJTZDJTYxJTYz JTY1JTNEJTIyJTc0JTcyJTc1JTY1JTIyJTNFJTNDJTJGJTczJTcwJTYxJTZFJTNFJTBBJTA5JTA5 JTA5JTA5JTBBJTA5JTA5JTA5JTA5JTBBJTA5JTA5JTA5JTA5JTBBJTA5JTA5JTA5JTA5JTBBJTA5 JTA5JTA5JTA5JTBBJTA5JTA5JTA5JTA5JTBBJTA5JTA5JTA5JTA5JTBBJTA5JTA5JTA5JTA5JTBB JTA5JTA5JTA5JTA5JTBBJTA5JTA5JTA5JTA5JTNDJTY0JTY5JTc2JTNFJTBBJTA5JTA5JTA5JTA5 JTA5JTNDJTZDJTYxJTYyJTY1JTZDJTIwJTY2JTZGJTcyJTNEJTIyJTZEJTZGJTY0JTY1JTZDJTVG JTU0JTY5JTc0JTZDJTY1JTIyJTNFJTUxJTc1JTY1JTczJTc0JTY5JTZGJTZFJTIwJTMzJTNDJTJG JTZDJTYxJTYyJTY1JTZDJTNFJTIwJTIwJTNDJTYyJTNFJTNDJTY2JTZGJTZFJTc0JTIwJTYzJTZG JTZDJTZGJTcyJTNEJTIyJTcyJTY1JTY0JTIyJTNFJTJBJTNDJTJGJTY2JTZGJTZFJTc0JTNFJTND JTJGJTYyJTNFJTBBJTA5JTA5JTA5JTA5JTA5JTNDJTczJTY1JTZDJTY1JTYzJTc0JTIwJTY5JTY0 JTNEJTIyJTZEJTZGJTY0JTY1JTZDJTVGJTU0JTY5JTc0JTZDJTY1JTIyJTIwJTZFJTYxJTZEJTY1 JTNEJTIyJTcxJTc1JTY1JTczJTc0JTY5JTZGJTZFJTMzJTIyJTIwJTczJTc0JTc5JTZDJTY1JTNE JTIyJTc3JTY5JTY0JTc0JTY4JTNBJTM0JTMwJTMwJTcwJTc4JTNCJTIwJTIyJTIwJTcyJTY1JTcx JTc1JTY5JTcyJTY1JTY0JTJGJTNFJTBBJTNDJTZGJTcwJTc0JTY5JTZGJTZFJTIwJTc2JTYxJTZD JTc1JTY1JTNEJTIyJTJEJTMxJTIyJTIwJTczJTY1JTZDJTY1JTYzJTc0JTY1JTY0JTNFJTJEJTIw JTUzJTY1JTZDJTY1JTYzJTc0JTIwJTJEJTNDJTJGJTZGJTcwJTc0JTY5JTZGJTZFJTNFJTBBJTND JTRGJTUwJTU0JTQ5JTRGJTRFJTIwJTc2JTYxJTZDJTc1JTY1JTNEJTIyJTRFJTYxJTZEJTY1JTIw JTZGJTY2JTIwJTZEJTc5JTIwJTYxJTZDJTZDJTJEJTc0JTY5JTZEJTY1JTIwJTY2JTYxJTc2JTZG JTc1JTcyJTY5JTc0JTY1JTIwJTZEJTZGJTc2JTY5JTY1JTIwJTYzJTY4JTYxJTcyJTYxJTYzJTc0 JTY1JTcyJTNGJTIyJTNFJTRFJTYxJTZEJTY1JTIwJTZGJTY2JTIwJTZEJTc5JTIwJTYxJTZDJTZD JTJEJTc0JTY5JTZEJTY1JTIwJTY2JTYxJTc2JTZGJTc1JTcyJTY5JTc0JTY1JTIwJTZEJTZGJTc2 JTY5JTY1JTIwJTYzJTY4JTYxJTcyJTYxJTYzJTc0JTY1JTcyJTNGJTNDJTJGJTRGJTUwJTU0JTQ5 JTRGJTRFJTNFJTBBJTNDJTRGJTUwJTU0JTQ5JTRGJTRFJTIwJTc2JTYxJTZDJTc1JTY1JTNEJTIy JTU3JTY4JTYxJTc0JTIwJTc3JTYxJTczJTIwJTc0JTY4JTY1JTIwJTY2JTY5JTcyJTczJTc0JTIw JTZEJTZGJTc2JTY5JTY1JTIwJTQ5JTIwJTY1JTc2JTY1JTcyJTIwJTczJTYxJTc3JTNGJTIyJTNF JTU3JTY4JTYxJTc0JTIwJTc3JTYxJTczJTIwJTc0JTY4JTY1JTIwJTY2JTY5JTcyJTczJTc0JTIw JTZEJTZGJTc2JTY5JTY1JTIwJTQ5JTIwJTY1JTc2JTY1JTcyJTIwJTczJTYxJTc3JTNGJTNDJTJG JTRGJTUwJTU0JTQ5JTRGJTRFJTNFJTBBJTNDJTRGJTUwJTU0JTQ5JTRGJTRFJTIwJTc2JTYxJTZD JTc1JTY1JTNEJTIyJTU3JTY4JTYxJTc0JTIwJTY5JTczJTIwJTc0JTY4JTY1JTIwJTZEJTY5JTY0 JTY0JTZDJTY1JTIwJTZFJTYxJTZEJTY1JTIwJTZGJTY2JTIwJTZEJTc5JTIwJTZGJTZDJTY0JTY1 JTczJTc0JTIwJTYzJTY4JTY5JTZDJTY0JTNGJTIyJTNFJTU3JTY4JTYxJTc0JTIwJTY5JTczJTIw JTc0JTY4JTY1JTIwJTZEJTY5JTY0JTY0JTZDJTY1JTIwJTZFJTYxJTZEJTY1JTIwJTZGJTY2JTIw JTZEJTc5JTIwJTZGJTZDJTY0JTY1JTczJTc0JTIwJTYzJTY4JTY5JTZDJTY0JTNGJTNDJTJGJTRG JTUwJTU0JTQ5JTRGJTRFJTNFJTBBJTNDJTRGJTUwJTU0JTQ5JTRGJTRFJTIwJTc2JTYxJTZDJTc1 JTY1JTNEJTIyJTQ5JTZFJTIwJTc3JTY4JTY5JTYzJTY4JTIwJTYzJTY5JTc0JTc5JTJGJTc0JTZG JTc3JTZFJTIwJTc3JTYxJTczJTIwJTZEJTc5JTIwJTY2JTYxJTc0JTY4JTY1JTcyJTIwJTYyJTZG JTcyJTZFJTNGJTIyJTNFJTQ5JTZFJTIwJTc3JTY4JTY5JTYzJTY4JTIwJTYzJTY5JTc0JTc5JTJG JTc0JTZGJTc3JTZFJTIwJTc3JTYxJTczJTIwJTZEJTc5JTIwJTY2JTYxJTc0JTY4JTY1JTcyJTIw JTYyJTZGJTcyJTZFJTNGJTNDJTJGJTRGJTUwJTU0JTQ5JTRGJTRFJTNFJTBBJTNDJTRGJTUwJTU0 JTQ5JTRGJTRFJTIwJTc2JTYxJTZDJTc1JTY1JTNEJTIyJTU3JTY4JTZGJTIwJTc3JTYxJTczJTIw JTZEJTc5JTIwJTY2JTYxJTc2JTZGJTc1JTcyJTY5JTc0JTY1JTIwJTYzJTYxJTcyJTc0JTZGJTZG JTZFJTIwJTYzJTY4JTYxJTcyJTYxJTYzJTc0JTY1JTcyJTIwJTYxJTczJTIwJTYxJTIwJTYzJTY4 JTY5JTZDJTY0JTNGJTIyJTNFJTU3JTY4JTZGJTIwJTc3JTYxJTczJTIwJTZEJTc5JTIwJTY2JTYx JTc2JTZGJTc1JTcyJTY5JTc0JTY1JTIwJTYzJTYxJTcyJTc0JTZGJTZGJTZFJTIwJTYzJTY4JTYx JTcyJTYxJTYzJTc0JTY1JTcyJTIwJTYxJTczJTIwJTYxJTIwJTYzJTY4JTY5JTZDJTY0JTNGJTND JTJGJTRGJTUwJTU0JTQ5JTRGJTRFJTNFJTBBJTNDJTRGJTUwJTU0JTQ5JTRGJTRFJTIwJTc2JTYx JTZDJTc1JTY1JTNEJTIyJTU3JTY4JTYxJTc0JTIwJTY5JTczJTIwJTZEJTc5JTIwJTZEJTZGJTc0 JTY4JTY1JTcyJTI3JTczJTIwJTZEJTY5JTY0JTY0JTZDJTY1JTIwJTZFJTYxJTZEJTY1JTNGJTIy JTNFJTU3JTY4JTYxJTc0JTIwJTY5JTczJTIwJTZEJTc5JTIwJTZEJTZGJTc0JTY4JTY1JTcyJTI3 JTczJTIwJTZEJTY5JTY0JTY0JTZDJTY1JTIwJTZFJTYxJTZEJTY1JTNGJTNDJTJGJTRGJTUwJTU0 JTQ5JTRGJTRFJTNFJTBBJTNDJTRGJTUwJTU0JTQ5JTRGJTRFJTIwJTc2JTYxJTZDJTc1JTY1JTNE JTIyJTQ5JTZFJTIwJTc3JTY4JTY5JTYzJTY4JTIwJTc5JTY1JTYxJTcyJTIwJTY0JTY5JTY0JTIw JTQ5JTIwJTZEJTY1JTY1JTc0JTIwJTZEJTc5JTIwJTczJTY5JTY3JTZFJTY5JTY2JTY5JTYzJTYx JTZFJTc0JTIwJTZGJTc0JTY4JTY1JTcyJTNGJTIyJTNFJTQ5JTZFJTIwJTc3JTY4JTY5JTYzJTY4 JTIwJTc5JTY1JTYxJTcyJTIwJTY0JTY5JTY0JTIwJTQ5JTIwJTZEJTY1JTY1JTc0JTIwJTZEJTc5 JTIwJTczJTY5JTY3JTZFJTY5JTY2JTY5JTYzJTYxJTZFJTc0JTIwJTZGJTc0JTY4JTY1JTcyJTNG JTNDJTJGJTRGJTUwJTU0JTQ5JTRGJTRFJTNFJTBBJTNDJTRGJTUwJTU0JTQ5JTRGJTRFJTIwJTc2 JTYxJTZDJTc1JTY1JTNEJTIyJTU3JTY4JTYxJTc0JTIwJTc3JTYxJTczJTIwJTZEJTc5JTIwJTY2 JTY5JTcyJTczJTc0JTIwJTcwJTY1JTc0JTI3JTczJTIwJTZFJTYxJTZEJTY1JTNGJTIyJTNFJTU3 JTY4JTYxJTc0JTIwJTc3JTYxJTczJTIwJTZEJTc5JTIwJTY2JTY5JTcyJTczJTc0JTIwJTcwJTY1 JTc0JTI3JTczJTIwJTZFJTYxJTZEJTY1JTNGJTNDJTJGJTRGJTUwJTU0JTQ5JTRGJTRFJTNFJTBB JTNDJTRGJTUwJTU0JTQ5JTRGJTRFJTIwJTc2JTYxJTZDJTc1JTY1JTNEJTIyJTQ2JTY5JTcyJTcz JTc0JTIwJTZFJTYxJTZEJTY1JTIwJTZGJTY2JTIwJTc0JTY4JTY1JTIwJTZEJTYxJTY5JTY0JTIw JTZGJTY2JTIwJTY4JTZGJTZFJTZGJTc1JTcyJTIwJTYxJTc0JTIwJTZEJTc5JTIwJTc3JTY1JTY0 JTY0JTY5JTZFJTY3JTNGJTIyJTNFJTQ2JTY5JTcyJTczJTc0JTIwJTZFJTYxJTZEJTY1JTIwJTZG JTY2JTIwJTc0JTY4JTY1JTIwJTZEJTYxJTY5JTY0JTIwJTZGJTY2JTIwJTY4JTZGJTZFJTZGJTc1 JTcyJTIwJTYxJTc0JTIwJTZEJTc5JTIwJTc3JTY1JTY0JTY0JTY5JTZFJTY3JTNGJTNDJTJGJTRG JTUwJTU0JTQ5JTRGJTRFJTNFJTBBJTNDJTRGJTUwJTU0JTQ5JTRGJTRFJTIwJTc2JTYxJTZDJTc1 JTY1JTNEJTIyJTQ2JTY5JTcyJTczJTc0JTIwJTZFJTYxJTZEJTY1JTIwJTZGJTY2JTIwJTZEJTc5 JTIwJTYyJTY1JTczJTc0JTIwJTY2JTcyJTY5JTY1JTZFJTY0JTIwJTY5JTZFJTIwJTY1JTZDJTY1 JTZEJTY1JTZFJTc0JTYxJTcyJTc5JTIwJTczJTYzJTY4JTZGJTZGJTZDJTNGJTIyJTNFJTQ2JTY5 JTcyJTczJTc0JTIwJTZFJTYxJTZEJTY1JTIwJTZGJTY2JTIwJTZEJTc5JTIwJTYyJTY1JTczJTc0 JTIwJTY2JTcyJTY5JTY1JTZFJTY0JTIwJTY5JTZFJTIwJTY1JTZDJTY1JTZEJTY1JTZFJTc0JTYx JTcyJTc5JTIwJTczJTYzJTY4JTZGJTZGJTZDJTNGJTNDJTJGJTRGJTUwJTU0JTQ5JTRGJTRFJTNF JTBBJTNDJTRGJTUwJTU0JTQ5JTRGJTRFJTIwJTc2JTYxJTZDJTc1JTY1JTNEJTIyJTQzJTcyJTY1 JTYxJTc0JTY1JTIwJTc5JTZGJTc1JTcyJTIwJTZGJTc3JTZFJTIwJTczJTY1JTYzJTc1JTcyJTY5 JTc0JTc5JTIwJTcxJTc1JTY1JTczJTc0JTY5JTZGJTZFJTNGJTIyJTNFJTQzJTcyJTY1JTYxJTc0 JTY1JTIwJTc5JTZGJTc1JTcyJTIwJTZGJTc3JTZFJTIwJTczJTY1JTYzJTc1JTcyJTY5JTc0JTc5 JTIwJTcxJTc1JTY1JTczJTc0JTY5JTZGJTZFJTNDJTJGJTRGJTUwJTU0JTQ5JTRGJTRFJTNFJTBB JTNDJTJGJTczJTY1JTZDJTY1JTYzJTc0JTNFJTBBJTA5JTA5JTA5JTA5JTNDJTJGJTY0JTY5JTc2 JTNFJTBBJTA5JTA5JTA5JTA5JTNDJTczJTcwJTYxJTZFJTIwJTYzJTZDJTYxJTczJTczJTNEJTIy JTY2JTY5JTY1JTZDJTY0JTJEJTc2JTYxJTZDJTY5JTY0JTYxJTc0JTY5JTZGJTZFJTJEJTc2JTYx JTZDJTY5JTY0JTIyJTIwJTY0JTYxJTc0JTYxJTJEJTc2JTYxJTZDJTZEJTczJTY3JTJEJTY2JTZG JTcyJTNEJTIyJTZEJTZGJTY0JTY1JTZDJTJFJTU0JTY5JTc0JTZDJTY1JTIyJTIwJTY0JTYxJTc0 JTYxJTJEJTc2JTYxJTZDJTZEJTczJTY3JTJEJTcyJTY1JTcwJTZDJTYxJTYzJTY1JTNEJTIyJTc0 JTcyJTc1JTY1JTIyJTNFJTNDJTJGJTczJTcwJTYxJTZFJTNFJTBBJTBBJTA5JTA5JTA5JTA5JTND JTY0JTY5JTc2JTNFJTBBJTA5JTA5JTA5JTA5JTA5JTNDJTZDJTYxJTYyJTY1JTZDJTIwJTY2JTZG JTcyJTNEJTIyJTZEJTZGJTY0JTY1JTZDJTVGJTQ2JTY5JTcyJTczJTc0JTRFJTYxJTZEJTY1JTIy JTNFJTQxJTZFJTczJTc3JTY1JTcyJTIwJTMzJTNDJTJGJTZDJTYxJTYyJTY1JTZDJTNFJTIwJTND JTYyJTNFJTNDJTY2JTZGJTZFJTc0JTIwJTYzJTZGJTZDJTZGJTcyJTNEJTIyJTcyJTY1JTY0JTIy JTNFJTJBJTNDJTJGJTY2JTZGJTZFJTc0JTNFJTNDJTJGJTYyJTNFJTIwJTBBJTA5JTA5JTA5JTA5 JTA5JTNDJTY5JTZFJTcwJTc1JTc0JTIwJTY0JTYxJTc0JTYxJTJEJTc2JTYxJTZDJTNEJTIyJTc0 JTcyJTc1JTY1JTIyJTIwJTY0JTYxJTc0JTYxJTJEJTc2JTYxJTZDJTJEJTZDJTY1JTZFJTY3JTc0 JTY4JTNEJTIyJTU0JTY4JTY1JTIwJTY2JTY5JTY1JTZDJTY0JTIwJTQ2JTY5JTcyJTczJTc0JTIw JTRFJTYxJTZEJTY1JTIwJTZEJTc1JTczJTc0JTIwJTYyJTY1JTIwJTYxJTIwJTczJTc0JTcyJTY5 JTZFJTY3JTIwJTc3JTY5JTc0JTY4JTIwJTYxJTIwJTZEJTYxJTc4JTY5JTZEJTc1JTZEJTIwJTZD JTY1JTZFJTY3JTc0JTY4JTIwJTZGJTY2JTIwJTMzJTM1JTJFJTIyJTIwJTY0JTYxJTc0JTYxJTJE JTc2JTYxJTZDJTJEJTZDJTY1JTZFJTY3JTc0JTY4JTJEJTZEJTYxJTc4JTNEJTIyJTMzJTM1JTIy JTIwJTY0JTYxJTc0JTYxJTJEJTc2JTYxJTZDJTJEJTcyJTY1JTcxJTc1JTY5JTcyJTY1JTY0JTNE JTIyJTU0JTY4JTY5JTczJTIwJTY2JTY5JTY1JTZDJTY0JTIwJTY5JTczJTIwJTcyJTY1JTcxJTc1 JTY5JTcyJTY1JTY0JTJFJTIyJTIwJTY5JTY0JTNEJTIyJTZEJTZGJTY0JTY1JTZDJTVGJTQ2JTY5 JTcyJTczJTc0JTRFJTYxJTZEJTY1JTIyJTIwJTZFJTYxJTZEJTY1JTNEJTIyJTQ2JTY5JTcyJTcz JTc0JTRFJTYxJTZEJTY1JTMzJTIyJTIwJTc0JTc5JTcwJTY1JTNEJTIyJTcwJTYxJTczJTczJTc3 JTZGJTcyJTY0JTIyJTIwJTc2JTYxJTZDJTc1JTY1JTNEJTIyJTIyJTIwJTJGJTNFJTBBJTA5JTA5 JTA5JTA5JTNDJTJGJTY0JTY5JTc2JTNFJTBBJTA5JTA5JTA5JTA5JTNDJTczJTcwJTYxJTZFJTIw JTYzJTZDJTYxJTczJTczJTNEJTIyJTY2JTY5JTY1JTZDJTY0JTJEJTc2JTYxJTZDJTY5JTY0JTYx JTc0JTY5JTZGJTZFJTJEJTc2JTYxJTZDJTY5JTY0JTIyJTIwJTY0JTYxJTc0JTYxJTJEJTc2JTYx JTZDJTZEJTczJTY3JTJEJTY2JTZGJTcyJTNEJTIyJTQ2JTY5JTcyJTczJTc0JTRFJTYxJTZEJTY1 JTIyJTIwJTY0JTYxJTc0JTYxJTJEJTc2JTYxJTZDJTZEJTczJTY3JTJEJTcyJTY1JTcwJTZDJTYx JTYzJTY1JTNEJTIyJTc0JTcyJTc1JTY1JTIyJTNFJTNDJTJGJTczJTcwJTYxJTZFJTNFJTBBJTA5 JTA5JTA5JTA5JTBBJTA5JTA5JTA5JTA5JTBBJTA5JTA5JTA5JTA5JTBBJTA5JTA5JTA5JTA5JTBB JTA5JTA5JTA5JTA5JTBBJTA5JTA5JTA5JTA5JTNDJTY0JTY5JTc2JTNFJTBBJTA5JTA5JTA5JTA5 JTA5JTNDJTZDJTYxJTYyJTY1JTZDJTIwJTY2JTZGJTcyJTNEJTIyJTZEJTZGJTY0JTY1JTZDJTVG JTU0JTY5JTc0JTZDJTY1JTIyJTNFJTUxJTc1JTY1JTczJTc0JTY5JTZGJTZFJTIwJTM0JTNDJTJG JTZDJTYxJTYyJTY1JTZDJTNFJTIwJTIwJTNDJTYyJTNFJTNDJTY2JTZGJTZFJTc0JTIwJTYzJTZG JTZDJTZGJTcyJTNEJTIyJTcyJTY1JTY0JTIyJTNFJTJBJTNDJTJGJTY2JTZGJTZFJTc0JTNFJTND JTJGJTYyJTNFJTBBJTA5JTA5JTA5JTA5JTA5JTNDJTczJTY1JTZDJTY1JTYzJTc0JTIwJTY5JTY0 JTNEJTIyJTZEJTZGJTY0JTY1JTZDJTVGJTU0JTY5JTc0JTZDJTY1JTIyJTIwJTZFJTYxJTZEJTY1 JTNEJTIyJTcxJTc1JTY1JTczJTc0JTY5JTZGJTZFJTM0JTIyJTIwJTczJTc0JTc5JTZDJTY1JTNE JTIyJTc3JTY5JTY0JTc0JTY4JTNBJTM0JTMwJTMwJTcwJTc4JTNCJTIwJTIyJTIwJTcyJTY1JTcx JTc1JTY5JTcyJTY1JTY0JTJGJTNFJTBBJTNDJTZGJTcwJTc0JTY5JTZGJTZFJTIwJTc2JTYxJTZD JTc1JTY1JTNEJTIyJTJEJTMxJTIyJTIwJTczJTY1JTZDJTY1JTYzJTc0JTY1JTY0JTNFJTJEJTIw JTUzJTY1JTZDJTY1JTYzJTc0JTIwJTJEJTNDJTJGJTZGJTcwJTc0JTY5JTZGJTZFJTNFJTBBJTND JTRGJTUwJTU0JTQ5JTRGJTRFJTIwJTc2JTYxJTZDJTc1JTY1JTNEJTIyJTRFJTYxJTZEJTY1JTIw JTZGJTY2JTIwJTZEJTc5JTIwJTYxJTZDJTZDJTJEJTc0JTY5JTZEJTY1JTIwJTY2JTYxJTc2JTZG JTc1JTcyJTY5JTc0JTY1JTIwJTZEJTZGJTc2JTY5JTY1JTIwJTYzJTY4JTYxJTcyJTYxJTYzJTc0 JTY1JTcyJTNGJTIyJTNFJTRFJTYxJTZEJTY1JTIwJTZGJTY2JTIwJTZEJTc5JTIwJTYxJTZDJTZD JTJEJTc0JTY5JTZEJTY1JTIwJTY2JTYxJTc2JTZGJTc1JTcyJTY5JTc0JTY1JTIwJTZEJTZGJTc2 JTY5JTY1JTIwJTYzJTY4JTYxJTcyJTYxJTYzJTc0JTY1JTcyJTNGJTNDJTJGJTRGJTUwJTU0JTQ5 JTRGJTRFJTNFJTBBJTNDJTRGJTUwJTU0JTQ5JTRGJTRFJTIwJTc2JTYxJTZDJTc1JTY1JTNEJTIy JTU3JTY4JTYxJTc0JTIwJTc3JTYxJTczJTIwJTc0JTY4JTY1JTIwJTY2JTY5JTcyJTczJTc0JTIw JTZEJTZGJTc2JTY5JTY1JTIwJTQ5JTIwJTY1JTc2JTY1JTcyJTIwJTczJTYxJTc3JTNGJTIyJTNF JTU3JTY4JTYxJTc0JTIwJTc3JTYxJTczJTIwJTc0JTY4JTY1JTIwJTY2JTY5JTcyJTczJTc0JTIw JTZEJTZGJTc2JTY5JTY1JTIwJTQ5JTIwJTY1JTc2JTY1JTcyJTIwJTczJTYxJTc3JTNGJTNDJTJG JTRGJTUwJTU0JTQ5JTRGJTRFJTNFJTBBJTNDJTRGJTUwJTU0JTQ5JTRGJTRFJTIwJTc2JTYxJTZD JTc1JTY1JTNEJTIyJTU3JTY4JTYxJTc0JTIwJTY5JTczJTIwJTc0JTY4JTY1JTIwJTZEJTY5JTY0 JTY0JTZDJTY1JTIwJTZFJTYxJTZEJTY1JTIwJTZGJTY2JTIwJTZEJTc5JTIwJTZGJTZDJTY0JTY1 JTczJTc0JTIwJTYzJTY4JTY5JTZDJTY0JTNGJTIyJTNFJTU3JTY4JTYxJTc0JTIwJTY5JTczJTIw JTc0JTY4JTY1JTIwJTZEJTY5JTY0JTY0JTZDJTY1JTIwJTZFJTYxJTZEJTY1JTIwJTZGJTY2JTIw JTZEJTc5JTIwJTZGJTZDJTY0JTY1JTczJTc0JTIwJTYzJTY4JTY5JTZDJTY0JTNGJTNDJTJGJTRG JTUwJTU0JTQ5JTRGJTRFJTNFJTBBJTNDJTRGJTUwJTU0JTQ5JTRGJTRFJTIwJTc2JTYxJTZDJTc1 JTY1JTNEJTIyJTQ5JTZFJTIwJTc3JTY4JTY5JTYzJTY4JTIwJTYzJTY5JTc0JTc5JTJGJTc0JTZG JTc3JTZFJTIwJTc3JTYxJTczJTIwJTZEJTc5JTIwJTY2JTYxJTc0JTY4JTY1JTcyJTIwJTYyJTZG JTcyJTZFJTNGJTIyJTNFJTQ5JTZFJTIwJTc3JTY4JTY5JTYzJTY4JTIwJTYzJTY5JTc0JTc5JTJG JTc0JTZGJTc3JTZFJTIwJTc3JTYxJTczJTIwJTZEJTc5JTIwJTY2JTYxJTc0JTY4JTY1JTcyJTIw JTYyJTZGJTcyJTZFJTNGJTNDJTJGJTRGJTUwJTU0JTQ5JTRGJTRFJTNFJTBBJTNDJTRGJTUwJTU0 JTQ5JTRGJTRFJTIwJTc2JTYxJTZDJTc1JTY1JTNEJTIyJTU3JTY4JTZGJTIwJTc3JTYxJTczJTIw JTZEJTc5JTIwJTY2JTYxJTc2JTZGJTc1JTcyJTY5JTc0JTY1JTIwJTYzJTYxJTcyJTc0JTZGJTZG JTZFJTIwJTYzJTY4JTYxJTcyJTYxJTYzJTc0JTY1JTcyJTIwJTYxJTczJTIwJTYxJTIwJTYzJTY4 JTY5JTZDJTY0JTNGJTIyJTNFJTU3JTY4JTZGJTIwJTc3JTYxJTczJTIwJTZEJTc5JTIwJTY2JTYx JTc2JTZGJTc1JTcyJTY5JTc0JTY1JTIwJTYzJTYxJTcyJTc0JTZGJTZGJTZFJTIwJTYzJTY4JTYx JTcyJTYxJTYzJTc0JTY1JTcyJTIwJTYxJTczJTIwJTYxJTIwJTYzJTY4JTY5JTZDJTY0JTNGJTND JTJGJTRGJTUwJTU0JTQ5JTRGJTRFJTNFJTBBJTNDJTRGJTUwJTU0JTQ5JTRGJTRFJTIwJTc2JTYx JTZDJTc1JTY1JTNEJTIyJTU3JTY4JTYxJTc0JTIwJTY5JTczJTIwJTZEJTc5JTIwJTZEJTZGJTc0 JTY4JTY1JTcyJTI3JTczJTIwJTZEJTY5JTY0JTY0JTZDJTY1JTIwJTZFJTYxJTZEJTY1JTNGJTIy JTNFJTU3JTY4JTYxJTc0JTIwJTY5JTczJTIwJTZEJTc5JTIwJTZEJTZGJTc0JTY4JTY1JTcyJTI3 JTczJTIwJTZEJTY5JTY0JTY0JTZDJTY1JTIwJTZFJTYxJTZEJTY1JTNGJTNDJTJGJTRGJTUwJTU0 JTQ5JTRGJTRFJTNFJTBBJTNDJTRGJTUwJTU0JTQ5JTRGJTRFJTIwJTc2JTYxJTZDJTc1JTY1JTNE JTIyJTQ5JTZFJTIwJTc3JTY4JTY5JTYzJTY4JTIwJTc5JTY1JTYxJTcyJTIwJTY0JTY5JTY0JTIw JTQ5JTIwJTZEJTY1JTY1JTc0JTIwJTZEJTc5JTIwJTczJTY5JTY3JTZFJTY5JTY2JTY5JTYzJTYx JTZFJTc0JTIwJTZGJTc0JTY4JTY1JTcyJTNGJTIyJTNFJTQ5JTZFJTIwJTc3JTY4JTY5JTYzJTY4 JTIwJTc5JTY1JTYxJTcyJTIwJTY0JTY5JTY0JTIwJTQ5JTIwJTZEJTY1JTY1JTc0JTIwJTZEJTc5 JTIwJTczJTY5JTY3JTZFJTY5JTY2JTY5JTYzJTYxJTZFJTc0JTIwJTZGJTc0JTY4JTY1JTcyJTNG JTNDJTJGJTRGJTUwJTU0JTQ5JTRGJTRFJTNFJTBBJTNDJTRGJTUwJTU0JTQ5JTRGJTRFJTIwJTc2 JTYxJTZDJTc1JTY1JTNEJTIyJTU3JTY4JTYxJTc0JTIwJTc3JTYxJTczJTIwJTZEJTc5JTIwJTY2 JTY5JTcyJTczJTc0JTIwJTcwJTY1JTc0JTI3JTczJTIwJTZFJTYxJTZEJTY1JTNGJTIyJTNFJTU3 JTY4JTYxJTc0JTIwJTc3JTYxJTczJTIwJTZEJTc5JTIwJTY2JTY5JTcyJTczJTc0JTIwJTcwJTY1 JTc0JTI3JTczJTIwJTZFJTYxJTZEJTY1JTNGJTNDJTJGJTRGJTUwJTU0JTQ5JTRGJTRFJTNFJTBB JTNDJTRGJTUwJTU0JTQ5JTRGJTRFJTIwJTc2JTYxJTZDJTc1JTY1JTNEJTIyJTQ2JTY5JTcyJTcz JTc0JTIwJTZFJTYxJTZEJTY1JTIwJTZGJTY2JTIwJTc0JTY4JTY1JTIwJTZEJTYxJTY5JTY0JTIw JTZGJTY2JTIwJTY4JTZGJTZFJTZGJTc1JTcyJTIwJTYxJTc0JTIwJTZEJTc5JTIwJTc3JTY1JTY0 JTY0JTY5JTZFJTY3JTNGJTIyJTNFJTQ2JTY5JTcyJTczJTc0JTIwJTZFJTYxJTZEJTY1JTIwJTZG JTY2JTIwJTc0JTY4JTY1JTIwJTZEJTYxJTY5JTY0JTIwJTZGJTY2JTIwJTY4JTZGJTZFJTZGJTc1 JTcyJTIwJTYxJTc0JTIwJTZEJTc5JTIwJTc3JTY1JTY0JTY0JTY5JTZFJTY3JTNGJTNDJTJGJTRG JTUwJTU0JTQ5JTRGJTRFJTNFJTBBJTNDJTRGJTUwJTU0JTQ5JTRGJTRFJTIwJTc2JTYxJTZDJTc1 JTY1JTNEJTIyJTQ2JTY5JTcyJTczJTc0JTIwJTZFJTYxJTZEJTY1JTIwJTZGJTY2JTIwJTZEJTc5 JTIwJTYyJTY1JTczJTc0JTIwJTY2JTcyJTY5JTY1JTZFJTY0JTIwJTY5JTZFJTIwJTY1JTZDJTY1 JTZEJTY1JTZFJTc0JTYxJTcyJTc5JTIwJTczJTYzJTY4JTZGJTZGJTZDJTNGJTIyJTNFJTQ2JTY5 JTcyJTczJTc0JTIwJTZFJTYxJTZEJTY1JTIwJTZGJTY2JTIwJTZEJTc5JTIwJTYyJTY1JTczJTc0 JTIwJTY2JTcyJTY5JTY1JTZFJTY0JTIwJTY5JTZFJTIwJTY1JTZDJTY1JTZEJTY1JTZFJTc0JTYx JTcyJTc5JTIwJTczJTYzJTY4JTZGJTZGJTZDJTNGJTNDJTJGJTRGJTUwJTU0JTQ5JTRGJTRFJTNF JTBBJTNDJTRGJTUwJTU0JTQ5JTRGJTRFJTIwJTc2JTYxJTZDJTc1JTY1JTNEJTIyJTQzJTcyJTY1 JTYxJTc0JTY1JTIwJTc5JTZGJTc1JTcyJTIwJTZGJTc3JTZFJTIwJTczJTY1JTYzJTc1JTcyJTY5 JTc0JTc5JTIwJTcxJTc1JTY1JTczJTc0JTY5JTZGJTZFJTNGJTIyJTNFJTQzJTcyJTY1JTYxJTc0 JTY1JTIwJTc5JTZGJTc1JTcyJTIwJTZGJTc3JTZFJTIwJTczJTY1JTYzJTc1JTcyJTY5JTc0JTc5 JTIwJTcxJTc1JTY1JTczJTc0JTY5JTZGJTZFJTNDJTJGJTRGJTUwJTU0JTQ5JTRGJTRFJTNFJTBB JTNDJTJGJTczJTY1JTZDJTY1JTYzJTc0JTNFJTBBJTA5JTA5JTA5JTA5JTNDJTJGJTY0JTY5JTc2 JTNFJTBBJTBBJTA5JTA5JTA5JTA5JTNDJTczJTcwJTYxJTZFJTIwJTYzJTZDJTYxJTczJTczJTNE JTIyJTY2JTY5JTY1JTZDJTY0JTJEJTc2JTYxJTZDJTY5JTY0JTYxJTc0JTY5JTZGJTZFJTJEJTc2 JTYxJTZDJTY5JTY0JTIyJTIwJTY0JTYxJTc0JTYxJTJEJTc2JTYxJTZDJTZEJTczJTY3JTJEJTY2 JTZGJTcyJTNEJTIyJTZEJTZGJTY0JTY1JTZDJTJFJTU0JTY5JTc0JTZDJTY1JTIyJTIwJTY0JTYx JTc0JTYxJTJEJTc2JTYxJTZDJTZEJTczJTY3JTJEJTcyJTY1JTcwJTZDJTYxJTYzJTY1JTNEJTIy JTc0JTcyJTc1JTY1JTIyJTNFJTNDJTJGJTczJTcwJTYxJTZFJTNFJTBBJTBBJTA5JTA5JTA5JTA5 JTNDJTY0JTY5JTc2JTNFJTBBJTA5JTA5JTA5JTA5JTA5JTNDJTZDJTYxJTYyJTY1JTZDJTIwJTY2 JTZGJTcyJTNEJTIyJTZEJTZGJTY0JTY1JTZDJTVGJTREJTY5JTY0JTY0JTZDJTY1JTRFJTYxJTZE JTY1JTIyJTNFJTQxJTZFJTczJTc3JTY1JTcyJTIwJTM0JTNDJTJGJTZDJTYxJTYyJTY1JTZDJTNF JTIwJTIwJTNDJTYyJTNFJTNDJTY2JTZGJTZFJTc0JTIwJTYzJTZGJTZDJTZGJTcyJTNEJTIyJTcy JTY1JTY0JTIyJTNFJTJBJTNDJTJGJTY2JTZGJTZFJTc0JTNFJTNDJTJGJTYyJTNFJTBBJTA5JTA5 JTA5JTA5JTA5JTNDJTY5JTZFJTcwJTc1JTc0JTIwJTY0JTYxJTc0JTYxJTJEJTc2JTYxJTZDJTNE JTIyJTc0JTcyJTc1JTY1JTIyJTIwJTY0JTYxJTc0JTYxJTJEJTc2JTYxJTZDJTJEJTZDJTY1JTZF JTY3JTc0JTY4JTNEJTIyJTU0JTY4JTY1JTIwJTY2JTY5JTY1JTZDJTY0JTIwJTREJTY5JTY0JTY0 JTZDJTY1JTIwJTRFJTYxJTZEJTY1JTIwJTZEJTc1JTczJTc0JTIwJTYyJTY1JTIwJTYxJTIwJTcz JTc0JTcyJTY5JTZFJTY3JTIwJTc3JTY5JTc0JTY4JTIwJTYxJTIwJTZEJTYxJTc4JTY5JTZEJTc1 JTZEJTIwJTZDJTY1JTZFJTY3JTc0JTY4JTIwJTZGJTY2JTIwJTMzJTM1JTJFJTIyJTIwJTY0JTYx JTc0JTYxJTJEJTc2JTYxJTZDJTJEJTZDJTY1JTZFJTY3JTc0JTY4JTJEJTZEJTYxJTc4JTNEJTIy JTMzJTM1JTIyJTIwJTY5JTY0JTNEJTIyJTZEJTZGJTY0JTY1JTZDJTVGJTREJTY5JTY0JTY0JTZD JTY1JTRFJTYxJTZEJTY1JTIyJTIwJTZFJTYxJTZEJTY1JTNEJTIyJTREJTY5JTY0JTY0JTZDJTY1 JTRFJTYxJTZEJTY1JTIyJTIwJTc0JTc5JTcwJTY1JTNEJTIyJTcwJTYxJTczJTczJTc3JTZGJTcy JTY0JTIyJTIwJTc2JTYxJTZDJTc1JTY1JTNEJTIyJTIyJTIwJTcyJTY1JTcxJTc1JTY5JTcyJTY1 JTY0JTJGJTNFJTBBJTA5JTA5JTA5JTA5JTNDJTJGJTY0JTY5JTc2JTNFJTBBJTA5JTA5JTA5JTA5 JTNDJTczJTcwJTYxJTZFJTIwJTYzJTZDJTYxJTczJTczJTNEJTIyJTY2JTY5JTY1JTZDJTY0JTJE JTc2JTYxJTZDJTY5JTY0JTYxJTc0JTY5JTZGJTZFJTJEJTc2JTYxJTZDJTY5JTY0JTIyJTIwJTY0 JTYxJTc0JTYxJTJEJTc2JTYxJTZDJTZEJTczJTY3JTJEJTY2JTZGJTcyJTNEJTIyJTREJTY5JTY0 JTY0JTZDJTY1JTRFJTYxJTZEJTY1JTIyJTIwJTY0JTYxJTc0JTYxJTJEJTc2JTYxJTZDJTZEJTcz JTY3JTJEJTcyJTY1JTcwJTZDJTYxJTYzJTY1JTNEJTIyJTc0JTcyJTc1JTY1JTIyJTNFJTNDJTJG JTczJTcwJTYxJTZFJTNFJTBBJTBBJTA5JTA5JTA5JTA5JTNDJTY0JTY5JTc2JTNFJTBBJTA5JTA5 JTA5JTA5JTA5JTNDJTZDJTYxJTYyJTY1JTZDJTIwJTY2JTZGJTcyJTNEJTIyJTZEJTZGJTY0JTY1 JTZDJTVGJTU0JTY5JTc0JTZDJTY1JTIyJTNFJTUxJTc1JTY1JTczJTc0JTY5JTZGJTZFJTIwJTM1 JTNDJTJGJTZDJTYxJTYyJTY1JTZDJTNFJTIwJTIwJTNDJTYyJTNFJTNDJTY2JTZGJTZFJTc0JTIw JTYzJTZGJTZDJTZGJTcyJTNEJTIyJTcyJTY1JTY0JTIyJTNFJTJBJTNDJTJGJTY2JTZGJTZFJTc0 JTNFJTNDJTJGJTYyJTNFJTBBJTA5JTA5JTA5JTA5JTA5JTNDJTczJTY1JTZDJTY1JTYzJTc0JTIw JTY5JTY0JTNEJTIyJTZEJTZGJTY0JTY1JTZDJTVGJTU0JTY5JTc0JTZDJTY1JTIyJTIwJTZFJTYx JTZEJTY1JTNEJTIyJTcxJTc1JTY1JTczJTc0JTY5JTZGJTZFJTM1JTIyJTIwJTczJTc0JTc5JTZD JTY1JTNEJTIyJTc3JTY5JTY0JTc0JTY4JTNBJTM0JTMwJTMwJTcwJTc4JTNCJTIwJTIyJTIwJTcy JTY1JTcxJTc1JTY5JTcyJTY1JTY0JTJGJTNFJTBBJTNDJTZGJTcwJTc0JTY5JTZGJTZFJTIwJTc2 JTYxJTZDJTc1JTY1JTNEJTIyJTJEJTMxJTIyJTIwJTczJTY1JTZDJTY1JTYzJTc0JTY1JTY0JTNF JTJEJTIwJTUzJTY1JTZDJTY1JTYzJTc0JTIwJTJEJTNDJTJGJTZGJTcwJTc0JTY5JTZGJTZFJTNF JTBBJTNDJTRGJTUwJTU0JTQ5JTRGJTRFJTIwJTc2JTYxJTZDJTc1JTY1JTNEJTIyJTRFJTYxJTZE JTY1JTIwJTZGJTY2JTIwJTZEJTc5JTIwJTYxJTZDJTZDJTJEJTc0JTY5JTZEJTY1JTIwJTY2JTYx JTc2JTZGJTc1JTcyJTY5JTc0JTY1JTIwJTZEJTZGJTc2JTY5JTY1JTIwJTYzJTY4JTYxJTcyJTYx JTYzJTc0JTY1JTcyJTNGJTIyJTNFJTRFJTYxJTZEJTY1JTIwJTZGJTY2JTIwJTZEJTc5JTIwJTYx JTZDJTZDJTJEJTc0JTY5JTZEJTY1JTIwJTY2JTYxJTc2JTZGJTc1JTcyJTY5JTc0JTY1JTIwJTZE JTZGJTc2JTY5JTY1JTIwJTYzJTY4JTYxJTcyJTYxJTYzJTc0JTY1JTcyJTNGJTNDJTJGJTRGJTUw JTU0JTQ5JTRGJTRFJTNFJTBBJTNDJTRGJTUwJTU0JTQ5JTRGJTRFJTIwJTc2JTYxJTZDJTc1JTY1 JTNEJTIyJTU3JTY4JTYxJTc0JTIwJTc3JTYxJTczJTIwJTc0JTY4JTY1JTIwJTY2JTY5JTcyJTcz JTc0JTIwJTZEJTZGJTc2JTY5JTY1JTIwJTQ5JTIwJTY1JTc2JTY1JTcyJTIwJTczJTYxJTc3JTNG JTIyJTNFJTU3JTY4JTYxJTc0JTIwJTc3JTYxJTczJTIwJTc0JTY4JTY1JTIwJTY2JTY5JTcyJTcz JTc0JTIwJTZEJTZGJTc2JTY5JTY1JTIwJTQ5JTIwJTY1JTc2JTY1JTcyJTIwJTczJTYxJTc3JTNG JTNDJTJGJTRGJTUwJTU0JTQ5JTRGJTRFJTNFJTBBJTNDJTRGJTUwJTU0JTQ5JTRGJTRFJTIwJTc2 JTYxJTZDJTc1JTY1JTNEJTIyJTU3JTY4JTYxJTc0JTIwJTY5JTczJTIwJTc0JTY4JTY1JTIwJTZE JTY5JTY0JTY0JTZDJTY1JTIwJTZFJTYxJTZEJTY1JTIwJTZGJTY2JTIwJTZEJTc5JTIwJTZGJTZD JTY0JTY1JTczJTc0JTIwJTYzJTY4JTY5JTZDJTY0JTNGJTIyJTNFJTU3JTY4JTYxJTc0JTIwJTY5 JTczJTIwJTc0JTY4JTY1JTIwJTZEJTY5JTY0JTY0JTZDJTY1JTIwJTZFJTYxJTZEJTY1JTIwJTZG JTY2JTIwJTZEJTc5JTIwJTZGJTZDJTY0JTY1JTczJTc0JTIwJTYzJTY4JTY5JTZDJTY0JTNGJTND JTJGJTRGJTUwJTU0JTQ5JTRGJTRFJTNFJTBBJTNDJTRGJTUwJTU0JTQ5JTRGJTRFJTIwJTc2JTYx JTZDJTc1JTY1JTNEJTIyJTQ5JTZFJTIwJTc3JTY4JTY5JTYzJTY4JTIwJTYzJTY5JTc0JTc5JTJG JTc0JTZGJTc3JTZFJTIwJTc3JTYxJTczJTIwJTZEJTc5JTIwJTY2JTYxJTc0JTY4JTY1JTcyJTIw JTYyJTZGJTcyJTZFJTNGJTIyJTNFJTQ5JTZFJTIwJTc3JTY4JTY5JTYzJTY4JTIwJTYzJTY5JTc0 JTc5JTJGJTc0JTZGJTc3JTZFJTIwJTc3JTYxJTczJTIwJTZEJTc5JTIwJTY2JTYxJTc0JTY4JTY1 JTcyJTIwJTYyJTZGJTcyJTZFJTNGJTNDJTJGJTRGJTUwJTU0JTQ5JTRGJTRFJTNFJTBBJTNDJTRG JTUwJTU0JTQ5JTRGJTRFJTIwJTc2JTYxJTZDJTc1JTY1JTNEJTIyJTU3JTY4JTZGJTIwJTc3JTYx JTczJTIwJTZEJTc5JTIwJTY2JTYxJTc2JTZGJTc1JTcyJTY5JTc0JTY1JTIwJTYzJTYxJTcyJTc0 JTZGJTZGJTZFJTIwJTYzJTY4JTYxJTcyJTYxJTYzJTc0JTY1JTcyJTIwJTYxJTczJTIwJTYxJTIw JTYzJTY4JTY5JTZDJTY0JTNGJTIyJTNFJTU3JTY4JTZGJTIwJTc3JTYxJTczJTIwJTZEJTc5JTIw JTY2JTYxJTc2JTZGJTc1JTcyJTY5JTc0JTY1JTIwJTYzJTYxJTcyJTc0JTZGJTZGJTZFJTIwJTYz JTY4JTYxJTcyJTYxJTYzJTc0JTY1JTcyJTIwJTYxJTczJTIwJTYxJTIwJTYzJTY4JTY5JTZDJTY0 JTNGJTNDJTJGJTRGJTUwJTU0JTQ5JTRGJTRFJTNFJTBBJTNDJTRGJTUwJTU0JTQ5JTRGJTRFJTIw JTc2JTYxJTZDJTc1JTY1JTNEJTIyJTU3JTY4JTYxJTc0JTIwJTY5JTczJTIwJTZEJTc5JTIwJTZE JTZGJTc0JTY4JTY1JTcyJTI3JTczJTIwJTZEJTY5JTY0JTY0JTZDJTY1JTIwJTZFJTYxJTZEJTY1 JTNGJTIyJTNFJTU3JTY4JTYxJTc0JTIwJTY5JTczJTIwJTZEJTc5JTIwJTZEJTZGJTc0JTY4JTY1 JTcyJTI3JTczJTIwJTZEJTY5JTY0JTY0JTZDJTY1JTIwJTZFJTYxJTZEJTY1JTNGJTNDJTJGJTRG JTUwJTU0JTQ5JTRGJTRFJTNFJTBBJTNDJTRGJTUwJTU0JTQ5JTRGJTRFJTIwJTc2JTYxJTZDJTc1 JTY1JTNEJTIyJTQ5JTZFJTIwJTc3JTY4JTY5JTYzJTY4JTIwJTc5JTY1JTYxJTcyJTIwJTY0JTY5 JTY0JTIwJTQ5JTIwJTZEJTY1JTY1JTc0JTIwJTZEJTc5JTIwJTczJTY5JTY3JTZFJTY5JTY2JTY5 JTYzJTYxJTZFJTc0JTIwJTZGJTc0JTY4JTY1JTcyJTNGJTIyJTNFJTQ5JTZFJTIwJTc3JTY4JTY5 JTYzJTY4JTIwJTc5JTY1JTYxJTcyJTIwJTY0JTY5JTY0JTIwJTQ5JTIwJTZEJTY1JTY1JTc0JTIw JTZEJTc5JTIwJTczJTY5JTY3JTZFJTY5JTY2JTY5JTYzJTYxJTZFJTc0JTIwJTZGJTc0JTY4JTY1 JTcyJTNGJTNDJTJGJTRGJTUwJTU0JTQ5JTRGJTRFJTNFJTBBJTNDJTRGJTUwJTU0JTQ5JTRGJTRF JTIwJTc2JTYxJTZDJTc1JTY1JTNEJTIyJTU3JTY4JTYxJTc0JTIwJTc3JTYxJTczJTIwJTZEJTc5 JTIwJTY2JTY5JTcyJTczJTc0JTIwJTcwJTY1JTc0JTI3JTczJTIwJTZFJTYxJTZEJTY1JTNGJTIy JTNFJTU3JTY4JTYxJTc0JTIwJTc3JTYxJTczJTIwJTZEJTc5JTIwJTY2JTY5JTcyJTczJTc0JTIw JTcwJTY1JTc0JTI3JTczJTIwJTZFJTYxJTZEJTY1JTNGJTNDJTJGJTRGJTUwJTU0JTQ5JTRGJTRF JTNFJTBBJTNDJTRGJTUwJTU0JTQ5JTRGJTRFJTIwJTc2JTYxJTZDJTc1JTY1JTNEJTIyJTQ2JTY5 JTcyJTczJTc0JTIwJTZFJTYxJTZEJTY1JTIwJTZGJTY2JTIwJTc0JTY4JTY1JTIwJTZEJTYxJTY5 JTY0JTIwJTZGJTY2JTIwJTY4JTZGJTZFJTZGJTc1JTcyJTIwJTYxJTc0JTIwJTZEJTc5JTIwJTc3 JTY1JTY0JTY0JTY5JTZFJTY3JTNGJTIyJTNFJTQ2JTY5JTcyJTczJTc0JTIwJTZFJTYxJTZEJTY1 JTIwJTZGJTY2JTIwJTc0JTY4JTY1JTIwJTZEJTYxJTY5JTY0JTIwJTZGJTY2JTIwJTY4JTZGJTZF JTZGJTc1JTcyJTIwJTYxJTc0JTIwJTZEJTc5JTIwJTc3JTY1JTY0JTY0JTY5JTZFJTY3JTNGJTND JTJGJTRGJTUwJTU0JTQ5JTRGJTRFJTNFJTBBJTNDJTRGJTUwJTU0JTQ5JTRGJTRFJTIwJTc2JTYx JTZDJTc1JTY1JTNEJTIyJTQ2JTY5JTcyJTczJTc0JTIwJTZFJTYxJTZEJTY1JTIwJTZGJTY2JTIw JTZEJTc5JTIwJTYyJTY1JTczJTc0JTIwJTY2JTcyJTY5JTY1JTZFJTY0JTIwJTY5JTZFJTIwJTY1 JTZDJTY1JTZEJTY1JTZFJTc0JTYxJTcyJTc5JTIwJTczJTYzJTY4JTZGJTZGJTZDJTNGJTIyJTNF JTQ2JTY5JTcyJTczJTc0JTIwJTZFJTYxJTZEJTY1JTIwJTZGJTY2JTIwJTZEJTc5JTIwJTYyJTY1 JTczJTc0JTIwJTY2JTcyJTY5JTY1JTZFJTY0JTIwJTY5JTZFJTIwJTY1JTZDJTY1JTZEJTY1JTZF JTc0JTYxJTcyJTc5JTIwJTczJTYzJTY4JTZGJTZGJTZDJTNGJTNDJTJGJTRGJTUwJTU0JTQ5JTRG JTRFJTNFJTBBJTNDJTRGJTUwJTU0JTQ5JTRGJTRFJTIwJTc2JTYxJTZDJTc1JTY1JTNEJTIyJTQz JTcyJTY1JTYxJTc0JTY1JTIwJTc5JTZGJTc1JTcyJTIwJTZGJTc3JTZFJTIwJTczJTY1JTYzJTc1 JTcyJTY5JTc0JTc5JTIwJTcxJTc1JTY1JTczJTc0JTY5JTZGJTZFJTNGJTIyJTNFJTQzJTcyJTY1 JTYxJTc0JTY1JTIwJTc5JTZGJTc1JTcyJTIwJTZGJTc3JTZFJTIwJTczJTY1JTYzJTc1JTcyJTY5 JTc0JTc5JTIwJTcxJTc1JTY1JTczJTc0JTY5JTZGJTZFJTNDJTJGJTRGJTUwJTU0JTQ5JTRGJTRF JTNFJTBBJTBBJTBBJTNDJTJGJTczJTY1JTZDJTY1JTYzJTc0JTNFJTBBJTA5JTA5JTA5JTA5JTND JTJGJTY0JTY5JTc2JTNFJTBBJTBBJTA5JTA5JTA5JTA5JTNDJTczJTcwJTYxJTZFJTIwJTYzJTZD JTYxJTczJTczJTNEJTIyJTY2JTY5JTY1JTZDJTY0JTJEJTc2JTYxJTZDJTY5JTY0JTYxJTc0JTY5 JTZGJTZFJTJEJTc2JTYxJTZDJTY5JTY0JTIyJTIwJTY0JTYxJTc0JTYxJTJEJTc2JTYxJTZDJTZE JTczJTY3JTJEJTY2JTZGJTcyJTNEJTIyJTZEJTZGJTY0JTY1JTZDJTJFJTU0JTY5JTc0JTZDJTY1 JTIyJTIwJTY0JTYxJTc0JTYxJTJEJTc2JTYxJTZDJTZEJTczJTY3JTJEJTcyJTY1JTcwJTZDJTYx JTYzJTY1JTNEJTIyJTc0JTcyJTc1JTY1JTIyJTNFJTNDJTJGJTczJTcwJTYxJTZFJTNFJTBBJTBB JTA5JTA5JTA5JTA5JTNDJTY0JTY5JTc2JTNFJTBBJTNDJTZDJTYxJTYyJTY1JTZDJTIwJTY2JTZG JTcyJTNEJTIyJTZEJTZGJTY0JTY1JTZDJTVGJTREJTY5JTY0JTY0JTZDJTY1JTRFJTYxJTZEJTY1 JTIyJTNFJTQxJTZFJTczJTc3JTY1JTcyJTIwJTM1JTNDJTJGJTZDJTYxJTYyJTY1JTZDJTNFJTIw JTIwJTNDJTYyJTNFJTNDJTY2JTZGJTZFJTc0JTIwJTYzJTZGJTZDJTZGJTcyJTNEJTIyJTcyJTY1 JTY0JTIyJTNFJTJBJTNDJTJGJTY2JTZGJTZFJTc0JTNFJTNDJTJGJTYyJTNFJTBBJTA5JTA5JTA5 JTA5JTA5JTNDJTY5JTZFJTcwJTc1JTc0JTIwJTY0JTYxJTc0JTYxJTJEJTc2JTYxJTZDJTNEJTIy JTc0JTcyJTc1JTY1JTIyJTIwJTY0JTYxJTc0JTYxJTJEJTc2JTYxJTZDJTJEJTZDJTY1JTZFJTY3 JTc0JTY4JTNEJTIyJTU0JTY4JTY1JTIwJTY2JTY5JTY1JTZDJTY0JTIwJTREJTY5JTY0JTY0JTZD JTY1JTIwJTRFJTYxJTZEJTY1JTIwJTZEJTc1JTczJTc0JTIwJTYyJTY1JTIwJTYxJTIwJTczJTc0 JTcyJTY5JTZFJTY3JTIwJTc3JTY5JTc0JTY4JTIwJTYxJTIwJTZEJTYxJTc4JTY5JTZEJTc1JTZE JTIwJTZDJTY1JTZFJTY3JTc0JTY4JTIwJTZGJTY2JTIwJTMzJTM1JTJFJTIyJTIwJTY0JTYxJTc0 JTYxJTJEJTc2JTYxJTZDJTJEJTZDJTY1JTZFJTY3JTc0JTY4JTJEJTZEJTYxJTc4JTNEJTIyJTMz JTM1JTIyJTIwJTY5JTY0JTNEJTIyJTZEJTZGJTY0JTY1JTZDJTVGJTREJTY5JTY0JTY0JTZDJTY1 JTRFJTYxJTZEJTY1JTIyJTIwJTZFJTYxJTZEJTY1JTNEJTIyJTRDJTYxJTczJTc0JTRFJTYxJTZE JTY1JTIyJTIwJTc0JTc5JTcwJTY1JTNEJTIyJTcwJTYxJTczJTczJTc3JTZGJTcyJTY0JTIyJTIw JTc2JTYxJTZDJTc1JTY1JTNEJTIyJTIyJTIwJTJGJTNFJTBBJTA5JTA5JTA5JTA5JTNDJTJGJTY0 JTY5JTc2JTNFJTBBJTA5JTA5JTA5JTA5JTNDJTczJTcwJTYxJTZFJTIwJTYzJTZDJTYxJTczJTcz JTNEJTIyJTY2JTY5JTY1JTZDJTY0JTJEJTc2JTYxJTZDJTY5JTY0JTYxJTc0JTY5JTZGJTZFJTJE JTc2JTYxJTZDJTY5JTY0JTIyJTIwJTY0JTYxJTc0JTYxJTJEJTc2JTYxJTZDJTZEJTczJTY3JTJE JTY2JTZGJTcyJTNEJTIyJTRDJTYxJTczJTc0JTRFJTYxJTZEJTY1JTIyJTIwJTY0JTYxJTc0JTYx JTJEJTc2JTYxJTZDJTZEJTczJTY3JTJEJTcyJTY1JTcwJTZDJTYxJTYzJTY1JTNEJTIyJTc0JTcy JTc1JTY1JTIyJTNFJTNDJTJGJTczJTcwJTYxJTZFJTNFJTBBJTBBJTA5JTA5JTA5JTA5JTNDJTY0 JTY5JTc2JTNFJTBBJTA5JTA5JTA5JTNDJTJGJTczJTY1JTYzJTc0JTY5JTZGJTZFJTNFJTBBJTA5 JTBBJTBBJTBBJTA5JTA5JTNDJTJGJTY0JTY5JTc2JTNFJTBBJTA5JTNDJTJGJTczJTY1JTYzJTc0 JTY5JTZGJTZFJTNFJTBBJTA5JTNDJTY0JTY5JTc2JTNFJTBBJTA5JTA5JTNDJTY5JTZFJTcwJTc1 JTc0JTIwJTc0JTc5JTcwJTY1JTNEJTIyJTczJTc1JTYyJTZEJTY5JTc0JTIyJTIwJTc2JTYxJTZD JTc1JTY1JTNEJTIyJTU1JTcwJTY0JTYxJTc0JTY1JTIwJTZEJTc5JTIwJTcwJTcyJTZGJTY2JTY5 JTZDJTY1JTIyJTIwJTJGJTNFJTBBJTA5JTNDJTJGJTY0JTY5JTc2JTNFJTBBJTNDJTJGJTY2JTZG JTcyJTZEJTNFJTBBJTNDJTJGJTY0JTY5JTc2JTNFJTBBJTBBJTBBJTA5JTNDJTY2JTZGJTZGJTc0 JTY1JTcyJTNFJTBBJTA5JTA5JTNDJTY0JTY5JTc2JTIwJTYzJTZDJTYxJTczJTczJTNEJTIyJTYz JTZGJTZFJTc0JTYxJTY5JTZFJTY1JTcyJTIyJTNFJTA5JTBBJTA5JTA5JTA5JTBBJTA5JTA5JTND JTJGJTY0JTY5JTc2JTNFJTBBJTA5JTNDJTJGJTY2JTZGJTZGJTc0JTY1JTcyJTNFJTBBJTBBJTA5 JTNDJTczJTYzJTcyJTY5JTcwJTc0JTIwJTczJTcyJTYzJTNEJTIyJTY4JTc0JTc0JTcwJTczJTNB JTJGJTJGJTczJTY1JTYzJTc1JTcyJTY1JTJFJTZBJTZFJTYzJTYyJTJFJTYzJTZGJTZEJTJGJTcw JTYzJTYxJTczJTJGJTUzJTYzJTcyJTY5JTcwJTc0JTczJTJGJTZBJTcxJTc1JTY1JTcyJTc5JTJE JTMyJTJFJTMxJTJFJTMwJTJFJTZEJTY5JTZFJTJFJTZBJTczJTIyJTNFJTNDJTJGJTczJTYzJTcy JTY5JTcwJTc0JTNFJTBBJTA5JTNDJTczJTYzJTcyJTY5JTcwJTc0JTIwJTczJTcyJTYzJTNEJTIy JTY4JTc0JTc0JTcwJTczJTNBJTJGJTJGJTczJTY1JTYzJTc1JTcyJTY1JTJFJTZBJTZFJTYzJTYy JTJFJTYzJTZGJTZEJTJGJTcwJTYzJTYxJTczJTJGJTUzJTYzJTcyJTY5JTcwJTc0JTczJTJGJTZB JTcxJTc1JTY1JTcyJTc5JTJFJTc2JTYxJTZDJTY5JTY0JTYxJTc0JTY1JTJFJTZEJTY5JTZFJTJF JTZBJTczJTIyJTNFJTNDJTJGJTczJTYzJTcyJTY5JTcwJTc0JTNFJTBBJTA5JTNDJTczJTYzJTcy JTY5JTcwJTc0JTIwJTczJTcyJTYzJTNEJTIyJTY4JTc0JTc0JTcwJTczJTNBJTJGJTJGJTczJTY1 JTYzJTc1JTcyJTY1JTJFJTZBJTZFJTYzJTYyJTJFJTYzJTZGJTZEJTJGJTcwJTYzJTYxJTczJTJG JTUzJTYzJTcyJTY5JTcwJTc0JTczJTJGJTZBJTcxJTc1JTY1JTcyJTc5JTJFJTc2JTYxJTZDJTY5 JTY0JTYxJTc0JTY1JTJFJTc1JTZFJTZGJTYyJTc0JTcyJTc1JTczJTY5JTc2JTY1JTJFJTZEJTY5 JTZFJTJFJTZBJTczJTIyJTNFJTNDJTJGJTczJTYzJTcyJTY5JTcwJTc0JTNFJTBBJTA5JTNDJTcz JTYzJTcyJTY5JTcwJTc0JTIwJTczJTcyJTYzJTNEJTIyJTY4JTc0JTc0JTcwJTczJTNBJTJGJTJG JTczJTY1JTYzJTc1JTcyJTY1JTJFJTZBJTZFJTYzJTYyJTJFJTYzJTZGJTZEJTJGJTcwJTYzJTYx JTczJTJGJTUzJTYzJTcyJTY5JTcwJTc0JTczJTJGJTZBJTcxJTc1JTY1JTcyJTc5JTJEJTc1JTY5 JTJEJTMxJTJFJTMxJTMwJTJFJTMzJTJFJTYzJTc1JTczJTc0JTZGJTZEJTJFJTZEJTY5JTZFJTJF JTZBJTczJTIyJTNFJTNDJTJGJTczJTYzJTcyJTY5JTcwJTc0JTNFJTBBJTA5JTNDJTczJTYzJTcy JTY5JTcwJTc0JTIwJTczJTcyJTYzJTNEJTIyJTY4JTc0JTc0JTcwJTczJTNBJTJGJTJGJTczJTY1 JTYzJTc1JTcyJTY1JTJFJTZBJTZFJTYzJTYyJTJFJTYzJTZGJTZEJTJGJTcwJTYzJTYxJTczJTJG JTUzJTYzJTcyJTY5JTcwJTc0JTczJTJGJTZBJTcxJTc1JTY1JTcyJTc5JTJFJTczJTY5JTZEJTcw JTZDJTY1JTZEJTZGJTY0JTYxJTZDJTJFJTMxJTJFJTM0JTJFJTM0JTJFJTZEJTY5JTZFJTJFJTZB JTczJTIyJTNFJTNDJTJGJTczJTYzJTcyJTY5JTcwJTc0JTNFJTBBJTA5JTNDJTczJTYzJTcyJTY5 JTcwJTc0JTIwJTczJTcyJTYzJTNEJTIyJTY4JTc0JTc0JTcwJTczJTNBJTJGJTJGJTczJTY1JTYz JTc1JTcyJTY1JTJFJTZBJTZFJTYzJTYyJTJFJTYzJTZGJTZEJTJGJTcwJTYzJTYxJTczJTJGJTUz JTYzJTcyJTY5JTcwJTc0JTczJTJGJTZBJTcxJTc1JTY1JTcyJTc5JTJFJTczJTYzJTcyJTZGJTZD JTZDJTU0JTZGJTJFJTZEJTY5JTZFJTJFJTZBJTczJTIyJTNFJTNDJTJGJTczJTYzJTcyJTY5JTcw JTc0JTNFJTBBJTA5JTNDJTczJTYzJTcyJTY5JTcwJTc0JTIwJTczJTcyJTYzJTNEJTIyJTY4JTc0 JTc0JTcwJTczJTNBJTJGJTJGJTczJTY1JTYzJTc1JTcyJTY1JTJFJTZBJTZFJTYzJTYyJTJFJTYz JTZGJTZEJTJGJTcwJTYzJTYxJTczJTJGJTUzJTYzJTcyJTY5JTcwJTc0JTczJTJGJTcwJTYzJTYx JTczJTJEJTYzJTZGJTZEJTZEJTZGJTZFJTJFJTZBJTczJTIyJTNFJTNDJTJGJTczJTYzJTcyJTY5 JTcwJTc0JTNFJTBBJTA5JTNDJTczJTYzJTcyJTY5JTcwJTc0JTIwJTczJTcyJTYzJTNEJTIyJTY4 JTc0JTc0JTcwJTczJTNBJTJGJTJGJTczJTY1JTYzJTc1JTcyJTY1JTJFJTZBJTZFJTYzJTYyJTJF JTYzJTZGJTZEJTJGJTcwJTYzJTYxJTczJTJGJTUzJTYzJTcyJTY5JTcwJTc0JTczJTJGJTcwJTYz JTYxJTczJTJEJTZBJTcxJTc1JTY1JTcyJTc5JTJEJTY1JTc4JTc0JTY1JTZFJTczJTY5JTZGJTZF JTczJTJFJTZBJTczJTIyJTNFJTNDJTJGJTczJTYzJTcyJTY5JTcwJTc0JTNFJTBBJTBBJTA5JTBB JTA5JTBBJTBBJTBBJTNDJTJGJTYyJTZGJTY0JTc5JTNFJTBBJTNDJTJGJTY4JTc0JTZEJTZDJTNF JTBBIikpOzwvc2NyaXB0Pg== --1aUZN3Uu9XIRr=_BaoVA1K6z3kBzLJpqDg0-- From owner-freebsd-stable@freebsd.org Thu Apr 19 15:23:28 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6126FF83989 for ; Thu, 19 Apr 2018 15:23:28 +0000 (UTC) (envelope-from lousie.thomas@mypioneersolutions.com) Received: from mail-io0-x245.google.com (mail-io0-x245.google.com [IPv6:2607:f8b0:4001:c06::245]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id DB4CC6CA6E for ; Thu, 19 Apr 2018 15:23:27 +0000 (UTC) (envelope-from lousie.thomas@mypioneersolutions.com) Received: by mail-io0-x245.google.com with SMTP id f6-v6so3804711ioc.1 for ; Thu, 19 Apr 2018 08:23:27 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=mypioneersolutions-com.20150623.gappssmtp.com; s=20150623; h=mime-version:message-id:date:subject:from:to; bh=z1Y+L9LdfHnw2WoNfL4sGuKDteIEo0ODuLIb+wnZPo8=; b=vDf7e71CJ/Eph7m8OgUe1oDO0a0HHcZCEiAZQAC1/jUYelbRmqV95qlsA2qLE/XG4G Y5VEQqp9CVl0f/l9jPZgFtAYuTD7KZcD5QBNbbiiYQyITAy6otIyw0fF+MFN6LoSEXGr brZAIk5q72IiFbxtFVIA6fyr81wsjl+rRGvvxy/FJEmVXeE+vQY4PFZRzQQJLpAgMEH0 ybUqcR8dTPArOwIVZP9QFGhsj5M32bmRoxPuKAJ4qLPuMfH0I5PRXhGX8UAkSYIpVqPa 1BRhxjyQeVmn126tf6/NDeRXJjAvzdBLet6guz3/rf8gUX47sT6GbTBVCom41e+7Qyib M+VA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:message-id:date:subject:from:to; bh=z1Y+L9LdfHnw2WoNfL4sGuKDteIEo0ODuLIb+wnZPo8=; b=PrvOvacDgCfLYRypEg6L9/lerlO5u2+b/TfdWr/J69TQVfC+ghJxAL2DrJMrNofhSh nwfIjh/Qd6dEnG8nNEzRdFlNdGp1YzCt4qiVHz11exY2Df7HAoAaKQ2KlWoe2n7yQryc MifwHtX6AAMYX3UqMsDuUYJwGm8arvfWev+Yd/iG8huLay0ciH/01pnRMLI9cNNqARGr ELwtEBsz+pZyrgZ2AweADY1ZDYLnWezuuMjDiscXyVi1pL/pSo+eEw4wzGvXL/SjHMjS ipBVvyxXt4FyKK0wRJRnl3KXS2Ufa5yIbxWH/LVe1//MvLTN5SsBXn/VRxxFKUo9dnlN dtsg== X-Gm-Message-State: ALQs6tAj8gZ1sIBrN3BvxdxUyhz3rUVyqdDJRi9j9xp8TX5GTkgXrTb2 0lc2lozgNh4GZZksRvr7HUDgcwRm4cRn X-Google-Smtp-Source: AB8JxZr+2idYCJ5T0RG+71yRMtyt4ZOTXX1NtYU6XG2K/gHaVtdNJ5yvtym0Q996Wyeckek827x+bSZq3w== MIME-Version: 1.0 X-Received: by 2002:a6b:d405:: with SMTP id l5-v6mr1051658iog.70.1524151407301; Thu, 19 Apr 2018 08:23:27 -0700 (PDT) Message-ID: <000000000000375f25056a352714@google.com> Date: Thu, 19 Apr 2018 15:23:27 +0000 Subject: Updated IBM Agile Users List From: lousie.thomas@mypioneersolutions.com To: freebsd-stable@freebsd.org Content-Type: text/plain; charset="UTF-8"; format=flowed; delsp=yes Content-Transfer-Encoding: base64 X-Content-Filtered-By: Mailman/MimeDel 2.1.25 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 19 Apr 2018 15:23:28 -0000 PGRpdiBkaXI9Imx0ciI+DQoNCg0KDQoNCg0KDQoNCg0KDQoNCg0KDQoNCg0KDQoNCg0KDQo8cCBj bGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibWFyZ2luOjBpbiAwaW4gIA0KMC4wMDAxcHQ7Zm9udC1z aXplOjExcHQ7Zm9udC1mYW1pbHk6Q2FsaWJyaSxzYW5zLXNlcmlmIj48c3BhbiAgDQpzdHlsZT0i Y29sb3I6cmdiKDAsMzIsOTYpIj5IaSw8c3Bhbj48L3NwYW4+PC9zcGFuPjwvcD4NCg0KPHAgY2xh c3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1hcmdpbjowaW4gMGluICANCjAuMDAwMXB0O2ZvbnQtc2l6 ZToxMXB0O2ZvbnQtZmFtaWx5OkNhbGlicmksc2Fucy1zZXJpZiI+PHNwYW4gIA0Kc3R5bGU9ImNv bG9yOnJnYigwLDMyLDk2KSI+PHNwYW4+wqA8L3NwYW4+PC9zcGFuPjwvcD4NCg0KPHAgY2xhc3M9 Ik1zb05vcm1hbCIgc3R5bGU9Im1hcmdpbjowaW4gMGluICANCjAuMDAwMXB0O2ZvbnQtc2l6ZTox MXB0O2ZvbnQtZmFtaWx5OkNhbGlicmksc2Fucy1zZXJpZiI+PHNwYW4gIA0Kc3R5bGU9ImNvbG9y OnJnYigwLDMyLDk2KSI+V291bGQgeW91IGJlIGludGVyZXN0ZWQgaW4NCmFjcXVpcmluZ8Kgb3Vy IHJlY2VudGx5IHVwZGF0ZWQgPGI+SUJNIEFnaWxlIFVzZXJzIExpc3Q8L2I+wqBmb3INCm1hcmtl dGluZyBvciBlbWFpbCBjYW1wYWlnbj88YnI+DQo8YnI+DQo8Yj5EYXRhIEZpZWxkczwvYj46IE5h bWUsIENvbXBhbnkmIzM5O3MgTmFtZSwgUGhvbmUgTnVtYmVyLCBKb2IgVGl0bGUsICANCkVtYWls IGFkZHJlc3MsDQpDb21wbGV0ZSBNYWlsaW5nIGFkZHJlc3MsIENvbXBhbnkgcmV2ZW51ZSwgc2l6 ZSwgV2ViIGFkZHJlc3MgIA0KZXRjLjxzcGFuPjwvc3Bhbj48L3NwYW4+PC9wPg0KDQo8cCBjbGFz cz0iTXNvTm9ybWFsIiBzdHlsZT0ibWFyZ2luOjBpbiAwaW4gIA0KMC4wMDAxcHQ7Zm9udC1zaXpl OjExcHQ7Zm9udC1mYW1pbHk6Q2FsaWJyaSxzYW5zLXNlcmlmIj48c3BhbiAgDQpzdHlsZT0iY29s b3I6cmdiKDAsMzIsOTYpIj7CoDxzcGFuPjwvc3Bhbj48L3NwYW4+PC9wPg0KDQo8cCBjbGFzcz0i TXNvTm9ybWFsIiBzdHlsZT0ibWFyZ2luOjBpbiAwaW4gIA0KMC4wMDAxcHQ7Zm9udC1zaXplOjEx cHQ7Zm9udC1mYW1pbHk6Q2FsaWJyaSxzYW5zLXNlcmlmIj48Yj48c3BhbiAgDQpzdHlsZT0iY29s b3I6cmdiKDAsMzIsOTYpIj5JQk0NCnByb2R1Y3RzIHVzZXImIzM5O3MgbGlzdHMgaW5jbHVkZTrC oDwvc3Bhbj48L2I+PHNwYW4gIA0Kc3R5bGU9ImNvbG9yOnJnYigwLDMyLDk2KSI+SUJNIEFTLzQw MCw8Yj4gPC9iPklCTSBDb2dub3MsPGI+ICANCjwvYj48L3NwYW4+PHNwYW4gc3R5bGU9ImNvbG9y OnJnYigwLDMyLDk2KSI+SUJNIElTUEYsIElCTSBJbmZvcm1peCwgSUJNDQpXZWJTcGhlcmUsIElC TSBJbmZvU3BoZXJlLCBJQk0gTWF4aW1vLCBJQk0gU1BTUywgSUJNIFJhdGlvbmFsIFJvc2UsIElC TQ0KU3RvcmFnZSwgSUJNIExvdHVzIE5vdGVzLCBJQk0gRmlsZU5ldCwgSUJNIENJQ1MsIElCTSBN YWluZnJhbWUsIE5ldGV6emEsICANCkRCMiwNCklCTSBUaXZvbGkgYW5kIG1hbnkgbW9yZS48L3Nw YW4+PHNwYW4gc3R5bGU9ImNvbG9yOnJnYigwLDMyLDk2KSI+PGJyPg0KPGJyPg0KV2UgYWxzbyBw cm92aWRlIERlY2lzaW9uIE1ha2VycyBDb250YWN0cyBzdWNoIGFzwqA8Yj5DLSBsZXZlbCwgVlAg bGV2ZWwsDQpEaXJlY3RvcnMgYW5kIE1hbmFnZXJzIGNvbnRhY3QgZGV0YWlsczwvYj4uPGJyPg0K PGJyPg0KPC9zcGFuPjxzcGFuIHN0eWxlPSJjb2xvcjpyZ2IoMCwzMiw5NikiPlBsZWFzZQ0KcmV2 aWV3IGFuZCBsZXQgbWUga25vdyBpZiB5b3UgYXJlIGludGVyZXN0ZWQgaW4gdGhlIGFib3ZlIG9y IGlmIHlvdSBwcmVmZXIgIA0KYW55DQpvdGhlciB0ZWNobm9sb2d5IGxpc3QuIElmIHlvdSBhcmUg bm90IHRoZSByaWdodCBwZXJzb24sIGZlZWwgZnJlZSB0byAgDQpmb3J3YXJkIHRoaXMNCmVtYWls IHRvIHRoZSByaWdodCBwZXJzb24gaW4geW91ciBvcmdhbml6YXRpb24uPC9zcGFuPjxzcGFuICAN CnN0eWxlPSJjb2xvcjpyZ2IoMCwzMiw5NikiPjxzcGFuPjwvc3Bhbj48L3NwYW4+PC9wPg0KDQo8 cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibWFyZ2luOjBpbiAwaW4gIA0KMC4wMDAxcHQ7Zm9u dC1zaXplOjExcHQ7Zm9udC1mYW1pbHk6Q2FsaWJyaSxzYW5zLXNlcmlmIj48c3BhbiAgDQpzdHls ZT0iY29sb3I6cmdiKDAsMzIsOTYpIj48c3Bhbj7CoDwvc3Bhbj48L3NwYW4+PC9wPg0KDQo8cCBj bGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibWFyZ2luOjBpbiAwaW4gIA0KMC4wMDAxcHQ7Zm9udC1z aXplOjExcHQ7Zm9udC1mYW1pbHk6Q2FsaWJyaSxzYW5zLXNlcmlmIj48c3BhbiAgDQpzdHlsZT0i Y29sb3I6cmdiKDAsMzIsOTYpIj5CZXN0IFJlZ2FyZHMsPGJyPg0KTG91c2llIFRob21hczxicj4N CjxiPk1hcmtldGluZyBBbmFseXRpY3M8L2I+PHNwYW4+PC9zcGFuPjwvc3Bhbj48L3A+DQoNCjxw IGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtYXJnaW46MGluIDBpbiAgDQowLjAwMDFwdDtmb250 LXNpemU6MTFwdDtmb250LWZhbWlseTpDYWxpYnJpLHNhbnMtc2VyaWYiPjxzcGFuICANCnN0eWxl PSJjb2xvcjpyZ2IoMCwzMiw5NikiPjxzcGFuPsKgPC9zcGFuPjwvc3Bhbj48L3A+DQoNCjxwIGNs YXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtYXJnaW46MGluIDBpbiAgDQowLjAwMDFwdDtmb250LXNp emU6MTFwdDtmb250LWZhbWlseTpDYWxpYnJpLHNhbnMtc2VyaWYiPjxzcGFuICANCnN0eWxlPSJj b2xvcjpyZ2IoMCwzMiw5NikiPlRvPHNwYW4gc3R5bGU9ImJhY2tncm91bmQ6d2hpdGUiPg0KPC9z cGFuPm9wdDxzcGFuIHN0eWxlPSJiYWNrZ3JvdW5kOndoaXRlIj4gPC9zcGFuPm91dDxzcGFuICAN CnN0eWxlPSJiYWNrZ3JvdW5kOndoaXRlIj4gPC9zcGFuPmtpbmRseTxzcGFuIHN0eWxlPSJiYWNr Z3JvdW5kOndoaXRlIj4gIA0KPC9zcGFuPnJlcGx5PHNwYW4gc3R5bGU9ImJhY2tncm91bmQ6d2hp dGUiPiA8L3NwYW4+YmFjazxzcGFuICANCnN0eWxlPSJiYWNrZ3JvdW5kOndoaXRlIj4gPC9zcGFu PndpdGg8c3BhbiBzdHlsZT0iYmFja2dyb3VuZDp3aGl0ZSI+ICANCuKAnDwvc3Bhbj5SZW1vdmXi gJ08c3BhbiAgDQpzdHlsZT0iYmFja2dyb3VuZDp3aGl0ZSI+PHNwYW4+PC9zcGFuPjwvc3Bhbj48 L3NwYW4+PC9wPg0KDQoNCg0KDQoNCjxicj48L2Rpdj4NCjxwPiZuYnNwOzwvcD48YSBzdHlsZT0n ZGlzcGxheTogYmxvY2s7IG1hcmdpbjogMzJweCAwIDQwcHggMDsgcGFkZGluZzogIA0KMTBweDsg Zm9udC1zaXplOiAxZW07IHRleHQtYWxpZ246IGNlbnRlcjsgYm9yZGVyOiAwOyBib3JkZXItdG9w OiAxcHggc29saWQgIA0KZ3JheTsgJyBocmVmPSdodHRwczovL2dvby5nbC8ya3NkUnYnPnBvd2Vy ZWQgYnkgR1NNLiBGcmVlIG1haWwgbWVyZ2UgYW5kICANCmVtYWlsIG1hcmtldGluZyBzb2Z0d2Fy ZSBmb3IgR21haWwuPC9hPg0K From owner-freebsd-stable@freebsd.org Fri Apr 20 11:15:07 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BB31DF94081 for ; Fri, 20 Apr 2018 11:15:07 +0000 (UTC) (envelope-from petefrench@ingresso.co.uk) Received: from constantine.ingresso.co.uk (unknown [IPv6:2a02:b90:3002:411::3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 5DBF37288F; Fri, 20 Apr 2018 11:15:07 +0000 (UTC) (envelope-from petefrench@ingresso.co.uk) Received: from [2a02:b90:3002:411::6] (helo=dilbert.ingresso.co.uk) by constantine.ingresso.co.uk with esmtpsa (TLSv1.2:ECDHE-RSA-AES256-GCM-SHA384:256) (Exim 4.89 (FreeBSD)) (envelope-from ) id 1f9U0O-000CNN-UO; Fri, 20 Apr 2018 11:15:04 +0000 Received: from petefrench by dilbert.ingresso.co.uk with local (Exim 4.91 (FreeBSD)) (envelope-from ) id 1f9U0O-0002Bl-O7; Fri, 20 Apr 2018 12:15:04 +0100 To: eric@vangyzen.net, freebsd@hda3.com, truckman@freebsd.org Subject: Re: Ryzen issues on FreeBSD ? (with sort of workaround) Cc: avg@freebsd.org, freebsd-stable@freebsd.org, petefrench@ingresso.co.uk In-Reply-To: Message-Id: From: Pete French Date: Fri, 20 Apr 2018 12:15:04 +0100 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 20 Apr 2018 11:15:07 -0000 So, resurrecting the thread from a few weeks ago, as I finally found time yesterday to out together the Ryzen machine I bought the parts for in Jaunary (busy year at work....). All went smoothl;y, checked it booted up, used it for 15 minutes, was impressed by the speed and went home. ...and by the time I got home, an hour or so later, it had locked up hard. I was somewhat dissapointed, as I had seen various fixes go in,. and had hoped the issues were fixed. This morning I have booted the machine back up, tweaking the BIOPS to do things mentioned in this thread, viz: Disable Turbo Boost Disable SMT Disable global C-states The memory was already ruunning correctly at 2133 (though I have locked that in the BIOS too) and I was already using kern.eventtimer.periodic=1, so the lockup was not related to those. Its the latest BIOS, and a -STABLE build from yesterday. I suspect it will now be stable, but I was wondering if anyone was any further forward on working out which of the settings above are the ones which 'fix' the issue - or indeed if its really fixed, by them or just made far less likely to happen. Anyone got any more comments on this ? cheers, -pete. From owner-freebsd-stable@freebsd.org Fri Apr 20 11:48:52 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9AA5CF96579 for ; Fri, 20 Apr 2018 11:48:52 +0000 (UTC) (envelope-from nimrod@nimrod.is-a-geek.net) Received: from mail-yw0-x22c.google.com (mail-yw0-x22c.google.com [IPv6:2607:f8b0:4002:c05::22c]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 3B407786B5 for ; Fri, 20 Apr 2018 11:48:52 +0000 (UTC) (envelope-from nimrod@nimrod.is-a-geek.net) Received: by mail-yw0-x22c.google.com with SMTP id q12-v6so2646885ywj.0 for ; Fri, 20 Apr 2018 04:48:52 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=YQGMYROybp839OKm995gtGnO5kqpA2j9kZkRB1Wv2+A=; b=O3S8dpYReFrvm8S8AMD2WUwYH0DZU9rGp2mKdq6xwlWpkxhQf8zBF9YNbtNUAWnwLH /vrxyAjwUxr3Cnlze0fOxTs4MnmZE4QkszlhneKkicX5zVZnrXwdax078VKXtL3ZbRXi llSeyjOeGWhpXdpEVY01h5liZOhgS/zLoMA86WWNklriANe23KZO8R4x6Jn7rl6tSNSj PIuUNwPvaHKLsCG6Ce8Jqt3oHrYes4aEC6IPLj8nx9hyLFVxRu+CSc1+b9SGO6ZaKh0p HU6Q/EYD5Kwx1hbfFAGoyYPgD1NzwvaJXZzbtEn2dxx1dHLaY5d77fEJKwIJ17jJ/fX5 igdQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=YQGMYROybp839OKm995gtGnO5kqpA2j9kZkRB1Wv2+A=; b=ACnU/RT3YmuBGahI3pgqr9CKs045dwKKpp55IANh7eMftxsy5ivyyuX5irprVcR/8p 1D6oSVHuurYgwjF+aiqmaO9EbwN/uF8uhRo5anAyRCZfA9aguuztqXkvaCZCdrvYEqEj HyzzjXf2aW8+3/8GCjerYf2noH+c45leTwYC3dbyrZH0pG3a4rZSZuWuhNvl9PJemkUN e/imsLInF9TQYJSM4EWZjkRs4zql5xUPdQW957VqbcGc9IrIBD9p6FpK+8HBoCa7oQSw mKBPqpBYhcRQTVX7UlWzKnaHoySMuJeNBNvdjQM1bnda3e0nHLXPh5H8p85S2bnLpR/b aBmg== X-Gm-Message-State: ALQs6tDwhQs+7/aM/RehbrHHKAPlFAPmA+X1uvh9GAn1If7f6YIdI7es rnn57JbuMCQVGnb5WjWkdy9AG6cHjQWTHd4Po5gCdg== X-Google-Smtp-Source: AIpwx49LP+mCV2k1LsZNpKw4B65OPDFAYp7wsCPHq3gkDjJo16VoPCtQiV6WKMDNa4lKayu2syEgt5PxvB/h8lIA0yM= X-Received: by 2002:a81:9ccf:: with SMTP id t198-v6mr456034ywg.352.1524224931502; Fri, 20 Apr 2018 04:48:51 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Nimrod Levy Date: Fri, 20 Apr 2018 11:48:40 +0000 Message-ID: Subject: Re: Ryzen issues on FreeBSD ? (with sort of workaround) To: Pete French Cc: eric@vangyzen.net, freebsd@hda3.com, truckman@freebsd.org, freebsd-stable@freebsd.org, avg@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.25 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 20 Apr 2018 11:48:52 -0000 I'm really glad to see that I'm not the only one still interested in this thread. I don't really have anything new to contribute. I've been getting about a week or so uptime out of my box. My habit has been to see if it hangs, then reboot and rebuild latest stable and reboot and run that for a while. Although now that this thread pops back up, I just realized it's been 2 weeks since the last cycle. I don't trust it yet, but I've seen clear improvement since this started. On Fri, Apr 20, 2018 at 7:18 AM Pete French wrote: > So, resurrecting the thread from a few weeks ago, as I finally found > time yesterday to out together the Ryzen machine I bought the parts for in > Jaunary (busy year at work....). All went smoothl;y, checked it > booted up, used it for 15 minutes, was impressed by the speed and went > home. > > ...and by the time I got home, an hour or so later, it had locked up hard. > > I was somewhat dissapointed, as I had seen various fixes go in,. and had > hoped > the issues were fixed. This morning I have booted the machine back up, > tweaking the BIOPS to do things mentioned in this thread, viz: > > Disable Turbo Boost > Disable SMT > Disable global C-states > > The memory was already ruunning correctly at 2133 (though I have locked > that > in the BIOS too) and I was already using kern.eventtimer.periodic=1, so > the lockup was not related to those. Its the latest BIOS, and a -STABLE > build from yesterday. > > I suspect it will now be stable, but I was wondering if anyone was any > further > forward on working out which of the settings above are the ones which 'fix' > the issue - or indeed if its really fixed, by them or just made far less > likely > to happen. > > Anyone got any more comments on this ? > > cheers, > > -pete. > _______________________________________________ > freebsd-stable@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" > -- -- Nimrod From owner-freebsd-stable@freebsd.org Fri Apr 20 11:55:29 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id EAF32F96F36 for ; Fri, 20 Apr 2018 11:55:28 +0000 (UTC) (envelope-from petefrench@ingresso.co.uk) Received: from constantine.ingresso.co.uk (unknown [IPv6:2a02:b90:3002:411::3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 2EF0E7B3AF; Fri, 20 Apr 2018 11:55:28 +0000 (UTC) (envelope-from petefrench@ingresso.co.uk) Received: from dilbert.london-internal.ingresso.co.uk ([10.64.50.6]) by constantine.ingresso.co.uk with esmtpsa (TLSv1.2:ECDHE-RSA-AES128-GCM-SHA256:128) (Exim 4.89 (FreeBSD)) (envelope-from ) id 1f9UdR-000Cum-Uu; Fri, 20 Apr 2018 11:55:25 +0000 Subject: Re: Ryzen issues on FreeBSD ? (with sort of workaround) To: Nimrod Levy Cc: eric@vangyzen.net, freebsd@hda3.com, truckman@freebsd.org, freebsd-stable@freebsd.org, avg@freebsd.org References: From: Pete French Message-ID: <70328375-165e-6ba4-8c21-03acd6ae8933@ingresso.co.uk> Date: Fri, 20 Apr 2018 12:55:25 +0100 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:52.0) Gecko/20100101 Thunderbird/52.7.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 20 Apr 2018 11:55:29 -0000 On 20/04/2018 12:48, Nimrod Levy wrote: > I'm really glad to see that I'm not the only one still interested in > this thread.  I don't really have anything new to contribute. I've been > getting about a week or so uptime out of my box. My habit has been to > see if it hangs, then reboot and rebuild latest stable and reboot and > run that for a while. Although now that this thread pops back up, I just > realized it's been 2 weeks since the last cycle. I don't trust it yet, > but I've seen clear improvement since this started. What setting sdo you have - just the ones I listed or some in the BSD setup itself ? I am surprised that the operson who said they were getting an actual Epyc server hasn't commented again on the thread. Hopefully that means it works fine on the server hardware :-) I have seen a few commits go through in STABLE related to VM which interest me, and which might cause hangs, so we shall see how it goes. Possibly looking at the Ryzen issue has flushed out a few VM problems anyway, which would be good, as more stbaility is always good (and I have a vague hope it might fix the mysetrious Go hangs too). -pete. From owner-freebsd-stable@freebsd.org Fri Apr 20 12:39:58 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 904F9F9EEAC for ; Fri, 20 Apr 2018 12:39:58 +0000 (UTC) (envelope-from nimrod@nimrod.is-a-geek.net) Received: from mail-yb0-x22c.google.com (mail-yb0-x22c.google.com [IPv6:2607:f8b0:4002:c09::22c]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 3058887117 for ; Fri, 20 Apr 2018 12:39:58 +0000 (UTC) (envelope-from nimrod@nimrod.is-a-geek.net) Received: by mail-yb0-x22c.google.com with SMTP id c10-v6so2944142ybn.7 for ; Fri, 20 Apr 2018 05:39:58 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=HhwPYVLWW2XVUtiUYTx/OAN+IPjpFKTm69F9nbJcqHM=; b=YHQ1bmLHP7vggSxc7TwfFd5VzCm8bpVI5spyNccoQfLnHUTMslKpGUbAN/hwVH7fHW Vz96BhEIKIj4fSs6ZeXFdQ0KCbIV3QrVretlJDzcWbM+SsHuvXPL5jaqlpIlz/tP1Hml h65b/IoCMPTyIU6f53UsKGmtsg/u3hTD3rKGbtVBajW9qYQ7suOiBIexgHNcPJjVwJlw os/2ApZDOvOwKD8pRBSX/F090JxMFscchGXgUJDnWxkX5pO/xJxnP1j14ELmhltYujH3 II3RfUoTNUJmH6SY4tPmivOgWRpgX/CmRXCa+U4RKhYpPPVIzJvPSm9LW7oULAO8bsFN 1RRg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=HhwPYVLWW2XVUtiUYTx/OAN+IPjpFKTm69F9nbJcqHM=; b=ZemghcuzGGaVgehvMpyGRYz6DhxyZzM2bpZi9050qZiroIQ1fFmqoeT1g6cqlRCCWS tUN589kz+TlAK0/pKo0+SA6GO02nMI7FyCYjuPOyiIAQNRp2H4SE/Xw2XqNOsuXPI+cN 1kcAjfH4+P4fG8fgTx8BBzqDdpSy5aAA4xSgE26HH/LX6ZyZoMSPlz+C/m+W2ODOTFwx dsy37KgQRFVwBti8EBYb67UrhjqbpAghB3VXqV/2/AiILAt+LtrEyQvxZ/2VTKZld4Ca 0GUtMKbDomhUUzcRgGZCXnuVrrMwUn1FG1QREZ6hkdm49MI8JbfIlH6ZQm2EllJfxKt/ 5B2Q== X-Gm-Message-State: ALQs6tBLTgOmG2V9naKDj6/jW61drV5EFrAUZ9dPnQrh1OweYRDnvQES oTkEuZoBxNB0ibwKz0hL6pRqKxZ3dW2A+JojJQdytg== X-Google-Smtp-Source: AIpwx4+BLYTP5XOHPRaK8TBva3j1ns7FVkVNbPVRpNggVlBDbeCpU7FK96mNmwQpHxj4eRQEsnVhvqxkY+3q3Jfe1X4= X-Received: by 2002:a25:20d7:: with SMTP id g206-v6mr6078217ybg.71.1524227997291; Fri, 20 Apr 2018 05:39:57 -0700 (PDT) MIME-Version: 1.0 References: <70328375-165e-6ba4-8c21-03acd6ae8933@ingresso.co.uk> In-Reply-To: <70328375-165e-6ba4-8c21-03acd6ae8933@ingresso.co.uk> From: Nimrod Levy Date: Fri, 20 Apr 2018 12:39:46 +0000 Message-ID: Subject: Re: Ryzen issues on FreeBSD ? (with sort of workaround) To: Pete French Cc: eric@vangyzen.net, freebsd@hda3.com, truckman@freebsd.org, freebsd-stable@freebsd.org, avg@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.25 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 20 Apr 2018 12:39:58 -0000 To be honest, I can't remember for certain what's set in the BIOS right now. The last post I made was from 3/17 and it says I have the memory clock lowered and c-states disabled. I don't think I've changed anything but the build of stable since then. -- Nimrod On Fri, Apr 20, 2018 at 7:55 AM Pete French wrote: > > > On 20/04/2018 12:48, Nimrod Levy wrote: > > I'm really glad to see that I'm not the only one still interested in > > this thread. I don't really have anything new to contribute. I've been > > getting about a week or so uptime out of my box. My habit has been to > > see if it hangs, then reboot and rebuild latest stable and reboot and > > run that for a while. Although now that this thread pops back up, I just > > realized it's been 2 weeks since the last cycle. I don't trust it yet, > > but I've seen clear improvement since this started. > > What setting sdo you have - just the ones I listed or some in the BSD > setup itself ? I am surprised that the operson who said they were > getting an actual Epyc server hasn't commented again on the thread. > Hopefully that means it works fine on the server hardware :-) > > I have seen a few commits go through in STABLE related to VM which > interest me, and which might cause hangs, so we shall see how it goes. > Possibly looking at the Ryzen issue has flushed out a few VM problems > anyway, which would be good, as more stbaility is always good (and I > have a vague hope it might fix the mysetrious Go hangs too). > > -pete. > -- -- Nimrod From owner-freebsd-stable@freebsd.org Fri Apr 20 13:31:58 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 19296FA3D4E for ; Fri, 20 Apr 2018 13:31:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id A013171B90 for ; Fri, 20 Apr 2018 13:31:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 59E08FA3D47; Fri, 20 Apr 2018 13:31:57 +0000 (UTC) Delivered-To: stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 485CAFA3D45 for ; Fri, 20 Apr 2018 13:31:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id DADCF71B8E for ; Fri, 20 Apr 2018 13:31:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 382AF2793F for ; Fri, 20 Apr 2018 13:31:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w3KDVumq059700 for ; Fri, 20 Apr 2018 13:31:56 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w3KDVu6Y059697 for stable@FreeBSD.org; Fri, 20 Apr 2018 13:31:56 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: stable@FreeBSD.org Subject: [Bug 227654] [panic] repeatable crash with IPv6+lagg+vlan+em Date: Fri, 20 Apr 2018 13:31:55 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.1-STABLE X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: eugen@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status keywords bug_severity priority component assigned_to reporter cc attachments.created Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 20 Apr 2018 13:31:58 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D227654 Bug ID: 227654 Summary: [panic] repeatable crash with IPv6+lagg+vlan+em Product: Base System Version: 11.1-STABLE Hardware: Any OS: Any Status: New Keywords: crash Severity: Affects Only Me Priority: --- Component: kern Assignee: net@FreeBSD.org Reporter: eugen@freebsd.org CC: stable@FreeBSD.org Created attachment 192681 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D192681&action= =3Dedit panic screenshot Hi! I run my workstation under FreeBSD 11.1-STABLE/amd64 r331249 with custom ke= rnel including IPv6 support, options DDB, KDB, INVARIANTS and WITNESS. The following sequence of commands produces a panic reliably, including cold-booted single user mode: ifconfig tap0 create up ifconfig lagg0 create up ifconfig lagg0 laggport tap0 ifconfig em0 up ifconfig vlan61 create vlan 61 vlandev em0 ifconfig vlan61 inet 192.168.0.1/24 ifconfig lagg0 laggport em0 # instant panic Panic messages sometimes printed in bright-white and then system jumps to B= IOS POST within a second or so. Sometimes they are pronted in gray then system = just hangs solid without any reaction on Ctrl-Alt-ESC to enter KDB and no crashd= ump generated. Screenshot is attached. --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-stable@freebsd.org Fri Apr 20 13:39:51 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A5550FA471B for ; Fri, 20 Apr 2018 13:39:51 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost2.sentex.ca (smarthost2.sentex.ca [IPv6:2607:f3e0:80:80::2]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client CN "smarthost.sentex.ca", Issuer "smarthost.sentex.ca" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 2089C746B5; Fri, 20 Apr 2018 13:39:51 +0000 (UTC) (envelope-from mike@sentex.net) Received: from lava.sentex.ca (lava.sentex.ca [IPv6:2607:f3e0:0:5::11]) by smarthost2.sentex.ca (8.15.2/8.15.2) with ESMTPS id w3KDdnwL070376 (version=TLSv1 cipher=DHE-RSA-CAMELLIA256-SHA bits=256 verify=NO); Fri, 20 Apr 2018 09:39:50 -0400 (EDT) (envelope-from mike@sentex.net) Received: from [192.168.43.26] (saphire3.sentex.net [192.168.43.26]) by lava.sentex.ca (8.15.2/8.15.2) with ESMTP id w3KDcVqi033559; Fri, 20 Apr 2018 09:38:31 -0400 (EDT) (envelope-from mike@sentex.net) Subject: Re: Ryzen issues on FreeBSD ? (with sort of workaround) To: Nimrod Levy , Pete French Cc: truckman@freebsd.org, eric@vangyzen.net, freebsd-stable@freebsd.org, avg@freebsd.org, freebsd@hda3.com References: <70328375-165e-6ba4-8c21-03acd6ae8933@ingresso.co.uk> From: Mike Tancsa Openpgp: preference=signencrypt Organization: Sentex Communications Message-ID: Date: Fri, 20 Apr 2018 09:38:31 -0400 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:52.0) Gecko/20100101 Thunderbird/52.7.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 8bit X-Scanned-By: MIMEDefang 2.78 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 20 Apr 2018 13:39:51 -0000 Its not just the Ryzen, I can lock up Epyc CPUs as well. They take a bit longer, but its not that hard to repeat. Unfortunately, I had to allocate this hardware over the Linux where it works reliably under all workloads without any such lock ups with all the default BIOS settings :( Here is a test case. https://lists.freebsd.org/pipermail/freebsd-stable/2018-February/088433.html Peter was able to recreate it as well. https://lists.freebsd.org/pipermail/freebsd-virtualization/2018-March/006187.html I dont think its VM / virtualization per se. I think Peter mentioned something about IPIs ---Mike On 4/20/2018 8:39 AM, Nimrod Levy wrote: > To be honest, I can't remember for certain what's set in the BIOS right > now. The last post I made was from 3/17 and it says I have the memory clock > lowered and c-states disabled. I don't think I've changed anything but the > build of stable since then. > > -- > Nimrod > > On Fri, Apr 20, 2018 at 7:55 AM Pete French > wrote: > >> >> >> On 20/04/2018 12:48, Nimrod Levy wrote: >>> I'm really glad to see that I'm not the only one still interested in >>> this thread. I don't really have anything new to contribute. I've been >>> getting about a week or so uptime out of my box. My habit has been to >>> see if it hangs, then reboot and rebuild latest stable and reboot and >>> run that for a while. Although now that this thread pops back up, I just >>> realized it's been 2 weeks since the last cycle. I don't trust it yet, >>> but I've seen clear improvement since this started. >> >> What setting sdo you have - just the ones I listed or some in the BSD >> setup itself ? I am surprised that the operson who said they were >> getting an actual Epyc server hasn't commented again on the thread. >> Hopefully that means it works fine on the server hardware :-) >> >> I have seen a few commits go through in STABLE related to VM which >> interest me, and which might cause hangs, so we shall see how it goes. >> Possibly looking at the Ryzen issue has flushed out a few VM problems >> anyway, which would be good, as more stbaility is always good (and I >> have a vague hope it might fix the mysetrious Go hangs too). >> >> -pete. >> -- ------------------- Mike Tancsa, tel +1 519 651 3400 x203 Sentex Communications, mike@sentex.net Providing Internet services since 1994 www.sentex.net Cambridge, Ontario Canada From owner-freebsd-stable@freebsd.org Fri Apr 20 13:51:10 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C556AFA5865 for ; Fri, 20 Apr 2018 13:51:10 +0000 (UTC) (envelope-from valerie.ross@sharedstrikes.com) Received: from mail-vk0-x247.google.com (mail-vk0-x247.google.com [IPv6:2607:f8b0:400c:c05::247]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 65110776BC for ; Fri, 20 Apr 2018 13:51:10 +0000 (UTC) (envelope-from valerie.ross@sharedstrikes.com) Received: by mail-vk0-x247.google.com with SMTP id l75so5618174vke.20 for ; Fri, 20 Apr 2018 06:51:10 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=sharedstrikes.com; s=google; h=mime-version:message-id:date:subject:from:to; bh=W+ClDanyj7JECSn8QBT5vGRaQhb1kba1Aops3qajptk=; b=dibaflF8ppfDf6Zmk2W5gT4alD5zFCnIm34aE0bUBdQ5JLJnARHebsaJv8ofXWTo31 laUwZp/xtjpA7VXTap2aJ+9c/+exskQHXvzj2ECPjpN3xbmPs7tx45iDJ2d0oegqYN0r Al3VCyr1LRhyz4WVSR4gNfBVYBeO3b3jIro9Bmm4FJu9xaG78s2zz+IaOKnHlyHLm+Wq bsRZG5bjUX9Qw2xIM5TPPPMHoTK2gl1lRFuSNWiBYafPb8OTJTF1uC6M2g9hVhuDe5sf Ax7qZa8HipDfUIQStdrwjj85umE4kT5Fji6Pd6MkX1o7WiYGSo4yKsi6L6lR5L/3oP5H ljLQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:message-id:date:subject:from:to; bh=W+ClDanyj7JECSn8QBT5vGRaQhb1kba1Aops3qajptk=; b=GBtRyFTTNVNtdrT+a80vFm4jxleIHdeobjqausoL9Pnh+u5Bhilfd80+7qr16Wfz86 gTL/DU6p3QqLIya/XjPV6cm7S8G6sz5H5fhxScpWfS48Ys/yCy2lIWcuFERwrZ8+vgeI 78x0F5X95rOuCbPrB2+boC2hD4di+dErpCxmtzX5cysSg47z9p8JzG/1BKx2HKXaVQUK XdIg0QAauRyfmTLQ9SlsOh51Ou5DSk+uD4LaT/aSTe17G/hogTfgBZqriuwAY6Y//uwk 2U4viuLofF/Okg6HZMYj6rj7HK+4eh8dNdyj5y+/ggDWZ8WkOhDbBSWMsFNnxb2wU8JS ew4Q== X-Gm-Message-State: ALQs6tDrmVfG+3wRLRNiX+X5cg8WKQH6te+YIZV8l+n+Bm2kJTUQXTox uAV/aQQzNRf28jQmtSfuIUyFEXg3Ad3m X-Google-Smtp-Source: AIpwx4/Ev3HkaA0y5J+JQmBbqmZed2nudjai2ZgrzyspBIjf8Zj+/QB1K1V+jrxqAi4Za/WWnifqHXgMFA== MIME-Version: 1.0 X-Received: by 10.176.18.95 with SMTP id s31mr4730420uac.50.1524232269744; Fri, 20 Apr 2018 06:51:09 -0700 (PDT) Message-ID: Date: Fri, 20 Apr 2018 13:51:09 +0000 Subject: MSP Globally Targeted Marketing Campaigns. From: valerie.ross@sharedstrikes.com To: freebsd-stable@freebsd.org Content-Type: text/plain; charset="UTF-8"; format=flowed; delsp=yes Content-Transfer-Encoding: base64 X-Content-Filtered-By: Mailman/MimeDel 2.1.25 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 20 Apr 2018 13:51:11 -0000 PGRpdiBkaXI9Imx0ciI+PHAgIA0KY2xhc3M9ImdtYWlsLW0tMjQyNTA5NDgzMzk2NTEwMjgwMmdt YWlsLW1zb25vc3BhY2luZyI+PHNwYW4gIA0Kc3R5bGU9ImZvbnQtc2l6ZToxMXB0O2ZvbnQtZmFt aWx5OkNhbGlicmksc2Fucy1zZXJpZjtjb2xvcjpyZ2IoMzEsNzgsMTIxKSI+SGksPHNwYW4+PC9z cGFuPjwvc3Bhbj48L3A+DQoNCjxwIGNsYXNzPSJnbWFpbC1Nc29Ob1NwYWNpbmciPjxzcGFuIHN0 eWxlPSJjb2xvcjpyZ2IoMzEsNzgsMTIxKSI+SG9wZSB0aGlzICANCm5vdGUgZmluZHMgeW91IHdl bGwhPC9zcGFuPjwvcD4NCg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgIA0Kc3R5bGU9Im1hcmdpbi1i b3R0b206MC4wMDAxcHQ7bGluZS1oZWlnaHQ6bm9ybWFsIj48c3BhbiAgDQpzdHlsZT0iY29sb3I6 cmdiKDMxLDc4LDEyMSkiPkkgdGhpbmsgdGhlcmUgaXMgYW4gb3Bwb3J0dW5pdHkgZm9yIHVzIHRv IGhlbHAgIA0KeW91IHJ1biBzb21lDQphbWF6aW5nIGNhbXBhaWducyB0aGF0IGNhbiBpbmNyZWFz ZSBzYWxlcywgZ2VuZXJhdGUgYnV6eiwgYW5kIGVuaGFuY2UgYnJhbmQNCmF3YXJlbmVzcyB0aHJv dWdoIG91ciB1cGRhdGVkIGFuZCBHbG9iYWxseSB0YXJnZXRlZCBsaXN0IG9mwqA8L3NwYW4+PGI+ PHNwYW4gIA0Kc3R5bGU9ImNvbG9yOnJnYigzMSw3OCwxMjEpIj5NYW5hZ2U8L3NwYW4+PC9iPjxi Pg0KPC9iPjxiPjxzcGFuIHN0eWxlPSJjb2xvcjpyZ2IoMzEsNzgsMTIxKSI+U2VydmljZQ0KUHJv dmlkZXJzIDwvc3Bhbj48L2I+PHNwYW4gc3R5bGU9ImNvbG9yOnJnYigzMSw3OCwxMjEpIj5mb3Ig UTItMjAxOCAgDQptYXJrZXRpbmcgQ2FtcGFpZ25zPC9zcGFuPjwvcD4NCg0KPHAgY2xhc3M9Ik1z b05vcm1hbCIgIA0Kc3R5bGU9Im1hcmdpbi1ib3R0b206MC4wMDAxcHQ7bGluZS1oZWlnaHQ6bm9y bWFsIj48c3BhbiAgDQpzdHlsZT0iY29sb3I6cmdiKDMxLDU2LDEwMCkiPsKgPC9zcGFuPjwvcD4N Cg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgIA0Kc3R5bGU9Im1hcmdpbi1ib3R0b206MC4wMDAxcHQ7 bGluZS1oZWlnaHQ6bm9ybWFsIj48Yj48c3BhbiAgDQpzdHlsZT0iY29sb3I6cmdiKDMxLDc4LDEy MSkiPkxpc3QgQ29udGFpbnM6PC9zcGFuPjwvYj48c3BhbiAgDQpzdHlsZT0iY29sb3I6cmdiKDMx LDc4LDEyMSkiPsKgTmFtZSwgQ29tcGFueSYjMzk7cyBOYW1lLCBQaG9uZQ0KTnVtYmVyLCBGYXgg TnVtYmVyLCBKb2IgVGl0bGUsIEVtYWlsIGFkZHJlc3MsIENvbXBsZXRlIE1haWxpbmcgQWRkcmVz cywgU0lDDQpjb2RlLCBDb21wYW55IHJldmVudWUsIHNpemUsIFdlYiBhZGRyZXNzIGV0Yy4gQWxs IFRlY2hub2xvZ3kgLyBDb21wYW5pZXMNClBhcnRuZXJzIGFuZCBVc2VycyBMaXN0LCBJVCBkZWNp c2lvbiBNYWtlcnMgZnJvbSBGb3J0dW5lIDUwMCBDb21wYW5pZXMsIElUDQpEZWNpc2lvbiBNYWtl cnMgZnJvbSBTTUUgYXMgd2VsbC48c3Bhbj48L3NwYW4+PC9zcGFuPjwvcD4NCg0KPHAgY2xhc3M9 Ik1zb05vcm1hbCIgIA0Kc3R5bGU9Im1hcmdpbi1ib3R0b206MC4wMDAxcHQ7bGluZS1oZWlnaHQ6 bm9ybWFsIj48c3BhbiAgDQpzdHlsZT0iY29sb3I6cmdiKDMxLDc4LDEyMSkiPsKgPC9zcGFuPjwv cD4NCg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgIA0Kc3R5bGU9Im1hcmdpbi1ib3R0b206MC4wMDAx cHQ7bGluZS1oZWlnaHQ6bm9ybWFsIj48c3BhbiAgDQpzdHlsZT0iY29sb3I6cmdiKDMxLDc4LDEy MSkiPllvdSBtYXkgYWxzbyBhY3F1aXJlIGRhdGFiYXNlICANCm9mOjxzcGFuPjwvc3Bhbj48L3Nw YW4+PC9wPg0KDQo8cCBjbGFzcz0iTXNvTm9ybWFsIiAgDQpzdHlsZT0ibWFyZ2luLWJvdHRvbTow LjAwMDFwdDtsaW5lLWhlaWdodDpub3JtYWwiPjxzcGFuICANCnN0eWxlPSJjb2xvcjpyZ2IoMzEs NzgsMTIxKSI+wqA8L3NwYW4+PC9wPg0KDQo8cCBjbGFzcz0iTXNvTm9ybWFsIiAgDQpzdHlsZT0i bWFyZ2luLWJvdHRvbTowLjAwMDFwdDtsaW5lLWhlaWdodDpub3JtYWwiPjxiPjxzcGFuICANCnN0 eWxlPSJjb2xvcjpyZ2IoMzEsNzgsMTIxKSI+MS7CoMKgwqDCoMKgIE1hbmFnZWQgU2VjdXJpdHkg U2VydmljZQ0KcHJvdmlkZXJzLSBNU1NQczwvc3Bhbj48L2I+PHNwYW4gIA0Kc3R5bGU9ImNvbG9y OnJnYigzMSw3OCwxMjEpIj48c3Bhbj48L3NwYW4+PC9zcGFuPjwvcD4NCg0KPHAgY2xhc3M9Ik1z b05vcm1hbCIgIA0Kc3R5bGU9Im1hcmdpbi1ib3R0b206MC4wMDAxcHQ7bGluZS1oZWlnaHQ6bm9y bWFsIj48Yj48c3BhbiAgDQpzdHlsZT0iY29sb3I6cmdiKDMxLDc4LDEyMSkiPjIuwqDCoMKgwqDC oCBWYWx1ZSBBZGRlZCBSZXNlbGxlcnMtDQpWQVJzPC9zcGFuPjwvYj48c3BhbiBzdHlsZT0iY29s b3I6cmdiKDMxLDc4LDEyMSkiPjxzcGFuPjwvc3Bhbj48L3NwYW4+PC9wPg0KDQo8cCBjbGFzcz0i TXNvTm9ybWFsIiAgDQpzdHlsZT0ibWFyZ2luLWJvdHRvbTowLjAwMDFwdDtsaW5lLWhlaWdodDpu b3JtYWwiPjxiPjxzcGFuICANCnN0eWxlPSJjb2xvcjpyZ2IoMzEsNzgsMTIxKSI+My7CoMKgwqDC oMKgIEluZGVwZW5kZW50IFNvZnR3YXJlIFZlbmRvcnMtDQpJU1ZzPC9zcGFuPjwvYj48L3A+DQoN CjxwIGNsYXNzPSJNc29Ob3JtYWwiICANCnN0eWxlPSJtYXJnaW4tYm90dG9tOjAuMDAwMXB0O2xp bmUtaGVpZ2h0Om5vcm1hbCI+PGI+PHNwYW4gIA0Kc3R5bGU9ImNvbG9yOnJnYigzMSw3OCwxMjEp Ij40LsKgwqDCoMKgwqAgU3lzdGVtIEludGVncmF0b3JzLSAgDQpTSXM8L3NwYW4+PC9iPjxzcGFu IHN0eWxlPSJjb2xvcjpyZ2IoMzEsNzgsMTIxKSI+PHNwYW4+PC9zcGFuPjwvc3Bhbj48L3A+DQoN CjxwIGNsYXNzPSJNc29Ob3JtYWwiICANCnN0eWxlPSJtYXJnaW4tYm90dG9tOjAuMDAwMXB0O2xp bmUtaGVpZ2h0Om5vcm1hbCI+PGI+PHNwYW4gIA0Kc3R5bGU9ImNvbG9yOnJnYigzMSw3OCwxMjEp Ij41LsKgwqDCoMKgwqAgVm9JUCBTZXJ2aWNlIFByb3ZpZGVycyBhbmQNCm1hbnkgbW9yZS48L3Nw YW4+PC9iPjxzcGFuICANCnN0eWxlPSJjb2xvcjpyZ2IoMzEsNzgsMTIxKSI+PHNwYW4+PC9zcGFu Pjwvc3Bhbj48L3A+DQoNCjxwIGNsYXNzPSJnbWFpbC1tLTI0MjUwOTQ4MzM5NjUxMDI4MDJnbWFp bC1tc29ub3NwYWNpbmciPjxzcGFuICANCnN0eWxlPSJmb250LXNpemU6MTFwdDtmb250LWZhbWls eTpDYWxpYnJpLHNhbnMtc2VyaWY7Y29sb3I6cmdiKDMxLDc4LDEyMSkiPlBsZWFzZSAgDQpsZXQg dXMga25vdyB5b3VyIGludGVyZXN0IHRvIHByb3ZpZGUgeW91IHdpdGgNCmRldGFpbGVkIGluZm9y bWF0aW9uLjxzcGFuPjwvc3Bhbj48L3NwYW4+PC9wPg0KDQo8cCBjbGFzcz0iZ21haWwtbS0yNDI1 MDk0ODMzOTY1MTAyODAyZ21haWwtbXNvbm9zcGFjaW5nIj48c3BhbiAgDQpzdHlsZT0iZm9udC1z aXplOjExcHQ7Zm9udC1mYW1pbHk6Q2FsaWJyaSxzYW5zLXNlcmlmO2NvbG9yOnJnYigzMSw3OCwx MjEpIj5Bd2FpdCAgDQp5b3VyIHJlc3BvbnNlITxzcGFuPjwvc3Bhbj48L3NwYW4+PC9wPg0KDQo8 cCBjbGFzcz0iTXNvTm9ybWFsIj48c3BhbiAgDQpzdHlsZT0iY29sb3I6cmdiKDMxLDc4LDEyMSki PlJlZ2FyZHMswqA8L3NwYW4+PC9wPjxwIGNsYXNzPSJNc29Ob3JtYWwiPjxzcGFuICANCnN0eWxl PSJjb2xvcjpyZ2IoMzEsNzgsMTIxKSI+PGJyPg0KVmFsZXJpZSBSb3NzPC9zcGFuPjwvcD48cCBj bGFzcz0iTXNvTm9ybWFsIj48c3BhbiAgDQpzdHlsZT0iY29sb3I6cmdiKDMxLDc4LDEyMSkiPjxi cj4NCjxiPk1hcmtldGluZyBFeGVjdXRpdmU8L2I+wqA8L3NwYW4+PHNwYW4+PC9zcGFuPjwvcD48 L2Rpdj4NCjxwPiZuYnNwOzwvcD48YSBzdHlsZT0nZGlzcGxheTogYmxvY2s7IG1hcmdpbjogMzJw eCAwIDQwcHggMDsgcGFkZGluZzogIA0KMTBweDsgZm9udC1zaXplOiAxZW07IHRleHQtYWxpZ246 IGNlbnRlcjsgYm9yZGVyOiAwOyBib3JkZXItdG9wOiAxcHggc29saWQgIA0KZ3JheTsgJyBocmVm PSdodHRwczovL2dvby5nbC8ya3NkUnYnPnBvd2VyZWQgYnkgR1NNLiBGcmVlIG1haWwgbWVyZ2Ug YW5kICANCmVtYWlsIG1hcmtldGluZyBzb2Z0d2FyZSBmb3IgR21haWwuPC9hPg0K From owner-freebsd-stable@freebsd.org Fri Apr 20 13:53:24 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 51CA2FA5A95 for ; Fri, 20 Apr 2018 13:53:24 +0000 (UTC) (envelope-from george+freebsd@m5p.com) Received: from mailhost.m5p.com (mailhost.m5p.com [74.104.188.4]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "m5p.com", Issuer "Let's Encrypt Authority X3" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id D5000779D1 for ; Fri, 20 Apr 2018 13:53:23 +0000 (UTC) (envelope-from george+freebsd@m5p.com) Received: from [IPv6:2001:470:1f07:15ff::1f] (haymarket.m5p.com [IPv6:2001:470:1f07:15ff::1f]) (authenticated bits=0) by mailhost.m5p.com (8.15.2/8.15.2) with ESMTPSA id w3KDqtog087502 (version=TLSv1.2 cipher=DHE-RSA-AES128-SHA bits=128 verify=NO) for ; Fri, 20 Apr 2018 09:53:04 -0400 (EDT) (envelope-from george+freebsd@m5p.com) Subject: Re: kern.sched.quantum: Creepy, sadistic scheduler To: freebsd-stable@freebsd.org References: <9FDC510B-49D0-4722-B695-6CD38CA20D4A@gmail.com> <8cfdb8a3-86a0-17ba-1e41-ff1912a30ee9@m5p.com> <20180417065617.GA95646@klump.hjerdalen.lokalnett> <20180417232016.2008438c.ebfe@inbox.ru> <2a68cfd7-6823-296d-0392-c9b12c66f6e0@m5p.com> From: George Mitchell Openpgp: preference=signencrypt Autocrypt: addr=george+freebsd@m5p.com; prefer-encrypt=mutual; keydata= xsFNBFgnLnwBEADAJDiBKQX77LFRz9wZW8mz3KvaQol2nIremcws0F1mz/zgFlk6uhQVtwnL wb4XL5LdFwcNE1+QZzPLcbYWoWQlz0lBw1bMuKAgr0S6V2e0+I0DqhKeslVFctcTwtvT6pnK VLZXO/7ZGAaLzG4K5vSPzgoevU+YI/pxNsVCH2UO/c3jQW63uEt25mIZbCF1Pu4jgp4RhIgF ujn877r/j6OwBwjzRUu3E6ADp+U825d+5YCuQMEH0wIPnn9GTpXvfdKdbwOIl2akqXqs4cnk iATWfK3r6D4mvDEj1OPHlTvJYcfic7aOIiAwmx1C1v78GjXOdOOA0SGffNix3C2/8oZUO1+V Aet4MKpUKkduWSvULhIkHNZ5Nu8SIJOqge8pmtHxuNXAMfMrAjMdjPwwBFLsYg3Xa2E2oJwg ehTauwd/EDJFcVCyDCyCAYOi/BH/+XQyxzgDlY9N9qj9tHqhVPI6XK7t8UVffGiZUq4rHp5J RdOToqiTNC6eCJBczhMIW+DuFvWU9e6W708T1dz0Accn6Lrgk4eRIn3GFPBG+TxnpjAqHsbW 607dcnD3YKAqY4e+khczL4EObhe7dC1v2fmZiAC6Ds3WHR11IfqoUgCkIwJ590Ej+ElygJFF XxI82wtEz9hkeLLvItpyEJNVjppViRW+Dgl/U7ypHB3qDgYjgwARAQABzSBHZW9yZ2UgTWl0 Y2hlbGwgPGdlb3JnZUBtNXAuY29tPsLBlwQTAQgAQQIbIwUJCWYBgAULCQgHAgYVCAkKCwIE FgIDAQIeAQIXgBYhBDXTOGR5LbCVuZCmV8EREt5vqeH5BQJYWXFRAhkBAAoJEMEREt5vqeH5 SRsQAIb/crcxXyAyeokAuTjN+YXkEFdVv/JrOgNXKdCukXt/UGd3nZTcAzpllytDIvIlPTNI 2/nZ5sm6ymeyVwmvkrM/r3sRUib5ftakJpbv0wn2j+eCGAca8IA2frBUg9bEXKcHRJRQCztG cpousHzOziTCRQ/1NfPcIFBNbQMPUVoQ96cJPvM/XfFGOISKKsSI78skHm6Oazh1hLCQTKvy hNNgVpNP/PHCHMbla1+SNgyn35CUelTh153lnkOhw1XyX6IxY4o5Bhcf3YrxAVcoeHq3FEH0 T3ygAdI14VrZGXXitBAMI78QLB0FiWMoPQ3Oddnoh6tlT4djnsc9IW0Tzk6ozvQL7sKdYgO8 ZlIpkBqQQfpSHzwPu9EkOFggPWB9WtP3IajQ0lt1LovqMug4C8APRC2/1cvi+GUIRwjVsop0 ukhlLTTJd3/S4Muh3s87M4Rdek1xpOiMKjYOVaxmhQQ91oz971zJuJJWpX7uUQiXx9oEwCDW TvI5yEuqYLsMUwx3d2iFTr+HbtlBJmF+Vguyrn/a3vFK8P/TH9fMvNeTdln9SuOOa1SAMMcy czOpBYg9RpzNLshUJVrhKzugT59Rl2wsNQsQCUkzgF3f8cZHJyl+8x6t0nuM9LTkMv13YIXS Mde3UOD2EaBhmeIqvC/adQHxpNudvxM1viFJDnTnzsFNBFgnLnwBEAC7kzsZqjBRPonnr/63 C98FSa3LikvqQWygmPSCC9DsFX/fB0CSXIHTrHQ4a7lXdfZyTZcGdxXN+MC8O8thjvVq6WYm CpyOJ/bq4SxOa9cnQSJ5SP9VCmVoDN/3T4ybXFzLAt756kfQ5jsVuP0m6iQ4z918zhZXk+Mo qdwGjYTxsBD02a7m1aeYafyaI2mZ+vdEy0cDhV4PDXI6ThLNAavTPji6ZrBdH5a4LMg30u8v kkNe0eCKvU+0cWb2VQIeddMhhiGSBE2Dv+A4eNe1VZvoGpLDlYdnoHraVFL2GHNFGymj/uRf 1hja5kW9Rekisqby5SpGABwrFFEs7ABpfYG0IRBKbjjG1Cqdfe/R6ETJFvvNOOpCKPAWeqYf Isxv4OHWTmhKihhIanYWCAe1MDLRRbj7UrOTZeia2WJ4v58xbU5rVQoHI/Tzaq86rXzRWITc 5w+kresMad0zpvQ900BdHc8ATNY2aW/Fr5it5OqMvIW6Y4gc8Z95MkQPVc8vj3WzfxuWtZNK 6Wbv4r6Qbiwg1RpY1JoEIoF4OsZJOVMQaB6ezD7xvaa2eY6nRGtq9SoJxo2qvlSbLlKq8NdH VYHhtTbpQ1NfrEJfv5sLX5W5IpoYww48bFYH67+7r1f/W3voBptSgE7qnYAm6Em9bEAKOQEX 8BXwoa54fn03z6TyhwARAQABwsFkBBgBCAAPBQJYJy58AhsMBQkJZgGAAAoJEMEREt5vqeH5 6PcP+JvrMM7ZM8UlnbrY4Er9psPj3ayllRhQFA9h6GNUKYuSzSxOrPaT96s8KUGMCr4jrn1S WFmeeNLLOgSJmQRicMh6LmnKq6WY6UaOfn7Y9O62NUjXfEI3Bw4ID36YCdQ+CJd14r0YOf4M 5F50bvHV3lbzD9TXZPxecHKC2ZUMBbT37tsckWCLL3lzKMsqQLwBUmgBl1NIUc7gyXxiNyxb 6SPVF1NguDDM438mcg9jSRAyjgAk6POUEM8YIXkw0Gg6HF1tNMJJ1xTMBCLYl6fHTtsxJpf9 yo+Hnw346hqYzXn4ytHJ49Ngcre8uhqM1l8iMpa17tEjfalkc1FWR9/qvoowOKtxpvblsy3a YzeEFgIomhLzISz6IafQ3S7Mt5AFlqwN/qQHx0k2V66GzDG0ngZBPROP1sXSpdJzO0zbJQFn MZE3f+y8vXMcE/MBXR7kAdYYApiEMQzVxy9TdQDU3lGLptcPZ1IOntTNFFrvp5NwsKi+6C9i mXtd5kJ1PwhcJYW3/ov/490l60C5SFUL/RZ/NOW8SHFaPcqlGcqIlexFKbzrMQwmYXo95jWB eZ0Qn+raxCUFZNGiwtusyQGBMcpHVJUanOCNd1z4ZbfmhUjDJKC/7YWDunvaDRSukGiRCl6J s8caqXHiVZjx+s76iWzm6AHRP5jg9D6EtTOrGiE= Message-ID: <04c788e9-b625-1ad3-a0ce-d92605b76fc7@m5p.com> Date: Fri, 20 Apr 2018 09:52:44 -0400 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:52.0) Gecko/20100101 Thunderbird/52.7.0 MIME-Version: 1.0 In-Reply-To: <2a68cfd7-6823-296d-0392-c9b12c66f6e0@m5p.com> Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="evah7dfG4tJbk2k8RLp9ORo9InswaKamX" X-Spam-Status: No, score=0.2 required=10.0 tests=HELO_MISC_IP, RP_MATCHES_RCVD autolearn=no autolearn_force=no version=3.4.1 X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on mattapan.m5p.com X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.6.2 (mailhost.m5p.com [IPv6:2001:470:1f07:15ff::f7]); Fri, 20 Apr 2018 09:53:05 -0400 (EDT) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 20 Apr 2018 13:53:24 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --evah7dfG4tJbk2k8RLp9ORo9InswaKamX Content-Type: multipart/mixed; boundary="E4oDdVbjcBxt2g1OmXAyfwe0bv6NJqh1E"; protected-headers="v1" From: George Mitchell To: freebsd-stable@freebsd.org Message-ID: <04c788e9-b625-1ad3-a0ce-d92605b76fc7@m5p.com> Subject: Re: kern.sched.quantum: Creepy, sadistic scheduler References: <9FDC510B-49D0-4722-B695-6CD38CA20D4A@gmail.com> <8cfdb8a3-86a0-17ba-1e41-ff1912a30ee9@m5p.com> <20180417065617.GA95646@klump.hjerdalen.lokalnett> <20180417232016.2008438c.ebfe@inbox.ru> <2a68cfd7-6823-296d-0392-c9b12c66f6e0@m5p.com> In-Reply-To: <2a68cfd7-6823-296d-0392-c9b12c66f6e0@m5p.com> --E4oDdVbjcBxt2g1OmXAyfwe0bv6NJqh1E Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: quoted-printable On 04/17/18 19:01, George Mitchell wrote: > On 04/17/18 17:20, EBFE via freebsd-stable wrote: >> [...] >> For interactive tasks, there is a "special" tunable: >> % sysctl kern.sched.interact >> kern.sched.interact: 10 # default is 30 >> % sysctl -d kern.sched.interact >> kern.sched.interact: Interactivity score threshold >> >> reducing the value from 30 to 10-15 keeps your gui/system responsive, >> even under high load. >> [...] >=20 > I suspect my case (make buildworld while running misc/dnetc) doesn't > qualify. However, I just completed a SCHED_ULE run with > preempt_thresh set to 5, and "time make buildworld" reports: > 7336.748u 677.085s 9:25:19.86 23.6% 27482+473k 42147+431581io 38010= pf+0w > Much closer to SCHED_4BSD! I'll try preempt_thresh=3D0 next, and I > guess I'll at least try preempt_thresh=3D224 to see how that works > for me. -- George >=20 I've now done SCHED_ULE runs with preempt_thresh set to 0, 1, 5, 80, and 224. The wall clock time is uniformly in the vicinity of 10 hours. The "time" output is consistent with SCHED_4BSD, but the wall clock time is really what I care about. Now I have set kern.sched.preempt_thresh back to the default of 80 and I am experimenting with kern.sched.interact. I'm pretty sure that setting kern.sched.preempt_thresh is not the answer to my problem. -- George --E4oDdVbjcBxt2g1OmXAyfwe0bv6NJqh1E-- --evah7dfG4tJbk2k8RLp9ORo9InswaKamX Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEENdM4ZHktsJW5kKZXwRES3m+p4fkFAlrZ8LcACgkQwRES3m+p 4fmDMA/7BtS84Z1tqiYYf1GE1bx10znAa/tTxVg6Dx+MvOEkpKqNMzesWgCgJ/z1 afBpIwbzW73nR5+5EW+8tOaPvB7NvHtv0LlWE7/XVVgQWfGg1Rzg5h98Rm3wLAwF vcP8QkXOIUDBCTJbtWyqou9+BkVGlh3zf65iwIgXARwgeces9PUZxJl3ZOlqwnBH dRrqRGZnCFZr4wdmV/Jiauvr6K2lm+mvUXrlK196ASXDwamwiHCIWyIqkmopwhf/ P/e8qOMEV22ANIPdxBkRMfL24DpL2d+riVl5QnYtZNzmhMKji4jw4qaB7z0q8rpN n9/YwwSaimMBmt7yAsTcCdRwIXyUEndFuRkR9SuSTR83nGbO9ZQHHAAZQfj/+Eew MEUFxnCGHMtcBD22naQbMTLsvaGGdEPKcjsUe31/dyk5m71gP9dfu7tPKgWSW1Xr FJ19v7VZJR1rGfksIZXAVFBfN+Pry7ka1YSOzn8Hh9cFqKtQ35rnoIw3pO4WZyHz JFibXwh3OyMfIWrB/HEiCPHRtDwqfw+A6QdGcEJYXG2fmG+TTcy8E4JRhAnH2LMd xkI2kZt2IuGTV3zVWWmWYbe+eO+Mc5PUG5UOQC5S2+IUpVnZBPorzYSZBJtkhe3i Hw0expVpb4/zwEZvuqe9WJ4PfNymSDZsvnjh3jMJw1sv4mt/GPM= =iK9J -----END PGP SIGNATURE----- --evah7dfG4tJbk2k8RLp9ORo9InswaKamX-- From owner-freebsd-stable@freebsd.org Fri Apr 20 14:35:14 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C441CFA8AEC for ; Fri, 20 Apr 2018 14:35:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 57743821AA for ; Fri, 20 Apr 2018 14:35:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 023BDFA8ADB; Fri, 20 Apr 2018 14:35:14 +0000 (UTC) Delivered-To: stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E504BFA8ADA for ; Fri, 20 Apr 2018 14:35:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 85159821A8 for ; Fri, 20 Apr 2018 14:35:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id D070516C for ; Fri, 20 Apr 2018 14:35:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w3KEZCx4022392 for ; Fri, 20 Apr 2018 14:35:12 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w3KEZCsW022391 for stable@FreeBSD.org; Fri, 20 Apr 2018 14:35:12 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: stable@FreeBSD.org Subject: [Bug 227654] [panic] repeatable crash with IPv6+lagg+vlan+em Date: Fri, 20 Apr 2018 14:35:13 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.1-STABLE X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: eugen@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 20 Apr 2018 14:35:15 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D227654 --- Comment #1 from Eugene Grosbein --- $ addr2line -e kernel.debug -i -f -C ffffffff806fe6ac ether_output_frame /data2/src/sys/net/if_ethersubr.c:449 ether_output /data2/src/sys/net/if_ethersubr.c:435 (kgdb) l /data2/src/sys/net/if_ethersubr.c:449 444 int 445 ether_output_frame(struct ifnet *ifp, struct mbuf *m) 446 { 447 int i; 448=20=20=20=20=20 449 if (PFIL_HOOKED(&V_link_pfil_hook)) { 450 i =3D pfil_run_hooks(&V_link_pfil_hook, &m, ifp, PFIL_OUT, NULL); 451=20=20=20=20=20 452 if (i !=3D 0) 453 return (EACCES); --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-stable@freebsd.org Fri Apr 20 15:24:22 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id EA771FAC059 for ; Fri, 20 Apr 2018 15:24:21 +0000 (UTC) (envelope-from emaste@freebsd.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2610:1c1:1:6074::16:84]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "freefall.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 9FF586EABB for ; Fri, 20 Apr 2018 15:24:21 +0000 (UTC) (envelope-from emaste@freebsd.org) Received: by freefall.freebsd.org (Postfix, from userid 1079) id 96241CE3B; Fri, 20 Apr 2018 15:24:21 +0000 (UTC) Resent-From: Ed Maste Resent-Date: Fri, 20 Apr 2018 15:24:21 +0000 Resent-Message-ID: <20180420152421.GC62725@freebsd.org> Resent-To: freebsd-stable@freebsd.org Date: Fri, 20 Apr 2018 13:42:30 +0000 From: Ed Maste To: freebsd-current@freebsd.org Subject: HEADS-UP: Deprecation of legacy (v3) password database support Message-ID: <20180420134230.GB62725@freebsd.org> Mail-Followup-To: Ed Maste , freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.9.2 (2017-12-15) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 20 Apr 2018 15:24:22 -0000 FreeBSD password databases (/etc/pwd.db, /etc/spwd.db) can contain records in one or both of two versions: * v3, a legacy architecture-dependent format * v4, the current architecture- and endian-independent format When v4 support was added in 2003 (r113596) pwd_mkdb emitted both v3 and v4 records in the output database. In 2015 r283981 added a -l option to control the emission of legacy v3 records; by default only v4 records are emitted. r283981's commit message states: The -l, -B and -L options are considered deprecated and will be removed in FreeBSD 12.0 release. I'd expect little impact if the -l, -B and -L options are removed, as r113596 is included in FreeBSD 5.1 and later. If legacy support is removed then software built on FreeBSD 5.0 or earlier will no longer be able to make use of password file data (via getpwent, getpwnam, etc.). Such software would still function inside of a jail that has a v3 password database, of course. Is anyone using pwd_mkdb's -l option and relying on legacy password database files in a non-jailed context? From owner-freebsd-stable@freebsd.org Fri Apr 20 16:57:26 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E35B2FB1C9F for ; Fri, 20 Apr 2018 16:57:25 +0000 (UTC) (envelope-from petefrench@ingresso.co.uk) Received: from constantine.ingresso.co.uk (unknown [IPv6:2a02:b90:3002:411::3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 7F4668401B for ; Fri, 20 Apr 2018 16:57:25 +0000 (UTC) (envelope-from petefrench@ingresso.co.uk) Received: from [2a02:b90:3002:411::6] (helo=dilbert.ingresso.co.uk) by constantine.ingresso.co.uk with esmtpsa (TLSv1.2:ECDHE-RSA-AES256-GCM-SHA384:256) (Exim 4.89 (FreeBSD)) (envelope-from ) id 1f9ZLf-0000Py-Hc for freebsd-stable@freebsd.org; Fri, 20 Apr 2018 16:57:23 +0000 Received: from petefrench by dilbert.ingresso.co.uk with local (Exim 4.91 (FreeBSD)) (envelope-from ) id 1f9ZLf-0003Ni-En for freebsd-stable@freebsd.org; Fri, 20 Apr 2018 17:57:23 +0100 To: freebsd-stable@freebsd.org Subject: A little oddity with mlx4en Message-Id: From: Pete French Date: Fri, 20 Apr 2018 17:57:23 +0100 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 20 Apr 2018 16:57:26 -0000 This amsued me. If I run 'sysctl -a' on a box with a ConnectX-2 card in it then I get this message on console: "mlx4_core0: port level mtu is only used for IB ports" Quite surprised that listing sysctls results in messages to console! -pete. From owner-freebsd-stable@freebsd.org Fri Apr 20 23:19:42 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DE67EFAAB5C for ; Fri, 20 Apr 2018 23:19:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 756517B721 for ; Fri, 20 Apr 2018 23:19:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 31938FAAB5A; Fri, 20 Apr 2018 23:19:41 +0000 (UTC) Delivered-To: stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E900DFAAB59 for ; Fri, 20 Apr 2018 23:19:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 6B3687B6F5 for ; Fri, 20 Apr 2018 23:19:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id A74214A45 for ; Fri, 20 Apr 2018 23:19:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w3KNJdXd084173 for ; Fri, 20 Apr 2018 23:19:39 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w3KNJdLF084172 for stable@FreeBSD.org; Fri, 20 Apr 2018 23:19:39 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: stable@FreeBSD.org Subject: [Bug 227654] [panic] repeatable crash with IPv6+lagg+vlan+em Date: Fri, 20 Apr 2018 23:19:39 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.1-STABLE X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: eugen@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 20 Apr 2018 23:19:42 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D227654 --- Comment #2 from Eugene Grosbein --- Created attachment 192690 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D192690&action= =3Dedit debugging patch for single user only Forgot to note that my kernel has VIMAGE too. I've reproduced this with my home desktop that has serial console, so I've digged this a bit deeper suspecting that curvnet may be not initialized. I've added some debugging output, the diff is attached. KASSERT did not catch this for unknown reason, so it's commented out. Anyway, curvnet occured to be zero, so any attempt to use V_link_pfil_hook dereferences NULL producing this panic: ether_output_frame: vlan61: curvnet 0 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0453d37= 780 ether_output() at ether_output+0x64c/frame 0xfffffe0453d37820 arprequest() at arprequest+0x443/frame 0xfffffe0453d37920 arp_ifinit() at arp_ifinit+0x58/frame 0xfffffe0453d37960 arp_handle_ifllchange() at arp_handle_ifllchange+0x3d/frame 0xfffffe0453d37= 980 if_setlladdr() at if_setlladdr+0x21e/frame 0xfffffe0453d379e0 taskqueue_run_locked() at taskqueue_run_locked+0x14c/frame 0xfffffe0453d37a= 40 taskqueue_thread_loop() at taskqueue_thread_loop+0x88/frame 0xfffffe0453d37= a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0453d37ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0453d37ab0 --- trap 0, rip =3D 0, rsp =3D 0, rbp =3D 0 --- Fatal trap 12: page fault while in kernel mode cpuid =3D 3; apic id =3D 03 fault virtual address =3D 0x28 fault code =3D supervisor read data, page not present instruction pointer =3D 0x20:0xffffffff80aca683 stack pointer =3D 0x28:0xfffffe0453d37790 frame pointer =3D 0x28:0xfffffe0453d37820 code segment =3D base 0x0, limit 0xfffff, type 0x1b =3D DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags =3D interrupt enabled, resume, IOPL =3D 0 current process =3D 0 (thread taskq) trap number =3D 12 p --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-stable@freebsd.org Sat Apr 21 09:27:23 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9DB16FB2872 for ; Sat, 21 Apr 2018 09:27:23 +0000 (UTC) (envelope-from petefrench@ingresso.co.uk) Received: from constantine.ingresso.co.uk (unknown [IPv6:2a02:b90:3002:411::3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4292B82810; Sat, 21 Apr 2018 09:27:23 +0000 (UTC) (envelope-from petefrench@ingresso.co.uk) Received: from [2a02:b90:3002:411::6] (helo=dilbert.ingresso.co.uk) by constantine.ingresso.co.uk with esmtpsa (TLSv1.2:ECDHE-RSA-AES256-GCM-SHA384:256) (Exim 4.89 (FreeBSD)) (envelope-from ) id 1f9one-000CD6-NL; Sat, 21 Apr 2018 09:27:18 +0000 Received: from petefrench by dilbert.ingresso.co.uk with local (Exim 4.91 (FreeBSD)) (envelope-from ) id 1f9one-0006n1-K6; Sat, 21 Apr 2018 10:27:18 +0100 To: mike@sentex.net, nimrodl@gmail.com, petefrench@ingresso.co.uk Subject: Re: Ryzen issues on FreeBSD ? (with sort of workaround) Cc: avg@freebsd.org, eric@vangyzen.net, freebsd-stable@freebsd.org, freebsd@hda3.com, truckman@freebsd.org In-Reply-To: Message-Id: From: Pete French Date: Sat, 21 Apr 2018 10:27:18 +0100 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 21 Apr 2018 09:27:23 -0000 > Its not just the Ryzen, I can lock up Epyc CPUs as well. They take a bit > longer, but its not that hard to repeat. Unfortunately, I had to > allocate this hardware over the Linux where it works reliably under all > workloads without any such lock ups with all the default BIOS settings :( AH, thats a shame to hear - was hooing it had worked OK for you! > Here is a test case. > https://lists.freebsd.org/pipermail/freebsd-stable/2018-February/088433.html Will give that a try next week - when remote form the box I dont want to crash it, so no such tests at the weekend, but hen I am back will see. The lockup from Thursday was aan idle-lockup, and that hasnt happened since I chnaged the BIOS settings. May reenable those one at a time to see if any single one is reposible, unless anyone has any insight. Much hunch would be that SMT may be OK to re-enable as tat has nothing do do with loading, whcih the other two do. cheers, -pete. From owner-freebsd-stable@freebsd.org Sat Apr 21 09:36:12 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 141B1FB3390 for ; Sat, 21 Apr 2018 09:36:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 9261C835F1 for ; Sat, 21 Apr 2018 09:36:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 507F0FB3386; Sat, 21 Apr 2018 09:36:11 +0000 (UTC) Delivered-To: stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3F2CEFB3385 for ; Sat, 21 Apr 2018 09:36:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id D07DC835DA for ; Sat, 21 Apr 2018 09:36:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 1F6AD11C45 for ; Sat, 21 Apr 2018 09:36:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w3L9a93T091397 for ; Sat, 21 Apr 2018 09:36:09 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w3L9a9Rq091396 for stable@FreeBSD.org; Sat, 21 Apr 2018 09:36:09 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: stable@FreeBSD.org Subject: [Bug 227654] [panic] repeatable crash with lagg+vlan+em Date: Sat, 21 Apr 2018 09:36:10 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.1-STABLE X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: eugen@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: short_desc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 21 Apr 2018 09:36:12 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D227654 Eugene Grosbein changed: What |Removed |Added ---------------------------------------------------------------------------- Summary|[panic] repeatable crash |[panic] repeatable crash |with IPv6+lagg+vlan+em |with lagg+vlan+em --- Comment #3 from Eugene Grosbein --- It seems IPv6 has nothing to do with the problem as it is reproduceable with INET4-only kernel too. --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-stable@freebsd.org Sat Apr 21 17:27:54 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 59C40FB4D8A for ; Sat, 21 Apr 2018 17:27:54 +0000 (UTC) (envelope-from lists@eitanadler.com) Received: from mail-yw0-x22f.google.com (mail-yw0-x22f.google.com [IPv6:2607:f8b0:4002:c05::22f]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id E428E83124 for ; Sat, 21 Apr 2018 17:27:53 +0000 (UTC) (envelope-from lists@eitanadler.com) Received: by mail-yw0-x22f.google.com with SMTP id e63-v6so3748892ywh.6 for ; Sat, 21 Apr 2018 10:27:53 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=eitanadler.com; s=0xdeadbeef; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=8HUp8bs1reHDQi1Fj6DDfBVg2dOtKGKoEZKWEIOaHIE=; b=S1nXsTdTqRn97fU5NYWl+NQmb0kBMSL8zYRAS9nrpyUFFDjbCw0Mil9kHFDYuYL11F VTR5VTB3O1/jb5JLX6pgfbwtNY/DHgWIT9vUHixBUD6odEQTZH7HF+FBxgchQzsAoSnU LsuW3dV7spykwLjl2Jj9qMP5X5X1HwjR83b28= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=8HUp8bs1reHDQi1Fj6DDfBVg2dOtKGKoEZKWEIOaHIE=; b=sKvt96931d7JHyBup6h1t5IHSuh/xtzdF4KDmUjD7pQ9RnrGRhe/xCyL61WSKvFrUH RoGuZWMIy8AygC5DUptOXa5pp7xlcJ4fCsnSjeT7r6RznKSGi1oYDU/v48C6tEOuDH0o SJv+YXC87TkH/pWt5rLQLzV0fVedqMGFaZvpk3PVGbX6RjsDtc1bFs9FmzqmK9mLnemD NQWkKVjRf2V1epiSSe0kpNEGzqxdM3qdNQZ80N+jzMRDG6AB3eLcKJFccfwMHkxyUFsc 5x6T1b/2QImot63I1PDKbHPDNKjmMAjIulVQynhY2YMeqyGBwQmOdqTrMi8+CnFJlOJm Zoww== X-Gm-Message-State: ALQs6tBSHOHS6yh3Eu5fzeWT6Pff7Cje4rtiZD7czFkY0f5PiyOhEDW+ BxJEo0qjInbhuidog6ewEBW4KL7JHAESoumEb9wt+A== X-Google-Smtp-Source: AIpwx4/luNuOOvMONiPhQM/Lfgj2GyxZwb37OB5kdgvIoYOYYh8m3UZMJNmXCOoR1iF7mJ+UaT+6RsK+6dlqJdlT03o= X-Received: by 2002:a81:6dd0:: with SMTP id i199-v6mr7999566ywc.141.1524331673125; Sat, 21 Apr 2018 10:27:53 -0700 (PDT) MIME-Version: 1.0 Received: by 2002:a25:c709:0:0:0:0:0 with HTTP; Sat, 21 Apr 2018 10:27:22 -0700 (PDT) In-Reply-To: References: From: Eitan Adler Date: Sat, 21 Apr 2018 10:27:22 -0700 Message-ID: Subject: Re: Ryzen issues on FreeBSD ? (with sort of workaround) To: Pete French Cc: Eric van Gyzen , freebsd@hda3.com, Don Lewis , freebsd-stable , Andriy Gapon Content-Type: text/plain; charset="UTF-8" X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 21 Apr 2018 17:27:54 -0000 On 20 April 2018 at 04:15, Pete French wrote: > So, resurrecting the thread from a few weeks ago, as I finally found > time yesterday to out together the Ryzen machine I bought the parts for in > Jaunary (busy year at work....). All went smoothl;y, checked it > booted up, used it for 15 minutes, was impressed by the speed and went home. > > ...and by the time I got home, an hour or so later, it had locked up hard. ... I have a Ryzen system parts: https://pcpartpicker.com/list/HhycYT dmesg: http://dmesgd.nycbug.org/index.cgi?do=view&id=3516 which I have been using for months without issue and on completely default settings. What mobo do you have? Did you update the BIOS to the latest version? -- Eitan Adler