From owner-freebsd-stable@freebsd.org Sun Feb 3 21:01:04 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id ACA3D14B27BE for ; Sun, 3 Feb 2019 21:01:04 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 0FA6A864D3 for ; Sun, 3 Feb 2019 21:01:04 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: by mailman.ysv.freebsd.org (Postfix) id BD13514B27A5; Sun, 3 Feb 2019 21:01:03 +0000 (UTC) Delivered-To: stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A817914B27A2 for ; Sun, 3 Feb 2019 21:01:03 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 31678864BF for ; Sun, 3 Feb 2019 21:01:03 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 37C38192AC for ; Sun, 3 Feb 2019 21:01:02 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id x13L12q2009705 for ; Sun, 3 Feb 2019 21:01:02 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id x13L12Fc009695 for stable@FreeBSD.org; Sun, 3 Feb 2019 21:01:02 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <201902032101.x13L12Fc009695@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: stable@FreeBSD.org Subject: Problem reports for stable@FreeBSD.org that need special attention Date: Sun, 3 Feb 2019 21:01:02 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 03 Feb 2019 21:01:04 -0000 To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- New | 230620 | "install -d" issue 1 problems total for which you should take action. From owner-freebsd-stable@freebsd.org Sun Feb 3 23:00:28 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8747414B66FA for ; Sun, 3 Feb 2019 23:00:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 165C08A6DF for ; Sun, 3 Feb 2019 23:00:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id C0D3C14B66F7; Sun, 3 Feb 2019 23:00:27 +0000 (UTC) Delivered-To: stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id AF2A814B66F6 for ; Sun, 3 Feb 2019 23:00:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 490C98A6DA for ; Sun, 3 Feb 2019 23:00:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 8C0531A47C for ; Sun, 3 Feb 2019 23:00:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id x13N0QZg078926 for ; Sun, 3 Feb 2019 23:00:26 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id x13N0QBh078924 for stable@FreeBSD.org; Sun, 3 Feb 2019 23:00:26 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: stable@FreeBSD.org Subject: [Bug 233006] [regression] [patch] bsdtar aborts creation of archive on ENOENT Date: Sun, 03 Feb 2019 23:00:25 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 11.2-STABLE X-Bugzilla-Keywords: patch, regression X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: mm@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: mm@FreeBSD.org X-Bugzilla-Flags: mfc-stable11? mfc-stable12? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 03 Feb 2019 23:00:28 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D233006 --- Comment #13 from Martin Matuska --- Hi Eugene, I have modified your patch to operate only if descended into subdirectories. It has broken the missing file test because missing files on top-level have been ignored as well. Sometimes more files are processed at a time, so it was necessary to process the error string a bit differently as well. Could you please check the libarchive pull request #1131 if it fixes your issue?=20 https://github.com/libarchive/libarchive/pull/1131 --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-stable@freebsd.org Mon Feb 4 07:37:10 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D004814C1D9E for ; Mon, 4 Feb 2019 07:37:10 +0000 (UTC) (envelope-from sthaug@nethelp.no) Received: from bizet.nethelp.no (bizet.nethelp.no [IPv6:2001:8c0:9e04:500::1]) by mx1.freebsd.org (Postfix) with ESMTP id 20AD871B09 for ; Mon, 4 Feb 2019 07:37:10 +0000 (UTC) (envelope-from sthaug@nethelp.no) Received: from localhost (bizet.nethelp.no [IPv6:2001:8c0:9e04:500::1]) by bizet.nethelp.no (Postfix) with ESMTP id 6D86BE6079 for ; Mon, 4 Feb 2019 08:37:00 +0100 (CET) Date: Mon, 04 Feb 2019 08:37:00 +0100 (CET) Message-Id: <20190204.083700.93851595.sthaug@nethelp.no> To: freebsd-stable@freebsd.org Subject: 64-bit integer overflow computing user cpu time in calcru() in kern_resource.c From: sthaug@nethelp.no X-Mailer: Mew version 6.7 on Emacs 26 / Mule 6.0 (HANACHIRUSATO) Mime-Version: 1.0 Content-Type: Text/Plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 04 Feb 2019 07:37:11 -0000 Hi, We use FreeBSD 11.2-STABLE for 5 recursive name servers, with PowerDNS recursor as the actual name server software. I recently complained on the pdns-users list that some graphs based on information from the name server process stopped working after a while (typically a week or less): https://mailman.powerdns.com/pipermail/pdns-users/2019-January/025739.html Bert Hubert of PowerDNS led me to https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=227689 and it definitely looks like this is the bug causing the disappearing graphs that I see. In https://mailman.powerdns.com/pipermail/pdns-users/2019-January/025742.html you can see the effect on the getrusage() call - in short, the values simply stop incrementing after a while. I fixed the problem by following the link from https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=227689 to https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=76972 which has an attachment (kern_resource.c.patch.txt) at https://bz-attachments.freebsd.org/attachment.cgi?id=50537 After adding this patch and rebooting, the problem has not recoccurred in nearly two weeks. I'm reasonably sure that the problem really has been fixed. I checked the code at the same place in HEAD, from https://svnweb.freebsd.org/base/head/sys/kern/kern_resource.c?view=markup and the bug appears to still be present in HEAD. So, I'd love it if somebody could - Update bugs 76972 and 227689 to note that this affects more than one person. - Fix this in HEAD and hopefully also MFC to 11.2-STABLE. Steinar Haug, Nethelp consulting, sthaug@nethelp.no From owner-freebsd-stable@freebsd.org Mon Feb 4 15:00:31 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 460A014D2B42 for ; Mon, 4 Feb 2019 15:00:31 +0000 (UTC) (envelope-from petefrench@ingresso.co.uk) Received: from constantine.ingresso.co.uk (unknown [IPv6:2a02:b90:3002:411::3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 79D5F8AB69 for ; Mon, 4 Feb 2019 15:00:29 +0000 (UTC) (envelope-from petefrench@ingresso.co.uk) Received: from [2a02:b90:3002:411::6] (helo=dilbert.ingresso.co.uk) by constantine.ingresso.co.uk with esmtpsa (TLSv1.2:ECDHE-RSA-AES256-GCM-SHA384:256) (Exim 4.91 (FreeBSD)) (envelope-from ) id 1gqfjX-000NMV-H0; Mon, 04 Feb 2019 15:00:27 +0000 Received: from petefrench by dilbert.ingresso.co.uk with local (Exim 4.91 (FreeBSD)) (envelope-from ) id 1gqfjX-000Onk-El; Mon, 04 Feb 2019 15:00:27 +0000 To: petefrench@ingresso.co.uk, rkoberman@gmail.com Subject: Re: More CARP issues under 12 (maybe not CARP after all) Cc: freebsd-stable@freebsd.org In-Reply-To: <3d452e3e-d723-e1a6-62af-9a1def83dacf@ingresso.co.uk> Message-Id: From: Pete French Date: Mon, 04 Feb 2019 15:00:27 +0000 X-Rspamd-Queue-Id: 79D5F8AB69 X-Spamd-Bar: +++ Authentication-Results: mx1.freebsd.org; dmarc=pass (policy=none) header.from=ingresso.co.uk; spf=pass (mx1.freebsd.org: domain of petefrench@ingresso.co.uk designates 2a02:b90:3002:411::3 as permitted sender) smtp.mailfrom=petefrench@ingresso.co.uk X-Spamd-Result: default: False [3.29 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RDNS_NONE(1.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+ip6:2a02:b90:3002:411::3]; NEURAL_HAM_LONG(-0.54)[-0.542,0]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; NEURAL_SPAM_MEDIUM(0.70)[0.704,0]; NEURAL_SPAM_SHORT(0.46)[0.455,0]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MX_GOOD(-0.01)[ingresso-co-uk.mail.protection.outlook.com,ingresso-co-uk.mail.protection.outlook.com]; DMARC_POLICY_ALLOW(-0.50)[ingresso.co.uk,none]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:16082, ipnet:2a02:b90::/32, country:GB]; HFILTER_HOSTNAME_UNKNOWN(2.50)[]; IP_SCORE(-0.02)[country: GB(-0.09)] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 04 Feb 2019 15:00:31 -0000 > > To point out the obvious, booting a 12.0 kernel with 11.0 userland to > > multiuser mode is seriously unsupported. You really need to boot to > > single user and install 12.0 userland to really expect things to work. > > Yes, good point. This has worked on every other machine I have upgraded > from 11 to 12, which is why I didnt think of that, but then all the > motherboards are slightly different. So, I went back to this, and di it properly. Booted single user mode, which worked, then installed world, mergemaster, and rebooted single user mode. ...and I get a kernel panic as I did before. So it wasn't the 11 world with the 12 kernel after all. Panic is reproduced below. I am somewhat stuck now though - where do I go from here ? Feeding entropy lo0: link state changed to UP carp: demoted by 240 to 240 (interface down) Fatal trap 12: page fault while in kernel mode cpuid = 0; apic id = 00 fault virtual address = 0x28 fault code = supervisor read data, page not present instruction pointer = 0x20:0xffffffff80ca1621 stack pointer = 0x28:0xfffffe00004da740 frame pointer = 0x28:0xfffffe00004da760 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 12 (swi4: clock (0)) trap number = 12 panic: page fault cpuid = 0 time = 1549292394 KDB: stack backtrace: #0 0xffffffff80be8d57 at kdb_backtrace+0x67 #1 0xffffffff80b9d293 at vpanic+0x1a3 #2 0xffffffff80b9d0e3 at panic+0x43 #3 0xffffffff8107384f at trap_fatal+0x35f #4 0xffffffff810738a9 at trap_pfault+0x49 #5 0xffffffff81072ece at trap+0x29e #6 0xffffffff8104ee55 at calltrap+0x8 #7 0xffffffff80ca1526 at ether_output+0x6b6 #8 0xffffffff80d0c824 at arprequest+0x4c4 #9 0xffffffff80d0e47c at garp_rexmit+0xbc #10 0xffffffff80bb7169 at softclock_call_cc+0x129 #11 0xffffffff80bb7649 at softclock+0x79 #12 0xffffffff80b613a4 at ithread_loop+0x1d4 #13 0xffffffff80b5e2d2 at fork_exit+0x82 #14 0xffffffff8104fe3e at fork_trampoline+0xe Uptime: 11s From owner-freebsd-stable@freebsd.org Mon Feb 4 15:52:17 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 49C3914D3BE9 for ; Mon, 4 Feb 2019 15:52:17 +0000 (UTC) (envelope-from marcnarc@gmail.com) Received: from mail-qk1-x744.google.com (mail-qk1-x744.google.com [IPv6:2607:f8b0:4864:20::744]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 46D208C3FE for ; Mon, 4 Feb 2019 15:52:16 +0000 (UTC) (envelope-from marcnarc@gmail.com) Received: by mail-qk1-x744.google.com with SMTP id q1so169524qkf.13 for ; Mon, 04 Feb 2019 07:52:16 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=subject:from:to:references:message-id:date:user-agent:mime-version :in-reply-to:content-language:content-transfer-encoding; bh=UDP7cz401/TY7LyU2ePqYBoDV05DsrpJOENZzCkHOvI=; b=S0pAALQDx8wyI2NX9ffpcIFgG+7i1msEGLmc/eAhYBBx6WhW8dtKOD5gEev1Hr+RR/ UCIBdrXVxRcMvlGKMhFcrJslKcMIeV/IFURHXZySoIyD/UBGbN52IJomH9ad//HWISj6 nsODdhpGR0pzB58wlYMiuPFfv3mDDRiZBdpjVGGtZ9ZXr341x8r0pQKd6WaArjYmgyMk n9JGLa071NM5SqXWB+WOu7eMxOMKxFlUV3SoNFGzOUg+0c4yUOvZHwlJoB1/b/bLapt/ SfVnsPsG6ADRgLhM04dTPaxLpb+xcrNjvRk74Fc0sqH8+RSO+r9K/MFownYnfiNT05dF 8/ag== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:from:to:references:message-id:date :user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=UDP7cz401/TY7LyU2ePqYBoDV05DsrpJOENZzCkHOvI=; b=bFKWQ7KaXyQWV84W9WazmagqUxP2odE+UZ2lYhdjCSkEeKcZ8jXn9VoIVa697RRDSm AEJW1OJRpKC4iYUO7uNN0QLqs5HFp03IIn0/xLA2LFVYXU/af3CLp1tPxttyvah0/Wd1 Lo3pdOlO7u0B+BDxum0JpFGwer+ZNj9/xi3pU9oYjL0m/RvC6GulmRTgGz3y+9KxoNog SAhYCLj1ofjHWzSME10Xvmg3M0UyxGiWLCOeKBOI5OehTEw7NDP1NWiq/YXhT1rSx9zy Fx+sNTzAAx4aAuw9266I59+mhnjCsV2ISLKMAR77jNtFr1KuztBXeFoo0NpFwTyBxn05 oEwA== X-Gm-Message-State: AHQUAuYWmUMZMMdpI5M58f8U39xKu8G/BkNEah3duiL/gMC9PjK6GjuY e3y8Bf+9wN0/YwEzQQwk4uo= X-Google-Smtp-Source: AHgI3IaE3qH3hk2m5uRrYEg0Uk+f508EuUGoDUIaZnuXqLDQ/slvUBvnwVPrXnNJLQg9URao75b47w== X-Received: by 2002:a37:7e86:: with SMTP id z128mr42993qkc.20.1549295535598; Mon, 04 Feb 2019 07:52:15 -0800 (PST) Received: from [10.10.1.32] ([192.252.130.194]) by smtp.gmail.com with ESMTPSA id q2sm10482669qkc.68.2019.02.04.07.52.14 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Mon, 04 Feb 2019 07:52:14 -0800 (PST) Subject: devel/jenkins upgrade glitch (was: Re: Minor 11.1 -> 11.2 upgrade glitch) From: Marc Branchaud To: FreeBSD Stable References: Message-ID: <3dd644ba-dbc0-786e-278d-58b86d197187@gmail.com> Date: Mon, 4 Feb 2019 10:52:14 -0500 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101 Thunderbird/60.4.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: 46D208C3FE X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=S0pAALQD; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of marcnarc@gmail.com designates 2607:f8b0:4864:20::744 as permitted sender) smtp.mailfrom=marcnarc@gmail.com X-Spamd-Result: default: False [-4.12 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; FREEMAIL_FROM(0.00)[gmail.com]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-0.73)[-0.728,0]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.999,0]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; IP_SCORE(-0.39)[ip: (2.50), ipnet: 2607:f8b0::/32(-2.43), asn: 15169(-1.94), country: US(-0.07)]; RCVD_IN_DNSWL_NONE(0.00)[4.4.7.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 04 Feb 2019 15:52:17 -0000 On 2018-09-17 11:07 a.m., Marc Branchaud wrote: > Hi all, > > I have a ZFS dataset mounted under /usr/local/jenkins.  I've made this > the home directory of my jenkins user, so that directory has to be owned > by jenkins. > >     # cd /usr/local >     # ls -ld jenkins >     drwxr-xr-x  20 jenkins  jenkins  75 Sep 17 10:48 jenkins > > After upgrading from 11.1 to 11.2, the directory ended up owned by root: > >     drwxr-xr-x  20 root  jenkins  75 Sep 17 10:48 jenkins Some follow-up info... I have contacted devel/jenkins's maintainer, Li-Wen Hsu, and have opened a new bug: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=235356 Li-Wen reports that he can't reproduce the problem in 12.0 or CURRENT, with pkg 1.10.5_5. (I am also using pkg 1.10.5_5, but on 11.2.) A very similar (possibly identical) bug in was fixed in 2014: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=193670 The issue was also in devel/jenkins-lts, also fixed in 2014: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=194274 M. > Only the directory ownership changed -- all the contents were still > owned by jenkins. > > Not a big deal, but I did have a moment of dread when jenkins failed to > start after the upgrade. > > So is this a bug, or is there some policy that everything immediately > under /usr/local should be owned by root? > >         M. From owner-freebsd-stable@freebsd.org Tue Feb 5 08:59:58 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 33DC214D5FDE for ; Tue, 5 Feb 2019 08:59:58 +0000 (UTC) (envelope-from petefrench@ingresso.co.uk) Received: from constantine.ingresso.co.uk (unknown [IPv6:2a02:b90:3002:411::3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 084FC95C13 for ; Tue, 5 Feb 2019 08:59:56 +0000 (UTC) (envelope-from petefrench@ingresso.co.uk) Received: from [82.47.240.30] (helo=foula.drayhouse.twisted.org.uk) by constantine.ingresso.co.uk with esmtpsa (TLSv1.2:ECDHE-RSA-AES128-GCM-SHA256:128) (Exim 4.91 (FreeBSD)) (envelope-from ) id 1gqwaA-000MeG-VI; Tue, 05 Feb 2019 08:59:55 +0000 Subject: Kernel panic going multiuser under 12 ( was Re: More CARP issues under 12 (maybe not CARP after all)) To: rkoberman@gmail.com Cc: freebsd-stable@freebsd.org References: From: Pete French Message-ID: <5a3c8443-cc01-2cfb-0e17-c584d1720e44@ingresso.co.uk> Date: Tue, 5 Feb 2019 08:59:55 +0000 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.11; rv:65.0) Gecko/20100101 Thunderbird/65.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 084FC95C13 X-Spamd-Bar: +++ Authentication-Results: mx1.freebsd.org; dmarc=pass (policy=none) header.from=ingresso.co.uk; spf=pass (mx1.freebsd.org: domain of petefrench@ingresso.co.uk designates 2a02:b90:3002:411::3 as permitted sender) smtp.mailfrom=petefrench@ingresso.co.uk X-Spamd-Result: default: False [3.33 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a02:b90:3002:411::3]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; RDNS_NONE(1.00)[]; NEURAL_SPAM_MEDIUM(0.85)[0.849,0]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MX_GOOD(-0.01)[cached: ingresso-co-uk.mail.protection.outlook.com]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[ingresso.co.uk,none]; NEURAL_HAM_SHORT(-0.21)[-0.211,0]; NEURAL_SPAM_LONG(0.02)[0.019,0]; IP_SCORE(-0.02)[country: GB(-0.09)]; FREEMAIL_TO(0.00)[gmail.com]; RECEIVED_SPAMHAUS_PBL(0.00)[30.240.47.82.zen.spamhaus.org : 127.0.0.11]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:16082, ipnet:2a02:b90::/32, country:GB]; HFILTER_HOSTNAME_UNKNOWN(2.50)[]; MID_RHS_MATCH_FROM(0.00)[]; FROM_EQ_ENVFROM(0.00)[] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 05 Feb 2019 08:59:58 -0000 Just to get the subject correct, as I tested this disabling CARP and I still see the panic when going multi-user. It netwprking related as the panic is in the ARP code, and seems to happen when the network interfaces are configured. The machine was using a mix of em and igb interfaces, but is now igb only. -pete. From owner-freebsd-stable@freebsd.org Tue Feb 5 14:47:58 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id F09D014BB7EF for ; Tue, 5 Feb 2019 14:47:57 +0000 (UTC) (envelope-from bu7cher@yandex.ru) Received: from forward106o.mail.yandex.net (forward106o.mail.yandex.net [IPv6:2a02:6b8:0:1a2d::609]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 7F7AD75F65 for ; Tue, 5 Feb 2019 14:47:56 +0000 (UTC) (envelope-from bu7cher@yandex.ru) Received: from mxback16o.mail.yandex.net (mxback16o.mail.yandex.net [IPv6:2a02:6b8:0:1a2d::67]) by forward106o.mail.yandex.net (Yandex) with ESMTP id E2F545060C81; Tue, 5 Feb 2019 17:47:52 +0300 (MSK) Received: from smtp4o.mail.yandex.net (smtp4o.mail.yandex.net [2a02:6b8:0:1a2d::28]) by mxback16o.mail.yandex.net (nwsmtp/Yandex) with ESMTP id mDEKM1zYw5-lq4GTZq3; Tue, 05 Feb 2019 17:47:52 +0300 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yandex.ru; s=mail; t=1549378072; bh=eMyVtl4bEa5akpG8mXhmJr2hIDs5+iedKjw7fohs4XM=; h=Subject:To:References:From:Message-ID:Date:In-Reply-To; b=SU13boiOgAyU1cGbVco/w6wUv+OyuyflsMVF+XRtUgMJ9GQ6l3gL0UFokF5YYqmX8 lgNg5D1v7CpHYdbZWBgFHLFL6UOdnPHJ9oIS+Ahv6/7a64+lOB0i1y4QZWw1VqUzSa VjQJ0DR0lYmcKp1vVQM/aNwAWVhMV3T+naWHXeBc= Received: by smtp4o.mail.yandex.net (nwsmtp/Yandex) with ESMTPSA id W9UwcmBuy9-lpBqrIQY; Tue, 05 Feb 2019 17:47:51 +0300 (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client certificate not present) Subject: Re: More CARP issues under 12 To: Pete French , freebsd-stable@freebsd.org References: From: "Andrey V. Elsukov" Openpgp: id=E6591E1B41DA1516F0C9BC0001C5EA0410C8A17A Autocrypt: addr=bu7cher@yandex.ru; prefer-encrypt=mutual; keydata= mQENBEwBF1kBCADB9sXFhBEUy8qQ4X63Y8eBatYMHGEFWN9ypS5lI3RE6qQW2EYbxNk7qUC5 21YIIS1mMFVBEfvR7J9uc7yaYgFCEb6Sce1RSO4ULN2mRKGHP3/Sl0ijZEjWHV91hY1YTHEF ZW/0GYinDf56sYpDDehaBF5wkWIo1+QK5nmj3vl0DIDCMNd7QEiWpyLVwECgLX2eOAXByT8B bCqVhJGcG6iFP7/B9Ll6uX5gb8thM9LM+ibwErDBVDGiOgvfxqidab7fdkh893IBCXa82H9N CNwnEtcgzh+BSKK5BgvPohFMgRwjti37TSxwLu63QejRGbZWSz3OK3jMOoF63tCgn7FvABEB AAG0JUFuZHJleSBWLiBFbHN1a292IDxidTdjaGVyQHlhbmRleC5ydT6JATgEEwECACIFAkwB F1kCGwMGCwkIBwMCBhUIAgkKCwQWAgMBAh4BAheAAAoJEAHF6gQQyKF6qmYIAI6ekfm1VA4T vqankI1ISE6ku4jV7UlpIQlEbE7/8n3Zd6teJ+pGOQhN5qk8QE7utdPdbktAzi+x7LIJVzUw 4TywZLXGrkP7VKYkfg6oyCGyzITghefQeJtr2TN4hYCkzPWpylkue8MtmqfZv/6royqwTbN+ +E09FQNvTgRUYJYTeQ1qOsxNRycwvw3dr2rOfuxShbzaHBB1pBIjGrMg8fC5pd65ACH5zuFV A0CoTNGMDrEZSfBkTW604UUHFFXeCoC3dwDZRKOWJ3GmMXns65Ai5YkA63BSHEE1Qle3VBhd cG1w0CB5FBV3pB27UVnf0jEbysrDqW4qN7XMRFSWNAy5AQ0ETAEXWQEIAJ2p6l9LBoqdH/0J PEFDY2t2gTvAuzz+8zs3R03dFuHcNbOwjvWCG0aOmVpAzkRa8egn5JB4sZaFUtKPYJEQ1Iu+ LUBwgvtXf4vWpzC67zs2dDuiW4LamH5p6xkTD61aHR7mCB3bg2TUjrDWn2Jt44cvoYxj3dz4 S49U1rc9ZPgD5axCNv45j72tggWlZvpefThP7xT1OlNTUqye2gAwQravXpZkl5JG4eOqJVIU X316iE3qso0iXRUtO7OseBf0PiVmk+wCahdreHOeOxK5jMhYkPKVn7z1sZiB7W2H2TojbmcK HZC22sz7Z/H36Lhg1+/RCnGzdEcjGc8oFHXHCxUAEQEAAYkBHwQYAQIACQUCTAEXWQIbDAAK CRABxeoEEMihegkYCAC3ivGYNe2taNm/4Nx5GPdzuaAJGKWksV+w9mo7dQvU+NmI2az5w8vw 98OmX7G0OV9snxMW+6cyNqBrVFTu33VVNzz9pnqNCHxGvj5dL5ltP160JV2zw2bUwJBYsgYQ WfyJJIM7l3gv5ZS3DGqaGIm9gOK1ANxfrR5PgPzvI9VxDhlr2juEVMZYAqPLEJe+SSxbwLoz BcFCNdDAyXcaAzXsx/E02YWm1hIWNRxanAe7Vlg7OL+gvLpdtrYCMg28PNqKNyrQ87LQ49O9 50IIZDOtNFeR0FGucjcLPdS9PiEqCoH7/waJxWp6ydJ+g4OYRBYNM0EmMgy1N85JJrV1mi5i Message-ID: <49a5ec49-a8d4-2d13-bc94-c8a7cc41fadd@yandex.ru> Date: Tue, 5 Feb 2019 17:44:09 +0300 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:60.0) Gecko/20100101 Thunderbird/60.4.0 MIME-Version: 1.0 In-Reply-To: Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="Lscd3BghQNhW5ButiOjmgpCk5WvHekcCp" X-Rspamd-Queue-Id: 7F7AD75F65 X-Spamd-Bar: ------- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yandex.ru header.s=mail header.b=SU13boiO; dmarc=pass (policy=none) header.from=yandex.ru; spf=pass (mx1.freebsd.org: domain of bu7cher@yandex.ru designates 2a02:6b8:0:1a2d::609 as permitted sender) smtp.mailfrom=bu7cher@yandex.ru X-Spamd-Result: default: False [-7.94 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a02:6b8:0:1a2d::/64]; FREEMAIL_FROM(0.00)[yandex.ru]; HAS_ATTACHMENT(0.00)[]; RCVD_COUNT_THREE(0.00)[4]; DKIM_TRACE(0.00)[yandex.ru:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[yandex.ru,none]; MX_GOOD(-0.01)[mx.yandex.ru,mx.yandex.ru,mx.yandex.ru,mx.yandex.ru,mx.yandex.ru]; SIGNED_PGP(-2.00)[]; NEURAL_HAM_SHORT(-1.00)[-0.997,0]; RCVD_IN_DNSWL_LOW(-0.10)[9.0.6.0.0.0.0.0.0.0.0.0.0.0.0.0.d.2.a.1.0.0.0.0.8.b.6.0.2.0.a.2.list.dnswl.org : 127.0.5.1]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:+]; FREEMAIL_ENVFROM(0.00)[yandex.ru]; ASN(0.00)[asn:13238, ipnet:2a02:6b8::/32, country:RU]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[yandex.ru.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[yandex.ru:s=mail]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.20)[multipart/signed,multipart/mixed,text/plain]; RCVD_TLS_LAST(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; IP_SCORE(-1.73)[ipnet: 2a02:6b8::/32(-4.81), asn: 13238(-3.84), country: RU(0.00)] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 05 Feb 2019 14:47:58 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --Lscd3BghQNhW5ButiOjmgpCk5WvHekcCp Content-Type: multipart/mixed; boundary="R2UtZJELS9cmfM9ZSpcQ20u7Mw3Up04ip"; protected-headers="v1" From: "Andrey V. Elsukov" To: Pete French , freebsd-stable@freebsd.org Message-ID: <49a5ec49-a8d4-2d13-bc94-c8a7cc41fadd@yandex.ru> Subject: Re: More CARP issues under 12 References: In-Reply-To: --R2UtZJELS9cmfM9ZSpcQ20u7Mw3Up04ip Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: quoted-printable On 17.01.2019 15:19, Pete French wrote: > so, having got a workaround for yesterdays problems, I now went to upgr= ade my > other pair of boxes using CARP. No 'pf' on these, just one shared addre= ss. > This is the setup I have tested in development and it works fine. >=20 > I install the new kenel and do the first reboot - and I get the panic > below. Maybe its not carp related, but seems suspicious as the last > thing it spits out is a carp message. >=20 > Fatal trap 12: page fault while in kernel mode > cpuid =3D 0; apic id =3D 00 > fault virtual address =3D 0x28 > fault code =3D supervisor read data, page not present > instruction pointer =3D 0x20:0xffffffff80ca0de1 > stack pointer =3D 0x28:0xfffffe00004da740 > frame pointer =3D 0x28:0xfffffe00004da760 > code segment =3D base 0x0, limit 0xfffff, type 0x1b > =3D DPL 0, pres 1, long 1, def32 0, gran 1 > processor eflags =3D interrupt enabled, resume, IOPL =3D 0 > current process =3D 12 (swi4: clock (0)) > trap number =3D 12 > panic: page fault > cpuid =3D 0 > time =3D 1547727391 > KDB: stack backtrace: > #0 0xffffffff80be8597 at kdb_backtrace+0x67 > #1 0xffffffff80b9ccf3 at vpanic+0x1a3 > #2 0xffffffff80b9cb43 at panic+0x43 > #3 0xffffffff8107382f at trap_fatal+0x35f > #4 0xffffffff81073889 at trap_pfault+0x49 > #5 0xffffffff81072eae at trap+0x29e > #6 0xffffffff8104e1a5 at calltrap+0x8 > #7 0xffffffff80ca0ce6 at ether_output+0x6b6 > #8 0xffffffff80d0bda4 at arprequest+0x4c4 > #9 0xffffffff80d0d9fc at garp_rexmit+0xbc > #10 0xffffffff80bb6ba9 at softclock_call_cc+0x129 > #11 0xffffffff80bb7089 at softclock+0x79 > #12 0xffffffff80b60e79 at ithread_loop+0x169 > #13 0xffffffff80b5e012 at fork_exit+0x82 > #14 0xffffffff8104f18e at fork_trampoline+0xe > Uptime: 19s Hi, What branch and revision do you use? Can you install gdb and then obtain this information: # kgdb (kgdb) list *ether_output+0x6b6 --=20 WBR, Andrey V. Elsukov --R2UtZJELS9cmfM9ZSpcQ20u7Mw3Up04ip-- --Lscd3BghQNhW5ButiOjmgpCk5WvHekcCp Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Comment: Using GnuPG with Thunderbird - https://www.enigmail.net/ iQEzBAEBCAAdFiEE5lkeG0HaFRbwybwAAcXqBBDIoXoFAlxZoT0ACgkQAcXqBBDI oXqS8Qf8DL2ednXGtPN+GY0FUdNdnQVgErpcVXSLffAcf1KCG8PwqsXMjdWLnIQK OcFe0R7Ousjue1re1SavujZjKfVtkg4GHpmArpgZ64QNowgajVrDeUV41/VkpBPc iHTlL+IXUfKY34ntawUPg8FYy7W10tKeFg1C9x0LQ6wvFc1pKRMNUWIjzvV0LvU8 263uGPnQZ83NxGe+2X3ccAsm1uu7QgDxecmB6k2aRKkbeMZeTo+hQm5Chto17lES OqGChYKx3wDl8cWz9blJz4tLJaYwY8nRb9OxUtxiJxD7AdjgA8WXFigvtDIMlZMA o/HvKnQq1SBig5o33GQM/fHorzElQg== =MHhw -----END PGP SIGNATURE----- --Lscd3BghQNhW5ButiOjmgpCk5WvHekcCp-- From owner-freebsd-stable@freebsd.org Tue Feb 5 15:06:07 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 55FD114BC3CB for ; Tue, 5 Feb 2019 15:06:07 +0000 (UTC) (envelope-from petefrench@ingresso.co.uk) Received: from constantine.ingresso.co.uk (unknown [IPv6:2a02:b90:3002:411::3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id F1C92772C7 for ; Tue, 5 Feb 2019 15:06:05 +0000 (UTC) (envelope-from petefrench@ingresso.co.uk) Received: from [2a02:b90:3002:411::6] (helo=dilbert.ingresso.co.uk) by constantine.ingresso.co.uk with esmtpsa (TLSv1.2:ECDHE-RSA-AES256-GCM-SHA384:256) (Exim 4.91 (FreeBSD)) (envelope-from ) id 1gr2IW-0001uf-2P; Tue, 05 Feb 2019 15:06:04 +0000 Received: from petefrench by dilbert.ingresso.co.uk with local (Exim 4.91 (FreeBSD)) (envelope-from ) id 1gr2IV-000BqA-VD; Tue, 05 Feb 2019 15:06:03 +0000 To: bu7cher@yandex.ru, freebsd-stable@freebsd.org, petefrench@ingresso.co.uk Subject: Re: More CARP issues under 12 In-Reply-To: <49a5ec49-a8d4-2d13-bc94-c8a7cc41fadd@yandex.ru> Message-Id: From: Pete French Date: Tue, 05 Feb 2019 15:06:03 +0000 X-Rspamd-Queue-Id: F1C92772C7 X-Spamd-Bar: ++ Authentication-Results: mx1.freebsd.org; dmarc=pass (policy=none) header.from=ingresso.co.uk; spf=pass (mx1.freebsd.org: domain of petefrench@ingresso.co.uk designates 2a02:b90:3002:411::3 as permitted sender) smtp.mailfrom=petefrench@ingresso.co.uk X-Spamd-Result: default: False [2.45 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RDNS_NONE(1.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+ip6:2a02:b90:3002:411::3]; NEURAL_HAM_LONG(-0.51)[-0.513,0]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; NEURAL_SPAM_MEDIUM(0.27)[0.275,0]; NEURAL_SPAM_SHORT(0.02)[0.017,0]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MX_GOOD(-0.01)[ingresso-co-uk.mail.protection.outlook.com,ingresso-co-uk.mail.protection.outlook.com]; DMARC_POLICY_ALLOW(-0.50)[ingresso.co.uk,none]; RCVD_TLS_LAST(0.00)[]; FREEMAIL_TO(0.00)[yandex.ru]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:16082, ipnet:2a02:b90::/32, country:GB]; HFILTER_HOSTNAME_UNKNOWN(2.50)[]; IP_SCORE(-0.02)[country: GB(-0.09)] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 05 Feb 2019 15:06:07 -0000 > Hi, > > What branch and revision do you use? Can you install gdb and then obtain > this information: The branch and revision is 12.0-STABLE r343538 GENERIC > # kgdb > > (kgdb) list *ether_output+0x6b6 trying to do this on the actual box is hard, as it panics, but on another machine running the same build I get this, which should suffice if you are just interested in seeing the line in the source code ? (kgdb) list *ether_output+0x6b6 0xffffffff80ca1526 is in ether_output (/usr/src/sys/net/if_ethersubr.c:435). 430 if (m == NULL) 431 return (0); 432 } 433 434 /* Continue with link-layer output */ 435 return ether_output_frame(ifp, m); 436 } 437 438 static bool 439 ether_set_pcp(struct mbuf **mp, struct ifnet *ifp, uint8_t pcp) From owner-freebsd-stable@freebsd.org Tue Feb 5 15:22:59 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2D83214BCCFA for ; Tue, 5 Feb 2019 15:22:59 +0000 (UTC) (envelope-from karl@denninger.net) Received: from colo1.denninger.net (colo1.denninger.net [104.236.120.189]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 65D9A77D36 for ; Tue, 5 Feb 2019 15:22:58 +0000 (UTC) (envelope-from karl@denninger.net) Received: from denninger.net (ip68-1-57-197.pn.at.cox.net [68.1.57.197]) by colo1.denninger.net (Postfix) with ESMTP id A05BC2110BC for ; Tue, 5 Feb 2019 10:22:21 -0500 (EST) Received: from [192.168.10.21] (D11.Denninger.Net [192.168.10.21]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by denninger.net (Postfix) with ESMTPSA id E074B5912C for ; Tue, 5 Feb 2019 09:22:20 -0600 (CST) Subject: Re: 9211 (LSI/SAS) issues on 11.2-STABLE To: freebsd-stable@freebsd.org References: <7bb25f55-fa77-f67e-11f3-b2240b01e25a@denninger.net> From: Karl Denninger Openpgp: preference=signencrypt Autocrypt: addr=karl@denninger.net; prefer-encrypt=mutual; keydata= mQINBFIX1zsBEADRcJfsQUl9oFeoMfLPJ1kql+3sIaYx0MfJAUhV9LnbWxr0fsWCskM1O4cV tHm5dqPkuPM4Ztc0jLotD1i9ubWvCHOlkLGxFOL+pFbjA+XZ7VKsC/xWmhMwJ3cM8HavK2OV SzEWQ/AEYtMi04IzGSwsxh/5/5R0mPHrsIomV5SbuiI0vjLuDj7fo6146AABI1ULzge4hBYW i/SHrqUrLORmUNBs6bxek79/B0Dzk5cIktD3LOfbT9EAa5J/osVkstMBhToJgQttaMIGv8SG CzpR/HwEokE+7DP+k2mLHnLj6H3kfugOF9pJH8Za4yFmw//s9cPXV8WwtZ2SKfVzn1unpKqf wmJ1PwJoom/d4fGvQDkgkGKRa6RGC6tPmXnqnx+YX4iCOdFfbP8L9rmk2sewDDVzHDU3I3ZZ 8hFIjMYM/QXXYszRatK0LCV0QPZuF7LCf4uQVKw1/oyJInsnH7+6a3c0h21x+CmSja9QJ+y0 yzgEN/nM89d6YTakfR+1xkYgodVmMy/bS8kmXbUUZG/CyeqCqc95RUySjKT2ECrf9GhhoQkl +D8n2MsrAUSMGB4GQSN+TIq9OBTpNuvATGSRuF9wnQcs1iSry+JNCpfRTyWp83uCNApe6oHU EET4Et6KDO3AvjvBMAX0TInTRGW2SQlJMuFKpc7Dg7tHK8zzqQARAQABtCNLYXJsIERlbm5p bmdlciA8a2FybEBkZW5uaW5nZXIubmV0PokCPAQTAQIAJgUCUhfXOwIbIwUJCWYBgAYLCQgH AwIEFQIIAwQWAgMBAh4BAheAAAoJEG6/sivc5s0PLxQP/i6x/QFx9G4Cw7C+LthhLXIm7NSH AtNbz2UjySEx2qkoQQjtsK6mcpEEaky4ky6t8gz0/SifIfJmSmyAx0UhUQ0WBv1vAXwtNrQQ jJd9Bj6l4c2083WaXyHPjt2u2Na6YFowyb4SaQb83hu/Zs25vkPQYJVVE0JX409MFVPUa6E3 zFbd1OTr3T4yNUy4gNeQZfzDqDS8slbIks2sXeoJrZ6qqXVI0ionoivOlaN4T6Q0UYyXtigj dQvvhMt0aNowKFjRqrmSDRpdz+o6yg7Mp7qEZ1V6EZk8KqQTH6htpCTQ8i79ttK4LG6bstSF Re6Fwq52nbrcANrcdmtZXqjo+SGbUqJ8b1ggrxAsJ5MEhRh2peKrCgI/TjQo+ZxfnqEoR4AI 46Cyiz+/lcVvlvmf2iPifS3EEdaH3Itfwt7MxFm6mQORYs6skHDw3tOYB2/AdCW6eRVYs2hB RMAG4uwApZfZDKgRoE95PJmQjeTBiGmRPcsQZtNESe7I7EjHtCDLwtJqvD4HkDDQwpzreT6W XkyIJ7ns7zDfA1E+AQhFR6rsTFGgQZRZKsVeov3SbhYKkCnVDCvb/PKQCAGkSZM9SvYG5Yax 8CMry3AefKktf9fqBFg8pWqtVxDwJr56dhi0GHXRu3jVI995rMGo1fLUG5fSxiZ8L5sAtokh 9WFmQpyl Message-ID: Date: Tue, 5 Feb 2019 09:22:20 -0600 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:60.0) Gecko/20100101 Thunderbird/60.5.0 MIME-Version: 1.0 In-Reply-To: <7bb25f55-fa77-f67e-11f3-b2240b01e25a@denninger.net> Content-Type: multipart/signed; protocol="application/pkcs7-signature"; micalg=sha-512; boundary="------------ms040500020502080904050803" X-Rspamd-Queue-Id: 65D9A77D36 X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-6.26 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; HAS_ATTACHMENT(0.00)[]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; MX_GOOD(-0.01)[px.denninger.net]; NEURAL_HAM_SHORT(-0.85)[-0.846,0]; FROM_EQ_ENVFROM(0.00)[]; IP_SCORE(-2.20)[ip: (-9.87), ipnet: 104.236.64.0/18(-3.71), asn: 14061(2.64), country: US(-0.07)]; R_DKIM_NA(0.00)[]; ASN(0.00)[asn:14061, ipnet:104.236.64.0/18, country:US]; MIME_TRACE(0.00)[0:+,1:+,2:+]; MID_RHS_MATCH_FROM(0.00)[]; RECEIVED_SPAMHAUS_PBL(0.00)[197.57.1.68.zen.spamhaus.org : 127.0.0.11]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; SIGNED_SMIME(-2.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.20)[multipart/signed,multipart/alternative,text/plain]; RCVD_TLS_LAST(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; AUTH_NA(1.00)[]; RCPT_COUNT_ONE(0.00)[1]; DMARC_NA(0.00)[denninger.net]; R_SPF_NA(0.00)[] X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 05 Feb 2019 15:22:59 -0000 This is a cryptographically signed message in MIME format. --------------ms040500020502080904050803 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable On 2/2/2019 12:02, Karl Denninger wrote: > I recently started having some really oddball things=C2=A0 happening un= der > stress.=C2=A0 This coincided with the machine being updated to 11.2-STA= BLE > (FreeBSD 11.2-STABLE #1 r342918:) from 11.1. > > Specifically, I get "errors" like this: > > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 (da12:mps0:0:37:0): READ(10)= =2E CDB: 28 00 af 82 bb 08 00 01 00 00 > length 131072 SMID 269 Aborting command 0xfffffe0001179110 > mps0: Sending reset from mpssas_send_abort for target ID 37 > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 (da12:mps0:0:37:0): READ(10)= =2E CDB: 28 00 af 82 bc 08 00 01 00 00 > length 131072 SMID 924 terminated ioc 804b loginfo 31140000 scsi 0 stat= e > c xfer 0 > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 (da12:mps0:0:37:0): READ(10)= =2E CDB: 28 00 af 82 ba 08 00 01 00 00 > length 131072 SMID 161 terminated ioc 804b loginfo 31140000 scsi 0 stat= e > c xfer 0 > mps0: Unfreezing devq for target ID 37 > (da12:mps0:0:37:0): READ(10). CDB: 28 00 af 82 bc 08 00 01 00 00 > (da12:mps0:0:37:0): CAM status: CCB request completed with an error > (da12:mps0:0:37:0): Retrying command > (da12:mps0:0:37:0): READ(10). CDB: 28 00 af 82 bb 08 00 01 00 00 > (da12:mps0:0:37:0): CAM status: Command timeout > (da12:mps0:0:37:0): Retrying command > (da12:mps0:0:37:0): READ(10). CDB: 28 00 af 82 ba 08 00 01 00 00 > (da12:mps0:0:37:0): CAM status: CCB request completed with an error > (da12:mps0:0:37:0): Retrying command > (da12:mps0:0:37:0): READ(10). CDB: 28 00 af 82 ba 08 00 01 00 00 > (da12:mps0:0:37:0): CAM status: SCSI Status Error > (da12:mps0:0:37:0): SCSI status: Check Condition > (da12:mps0:0:37:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, > reset, or bus device reset occurred) > (da12:mps0:0:37:0): Retrying command (per sense data) > > The "Unit Attention" implies the drive reset.=C2=A0 It only occurs on c= ertain > drives under very heavy load (e.g. a scrub.)=C2=A0 I've managed to prov= oke it > on two different brands of disk across multiple firmware and capacities= , > however, which tends to point away from a drive firmware problem. > > A look at the pool data shows /no /errors (e.g. no checksum problems, > etc) and a look at the disk itself (using smartctl) shows no problems > either -- whatever is going on here the adapter is recovering from it > without any data corruption or loss registered on *either end*! > > The configuration is an older SuperMicro Xeon board (X8DTL-IF) and show= s: > > mps0: port 0xc000-0xc0ff mem > 0xfbb3c000-0xfbb3ffff,0xfbb40000-0xfbb7ffff irq 30 at device 0.0 on pci= 3 > mps0: Firmware: 19.00.00.00, Driver: 21.02.00.00-fbsd > mps0: IOCCapabilities: > 1285c After considerable additional work this looks increasingly like either a missed interrupt or a command is getting lost between the host adapter and the expander. I'm going to turn the driver debug level up and see if I can capture more information..... whatever is behind this, however, it is almost-certainly related to something that changed between 11.1 and 11.2, as I never saw these on the 11.1-STABLE build. -- Karl Denninger karl@denninger.net /The Market Ticker/ /[S/MIME encrypted email preferred]/ --------------ms040500020502080904050803 Content-Type: application/pkcs7-signature; name="smime.p7s" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="smime.p7s" Content-Description: S/MIME Cryptographic Signature MIAGCSqGSIb3DQEHAqCAMIACAQExDzANBglghkgBZQMEAgMFADCABgkqhkiG9w0BBwEAAKCC DdgwggagMIIEiKADAgECAhMA5EiKghDOXrvfxYxjITXYDdhIMA0GCSqGSIb3DQEBCwUAMIGL MQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTESMBAGA1UEBwwJTmljZXZpbGxlMRkw FwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5c3RlbXMgQ0ExITAf BgNVBAMMGEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBDQTAeFw0xNzA4MTcxNjQyMTdaFw0yNzA4 MTUxNjQyMTdaMHsxCzAJBgNVBAYTAlVTMRAwDgYDVQQIDAdGbG9yaWRhMRkwFwYDVQQKDBBD dWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5c3RlbXMgQ0ExJTAjBgNVBAMMHEN1 ZGEgU3lzdGVtcyBMTEMgMjAxNyBJbnQgQ0EwggIiMA0GCSqGSIb3DQEBAQUAA4ICDwAwggIK AoICAQC1aJotNUI+W4jP7xQDO8L/b4XiF4Rss9O0B+3vMH7Njk85fZ052QhZpMVlpaaO+sCI KqG3oNEbuOHzJB/NDJFnqh7ijBwhdWutdsq23Ux6TvxgakyMPpT6TRNEJzcBVQA0kpby1DVD 0EKSK/FrWWBiFmSxg7qUfmIq/mMzgE6epHktyRM3OGq3dbRdOUgfumWrqHXOrdJz06xE9NzY vc9toqZnd79FUtE/nSZVm1VS3Grq7RKV65onvX3QOW4W1ldEHwggaZxgWGNiR/D4eosAGFxn uYeWlKEC70c99Mp1giWux+7ur6hc2E+AaTGh+fGeijO5q40OGd+dNMgK8Es0nDRw81lRcl24 SWUEky9y8DArgIFlRd6d3ZYwgc1DMTWkTavx3ZpASp5TWih6yI8ACwboTvlUYeooMsPtNa9E 6UQ1nt7VEi5syjxnDltbEFoLYcXBcqhRhFETJe9CdenItAHAtOya3w5+fmC2j/xJz29og1KH YqWHlo3Kswi9G77an+zh6nWkMuHs+03DU8DaOEWzZEav3lVD4u76bKRDTbhh0bMAk4eXriGL h4MUoX3Imfcr6JoyheVrAdHDL/BixbMH1UUspeRuqQMQ5b2T6pabXP0oOB4FqldWiDgJBGRd zWLgCYG8wPGJGYgHibl5rFiI5Ix3FQncipc6SdUzOQIDAQABo4IBCjCCAQYwHQYDVR0OBBYE FF3AXsKnjdPND5+bxVECGKtc047PMIHABgNVHSMEgbgwgbWAFBu1oRhUMNEzjODolDka5k4Q EDBioYGRpIGOMIGLMQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTESMBAGA1UEBwwJ TmljZXZpbGxlMRkwFwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5 c3RlbXMgQ0ExITAfBgNVBAMMGEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBDQYIJAKxAy1WBo2kY MBIGA1UdEwEB/wQIMAYBAf8CAQAwDgYDVR0PAQH/BAQDAgGGMA0GCSqGSIb3DQEBCwUAA4IC AQCB5686UCBVIT52jO3sz9pKuhxuC2npi8ZvoBwt/IH9piPA15/CGF1XeXUdu2qmhOjHkVLN gO7XB1G8CuluxofOIUce0aZGyB+vZ1ylHXlMeB0R82f5dz3/T7RQso55Y2Vog2Zb7PYTC5B9 oNy3ylsnNLzanYlcW3AAfzZcbxYuAdnuq0Im3EpGm8DoItUcf1pDezugKm/yKtNtY6sDyENj tExZ377cYA3IdIwqn1Mh4OAT/Rmh8au2rZAo0+bMYBy9C11Ex0hQ8zWcvPZBDn4v4RtO8g+K uQZQcJnO09LJNtw94W3d2mj4a7XrsKMnZKvm6W9BJIQ4Nmht4wXAtPQ1xA+QpxPTmsGAU0Cv HmqVC7XC3qxFhaOrD2dsvOAK6Sn3MEpH/YrfYCX7a7cz5zW3DsJQ6o3pYfnnQz+hnwLlz4MK 17NIA0WOdAF9IbtQqarf44+PEyUbKtz1r0KGeGLs+VGdd2FLA0e7yuzxJDYcaBTVwqaHhU2/ Fna/jGU7BhrKHtJbb/XlLeFJ24yvuiYKpYWQSSyZu1R/gvZjHeGb344jGBsZdCDrdxtQQcVA 6OxsMAPSUPMrlg9LWELEEYnVulQJerWxpUecGH92O06wwmPgykkz//UmmgjVSh7ErNvL0lUY UMfunYVO/O5hwhW+P4gviCXzBFeTtDZH259O7TCCBzAwggUYoAMCAQICEwCg0WvVwekjGFiO 62SckFwepz0wDQYJKoZIhvcNAQELBQAwezELMAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3Jp ZGExGTAXBgNVBAoMEEN1ZGEgU3lzdGVtcyBMTEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBD QTElMCMGA1UEAwwcQ3VkYSBTeXN0ZW1zIExMQyAyMDE3IEludCBDQTAeFw0xNzA4MTcyMTIx MjBaFw0yMjA4MTYyMTIxMjBaMFcxCzAJBgNVBAYTAlVTMRAwDgYDVQQIDAdGbG9yaWRhMRkw FwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRswGQYDVQQDDBJrYXJsQGRlbm5pbmdlci5uZXQw ggIiMA0GCSqGSIb3DQEBAQUAA4ICDwAwggIKAoICAQC+HVSyxVtJhy3Ohs+PAGRuO//Dha9A 16l5FPATr6wude9zjX5f2lrkRyU8vhCXTZW7WbvWZKpcZ8r0dtZmiK9uF58Ec6hhvfkxJzbg 96WHBw5Fumd5ahZzuCJDtCAWW8R7/KN+zwzQf1+B3MVLmbaXAFBuKzySKhKMcHbK3/wjUYTg y+3UK6v2SBrowvkUBC+jxNg3Wy12GsTXcUS/8FYIXgVVPgfZZrbJJb5HWOQpvvhILpPCD3xs YJFNKEPltXKWHT7Qtc2HNqikgNwj8oqOb+PeZGMiWapsatKm8mxuOOGOEBhAoTVTwUHlMNTg 6QUCJtuWFCK38qOCyk9Haj+86lUU8RG6FkRXWgMbNQm1mWREQhw3axgGLSntjjnznJr5vsvX SYR6c+XKLd5KQZcS6LL8FHYNjqVKHBYM+hDnrTZMqa20JLAF1YagutDiMRURU23iWS7bA9tM cXcqkclTSDtFtxahRifXRI7Epq2GSKuEXe/1Tfb5CE8QsbCpGsfSwv2tZ/SpqVG08MdRiXxN 5tmZiQWo15IyWoeKOXl/hKxA9KPuDHngXX022b1ly+5ZOZbxBAZZMod4y4b4FiRUhRI97r9l CxsP/EPHuuTIZ82BYhrhbtab8HuRo2ofne2TfAWY2BlA7ExM8XShMd9bRPZrNTokPQPUCWCg CdIATQIDAQABo4IBzzCCAcswPAYIKwYBBQUHAQEEMDAuMCwGCCsGAQUFBzABhiBodHRwOi8v b2NzcC5jdWRhc3lzdGVtcy5uZXQ6ODg4ODAJBgNVHRMEAjAAMBEGCWCGSAGG+EIBAQQEAwIF oDAOBgNVHQ8BAf8EBAMCBeAwHQYDVR0lBBYwFAYIKwYBBQUHAwIGCCsGAQUFBwMEMDMGCWCG SAGG+EIBDQQmFiRPcGVuU1NMIEdlbmVyYXRlZCBDbGllbnQgQ2VydGlmaWNhdGUwHQYDVR0O BBYEFLElmNWeVgsBPe7O8NiBzjvjYnpRMIHKBgNVHSMEgcIwgb+AFF3AXsKnjdPND5+bxVEC GKtc047PoYGRpIGOMIGLMQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTESMBAGA1UE BwwJTmljZXZpbGxlMRkwFwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRh IFN5c3RlbXMgQ0ExITAfBgNVBAMMGEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBDQYITAORIioIQ zl6738WMYyE12A3YSDAdBgNVHREEFjAUgRJrYXJsQGRlbm5pbmdlci5uZXQwDQYJKoZIhvcN AQELBQADggIBAJXboPFBMLMtaiUt4KEtJCXlHO/3ZzIUIw/eobWFMdhe7M4+0u3te0sr77QR dcPKR0UeHffvpth2Mb3h28WfN0FmJmLwJk+pOx4u6uO3O0E1jNXoKh8fVcL4KU79oEQyYkbu 2HwbXBU9HbldPOOZDnPLi0whi/sbFHdyd4/w/NmnPgzAsQNZ2BYT9uBNr+jZw4SsluQzXG1X lFL/qCBoi1N2mqKPIepfGYF6drbr1RnXEJJsuD+NILLooTNf7PMgHPZ4VSWQXLNeFfygoOOK FiO0qfxPKpDMA+FHa8yNjAJZAgdJX5Mm1kbqipvb+r/H1UAmrzGMbhmf1gConsT5f8KU4n3Q IM2sOpTQe7BoVKlQM/fpQi6aBzu67M1iF1WtODpa5QUPvj1etaK+R3eYBzi4DIbCIWst8MdA 1+fEeKJFvMEZQONpkCwrJ+tJEuGQmjoQZgK1HeloepF0WDcviiho5FlgtAij+iBPtwMuuLiL shAXA5afMX1hYM4l11JXntle12EQFP1r6wOUkpOdxceCcMVDEJBBCHW2ZmdEaXgAm1VU+fnQ qS/wNw/S0X3RJT1qjr5uVlp2Y0auG/eG0jy6TT0KzTJeR9tLSDXprYkN2l/Qf7/nT6Q03qyE QnnKiBXWAZXveafyU/zYa7t3PTWFQGgWoC4w6XqgPo4KV44OMYIFBzCCBQMCAQEwgZIwezEL MAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3JpZGExGTAXBgNVBAoMEEN1ZGEgU3lzdGVtcyBM TEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBDQTElMCMGA1UEAwwcQ3VkYSBTeXN0ZW1zIExM QyAyMDE3IEludCBDQQITAKDRa9XB6SMYWI7rZJyQXB6nPTANBglghkgBZQMEAgMFAKCCAkUw GAYJKoZIhvcNAQkDMQsGCSqGSIb3DQEHATAcBgkqhkiG9w0BCQUxDxcNMTkwMjA1MTUyMjIw WjBPBgkqhkiG9w0BCQQxQgRASD6BpOFGSYktXedGJVC7xNu+DQtweF9dVXQ66mpMoogli+3N rNrqSfF/LabRD9k74l8DhD6VwlGJg5UzUHPSnDBsBgkqhkiG9w0BCQ8xXzBdMAsGCWCGSAFl AwQBKjALBglghkgBZQMEAQIwCgYIKoZIhvcNAwcwDgYIKoZIhvcNAwICAgCAMA0GCCqGSIb3 DQMCAgFAMAcGBSsOAwIHMA0GCCqGSIb3DQMCAgEoMIGjBgkrBgEEAYI3EAQxgZUwgZIwezEL MAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3JpZGExGTAXBgNVBAoMEEN1ZGEgU3lzdGVtcyBM TEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBDQTElMCMGA1UEAwwcQ3VkYSBTeXN0ZW1zIExM QyAyMDE3IEludCBDQQITAKDRa9XB6SMYWI7rZJyQXB6nPTCBpQYLKoZIhvcNAQkQAgsxgZWg gZIwezELMAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3JpZGExGTAXBgNVBAoMEEN1ZGEgU3lz dGVtcyBMTEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBDQTElMCMGA1UEAwwcQ3VkYSBTeXN0 ZW1zIExMQyAyMDE3IEludCBDQQITAKDRa9XB6SMYWI7rZJyQXB6nPTANBgkqhkiG9w0BAQEF AASCAgCW7U71G0tR6JHaiW63VC8AL1CPIQHxFuB6p68qhratB6IblAGLbYDvaj7dUwdEmDkl 0kNeQV6JsZjh+/pG6fHG79kyqald2SZgLd4+Oh5R+sxJAyZk58SnzM1ZWSPZqWzLEIoQxCxN zV7TX0+SPazwWnT8Kx45WsT3MmaFNRcdJ/WhjJocaJLs6pik1hyg2cMzVS/HS0vkfhVAOP28 FG1tanlh3fY/g9hgbj7Ov0IVub1pwY20NKZEy/RouwU4qAbFkr+VRhyWdwLnSz/SZj9P9QeV YYMB/Q8ou1csGz1tRnM/IJxFzv4iVQl6vGMnmdTns4BFSkT5Pk1NB/dzMrddwhHfypoDJ9pe LART+u50eq8tqoftU4kH7nr31rUWFAicjdmhDfRh+xVtiWt/YZCIa3ATRqG5bfOTGdshKlg/ yNNz6Xu6gScVWsC3DHnljGaogFTaW2xnup9BCsINEp6XlFeWPSiEgx8fLFnPq5hRH9nh3abK BQfb57MzpNpNRERh26rvj9gF70prOTzyaNpPBj73Ep/mKbPrS/EJCqParUlhT+K3ZvuWKz8R KCzZANf4TEa9ifkZikQdwrH5yDbjneXvy2lLbOPJMcTEwbXxxuFM2Y2caWkpwwyxQ3YlZaLe aHY5C0r6Vn5DnS5psKznuVjmtNEqes2x8W+t/sesdwAAAAAAAA== --------------ms040500020502080904050803-- From owner-freebsd-stable@freebsd.org Tue Feb 5 16:27:00 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 89AC114BECCE for ; Tue, 5 Feb 2019 16:26:59 +0000 (UTC) (envelope-from karl@denninger.net) Received: from colo1.denninger.net (colo1.denninger.net [104.236.120.189]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 01E8982653 for ; Tue, 5 Feb 2019 16:26:57 +0000 (UTC) (envelope-from karl@denninger.net) Received: from denninger.net (ip68-1-57-197.pn.at.cox.net [68.1.57.197]) by colo1.denninger.net (Postfix) with ESMTP id 1D96D21109A for ; Tue, 5 Feb 2019 11:26:25 -0500 (EST) Received: from [192.168.10.21] (D11.Denninger.Net [192.168.10.21]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by denninger.net (Postfix) with ESMTPSA id 4F2C424819D for ; Tue, 5 Feb 2019 10:26:25 -0600 (CST) Subject: Re: 9211 (LSI/SAS) issues on 11.2-STABLE To: freebsd-stable@freebsd.org References: <7bb25f55-fa77-f67e-11f3-b2240b01e25a@denninger.net> From: Karl Denninger Openpgp: preference=signencrypt Autocrypt: addr=karl@denninger.net; prefer-encrypt=mutual; keydata= mQINBFIX1zsBEADRcJfsQUl9oFeoMfLPJ1kql+3sIaYx0MfJAUhV9LnbWxr0fsWCskM1O4cV tHm5dqPkuPM4Ztc0jLotD1i9ubWvCHOlkLGxFOL+pFbjA+XZ7VKsC/xWmhMwJ3cM8HavK2OV SzEWQ/AEYtMi04IzGSwsxh/5/5R0mPHrsIomV5SbuiI0vjLuDj7fo6146AABI1ULzge4hBYW i/SHrqUrLORmUNBs6bxek79/B0Dzk5cIktD3LOfbT9EAa5J/osVkstMBhToJgQttaMIGv8SG CzpR/HwEokE+7DP+k2mLHnLj6H3kfugOF9pJH8Za4yFmw//s9cPXV8WwtZ2SKfVzn1unpKqf wmJ1PwJoom/d4fGvQDkgkGKRa6RGC6tPmXnqnx+YX4iCOdFfbP8L9rmk2sewDDVzHDU3I3ZZ 8hFIjMYM/QXXYszRatK0LCV0QPZuF7LCf4uQVKw1/oyJInsnH7+6a3c0h21x+CmSja9QJ+y0 yzgEN/nM89d6YTakfR+1xkYgodVmMy/bS8kmXbUUZG/CyeqCqc95RUySjKT2ECrf9GhhoQkl +D8n2MsrAUSMGB4GQSN+TIq9OBTpNuvATGSRuF9wnQcs1iSry+JNCpfRTyWp83uCNApe6oHU EET4Et6KDO3AvjvBMAX0TInTRGW2SQlJMuFKpc7Dg7tHK8zzqQARAQABtCNLYXJsIERlbm5p bmdlciA8a2FybEBkZW5uaW5nZXIubmV0PokCPAQTAQIAJgUCUhfXOwIbIwUJCWYBgAYLCQgH AwIEFQIIAwQWAgMBAh4BAheAAAoJEG6/sivc5s0PLxQP/i6x/QFx9G4Cw7C+LthhLXIm7NSH AtNbz2UjySEx2qkoQQjtsK6mcpEEaky4ky6t8gz0/SifIfJmSmyAx0UhUQ0WBv1vAXwtNrQQ jJd9Bj6l4c2083WaXyHPjt2u2Na6YFowyb4SaQb83hu/Zs25vkPQYJVVE0JX409MFVPUa6E3 zFbd1OTr3T4yNUy4gNeQZfzDqDS8slbIks2sXeoJrZ6qqXVI0ionoivOlaN4T6Q0UYyXtigj dQvvhMt0aNowKFjRqrmSDRpdz+o6yg7Mp7qEZ1V6EZk8KqQTH6htpCTQ8i79ttK4LG6bstSF Re6Fwq52nbrcANrcdmtZXqjo+SGbUqJ8b1ggrxAsJ5MEhRh2peKrCgI/TjQo+ZxfnqEoR4AI 46Cyiz+/lcVvlvmf2iPifS3EEdaH3Itfwt7MxFm6mQORYs6skHDw3tOYB2/AdCW6eRVYs2hB RMAG4uwApZfZDKgRoE95PJmQjeTBiGmRPcsQZtNESe7I7EjHtCDLwtJqvD4HkDDQwpzreT6W XkyIJ7ns7zDfA1E+AQhFR6rsTFGgQZRZKsVeov3SbhYKkCnVDCvb/PKQCAGkSZM9SvYG5Yax 8CMry3AefKktf9fqBFg8pWqtVxDwJr56dhi0GHXRu3jVI995rMGo1fLUG5fSxiZ8L5sAtokh 9WFmQpyl Message-ID: <9ea70420-0c06-ad9d-e8b7-f9d92fed20d8@denninger.net> Date: Tue, 5 Feb 2019 10:26:24 -0600 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:60.0) Gecko/20100101 Thunderbird/60.5.0 MIME-Version: 1.0 In-Reply-To: Content-Type: multipart/signed; protocol="application/pkcs7-signature"; micalg=sha-512; boundary="------------ms030707090402060507070908" X-Rspamd-Queue-Id: 01E8982653 X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-6.02 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; HAS_ATTACHMENT(0.00)[]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; MX_GOOD(-0.01)[cached: px.denninger.net]; MIME_BASE64_TEXT(0.10)[]; NEURAL_HAM_SHORT(-0.69)[-0.693,0]; FROM_EQ_ENVFROM(0.00)[]; IP_SCORE(-2.22)[ip: (-9.87), ipnet: 104.236.64.0/18(-3.78), asn: 14061(2.64), country: US(-0.07)]; R_DKIM_NA(0.00)[]; ASN(0.00)[asn:14061, ipnet:104.236.64.0/18, country:US]; MIME_TRACE(0.00)[0:+,1:+,2:+]; MID_RHS_MATCH_FROM(0.00)[]; RECEIVED_SPAMHAUS_PBL(0.00)[197.57.1.68.zen.spamhaus.org : 127.0.0.11]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.999,0]; FROM_HAS_DN(0.00)[]; SIGNED_SMIME(-2.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.20)[multipart/signed,multipart/alternative,text/plain]; RCVD_TLS_LAST(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; AUTH_NA(1.00)[]; RCPT_COUNT_ONE(0.00)[1]; DMARC_NA(0.00)[denninger.net]; R_SPF_NA(0.00)[] X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 05 Feb 2019 16:27:00 -0000 This is a cryptographically signed message in MIME format. --------------ms030707090402060507070908 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: base64 T24gMi81LzIwMTkgMDk6MjIsIEthcmwgRGVubmluZ2VyIHdyb3RlOg0KPiBPbiAyLzIvMjAx OSAxMjowMiwgS2FybCBEZW5uaW5nZXIgd3JvdGU6DQo+PiBJIHJlY2VudGx5IHN0YXJ0ZWQg aGF2aW5nIHNvbWUgcmVhbGx5IG9kZGJhbGwgdGhpbmdzwqAgaGFwcGVuaW5nIHVuZGVyDQo+ PiBzdHJlc3MuwqAgVGhpcyBjb2luY2lkZWQgd2l0aCB0aGUgbWFjaGluZSBiZWluZyB1cGRh dGVkIHRvIDExLjItU1RBQkxFDQo+PiAoRnJlZUJTRCAxMS4yLVNUQUJMRSAjMSByMzQyOTE4 OikgZnJvbSAxMS4xLg0KPj4NCj4+IFNwZWNpZmljYWxseSwgSSBnZXQgImVycm9ycyIgbGlr ZSB0aGlzOg0KPj4NCj4+IMKgwqDCoMKgwqDCoMKgIChkYTEyOm1wczA6MDozNzowKTogUkVB RCgxMCkuIENEQjogMjggMDAgYWYgODIgYmIgMDggMDAgMDEgMDAgMDANCj4+IGxlbmd0aCAx MzEwNzIgU01JRCAyNjkgQWJvcnRpbmcgY29tbWFuZCAweGZmZmZmZTAwMDExNzkxMTANCj4+ IG1wczA6IFNlbmRpbmcgcmVzZXQgZnJvbSBtcHNzYXNfc2VuZF9hYm9ydCBmb3IgdGFyZ2V0 IElEIDM3DQo+PiDCoMKgwqDCoMKgwqDCoCAoZGExMjptcHMwOjA6Mzc6MCk6IFJFQUQoMTAp LiBDREI6IDI4IDAwIGFmIDgyIGJjIDA4IDAwIDAxIDAwIDAwDQo+PiBsZW5ndGggMTMxMDcy IFNNSUQgOTI0IHRlcm1pbmF0ZWQgaW9jIDgwNGIgbG9naW5mbyAzMTE0MDAwMCBzY3NpIDAg c3RhdGUNCj4+IGMgeGZlciAwDQo+PiDCoMKgwqDCoMKgwqDCoCAoZGExMjptcHMwOjA6Mzc6 MCk6IFJFQUQoMTApLiBDREI6IDI4IDAwIGFmIDgyIGJhIDA4IDAwIDAxIDAwIDAwDQo+PiBs ZW5ndGggMTMxMDcyIFNNSUQgMTYxIHRlcm1pbmF0ZWQgaW9jIDgwNGIgbG9naW5mbyAzMTE0 MDAwMCBzY3NpIDAgc3RhdGUNCj4+IGMgeGZlciAwDQo+PiBtcHMwOiBVbmZyZWV6aW5nIGRl dnEgZm9yIHRhcmdldCBJRCAzNw0KPj4gKGRhMTI6bXBzMDowOjM3OjApOiBSRUFEKDEwKS4g Q0RCOiAyOCAwMCBhZiA4MiBiYyAwOCAwMCAwMSAwMCAwMA0KPj4gKGRhMTI6bXBzMDowOjM3 OjApOiBDQU0gc3RhdHVzOiBDQ0IgcmVxdWVzdCBjb21wbGV0ZWQgd2l0aCBhbiBlcnJvcg0K Pj4gKGRhMTI6bXBzMDowOjM3OjApOiBSZXRyeWluZyBjb21tYW5kDQo+PiAoZGExMjptcHMw OjA6Mzc6MCk6IFJFQUQoMTApLiBDREI6IDI4IDAwIGFmIDgyIGJiIDA4IDAwIDAxIDAwIDAw DQo+PiAoZGExMjptcHMwOjA6Mzc6MCk6IENBTSBzdGF0dXM6IENvbW1hbmQgdGltZW91dA0K Pj4gKGRhMTI6bXBzMDowOjM3OjApOiBSZXRyeWluZyBjb21tYW5kDQo+PiAoZGExMjptcHMw OjA6Mzc6MCk6IFJFQUQoMTApLiBDREI6IDI4IDAwIGFmIDgyIGJhIDA4IDAwIDAxIDAwIDAw DQo+PiAoZGExMjptcHMwOjA6Mzc6MCk6IENBTSBzdGF0dXM6IENDQiByZXF1ZXN0IGNvbXBs ZXRlZCB3aXRoIGFuIGVycm9yDQo+PiAoZGExMjptcHMwOjA6Mzc6MCk6IFJldHJ5aW5nIGNv bW1hbmQNCj4+IChkYTEyOm1wczA6MDozNzowKTogUkVBRCgxMCkuIENEQjogMjggMDAgYWYg ODIgYmEgMDggMDAgMDEgMDAgMDANCj4+IChkYTEyOm1wczA6MDozNzowKTogQ0FNIHN0YXR1 czogU0NTSSBTdGF0dXMgRXJyb3INCj4+IChkYTEyOm1wczA6MDozNzowKTogU0NTSSBzdGF0 dXM6IENoZWNrIENvbmRpdGlvbg0KPj4gKGRhMTI6bXBzMDowOjM3OjApOiBTQ1NJIHNlbnNl OiBVTklUIEFUVEVOVElPTiBhc2M6MjksMCAoUG93ZXIgb24sDQo+PiByZXNldCwgb3IgYnVz IGRldmljZSByZXNldCBvY2N1cnJlZCkNCj4+IChkYTEyOm1wczA6MDozNzowKTogUmV0cnlp bmcgY29tbWFuZCAocGVyIHNlbnNlIGRhdGEpDQo+Pg0KPj4gVGhlICJVbml0IEF0dGVudGlv biIgaW1wbGllcyB0aGUgZHJpdmUgcmVzZXQuwqAgSXQgb25seSBvY2N1cnMgb24gY2VydGFp bg0KPj4gZHJpdmVzIHVuZGVyIHZlcnkgaGVhdnkgbG9hZCAoZS5nLiBhIHNjcnViLinCoCBJ J3ZlIG1hbmFnZWQgdG8gcHJvdm9rZSBpdA0KPj4gb24gdHdvIGRpZmZlcmVudCBicmFuZHMg b2YgZGlzayBhY3Jvc3MgbXVsdGlwbGUgZmlybXdhcmUgYW5kIGNhcGFjaXRpZXMsDQo+PiBo b3dldmVyLCB3aGljaCB0ZW5kcyB0byBwb2ludCBhd2F5IGZyb20gYSBkcml2ZSBmaXJtd2Fy ZSBwcm9ibGVtLg0KPj4NCj4+IEEgbG9vayBhdCB0aGUgcG9vbCBkYXRhIHNob3dzIC9ubyAv ZXJyb3JzIChlLmcuIG5vIGNoZWNrc3VtIHByb2JsZW1zLA0KPj4gZXRjKSBhbmQgYSBsb29r IGF0IHRoZSBkaXNrIGl0c2VsZiAodXNpbmcgc21hcnRjdGwpIHNob3dzIG5vIHByb2JsZW1z DQo+PiBlaXRoZXIgLS0gd2hhdGV2ZXIgaXMgZ29pbmcgb24gaGVyZSB0aGUgYWRhcHRlciBp cyByZWNvdmVyaW5nIGZyb20gaXQNCj4+IHdpdGhvdXQgYW55IGRhdGEgY29ycnVwdGlvbiBv ciBsb3NzIHJlZ2lzdGVyZWQgb24gKmVpdGhlciBlbmQqIQ0KPj4NCj4+IFRoZSBjb25maWd1 cmF0aW9uIGlzIGFuIG9sZGVyIFN1cGVyTWljcm8gWGVvbiBib2FyZCAoWDhEVEwtSUYpIGFu ZCBzaG93czoNCj4+DQo+PiBtcHMwOiA8QXZhZ28gVGVjaG5vbG9naWVzIChMU0kpIFNBUzIw MDg+IHBvcnQgMHhjMDAwLTB4YzBmZiBtZW0NCj4+IDB4ZmJiM2MwMDAtMHhmYmIzZmZmZiww eGZiYjQwMDAwLTB4ZmJiN2ZmZmYgaXJxIDMwIGF0IGRldmljZSAwLjAgb24gcGNpMw0KPj4g bXBzMDogRmlybXdhcmU6IDE5LjAwLjAwLjAwLCBEcml2ZXI6IDIxLjAyLjAwLjAwLWZic2QN Cj4+IG1wczA6IElPQ0NhcGFiaWxpdGllczoNCj4+IDEyODVjPFNjc2lUYXNrRnVsbCxEaWFn VHJhY2UsU25hcEJ1ZixFRURQLFRyYW5zUmV0cnksRXZlbnRSZXBsYXksSG9zdERpc2M+DQo+ IEFmdGVyIGNvbnNpZGVyYWJsZSBhZGRpdGlvbmFsIHdvcmsgdGhpcyBsb29rcyBpbmNyZWFz aW5nbHkgbGlrZSBlaXRoZXIgYQ0KPiBtaXNzZWQgaW50ZXJydXB0IG9yIGEgY29tbWFuZCBp cyBnZXR0aW5nIGxvc3QgYmV0d2VlbiB0aGUgaG9zdCBhZGFwdGVyDQo+IGFuZCB0aGUgZXhw YW5kZXIuDQo+DQo+IEknbSBnb2luZyB0byB0dXJuIHRoZSBkcml2ZXIgZGVidWcgbGV2ZWwg dXAgYW5kIHNlZSBpZiBJIGNhbiBjYXB0dXJlDQo+IG1vcmUgaW5mb3JtYXRpb24uLi4uLiB3 aGF0ZXZlciBpcyBiZWhpbmQgdGhpcywgaG93ZXZlciwgaXQgaXMNCj4gYWxtb3N0LWNlcnRh aW5seSByZWxhdGVkIHRvIHNvbWV0aGluZyB0aGF0IGNoYW5nZWQgYmV0d2VlbiAxMS4xIGFu ZA0KPiAxMS4yLCBhcyBJIG5ldmVyIHNhdyB0aGVzZSBvbiB0aGUgMTEuMS1TVEFCTEUgYnVp bGQuDQo+DQo+IC0tDQo+IEthcmwgRGVubmluZ2VyDQo+IGthcmxAZGVubmluZ2VyLm5ldCA8 bWFpbHRvOmthcmxAZGVubmluZ2VyLm5ldD4NCj4gL1RoZSBNYXJrZXQgVGlja2VyLw0KPiAv W1MvTUlNRSBlbmNyeXB0ZWQgZW1haWwgcHJlZmVycmVkXS8NClByZXR0eSBkZWNlbnQgdHJh Y2UgaGVyZSAtLSBhbnkgaWRlYXM/DQoNCm1wczA6IHRpbWVkb3V0IGNtIDB4ZmZmZmZlMDAw MTFiNTAyMCBhbGxvY2F0ZWQgdG0gMHhmZmZmZmUwMDAxMTgxMmEwDQrCoMKgwqDCoMKgwqDC oCAoZGExMTptcHMwOjA6Mzc6MCk6IFJFQUQoMTApLiBDREI6IDI4IDAwIDgyIGI1IDNiIDgw IDAwIDAxIDAwIDAwDQpsZW5ndGggMTMxMDcyIFNNSUQgNjM0IEFib3J0aW5nIGNvbW1hbmQg MHhmZmZmZmUwMDAxMWI1MDIwDQptcHMwOiBTZW5kaW5nIHJlc2V0IGZyb20gbXBzc2FzX3Nl bmRfYWJvcnQgZm9yIHRhcmdldCBJRCAzNw0KbXBzMDogcXVldWVkIHRpbWVkb3V0IGNtIDB4 ZmZmZmZlMDAwMTFjMjc2MCBmb3IgcHJvY2Vzc2luZyBieSB0bQ0KMHhmZmZmZmUwMDAxMTgx MmEwDQptcHMwOiBxdWV1ZWQgdGltZWRvdXQgY20gMHhmZmZmZmUwMDAxMWE3NGYwIGZvciBw cm9jZXNzaW5nIGJ5IHRtDQoweGZmZmZmZTAwMDExODEyYTANCm1wczA6IHF1ZXVlZCB0aW1l ZG91dCBjbSAweGZmZmZmZTAwMDExY2ZkNTAgZm9yIHByb2Nlc3NpbmcgYnkgdG0NCjB4ZmZm ZmZlMDAwMTE4MTJhMA0KbXBzMDogRXZlbnRSZXBsecKgwqDCoMKgwqDCoMKgIDoNCsKgwqDC oMKgwqDCoMKgIEV2ZW50RGF0YUxlbmd0aDogMg0KwqDCoMKgwqDCoMKgwqAgQWNrUmVxdWly ZWQ6IDANCsKgwqDCoMKgwqDCoMKgIEV2ZW50OiBTYXNEaXNjb3ZlcnkgKDB4MTYpDQrCoMKg wqDCoMKgwqDCoCBFdmVudENvbnRleHQ6IDB4MA0KwqDCoMKgwqDCoMKgwqAgRmxhZ3M6IDE8 SW5Qcm9ncmVzcz4NCsKgwqDCoMKgwqDCoMKgIFJlYXNvbkNvZGU6IERpc2NvdmVyeSBTdGFy dGVkDQrCoMKgwqDCoMKgwqDCoCBQaHlzaWNhbFBvcnQ6IDANCsKgwqDCoMKgwqDCoMKgIERp c2NvdmVyeVN0YXR1czogMA0KbXBzMDogKDApLT4obXBzc2FzX2Z3X3dvcmspIFdvcmtpbmcg b27CoCBFdmVudDogWzE2XQ0KbXBzMDogKDEpLT4obXBzc2FzX2Z3X3dvcmspIEV2ZW50IEZy ZWU6IFsxNl0NCsKgwqDCoMKgwqDCoMKgIChkYTExOm1wczA6MDozNzowKTogUkVBRCgxMCku IENEQjogMjggMDAgODIgYjUgM2MgODAgMDAgMDEgMDAgMDANCmxlbmd0aCAxMzEwNzIgU01J RCA5NjEgY29tcGxldGVkIHRpbWVkb3V0IGNtIDB4ZmZmZmZlMDAwMTFjZmQ1MCBjY2INCjB4 ZmZmZmY4MDE5NDU4ZTAwMCBkdXJpbmcgcmVjb3ZlcnkgaW9jIDgwNGIgc2NzaSAwIHN0YXRl IGMNCihkYTExOm1wczA6MDozNzowKTogUkVBRCgxMCkuIENEQjogMjggMDAgODIgYjUgM2Mg ODAgMDAgMDEgMDAgMDAgbGVuZ3RoDQoxMzEwNzIgU01JRCA5NjEgdGVybWluYXRlZCBpb2Mg ODA0YiBsb2dpbmZvIDMxMTQwMDAwIHNjc2kgMCBzdGF0ZSBjIHhmZXIgMA0KwqDCoMKgwqDC oMKgwqAgKGRhMTE6bXBzMDowOjM3OjApOiBSRUFEKDEwKS4gQ0RCOiAyOCAwMCA4MiBiNSAz YiA4MCAwMCAwMSAwMCAwMA0KbGVuZ3RoIDEzMTA3MiBTTUlEIDYzNCBjb21wbGV0ZWQgdGlt ZWRvdXQgY20NCjB4ZmZmZmZlMDAwMTFiNShkYTExOm1wczA6MDozNzowKTogUkVBRCgxMCku IENEQjogMjggMDAgODIgYjUgM2MgODAgMDANCjAxIDAwIDAwDQowMjAgY2NiIDB4ZmZmZmY4 MDA1NmZiNTAwMCBkdXJpbmcgcmVjb3ZlcnkgaW9jIDgwNDggc2NzaSAwIHN0YXRlDQpjKGRh MTE6bXBzMDowOjM3OjApOiBDQU0gc3RhdHVzOiBDQ0IgcmVxdWVzdCBjb21wbGV0ZWQgd2l0 aCBhbiBlcnJvcg0KKGRhMTE6bXBzMDowOjM3OjApOiBSZXRyeWluZyBjb21tYW5kDQrCoMKg wqDCoMKgwqDCoCAoZGExMTptcHMwOjA6Mzc6MCk6IFJFQUQoMTApLiBDREI6IDI4IDAwIDgy IGI1IDNhIDgwIDAwIDAxIDAwIDAwDQpsZW5ndGggMTMxMDcyIFNNSUQgNzk4IGNvbXBsZXRl ZCB0aW1lZG91dCBjbSAweGZmZmZmZTAwMDExYzI3NjAgY2NiDQoweGZmZmZmODAwNTRlODYw MDAgZHVyaW5nIHJlY292ZXJ5IGlvYyA4MDRiIHNjc2kgMCBzdGF0ZSBjDQooZGExMTptcHMw OjA6Mzc6MCk6IFJFQUQoMTApLiBDREI6IDI4IDAwIDgyIGI1IDNhIDgwIDAwIDAxIDAwIDAw IGxlbmd0aA0KMTMxMDcyIFNNSUQgNzk4IHRlcm1pbmF0ZWQgaW9jIDgwNGIgbG9naW5mbyAz MTE0MDAwMCBzY3NpIDAgc3RhdGUgYyB4ZmVyIDANCsKgwqDCoMKgwqDCoMKgIChkYTExOm1w czA6MDozNzowKTogUkVBRCgxMCkuIENEQjogMjggMDAgODIgYjUgMzkgODAgMDAgMDEgMDAg MDANCmxlbmd0aCAxMzEwNzIgU01JRCA0NjcgY29tcGxldGVkIHRpbWVkb3V0IGNtIDB4ZmZm ZmZlMDAwMTFhNzRmMCBjY2INCjB4ZmZmZmY4MDExZWZlMzAwMCBkdXJpbmcgcmVjb3Zlcnkg aW9jIDgwNGIgc2NzaSAwIHN0YXRlIGMNCihkYTExOm1wczA6MDozNzowKTogUkVBRCgxMCku IENEQjogMjggMDAgODIgYjUgMzkgODAgMDAgMDEgMDAgMDAgbGVuZ3RoDQoxMzEwNzIgU01J RCA0NjcgdGVybWluYXRlZCBpb2MgODA0YiBsb2dpbmZvIDMxMTQwMDAwIHNjc2kgMCBzdGF0 ZSBjIHhmZXIgMA0KwqDCoMKgwqDCoMKgwqAgKHhwdDA6bXBzMDowOjM3OjApOiBTTUlEIDIg YWJvcnQgVGFza01JRCA2MzQgc3RhdHVzIDB4MCBjb2RlIDB4MA0KY291bnQgNA0KwqDCoMKg wqDCoMKgwqAgKHhwdDA6bXBzMDowOjM3OjApOiBTTUlEIDIgZmluaXNoZWQgcmVjb3Zlcnkg YWZ0ZXIgYWJvcnRpbmcNClRhc2tNSUQgNjM0DQptcHMwOiBVbmZyZWV6aW5nIGRldnEgZm9y IHRhcmdldCBJRCAzNw0KKGRhMTE6bXBzMDowOjM3OjApOiBSRUFEKDEwKS4gQ0RCOiAyOCAw MCA4MiBiNSAzYiA4MCAwMCAwMSAwMCAwMA0KKGRhMTE6bXBzMDowOjM3OjApOiBDQU0gc3Rh dHVzOiBDb21tYW5kIHRpbWVvdXQNCihkYTExOm1wczA6MDozNzowKTogUmV0cnlpbmcgY29t bWFuZA0KKGRhMTE6bXBzMDowOjM3OjApOiBSRUFEKDEwKS4gQ0RCOiAyOCAwMCA4MiBiNSAz YSA4MCAwMCAwMSAwMCAwMA0KKGRhMTE6bXBzMDowOjM3OjApOiBDQU0gc3RhdHVzOiBDQ0Ig cmVxdWVzdCBjb21wbGV0ZWQgd2l0aCBhbiBlcnJvcg0KKGRhMTE6bXBzMDowOjM3OjApOiBS ZXRyeWluZyBjb21tYW5kDQooZGExMTptcHMwOjA6Mzc6MCk6IFJFQUQoMTApLiBDREI6IDI4 IDAwIDgyIGI1IDM5IDgwIDAwIDAxIDAwIDAwDQooZGExMTptcHMwOjA6Mzc6MCk6IENBTSBz dGF0dXM6IENDQiByZXF1ZXN0IGNvbXBsZXRlZCB3aXRoIGFuIGVycm9yDQooZGExMTptcHMw OjA6Mzc6MCk6IFJldHJ5aW5nIGNvbW1hbmQNCm1wczA6IEV2ZW50UmVwbHnCoMKgwqDCoMKg wqDCoCA6DQrCoMKgwqDCoMKgwqDCoCBFdmVudERhdGFMZW5ndGg6IDQNCsKgwqDCoMKgwqDC oMKgIEFja1JlcXVpcmVkOiAwDQrCoMKgwqDCoMKgwqDCoCBFdmVudDogU2FzVG9wb2xvZ3lD aGFuZ2VMaXN0ICgweDFjKQ0KwqDCoMKgwqDCoMKgwqAgRXZlbnRDb250ZXh0OiAweDANCsKg wqDCoMKgwqDCoMKgIEVuY2xvc3VyZUhhbmRsZTogMHgyDQrCoMKgwqDCoMKgwqDCoCBFeHBh bmRlckRldkhhbmRsZTogMHg5DQrCoMKgwqDCoMKgwqDCoCBOdW1QaHlzOiAyNQ0KwqDCoMKg wqDCoMKgwqAgTnVtRW50cmllczogMQ0KwqDCoMKgwqDCoMKgwqAgU3RhcnRQaHlOdW06IDEy DQrCoMKgwqDCoMKgwqDCoCBFeHBTdGF0dXM6IFJlc3BvbmRpbmcgKDB4MykNCsKgwqDCoMKg wqDCoMKgIFBoeXNpY2FsUG9ydDogMA0KwqDCoMKgwqDCoMKgwqAgUEhZWzEyXS5BdHRhY2hl ZERldkhhbmRsZTogMHgwMDEzDQrCoMKgwqDCoMKgwqDCoCBQSFlbMTJdLkxpbmtSYXRlOiA2 LjBHYnBzICgweGFhKQ0KwqDCoMKgwqDCoMKgwqAgUEhZWzEyXS5QaHlTdGF0dXM6IFBIWUxp bmtTdGF0dXNDaGFuZ2UNCm1wczA6ICgxKS0+KG1wc3Nhc19md193b3JrKSBXb3JraW5nIG9u wqAgRXZlbnQ6IFsxY10NCm1wczA6ICgyKS0+KG1wc3Nhc19md193b3JrKSBFdmVudCBGcmVl OiBbMWNdDQptcHMwOiBFdmVudFJlcGx5wqDCoMKgwqDCoMKgwqAgOg0KwqDCoMKgwqDCoMKg wqAgRXZlbnREYXRhTGVuZ3RoOiAyDQrCoMKgwqDCoMKgwqDCoCBBY2tSZXF1aXJlZDogMA0K wqDCoMKgwqDCoMKgwqAgRXZlbnQ6IFNhc0Rpc2NvdmVyeSAoMHgxNikNCsKgwqDCoMKgwqDC oMKgIEV2ZW50Q29udGV4dDogMHgwDQrCoMKgwqDCoMKgwqDCoCBGbGFnczogMA0KwqDCoMKg wqDCoMKgwqAgUmVhc29uQ29kZTogRGlzY292ZXJ5IENvbXBsZXRlDQrCoMKgwqDCoMKgwqDC oCBQaHlzaWNhbFBvcnQ6IDANCsKgwqDCoMKgwqDCoMKgIERpc2NvdmVyeVN0YXR1czogMA0K bXBzMDogKDIpLT4obXBzc2FzX2Z3X3dvcmspIFdvcmtpbmcgb27CoCBFdmVudDogWzE2XQ0K bXBzMDogKDMpLT4obXBzc2FzX2Z3X3dvcmspIEV2ZW50IEZyZWU6IFsxNl0NCihkYTExOm1w czA6MDozNzowKTogUkVBRCgxMCkuIENEQjogMjggMDAgODIgYjUgMzkgODAgMDAgMDEgMDAg MDANCihkYTExOm1wczA6MDozNzowKTogQ0FNIHN0YXR1czogU0NTSSBTdGF0dXMgRXJyb3IN CihkYTExOm1wczA6MDozNzowKTogU0NTSSBzdGF0dXM6IENoZWNrIENvbmRpdGlvbg0KKGRh MTE6bXBzMDowOjM3OjApOiBTQ1NJIHNlbnNlOiBVTklUIEFUVEVOVElPTiBhc2M6MjksMCAo UG93ZXIgb24sDQpyZXNldCwgb3IgYnVzIGRldmljZSByZXNldCBvY2N1cnJlZCkNCihkYTEx Om1wczA6MDozNzowKTogUmV0cnlpbmcgY29tbWFuZCAocGVyIHNlbnNlIGRhdGEpDQoNClRo aXMgaXMgd2hhdCdzIHJ1bm5pbmcgcmlnaHQgbm93IHRoYXQgcHJvZHVjZWQgdGhhdCAtLSBu b3RlIG5vIGVycm9ycw0KcmVwb3J0ZWQgb24gdGhlIHR3byBwcm92aWRlcnMgKHRoZSBkZWdy YWRlZCBzdGF0ZSBpcyBpbnRlbnRpb25hbDsgdGhlDQp0aGlyZCB1bml0IGlzIG9mZi1zaXRl IGluIGEgYmFuayB2YXVsdCk6DQoNCltrYXJsQE5ld0ZTIC92YXIvbG9nXSQgenBvb2wgc3Rh dHVzIGJhY2t1cA0KwqAgcG9vbDogYmFja3VwDQrCoHN0YXRlOiBERUdSQURFRA0Kc3RhdHVz OiBPbmUgb3IgbW9yZSBkZXZpY2VzIGhhcyBiZWVuIHRha2VuIG9mZmxpbmUgYnkgdGhlIGFk bWluaXN0cmF0b3IuDQrCoMKgwqDCoMKgwqDCoCBTdWZmaWNpZW50IHJlcGxpY2FzIGV4aXN0 IGZvciB0aGUgcG9vbCB0byBjb250aW51ZSBmdW5jdGlvbmluZyBpbiBhDQrCoMKgwqDCoMKg wqDCoCBkZWdyYWRlZCBzdGF0ZS4NCmFjdGlvbjogT25saW5lIHRoZSBkZXZpY2UgdXNpbmcg J3pwb29sIG9ubGluZScgb3IgcmVwbGFjZSB0aGUgZGV2aWNlIHdpdGgNCsKgwqDCoMKgwqDC oMKgICd6cG9vbCByZXBsYWNlJy4NCsKgIHNjYW46IHNjcnViIGluIHByb2dyZXNzIHNpbmNl IFR1ZSBGZWLCoCA1IDA2OjU3OjE0IDIwMTkNCsKgwqDCoMKgwqDCoMKgIDg0MEcgc2Nhbm5l ZCBhdCAyMDBNL3MsIDUxN0cgaXNzdWVkIGF0IDEyM00vcywgMy4zNlQgdG90YWwNCsKgwqDC oMKgwqDCoMKgIDAgcmVwYWlyZWQsIDE1LjA0JSBkb25lLCAwIGRheXMgMDY6NDQ6MTcgdG8g Z28NCmNvbmZpZzoNCg0KwqDCoMKgwqDCoMKgwqAgTkFNRcKgwqDCoMKgwqDCoMKgwqDCoMKg wqDCoMKgwqDCoMKgwqDCoMKgwqDCoCBTVEFURcKgwqDCoMKgIFJFQUQgV1JJVEUgQ0tTVU0N CsKgwqDCoMKgwqDCoMKgIGJhY2t1cMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKg wqDCoMKgIERFR1JBREVEwqDCoMKgwqAgMMKgwqDCoMKgIDDCoMKgwqDCoCAwDQrCoMKgwqDC oMKgwqDCoMKgwqAgbWlycm9yLTDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqAgREVH UkFERUTCoMKgwqDCoCAwwqDCoMKgwqAgMMKgwqDCoMKgIDANCsKgwqDCoMKgwqDCoMKgwqDC oMKgwqAgZ3B0L2JhY2t1cDYxLmVsacKgwqDCoMKgwqAgT05MSU5FwqDCoMKgwqDCoMKgIDDC oMKgwqDCoCAwwqDCoMKgwqAgMA0KwqDCoMKgwqDCoMKgwqDCoMKgwqDCoCBncHQvYmFja3Vw NjItMS5lbGnCoMKgwqAgT05MSU5FwqDCoMKgwqDCoMKgIDDCoMKgwqDCoCAwwqDCoMKgwqAg MA0KwqDCoMKgwqDCoMKgwqDCoMKgwqDCoCAxMzI4MjgxMjI5NTc1NTQ2MDQ3OcKgIE9GRkxJ TkXCoMKgwqDCoMKgIDDCoMKgwqDCoCAwwqDCoMKgwqAgMMKgIHdhcw0KL2Rldi9ncHQvYmFj a3VwNjItMi5lbGkNCg0KZXJyb3JzOiBObyBrbm93biBkYXRhIGVycm9ycw0KDQpCdXQsIGhl cmUncyB0aGUgU01BUlQgZGF0YSBvbiB0aGUgZGlzayAtLSBpdCBET0VTIHNob3cgdGhlIHJl c2V0Og0KDQpCZWZvcmUuLi4uDQoNCkRldmljZSBTdGF0aXN0aWNzIChHUCBMb2cgMHgwNCkN ClBhZ2XCoCBPZmZzZXQgU2l6ZcKgwqDCoMKgwqDCoMKgIFZhbHVlIEZsYWdzIERlc2NyaXB0 aW9uDQoweDAxwqAgPT09PT3CoCA9wqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoCA9wqAg PT09wqAgPT0gR2VuZXJhbCBTdGF0aXN0aWNzIChyZXYgMikgPT0NCjB4MDHCoCAweDAwOMKg IDTCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoCAxOcKgIC0tLcKgIExpZmV0aW1lIFBvd2Vy LU9uIFJlc2V0cw0KMHgwMcKgIDB4MDE4wqAgNsKgwqDCoMKgIDMyMDAyMTM4NTM0wqAgLS0t wqAgTG9naWNhbCBTZWN0b3JzIFdyaXR0ZW4NCjB4MDHCoCAweDAyMMKgIDbCoMKgwqDCoMKg wqAgMTU1ODk1MzI1wqAgLS0twqAgTnVtYmVyIG9mIFdyaXRlIENvbW1hbmRzDQoweDAxwqAg MHgwMjjCoCA2wqDCoMKgIDI2NTQ1NzAxNjUwMMKgIC0tLcKgIExvZ2ljYWwgU2VjdG9ycyBS ZWFkDQoweDAxwqAgMHgwMzDCoCA2wqDCoMKgwqDCoCAxMTMyNjAxNDkwwqAgLS0twqAgTnVt YmVyIG9mIFJlYWQgQ29tbWFuZHMNCjB4MDHCoCAweDAzOMKgIDbCoMKgwqDCoCA2MTUzNzUx NTMwMMKgIC0tLcKgIERhdGUgYW5kIFRpbWUgVGltZVN0YW1wDQoweDAzwqAgPT09PT3CoCA9 wqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoCA9wqAgPT09wqAgPT0gUm90YXRpbmcgTWVk aWEgU3RhdGlzdGljcyAocmV2IDEpID09DQoweDAzwqAgMHgwMDjCoCA0wqDCoMKgwqDCoMKg wqDCoMKgwqDCoCA2MTE0wqAgLS0twqAgU3BpbmRsZSBNb3RvciBQb3dlci1vbiBIb3Vycw0K MHgwM8KgIDB4MDEwwqAgNMKgwqDCoMKgwqDCoMKgwqDCoMKgwqAgNjExNMKgIC0tLcKgIEhl YWQgRmx5aW5nIEhvdXJzDQoweDAzwqAgMHgwMTjCoCA0wqDCoMKgwqDCoMKgwqDCoMKgwqAg MzA2MDLCoCAtLS3CoCBIZWFkIExvYWQgRXZlbnRzDQoweDAzwqAgMHgwMjDCoCA0wqDCoMKg wqDCoMKgwqDCoMKgwqDCoMKgwqDCoCAwwqAgLS0twqAgTnVtYmVyIG9mIFJlYWxsb2NhdGVk IExvZ2ljYWwgU2VjdG9ycw0KMHgwM8KgIDB4MDI4wqAgNMKgwqDCoMKgwqDCoMKgwqDCoCAy ODM3MzXCoCAtLS3CoCBSZWFkIFJlY292ZXJ5IEF0dGVtcHRzDQoweDAzwqAgMHgwMzDCoCA0 wqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoCAwwqAgLS0twqAgTnVtYmVyIG9mIE1lY2hh bmljYWwgU3RhcnQgRmFpbHVyZXMNCjB4MDTCoCA9PT09PcKgID3CoMKgwqDCoMKgwqDCoMKg wqDCoMKgwqDCoMKgID3CoCA9PT3CoCA9PSBHZW5lcmFsIEVycm9ycyBTdGF0aXN0aWNzIChy ZXYgMSkgPT0NCjB4MDTCoCAweDAwOMKgIDTCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKg IDDCoCAtLS3CoCBOdW1iZXIgb2YgUmVwb3J0ZWQgVW5jb3JyZWN0YWJsZSBFcnJvcnMNCjB4 MDTCoCAweDAxMMKgIDTCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoCAxN8KgIC0tLcKgIFJl c2V0cyBCZXR3ZWVuIENtZCBBY2NlcHRhbmNlIGFuZA0KQ29tcGxldGlvDQpuDQoweDA1wqAg PT09PT3CoCA9wqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoCA9wqAgPT09wqAgPT0gVGVt cGVyYXR1cmUgU3RhdGlzdGljcyAocmV2IDEpID09DQoweDA1wqAgMHgwMDjCoCAxwqDCoMKg wqDCoMKgwqDCoMKgwqDCoMKgwqAgMzjCoCAtLS3CoCBDdXJyZW50IFRlbXBlcmF0dXJlDQow eDA1wqAgMHgwMTDCoCAxwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqAgNDDCoCBOLS3CoCBB dmVyYWdlIFNob3J0IFRlcm0gVGVtcGVyYXR1cmUNCjB4MDXCoCAweDAxOMKgIDHCoMKgwqDC oMKgwqDCoMKgwqDCoMKgwqDCoCAzMsKgIE4tLcKgIEF2ZXJhZ2UgTG9uZyBUZXJtIFRlbXBl cmF0dXJlDQoweDA1wqAgMHgwMjDCoCAxwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqAgNTLC oCAtLS3CoCBIaWdoZXN0IFRlbXBlcmF0dXJlDQoweDA1wqAgMHgwMjjCoCAxwqDCoMKgwqDC oMKgwqDCoMKgwqDCoMKgwqAgMjPCoCAtLS3CoCBMb3dlc3QgVGVtcGVyYXR1cmUNCjB4MDXC oCAweDAzMMKgIDHCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoCA0OMKgIE4tLcKgIEhpZ2hl c3QgQXZlcmFnZSBTaG9ydCBUZXJtIFRlbXBlcmF0dXJlDQoweDA1wqAgMHgwMzjCoCAxwqDC oMKgwqDCoMKgwqDCoMKgwqDCoMKgwqAgMjXCoCBOLS3CoCBMb3dlc3QgQXZlcmFnZSBTaG9y dCBUZXJtIFRlbXBlcmF0dXJlDQoweDA1wqAgMHgwNDDCoCAxwqDCoMKgwqDCoMKgwqDCoMKg wqDCoMKgwqAgNDTCoCBOLS3CoCBIaWdoZXN0IEF2ZXJhZ2UgTG9uZyBUZXJtIFRlbXBlcmF0 dXJlDQoweDA1wqAgMHgwNDjCoCAxwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqAgMjXCoCBO LS3CoCBMb3dlc3QgQXZlcmFnZSBMb25nIFRlcm0gVGVtcGVyYXR1cmUNCjB4MDXCoCAweDA1 MMKgIDTCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgIDDCoCAtLS3CoCBUaW1lIGluIE92 ZXItVGVtcGVyYXR1cmUNCjB4MDXCoCAweDA1OMKgIDHCoMKgwqDCoMKgwqDCoMKgwqDCoMKg wqDCoCA2MMKgIC0tLcKgIFNwZWNpZmllZCBNYXhpbXVtIE9wZXJhdGluZyBUZW1wZXJhdHVy ZQ0KMHgwNcKgIDB4MDYwwqAgNMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqAgMMKgIC0t LcKgIFRpbWUgaW4gVW5kZXItVGVtcGVyYXR1cmUNCjB4MDXCoCAweDA2OMKgIDHCoMKgwqDC oMKgwqDCoMKgwqDCoMKgwqDCoMKgIDDCoCAtLS3CoCBTcGVjaWZpZWQgTWluaW11bSBPcGVy YXRpbmcgVGVtcGVyYXR1cmUNCjB4MDbCoCA9PT09PcKgID3CoMKgwqDCoMKgwqDCoMKgwqDC oMKgwqDCoMKgID3CoCA9PT3CoCA9PSBUcmFuc3BvcnQgU3RhdGlzdGljcyAocmV2IDEpID09 DQoweDA2wqAgMHgwMDjCoCA0wqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoCA2wqAgLS0t wqAgTnVtYmVyIG9mIEhhcmR3YXJlIFJlc2V0cw0KMHgwNsKgIDB4MDEwwqAgNMKgwqDCoMKg wqDCoMKgwqDCoMKgwqDCoMKgwqAgMMKgIC0tLcKgIE51bWJlciBvZiBBU1IgRXZlbnRzDQow eDA2wqAgMHgwMTjCoCA0wqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoCAwwqAgLS0twqAg TnVtYmVyIG9mIEludGVyZmFjZSBDUkMgRXJyb3JzDQrCoMKgwqDCoMKgwqDCoMKgwqDCoMKg wqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoCB8fHxfIEMgbW9uaXRv cmVkIGNvbmRpdGlvbiBtZXQNCsKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDC oMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgIHx8X18gRCBzdXBwb3J0cyBEU04NCsKgwqDC oMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDC oMKgIHxfX18gTiBub3JtYWxpemVkIHZhbHVlDQoNCkFuZCBhZnRlci4uLi4NCg0KRGV2aWNl IFN0YXRpc3RpY3MgKEdQIExvZyAweDA0KQ0KUGFnZcKgIE9mZnNldCBTaXplwqDCoMKgwqDC oMKgwqAgVmFsdWUgRmxhZ3MgRGVzY3JpcHRpb24NCjB4MDHCoCA9PT09PcKgID3CoMKgwqDC oMKgwqDCoMKgwqDCoMKgwqDCoMKgID3CoCA9PT3CoCA9PSBHZW5lcmFsIFN0YXRpc3RpY3Mg KHJldiAyKSA9PQ0KMHgwMcKgIDB4MDA4wqAgNMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKg IDE5wqAgLS0twqAgTGlmZXRpbWUgUG93ZXItT24gUmVzZXRzDQoweDAxwqAgMHgwMTjCoCA2 wqDCoMKgwqAgMzIwMDQxOTUwNzDCoCAtLS3CoCBMb2dpY2FsIFNlY3RvcnMgV3JpdHRlbg0K MHgwMcKgIDB4MDIwwqAgNsKgwqDCoMKgwqDCoCAxNTU5NDY3MzLCoCAtLS3CoCBOdW1iZXIg b2YgV3JpdGUgQ29tbWFuZHMNCjB4MDHCoCAweDAyOMKgIDbCoMKgwqAgMjY2MzQwMDUyNDY4 wqAgLS0twqAgTG9naWNhbCBTZWN0b3JzIFJlYWQNCjB4MDHCoCAweDAzMMKgIDbCoMKgwqDC oMKgIDExMzYzNDc0NjPCoCAtLS3CoCBOdW1iZXIgb2YgUmVhZCBDb21tYW5kcw0KMHgwMcKg IDB4MDM4wqAgNsKgwqDCoMKgIDYxNTQwODE0NzAwwqAgLS0twqAgRGF0ZSBhbmQgVGltZSBU aW1lU3RhbXANCjB4MDPCoCA9PT09PcKgID3CoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKg ID3CoCA9PT3CoCA9PSBSb3RhdGluZyBNZWRpYSBTdGF0aXN0aWNzIChyZXYgMSkgPT0NCjB4 MDPCoCAweDAwOMKgIDTCoMKgwqDCoMKgwqDCoMKgwqDCoMKgIDYxMTTCoCAtLS3CoCBTcGlu ZGxlIE1vdG9yIFBvd2VyLW9uIEhvdXJzDQoweDAzwqAgMHgwMTDCoCA0wqDCoMKgwqDCoMKg wqDCoMKgwqDCoCA2MTE0wqAgLS0twqAgSGVhZCBGbHlpbmcgSG91cnMNCjB4MDPCoCAweDAx OMKgIDTCoMKgwqDCoMKgwqDCoMKgwqDCoCAzMDYwMsKgIC0tLcKgIEhlYWQgTG9hZCBFdmVu dHMNCjB4MDPCoCAweDAyMMKgIDTCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgIDDCoCAt LS3CoCBOdW1iZXIgb2YgUmVhbGxvY2F0ZWQgTG9naWNhbCBTZWN0b3JzDQoweDAzwqAgMHgw MjjCoCA0wqDCoMKgwqDCoMKgwqDCoMKgIDI4Mzg0OMKgIC0tLcKgIFJlYWQgUmVjb3Zlcnkg QXR0ZW1wdHMNCjB4MDPCoCAweDAzMMKgIDTCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKg IDDCoCAtLS3CoCBOdW1iZXIgb2YgTWVjaGFuaWNhbCBTdGFydCBGYWlsdXJlcw0KMHgwNMKg ID09PT09wqAgPcKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqAgPcKgID09PcKgID09IEdl bmVyYWwgRXJyb3JzIFN0YXRpc3RpY3MgKHJldiAxKSA9PQ0KMHgwNMKgIDB4MDA4wqAgNMKg wqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqAgMMKgIC0tLcKgIE51bWJlciBvZiBSZXBvcnRl ZCBVbmNvcnJlY3RhYmxlIEVycm9ycw0KMHgwNMKgIDB4MDEwwqAgNMKgwqDCoMKgwqDCoMKg wqDCoMKgwqDCoMKgIDE3wqAgLS0twqAgUmVzZXRzIEJldHdlZW4gQ21kIEFjY2VwdGFuY2Ug YW5kDQpDb21wbGV0aW9uDQoweDA1wqAgPT09PT3CoCA9wqDCoMKgwqDCoMKgwqDCoMKgwqDC oMKgwqDCoCA9wqAgPT09wqAgPT0gVGVtcGVyYXR1cmUgU3RhdGlzdGljcyAocmV2IDEpID09 DQoweDA1wqAgMHgwMDjCoCAxwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqAgNDHCoCAtLS3C oCBDdXJyZW50IFRlbXBlcmF0dXJlDQoweDA1wqAgMHgwMTDCoCAxwqDCoMKgwqDCoMKgwqDC oMKgwqDCoMKgwqAgNDDCoCBOLS3CoCBBdmVyYWdlIFNob3J0IFRlcm0gVGVtcGVyYXR1cmUN CjB4MDXCoCAweDAxOMKgIDHCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoCAzMsKgIE4tLcKg IEF2ZXJhZ2UgTG9uZyBUZXJtIFRlbXBlcmF0dXJlDQoweDA1wqAgMHgwMjDCoCAxwqDCoMKg wqDCoMKgwqDCoMKgwqDCoMKgwqAgNTLCoCAtLS3CoCBIaWdoZXN0IFRlbXBlcmF0dXJlDQow eDA1wqAgMHgwMjjCoCAxwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqAgMjPCoCAtLS3CoCBM b3dlc3QgVGVtcGVyYXR1cmUNCjB4MDXCoCAweDAzMMKgIDHCoMKgwqDCoMKgwqDCoMKgwqDC oMKgwqDCoCA0OMKgIE4tLcKgIEhpZ2hlc3QgQXZlcmFnZSBTaG9ydCBUZXJtIFRlbXBlcmF0 dXJlDQoweDA1wqAgMHgwMzjCoCAxwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqAgMjXCoCBO LS3CoCBMb3dlc3QgQXZlcmFnZSBTaG9ydCBUZXJtIFRlbXBlcmF0dXJlDQoweDA1wqAgMHgw NDDCoCAxwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqAgNDTCoCBOLS3CoCBIaWdoZXN0IEF2 ZXJhZ2UgTG9uZyBUZXJtIFRlbXBlcmF0dXJlDQoweDA1wqAgMHgwNDjCoCAxwqDCoMKgwqDC oMKgwqDCoMKgwqDCoMKgwqAgMjXCoCBOLS3CoCBMb3dlc3QgQXZlcmFnZSBMb25nIFRlcm0g VGVtcGVyYXR1cmUNCjB4MDXCoCAweDA1MMKgIDTCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDC oMKgIDDCoCAtLS3CoCBUaW1lIGluIE92ZXItVGVtcGVyYXR1cmUNCjB4MDXCoCAweDA1OMKg IDHCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoCA2MMKgIC0tLcKgIFNwZWNpZmllZCBNYXhp bXVtIE9wZXJhdGluZyBUZW1wZXJhdHVyZQ0KMHgwNcKgIDB4MDYwwqAgNMKgwqDCoMKgwqDC oMKgwqDCoMKgwqDCoMKgwqAgMMKgIC0tLcKgIFRpbWUgaW4gVW5kZXItVGVtcGVyYXR1cmUN CjB4MDXCoCAweDA2OMKgIDHCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgIDDCoCAtLS3C oCBTcGVjaWZpZWQgTWluaW11bSBPcGVyYXRpbmcgVGVtcGVyYXR1cmUNCjB4MDbCoCA9PT09 PcKgID3CoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgID3CoCA9PT3CoCA9PSBUcmFuc3Bv cnQgU3RhdGlzdGljcyAocmV2IDEpID09DQoweDA2wqAgMHgwMDjCoCA0wqDCoMKgwqDCoMKg wqDCoMKgwqDCoMKgwqDCoCA3wqAgLS0twqAgTnVtYmVyIG9mIEhhcmR3YXJlIFJlc2V0cw0K MHgwNsKgIDB4MDEwwqAgNMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqAgMMKgIC0tLcKg IE51bWJlciBvZiBBU1IgRXZlbnRzDQoweDA2wqAgMHgwMTjCoCA0wqDCoMKgwqDCoMKgwqDC oMKgwqDCoMKgwqDCoCAwwqAgLS0twqAgTnVtYmVyIG9mIEludGVyZmFjZSBDUkMgRXJyb3Jz DQrCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKg wqDCoMKgwqDCoCB8fHxfIEMgbW9uaXRvcmVkIGNvbmRpdGlvbiBtZXQNCsKgwqDCoMKgwqDC oMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgIHx8 X18gRCBzdXBwb3J0cyBEU04NCsKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDC oMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgIHxfX18gTiBub3JtYWxpemVkIHZhbHVlDQoN Ck51bWJlciBvZiBIYXJkd2FyZSBSZXNldHMgaGFzIGluY3JlbWVudGVkLsKgIFRoZXJlIGFy ZSBubyBvdGhlciBlcnJvcnMgc2hvd246DQoNClNNQVJUIEF0dHJpYnV0ZXMgRGF0YSBTdHJ1 Y3R1cmUgcmV2aXNpb24gbnVtYmVyOiAxNg0KVmVuZG9yIFNwZWNpZmljIFNNQVJUIEF0dHJp YnV0ZXMgd2l0aCBUaHJlc2hvbGRzOg0KSUQjIEFUVFJJQlVURV9OQU1FwqDCoMKgwqDCoMKg wqDCoMKgIEZMQUdTwqDCoMKgIFZBTFVFIFdPUlNUIFRIUkVTSCBGQUlMIFJBV19WQUxVRQ0K wqAgMSBSYXdfUmVhZF9FcnJvcl9SYXRlwqDCoMKgwqAgUE8tUi0twqDCoCAxMDDCoMKgIDEw MMKgwqAgMDE2wqDCoMKgIC3CoMKgwqAgMA0KwqAgMiBUaHJvdWdocHV0X1BlcmZvcm1hbmNl wqAgUC1TLS0twqDCoCAxMzfCoMKgIDEzN8KgwqAgMDU0wqDCoMKgIC3CoMKgwqAgMTA0DQrC oCAzIFNwaW5fVXBfVGltZcKgwqDCoMKgwqDCoMKgwqDCoMKgwqAgUE9TLS0twqDCoCAxMzLC oMKgIDEzMsKgwqAgMDI0wqDCoMKgIC3CoMKgwqAgNDk3DQooQXZlcmFnZSA0OTcpDQrCoCA0 IFN0YXJ0X1N0b3BfQ291bnTCoMKgwqDCoMKgwqDCoCAtTy0tQy3CoMKgIDA5OcKgwqAgMDk5 wqDCoCAwMDDCoMKgwqAgLcKgwqDCoCA3MDc0DQrCoCA1IFJlYWxsb2NhdGVkX1NlY3Rvcl9D dMKgwqAgUE8tLUNLwqDCoCAxMDDCoMKgIDEwMMKgwqAgMDA1wqDCoMKgIC3CoMKgwqAgMA0K wqAgNyBTZWVrX0Vycm9yX1JhdGXCoMKgwqDCoMKgwqDCoMKgIFBPLVItLcKgwqAgMTAwwqDC oCAxMDDCoMKgIDA2N8KgwqDCoCAtwqDCoMKgIDANCsKgIDggU2Vla19UaW1lX1BlcmZvcm1h bmNlwqDCoCBQLVMtLS3CoMKgIDEyOMKgwqAgMTI4wqDCoCAwMjDCoMKgwqAgLcKgwqDCoCAx OA0KwqAgOSBQb3dlcl9Pbl9Ib3Vyc8KgwqDCoMKgwqDCoMKgwqDCoCAtTy0tQy3CoMKgIDA5 OMKgwqAgMDk4wqDCoCAwMDDCoMKgwqAgLcKgwqDCoCAxNzA5NA0KwqAxMCBTcGluX1JldHJ5 X0NvdW50wqDCoMKgwqDCoMKgwqAgUE8tLUMtwqDCoCAxMDDCoMKgIDEwMMKgwqAgMDYwwqDC oMKgIC3CoMKgwqAgMA0KwqAxMiBQb3dlcl9DeWNsZV9Db3VudMKgwqDCoMKgwqDCoCAtTy0t Q0vCoMKgIDEwMMKgwqAgMTAwwqDCoCAwMDDCoMKgwqAgLcKgwqDCoCAxOQ0KMTkyIFBvd2Vy LU9mZl9SZXRyYWN0X0NvdW50IC1PLS1DS8KgwqAgMDc1wqDCoCAwNzXCoMKgIDAwMMKgwqDC oCAtwqDCoMKgIDMwNjAyDQoxOTMgTG9hZF9DeWNsZV9Db3VudMKgwqDCoMKgwqDCoMKgIC1P LS1DLcKgwqAgMDc1wqDCoCAwNzXCoMKgIDAwMMKgwqDCoCAtwqDCoMKgIDMwNjAyDQoxOTQg VGVtcGVyYXR1cmVfQ2Vsc2l1c8KgwqDCoMKgIC1PLS0tLcKgwqAgMTQ2wqDCoCAxNDbCoMKg IDAwMMKgwqDCoCAtwqDCoMKgIDQxIChNaW4vTWF4DQoyMy81MikNCjE5NiBSZWFsbG9jYXRl ZF9FdmVudF9Db3VudCAtTy0tQ0vCoMKgIDEwMMKgwqAgMTAwwqDCoCAwMDDCoMKgwqAgLcKg wqDCoCAwDQoxOTcgQ3VycmVudF9QZW5kaW5nX1NlY3RvcsKgIC1PLS0tS8KgwqAgMTAwwqDC oCAxMDDCoMKgIDAwMMKgwqDCoCAtwqDCoMKgIDANCjE5OCBPZmZsaW5lX1VuY29ycmVjdGFi bGXCoMKgIC0tLVItLcKgwqAgMTAwwqDCoCAxMDDCoMKgIDAwMMKgwqDCoCAtwqDCoMKgIDAN CjE5OSBVRE1BX0NSQ19FcnJvcl9Db3VudMKgwqDCoCAtTy1SLS3CoMKgIDIwMMKgwqAgMjAw wqDCoCAwMDDCoMKgwqAgLcKgwqDCoCAwDQrCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKg wqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqAgfHx8fHx8XyBLIGF1dG8ta2VlcA0KwqDCoMKg wqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgIHx8fHx8 X18gQyBldmVudCBjb3VudA0KwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKg wqDCoMKgwqDCoMKgwqDCoMKgIHx8fHxfX18gUiBlcnJvciByYXRlDQrCoMKgwqDCoMKgwqDC oMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqAgfHx8X19fXyBTIHNw ZWVkL3BlcmZvcm1hbmNlDQrCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDC oMKgwqDCoMKgwqDCoMKgwqAgfHxfX19fXyBPIHVwZGF0ZWQgb25saW5lDQrCoMKgwqDCoMKg wqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqAgfF9fX19fXyBQ IHByZWZhaWx1cmUgd2FybmluZw0KDQpJJ2QgdGhyb3cgcG9zc2libGUgc2hhZGUgYXQgdGhl IGJhY2twbGFuZSBvciBjYWJsZSAvYnV0IEkgaGF2ZSBhbHJlYWR5DQpzd2FwcGVkIGJvdGgg b3V0IGZvciBzcGFyZXMgd2l0aG91dCBhbnkgY2hhbmdlIGluIGJlaGF2aW9yLi8NCg0KLS0g DQpLYXJsIERlbm5pbmdlcg0Ka2FybEBkZW5uaW5nZXIubmV0IDxtYWlsdG86a2FybEBkZW5u aW5nZXIubmV0Pg0KL1RoZSBNYXJrZXQgVGlja2VyLw0KL1tTL01JTUUgZW5jcnlwdGVkIGVt YWlsIHByZWZlcnJlZF0vDQo= --------------ms030707090402060507070908 Content-Type: application/pkcs7-signature; name="smime.p7s" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="smime.p7s" Content-Description: S/MIME Cryptographic Signature MIAGCSqGSIb3DQEHAqCAMIACAQExDzANBglghkgBZQMEAgMFADCABgkqhkiG9w0BBwEAAKCC DdgwggagMIIEiKADAgECAhMA5EiKghDOXrvfxYxjITXYDdhIMA0GCSqGSIb3DQEBCwUAMIGL MQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTESMBAGA1UEBwwJTmljZXZpbGxlMRkw FwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5c3RlbXMgQ0ExITAf BgNVBAMMGEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBDQTAeFw0xNzA4MTcxNjQyMTdaFw0yNzA4 MTUxNjQyMTdaMHsxCzAJBgNVBAYTAlVTMRAwDgYDVQQIDAdGbG9yaWRhMRkwFwYDVQQKDBBD dWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5c3RlbXMgQ0ExJTAjBgNVBAMMHEN1 ZGEgU3lzdGVtcyBMTEMgMjAxNyBJbnQgQ0EwggIiMA0GCSqGSIb3DQEBAQUAA4ICDwAwggIK AoICAQC1aJotNUI+W4jP7xQDO8L/b4XiF4Rss9O0B+3vMH7Njk85fZ052QhZpMVlpaaO+sCI KqG3oNEbuOHzJB/NDJFnqh7ijBwhdWutdsq23Ux6TvxgakyMPpT6TRNEJzcBVQA0kpby1DVD 0EKSK/FrWWBiFmSxg7qUfmIq/mMzgE6epHktyRM3OGq3dbRdOUgfumWrqHXOrdJz06xE9NzY vc9toqZnd79FUtE/nSZVm1VS3Grq7RKV65onvX3QOW4W1ldEHwggaZxgWGNiR/D4eosAGFxn uYeWlKEC70c99Mp1giWux+7ur6hc2E+AaTGh+fGeijO5q40OGd+dNMgK8Es0nDRw81lRcl24 SWUEky9y8DArgIFlRd6d3ZYwgc1DMTWkTavx3ZpASp5TWih6yI8ACwboTvlUYeooMsPtNa9E 6UQ1nt7VEi5syjxnDltbEFoLYcXBcqhRhFETJe9CdenItAHAtOya3w5+fmC2j/xJz29og1KH YqWHlo3Kswi9G77an+zh6nWkMuHs+03DU8DaOEWzZEav3lVD4u76bKRDTbhh0bMAk4eXriGL h4MUoX3Imfcr6JoyheVrAdHDL/BixbMH1UUspeRuqQMQ5b2T6pabXP0oOB4FqldWiDgJBGRd zWLgCYG8wPGJGYgHibl5rFiI5Ix3FQncipc6SdUzOQIDAQABo4IBCjCCAQYwHQYDVR0OBBYE FF3AXsKnjdPND5+bxVECGKtc047PMIHABgNVHSMEgbgwgbWAFBu1oRhUMNEzjODolDka5k4Q EDBioYGRpIGOMIGLMQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTESMBAGA1UEBwwJ TmljZXZpbGxlMRkwFwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5 c3RlbXMgQ0ExITAfBgNVBAMMGEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBDQYIJAKxAy1WBo2kY MBIGA1UdEwEB/wQIMAYBAf8CAQAwDgYDVR0PAQH/BAQDAgGGMA0GCSqGSIb3DQEBCwUAA4IC AQCB5686UCBVIT52jO3sz9pKuhxuC2npi8ZvoBwt/IH9piPA15/CGF1XeXUdu2qmhOjHkVLN gO7XB1G8CuluxofOIUce0aZGyB+vZ1ylHXlMeB0R82f5dz3/T7RQso55Y2Vog2Zb7PYTC5B9 oNy3ylsnNLzanYlcW3AAfzZcbxYuAdnuq0Im3EpGm8DoItUcf1pDezugKm/yKtNtY6sDyENj tExZ377cYA3IdIwqn1Mh4OAT/Rmh8au2rZAo0+bMYBy9C11Ex0hQ8zWcvPZBDn4v4RtO8g+K uQZQcJnO09LJNtw94W3d2mj4a7XrsKMnZKvm6W9BJIQ4Nmht4wXAtPQ1xA+QpxPTmsGAU0Cv HmqVC7XC3qxFhaOrD2dsvOAK6Sn3MEpH/YrfYCX7a7cz5zW3DsJQ6o3pYfnnQz+hnwLlz4MK 17NIA0WOdAF9IbtQqarf44+PEyUbKtz1r0KGeGLs+VGdd2FLA0e7yuzxJDYcaBTVwqaHhU2/ Fna/jGU7BhrKHtJbb/XlLeFJ24yvuiYKpYWQSSyZu1R/gvZjHeGb344jGBsZdCDrdxtQQcVA 6OxsMAPSUPMrlg9LWELEEYnVulQJerWxpUecGH92O06wwmPgykkz//UmmgjVSh7ErNvL0lUY UMfunYVO/O5hwhW+P4gviCXzBFeTtDZH259O7TCCBzAwggUYoAMCAQICEwCg0WvVwekjGFiO 62SckFwepz0wDQYJKoZIhvcNAQELBQAwezELMAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3Jp ZGExGTAXBgNVBAoMEEN1ZGEgU3lzdGVtcyBMTEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBD QTElMCMGA1UEAwwcQ3VkYSBTeXN0ZW1zIExMQyAyMDE3IEludCBDQTAeFw0xNzA4MTcyMTIx MjBaFw0yMjA4MTYyMTIxMjBaMFcxCzAJBgNVBAYTAlVTMRAwDgYDVQQIDAdGbG9yaWRhMRkw FwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRswGQYDVQQDDBJrYXJsQGRlbm5pbmdlci5uZXQw ggIiMA0GCSqGSIb3DQEBAQUAA4ICDwAwggIKAoICAQC+HVSyxVtJhy3Ohs+PAGRuO//Dha9A 16l5FPATr6wude9zjX5f2lrkRyU8vhCXTZW7WbvWZKpcZ8r0dtZmiK9uF58Ec6hhvfkxJzbg 96WHBw5Fumd5ahZzuCJDtCAWW8R7/KN+zwzQf1+B3MVLmbaXAFBuKzySKhKMcHbK3/wjUYTg y+3UK6v2SBrowvkUBC+jxNg3Wy12GsTXcUS/8FYIXgVVPgfZZrbJJb5HWOQpvvhILpPCD3xs YJFNKEPltXKWHT7Qtc2HNqikgNwj8oqOb+PeZGMiWapsatKm8mxuOOGOEBhAoTVTwUHlMNTg 6QUCJtuWFCK38qOCyk9Haj+86lUU8RG6FkRXWgMbNQm1mWREQhw3axgGLSntjjnznJr5vsvX SYR6c+XKLd5KQZcS6LL8FHYNjqVKHBYM+hDnrTZMqa20JLAF1YagutDiMRURU23iWS7bA9tM cXcqkclTSDtFtxahRifXRI7Epq2GSKuEXe/1Tfb5CE8QsbCpGsfSwv2tZ/SpqVG08MdRiXxN 5tmZiQWo15IyWoeKOXl/hKxA9KPuDHngXX022b1ly+5ZOZbxBAZZMod4y4b4FiRUhRI97r9l CxsP/EPHuuTIZ82BYhrhbtab8HuRo2ofne2TfAWY2BlA7ExM8XShMd9bRPZrNTokPQPUCWCg CdIATQIDAQABo4IBzzCCAcswPAYIKwYBBQUHAQEEMDAuMCwGCCsGAQUFBzABhiBodHRwOi8v b2NzcC5jdWRhc3lzdGVtcy5uZXQ6ODg4ODAJBgNVHRMEAjAAMBEGCWCGSAGG+EIBAQQEAwIF oDAOBgNVHQ8BAf8EBAMCBeAwHQYDVR0lBBYwFAYIKwYBBQUHAwIGCCsGAQUFBwMEMDMGCWCG SAGG+EIBDQQmFiRPcGVuU1NMIEdlbmVyYXRlZCBDbGllbnQgQ2VydGlmaWNhdGUwHQYDVR0O BBYEFLElmNWeVgsBPe7O8NiBzjvjYnpRMIHKBgNVHSMEgcIwgb+AFF3AXsKnjdPND5+bxVEC GKtc047PoYGRpIGOMIGLMQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTESMBAGA1UE BwwJTmljZXZpbGxlMRkwFwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRh IFN5c3RlbXMgQ0ExITAfBgNVBAMMGEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBDQYITAORIioIQ zl6738WMYyE12A3YSDAdBgNVHREEFjAUgRJrYXJsQGRlbm5pbmdlci5uZXQwDQYJKoZIhvcN AQELBQADggIBAJXboPFBMLMtaiUt4KEtJCXlHO/3ZzIUIw/eobWFMdhe7M4+0u3te0sr77QR dcPKR0UeHffvpth2Mb3h28WfN0FmJmLwJk+pOx4u6uO3O0E1jNXoKh8fVcL4KU79oEQyYkbu 2HwbXBU9HbldPOOZDnPLi0whi/sbFHdyd4/w/NmnPgzAsQNZ2BYT9uBNr+jZw4SsluQzXG1X lFL/qCBoi1N2mqKPIepfGYF6drbr1RnXEJJsuD+NILLooTNf7PMgHPZ4VSWQXLNeFfygoOOK FiO0qfxPKpDMA+FHa8yNjAJZAgdJX5Mm1kbqipvb+r/H1UAmrzGMbhmf1gConsT5f8KU4n3Q IM2sOpTQe7BoVKlQM/fpQi6aBzu67M1iF1WtODpa5QUPvj1etaK+R3eYBzi4DIbCIWst8MdA 1+fEeKJFvMEZQONpkCwrJ+tJEuGQmjoQZgK1HeloepF0WDcviiho5FlgtAij+iBPtwMuuLiL shAXA5afMX1hYM4l11JXntle12EQFP1r6wOUkpOdxceCcMVDEJBBCHW2ZmdEaXgAm1VU+fnQ qS/wNw/S0X3RJT1qjr5uVlp2Y0auG/eG0jy6TT0KzTJeR9tLSDXprYkN2l/Qf7/nT6Q03qyE QnnKiBXWAZXveafyU/zYa7t3PTWFQGgWoC4w6XqgPo4KV44OMYIFBzCCBQMCAQEwgZIwezEL MAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3JpZGExGTAXBgNVBAoMEEN1ZGEgU3lzdGVtcyBM TEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBDQTElMCMGA1UEAwwcQ3VkYSBTeXN0ZW1zIExM QyAyMDE3IEludCBDQQITAKDRa9XB6SMYWI7rZJyQXB6nPTANBglghkgBZQMEAgMFAKCCAkUw GAYJKoZIhvcNAQkDMQsGCSqGSIb3DQEHATAcBgkqhkiG9w0BCQUxDxcNMTkwMjA1MTYyNjI0 WjBPBgkqhkiG9w0BCQQxQgRAlnWwTvqiootpUHv5swkgkGGDqkZDIFOQgasbSsWukcdIwhis kusclr0KERI7Xbp0OUVyA+dGLCWmQYJRHQWBXTBsBgkqhkiG9w0BCQ8xXzBdMAsGCWCGSAFl AwQBKjALBglghkgBZQMEAQIwCgYIKoZIhvcNAwcwDgYIKoZIhvcNAwICAgCAMA0GCCqGSIb3 DQMCAgFAMAcGBSsOAwIHMA0GCCqGSIb3DQMCAgEoMIGjBgkrBgEEAYI3EAQxgZUwgZIwezEL MAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3JpZGExGTAXBgNVBAoMEEN1ZGEgU3lzdGVtcyBM TEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBDQTElMCMGA1UEAwwcQ3VkYSBTeXN0ZW1zIExM QyAyMDE3IEludCBDQQITAKDRa9XB6SMYWI7rZJyQXB6nPTCBpQYLKoZIhvcNAQkQAgsxgZWg gZIwezELMAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3JpZGExGTAXBgNVBAoMEEN1ZGEgU3lz dGVtcyBMTEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBDQTElMCMGA1UEAwwcQ3VkYSBTeXN0 ZW1zIExMQyAyMDE3IEludCBDQQITAKDRa9XB6SMYWI7rZJyQXB6nPTANBgkqhkiG9w0BAQEF AASCAgAm3UBr7Y97RDqMZgqjMCjekNSJwqNz7LOn4KXb1VC9mFP65kuYQxa85S0ajGxXjzzv cUfixX+J+6e2ZoWFuiQ07q6AEowUB+QHyJwyrm1e05yXxORDul3RBH3GOKUhpJ2ANHY6BV6G Jef3LjAmL7IxFcuXLc6VDmTa5rT5OCWZNf6U8PddS5ZJoNxYjnMlDW2BQZUll6ZT4bniKooC BGXZqE0QK/fpOkVMq2PPpj0+Xp9VY37cLeeu5Ol1OMCUii7XS8aS+wO8c8NoOJDd3iP9AASB +4rAEDJB0wvYG4RYW1hBQY1r9r25klLWjpB7yzDTklD46DEN3SJCFWayzyK1EHbPmVJQf6K+ iAG2CS2xQ7et33BXlIuBvgf0k4/oHIoPWGKD+1bmLU2KCXP20BwqWqPpoD5d/bM9zuf2TT+l rgKJyZCYCZ8oKDg0unNxFayZ83JQ/xZQYgM4VOTfMCM1eR7Gg9tiAisS0CjTKUgvilOzqV7l fe6SXKOwaqWgtjSNHgQZSiFcVRh1bRxTswHnUe3O9Ah57bg40va9vW6dMQDQBleEsUbIGXal IY+rF5ZBi1fpziJkbfBdg9dSKqv1/kUZHJNm6KUuPNvnFUTEWE+2O28N2NOHxZ7kLXF9R+Zx iVZ3qQVFDQg8iUC8oehB9d+6Mmo4W3AROXMaJ2b13AAAAAAAAA== --------------ms030707090402060507070908-- From owner-freebsd-stable@freebsd.org Tue Feb 5 19:54:51 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id AA92F14CEBF6 for ; Tue, 5 Feb 2019 19:54:51 +0000 (UTC) (envelope-from shawn.webb@hardenedbsd.org) Received: from mail-wr1-x442.google.com (mail-wr1-x442.google.com [IPv6:2a00:1450:4864:20::442]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 452C08EDBE for ; Tue, 5 Feb 2019 19:54:50 +0000 (UTC) (envelope-from shawn.webb@hardenedbsd.org) Received: by mail-wr1-x442.google.com with SMTP id l9so4983020wrt.13 for ; Tue, 05 Feb 2019 11:54:50 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=hardenedbsd.org; s=google; h=date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to:user-agent; bh=SPJllcMHrNoeIpfUbE42R372lZ3TmeN8Zuyb03eoVNE=; b=hq7JOD4Mxe4UjqvDHNnvELOKD/fifUSUmrwK4EO10M87hBRPEhyvkkFsrkTqx1MolI KFFJssPSVFd9oz8IzWXz2YPCIk8hZGYxoptb9kd6PzyYvk31iemn0kozw/cP3efjYSUQ tFUstAgbc7j5wwz9i98LkqPwJ4lywer/SlHjA+L2mCEVnaf4NIbzAek/bxsplwbLJO34 1ZuTPfZ/HRZvtz/vGz5LMdUPrLBnKc2YV8wFNv4mQWAQHR/A3dpTZUcyPgHzRCx2faLk cOC6TAD0d+3+0ESAb74mNOdg0DH9GtAltoQtldJ1Yqw6pOipLBOGEGdClEXQ68Qe+pTQ TCRQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to:user-agent; bh=SPJllcMHrNoeIpfUbE42R372lZ3TmeN8Zuyb03eoVNE=; b=H/eWBZ1KskMUXd6PTyPoSkZ1J7fQoWULo7FJYXaf1t38sj6PkOrfAwtEXxGlKz9SZj +LCSa1RY3HGgFoWNcpDsiJCMo3Svgr7KQZJn9fepBRwnaIKsQxk8F1BQPjJHbww36yrJ OIlGWkFN/iDEoSGXof0mQcYM1Dwjc8AJySqwAT79+lUsmO6Qo2M1WaeHu0zb+L6wcqna KExEzES0Zl+yXEXzbLNwEbmPRHn4ljEIodSIGZsfIjmlwKUdyKM2qqDvIOtMAtCLQbRm t7v28TQeB6MXEqvOLlEzzWAKfJKZnvWP6oQuRULXmdDwDaPwyZq77l+cvjb1KsY6azXh cb8Q== X-Gm-Message-State: AHQUAuYp3ammmli2XMVagj4U8NYriCf6wnQVveCHZF2e/QfV330VdOM6 xhZhx2U/WBeYx3Wve4mItirj7+3Cp7bGvSzNYSNc6aC4xiBx/9mA/F9ViEWzwzubVA3mALcu6AX EokydxF925bMLj1XyqbqhEeZAvTscPy4oS/0osC/JcMNgAqmJu3VxKwtE5fPfsFlariZYGMYfMV SN55HypWdZ X-Google-Smtp-Source: AHgI3IbsRLoxKF2yyJv/QT62LF1m8qRIK94FrTQHple0Yc7kDTWzXO+apuzDJvfIy+uDZf9afYvLNA== X-Received: by 2002:a5d:6710:: with SMTP id o16mr5129305wru.152.1549396488696; Tue, 05 Feb 2019 11:54:48 -0800 (PST) Received: from mutt-hbsd (232.ip-54-39-148.net. [54.39.148.232]) by smtp.gmail.com with ESMTPSA id w18sm25290537wru.54.2019.02.05.11.54.45 (version=TLS1_2 cipher=ECDHE-RSA-CHACHA20-POLY1305 bits=256/256); Tue, 05 Feb 2019 11:54:47 -0800 (PST) Date: Tue, 5 Feb 2019 14:54:16 -0500 From: Shawn Webb To: freebsd-stable@freebsd.org Cc: FreeBSD Errata Notices Subject: Re: [FreeBSD-Announce] FreeBSD Errata Notice FreeBSD-EN-19:05.kqueue Message-ID: <20190205195416.5ddsmc4rf7og4ece@mutt-hbsd> References: <20190109194030.DFE3A8CC7@freefall.freebsd.org> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="kiaejttu3tx4nf65" Content-Disposition: inline In-Reply-To: <20190109194030.DFE3A8CC7@freefall.freebsd.org> X-Operating-System: FreeBSD mutt-hbsd 13.0-CURRENT-HBSD FreeBSD 13.0-CURRENT-HBSD 1b35a2c4553(hardened/current/cross-dso-cfi) HARDENEDBSD-13-CURRENT amd64 X-PGP-Key: http://pgp.mit.edu/pks/lookup?op=vindex&search=0x6A84658F52456EEE User-Agent: NeoMutt/20180716 X-Rspamd-Queue-Id: 452C08EDBE X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=hardenedbsd.org header.s=google header.b=hq7JOD4M; spf=pass (mx1.freebsd.org: domain of shawn.webb@hardenedbsd.org designates 2a00:1450:4864:20::442 as permitted sender) smtp.mailfrom=shawn.webb@hardenedbsd.org X-Spamd-Result: default: False [-5.46 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_ALLOW(-0.20)[hardenedbsd.org:s=google]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; DMARC_NA(0.00)[hardenedbsd.org]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[hardenedbsd.org:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[2.4.4.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.5.4.1.0.0.a.2.list.dnswl.org : 127.0.5.0]; MX_GOOD(-0.01)[alt1.aspmx.l.google.com,aspmx.l.google.com,aspmx2.googlemail.com,alt2.aspmx.l.google.com,aspmx3.googlemail.com]; SIGNED_PGP(-2.00)[]; NEURAL_HAM_SHORT(-0.94)[-0.938,0]; FROM_EQ_ENVFROM(0.00)[]; MID_RHS_NOT_FQDN(0.50)[]; MIME_TRACE(0.00)[0:+,1:+]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; RCVD_TLS_LAST(0.00)[]; IP_SCORE(-0.41)[ip: (2.27), ipnet: 2a00:1450::/32(-2.30), asn: 15169(-1.95), country: US(-0.07)] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 05 Feb 2019 19:54:51 -0000 --kiaejttu3tx4nf65 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Wed, Jan 09, 2019 at 07:40:30PM +0000, FreeBSD Errata Notices wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA512 >=20 > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D > FreeBSD-EN-19:05.kqueue Errata No= tice > The FreeBSD Pro= ject >=20 > Topic: kqueue race condition and kernel panic >=20 > Category: core > Module: kqueue > Announced: 2019-01-09 > Credits: Mark Johnston > Affects: FreeBSD 11.2 > Corrected: 2019-11-24 17:11:47 UTC (stable/11, 11.2-STABLE) Corrected November of 2018 or 2019? ;) --=20 Shawn Webb Cofounder and Security Engineer HardenedBSD Tor-ified Signal: +1 443-546-8752 Tor+XMPP+OTR: lattera@is.a.hacker.sx GPG Key ID: 0x6A84658F52456EEE GPG Key Fingerprint: 2ABA B6BD EF6A F486 BE89 3D9E 6A84 658F 5245 6EEE --kiaejttu3tx4nf65 Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEEKrq2ve9q9Ia+iT2eaoRlj1JFbu4FAlxZ6eMACgkQaoRlj1JF bu5WwQ//XgzSEDrGqXW7jGf3GkUdGfQm8PgC/6PLrOBNkj7LNzYCjt+h5K7Nk5X7 X3G6O4K9fiFu9F8KnRZpPbtgzrBW16IFCprNylgVz2s5BX/d7oolmYIolw0YWly2 IV+f5YNzaZcIkTOA2O5PvRyAxmkc9NnG4PF+FBP3F5a5idcE+/kpOK/doI2Q2Vb7 fmwWwiewy/3CK6vrxwo+bXU9OXPgJ3JDyu53PWr9OCezz9gfP4i5CE8hHTw5NDhU 5A0fUGY1SUc/Zge2sla/gFDuObLImmeRB6EYah6kAYvjC0olhzOWsAVFDFib9oNm FtGiUptOKi47fwn/P5cbbwf2O7/Czz2E7XcYb1Ioof0/2Sexvg1DtMSuyC4FZN8X 7aPqkgZYnUA8EHWgYB7ytN73vFZXjrlRD7JvixsFvAmzlvNb2L78Q5vdoR8+Kpjq BzaHrMbIhw0dIY4yoB45UUwr6Rx1/v3QvAx6XoL2UqDyc6O4nn48E5DKqG8pwXAl 2wkDzIcJYv+Xm4K/na9/OijCekEA1yYmuxfAsO6MGbEakHMu1Y5x4b7wjuemVwiu OCSqG1onlZ90AIfkGBzLjTZY0vKc9Je2NJAMxIvCDWcRjcRranDjh/+Tu8WL+qP1 qKnRhFaDphBxfQ3ClZg5Fnbtt35m+vGVQXegYiLZZZ71tPEeryU= =lHX1 -----END PGP SIGNATURE----- --kiaejttu3tx4nf65-- From owner-freebsd-stable@freebsd.org Tue Feb 5 20:00:44 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1C0F714CEE61 for ; Tue, 5 Feb 2019 20:00:44 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-lj1-f181.google.com (mail-lj1-f181.google.com [209.85.208.181]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 3C1B08EFF3; Tue, 5 Feb 2019 20:00:41 +0000 (UTC) (envelope-from asomers@gmail.com) Received: by mail-lj1-f181.google.com with SMTP id v14-v6so1214358ljv.1; Tue, 05 Feb 2019 12:00:41 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=3HFTM1oHzy6rZxbbQLoRF3WBwXOfEqFtH1Nym0MFCDQ=; b=PnXNbl7Ei+C/JIAauw+JPXspdowaZJB5t1hzzLl7d2a7EA3p9Zf/S+huwAPwrk0olS TFvy5tdsJuUU9txoHXl4BcJqarzM24PtjUsZ9c3nosRE6Jfg/uY5H/JrKfWvKAJeIBWS jOLVWyMeMoHXCapwKZjfz3XBkd2cfY38SQ+NivSq/AjM1fdjCSl7vLbTsN52VqqDMU2q kzlcHrKcyAIqFWDDWGjY7WsUGMMpdoyXbAhZwIYboyp3REtH0AXcwSYIoBojI3fEuMIC X+gAfY2mFGFrl3d+EVjLfbJhtyAZB+lPxZXSSlcf64Jv7Ny9ch15DfO3Yo9t02ggFBIy sPYA== X-Gm-Message-State: AHQUAuYlZoTcqfCIL3bRtwcTHCFwopvgqeN3fN+N5fxX1g6ZLMDZ6L1Y nbVFqydrvagMQRu7eprhSlyenVuvZYXMGvIN/zyEZw== X-Google-Smtp-Source: AHgI3IarqID/aZcQ56hUDNfnevB9ukuvJDYWFVWf0+1mfL6ALHRHjb/0DPobOze2FAqa+YVzDJZ6IA106N96waLbtEE= X-Received: by 2002:a2e:9b15:: with SMTP id u21-v6mr3668970lji.29.1549396832649; Tue, 05 Feb 2019 12:00:32 -0800 (PST) MIME-Version: 1.0 References: <20190109194030.DFE3A8CC7@freefall.freebsd.org> <20190205195416.5ddsmc4rf7og4ece@mutt-hbsd> In-Reply-To: <20190205195416.5ddsmc4rf7og4ece@mutt-hbsd> From: Alan Somers Date: Tue, 5 Feb 2019 13:00:20 -0700 Message-ID: Subject: Re: [FreeBSD-Announce] FreeBSD Errata Notice FreeBSD-EN-19:05.kqueue To: Shawn Webb Cc: FreeBSD , FreeBSD Errata Notices Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 3C1B08EFF3 X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; spf=pass (mx1.freebsd.org: domain of asomers@gmail.com designates 209.85.208.181 as permitted sender) smtp.mailfrom=asomers@gmail.com X-Spamd-Result: default: False [-4.10 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_LAST(0.00)[]; DMARC_NA(0.00)[freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; NEURAL_HAM_SHORT(-0.93)[-0.931,0]; RCVD_IN_DNSWL_NONE(0.00)[181.208.85.209.list.dnswl.org : 127.0.5.0]; IP_SCORE(-1.16)[ipnet: 209.85.128.0/17(-3.77), asn: 15169(-1.95), country: US(-0.07)]; FORGED_SENDER(0.30)[asomers@freebsd.org,asomers@gmail.com]; MIME_TRACE(0.00)[0:+]; R_DKIM_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; FROM_NEQ_ENVFROM(0.00)[asomers@freebsd.org,asomers@gmail.com]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 05 Feb 2019 20:00:44 -0000 On Tue, Feb 5, 2019 at 12:55 PM Shawn Webb wrote: > > On Wed, Jan 09, 2019 at 07:40:30PM +0000, FreeBSD Errata Notices wrote: > > -----BEGIN PGP SIGNED MESSAGE----- > > Hash: SHA512 > > > > ============================================================================= > > FreeBSD-EN-19:05.kqueue Errata Notice > > The FreeBSD Project > > > > Topic: kqueue race condition and kernel panic > > > > Category: core > > Module: kqueue > > Announced: 2019-01-09 > > Credits: Mark Johnston > > Affects: FreeBSD 11.2 > > Corrected: 2019-11-24 17:11:47 UTC (stable/11, 11.2-STABLE) > > Corrected November of 2018 or 2019? ;) 2019, of course. re@ does NOT make mistakes. What you fail to realize is that NIST was using kqueue to check their atomic clock, and they lost the race. Enjoy the rest of 2020. -Alan From owner-freebsd-stable@freebsd.org Tue Feb 5 20:34:35 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 20CE414CFDC6 for ; Tue, 5 Feb 2019 20:34:35 +0000 (UTC) (envelope-from ian@freebsd.org) Received: from outbound3d.ore.mailhop.org (outbound3d.ore.mailhop.org [54.186.57.195]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 5663968472 for ; Tue, 5 Feb 2019 20:34:34 +0000 (UTC) (envelope-from ian@freebsd.org) ARC-Seal: i=1; a=rsa-sha256; t=1549397875; cv=none; d=outbound.mailhop.org; s=arc-outbound20181012; b=IlOCRgnklLUrWiEw2pySEZkGUHyAS96PxNBX/W3gXPD9TtqtHXMIT4yoIlj542osSonG8mVF7CJp9 jsKPbjFBvFkBaWCdrjW7Mzxz9CiCAj8yNuvQBUnSoj/4OtcpPVW86LQcvhBt8qd7G9lVtJAMsEjRyB FHC1HFAVzrZA8lFcB25x37X9cEKSiJUX+MfHAcjAoxA08cI//kYmik7P6S9lK5yzbijs3fism1vXeP b6QbesoL12LoKGtlunkC2bFQulEIa7o27ICjbcXglLcjTTFSBlKqp051IZIVe79evihxyTuCeI3oLF FKjltVawvOo3NEUcZYsTgkNLTHD69fw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=outbound.mailhop.org; s=arc-outbound20181012; h=content-transfer-encoding:mime-version:content-type:references:in-reply-to: date:cc:to:from:subject:message-id:dkim-signature:from; bh=vmhMH9jK5WkSWJHF00NoGN2YncOKM4pYZp3p6L5nTHg=; b=myLOd2M4N74/N8KETmser3lN5MOejVZGgHH1E6pnmt++poZCsI50xhxGeWwRkbwxfuf3Qenzs8esO vAQi844E+xg6IIbcbACGDh/ipluBqXN1QVzo8uWR75oXZfE/VXHzB9yV5NySbtuRxDQXmFZmS2SncU WCgbvqgd2pTwC7oIWpvVw9ldWO90IjNUcQ+ENEyoiH1NtpW1e+vAyDEd78Noy9YjOLZgTT1LkEQPcO J2MMgA4CptVKvNE0fJ6Juf0+96aLXTDgGuRb1qGLINcbQAM3Vr836V2nPaTscSHRaL795yzDQiG/7M UwIYDt8M5cY04g2NQdCdrPQHSlnsveg== ARC-Authentication-Results: i=1; outbound3.ore.mailhop.org; spf=softfail smtp.mailfrom=freebsd.org smtp.remote-ip=67.177.211.60; dmarc=none header.from=freebsd.org; arc=none header.oldest-pass=0; DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=outbound.mailhop.org; s=dkim-high; h=content-transfer-encoding:mime-version:content-type:references:in-reply-to: date:cc:to:from:subject:message-id:from; bh=vmhMH9jK5WkSWJHF00NoGN2YncOKM4pYZp3p6L5nTHg=; b=ZZMpdmQDnnNqXCr37KDqdQMbb+4vELxucfV8VyyT4AcYCZpHNC1kdRjbCb5+iFmHyrXo13ZTb8MEQ Mo9X211PYS0YnnptJZfKYENzMun07X4R3OcoBEWpXbaBQwH1YhM11EEq8DtPhflvgdE3NrDx6NmWV8 odL1kYfqdaYsmq2ZL2MfKhOU7fFcSVilwYryP0XYnAGaKGjWxk/JMm2LzCs4BArKNZcrLUynT9j6Wj /SQ36gUgq9/F2PLPvAxucx5OwKGCfIek8JtCvnzGEkvQep6BvBgueiUxfDIhQBYWrXkkUDE/8gwuOw DHA5TNR75laMmH7PKn1xjf82NliHOCg== X-MHO-RoutePath: aGlwcGll X-MHO-User: 1e0f1992-2983-11e9-9789-75353a1f43cf X-Report-Abuse-To: https://support.duocircle.com/support/solutions/articles/5000540958-duocircle-standard-smtp-abuse-information X-Originating-IP: 67.177.211.60 X-Mail-Handler: DuoCircle Outbound SMTP Received: from ilsoft.org (unknown [67.177.211.60]) by outbound3.ore.mailhop.org (Halon) with ESMTPSA id 1e0f1992-2983-11e9-9789-75353a1f43cf; Tue, 05 Feb 2019 20:17:54 +0000 (UTC) Received: from rev (rev [172.22.42.240]) by ilsoft.org (8.15.2/8.15.2) with ESMTP id x15KILxV038362; Tue, 5 Feb 2019 13:18:21 -0700 (MST) (envelope-from ian@freebsd.org) Message-ID: Subject: Re: [FreeBSD-Announce] FreeBSD Errata Notice FreeBSD-EN-19:05.kqueue From: Ian Lepore To: Alan Somers , Shawn Webb Cc: FreeBSD Errata Notices , FreeBSD Date: Tue, 05 Feb 2019 13:18:21 -0700 In-Reply-To: References: <20190109194030.DFE3A8CC7@freefall.freebsd.org> <20190205195416.5ddsmc4rf7og4ece@mutt-hbsd> Content-Type: text/plain; charset="UTF-8" X-Mailer: Evolution 3.28.5 FreeBSD GNOME Team Mime-Version: 1.0 Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 5663968472 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-2.97 / 15.00]; local_wl_from(0.00)[freebsd.org]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_SHORT(-0.97)[-0.973,0]; ASN(0.00)[asn:16509, ipnet:54.186.0.0/15, country:US]; NEURAL_HAM_LONG(-1.00)[-1.000,0] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 05 Feb 2019 20:34:35 -0000 On Tue, 2019-02-05 at 13:00 -0700, Alan Somers wrote: > On Tue, Feb 5, 2019 at 12:55 PM Shawn Webb wrote: > > > > On Wed, Jan 09, 2019 at 07:40:30PM +0000, FreeBSD Errata Notices wrote: > > > -----BEGIN PGP SIGNED MESSAGE----- > > > Hash: SHA512 > > > > > > ============================================================================= > > > FreeBSD-EN-19:05.kqueue Errata Notice > > > The FreeBSD Project > > > > > > Topic: kqueue race condition and kernel panic > > > > > > Category: core > > > Module: kqueue > > > Announced: 2019-01-09 > > > Credits: Mark Johnston > > > Affects: FreeBSD 11.2 > > > Corrected: 2019-11-24 17:11:47 UTC (stable/11, 11.2-STABLE) > > > > Corrected November of 2018 or 2019? ;) > > 2019, of course. re@ does NOT make mistakes. What you fail to > realize is that NIST was using kqueue to check their atomic clock, and > they lost the race. Enjoy the rest of 2020. > -Alan > I think you meant that as a joke, but the reality is that NIST measures their atomic clocks using gear that runs FreeBSD (made by the company I work for). :) -- Ian From owner-freebsd-stable@freebsd.org Tue Feb 5 20:47:25 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C034A14D01B5 for ; Tue, 5 Feb 2019 20:47:25 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from hz.grosbein.net (hz.grosbein.net [IPv6:2a01:4f8:d12:604::2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id D921469D18; Tue, 5 Feb 2019 20:47:14 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from eg.sd.rdtc.ru (eg.sd.rdtc.ru [IPv6:2a03:3100:c:13:0:0:0:5]) by hz.grosbein.net (8.15.2/8.15.2) with ESMTPS id x15Kl7c5094881 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Tue, 5 Feb 2019 21:47:07 +0100 (CET) (envelope-from eugen@grosbein.net) X-Envelope-From: eugen@grosbein.net X-Envelope-To: ian@freebsd.org Received: from [10.58.0.4] ([10.58.0.4]) by eg.sd.rdtc.ru (8.15.2/8.15.2) with ESMTPS id x15Kl6sZ072774 (version=TLSv1.2 cipher=DHE-RSA-AES128-SHA bits=128 verify=NOT); Wed, 6 Feb 2019 03:47:06 +0700 (+07) (envelope-from eugen@grosbein.net) Subject: Re: [FreeBSD-Announce] FreeBSD Errata Notice FreeBSD-EN-19:05.kqueue To: Ian Lepore , Alan Somers , Shawn Webb References: <20190109194030.DFE3A8CC7@freefall.freebsd.org> <20190205195416.5ddsmc4rf7og4ece@mutt-hbsd> Cc: FreeBSD Errata Notices , FreeBSD From: Eugene Grosbein Message-ID: Date: Wed, 6 Feb 2019 03:46:57 +0700 User-Agent: Mozilla/5.0 (Windows NT 6.3; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.8.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 8bit X-Spam-Status: No, score=0.3 required=5.0 tests=BAYES_00,LOCAL_FROM,SPF_PASS autolearn=no autolearn_force=no version=3.4.2 X-Spam-Report: * -2.3 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * -0.0 SPF_PASS SPF: sender matches SPF record * 2.6 LOCAL_FROM From my domains X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on hz.grosbein.net X-Rspamd-Queue-Id: D921469D18 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; spf=permerror (mx1.freebsd.org: domain of eugen@grosbein.net uses mechanism not recognized by this client) smtp.mailfrom=eugen@grosbein.net X-Spamd-Result: default: False [-3.77 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; MX_INVALID(0.50)[greylisted]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[grosbein.net]; RCPT_COUNT_FIVE(0.00)[5]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; R_SPF_PERMFAIL(0.00)[]; NEURAL_HAM_SHORT(-0.71)[-0.714,0]; IP_SCORE(-1.46)[ip: (-2.62), ipnet: 2a01:4f8::/29(-2.42), asn: 24940(-2.26), country: DE(-0.01)]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:24940, ipnet:2a01:4f8::/29, country:DE]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 05 Feb 2019 20:47:26 -0000 06.02.2019 3:18, Ian Lepore wrote: >> 2019, of course. re@ does NOT make mistakes. What you fail to >> realize is that NIST was using kqueue to check their atomic clock, and >> they lost the race. Enjoy the rest of 2020. >> -Alan >> > > I think you meant that as a joke, but the reality is that NIST measures > their atomic clocks using gear that runs FreeBSD (made by the company I > work for). :) I do not know if it is related or not: some months ago my FreeBSD 11.2-STABLE box having GPS received attached at /dev/cuau0 for my local ntpd stratum 1 server went to late of 2020 insanely. I was forced to comment GPS out of ntpd config to revive it but I lost all data in hundreds of local RRD databases and I found a race in libarchive being a reason why my backups had not most part of databases. I still do not know exact reason and use Internet time source instead of local GPS. From owner-freebsd-stable@freebsd.org Tue Feb 5 21:11:58 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BA38E14D0AA7 for ; Tue, 5 Feb 2019 21:11:58 +0000 (UTC) (envelope-from ian@freebsd.org) Received: from outbound2m.ore.mailhop.org (outbound2m.ore.mailhop.org [54.149.155.156]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 0BA4E6AB63 for ; Tue, 5 Feb 2019 21:11:57 +0000 (UTC) (envelope-from ian@freebsd.org) ARC-Seal: i=1; a=rsa-sha256; t=1549400088; cv=none; d=outbound.mailhop.org; s=arc-outbound20181012; b=rsoWQzQQAbPyXU1/Fy/rOaordDNgmw3L9DUxCpzItHpsn5tNaKA7iZQVPO5JVFjnNvg/7CFiet3cE JWGgxuxRZ62a3OGFZhipQgl7Rmz02WKY3lXZgyis79iSXPxzx7KjSXUqHfYBhVa08k94qbJEhaYJD3 SRRp1DKdPDikSB/A3brScarG4i6iJwxcA5japmGwld5xejnAYgh7hDbakS4iqu16BAbbuaqq8ZTTAN NLT7gHKTVrIu3PTN9Bn0kRuwXXf8KjBuVIIlHCZJQ9AA8UQKRLYVjx9LKi2DbYfO9uO/Z5D2q00MPs 7ET/77Gf4CV2OUi2RBdTZUAsksqgw7w== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=outbound.mailhop.org; s=arc-outbound20181012; h=content-transfer-encoding:mime-version:content-type:references:in-reply-to: date:cc:to:from:subject:message-id:dkim-signature:from; bh=Ivvt6TAqy7e1dZT9uDsbBoY7V+2eLFsgTmBQHPvkPHg=; b=OKp78ouWGgPVnReTLcgi8pK3hjFq6UnqGuDdtj2XpHWB554wfWKDkNIgiyOOEvo2tr2w09uVXgl1S eBYZq6G86mX3ByAbumno0z1hxbY3nF46BxhiopoHcGxj1M/u6Lr9pPWAvewsUxVJLlEQJ2WGW4oxkF 4I6L4XdP9qshAVTw6uzDuXBD+PEG9/p7NqY4erlE/C/aaW1lPN01irkcpBHGp28gUqXNc1pOHalHc4 R/BS26w3j21zhjVrHLZ4AQ+ms09ot3Nn+REl0lx7nDlupGKy9oZtoVZh6NoPVUABk8KjrhOsALpZ4y oIFewOI1AYlecpITb1BbUjREcz09MaQ== ARC-Authentication-Results: i=1; outbound4.ore.mailhop.org; spf=softfail smtp.mailfrom=freebsd.org smtp.remote-ip=67.177.211.60; dmarc=none header.from=freebsd.org; arc=none header.oldest-pass=0; DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=outbound.mailhop.org; s=dkim-high; h=content-transfer-encoding:mime-version:content-type:references:in-reply-to: date:cc:to:from:subject:message-id:from; bh=Ivvt6TAqy7e1dZT9uDsbBoY7V+2eLFsgTmBQHPvkPHg=; b=IzLPXb9msRvcc+iOUvL3aHNq1x4HUEc26KeqO04+Cox06yxxybqVxJ5M0wFIhDNG3oGmo6NXenAVz jUSiLQ4TbDPvcXZYS0O2/RLtq3tTYrQPOdEDeBMnD/tLktG7xndYexA3+dgNpmAbu517TZkYYZTSQU LvobBDFzZ4XPU2eg3ikh1X4I1LtASt77+5n2Q92x631lHPgOaDH4xgxziQ3VhjNBQ3r8n8APyW47ov HbjatwHRLFAV2y+SD58pJISFkV/2pMxu/04QMDtT/boyqKLa7w5xgx2nhUs5AzwUWMsYAdZ3fdcxBZ +WyV+t8DWyJACN+Pt9U8W/iaVDEFSSA== X-MHO-RoutePath: aGlwcGll X-MHO-User: 44f5ee0a-2988-11e9-befd-af03bedce89f X-Report-Abuse-To: https://support.duocircle.com/support/solutions/articles/5000540958-duocircle-standard-smtp-abuse-information X-Originating-IP: 67.177.211.60 X-Mail-Handler: DuoCircle Outbound SMTP Received: from ilsoft.org (unknown [67.177.211.60]) by outbound4.ore.mailhop.org (Halon) with ESMTPSA id 44f5ee0a-2988-11e9-befd-af03bedce89f; Tue, 05 Feb 2019 20:54:47 +0000 (UTC) Received: from rev (rev [172.22.42.240]) by ilsoft.org (8.15.2/8.15.2) with ESMTP id x15Ktk2T038485; Tue, 5 Feb 2019 13:55:46 -0700 (MST) (envelope-from ian@freebsd.org) Message-ID: <3954a6fd232be453e8632159892250cb3ae47d08.camel@freebsd.org> Subject: Re: [FreeBSD-Announce] FreeBSD Errata Notice FreeBSD-EN-19:05.kqueue From: Ian Lepore To: Eugene Grosbein Cc: FreeBSD Date: Tue, 05 Feb 2019 13:55:46 -0700 In-Reply-To: References: <20190109194030.DFE3A8CC7@freefall.freebsd.org> <20190205195416.5ddsmc4rf7og4ece@mutt-hbsd> Content-Type: text/plain; charset="UTF-8" X-Mailer: Evolution 3.28.5 FreeBSD GNOME Team Mime-Version: 1.0 Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 0BA4E6AB63 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-2.97 / 15.00]; local_wl_from(0.00)[freebsd.org]; NEURAL_HAM_MEDIUM(-1.00)[-0.999,0]; NEURAL_HAM_SHORT(-0.97)[-0.972,0]; ASN(0.00)[asn:16509, ipnet:54.148.0.0/15, country:US]; NEURAL_HAM_LONG(-1.00)[-1.000,0] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 05 Feb 2019 21:11:59 -0000 On Wed, 2019-02-06 at 03:46 +0700, Eugene Grosbein wrote: > 06.02.2019 3:18, Ian Lepore wrote: > > > > 2019, of course. re@ does NOT make mistakes. What you fail to > > > realize is that NIST was using kqueue to check their atomic > > > clock, and > > > they lost the race. Enjoy the rest of 2020. > > > -Alan > > > > > > > I think you meant that as a joke, but the reality is that NIST > > measures > > their atomic clocks using gear that runs FreeBSD (made by the > > company I > > work for). :) > > I do not know if it is related or not: some months ago my FreeBSD > 11.2-STABLE box > having GPS received attached at /dev/cuau0 for my local ntpd stratum > 1 server > went to late of 2020 insanely. I was forced to comment GPS out of > ntpd config to revive it > but I lost all data in hundreds of local RRD databases and > I found a race in libarchive being a reason why my backups had not > most part of databases. > > I still do not know exact reason and use Internet time source instead > of local GPS. The GPS week number rolls over in April 2019. At $work we have already been seeing glitches in gps receivers as early as last June that were caused by errors in the receivers' firmware that didn't handle the upcoming rollover properly. When a receiver first powers on, it has no real idea what gps era it's in (right now we're in the 2nd, about to roll over to the 3rd). It has to guess, which it mostly does the same way as software does that has to deal with 2-digit years: make a decision based on the current date being before/after some cutoff (like > 70 means 2070), and assume everyone will be running newer firmware before that date arrives. So your problem was most likely the gps receiver making a bad choice before it had enough info to make a good choice. It's one of many reasons why an ntp server should have at least 3 (really, at least 5) peers, so it can reject obviously-insane data from a single source. Even when you use a gps to get really accurate local time, you should have a handful of network peers that can serve as sanity-checkers. -- Ian From owner-freebsd-stable@freebsd.org Tue Feb 5 21:17:09 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7172014D0D08 for ; Tue, 5 Feb 2019 21:17:09 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from hz.grosbein.net (hz.grosbein.net [IPv6:2a01:4f8:d12:604::2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 5F6836AEA7; Tue, 5 Feb 2019 21:17:08 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from eg.sd.rdtc.ru (eg.sd.rdtc.ru [IPv6:2a03:3100:c:13:0:0:0:5]) by hz.grosbein.net (8.15.2/8.15.2) with ESMTPS id x15LGsCM095098 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Tue, 5 Feb 2019 22:16:54 +0100 (CET) (envelope-from eugen@grosbein.net) X-Envelope-From: eugen@grosbein.net X-Envelope-To: ian@freebsd.org Received: from [10.58.0.4] ([10.58.0.4]) by eg.sd.rdtc.ru (8.15.2/8.15.2) with ESMTPS id x15LGrWM073261 (version=TLSv1.2 cipher=DHE-RSA-AES128-SHA bits=128 verify=NOT); Wed, 6 Feb 2019 04:16:53 +0700 (+07) (envelope-from eugen@grosbein.net) Subject: Re: [FreeBSD-Announce] FreeBSD Errata Notice FreeBSD-EN-19:05.kqueue To: Ian Lepore References: <20190109194030.DFE3A8CC7@freefall.freebsd.org> <20190205195416.5ddsmc4rf7og4ece@mutt-hbsd> <3954a6fd232be453e8632159892250cb3ae47d08.camel@freebsd.org> Cc: FreeBSD From: Eugene Grosbein Message-ID: <6aa7990c-ed7e-c849-d04b-4d144d167c67@grosbein.net> Date: Wed, 6 Feb 2019 04:16:44 +0700 User-Agent: Mozilla/5.0 (Windows NT 6.3; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.8.0 MIME-Version: 1.0 In-Reply-To: <3954a6fd232be453e8632159892250cb3ae47d08.camel@freebsd.org> Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=0.3 required=5.0 tests=BAYES_00,LOCAL_FROM,SPF_PASS autolearn=no autolearn_force=no version=3.4.2 X-Spam-Report: * -2.3 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * -0.0 SPF_PASS SPF: sender matches SPF record * 2.6 LOCAL_FROM From my domains X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on hz.grosbein.net X-Rspamd-Queue-Id: 5F6836AEA7 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; spf=permerror (mx1.freebsd.org: domain of eugen@grosbein.net uses mechanism not recognized by this client) smtp.mailfrom=eugen@grosbein.net X-Spamd-Result: default: False [-3.97 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; MX_INVALID(0.50)[cached]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[grosbein.net]; RCVD_COUNT_THREE(0.00)[3]; IP_SCORE(-1.45)[ip: (-2.58), ipnet: 2a01:4f8::/29(-2.42), asn: 24940(-2.26), country: DE(-0.01)]; TO_DN_ALL(0.00)[]; R_SPF_PERMFAIL(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-0.92)[-0.915,0]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:24940, ipnet:2a01:4f8::/29, country:DE]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 05 Feb 2019 21:17:09 -0000 06.02.2019 3:55, Ian Lepore wrote: > So your problem was most likely the gps receiver making a bad choice > before it had enough info to make a good choice. It's one of many > reasons why an ntp server should have at least 3 (really, at least 5) > peers, so it can reject obviously-insane data from a single source. > Even when you use a gps to get really accurate local time, you should > have a handful of network peers that can serve as sanity-checkers. And I have and had that moment: driftfile /var/db/ntpd.drift server Time2.Stupi.SE iburst maxpoll 9 server ntp1.sp.se iburst maxpoll 9 server ntp1.mmo.netnod.se iburst maxpoll 9 server ntp1.ptb.de iburst maxpoll 9 server ntp1.ien.it iburst maxpoll 9 server ntp1.sth.netnod.se iburst maxpoll 9 server 127.127.1.0 fudge 127.127.1.0 stratum 10 # Had to comment out following 3 lines after the incident #tos mindist 0.015 #server 127.127.20.1 mode 1 iburst maxpoll 9 prefer #fudge 127.127.20.1 stratum 10 time1 0.000 time2 0.000 flag1 1 flag3 1 refid PPS pool 0.freebsd.pool.ntp.org iburst restrict -4 default kod notrap nomodify nopeer noquery restrict -6 default kod notrap nomodify nopeer noquery restrict 127.0.0.1 restrict ::1 leapfile "/var/db/ntpd.leap-seconds.list" From owner-freebsd-stable@freebsd.org Tue Feb 5 22:50:21 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0D65214D2FE0 for ; Tue, 5 Feb 2019 22:50:21 +0000 (UTC) (envelope-from karl@denninger.net) Received: from colo1.denninger.net (colo1.denninger.net [104.236.120.189]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 8B3096E163 for ; Tue, 5 Feb 2019 22:50:19 +0000 (UTC) (envelope-from karl@denninger.net) Received: from denninger.net (ip68-1-57-197.pn.at.cox.net [68.1.57.197]) by colo1.denninger.net (Postfix) with ESMTP id A1E472110BE for ; Tue, 5 Feb 2019 17:49:47 -0500 (EST) Received: from [192.168.10.21] (D11.Denninger.Net [192.168.10.21]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by denninger.net (Postfix) with ESMTPSA id 1F9A9580105 for ; Tue, 5 Feb 2019 16:49:47 -0600 (CST) Subject: Re: 9211 (LSI/SAS) issues on 11.2-STABLE To: freebsd-stable@freebsd.org References: <7bb25f55-fa77-f67e-11f3-b2240b01e25a@denninger.net> <9ea70420-0c06-ad9d-e8b7-f9d92fed20d8@denninger.net> From: Karl Denninger Openpgp: preference=signencrypt Autocrypt: addr=karl@denninger.net; prefer-encrypt=mutual; keydata= mQINBFIX1zsBEADRcJfsQUl9oFeoMfLPJ1kql+3sIaYx0MfJAUhV9LnbWxr0fsWCskM1O4cV tHm5dqPkuPM4Ztc0jLotD1i9ubWvCHOlkLGxFOL+pFbjA+XZ7VKsC/xWmhMwJ3cM8HavK2OV SzEWQ/AEYtMi04IzGSwsxh/5/5R0mPHrsIomV5SbuiI0vjLuDj7fo6146AABI1ULzge4hBYW i/SHrqUrLORmUNBs6bxek79/B0Dzk5cIktD3LOfbT9EAa5J/osVkstMBhToJgQttaMIGv8SG CzpR/HwEokE+7DP+k2mLHnLj6H3kfugOF9pJH8Za4yFmw//s9cPXV8WwtZ2SKfVzn1unpKqf wmJ1PwJoom/d4fGvQDkgkGKRa6RGC6tPmXnqnx+YX4iCOdFfbP8L9rmk2sewDDVzHDU3I3ZZ 8hFIjMYM/QXXYszRatK0LCV0QPZuF7LCf4uQVKw1/oyJInsnH7+6a3c0h21x+CmSja9QJ+y0 yzgEN/nM89d6YTakfR+1xkYgodVmMy/bS8kmXbUUZG/CyeqCqc95RUySjKT2ECrf9GhhoQkl +D8n2MsrAUSMGB4GQSN+TIq9OBTpNuvATGSRuF9wnQcs1iSry+JNCpfRTyWp83uCNApe6oHU EET4Et6KDO3AvjvBMAX0TInTRGW2SQlJMuFKpc7Dg7tHK8zzqQARAQABtCNLYXJsIERlbm5p bmdlciA8a2FybEBkZW5uaW5nZXIubmV0PokCPAQTAQIAJgUCUhfXOwIbIwUJCWYBgAYLCQgH AwIEFQIIAwQWAgMBAh4BAheAAAoJEG6/sivc5s0PLxQP/i6x/QFx9G4Cw7C+LthhLXIm7NSH AtNbz2UjySEx2qkoQQjtsK6mcpEEaky4ky6t8gz0/SifIfJmSmyAx0UhUQ0WBv1vAXwtNrQQ jJd9Bj6l4c2083WaXyHPjt2u2Na6YFowyb4SaQb83hu/Zs25vkPQYJVVE0JX409MFVPUa6E3 zFbd1OTr3T4yNUy4gNeQZfzDqDS8slbIks2sXeoJrZ6qqXVI0ionoivOlaN4T6Q0UYyXtigj dQvvhMt0aNowKFjRqrmSDRpdz+o6yg7Mp7qEZ1V6EZk8KqQTH6htpCTQ8i79ttK4LG6bstSF Re6Fwq52nbrcANrcdmtZXqjo+SGbUqJ8b1ggrxAsJ5MEhRh2peKrCgI/TjQo+ZxfnqEoR4AI 46Cyiz+/lcVvlvmf2iPifS3EEdaH3Itfwt7MxFm6mQORYs6skHDw3tOYB2/AdCW6eRVYs2hB RMAG4uwApZfZDKgRoE95PJmQjeTBiGmRPcsQZtNESe7I7EjHtCDLwtJqvD4HkDDQwpzreT6W XkyIJ7ns7zDfA1E+AQhFR6rsTFGgQZRZKsVeov3SbhYKkCnVDCvb/PKQCAGkSZM9SvYG5Yax 8CMry3AefKktf9fqBFg8pWqtVxDwJr56dhi0GHXRu3jVI995rMGo1fLUG5fSxiZ8L5sAtokh 9WFmQpyl Message-ID: <57ddc2f4-681c-e0aa-0484-42cee3876a05@denninger.net> Date: Tue, 5 Feb 2019 16:49:46 -0600 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:60.0) Gecko/20100101 Thunderbird/60.5.0 MIME-Version: 1.0 In-Reply-To: <9ea70420-0c06-ad9d-e8b7-f9d92fed20d8@denninger.net> Content-Type: multipart/signed; protocol="application/pkcs7-signature"; micalg=sha-512; boundary="------------ms010104060201000008040902" X-Rspamd-Queue-Id: 8B3096E163 X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-6.27 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; HAS_ATTACHMENT(0.00)[]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; MX_GOOD(-0.01)[cached: px.denninger.net]; MIME_BASE64_TEXT(0.10)[]; NEURAL_HAM_SHORT(-0.92)[-0.924,0]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; R_DKIM_NA(0.00)[]; ASN(0.00)[asn:14061, ipnet:104.236.64.0/18, country:US]; MIME_TRACE(0.00)[0:+,1:+,2:+]; MID_RHS_MATCH_FROM(0.00)[]; RECEIVED_SPAMHAUS_PBL(0.00)[197.57.1.68.zen.spamhaus.org : 127.0.0.11]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; SIGNED_SMIME(-2.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.20)[multipart/signed,multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; AUTH_NA(1.00)[]; RCPT_COUNT_ONE(0.00)[1]; IP_SCORE(-2.23)[ip: (-9.88), ipnet: 104.236.64.0/18(-3.85), asn: 14061(2.63), country: US(-0.07)]; DMARC_NA(0.00)[denninger.net]; R_SPF_NA(0.00)[] X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 05 Feb 2019 22:50:21 -0000 This is a cryptographically signed message in MIME format. --------------ms010104060201000008040902 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: base64 QlRXIHVuZGVyIDEyLjAtU1RBQkxFIChidWlsdCB0aGlzIGFmdGVybm9vbiBhZnRlciB0aGUg YWR2aXNvcmllcyBjYW1lDQpvdXQsIHdpdGggdGhlIHBhdGNoZXMpIGl0J3MgTVVDSCB3b3Jz ZS7CoCBJIGdldCB0aGUgc2FtZSBkZXZpY2UgcmVzZXRzDQpCVVQgaXQncyBmb2xsb3dlZCBi eSBhbiBpbW1lZGlhdGUgcGFuaWMgd2hpY2ggSSBjYW5ub3QgZHVtcCBhcyBpdA0KZ2VuZXJh dGVzIGEgcGFnZS1mYXVsdCAoc3VwZXJ2aXNvciByZWFkIGRhdGEsIHBhZ2Ugbm90IHByZXNl bnQpIGluIHRoZQ0KbXBzICpkcml2ZXIqIGF0IG1wc3Nhc19zZW5kX2Fib3J0KzB4MjEuDQoN ClRoaXMgcHJlY2x1ZGVzIGEgZHVtcCBvZiBjb3Vyc2Ugc2luY2UgYXR0ZW1wdGluZyB0byBk byBzbyBnaXZlcyB5b3UgYQ0KZG91YmxlLXBhbmljIChJIHdhcyB3b25kZXJpbmcgd2h5IEkg ZGlkbid0IGdldCBhIGNyYXNoIGR1bXAhKTsgSSdsbA0KcmUtamlnZ2VyIHRoZSBib3ggdG8g c3RpY2sgYSBkdW1wIGRldmljZSBvbiBhbiBpbnRlcm5hbCBTQVRBIGRldmljZSBzbyBJDQpj YW4gc3VjY2Vzc2Z1bGx5IGdldCB0aGUgZHVtcCB3aGVuIGl0IGhhcHBlbnMgYW5kIHNlZSBp ZiBJIGNhbiBvYnRhaW4gYQ0KcHJvcGVyIGNyYXNoIGR1bXAgb24gdGhpcy4NCg0KSSB0aGlu ayBpdCdzIGZhaXIgdG8gYXNzdW1lIHRoYXQgMTIuMC1TVEFCTEUgc2hvdWxkIG5vdCBwYW5p YyBvbiBhIGRpc2sNCnByb2JsZW0gKHVubGVzcyBvZiBjb3Vyc2UgdGhlIHByb2JsZW0gaXMg dHJ5aW5nIHRvIHBhZ2Ugc29tZXRoaW5nIGJhY2sNCmluIC0tIGl0J3Mgbm90LCB0aGUgZHJp dmUgdGhhdCBhYm9ydHMgYW5kIHJlc2V0cyBpcyBvbiBhIGRhdGEgcGFjayBkb2luZw0KYSBz Y3J1YikNCg0KT24gMi81LzIwMTkgMTA6MjYsIEthcmwgRGVubmluZ2VyIHdyb3RlOg0KPiBP biAyLzUvMjAxOSAwOToyMiwgS2FybCBEZW5uaW5nZXIgd3JvdGU6DQo+PiBPbiAyLzIvMjAx OSAxMjowMiwgS2FybCBEZW5uaW5nZXIgd3JvdGU6DQo+Pj4gSSByZWNlbnRseSBzdGFydGVk IGhhdmluZyBzb21lIHJlYWxseSBvZGRiYWxsIHRoaW5nc8KgIGhhcHBlbmluZyB1bmRlcg0K Pj4+IHN0cmVzcy7CoCBUaGlzIGNvaW5jaWRlZCB3aXRoIHRoZSBtYWNoaW5lIGJlaW5nIHVw ZGF0ZWQgdG8gMTEuMi1TVEFCTEUNCj4+PiAoRnJlZUJTRCAxMS4yLVNUQUJMRSAjMSByMzQy OTE4OikgZnJvbSAxMS4xLg0KPj4+DQo+Pj4gU3BlY2lmaWNhbGx5LCBJIGdldCAiZXJyb3Jz IiBsaWtlIHRoaXM6DQo+Pj4NCj4+PiDCoMKgwqDCoMKgwqDCoCAoZGExMjptcHMwOjA6Mzc6 MCk6IFJFQUQoMTApLiBDREI6IDI4IDAwIGFmIDgyIGJiIDA4IDAwIDAxIDAwIDAwDQo+Pj4g bGVuZ3RoIDEzMTA3MiBTTUlEIDI2OSBBYm9ydGluZyBjb21tYW5kIDB4ZmZmZmZlMDAwMTE3 OTExMA0KPj4+IG1wczA6IFNlbmRpbmcgcmVzZXQgZnJvbSBtcHNzYXNfc2VuZF9hYm9ydCBm b3IgdGFyZ2V0IElEIDM3DQo+Pj4gwqDCoMKgwqDCoMKgwqAgKGRhMTI6bXBzMDowOjM3OjAp OiBSRUFEKDEwKS4gQ0RCOiAyOCAwMCBhZiA4MiBiYyAwOCAwMCAwMSAwMCAwMA0KPj4+IGxl bmd0aCAxMzEwNzIgU01JRCA5MjQgdGVybWluYXRlZCBpb2MgODA0YiBsb2dpbmZvIDMxMTQw MDAwIHNjc2kgMCBzdGF0ZQ0KPj4+IGMgeGZlciAwDQo+Pj4gwqDCoMKgwqDCoMKgwqAgKGRh MTI6bXBzMDowOjM3OjApOiBSRUFEKDEwKS4gQ0RCOiAyOCAwMCBhZiA4MiBiYSAwOCAwMCAw MSAwMCAwMA0KPj4+IGxlbmd0aCAxMzEwNzIgU01JRCAxNjEgdGVybWluYXRlZCBpb2MgODA0 YiBsb2dpbmZvIDMxMTQwMDAwIHNjc2kgMCBzdGF0ZQ0KPj4+IGMgeGZlciAwDQo+Pj4gbXBz MDogVW5mcmVlemluZyBkZXZxIGZvciB0YXJnZXQgSUQgMzcNCj4+PiAoZGExMjptcHMwOjA6 Mzc6MCk6IFJFQUQoMTApLiBDREI6IDI4IDAwIGFmIDgyIGJjIDA4IDAwIDAxIDAwIDAwDQo+ Pj4gKGRhMTI6bXBzMDowOjM3OjApOiBDQU0gc3RhdHVzOiBDQ0IgcmVxdWVzdCBjb21wbGV0 ZWQgd2l0aCBhbiBlcnJvcg0KPj4+IChkYTEyOm1wczA6MDozNzowKTogUmV0cnlpbmcgY29t bWFuZA0KPj4+IChkYTEyOm1wczA6MDozNzowKTogUkVBRCgxMCkuIENEQjogMjggMDAgYWYg ODIgYmIgMDggMDAgMDEgMDAgMDANCj4+PiAoZGExMjptcHMwOjA6Mzc6MCk6IENBTSBzdGF0 dXM6IENvbW1hbmQgdGltZW91dA0KPj4+IChkYTEyOm1wczA6MDozNzowKTogUmV0cnlpbmcg Y29tbWFuZA0KPj4+IChkYTEyOm1wczA6MDozNzowKTogUkVBRCgxMCkuIENEQjogMjggMDAg YWYgODIgYmEgMDggMDAgMDEgMDAgMDANCj4+PiAoZGExMjptcHMwOjA6Mzc6MCk6IENBTSBz dGF0dXM6IENDQiByZXF1ZXN0IGNvbXBsZXRlZCB3aXRoIGFuIGVycm9yDQo+Pj4gKGRhMTI6 bXBzMDowOjM3OjApOiBSZXRyeWluZyBjb21tYW5kDQo+Pj4gKGRhMTI6bXBzMDowOjM3OjAp OiBSRUFEKDEwKS4gQ0RCOiAyOCAwMCBhZiA4MiBiYSAwOCAwMCAwMSAwMCAwMA0KPj4+IChk YTEyOm1wczA6MDozNzowKTogQ0FNIHN0YXR1czogU0NTSSBTdGF0dXMgRXJyb3INCj4+PiAo ZGExMjptcHMwOjA6Mzc6MCk6IFNDU0kgc3RhdHVzOiBDaGVjayBDb25kaXRpb24NCj4+PiAo ZGExMjptcHMwOjA6Mzc6MCk6IFNDU0kgc2Vuc2U6IFVOSVQgQVRURU5USU9OIGFzYzoyOSww IChQb3dlciBvbiwNCj4+PiByZXNldCwgb3IgYnVzIGRldmljZSByZXNldCBvY2N1cnJlZCkN Cj4+PiAoZGExMjptcHMwOjA6Mzc6MCk6IFJldHJ5aW5nIGNvbW1hbmQgKHBlciBzZW5zZSBk YXRhKQ0KPj4+DQo+Pj4gVGhlICJVbml0IEF0dGVudGlvbiIgaW1wbGllcyB0aGUgZHJpdmUg cmVzZXQuwqAgSXQgb25seSBvY2N1cnMgb24gY2VydGFpbg0KPj4+IGRyaXZlcyB1bmRlciB2 ZXJ5IGhlYXZ5IGxvYWQgKGUuZy4gYSBzY3J1Yi4pwqAgSSd2ZSBtYW5hZ2VkIHRvIHByb3Zv a2UgaXQNCj4+PiBvbiB0d28gZGlmZmVyZW50IGJyYW5kcyBvZiBkaXNrIGFjcm9zcyBtdWx0 aXBsZSBmaXJtd2FyZSBhbmQgY2FwYWNpdGllcywNCj4+PiBob3dldmVyLCB3aGljaCB0ZW5k cyB0byBwb2ludCBhd2F5IGZyb20gYSBkcml2ZSBmaXJtd2FyZSBwcm9ibGVtLg0KPj4+DQo+ Pj4gQSBsb29rIGF0IHRoZSBwb29sIGRhdGEgc2hvd3MgL25vIC9lcnJvcnMgKGUuZy4gbm8g Y2hlY2tzdW0gcHJvYmxlbXMsDQo+Pj4gZXRjKSBhbmQgYSBsb29rIGF0IHRoZSBkaXNrIGl0 c2VsZiAodXNpbmcgc21hcnRjdGwpIHNob3dzIG5vIHByb2JsZW1zDQo+Pj4gZWl0aGVyIC0t IHdoYXRldmVyIGlzIGdvaW5nIG9uIGhlcmUgdGhlIGFkYXB0ZXIgaXMgcmVjb3ZlcmluZyBm cm9tIGl0DQo+Pj4gd2l0aG91dCBhbnkgZGF0YSBjb3JydXB0aW9uIG9yIGxvc3MgcmVnaXN0 ZXJlZCBvbiAqZWl0aGVyIGVuZCohDQo+Pj4NCj4+PiBUaGUgY29uZmlndXJhdGlvbiBpcyBh biBvbGRlciBTdXBlck1pY3JvIFhlb24gYm9hcmQgKFg4RFRMLUlGKSBhbmQgc2hvd3M6DQo+ Pj4NCj4+PiBtcHMwOiA8QXZhZ28gVGVjaG5vbG9naWVzIChMU0kpIFNBUzIwMDg+IHBvcnQg MHhjMDAwLTB4YzBmZiBtZW0NCj4+PiAweGZiYjNjMDAwLTB4ZmJiM2ZmZmYsMHhmYmI0MDAw MC0weGZiYjdmZmZmIGlycSAzMCBhdCBkZXZpY2UgMC4wIG9uIHBjaTMNCj4+PiBtcHMwOiBG aXJtd2FyZTogMTkuMDAuMDAuMDAsIERyaXZlcjogMjEuMDIuMDAuMDAtZmJzZA0KPj4+IG1w czA6IElPQ0NhcGFiaWxpdGllczoNCj4+PiAxMjg1YzxTY3NpVGFza0Z1bGwsRGlhZ1RyYWNl LFNuYXBCdWYsRUVEUCxUcmFuc1JldHJ5LEV2ZW50UmVwbGF5LEhvc3REaXNjPg0KPj4gQWZ0 ZXIgY29uc2lkZXJhYmxlIGFkZGl0aW9uYWwgd29yayB0aGlzIGxvb2tzIGluY3JlYXNpbmds eSBsaWtlIGVpdGhlciBhDQo+PiBtaXNzZWQgaW50ZXJydXB0IG9yIGEgY29tbWFuZCBpcyBn ZXR0aW5nIGxvc3QgYmV0d2VlbiB0aGUgaG9zdCBhZGFwdGVyDQo+PiBhbmQgdGhlIGV4cGFu ZGVyLg0KPj4NCj4+IEknbSBnb2luZyB0byB0dXJuIHRoZSBkcml2ZXIgZGVidWcgbGV2ZWwg dXAgYW5kIHNlZSBpZiBJIGNhbiBjYXB0dXJlDQo+PiBtb3JlIGluZm9ybWF0aW9uLi4uLi4g d2hhdGV2ZXIgaXMgYmVoaW5kIHRoaXMsIGhvd2V2ZXIsIGl0IGlzDQo+PiBhbG1vc3QtY2Vy dGFpbmx5IHJlbGF0ZWQgdG8gc29tZXRoaW5nIHRoYXQgY2hhbmdlZCBiZXR3ZWVuIDExLjEg YW5kDQo+PiAxMS4yLCBhcyBJIG5ldmVyIHNhdyB0aGVzZSBvbiB0aGUgMTEuMS1TVEFCTEUg YnVpbGQuDQo+Pg0KPj4gLS0NCj4+IEthcmwgRGVubmluZ2VyDQo+PiBrYXJsQGRlbm5pbmdl ci5uZXQgPG1haWx0bzprYXJsQGRlbm5pbmdlci5uZXQ+DQo+PiAvVGhlIE1hcmtldCBUaWNr ZXIvDQo+PiAvW1MvTUlNRSBlbmNyeXB0ZWQgZW1haWwgcHJlZmVycmVkXS8NCj4gUHJldHR5 IGRlY2VudCB0cmFjZSBoZXJlIC0tIGFueSBpZGVhcz8NCj4NCj4gbXBzMDogdGltZWRvdXQg Y20gMHhmZmZmZmUwMDAxMWI1MDIwIGFsbG9jYXRlZCB0bSAweGZmZmZmZTAwMDExODEyYTAN Cj4gwqDCoMKgwqDCoMKgwqAgKGRhMTE6bXBzMDowOjM3OjApOiBSRUFEKDEwKS4gQ0RCOiAy OCAwMCA4MiBiNSAzYiA4MCAwMCAwMSAwMCAwMA0KPiBsZW5ndGggMTMxMDcyIFNNSUQgNjM0 IEFib3J0aW5nIGNvbW1hbmQgMHhmZmZmZmUwMDAxMWI1MDIwDQo+IG1wczA6IFNlbmRpbmcg cmVzZXQgZnJvbSBtcHNzYXNfc2VuZF9hYm9ydCBmb3IgdGFyZ2V0IElEIDM3DQo+IG1wczA6 IHF1ZXVlZCB0aW1lZG91dCBjbSAweGZmZmZmZTAwMDExYzI3NjAgZm9yIHByb2Nlc3Npbmcg YnkgdG0NCj4gMHhmZmZmZmUwMDAxMTgxMmEwDQo+IG1wczA6IHF1ZXVlZCB0aW1lZG91dCBj bSAweGZmZmZmZTAwMDExYTc0ZjAgZm9yIHByb2Nlc3NpbmcgYnkgdG0NCj4gMHhmZmZmZmUw MDAxMTgxMmEwDQo+IG1wczA6IHF1ZXVlZCB0aW1lZG91dCBjbSAweGZmZmZmZTAwMDExY2Zk NTAgZm9yIHByb2Nlc3NpbmcgYnkgdG0NCj4gMHhmZmZmZmUwMDAxMTgxMmEwDQo+IG1wczA6 IEV2ZW50UmVwbHnCoMKgwqDCoMKgwqDCoCA6DQo+IMKgwqDCoMKgwqDCoMKgIEV2ZW50RGF0 YUxlbmd0aDogMg0KPiDCoMKgwqDCoMKgwqDCoCBBY2tSZXF1aXJlZDogMA0KPiDCoMKgwqDC oMKgwqDCoCBFdmVudDogU2FzRGlzY292ZXJ5ICgweDE2KQ0KPiDCoMKgwqDCoMKgwqDCoCBF dmVudENvbnRleHQ6IDB4MA0KPiDCoMKgwqDCoMKgwqDCoCBGbGFnczogMTxJblByb2dyZXNz Pg0KPiDCoMKgwqDCoMKgwqDCoCBSZWFzb25Db2RlOiBEaXNjb3ZlcnkgU3RhcnRlZA0KPiDC oMKgwqDCoMKgwqDCoCBQaHlzaWNhbFBvcnQ6IDANCj4gwqDCoMKgwqDCoMKgwqAgRGlzY292 ZXJ5U3RhdHVzOiAwDQo+IG1wczA6ICgwKS0+KG1wc3Nhc19md193b3JrKSBXb3JraW5nIG9u wqAgRXZlbnQ6IFsxNl0NCj4gbXBzMDogKDEpLT4obXBzc2FzX2Z3X3dvcmspIEV2ZW50IEZy ZWU6IFsxNl0NCj4gwqDCoMKgwqDCoMKgwqAgKGRhMTE6bXBzMDowOjM3OjApOiBSRUFEKDEw KS4gQ0RCOiAyOCAwMCA4MiBiNSAzYyA4MCAwMCAwMSAwMCAwMA0KPiBsZW5ndGggMTMxMDcy IFNNSUQgOTYxIGNvbXBsZXRlZCB0aW1lZG91dCBjbSAweGZmZmZmZTAwMDExY2ZkNTAgY2Ni DQo+IDB4ZmZmZmY4MDE5NDU4ZTAwMCBkdXJpbmcgcmVjb3ZlcnkgaW9jIDgwNGIgc2NzaSAw IHN0YXRlIGMNCj4gKGRhMTE6bXBzMDowOjM3OjApOiBSRUFEKDEwKS4gQ0RCOiAyOCAwMCA4 MiBiNSAzYyA4MCAwMCAwMSAwMCAwMCBsZW5ndGgNCj4gMTMxMDcyIFNNSUQgOTYxIHRlcm1p bmF0ZWQgaW9jIDgwNGIgbG9naW5mbyAzMTE0MDAwMCBzY3NpIDAgc3RhdGUgYyB4ZmVyIDAN Cj4gwqDCoMKgwqDCoMKgwqAgKGRhMTE6bXBzMDowOjM3OjApOiBSRUFEKDEwKS4gQ0RCOiAy OCAwMCA4MiBiNSAzYiA4MCAwMCAwMSAwMCAwMA0KPiBsZW5ndGggMTMxMDcyIFNNSUQgNjM0 IGNvbXBsZXRlZCB0aW1lZG91dCBjbQ0KPiAweGZmZmZmZTAwMDExYjUoZGExMTptcHMwOjA6 Mzc6MCk6IFJFQUQoMTApLiBDREI6IDI4IDAwIDgyIGI1IDNjIDgwIDAwDQo+IDAxIDAwIDAw DQo+IDAyMCBjY2IgMHhmZmZmZjgwMDU2ZmI1MDAwIGR1cmluZyByZWNvdmVyeSBpb2MgODA0 OCBzY3NpIDAgc3RhdGUNCj4gYyhkYTExOm1wczA6MDozNzowKTogQ0FNIHN0YXR1czogQ0NC IHJlcXVlc3QgY29tcGxldGVkIHdpdGggYW4gZXJyb3INCj4gKGRhMTE6bXBzMDowOjM3OjAp OiBSZXRyeWluZyBjb21tYW5kDQo+IMKgwqDCoMKgwqDCoMKgIChkYTExOm1wczA6MDozNzow KTogUkVBRCgxMCkuIENEQjogMjggMDAgODIgYjUgM2EgODAgMDAgMDEgMDAgMDANCj4gbGVu Z3RoIDEzMTA3MiBTTUlEIDc5OCBjb21wbGV0ZWQgdGltZWRvdXQgY20gMHhmZmZmZmUwMDAx MWMyNzYwIGNjYg0KPiAweGZmZmZmODAwNTRlODYwMDAgZHVyaW5nIHJlY292ZXJ5IGlvYyA4 MDRiIHNjc2kgMCBzdGF0ZSBjDQo+IChkYTExOm1wczA6MDozNzowKTogUkVBRCgxMCkuIENE QjogMjggMDAgODIgYjUgM2EgODAgMDAgMDEgMDAgMDAgbGVuZ3RoDQo+IDEzMTA3MiBTTUlE IDc5OCB0ZXJtaW5hdGVkIGlvYyA4MDRiIGxvZ2luZm8gMzExNDAwMDAgc2NzaSAwIHN0YXRl IGMgeGZlciAwDQo+IMKgwqDCoMKgwqDCoMKgIChkYTExOm1wczA6MDozNzowKTogUkVBRCgx MCkuIENEQjogMjggMDAgODIgYjUgMzkgODAgMDAgMDEgMDAgMDANCj4gbGVuZ3RoIDEzMTA3 MiBTTUlEIDQ2NyBjb21wbGV0ZWQgdGltZWRvdXQgY20gMHhmZmZmZmUwMDAxMWE3NGYwIGNj Yg0KPiAweGZmZmZmODAxMWVmZTMwMDAgZHVyaW5nIHJlY292ZXJ5IGlvYyA4MDRiIHNjc2kg MCBzdGF0ZSBjDQo+IChkYTExOm1wczA6MDozNzowKTogUkVBRCgxMCkuIENEQjogMjggMDAg ODIgYjUgMzkgODAgMDAgMDEgMDAgMDAgbGVuZ3RoDQo+IDEzMTA3MiBTTUlEIDQ2NyB0ZXJt aW5hdGVkIGlvYyA4MDRiIGxvZ2luZm8gMzExNDAwMDAgc2NzaSAwIHN0YXRlIGMgeGZlciAw DQo+IMKgwqDCoMKgwqDCoMKgICh4cHQwOm1wczA6MDozNzowKTogU01JRCAyIGFib3J0IFRh c2tNSUQgNjM0IHN0YXR1cyAweDAgY29kZSAweDANCj4gY291bnQgNA0KPiDCoMKgwqDCoMKg wqDCoCAoeHB0MDptcHMwOjA6Mzc6MCk6IFNNSUQgMiBmaW5pc2hlZCByZWNvdmVyeSBhZnRl ciBhYm9ydGluZw0KPiBUYXNrTUlEIDYzNA0KPiBtcHMwOiBVbmZyZWV6aW5nIGRldnEgZm9y IHRhcmdldCBJRCAzNw0KPiAoZGExMTptcHMwOjA6Mzc6MCk6IFJFQUQoMTApLiBDREI6IDI4 IDAwIDgyIGI1IDNiIDgwIDAwIDAxIDAwIDAwDQo+IChkYTExOm1wczA6MDozNzowKTogQ0FN IHN0YXR1czogQ29tbWFuZCB0aW1lb3V0DQo+IChkYTExOm1wczA6MDozNzowKTogUmV0cnlp bmcgY29tbWFuZA0KPiAoZGExMTptcHMwOjA6Mzc6MCk6IFJFQUQoMTApLiBDREI6IDI4IDAw IDgyIGI1IDNhIDgwIDAwIDAxIDAwIDAwDQo+IChkYTExOm1wczA6MDozNzowKTogQ0FNIHN0 YXR1czogQ0NCIHJlcXVlc3QgY29tcGxldGVkIHdpdGggYW4gZXJyb3INCj4gKGRhMTE6bXBz MDowOjM3OjApOiBSZXRyeWluZyBjb21tYW5kDQo+IChkYTExOm1wczA6MDozNzowKTogUkVB RCgxMCkuIENEQjogMjggMDAgODIgYjUgMzkgODAgMDAgMDEgMDAgMDANCj4gKGRhMTE6bXBz MDowOjM3OjApOiBDQU0gc3RhdHVzOiBDQ0IgcmVxdWVzdCBjb21wbGV0ZWQgd2l0aCBhbiBl cnJvcg0KPiAoZGExMTptcHMwOjA6Mzc6MCk6IFJldHJ5aW5nIGNvbW1hbmQNCj4gbXBzMDog RXZlbnRSZXBsecKgwqDCoMKgwqDCoMKgIDoNCj4gwqDCoMKgwqDCoMKgwqAgRXZlbnREYXRh TGVuZ3RoOiA0DQo+IMKgwqDCoMKgwqDCoMKgIEFja1JlcXVpcmVkOiAwDQo+IMKgwqDCoMKg wqDCoMKgIEV2ZW50OiBTYXNUb3BvbG9neUNoYW5nZUxpc3QgKDB4MWMpDQo+IMKgwqDCoMKg wqDCoMKgIEV2ZW50Q29udGV4dDogMHgwDQo+IMKgwqDCoMKgwqDCoMKgIEVuY2xvc3VyZUhh bmRsZTogMHgyDQo+IMKgwqDCoMKgwqDCoMKgIEV4cGFuZGVyRGV2SGFuZGxlOiAweDkNCj4g wqDCoMKgwqDCoMKgwqAgTnVtUGh5czogMjUNCj4gwqDCoMKgwqDCoMKgwqAgTnVtRW50cmll czogMQ0KPiDCoMKgwqDCoMKgwqDCoCBTdGFydFBoeU51bTogMTINCj4gwqDCoMKgwqDCoMKg wqAgRXhwU3RhdHVzOiBSZXNwb25kaW5nICgweDMpDQo+IMKgwqDCoMKgwqDCoMKgIFBoeXNp Y2FsUG9ydDogMA0KPiDCoMKgwqDCoMKgwqDCoCBQSFlbMTJdLkF0dGFjaGVkRGV2SGFuZGxl OiAweDAwMTMNCj4gwqDCoMKgwqDCoMKgwqAgUEhZWzEyXS5MaW5rUmF0ZTogNi4wR2JwcyAo MHhhYSkNCj4gwqDCoMKgwqDCoMKgwqAgUEhZWzEyXS5QaHlTdGF0dXM6IFBIWUxpbmtTdGF0 dXNDaGFuZ2UNCj4gbXBzMDogKDEpLT4obXBzc2FzX2Z3X3dvcmspIFdvcmtpbmcgb27CoCBF dmVudDogWzFjXQ0KPiBtcHMwOiAoMiktPihtcHNzYXNfZndfd29yaykgRXZlbnQgRnJlZTog WzFjXQ0KPiBtcHMwOiBFdmVudFJlcGx5wqDCoMKgwqDCoMKgwqAgOg0KPiDCoMKgwqDCoMKg wqDCoCBFdmVudERhdGFMZW5ndGg6IDINCj4gwqDCoMKgwqDCoMKgwqAgQWNrUmVxdWlyZWQ6 IDANCj4gwqDCoMKgwqDCoMKgwqAgRXZlbnQ6IFNhc0Rpc2NvdmVyeSAoMHgxNikNCj4gwqDC oMKgwqDCoMKgwqAgRXZlbnRDb250ZXh0OiAweDANCj4gwqDCoMKgwqDCoMKgwqAgRmxhZ3M6 IDANCj4gwqDCoMKgwqDCoMKgwqAgUmVhc29uQ29kZTogRGlzY292ZXJ5IENvbXBsZXRlDQo+ IMKgwqDCoMKgwqDCoMKgIFBoeXNpY2FsUG9ydDogMA0KPiDCoMKgwqDCoMKgwqDCoCBEaXNj b3ZlcnlTdGF0dXM6IDANCj4gbXBzMDogKDIpLT4obXBzc2FzX2Z3X3dvcmspIFdvcmtpbmcg b27CoCBFdmVudDogWzE2XQ0KPiBtcHMwOiAoMyktPihtcHNzYXNfZndfd29yaykgRXZlbnQg RnJlZTogWzE2XQ0KPiAoZGExMTptcHMwOjA6Mzc6MCk6IFJFQUQoMTApLiBDREI6IDI4IDAw IDgyIGI1IDM5IDgwIDAwIDAxIDAwIDAwDQo+IChkYTExOm1wczA6MDozNzowKTogQ0FNIHN0 YXR1czogU0NTSSBTdGF0dXMgRXJyb3INCj4gKGRhMTE6bXBzMDowOjM3OjApOiBTQ1NJIHN0 YXR1czogQ2hlY2sgQ29uZGl0aW9uDQo+IChkYTExOm1wczA6MDozNzowKTogU0NTSSBzZW5z ZTogVU5JVCBBVFRFTlRJT04gYXNjOjI5LDAgKFBvd2VyIG9uLA0KPiByZXNldCwgb3IgYnVz IGRldmljZSByZXNldCBvY2N1cnJlZCkNCj4gKGRhMTE6bXBzMDowOjM3OjApOiBSZXRyeWlu ZyBjb21tYW5kIChwZXIgc2Vuc2UgZGF0YSkNCj4NCj4gVGhpcyBpcyB3aGF0J3MgcnVubmlu ZyByaWdodCBub3cgdGhhdCBwcm9kdWNlZCB0aGF0IC0tIG5vdGUgbm8gZXJyb3JzDQo+IHJl cG9ydGVkIG9uIHRoZSB0d28gcHJvdmlkZXJzICh0aGUgZGVncmFkZWQgc3RhdGUgaXMgaW50 ZW50aW9uYWw7IHRoZQ0KPiB0aGlyZCB1bml0IGlzIG9mZi1zaXRlIGluIGEgYmFuayB2YXVs dCk6DQo+DQo+IFtrYXJsQE5ld0ZTIC92YXIvbG9nXSQgenBvb2wgc3RhdHVzIGJhY2t1cA0K PiDCoCBwb29sOiBiYWNrdXANCj4gwqBzdGF0ZTogREVHUkFERUQNCj4gc3RhdHVzOiBPbmUg b3IgbW9yZSBkZXZpY2VzIGhhcyBiZWVuIHRha2VuIG9mZmxpbmUgYnkgdGhlIGFkbWluaXN0 cmF0b3IuDQo+IMKgwqDCoMKgwqDCoMKgIFN1ZmZpY2llbnQgcmVwbGljYXMgZXhpc3QgZm9y IHRoZSBwb29sIHRvIGNvbnRpbnVlIGZ1bmN0aW9uaW5nIGluIGENCj4gwqDCoMKgwqDCoMKg wqAgZGVncmFkZWQgc3RhdGUuDQo+IGFjdGlvbjogT25saW5lIHRoZSBkZXZpY2UgdXNpbmcg J3pwb29sIG9ubGluZScgb3IgcmVwbGFjZSB0aGUgZGV2aWNlIHdpdGgNCj4gwqDCoMKgwqDC oMKgwqAgJ3pwb29sIHJlcGxhY2UnLg0KPiDCoCBzY2FuOiBzY3J1YiBpbiBwcm9ncmVzcyBz aW5jZSBUdWUgRmViwqAgNSAwNjo1NzoxNCAyMDE5DQo+IMKgwqDCoMKgwqDCoMKgIDg0MEcg c2Nhbm5lZCBhdCAyMDBNL3MsIDUxN0cgaXNzdWVkIGF0IDEyM00vcywgMy4zNlQgdG90YWwN Cj4gwqDCoMKgwqDCoMKgwqAgMCByZXBhaXJlZCwgMTUuMDQlIGRvbmUsIDAgZGF5cyAwNjo0 NDoxNyB0byBnbw0KPiBjb25maWc6DQo+DQo+IMKgwqDCoMKgwqDCoMKgIE5BTUXCoMKgwqDC oMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqAgU1RBVEXCoMKgwqDCoCBSRUFE IFdSSVRFIENLU1VNDQo+IMKgwqDCoMKgwqDCoMKgIGJhY2t1cMKgwqDCoMKgwqDCoMKgwqDC oMKgwqDCoMKgwqDCoMKgwqDCoMKgIERFR1JBREVEwqDCoMKgwqAgMMKgwqDCoMKgIDDCoMKg wqDCoCAwDQo+IMKgwqDCoMKgwqDCoMKgwqDCoCBtaXJyb3ItMMKgwqDCoMKgwqDCoMKgwqDC oMKgwqDCoMKgwqDCoCBERUdSQURFRMKgwqDCoMKgIDDCoMKgwqDCoCAwwqDCoMKgwqAgMA0K PiDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgIGdwdC9iYWNrdXA2MS5lbGnCoMKgwqDCoMKgIE9O TElORcKgwqDCoMKgwqDCoCAwwqDCoMKgwqAgMMKgwqDCoMKgIDANCj4gwqDCoMKgwqDCoMKg wqDCoMKgwqDCoCBncHQvYmFja3VwNjItMS5lbGnCoMKgwqAgT05MSU5FwqDCoMKgwqDCoMKg IDDCoMKgwqDCoCAwwqDCoMKgwqAgMA0KPiDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgIDEzMjgy ODEyMjk1NzU1NDYwNDc5wqAgT0ZGTElORcKgwqDCoMKgwqAgMMKgwqDCoMKgIDDCoMKgwqDC oCAwwqAgd2FzDQo+IC9kZXYvZ3B0L2JhY2t1cDYyLTIuZWxpDQo+DQo+IGVycm9yczogTm8g a25vd24gZGF0YSBlcnJvcnMNCj4NCj4gQnV0LCBoZXJlJ3MgdGhlIFNNQVJUIGRhdGEgb24g dGhlIGRpc2sgLS0gaXQgRE9FUyBzaG93IHRoZSByZXNldDoNCj4NCj4gQmVmb3JlLi4uLg0K Pg0KPiBEZXZpY2UgU3RhdGlzdGljcyAoR1AgTG9nIDB4MDQpDQo+IFBhZ2XCoCBPZmZzZXQg U2l6ZcKgwqDCoMKgwqDCoMKgIFZhbHVlIEZsYWdzIERlc2NyaXB0aW9uDQo+IDB4MDHCoCA9 PT09PcKgID3CoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgID3CoCA9PT3CoCA9PSBHZW5l cmFsIFN0YXRpc3RpY3MgKHJldiAyKSA9PQ0KPiAweDAxwqAgMHgwMDjCoCA0wqDCoMKgwqDC oMKgwqDCoMKgwqDCoMKgwqAgMTnCoCAtLS3CoCBMaWZldGltZSBQb3dlci1PbiBSZXNldHMN Cj4gMHgwMcKgIDB4MDE4wqAgNsKgwqDCoMKgIDMyMDAyMTM4NTM0wqAgLS0twqAgTG9naWNh bCBTZWN0b3JzIFdyaXR0ZW4NCj4gMHgwMcKgIDB4MDIwwqAgNsKgwqDCoMKgwqDCoCAxNTU4 OTUzMjXCoCAtLS3CoCBOdW1iZXIgb2YgV3JpdGUgQ29tbWFuZHMNCj4gMHgwMcKgIDB4MDI4 wqAgNsKgwqDCoCAyNjU0NTcwMTY1MDDCoCAtLS3CoCBMb2dpY2FsIFNlY3RvcnMgUmVhZA0K PiAweDAxwqAgMHgwMzDCoCA2wqDCoMKgwqDCoCAxMTMyNjAxNDkwwqAgLS0twqAgTnVtYmVy IG9mIFJlYWQgQ29tbWFuZHMNCj4gMHgwMcKgIDB4MDM4wqAgNsKgwqDCoMKgIDYxNTM3NTE1 MzAwwqAgLS0twqAgRGF0ZSBhbmQgVGltZSBUaW1lU3RhbXANCj4gMHgwM8KgID09PT09wqAg PcKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqAgPcKgID09PcKgID09IFJvdGF0aW5nIE1l ZGlhIFN0YXRpc3RpY3MgKHJldiAxKSA9PQ0KPiAweDAzwqAgMHgwMDjCoCA0wqDCoMKgwqDC oMKgwqDCoMKgwqDCoCA2MTE0wqAgLS0twqAgU3BpbmRsZSBNb3RvciBQb3dlci1vbiBIb3Vy cw0KPiAweDAzwqAgMHgwMTDCoCA0wqDCoMKgwqDCoMKgwqDCoMKgwqDCoCA2MTE0wqAgLS0t wqAgSGVhZCBGbHlpbmcgSG91cnMNCj4gMHgwM8KgIDB4MDE4wqAgNMKgwqDCoMKgwqDCoMKg wqDCoMKgIDMwNjAywqAgLS0twqAgSGVhZCBMb2FkIEV2ZW50cw0KPiAweDAzwqAgMHgwMjDC oCA0wqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoCAwwqAgLS0twqAgTnVtYmVyIG9mIFJl YWxsb2NhdGVkIExvZ2ljYWwgU2VjdG9ycw0KPiAweDAzwqAgMHgwMjjCoCA0wqDCoMKgwqDC oMKgwqDCoMKgIDI4MzczNcKgIC0tLcKgIFJlYWQgUmVjb3ZlcnkgQXR0ZW1wdHMNCj4gMHgw M8KgIDB4MDMwwqAgNMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqAgMMKgIC0tLcKgIE51 bWJlciBvZiBNZWNoYW5pY2FsIFN0YXJ0IEZhaWx1cmVzDQo+IDB4MDTCoCA9PT09PcKgID3C oMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgID3CoCA9PT3CoCA9PSBHZW5lcmFsIEVycm9y cyBTdGF0aXN0aWNzIChyZXYgMSkgPT0NCj4gMHgwNMKgIDB4MDA4wqAgNMKgwqDCoMKgwqDC oMKgwqDCoMKgwqDCoMKgwqAgMMKgIC0tLcKgIE51bWJlciBvZiBSZXBvcnRlZCBVbmNvcnJl Y3RhYmxlIEVycm9ycw0KPiAweDA0wqAgMHgwMTDCoCA0wqDCoMKgwqDCoMKgwqDCoMKgwqDC oMKgwqAgMTfCoCAtLS3CoCBSZXNldHMgQmV0d2VlbiBDbWQgQWNjZXB0YW5jZSBhbmQNCj4g Q29tcGxldGlvDQo+IG4NCj4gMHgwNcKgID09PT09wqAgPcKgwqDCoMKgwqDCoMKgwqDCoMKg wqDCoMKgwqAgPcKgID09PcKgID09IFRlbXBlcmF0dXJlIFN0YXRpc3RpY3MgKHJldiAxKSA9 PQ0KPiAweDA1wqAgMHgwMDjCoCAxwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqAgMzjCoCAt LS3CoCBDdXJyZW50IFRlbXBlcmF0dXJlDQo+IDB4MDXCoCAweDAxMMKgIDHCoMKgwqDCoMKg wqDCoMKgwqDCoMKgwqDCoCA0MMKgIE4tLcKgIEF2ZXJhZ2UgU2hvcnQgVGVybSBUZW1wZXJh dHVyZQ0KPiAweDA1wqAgMHgwMTjCoCAxwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqAgMzLC oCBOLS3CoCBBdmVyYWdlIExvbmcgVGVybSBUZW1wZXJhdHVyZQ0KPiAweDA1wqAgMHgwMjDC oCAxwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqAgNTLCoCAtLS3CoCBIaWdoZXN0IFRlbXBl cmF0dXJlDQo+IDB4MDXCoCAweDAyOMKgIDHCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoCAy M8KgIC0tLcKgIExvd2VzdCBUZW1wZXJhdHVyZQ0KPiAweDA1wqAgMHgwMzDCoCAxwqDCoMKg wqDCoMKgwqDCoMKgwqDCoMKgwqAgNDjCoCBOLS3CoCBIaWdoZXN0IEF2ZXJhZ2UgU2hvcnQg VGVybSBUZW1wZXJhdHVyZQ0KPiAweDA1wqAgMHgwMzjCoCAxwqDCoMKgwqDCoMKgwqDCoMKg wqDCoMKgwqAgMjXCoCBOLS3CoCBMb3dlc3QgQXZlcmFnZSBTaG9ydCBUZXJtIFRlbXBlcmF0 dXJlDQo+IDB4MDXCoCAweDA0MMKgIDHCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoCA0NMKg IE4tLcKgIEhpZ2hlc3QgQXZlcmFnZSBMb25nIFRlcm0gVGVtcGVyYXR1cmUNCj4gMHgwNcKg IDB4MDQ4wqAgMcKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgIDI1wqAgTi0twqAgTG93ZXN0 IEF2ZXJhZ2UgTG9uZyBUZXJtIFRlbXBlcmF0dXJlDQo+IDB4MDXCoCAweDA1MMKgIDTCoMKg wqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgIDDCoCAtLS3CoCBUaW1lIGluIE92ZXItVGVtcGVy YXR1cmUNCj4gMHgwNcKgIDB4MDU4wqAgMcKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgIDYw wqAgLS0twqAgU3BlY2lmaWVkIE1heGltdW0gT3BlcmF0aW5nIFRlbXBlcmF0dXJlDQo+IDB4 MDXCoCAweDA2MMKgIDTCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgIDDCoCAtLS3CoCBU aW1lIGluIFVuZGVyLVRlbXBlcmF0dXJlDQo+IDB4MDXCoCAweDA2OMKgIDHCoMKgwqDCoMKg wqDCoMKgwqDCoMKgwqDCoMKgIDDCoCAtLS3CoCBTcGVjaWZpZWQgTWluaW11bSBPcGVyYXRp bmcgVGVtcGVyYXR1cmUNCj4gMHgwNsKgID09PT09wqAgPcKgwqDCoMKgwqDCoMKgwqDCoMKg wqDCoMKgwqAgPcKgID09PcKgID09IFRyYW5zcG9ydCBTdGF0aXN0aWNzIChyZXYgMSkgPT0N Cj4gMHgwNsKgIDB4MDA4wqAgNMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqAgNsKgIC0t LcKgIE51bWJlciBvZiBIYXJkd2FyZSBSZXNldHMNCj4gMHgwNsKgIDB4MDEwwqAgNMKgwqDC oMKgwqDCoMKgwqDCoMKgwqDCoMKgwqAgMMKgIC0tLcKgIE51bWJlciBvZiBBU1IgRXZlbnRz DQo+IDB4MDbCoCAweDAxOMKgIDTCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgIDDCoCAt LS3CoCBOdW1iZXIgb2YgSW50ZXJmYWNlIENSQyBFcnJvcnMNCj4gwqDCoMKgwqDCoMKgwqDC oMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqAgfHx8XyBD IG1vbml0b3JlZCBjb25kaXRpb24gbWV0DQo+IMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKg wqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgIHx8X18gRCBzdXBwb3J0cyBE U04NCj4gwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKg wqDCoMKgwqDCoMKgwqAgfF9fXyBOIG5vcm1hbGl6ZWQgdmFsdWUNCj4NCj4gQW5kIGFmdGVy Li4uLg0KPg0KPiBEZXZpY2UgU3RhdGlzdGljcyAoR1AgTG9nIDB4MDQpDQo+IFBhZ2XCoCBP ZmZzZXQgU2l6ZcKgwqDCoMKgwqDCoMKgIFZhbHVlIEZsYWdzIERlc2NyaXB0aW9uDQo+IDB4 MDHCoCA9PT09PcKgID3CoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgID3CoCA9PT3CoCA9 PSBHZW5lcmFsIFN0YXRpc3RpY3MgKHJldiAyKSA9PQ0KPiAweDAxwqAgMHgwMDjCoCA0wqDC oMKgwqDCoMKgwqDCoMKgwqDCoMKgwqAgMTnCoCAtLS3CoCBMaWZldGltZSBQb3dlci1PbiBS ZXNldHMNCj4gMHgwMcKgIDB4MDE4wqAgNsKgwqDCoMKgIDMyMDA0MTk1MDcwwqAgLS0twqAg TG9naWNhbCBTZWN0b3JzIFdyaXR0ZW4NCj4gMHgwMcKgIDB4MDIwwqAgNsKgwqDCoMKgwqDC oCAxNTU5NDY3MzLCoCAtLS3CoCBOdW1iZXIgb2YgV3JpdGUgQ29tbWFuZHMNCj4gMHgwMcKg IDB4MDI4wqAgNsKgwqDCoCAyNjYzNDAwNTI0NjjCoCAtLS3CoCBMb2dpY2FsIFNlY3RvcnMg UmVhZA0KPiAweDAxwqAgMHgwMzDCoCA2wqDCoMKgwqDCoCAxMTM2MzQ3NDYzwqAgLS0twqAg TnVtYmVyIG9mIFJlYWQgQ29tbWFuZHMNCj4gMHgwMcKgIDB4MDM4wqAgNsKgwqDCoMKgIDYx NTQwODE0NzAwwqAgLS0twqAgRGF0ZSBhbmQgVGltZSBUaW1lU3RhbXANCj4gMHgwM8KgID09 PT09wqAgPcKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqAgPcKgID09PcKgID09IFJvdGF0 aW5nIE1lZGlhIFN0YXRpc3RpY3MgKHJldiAxKSA9PQ0KPiAweDAzwqAgMHgwMDjCoCA0wqDC oMKgwqDCoMKgwqDCoMKgwqDCoCA2MTE0wqAgLS0twqAgU3BpbmRsZSBNb3RvciBQb3dlci1v biBIb3Vycw0KPiAweDAzwqAgMHgwMTDCoCA0wqDCoMKgwqDCoMKgwqDCoMKgwqDCoCA2MTE0 wqAgLS0twqAgSGVhZCBGbHlpbmcgSG91cnMNCj4gMHgwM8KgIDB4MDE4wqAgNMKgwqDCoMKg wqDCoMKgwqDCoMKgIDMwNjAywqAgLS0twqAgSGVhZCBMb2FkIEV2ZW50cw0KPiAweDAzwqAg MHgwMjDCoCA0wqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoCAwwqAgLS0twqAgTnVtYmVy IG9mIFJlYWxsb2NhdGVkIExvZ2ljYWwgU2VjdG9ycw0KPiAweDAzwqAgMHgwMjjCoCA0wqDC oMKgwqDCoMKgwqDCoMKgIDI4Mzg0OMKgIC0tLcKgIFJlYWQgUmVjb3ZlcnkgQXR0ZW1wdHMN Cj4gMHgwM8KgIDB4MDMwwqAgNMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqAgMMKgIC0t LcKgIE51bWJlciBvZiBNZWNoYW5pY2FsIFN0YXJ0IEZhaWx1cmVzDQo+IDB4MDTCoCA9PT09 PcKgID3CoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgID3CoCA9PT3CoCA9PSBHZW5lcmFs IEVycm9ycyBTdGF0aXN0aWNzIChyZXYgMSkgPT0NCj4gMHgwNMKgIDB4MDA4wqAgNMKgwqDC oMKgwqDCoMKgwqDCoMKgwqDCoMKgwqAgMMKgIC0tLcKgIE51bWJlciBvZiBSZXBvcnRlZCBV bmNvcnJlY3RhYmxlIEVycm9ycw0KPiAweDA0wqAgMHgwMTDCoCA0wqDCoMKgwqDCoMKgwqDC oMKgwqDCoMKgwqAgMTfCoCAtLS3CoCBSZXNldHMgQmV0d2VlbiBDbWQgQWNjZXB0YW5jZSBh bmQNCj4gQ29tcGxldGlvbg0KPiAweDA1wqAgPT09PT3CoCA9wqDCoMKgwqDCoMKgwqDCoMKg wqDCoMKgwqDCoCA9wqAgPT09wqAgPT0gVGVtcGVyYXR1cmUgU3RhdGlzdGljcyAocmV2IDEp ID09DQo+IDB4MDXCoCAweDAwOMKgIDHCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoCA0McKg IC0tLcKgIEN1cnJlbnQgVGVtcGVyYXR1cmUNCj4gMHgwNcKgIDB4MDEwwqAgMcKgwqDCoMKg wqDCoMKgwqDCoMKgwqDCoMKgIDQwwqAgTi0twqAgQXZlcmFnZSBTaG9ydCBUZXJtIFRlbXBl cmF0dXJlDQo+IDB4MDXCoCAweDAxOMKgIDHCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoCAz MsKgIE4tLcKgIEF2ZXJhZ2UgTG9uZyBUZXJtIFRlbXBlcmF0dXJlDQo+IDB4MDXCoCAweDAy MMKgIDHCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoCA1MsKgIC0tLcKgIEhpZ2hlc3QgVGVt cGVyYXR1cmUNCj4gMHgwNcKgIDB4MDI4wqAgMcKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKg IDIzwqAgLS0twqAgTG93ZXN0IFRlbXBlcmF0dXJlDQo+IDB4MDXCoCAweDAzMMKgIDHCoMKg wqDCoMKgwqDCoMKgwqDCoMKgwqDCoCA0OMKgIE4tLcKgIEhpZ2hlc3QgQXZlcmFnZSBTaG9y dCBUZXJtIFRlbXBlcmF0dXJlDQo+IDB4MDXCoCAweDAzOMKgIDHCoMKgwqDCoMKgwqDCoMKg wqDCoMKgwqDCoCAyNcKgIE4tLcKgIExvd2VzdCBBdmVyYWdlIFNob3J0IFRlcm0gVGVtcGVy YXR1cmUNCj4gMHgwNcKgIDB4MDQwwqAgMcKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgIDQ0 wqAgTi0twqAgSGlnaGVzdCBBdmVyYWdlIExvbmcgVGVybSBUZW1wZXJhdHVyZQ0KPiAweDA1 wqAgMHgwNDjCoCAxwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqAgMjXCoCBOLS3CoCBMb3dl c3QgQXZlcmFnZSBMb25nIFRlcm0gVGVtcGVyYXR1cmUNCj4gMHgwNcKgIDB4MDUwwqAgNMKg wqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqAgMMKgIC0tLcKgIFRpbWUgaW4gT3Zlci1UZW1w ZXJhdHVyZQ0KPiAweDA1wqAgMHgwNTjCoCAxwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqAg NjDCoCAtLS3CoCBTcGVjaWZpZWQgTWF4aW11bSBPcGVyYXRpbmcgVGVtcGVyYXR1cmUNCj4g MHgwNcKgIDB4MDYwwqAgNMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqAgMMKgIC0tLcKg IFRpbWUgaW4gVW5kZXItVGVtcGVyYXR1cmUNCj4gMHgwNcKgIDB4MDY4wqAgMcKgwqDCoMKg wqDCoMKgwqDCoMKgwqDCoMKgwqAgMMKgIC0tLcKgIFNwZWNpZmllZCBNaW5pbXVtIE9wZXJh dGluZyBUZW1wZXJhdHVyZQ0KPiAweDA2wqAgPT09PT3CoCA9wqDCoMKgwqDCoMKgwqDCoMKg wqDCoMKgwqDCoCA9wqAgPT09wqAgPT0gVHJhbnNwb3J0IFN0YXRpc3RpY3MgKHJldiAxKSA9 PQ0KPiAweDA2wqAgMHgwMDjCoCA0wqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoCA3wqAg LS0twqAgTnVtYmVyIG9mIEhhcmR3YXJlIFJlc2V0cw0KPiAweDA2wqAgMHgwMTDCoCA0wqDC oMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoCAwwqAgLS0twqAgTnVtYmVyIG9mIEFTUiBFdmVu dHMNCj4gMHgwNsKgIDB4MDE4wqAgNMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqAgMMKg IC0tLcKgIE51bWJlciBvZiBJbnRlcmZhY2UgQ1JDIEVycm9ycw0KPiDCoMKgwqDCoMKgwqDC oMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoCB8fHxf IEMgbW9uaXRvcmVkIGNvbmRpdGlvbiBtZXQNCj4gwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKg wqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqAgfHxfXyBEIHN1cHBvcnRz IERTTg0KPiDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKg wqDCoMKgwqDCoMKgwqDCoCB8X19fIE4gbm9ybWFsaXplZCB2YWx1ZQ0KPg0KPiBOdW1iZXIg b2YgSGFyZHdhcmUgUmVzZXRzIGhhcyBpbmNyZW1lbnRlZC7CoCBUaGVyZSBhcmUgbm8gb3Ro ZXIgZXJyb3JzIHNob3duOg0KPg0KPiBTTUFSVCBBdHRyaWJ1dGVzIERhdGEgU3RydWN0dXJl IHJldmlzaW9uIG51bWJlcjogMTYNCj4gVmVuZG9yIFNwZWNpZmljIFNNQVJUIEF0dHJpYnV0 ZXMgd2l0aCBUaHJlc2hvbGRzOg0KPiBJRCMgQVRUUklCVVRFX05BTUXCoMKgwqDCoMKgwqDC oMKgwqAgRkxBR1PCoMKgwqAgVkFMVUUgV09SU1QgVEhSRVNIIEZBSUwgUkFXX1ZBTFVFDQo+ IMKgIDEgUmF3X1JlYWRfRXJyb3JfUmF0ZcKgwqDCoMKgIFBPLVItLcKgwqAgMTAwwqDCoCAx MDDCoMKgIDAxNsKgwqDCoCAtwqDCoMKgIDANCj4gwqAgMiBUaHJvdWdocHV0X1BlcmZvcm1h bmNlwqAgUC1TLS0twqDCoCAxMzfCoMKgIDEzN8KgwqAgMDU0wqDCoMKgIC3CoMKgwqAgMTA0 DQo+IMKgIDMgU3Bpbl9VcF9UaW1lwqDCoMKgwqDCoMKgwqDCoMKgwqDCoCBQT1MtLS3CoMKg IDEzMsKgwqAgMTMywqDCoCAwMjTCoMKgwqAgLcKgwqDCoCA0OTcNCj4gKEF2ZXJhZ2UgNDk3 KQ0KPiDCoCA0IFN0YXJ0X1N0b3BfQ291bnTCoMKgwqDCoMKgwqDCoCAtTy0tQy3CoMKgIDA5 OcKgwqAgMDk5wqDCoCAwMDDCoMKgwqAgLcKgwqDCoCA3MDc0DQo+IMKgIDUgUmVhbGxvY2F0 ZWRfU2VjdG9yX0N0wqDCoCBQTy0tQ0vCoMKgIDEwMMKgwqAgMTAwwqDCoCAwMDXCoMKgwqAg LcKgwqDCoCAwDQo+IMKgIDcgU2Vla19FcnJvcl9SYXRlwqDCoMKgwqDCoMKgwqDCoCBQTy1S LS3CoMKgIDEwMMKgwqAgMTAwwqDCoCAwNjfCoMKgwqAgLcKgwqDCoCAwDQo+IMKgIDggU2Vl a19UaW1lX1BlcmZvcm1hbmNlwqDCoCBQLVMtLS3CoMKgIDEyOMKgwqAgMTI4wqDCoCAwMjDC oMKgwqAgLcKgwqDCoCAxOA0KPiDCoCA5IFBvd2VyX09uX0hvdXJzwqDCoMKgwqDCoMKgwqDC oMKgIC1PLS1DLcKgwqAgMDk4wqDCoCAwOTjCoMKgIDAwMMKgwqDCoCAtwqDCoMKgIDE3MDk0 DQo+IMKgMTAgU3Bpbl9SZXRyeV9Db3VudMKgwqDCoMKgwqDCoMKgIFBPLS1DLcKgwqAgMTAw wqDCoCAxMDDCoMKgIDA2MMKgwqDCoCAtwqDCoMKgIDANCj4gwqAxMiBQb3dlcl9DeWNsZV9D b3VudMKgwqDCoMKgwqDCoCAtTy0tQ0vCoMKgIDEwMMKgwqAgMTAwwqDCoCAwMDDCoMKgwqAg LcKgwqDCoCAxOQ0KPiAxOTIgUG93ZXItT2ZmX1JldHJhY3RfQ291bnQgLU8tLUNLwqDCoCAw NzXCoMKgIDA3NcKgwqAgMDAwwqDCoMKgIC3CoMKgwqAgMzA2MDINCj4gMTkzIExvYWRfQ3lj bGVfQ291bnTCoMKgwqDCoMKgwqDCoCAtTy0tQy3CoMKgIDA3NcKgwqAgMDc1wqDCoCAwMDDC oMKgwqAgLcKgwqDCoCAzMDYwMg0KPiAxOTQgVGVtcGVyYXR1cmVfQ2Vsc2l1c8KgwqDCoMKg IC1PLS0tLcKgwqAgMTQ2wqDCoCAxNDbCoMKgIDAwMMKgwqDCoCAtwqDCoMKgIDQxIChNaW4v TWF4DQo+IDIzLzUyKQ0KPiAxOTYgUmVhbGxvY2F0ZWRfRXZlbnRfQ291bnQgLU8tLUNLwqDC oCAxMDDCoMKgIDEwMMKgwqAgMDAwwqDCoMKgIC3CoMKgwqAgMA0KPiAxOTcgQ3VycmVudF9Q ZW5kaW5nX1NlY3RvcsKgIC1PLS0tS8KgwqAgMTAwwqDCoCAxMDDCoMKgIDAwMMKgwqDCoCAt wqDCoMKgIDANCj4gMTk4IE9mZmxpbmVfVW5jb3JyZWN0YWJsZcKgwqAgLS0tUi0twqDCoCAx MDDCoMKgIDEwMMKgwqAgMDAwwqDCoMKgIC3CoMKgwqAgMA0KPiAxOTkgVURNQV9DUkNfRXJy b3JfQ291bnTCoMKgwqAgLU8tUi0twqDCoCAyMDDCoMKgIDIwMMKgwqAgMDAwwqDCoMKgIC3C oMKgwqAgMA0KPiDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDC oMKgwqDCoMKgwqAgfHx8fHx8XyBLIGF1dG8ta2VlcA0KPiDCoMKgwqDCoMKgwqDCoMKgwqDC oMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqAgfHx8fHxfXyBDIGV2ZW50IGNv dW50DQo+IMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDC oMKgwqDCoCB8fHx8X19fIFIgZXJyb3IgcmF0ZQ0KPiDCoMKgwqDCoMKgwqDCoMKgwqDCoMKg wqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqAgfHx8X19fXyBTIHNwZWVkL3BlcmZv cm1hbmNlDQo+IMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKg wqDCoMKgwqDCoCB8fF9fX19fIE8gdXBkYXRlZCBvbmxpbmUNCj4gwqDCoMKgwqDCoMKgwqDC oMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgIHxfX19fX18gUCBwcmVm YWlsdXJlIHdhcm5pbmcNCj4NCj4gSSdkIHRocm93IHBvc3NpYmxlIHNoYWRlIGF0IHRoZSBi YWNrcGxhbmUgb3IgY2FibGUgL2J1dCBJIGhhdmUgYWxyZWFkeQ0KPiBzd2FwcGVkIGJvdGgg b3V0IGZvciBzcGFyZXMgd2l0aG91dCBhbnkgY2hhbmdlIGluIGJlaGF2aW9yLi8NCj4NCi0t IA0KS2FybCBEZW5uaW5nZXINCmthcmxAZGVubmluZ2VyLm5ldCA8bWFpbHRvOmthcmxAZGVu bmluZ2VyLm5ldD4NCi9UaGUgTWFya2V0IFRpY2tlci8NCi9bUy9NSU1FIGVuY3J5cHRlZCBl bWFpbCBwcmVmZXJyZWRdLw0K --------------ms010104060201000008040902 Content-Type: application/pkcs7-signature; name="smime.p7s" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="smime.p7s" Content-Description: S/MIME Cryptographic Signature MIAGCSqGSIb3DQEHAqCAMIACAQExDzANBglghkgBZQMEAgMFADCABgkqhkiG9w0BBwEAAKCC DdgwggagMIIEiKADAgECAhMA5EiKghDOXrvfxYxjITXYDdhIMA0GCSqGSIb3DQEBCwUAMIGL MQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTESMBAGA1UEBwwJTmljZXZpbGxlMRkw FwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5c3RlbXMgQ0ExITAf BgNVBAMMGEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBDQTAeFw0xNzA4MTcxNjQyMTdaFw0yNzA4 MTUxNjQyMTdaMHsxCzAJBgNVBAYTAlVTMRAwDgYDVQQIDAdGbG9yaWRhMRkwFwYDVQQKDBBD dWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5c3RlbXMgQ0ExJTAjBgNVBAMMHEN1 ZGEgU3lzdGVtcyBMTEMgMjAxNyBJbnQgQ0EwggIiMA0GCSqGSIb3DQEBAQUAA4ICDwAwggIK AoICAQC1aJotNUI+W4jP7xQDO8L/b4XiF4Rss9O0B+3vMH7Njk85fZ052QhZpMVlpaaO+sCI KqG3oNEbuOHzJB/NDJFnqh7ijBwhdWutdsq23Ux6TvxgakyMPpT6TRNEJzcBVQA0kpby1DVD 0EKSK/FrWWBiFmSxg7qUfmIq/mMzgE6epHktyRM3OGq3dbRdOUgfumWrqHXOrdJz06xE9NzY vc9toqZnd79FUtE/nSZVm1VS3Grq7RKV65onvX3QOW4W1ldEHwggaZxgWGNiR/D4eosAGFxn uYeWlKEC70c99Mp1giWux+7ur6hc2E+AaTGh+fGeijO5q40OGd+dNMgK8Es0nDRw81lRcl24 SWUEky9y8DArgIFlRd6d3ZYwgc1DMTWkTavx3ZpASp5TWih6yI8ACwboTvlUYeooMsPtNa9E 6UQ1nt7VEi5syjxnDltbEFoLYcXBcqhRhFETJe9CdenItAHAtOya3w5+fmC2j/xJz29og1KH YqWHlo3Kswi9G77an+zh6nWkMuHs+03DU8DaOEWzZEav3lVD4u76bKRDTbhh0bMAk4eXriGL h4MUoX3Imfcr6JoyheVrAdHDL/BixbMH1UUspeRuqQMQ5b2T6pabXP0oOB4FqldWiDgJBGRd zWLgCYG8wPGJGYgHibl5rFiI5Ix3FQncipc6SdUzOQIDAQABo4IBCjCCAQYwHQYDVR0OBBYE FF3AXsKnjdPND5+bxVECGKtc047PMIHABgNVHSMEgbgwgbWAFBu1oRhUMNEzjODolDka5k4Q EDBioYGRpIGOMIGLMQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTESMBAGA1UEBwwJ TmljZXZpbGxlMRkwFwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5 c3RlbXMgQ0ExITAfBgNVBAMMGEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBDQYIJAKxAy1WBo2kY MBIGA1UdEwEB/wQIMAYBAf8CAQAwDgYDVR0PAQH/BAQDAgGGMA0GCSqGSIb3DQEBCwUAA4IC AQCB5686UCBVIT52jO3sz9pKuhxuC2npi8ZvoBwt/IH9piPA15/CGF1XeXUdu2qmhOjHkVLN gO7XB1G8CuluxofOIUce0aZGyB+vZ1ylHXlMeB0R82f5dz3/T7RQso55Y2Vog2Zb7PYTC5B9 oNy3ylsnNLzanYlcW3AAfzZcbxYuAdnuq0Im3EpGm8DoItUcf1pDezugKm/yKtNtY6sDyENj tExZ377cYA3IdIwqn1Mh4OAT/Rmh8au2rZAo0+bMYBy9C11Ex0hQ8zWcvPZBDn4v4RtO8g+K uQZQcJnO09LJNtw94W3d2mj4a7XrsKMnZKvm6W9BJIQ4Nmht4wXAtPQ1xA+QpxPTmsGAU0Cv HmqVC7XC3qxFhaOrD2dsvOAK6Sn3MEpH/YrfYCX7a7cz5zW3DsJQ6o3pYfnnQz+hnwLlz4MK 17NIA0WOdAF9IbtQqarf44+PEyUbKtz1r0KGeGLs+VGdd2FLA0e7yuzxJDYcaBTVwqaHhU2/ Fna/jGU7BhrKHtJbb/XlLeFJ24yvuiYKpYWQSSyZu1R/gvZjHeGb344jGBsZdCDrdxtQQcVA 6OxsMAPSUPMrlg9LWELEEYnVulQJerWxpUecGH92O06wwmPgykkz//UmmgjVSh7ErNvL0lUY UMfunYVO/O5hwhW+P4gviCXzBFeTtDZH259O7TCCBzAwggUYoAMCAQICEwCg0WvVwekjGFiO 62SckFwepz0wDQYJKoZIhvcNAQELBQAwezELMAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3Jp ZGExGTAXBgNVBAoMEEN1ZGEgU3lzdGVtcyBMTEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBD QTElMCMGA1UEAwwcQ3VkYSBTeXN0ZW1zIExMQyAyMDE3IEludCBDQTAeFw0xNzA4MTcyMTIx MjBaFw0yMjA4MTYyMTIxMjBaMFcxCzAJBgNVBAYTAlVTMRAwDgYDVQQIDAdGbG9yaWRhMRkw FwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRswGQYDVQQDDBJrYXJsQGRlbm5pbmdlci5uZXQw ggIiMA0GCSqGSIb3DQEBAQUAA4ICDwAwggIKAoICAQC+HVSyxVtJhy3Ohs+PAGRuO//Dha9A 16l5FPATr6wude9zjX5f2lrkRyU8vhCXTZW7WbvWZKpcZ8r0dtZmiK9uF58Ec6hhvfkxJzbg 96WHBw5Fumd5ahZzuCJDtCAWW8R7/KN+zwzQf1+B3MVLmbaXAFBuKzySKhKMcHbK3/wjUYTg y+3UK6v2SBrowvkUBC+jxNg3Wy12GsTXcUS/8FYIXgVVPgfZZrbJJb5HWOQpvvhILpPCD3xs YJFNKEPltXKWHT7Qtc2HNqikgNwj8oqOb+PeZGMiWapsatKm8mxuOOGOEBhAoTVTwUHlMNTg 6QUCJtuWFCK38qOCyk9Haj+86lUU8RG6FkRXWgMbNQm1mWREQhw3axgGLSntjjnznJr5vsvX SYR6c+XKLd5KQZcS6LL8FHYNjqVKHBYM+hDnrTZMqa20JLAF1YagutDiMRURU23iWS7bA9tM cXcqkclTSDtFtxahRifXRI7Epq2GSKuEXe/1Tfb5CE8QsbCpGsfSwv2tZ/SpqVG08MdRiXxN 5tmZiQWo15IyWoeKOXl/hKxA9KPuDHngXX022b1ly+5ZOZbxBAZZMod4y4b4FiRUhRI97r9l CxsP/EPHuuTIZ82BYhrhbtab8HuRo2ofne2TfAWY2BlA7ExM8XShMd9bRPZrNTokPQPUCWCg CdIATQIDAQABo4IBzzCCAcswPAYIKwYBBQUHAQEEMDAuMCwGCCsGAQUFBzABhiBodHRwOi8v b2NzcC5jdWRhc3lzdGVtcy5uZXQ6ODg4ODAJBgNVHRMEAjAAMBEGCWCGSAGG+EIBAQQEAwIF oDAOBgNVHQ8BAf8EBAMCBeAwHQYDVR0lBBYwFAYIKwYBBQUHAwIGCCsGAQUFBwMEMDMGCWCG SAGG+EIBDQQmFiRPcGVuU1NMIEdlbmVyYXRlZCBDbGllbnQgQ2VydGlmaWNhdGUwHQYDVR0O BBYEFLElmNWeVgsBPe7O8NiBzjvjYnpRMIHKBgNVHSMEgcIwgb+AFF3AXsKnjdPND5+bxVEC GKtc047PoYGRpIGOMIGLMQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTESMBAGA1UE BwwJTmljZXZpbGxlMRkwFwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRh IFN5c3RlbXMgQ0ExITAfBgNVBAMMGEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBDQYITAORIioIQ zl6738WMYyE12A3YSDAdBgNVHREEFjAUgRJrYXJsQGRlbm5pbmdlci5uZXQwDQYJKoZIhvcN AQELBQADggIBAJXboPFBMLMtaiUt4KEtJCXlHO/3ZzIUIw/eobWFMdhe7M4+0u3te0sr77QR dcPKR0UeHffvpth2Mb3h28WfN0FmJmLwJk+pOx4u6uO3O0E1jNXoKh8fVcL4KU79oEQyYkbu 2HwbXBU9HbldPOOZDnPLi0whi/sbFHdyd4/w/NmnPgzAsQNZ2BYT9uBNr+jZw4SsluQzXG1X lFL/qCBoi1N2mqKPIepfGYF6drbr1RnXEJJsuD+NILLooTNf7PMgHPZ4VSWQXLNeFfygoOOK FiO0qfxPKpDMA+FHa8yNjAJZAgdJX5Mm1kbqipvb+r/H1UAmrzGMbhmf1gConsT5f8KU4n3Q IM2sOpTQe7BoVKlQM/fpQi6aBzu67M1iF1WtODpa5QUPvj1etaK+R3eYBzi4DIbCIWst8MdA 1+fEeKJFvMEZQONpkCwrJ+tJEuGQmjoQZgK1HeloepF0WDcviiho5FlgtAij+iBPtwMuuLiL shAXA5afMX1hYM4l11JXntle12EQFP1r6wOUkpOdxceCcMVDEJBBCHW2ZmdEaXgAm1VU+fnQ qS/wNw/S0X3RJT1qjr5uVlp2Y0auG/eG0jy6TT0KzTJeR9tLSDXprYkN2l/Qf7/nT6Q03qyE QnnKiBXWAZXveafyU/zYa7t3PTWFQGgWoC4w6XqgPo4KV44OMYIFBzCCBQMCAQEwgZIwezEL MAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3JpZGExGTAXBgNVBAoMEEN1ZGEgU3lzdGVtcyBM TEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBDQTElMCMGA1UEAwwcQ3VkYSBTeXN0ZW1zIExM QyAyMDE3IEludCBDQQITAKDRa9XB6SMYWI7rZJyQXB6nPTANBglghkgBZQMEAgMFAKCCAkUw GAYJKoZIhvcNAQkDMQsGCSqGSIb3DQEHATAcBgkqhkiG9w0BCQUxDxcNMTkwMjA1MjI0OTQ2 WjBPBgkqhkiG9w0BCQQxQgRAWfR77ytZfE9zA6XrAv+7QoCWIwfbAMdrRhMkP0/Ku0Rw9mS6 1rsXaK2yZyoNgkyEzfjvcBIp0jP5VgtP+5zNLzBsBgkqhkiG9w0BCQ8xXzBdMAsGCWCGSAFl AwQBKjALBglghkgBZQMEAQIwCgYIKoZIhvcNAwcwDgYIKoZIhvcNAwICAgCAMA0GCCqGSIb3 DQMCAgFAMAcGBSsOAwIHMA0GCCqGSIb3DQMCAgEoMIGjBgkrBgEEAYI3EAQxgZUwgZIwezEL MAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3JpZGExGTAXBgNVBAoMEEN1ZGEgU3lzdGVtcyBM TEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBDQTElMCMGA1UEAwwcQ3VkYSBTeXN0ZW1zIExM QyAyMDE3IEludCBDQQITAKDRa9XB6SMYWI7rZJyQXB6nPTCBpQYLKoZIhvcNAQkQAgsxgZWg gZIwezELMAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3JpZGExGTAXBgNVBAoMEEN1ZGEgU3lz dGVtcyBMTEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBDQTElMCMGA1UEAwwcQ3VkYSBTeXN0 ZW1zIExMQyAyMDE3IEludCBDQQITAKDRa9XB6SMYWI7rZJyQXB6nPTANBgkqhkiG9w0BAQEF AASCAgBz9r2FLhFAo65z8ENQnYdNm6HsJMDNzbsvuqhwQWeqdSJx0E9ctTBIrmHP5CsSSiLK 9hWoaJCsikw7xNSTi3JmckN5PF4I7UUDp9zBUO/TzK3EpHs3yCB/puG9U5uUoiBHU5P3k6Ia T+7ycSr0Gr8NMHPC1b+tfvAK57MqsqjK5MGFyGfxR/V57MXEVz8dd0guNpb+wMm2ho9ZsCcE iSKBuIbqwMhVV443NwPp4PNj56Zhz4sBUOssr/FjMb2IIe3s8y7eCvCBOmy4EwIYSMFeh4aO teC8DQ3F54wbKoi+HsLf0R2gY//43FQZ84bAIdEkDQq9Ok+MVFWjEUlWchnR2ZKyi+ovn/17 bgocsemji7IDs/d0unJvH75q6AlSHej2dQxrrT29Nrpu8iMZTs++KEoc3cYFYC2zQJiZRNGB /vWtyTW+DCHYKJuwnSq0rVs7wAsDOHmY9PYTrF2We+qs3PgAaGjRkIHC3JCORNiF5szRTVZ6 QlwhULEOAnAPeUMsklx9nYEQmUY+wh2I6m9XflaXlBqHLdmagf5/zRFOPZwCoZkP/15m/HFq 6PvAp0pmrFClc6LBBe+lSq/DZsnq57Koq84IDgtw2ouzOJyOz5oOBW1MOUqId1nKK8KwAVcu o0PqInj8sUXGIlAh7OFLCie8bu+BVxrNI26fprk9lQAAAAAAAA== --------------ms010104060201000008040902-- From owner-freebsd-stable@freebsd.org Tue Feb 5 23:44:12 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4DD4B14D4819 for ; Tue, 5 Feb 2019 23:44:12 +0000 (UTC) (envelope-from lwhsu.freebsd@gmail.com) Received: from mail-yw1-f66.google.com (mail-yw1-f66.google.com [209.85.161.66]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 62B5470012 for ; Tue, 5 Feb 2019 23:44:11 +0000 (UTC) (envelope-from lwhsu.freebsd@gmail.com) Received: by mail-yw1-f66.google.com with SMTP id v201so2431107ywa.9 for ; Tue, 05 Feb 2019 15:44:11 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=gves658r1da+A0H/+JaFE6XLBMDvzr5wfhgc4fFtMBo=; b=GZc2wLd93WRaHb7fQShSFrvbiEkSqP5T1eS7rHi925ag1G4TPV1BL2CZBjggYK9Xj8 ivtehij5SZX7hWDZcajwdgBjYzhe4/yvHwTltVAl/ETfln3zvh/Mxy6tkWChtoDce3tt CIyGAox7y5jCTLrj3CIuFpKkhCM/V5MdrPabDcVZJxonXQPf8hyPJxJPMyp1oMrwQ/xz dNbX8YffmGSyitoGuxH+T6iOn5gIE150azXAZ7P2XXGASSPdC4AYeLt3+okZ0QveMJ/M gLjCwGNI2WFYhGIPztfjDCTPEIGe+9CzZmJhF/gLHC6KiwzgNy4nYI3VRBniN9FLKQ2w CiDw== X-Gm-Message-State: AHQUAuZQ1Pk6qrvxR6BC9TSPeUQXOIYRXlLaQvdPg/PrYBIP3AiYOoVv mA3CN1MhjkFe7U/uhAomh17IN6k5lbzd2MeV3Ow= X-Google-Smtp-Source: AHgI3IY19Jy2FeAaQfeZbb4OxyBypql9A3UA7A8h02VU2JNxggQFQapJO36OeNNeyT2TYmGyIosJRlMGgOmQuAUH0RI= X-Received: by 2002:a0d:e808:: with SMTP id r8mr6125747ywe.318.1549410245201; Tue, 05 Feb 2019 15:44:05 -0800 (PST) MIME-Version: 1.0 From: Li-Wen Hsu Date: Wed, 6 Feb 2019 07:43:53 +0800 Message-ID: Subject: FreeBSD CI Weekly Report 2019-02-03 To: freebsd-testing@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 62B5470012 X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; spf=pass (mx1.freebsd.org: domain of lwhsufreebsd@gmail.com designates 209.85.161.66 as permitted sender) smtp.mailfrom=lwhsufreebsd@gmail.com X-Spamd-Result: default: False [-4.03 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; RCVD_COUNT_TWO(0.00)[2]; FROM_NEQ_ENVFROM(0.00)[lwhsu@freebsd.org,lwhsufreebsd@gmail.com]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; MIME_TRACE(0.00)[0:+]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; RCVD_TLS_LAST(0.00)[]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; NEURAL_HAM_SHORT(-0.86)[-0.861,0]; RCVD_IN_DNSWL_NONE(0.00)[66.161.85.209.list.dnswl.org : 127.0.5.0]; IP_SCORE(-1.16)[ipnet: 209.85.128.0/17(-3.76), asn: 15169(-1.95), country: US(-0.07)]; FORGED_SENDER(0.30)[lwhsu@freebsd.org,lwhsufreebsd@gmail.com]; DMARC_NA(0.00)[freebsd.org]; R_DKIM_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; FORGED_RECIPIENTS(0.00)[freebsd-testing@freebsd.org,freebsd-stable@freebsd.org]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; TAGGED_FROM(0.00)[]; TO_DOM_EQ_FROM_DOM(0.00)[] X-Mailman-Approved-At: Tue, 05 Feb 2019 23:51:07 +0000 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 05 Feb 2019 23:44:12 -0000 (bcc -current and -stable for more audience) FreeBSD CI Weekly Report 2019-02-03 =================================== Here is a summary of the FreeBSD Continuous Integration results for the period from 2019-01-28 to 2019-02-03. During this period, we have: * 2220 builds (93.7% passed, 6.2% failed, 0.1% exception) were executed on aarch64, amd64, armv6, armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64, sparc64 architectures for building world, GENERIC and LINT kernel of head, stable/12, stable/11 branches. * 565 test runs (25.7% passed, 69.2% unstable, 5.1% exception) were executed on amd64, i386, riscv64 architectures for head, stable/12, stable/11 branches. * 7 doc buils (85.8% passed, 14.2% failed) If any of the issues found by CI are in your area of interest or expertise please investigate the PRs listed below. Web version of this report is available at https://hackmd.io/s/B1CMKdJNE and archive is available at http://hackfoldr.org/freebsd-ci-report/, any help is welcome. ## Failing Jobs * https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/ after r343713 (Enable COVERAGE and KCOV by default on arm64 and amd64.), the test VM exits while executing dtrace test cases. ## Fixed Jobs * https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc/8765/ * Fixed/workarounded by * https://svnweb.freebsd.org/changeset/base/343670 * https://svnweb.freebsd.org/changeset/base/343671 * https://svnweb.freebsd.org/changeset/base/343672 * See also: https://bugs.freebsd.org/130067 ## Failing Tests * https://ci.freebsd.org/job/FreeBSD-head-amd64-test/ * lib.libc.sys.sendfile_test.hdtr_positive_v4 * lib.libc.sys.sendfile_test.hdtr_positive_v6 see https://bugs.freebsd.org/235200 and https://bugs.freebsd.org/234809 for deails * https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/ * There are 61 (-3 since last report) failing cases, see https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/ for more details * https://ci.freebsd.org/job/FreeBSD-head-i386-test/ * sys.netmap.ctrl-api-test.main * sys.opencrypto.runtests.main * lib.libc.regex.exhaust_test.regcomp_too_big * lib.libregex.exhaust_test.regcomp_too_big * sys.kern.coredump_phnum_test.coredump_phnum WIP: https://reviews.freebsd.org/D18495 * lib.libc.sys.sendfile_test.hdtr_positive_v4 * lib.libc.sys.sendfile_test.hdtr_positive_v6 see https://bugs.freebsd.org/235200 and https://bugs.freebsd.org/234809 for deails * https://ci.freebsd.org/job/FreeBSD-stable-12-i386-test/ * sbin.bectl.bectl_test.bectl_mount * sys.netmap.ctrl-api-test.main * sys.opencrypto.runtests.main * lib.libc.regex.exhaust_test.regcomp_too_big * lib.libregex.exhaust_test.regcomp_too_big * sys.kern.coredump_phnum_test.coredump_phnum WIP: https://reviews.freebsd.org/D18495 * https://ci.freebsd.org/job/FreeBSD-stable-11-amd64-test/ * usr.bin.procstat.procstat_test.kernel_stacks * https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/ * sys.netmap.ctrl-api-test.main * sys.opencrypto.runtests.main * usr.bin.procstat.procstat_test.environment * usr.bin.procstat.procstat_test.kernel_stacks * local.kyua.* (31 cases) * local.lutok.* (3 cases) ## Disabled Tests * lib.libc.sys.mmap_test.mmap_truncate_signal https://bugs.freebsd.org/211924 * sys.fs.tmpfs.mount_test.large https://bugs.freebsd.org/212862 * sys.fs.tmpfs.link_test.kqueue https://bugs.freebsd.org/213662 * sys.kqueue.libkqueue.kqueue_test.main https://bugs.freebsd.org/233586 * usr.bin.procstat.procstat_test.command_line_arguments https://bugs.freebsd.org/233587 * usr.bin.procstat.procstat_test.environment https://bugs.freebsd.org/233588 * lib.msun.{cbrt_test.cbrtl_powl,trig_test.reduction} https://bugs.freebsd.org/234040 ## Open Issues ### Cause build fails * [233339: genassym.o build race](https://bugs.freebsd.org/233339) * [233735: Possible build race: genoffset.o /usr/src/sys/sys/types.h: error: machine/endian.h: No such file or directory](https://bugs.freebsd.org/233735) * [233769: Possible build race: ld: error: unable to find library -lgcc_s](https://bugs.freebsd.org/233769) ### Others [Tickets related to testing@](https://preview.tinyurl.com/y9maauwg) ## Closed Issues * [235097: ci runs panic with use-after-free when running sys/netpfil/pf/nat tests](https://bugs.freebsd.org/235097) * patch committed (https://svnweb.freebsd.org/changeset/base/343418) and MFC to 12 (https://svnweb.freebsd.org/changeset/base/343652) and 11 (https://svnweb.freebsd.org/changeset/base/343653) * [235411: sys.netpfil.pf.fragmentation.v6 panics after r343631](https://bugs.freebsd.org/235411) * Fixed in https://svnweb.freebsd.org/changeset/base/343678 ## Other News * Facebook's zstd has FreeBSD CI integrated with Cirrus CI: https://github.com/facebook/zstd/pull/1501 * We have a job does lint check the doc with [igor](https://www.freshports.org/textproc/igor): https://ci.freebsd.org/job/FreeBSD-doc-head-igor/lastCompletedBuild/checkstyleResult/ most of them are minor issues but some of them are worth to be checked and improved. From owner-freebsd-stable@freebsd.org Wed Feb 6 12:20:46 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4BCD814D1CB0 for ; Wed, 6 Feb 2019 12:20:46 +0000 (UTC) (envelope-from bu7cher@yandex.ru) Received: from forward103p.mail.yandex.net (forward103p.mail.yandex.net [IPv6:2a02:6b8:0:1472:2741:0:8b7:106]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 845316B6D3 for ; Wed, 6 Feb 2019 12:20:44 +0000 (UTC) (envelope-from bu7cher@yandex.ru) Received: from mxback13g.mail.yandex.net (mxback13g.mail.yandex.net [IPv6:2a02:6b8:0:1472:2741:0:8b7:92]) by forward103p.mail.yandex.net (Yandex) with ESMTP id DC1EE18C145A; Wed, 6 Feb 2019 15:20:40 +0300 (MSK) Received: from smtp4o.mail.yandex.net (smtp4o.mail.yandex.net [2a02:6b8:0:1a2d::28]) by mxback13g.mail.yandex.net (nwsmtp/Yandex) with ESMTP id osyHYS9p5S-Keo4MsuR; Wed, 06 Feb 2019 15:20:40 +0300 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yandex.ru; s=mail; t=1549455640; bh=8/vMf/0uXa6KQr0CQsHYzT00SsEmNziQEtJbmhmnAC8=; h=Subject:To:References:From:Message-ID:Date:In-Reply-To; b=VJGKSfNU13F2V417octoOJPCxKW78D6MBQQ8W2sRAv3tFLRZyMehRqtVr0ffmLvNd fe3Zh+joi1Ey3elJn2iBcosMOJx/GEi2bwOq3LDcChYutCIVUNgCTjgM57kTdmJ3k9 GQAcP6DPixIcGn5XAFa+1qL2uBQBbXzwdq7NPOAM= Received: by smtp4o.mail.yandex.net (nwsmtp/Yandex) with ESMTPSA id k5oF3TYELZ-KdGuRb6J; Wed, 06 Feb 2019 15:20:39 +0300 (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client certificate not present) Subject: Re: More CARP issues under 12 To: Pete French , freebsd-stable@freebsd.org References: From: "Andrey V. Elsukov" Openpgp: id=E6591E1B41DA1516F0C9BC0001C5EA0410C8A17A Autocrypt: addr=bu7cher@yandex.ru; prefer-encrypt=mutual; keydata= mQENBEwBF1kBCADB9sXFhBEUy8qQ4X63Y8eBatYMHGEFWN9ypS5lI3RE6qQW2EYbxNk7qUC5 21YIIS1mMFVBEfvR7J9uc7yaYgFCEb6Sce1RSO4ULN2mRKGHP3/Sl0ijZEjWHV91hY1YTHEF ZW/0GYinDf56sYpDDehaBF5wkWIo1+QK5nmj3vl0DIDCMNd7QEiWpyLVwECgLX2eOAXByT8B bCqVhJGcG6iFP7/B9Ll6uX5gb8thM9LM+ibwErDBVDGiOgvfxqidab7fdkh893IBCXa82H9N CNwnEtcgzh+BSKK5BgvPohFMgRwjti37TSxwLu63QejRGbZWSz3OK3jMOoF63tCgn7FvABEB AAG0JUFuZHJleSBWLiBFbHN1a292IDxidTdjaGVyQHlhbmRleC5ydT6JATgEEwECACIFAkwB F1kCGwMGCwkIBwMCBhUIAgkKCwQWAgMBAh4BAheAAAoJEAHF6gQQyKF6qmYIAI6ekfm1VA4T vqankI1ISE6ku4jV7UlpIQlEbE7/8n3Zd6teJ+pGOQhN5qk8QE7utdPdbktAzi+x7LIJVzUw 4TywZLXGrkP7VKYkfg6oyCGyzITghefQeJtr2TN4hYCkzPWpylkue8MtmqfZv/6royqwTbN+ +E09FQNvTgRUYJYTeQ1qOsxNRycwvw3dr2rOfuxShbzaHBB1pBIjGrMg8fC5pd65ACH5zuFV A0CoTNGMDrEZSfBkTW604UUHFFXeCoC3dwDZRKOWJ3GmMXns65Ai5YkA63BSHEE1Qle3VBhd cG1w0CB5FBV3pB27UVnf0jEbysrDqW4qN7XMRFSWNAy5AQ0ETAEXWQEIAJ2p6l9LBoqdH/0J PEFDY2t2gTvAuzz+8zs3R03dFuHcNbOwjvWCG0aOmVpAzkRa8egn5JB4sZaFUtKPYJEQ1Iu+ LUBwgvtXf4vWpzC67zs2dDuiW4LamH5p6xkTD61aHR7mCB3bg2TUjrDWn2Jt44cvoYxj3dz4 S49U1rc9ZPgD5axCNv45j72tggWlZvpefThP7xT1OlNTUqye2gAwQravXpZkl5JG4eOqJVIU X316iE3qso0iXRUtO7OseBf0PiVmk+wCahdreHOeOxK5jMhYkPKVn7z1sZiB7W2H2TojbmcK HZC22sz7Z/H36Lhg1+/RCnGzdEcjGc8oFHXHCxUAEQEAAYkBHwQYAQIACQUCTAEXWQIbDAAK CRABxeoEEMihegkYCAC3ivGYNe2taNm/4Nx5GPdzuaAJGKWksV+w9mo7dQvU+NmI2az5w8vw 98OmX7G0OV9snxMW+6cyNqBrVFTu33VVNzz9pnqNCHxGvj5dL5ltP160JV2zw2bUwJBYsgYQ WfyJJIM7l3gv5ZS3DGqaGIm9gOK1ANxfrR5PgPzvI9VxDhlr2juEVMZYAqPLEJe+SSxbwLoz BcFCNdDAyXcaAzXsx/E02YWm1hIWNRxanAe7Vlg7OL+gvLpdtrYCMg28PNqKNyrQ87LQ49O9 50IIZDOtNFeR0FGucjcLPdS9PiEqCoH7/waJxWp6ydJ+g4OYRBYNM0EmMgy1N85JJrV1mi5i Message-ID: <4a350f47-eaca-5aca-9268-bf7a6618e71c@yandex.ru> Date: Wed, 6 Feb 2019 15:16:57 +0300 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:60.0) Gecko/20100101 Thunderbird/60.4.0 MIME-Version: 1.0 In-Reply-To: Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="7bK3PQoFiD4BFFm2wfsqU3zcyBEpaGZUH" X-Rspamd-Queue-Id: 845316B6D3 X-Spamd-Bar: ------- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yandex.ru header.s=mail header.b=VJGKSfNU; dmarc=pass (policy=none) header.from=yandex.ru; spf=pass (mx1.freebsd.org: domain of bu7cher@yandex.ru designates 2a02:6b8:0:1472:2741:0:8b7:106 as permitted sender) smtp.mailfrom=bu7cher@yandex.ru X-Spamd-Result: default: False [-7.70 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a02:6b8:0:1000::/52]; FREEMAIL_FROM(0.00)[yandex.ru]; HAS_ATTACHMENT(0.00)[]; RCVD_COUNT_THREE(0.00)[4]; DKIM_TRACE(0.00)[yandex.ru:+]; MX_GOOD(-0.01)[cached: mx.yandex.ru]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-0.76)[-0.761,0]; DMARC_POLICY_ALLOW(-0.50)[yandex.ru,none]; SIGNED_PGP(-2.00)[]; FROM_EQ_ENVFROM(0.00)[]; IP_SCORE(-1.73)[ipnet: 2a02:6b8::/32(-4.81), asn: 13238(-3.84), country: RU(0.00)]; RCVD_TLS_LAST(0.00)[]; RCVD_IN_DNSWL_LOW(-0.10)[6.0.1.0.7.b.8.0.0.0.0.0.1.4.7.2.2.7.4.1.0.0.0.0.8.b.6.0.2.0.a.2.list.dnswl.org : 127.0.5.1]; ASN(0.00)[asn:13238, ipnet:2a02:6b8::/32, country:RU]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[yandex.ru.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[yandex.ru]; R_DKIM_ALLOW(-0.20)[yandex.ru:s=mail]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.20)[multipart/signed,multipart/mixed,text/plain]; MIME_TRACE(0.00)[0:+,1:+,2:+]; TO_MATCH_ENVRCPT_SOME(0.00)[] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 06 Feb 2019 12:20:46 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --7bK3PQoFiD4BFFm2wfsqU3zcyBEpaGZUH Content-Type: multipart/mixed; boundary="OUo7VcTDD6nkTlEx80j3kJVBBpyr78ypS"; protected-headers="v1" From: "Andrey V. Elsukov" To: Pete French , freebsd-stable@freebsd.org Message-ID: <4a350f47-eaca-5aca-9268-bf7a6618e71c@yandex.ru> Subject: Re: More CARP issues under 12 References: In-Reply-To: --OUo7VcTDD6nkTlEx80j3kJVBBpyr78ypS Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: quoted-printable On 05.02.2019 18:06, Pete French wrote: > The branch and revision is 12.0-STABLE r343538 GENERIC >=20 >> # kgdb >> >> (kgdb) list *ether_output+0x6b6 >=20 > trying to do this on the actual box is hard, as it panics, but on anoth= er > machine running the same build I get this, which should suffice if you > are just interested in seeing the line in the source code ? >=20 > (kgdb) list *ether_output+0x6b6 > 0xffffffff80ca1526 is in ether_output (/usr/src/sys/net/if_ethersubr.c:= 435). > 430 if (m =3D=3D NULL) > 431 return (0); > 432 } > 433 > 434 /* Continue with link-layer output */ > 435 return ether_output_frame(ifp, m); > 436 } > 437 > 438 static bool > 439 ether_set_pcp(struct mbuf **mp, struct ifnet *ifp, uint8_t pcp)= Hi, this doesn't look very useful. Do you have some specificity with this host except carp? Some modifications to kernel config, lagg, jails, etc. --=20 WBR, Andrey V. Elsukov --OUo7VcTDD6nkTlEx80j3kJVBBpyr78ypS-- --7bK3PQoFiD4BFFm2wfsqU3zcyBEpaGZUH Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Comment: Using GnuPG with Thunderbird - https://www.enigmail.net/ iQEzBAEBCAAdFiEE5lkeG0HaFRbwybwAAcXqBBDIoXoFAlxa0DkACgkQAcXqBBDI oXriNAf8CNhIkfZ+7A+K/eVedPFZRCCERDNfCbAn1kJ4xXyfHwfmFNMbovbesfll 5kZw5LbxXLqvSeL+Io1GaxVkkDljzjySCAiBLP4gxZJ9P+FML/XQsRsc9862ZqKb GdYmS9Ig8MJL4gp+dgI+iA0dNbi9XfweGYY6LHG40I1TAI4deJDJQPl9y4WyrEje 3f/z3hc3aNa61BZVbkqWY9+cxLrRI/mB2KXEintmEjTKDj9Zd3ZHAo68tkdxi+tl IMHdBPXTC+lbt8r6AqrdJjKGhVuqUQrVc0BgrqmM+Scjr/95p3iXRVn1px6/hWPs yKUgnFLOVm1bFCdGRxx+a+XTDvv7nQ== =M4St -----END PGP SIGNATURE----- --7bK3PQoFiD4BFFm2wfsqU3zcyBEpaGZUH-- From owner-freebsd-stable@freebsd.org Wed Feb 6 12:31:00 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 01E3814D28B6 for ; Wed, 6 Feb 2019 12:31:00 +0000 (UTC) (envelope-from petefrench@ingresso.co.uk) Received: from constantine.ingresso.co.uk (unknown [IPv6:2a02:b90:3002:411::3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 8AF4C6BDE1 for ; Wed, 6 Feb 2019 12:30:58 +0000 (UTC) (envelope-from petefrench@ingresso.co.uk) Received: from [82.47.240.30] (helo=foula.drayhouse.twisted.org.uk) by constantine.ingresso.co.uk with esmtpsa (TLSv1.2:ECDHE-RSA-AES128-GCM-SHA256:128) (Exim 4.91 (FreeBSD)) (envelope-from ) id 1grMLv-000Ie7-S1; Wed, 06 Feb 2019 12:30:55 +0000 Subject: Re: More CARP issues under 12 To: "Andrey V. Elsukov" , freebsd-stable@freebsd.org References: <4a350f47-eaca-5aca-9268-bf7a6618e71c@yandex.ru> From: Pete French Message-ID: Date: Wed, 6 Feb 2019 12:30:55 +0000 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.11; rv:65.0) Gecko/20100101 Thunderbird/65.0 MIME-Version: 1.0 In-Reply-To: <4a350f47-eaca-5aca-9268-bf7a6618e71c@yandex.ru> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 8AF4C6BDE1 X-Spamd-Bar: +++++ Authentication-Results: mx1.freebsd.org; dmarc=pass (policy=none) header.from=ingresso.co.uk; spf=pass (mx1.freebsd.org: domain of petefrench@ingresso.co.uk designates 2a02:b90:3002:411::3 as permitted sender) smtp.mailfrom=petefrench@ingresso.co.uk X-Spamd-Result: default: False [5.01 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a02:b90:3002:411::3]; NEURAL_SPAM_SHORT(0.90)[0.900,0]; MIME_GOOD(-0.10)[text/plain]; IP_SCORE(-0.02)[country: GB(-0.09)]; RDNS_NONE(1.00)[]; NEURAL_SPAM_MEDIUM(0.86)[0.855,0]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MX_GOOD(-0.01)[cached: ingresso-co-uk.mail.protection.outlook.com]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[ingresso.co.uk,none]; NEURAL_SPAM_LONG(0.58)[0.579,0]; FREEMAIL_TO(0.00)[yandex.ru]; RECEIVED_SPAMHAUS_PBL(0.00)[30.240.47.82.zen.spamhaus.org : 127.0.0.11]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:16082, ipnet:2a02:b90::/32, country:GB]; HFILTER_HOSTNAME_UNKNOWN(2.50)[]; MID_RHS_MATCH_FROM(0.00)[]; FROM_EQ_ENVFROM(0.00)[] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 06 Feb 2019 12:31:00 -0000 On 06/02/2019 12:16, Andrey V. Elsukov wrote: > Hi, > > this doesn't look very useful. > Do you have some specificity with this host except carp? Some > modifications to kernel config, lagg, jails, etc. No, none of those. Its a supermicro motherboard, runs FreeBSD GENERIC and mysql+redis on top, thats it. The only oddity is carp (used to fail over the redis). but the panic happens when I disable carp and have removed all the ports too. My only customisation to the build is to disable sendmail and lpr. We do use geli for the dirves, and load aesni as a module as well to speed that up. loader.conf below: kern.geom.label.disk_ident.enable=0 kern.geom.label.gptid.enable=0 ahci_load="YES" console="comconsole" aesni_load="YES" cryptodev_load="YES" geom_eli_load="YES" carp_load="YES" zfs_load="YES" vfs.zfs.arc_max="1G" vfs.zfs.prefetch_disable="1" vfs.zfs.txg.timeout="5" vfs.zfs.vdev.cache.size="10M" vfs.zfs.vdev.cache.max="10M" rc.conf below geli_enable="YES" geli_autodetach="NO" geli_devices="ada0p4 ada1p4" hostname="serpentine-passive.telehouse-internal.ingresso.co.uk" ifconfig_igb0="inet 10.32.10.4/16" ifconfig_igb0_ipv6="inet6 2a02:1658:1:2:e550::4/64" ifconfig_igb0_alias0="inet 10.32.10.8/16 vhid 80 advskew 160 pass redacted" defaultrouter="10.32.10.6" ipv6_defaultrouter="2a02:1658:1:2:e550::6" ifconfig_igb1="down" pf_enable="NO" pf_rules="/usr/local/etc/pf.conf" redis_enable="YES" stunnel_enable="YES" mysql_enable="YES" mysql_dbdir="/usr/home/mysql/data" tsw_redis_capture_enable="YES" tsw_redis_capture_if="igb0" datadog_enable="YES" datadog_user="root" datadog_chdir="/usr/local/datadog" sshd_enable="YES" named_enable="YES" zfs_enable="YES" ntpd_enable="YES" syslogd_enable="NO" syslog_ng_enable="YES" exim_enable="YES" sendmail_enable="NO" sendmail_submit_enable="NO" sendmail_outbound_enable="NO" sendmail_msp_queue_enable="NO" nfs_server_enable="NO" nfs_client_enable="YES" nfsv4_server_enable="NO" nfsuserd_enable="YES" rpcbind_enable="YES" rpc_lockd_enable="YES" rpc_lockd_flags="-p 819" rpc_statd_enable="YES" rpc_statd_flags="-p 823" mountd_enable="NO" fluentd_enable="YES" The tsw_redis_capture script just set the carp to MASTER if redis is enabled - means if the machine boots without redis running then carp wont grap the address anyway. From owner-freebsd-stable@freebsd.org Wed Feb 6 15:13:20 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9EC5F14D64FA for ; Wed, 6 Feb 2019 15:13:20 +0000 (UTC) (envelope-from devgs@ukr.net) Received: from frv199.fwdcdn.com (frv199.fwdcdn.com [212.42.77.199]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.ukr.net", Issuer "Thawte RSA CA 2018" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id E0ED771018 for ; Wed, 6 Feb 2019 15:13:18 +0000 (UTC) (envelope-from devgs@ukr.net) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=ukr.net; s=ffe; h=Content-Transfer-Encoding:Content-Type:MIME-Version:Message-Id:To: Subject:From:Date:Sender:Reply-To:Cc:Content-ID:Content-Description: Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID: In-Reply-To:References:List-Id:List-Help:List-Unsubscribe:List-Subscribe: List-Post:List-Owner:List-Archive; bh=5VZ1fmVFY2b5Yfbndt+XTTfnVftwgGgFzK7A/b1ghmk=; b=UPkjulI2TLVh88Fq4W5iflUEZ9 3mBvq7GRoVKxaQwI+dkv9YpP7oiHArYogBxhQP3kHxu2W/Grvrc0xm91IU4DHKwTHDJemaAQnsuf6 tkQnsUdshHjwnUG+M8/Hkweiqv1r3hhjX0fhypWczel0i81Ag4zCx0CYulx1YHP9FUzg=; Received: from [10.10.10.39] (helo=frv39.fwdcdn.com) by frv199.fwdcdn.com with smtp ID 1grOsv-000I4F-5B for freebsd-stable@freebsd.org; Wed, 06 Feb 2019 17:13:09 +0200 Date: Wed, 06 Feb 2019 17:13:08 +0200 From: Paul Subject: Request for more intelligent local port allocation algorithm To: freebsd-net@freebsd.org, freebsd-stable@freebsd.org X-Mailer: mail.ukr.net 5.0 Message-Id: <1549461051.318520353.gg4fwwj8@frv39.fwdcdn.com> Received: from devgs@ukr.net by frv39.fwdcdn.com; Wed, 06 Feb 2019 17:13:09 +0200 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: binary X-Rspamd-Queue-Id: E0ED771018 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=ukr.net header.s=ffe header.b=UPkjulI2; dmarc=pass (policy=none) header.from=ukr.net; spf=pass (mx1.freebsd.org: domain of devgs@ukr.net designates 212.42.77.199 as permitted sender) smtp.mailfrom=devgs@ukr.net X-Spamd-Result: default: False [-3.76 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.998,0]; R_DKIM_ALLOW(-0.20)[ukr.net:s=ffe]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:212.42.77.0/24]; FREEMAIL_FROM(0.00)[ukr.net]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; NEURAL_HAM_LONG(-1.00)[-0.999,0]; NEURAL_SPAM_SHORT(0.23)[0.235,0]; DWL_DNSWL_LOW(-1.00)[ukr.net.dwl.dnswl.org : 127.0.5.1]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[ukr.net:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[ukr.net,none]; MX_GOOD(-0.01)[mxs.ukr.net]; IP_SCORE(0.01)[country: UA(0.04)]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[ukr.net]; ASN(0.00)[asn:8856, ipnet:212.42.77.0/24, country:UA]; RCVD_TLS_LAST(0.00)[] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 06 Feb 2019 15:13:20 -0000 Hi dev team, It's not a secret that when application is trying to establish new TCP connection, without first binding a socket to specific local interface address, OS handles that automatically. Unfortunately there is a catch, that lies in a different logic of local port allocation: (1) when socket is bound before connect() vs (2) when it is not. When allocating the port in in_pcb_lport() by checking whether different ports are free, using in_pcblookup_local(), the behaviour is following: (1) Bound, ie laddr is assigned with specific address: Port is considered occupied only if there is a PCBs that matches both laddr and lport (2) Not bound, ie laddr == INADDR_ANY: Port is considered occupied if there is any PCBs that only matches lport. What this means is that in order to allocate a port none of the all available local addresses should have it allocated, even though this requirement is ridiculous, since we are allocating only one PCB Looking though the code, it seems that (2) is due to the fact that tcp_connect() first allocates the port, indirectly through the call to in_pcbbind() and only then allocates the actual local address, also indirectly, though the call to in_pcbconnect_setup(), that in turn calls in_pcbladdr(). So, probably, in order to guarantee that in_pcbconnect_setup() will not fail we make sure that all range of local addresses are available, no matter which one of them is actually selected by in_pcbladdr()? In real world, this creates serious problems for servers that have a lot of outgoing connections, for example nginx proxy with a lot of open HTTP2 connections. In order to avoid this limitation we have created workarounds within the nginx config as well as within our own software, basically by having 50 local addresses and only following the scenario (1). Alas, all of the built-in Unix utilities as well as other software always follow scenario (2). As the result given large number of connections there may be points in time, when whole range of ports is occupied by at least one local address. Even worse is the outcome of such condition: when in_pcb_lport() travels over the range of possible port numbers, making myriad of calls to in_pcblookup_local(), some kind of important lock is being held withing the kernel. So important that it leads to a complete lock of the system. Even the direct terminal access is not available: it is not responsive. The more calls to connect through scenario (2) there are the longer it takes the system to unfreeze. Given some circumstances, the only option is hard reset. Is it possible to somehow update the code that does connect via scenario (2) to enable more intelligent port allocation, like for example allocating local address and port simultaneously From owner-freebsd-stable@freebsd.org Wed Feb 6 15:18:51 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8F93114D677A for ; Wed, 6 Feb 2019 15:18:51 +0000 (UTC) (envelope-from borjam@sarenet.es) Received: from cu01176b.smtpx.saremail.com (cu01176b.smtpx.saremail.com [195.16.151.151]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 69F0B712E6 for ; Wed, 6 Feb 2019 15:18:50 +0000 (UTC) (envelope-from borjam@sarenet.es) Received: from [172.16.8.5] (unknown [192.148.167.11]) by proxypop01.sare.net (Postfix) with ESMTPA id B3BE59DF622; Wed, 6 Feb 2019 16:18:38 +0100 (CET) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 12.2 \(3445.102.3\)) Subject: Re: 9211 (LSI/SAS) issues on 11.2-STABLE From: Borja Marcos In-Reply-To: <57ddc2f4-681c-e0aa-0484-42cee3876a05@denninger.net> Date: Wed, 6 Feb 2019 16:18:37 +0100 Cc: freebsd-stable@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <1FFC1686-E70F-4649-B170-34F90B773918@sarenet.es> References: <7bb25f55-fa77-f67e-11f3-b2240b01e25a@denninger.net> <9ea70420-0c06-ad9d-e8b7-f9d92fed20d8@denninger.net> <57ddc2f4-681c-e0aa-0484-42cee3876a05@denninger.net> To: Karl Denninger X-Mailer: Apple Mail (2.3445.102.3) X-Rspamd-Queue-Id: 69F0B712E6 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dmarc=pass (policy=none) header.from=sarenet.es; spf=pass (mx1.freebsd.org: domain of borjam@sarenet.es designates 195.16.151.151 as permitted sender) smtp.mailfrom=borjam@sarenet.es X-Spamd-Result: default: False [-3.63 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:195.16.150.0/23]; MV_CASE(0.50)[]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_LAST(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MX_GOOD(-0.01)[smtp.sarenet.es,smtp.sarenet.es,smtp.sarenet.es]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[151.151.16.195.list.dnswl.org : 127.0.10.0]; NEURAL_HAM_SHORT(-0.76)[-0.764,0]; DMARC_POLICY_ALLOW(-0.50)[sarenet.es,none]; IP_SCORE(-0.56)[ip: (-1.85), ipnet: 195.16.128.0/19(-0.55), asn: 3262(-0.44), country: ES(0.05)]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:3262, ipnet:195.16.128.0/19, country:ES]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 06 Feb 2019 15:18:51 -0000 > On 5 Feb 2019, at 23:49, Karl Denninger wrote: >=20 > BTW under 12.0-STABLE (built this afternoon after the advisories came > out, with the patches) it's MUCH worse. I get the same device resets > BUT it's followed by an immediate panic which I cannot dump as it > generates a page-fault (supervisor read data, page not present) in the > mps *driver* at mpssas_send_abort+0x21. > This precludes a dump of course since attempting to do so gives you a > double-panic (I was wondering why I didn't get a crash dump!); I'll > re-jigger the box to stick a dump device on an internal SATA device so = I > can successfully get the dump when it happens and see if I can obtain = a > proper crash dump on this. >=20 > I think it's fair to assume that 12.0-STABLE should not panic on a = disk > problem (unless of course the problem is trying to page something back > in -- it's not, the drive that aborts and resets is on a data pack = doing > a scrub) It shouldn=E2=80=99t panic I imagine. >>>> mps0: Sending reset from mpssas_send_abort for target ID 37 >> 0x06 =3D=3D=3D=3D=3D =3D =3D =3D=3D=3D =3D=3D = Transport Statistics (rev 1) =3D=3D >> 0x06 0x008 4 6 --- Number of Hardware Resets >> 0x06 0x010 4 0 --- Number of ASR Events >> 0x06 0x018 4 0 --- Number of Interface CRC Errors >> |||_ C monitored condition met >> ||__ D supports DSN >> |___ N normalized value >>=20 >> 0x06 0x008 4 7 --- Number of Hardware Resets >> 0x06 0x010 4 0 --- Number of ASR Events >> 0x06 0x018 4 0 --- Number of Interface CRC Errors >> |||_ C monitored condition met >> ||__ D supports DSN >> |___ N normalized value >>=20 >> Number of Hardware Resets has incremented. There are no other errors = shown: What is _exactly_ that value? Is it related to the number of resets sent = from the HBA _or_ the device resetting by itself? >> I'd throw possible shade at the backplane or cable /but I have = already >> swapped both out for spares without any change in behavior./ What about the power supply?=20 Borja. From owner-freebsd-stable@freebsd.org Wed Feb 6 15:19:23 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8576014D67AF; Wed, 6 Feb 2019 15:19:23 +0000 (UTC) (envelope-from king.c.david@googlemail.com) Received: from mail-lf1-x141.google.com (mail-lf1-x141.google.com [IPv6:2a00:1450:4864:20::141]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 1857371329; Wed, 6 Feb 2019 15:19:22 +0000 (UTC) (envelope-from king.c.david@googlemail.com) Received: by mail-lf1-x141.google.com with SMTP id l142so5653764lfe.2; Wed, 06 Feb 2019 07:19:22 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=MX6F//+vnTfAMTbqIBnkUA2aCeR7Ba1341kddZZ8sv0=; b=Pxx1ekyoGO478e6VHsxBGKqll/zdRxyD6izUb0I9m8l92lgIfgHdvoypPfCDbcZfmE uUC1lToWOKMHePMROHFZD5eByZPKMcEm5zCWK7iGjcQlVvEEd8yvniG6m3vRt4QQZIUG SFkdA4ufuMGs7Y8PlkzB/pfRR3fB2FIEDpwHn02DkHeIBCDvNaUcOUa7nGMGgK6M+mOY CRhfPC+PMhLg7IF7DC96aPrlhDKumc9eJXL6qolApPhTP/9Ew/VXHJYBuNUfSDaXozWd C0jYoePi/LfHc/TZSpIo9DN2J8tCV9QhCCNwT15ITNx+0bkOQlagEGvfTPBC/FxrCU7l a/yg== X-Gm-Message-State: AHQUAuZhASDg5SmVI/GqetDm7zDEvEjmTSEot9WLXAjbL0ypnQF8Pdaj bxbcCHpm94ke3Rk6/5Q1esqp9qnONR5upHgyqhcaBNYJ X-Google-Smtp-Source: AHgI3IYn8mEw+H8d9GQJalZpEiwkt6tJksD2ODDdQ1zhgeaEEOT6TlYez9y2nP4KyhmpmdltUR/rBy7YW85EdYxoMvM= X-Received: by 2002:a19:4948:: with SMTP id l8mr7372768lfj.156.1549466360491; Wed, 06 Feb 2019 07:19:20 -0800 (PST) MIME-Version: 1.0 References: <1549461051.318520353.gg4fwwj8@frv39.fwdcdn.com> In-Reply-To: <1549461051.318520353.gg4fwwj8@frv39.fwdcdn.com> From: David King Date: Wed, 6 Feb 2019 15:18:44 +0000 Message-ID: Subject: Re: Request for more intelligent local port allocation algorithm To: Paul Cc: freebsd-net@freebsd.org, freebsd-stable@freebsd.org X-Rspamd-Queue-Id: 1857371329 X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.65 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.997,0]; R_DKIM_ALLOW(-0.20)[googlemail.com:s=20161025]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; FREEMAIL_FROM(0.00)[googlemail.com]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; RCVD_TLS_LAST(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; TO_DN_SOME(0.00)[]; NEURAL_HAM_SHORT(-0.31)[-0.307,0]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[googlemail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[1.4.1.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.5.4.1.0.0.a.2.list.dnswl.org : 127.0.5.0]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; IP_SCORE(-0.34)[ip: (2.66), ipnet: 2a00:1450::/32(-2.30), asn: 15169(-1.96), country: US(-0.07)]; FREEMAIL_TO(0.00)[ukr.net]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; TAGGED_FROM(0.00)[]; RCVD_COUNT_TWO(0.00)[2] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 06 Feb 2019 15:19:23 -0000 Just to add to this, if anyone is doing some work on the outbound tcp connection, could they also have a look at the bug here https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=210726 Thanks! On Wed, 6 Feb 2019 at 15:15, Paul wrote: > Hi dev team, > > It's not a secret that when application is trying to establish new TCP > connection, without > first binding a socket to specific local interface address, OS handles > that automatically. > Unfortunately there is a catch, that lies in a different logic of local > port allocation: > (1) when socket is bound before connect() vs (2) when it is not. When > allocating the port > in in_pcb_lport() by checking whether different ports are free, using > in_pcblookup_local(), > the behaviour is following: > > (1) Bound, ie laddr is assigned with specific address: > Port is considered occupied only if there is a PCBs that matches both > laddr and lport > > (2) Not bound, ie laddr == INADDR_ANY: > Port is considered occupied if there is any PCBs that only matches > lport. What this > means is that in order to allocate a port none of the all available > local addresses > should have it allocated, even though this requirement is ridiculous, > since we are > allocating only one PCB > > Looking though the code, it seems that (2) is due to the fact that > tcp_connect() first > allocates the port, indirectly through the call to in_pcbbind() and only > then allocates > the actual local address, also indirectly, though the call to > in_pcbconnect_setup(), that > in turn calls in_pcbladdr(). So, probably, in order to guarantee that > in_pcbconnect_setup() > will not fail we make sure that all range of local addresses are > available, no matter > which one of them is actually selected by in_pcbladdr()? > > In real world, this creates serious problems for servers that have a lot > of outgoing > connections, for example nginx proxy with a lot of open HTTP2 connections. > In order to > avoid this limitation we have created workarounds within the nginx config > as well as > within our own software, basically by having 50 local addresses and only > following the > scenario (1). Alas, all of the built-in Unix utilities as well as other > software always > follow scenario (2). As the result given large number of connections there > may be points > in time, when whole range of ports is occupied by at least one local > address. Even worse is > the outcome of such condition: when in_pcb_lport() travels over the range > of possible port > numbers, making myriad of calls to in_pcblookup_local(), some kind of > important lock is > being held withing the kernel. So important that it leads to a complete > lock of the system. > Even the direct terminal access is not available: it is not responsive. > The more calls to > connect through scenario (2) there are the longer it takes the system to > unfreeze. Given > some circumstances, the only option is hard reset. > > Is it possible to somehow update the code that does connect via scenario > (2) to enable > more intelligent port allocation, like for example allocating local > address and port simultaneously > > _______________________________________________ > freebsd-stable@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" > From owner-freebsd-stable@freebsd.org Wed Feb 6 15:34:49 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B228C14D6FEE for ; Wed, 6 Feb 2019 15:34:49 +0000 (UTC) (envelope-from karl@denninger.net) Received: from colo1.denninger.net (colo1.denninger.net [104.236.120.189]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id C023A71E78 for ; Wed, 6 Feb 2019 15:34:48 +0000 (UTC) (envelope-from karl@denninger.net) Received: from denninger.net (ip68-1-57-197.pn.at.cox.net [68.1.57.197]) by colo1.denninger.net (Postfix) with ESMTP id 1FA722110B7 for ; Wed, 6 Feb 2019 10:34:10 -0500 (EST) Received: from [192.168.10.21] (D11.Denninger.Net [192.168.10.21]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by denninger.net (Postfix) with ESMTPSA id 306FC581A22 for ; Wed, 6 Feb 2019 09:34:10 -0600 (CST) Subject: Re: 9211 (LSI/SAS) issues on 11.2-STABLE To: freebsd-stable@freebsd.org References: <7bb25f55-fa77-f67e-11f3-b2240b01e25a@denninger.net> <9ea70420-0c06-ad9d-e8b7-f9d92fed20d8@denninger.net> <57ddc2f4-681c-e0aa-0484-42cee3876a05@denninger.net> <1FFC1686-E70F-4649-B170-34F90B773918@sarenet.es> From: Karl Denninger Openpgp: preference=signencrypt Autocrypt: addr=karl@denninger.net; prefer-encrypt=mutual; keydata= mQINBFIX1zsBEADRcJfsQUl9oFeoMfLPJ1kql+3sIaYx0MfJAUhV9LnbWxr0fsWCskM1O4cV tHm5dqPkuPM4Ztc0jLotD1i9ubWvCHOlkLGxFOL+pFbjA+XZ7VKsC/xWmhMwJ3cM8HavK2OV SzEWQ/AEYtMi04IzGSwsxh/5/5R0mPHrsIomV5SbuiI0vjLuDj7fo6146AABI1ULzge4hBYW i/SHrqUrLORmUNBs6bxek79/B0Dzk5cIktD3LOfbT9EAa5J/osVkstMBhToJgQttaMIGv8SG CzpR/HwEokE+7DP+k2mLHnLj6H3kfugOF9pJH8Za4yFmw//s9cPXV8WwtZ2SKfVzn1unpKqf wmJ1PwJoom/d4fGvQDkgkGKRa6RGC6tPmXnqnx+YX4iCOdFfbP8L9rmk2sewDDVzHDU3I3ZZ 8hFIjMYM/QXXYszRatK0LCV0QPZuF7LCf4uQVKw1/oyJInsnH7+6a3c0h21x+CmSja9QJ+y0 yzgEN/nM89d6YTakfR+1xkYgodVmMy/bS8kmXbUUZG/CyeqCqc95RUySjKT2ECrf9GhhoQkl +D8n2MsrAUSMGB4GQSN+TIq9OBTpNuvATGSRuF9wnQcs1iSry+JNCpfRTyWp83uCNApe6oHU EET4Et6KDO3AvjvBMAX0TInTRGW2SQlJMuFKpc7Dg7tHK8zzqQARAQABtCNLYXJsIERlbm5p bmdlciA8a2FybEBkZW5uaW5nZXIubmV0PokCPAQTAQIAJgUCUhfXOwIbIwUJCWYBgAYLCQgH AwIEFQIIAwQWAgMBAh4BAheAAAoJEG6/sivc5s0PLxQP/i6x/QFx9G4Cw7C+LthhLXIm7NSH AtNbz2UjySEx2qkoQQjtsK6mcpEEaky4ky6t8gz0/SifIfJmSmyAx0UhUQ0WBv1vAXwtNrQQ jJd9Bj6l4c2083WaXyHPjt2u2Na6YFowyb4SaQb83hu/Zs25vkPQYJVVE0JX409MFVPUa6E3 zFbd1OTr3T4yNUy4gNeQZfzDqDS8slbIks2sXeoJrZ6qqXVI0ionoivOlaN4T6Q0UYyXtigj dQvvhMt0aNowKFjRqrmSDRpdz+o6yg7Mp7qEZ1V6EZk8KqQTH6htpCTQ8i79ttK4LG6bstSF Re6Fwq52nbrcANrcdmtZXqjo+SGbUqJ8b1ggrxAsJ5MEhRh2peKrCgI/TjQo+ZxfnqEoR4AI 46Cyiz+/lcVvlvmf2iPifS3EEdaH3Itfwt7MxFm6mQORYs6skHDw3tOYB2/AdCW6eRVYs2hB RMAG4uwApZfZDKgRoE95PJmQjeTBiGmRPcsQZtNESe7I7EjHtCDLwtJqvD4HkDDQwpzreT6W XkyIJ7ns7zDfA1E+AQhFR6rsTFGgQZRZKsVeov3SbhYKkCnVDCvb/PKQCAGkSZM9SvYG5Yax 8CMry3AefKktf9fqBFg8pWqtVxDwJr56dhi0GHXRu3jVI995rMGo1fLUG5fSxiZ8L5sAtokh 9WFmQpyl Message-ID: <76c295f5-fc2b-2c9f-78b1-163939afb24a@denninger.net> Date: Wed, 6 Feb 2019 09:34:10 -0600 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:60.0) Gecko/20100101 Thunderbird/60.5.0 MIME-Version: 1.0 In-Reply-To: <1FFC1686-E70F-4649-B170-34F90B773918@sarenet.es> Content-Type: multipart/signed; protocol="application/pkcs7-signature"; micalg=sha-512; boundary="------------ms090408070206030201050706" X-Rspamd-Queue-Id: C023A71E78 X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-6.43 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; HAS_ATTACHMENT(0.00)[]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; MX_GOOD(-0.01)[px.denninger.net]; NEURAL_HAM_SHORT(-0.97)[-0.968,0]; FROM_EQ_ENVFROM(0.00)[]; IP_SCORE(-2.25)[ip: (-9.88), ipnet: 104.236.64.0/18(-3.91), asn: 14061(2.62), country: US(-0.07)]; R_DKIM_NA(0.00)[]; ASN(0.00)[asn:14061, ipnet:104.236.64.0/18, country:US]; MIME_TRACE(0.00)[0:+,1:+,2:+]; MID_RHS_MATCH_FROM(0.00)[]; RECEIVED_SPAMHAUS_PBL(0.00)[197.57.1.68.zen.spamhaus.org : 127.0.0.11]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; SIGNED_SMIME(-2.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.20)[multipart/signed,multipart/alternative,text/plain]; RCVD_TLS_LAST(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; AUTH_NA(1.00)[]; RCPT_COUNT_ONE(0.00)[1]; DMARC_NA(0.00)[denninger.net]; R_SPF_NA(0.00)[] X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 06 Feb 2019 15:34:50 -0000 This is a cryptographically signed message in MIME format. --------------ms090408070206030201050706 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable On 2/6/2019 09:18, Borja Marcos wrote: >> On 5 Feb 2019, at 23:49, Karl Denninger wrote: >> >> BTW under 12.0-STABLE (built this afternoon after the advisories came >> out, with the patches) it's MUCH worse. I get the same device resets >> BUT it's followed by an immediate panic which I cannot dump as it >> generates a page-fault (supervisor read data, page not present) in the= >> mps *driver* at mpssas_send_abort+0x21. >> This precludes a dump of course since attempting to do so gives you a >> double-panic (I was wondering why I didn't get a crash dump!); I'll >> re-jigger the box to stick a dump device on an internal SATA device so= I >> can successfully get the dump when it happens and see if I can obtain = a >> proper crash dump on this. >> >> I think it's fair to assume that 12.0-STABLE should not panic on a dis= k >> problem (unless of course the problem is trying to page something back= >> in -- it's not, the drive that aborts and resets is on a data pack doi= ng >> a scrub) > It shouldn=E2=80=99t panic I imagine. > >>>>> mps0: Sending reset from mpssas_send_abort for target ID 37 > >>> 0x06 =3D=3D=3D=3D=3D =3D =3D =3D=3D=3D =3D=3D Trans= port Statistics (rev 1) =3D=3D >>> 0x06 0x008 4 6 --- Number of Hardware Resets >>> 0x06 0x010 4 0 --- Number of ASR Events >>> 0x06 0x018 4 0 --- Number of Interface CRC Errors >>> |||_ C monitored condition met >>> ||__ D supports DSN >>> |___ N normalized value >>> >>> 0x06 0x008 4 7 --- Number of Hardware Resets >>> 0x06 0x010 4 0 --- Number of ASR Events >>> 0x06 0x018 4 0 --- Number of Interface CRC Errors >>> |||_ C monitored condition met >>> ||__ D supports DSN >>> |___ N normalized value >>> >>> Number of Hardware Resets has incremented. There are no other errors= shown: > What is _exactly_ that value? Is it related to the number of resets sen= t from the HBA > _or_ the device resetting by itself? Good question.=C2=A0 What counts as a "reset"; UNIT ATTENTION is what the= controller receives but whether that's a power reset, a reset *command* from the HBA or a firmware crash (yikes!) in the disk I'm not certain. >>> I'd throw possible shade at the backplane or cable /but I have alread= y >>> swapped both out for spares without any change in behavior./ > What about the power supply?=20 > There are multiple other devices and the system board on that supply (and thus voltage rails) but it too has been swapped out without change.=C2=A0 In fact at this point other than the system board and RAM (which is ECC, and is showing no errors in the system's BMC log) /everything /in the server case (HBA, SATA expander, backplane, power supply and cables) has been swapped for spares.=C2=A0 No change in behavi= or. Note that with 20.0.7.0 firmware in the HBA instead of a unit attention I get a *controller* reset (!!!) which detaches some random number of devices from ZFS's point of view before it comes back up (depending on what's active at the time) which is potentially catastrophic if it hits the system pool.=C2=A0 I immediately went back to 19.0.0.0 firmware on th= e HBA; I had upgraded to 20.0.7.0 since there had been good reports of stability with it when I first saw this, thinking there was a drive change that might have resulted in issues with it when running 19.0 firmware on the card. This system was completely stable for over a year on 11.1-STABLE and in fact hadn't been rebooted or logged a single "event" in over six months; the problems started immediately upon upgrade to 11.2-STABLE and persists on 12.0-STABLE.=C2=A0 The disks in question haven't changed eith= er (so it can't be a difference in firmware that is in a newer purchased disk, for example.) I'm thinking perhaps *something* in the codebase change made the HBA -> SAS Expander combination trouble where it wasn't before; I've got a couple of 16i HBAs on the way which will allow me to remove the SAS expander to see if that causes the problem to disappear.=C2=A0 I've got a= bunch of these Lenovo expanders and have been using them without any sort of trouble in multiple machines; it's only when I went beyond 11.1 that I started having trouble with them. --=20 Karl Denninger karl@denninger.net /The Market Ticker/ /[S/MIME encrypted email preferred]/ --------------ms090408070206030201050706 Content-Type: application/pkcs7-signature; name="smime.p7s" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="smime.p7s" Content-Description: S/MIME Cryptographic Signature MIAGCSqGSIb3DQEHAqCAMIACAQExDzANBglghkgBZQMEAgMFADCABgkqhkiG9w0BBwEAAKCC DdgwggagMIIEiKADAgECAhMA5EiKghDOXrvfxYxjITXYDdhIMA0GCSqGSIb3DQEBCwUAMIGL MQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTESMBAGA1UEBwwJTmljZXZpbGxlMRkw FwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5c3RlbXMgQ0ExITAf BgNVBAMMGEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBDQTAeFw0xNzA4MTcxNjQyMTdaFw0yNzA4 MTUxNjQyMTdaMHsxCzAJBgNVBAYTAlVTMRAwDgYDVQQIDAdGbG9yaWRhMRkwFwYDVQQKDBBD dWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5c3RlbXMgQ0ExJTAjBgNVBAMMHEN1 ZGEgU3lzdGVtcyBMTEMgMjAxNyBJbnQgQ0EwggIiMA0GCSqGSIb3DQEBAQUAA4ICDwAwggIK AoICAQC1aJotNUI+W4jP7xQDO8L/b4XiF4Rss9O0B+3vMH7Njk85fZ052QhZpMVlpaaO+sCI KqG3oNEbuOHzJB/NDJFnqh7ijBwhdWutdsq23Ux6TvxgakyMPpT6TRNEJzcBVQA0kpby1DVD 0EKSK/FrWWBiFmSxg7qUfmIq/mMzgE6epHktyRM3OGq3dbRdOUgfumWrqHXOrdJz06xE9NzY vc9toqZnd79FUtE/nSZVm1VS3Grq7RKV65onvX3QOW4W1ldEHwggaZxgWGNiR/D4eosAGFxn uYeWlKEC70c99Mp1giWux+7ur6hc2E+AaTGh+fGeijO5q40OGd+dNMgK8Es0nDRw81lRcl24 SWUEky9y8DArgIFlRd6d3ZYwgc1DMTWkTavx3ZpASp5TWih6yI8ACwboTvlUYeooMsPtNa9E 6UQ1nt7VEi5syjxnDltbEFoLYcXBcqhRhFETJe9CdenItAHAtOya3w5+fmC2j/xJz29og1KH YqWHlo3Kswi9G77an+zh6nWkMuHs+03DU8DaOEWzZEav3lVD4u76bKRDTbhh0bMAk4eXriGL h4MUoX3Imfcr6JoyheVrAdHDL/BixbMH1UUspeRuqQMQ5b2T6pabXP0oOB4FqldWiDgJBGRd zWLgCYG8wPGJGYgHibl5rFiI5Ix3FQncipc6SdUzOQIDAQABo4IBCjCCAQYwHQYDVR0OBBYE FF3AXsKnjdPND5+bxVECGKtc047PMIHABgNVHSMEgbgwgbWAFBu1oRhUMNEzjODolDka5k4Q EDBioYGRpIGOMIGLMQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTESMBAGA1UEBwwJ TmljZXZpbGxlMRkwFwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5 c3RlbXMgQ0ExITAfBgNVBAMMGEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBDQYIJAKxAy1WBo2kY MBIGA1UdEwEB/wQIMAYBAf8CAQAwDgYDVR0PAQH/BAQDAgGGMA0GCSqGSIb3DQEBCwUAA4IC AQCB5686UCBVIT52jO3sz9pKuhxuC2npi8ZvoBwt/IH9piPA15/CGF1XeXUdu2qmhOjHkVLN gO7XB1G8CuluxofOIUce0aZGyB+vZ1ylHXlMeB0R82f5dz3/T7RQso55Y2Vog2Zb7PYTC5B9 oNy3ylsnNLzanYlcW3AAfzZcbxYuAdnuq0Im3EpGm8DoItUcf1pDezugKm/yKtNtY6sDyENj tExZ377cYA3IdIwqn1Mh4OAT/Rmh8au2rZAo0+bMYBy9C11Ex0hQ8zWcvPZBDn4v4RtO8g+K uQZQcJnO09LJNtw94W3d2mj4a7XrsKMnZKvm6W9BJIQ4Nmht4wXAtPQ1xA+QpxPTmsGAU0Cv HmqVC7XC3qxFhaOrD2dsvOAK6Sn3MEpH/YrfYCX7a7cz5zW3DsJQ6o3pYfnnQz+hnwLlz4MK 17NIA0WOdAF9IbtQqarf44+PEyUbKtz1r0KGeGLs+VGdd2FLA0e7yuzxJDYcaBTVwqaHhU2/ Fna/jGU7BhrKHtJbb/XlLeFJ24yvuiYKpYWQSSyZu1R/gvZjHeGb344jGBsZdCDrdxtQQcVA 6OxsMAPSUPMrlg9LWELEEYnVulQJerWxpUecGH92O06wwmPgykkz//UmmgjVSh7ErNvL0lUY UMfunYVO/O5hwhW+P4gviCXzBFeTtDZH259O7TCCBzAwggUYoAMCAQICEwCg0WvVwekjGFiO 62SckFwepz0wDQYJKoZIhvcNAQELBQAwezELMAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3Jp ZGExGTAXBgNVBAoMEEN1ZGEgU3lzdGVtcyBMTEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBD QTElMCMGA1UEAwwcQ3VkYSBTeXN0ZW1zIExMQyAyMDE3IEludCBDQTAeFw0xNzA4MTcyMTIx MjBaFw0yMjA4MTYyMTIxMjBaMFcxCzAJBgNVBAYTAlVTMRAwDgYDVQQIDAdGbG9yaWRhMRkw FwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRswGQYDVQQDDBJrYXJsQGRlbm5pbmdlci5uZXQw ggIiMA0GCSqGSIb3DQEBAQUAA4ICDwAwggIKAoICAQC+HVSyxVtJhy3Ohs+PAGRuO//Dha9A 16l5FPATr6wude9zjX5f2lrkRyU8vhCXTZW7WbvWZKpcZ8r0dtZmiK9uF58Ec6hhvfkxJzbg 96WHBw5Fumd5ahZzuCJDtCAWW8R7/KN+zwzQf1+B3MVLmbaXAFBuKzySKhKMcHbK3/wjUYTg y+3UK6v2SBrowvkUBC+jxNg3Wy12GsTXcUS/8FYIXgVVPgfZZrbJJb5HWOQpvvhILpPCD3xs YJFNKEPltXKWHT7Qtc2HNqikgNwj8oqOb+PeZGMiWapsatKm8mxuOOGOEBhAoTVTwUHlMNTg 6QUCJtuWFCK38qOCyk9Haj+86lUU8RG6FkRXWgMbNQm1mWREQhw3axgGLSntjjnznJr5vsvX SYR6c+XKLd5KQZcS6LL8FHYNjqVKHBYM+hDnrTZMqa20JLAF1YagutDiMRURU23iWS7bA9tM cXcqkclTSDtFtxahRifXRI7Epq2GSKuEXe/1Tfb5CE8QsbCpGsfSwv2tZ/SpqVG08MdRiXxN 5tmZiQWo15IyWoeKOXl/hKxA9KPuDHngXX022b1ly+5ZOZbxBAZZMod4y4b4FiRUhRI97r9l CxsP/EPHuuTIZ82BYhrhbtab8HuRo2ofne2TfAWY2BlA7ExM8XShMd9bRPZrNTokPQPUCWCg CdIATQIDAQABo4IBzzCCAcswPAYIKwYBBQUHAQEEMDAuMCwGCCsGAQUFBzABhiBodHRwOi8v b2NzcC5jdWRhc3lzdGVtcy5uZXQ6ODg4ODAJBgNVHRMEAjAAMBEGCWCGSAGG+EIBAQQEAwIF oDAOBgNVHQ8BAf8EBAMCBeAwHQYDVR0lBBYwFAYIKwYBBQUHAwIGCCsGAQUFBwMEMDMGCWCG SAGG+EIBDQQmFiRPcGVuU1NMIEdlbmVyYXRlZCBDbGllbnQgQ2VydGlmaWNhdGUwHQYDVR0O BBYEFLElmNWeVgsBPe7O8NiBzjvjYnpRMIHKBgNVHSMEgcIwgb+AFF3AXsKnjdPND5+bxVEC GKtc047PoYGRpIGOMIGLMQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTESMBAGA1UE BwwJTmljZXZpbGxlMRkwFwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRh IFN5c3RlbXMgQ0ExITAfBgNVBAMMGEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBDQYITAORIioIQ zl6738WMYyE12A3YSDAdBgNVHREEFjAUgRJrYXJsQGRlbm5pbmdlci5uZXQwDQYJKoZIhvcN AQELBQADggIBAJXboPFBMLMtaiUt4KEtJCXlHO/3ZzIUIw/eobWFMdhe7M4+0u3te0sr77QR dcPKR0UeHffvpth2Mb3h28WfN0FmJmLwJk+pOx4u6uO3O0E1jNXoKh8fVcL4KU79oEQyYkbu 2HwbXBU9HbldPOOZDnPLi0whi/sbFHdyd4/w/NmnPgzAsQNZ2BYT9uBNr+jZw4SsluQzXG1X lFL/qCBoi1N2mqKPIepfGYF6drbr1RnXEJJsuD+NILLooTNf7PMgHPZ4VSWQXLNeFfygoOOK FiO0qfxPKpDMA+FHa8yNjAJZAgdJX5Mm1kbqipvb+r/H1UAmrzGMbhmf1gConsT5f8KU4n3Q IM2sOpTQe7BoVKlQM/fpQi6aBzu67M1iF1WtODpa5QUPvj1etaK+R3eYBzi4DIbCIWst8MdA 1+fEeKJFvMEZQONpkCwrJ+tJEuGQmjoQZgK1HeloepF0WDcviiho5FlgtAij+iBPtwMuuLiL shAXA5afMX1hYM4l11JXntle12EQFP1r6wOUkpOdxceCcMVDEJBBCHW2ZmdEaXgAm1VU+fnQ qS/wNw/S0X3RJT1qjr5uVlp2Y0auG/eG0jy6TT0KzTJeR9tLSDXprYkN2l/Qf7/nT6Q03qyE QnnKiBXWAZXveafyU/zYa7t3PTWFQGgWoC4w6XqgPo4KV44OMYIFBzCCBQMCAQEwgZIwezEL MAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3JpZGExGTAXBgNVBAoMEEN1ZGEgU3lzdGVtcyBM TEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBDQTElMCMGA1UEAwwcQ3VkYSBTeXN0ZW1zIExM QyAyMDE3IEludCBDQQITAKDRa9XB6SMYWI7rZJyQXB6nPTANBglghkgBZQMEAgMFAKCCAkUw GAYJKoZIhvcNAQkDMQsGCSqGSIb3DQEHATAcBgkqhkiG9w0BCQUxDxcNMTkwMjA2MTUzNDEw WjBPBgkqhkiG9w0BCQQxQgRA4N+IkEeaYlMQQBammZDI85N7PPn96QNOISquLsHtpDLlIsag 78vM4FRPA/sJ0Qg49FlmCaNXMqIJDfJuHgMUkjBsBgkqhkiG9w0BCQ8xXzBdMAsGCWCGSAFl AwQBKjALBglghkgBZQMEAQIwCgYIKoZIhvcNAwcwDgYIKoZIhvcNAwICAgCAMA0GCCqGSIb3 DQMCAgFAMAcGBSsOAwIHMA0GCCqGSIb3DQMCAgEoMIGjBgkrBgEEAYI3EAQxgZUwgZIwezEL MAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3JpZGExGTAXBgNVBAoMEEN1ZGEgU3lzdGVtcyBM TEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBDQTElMCMGA1UEAwwcQ3VkYSBTeXN0ZW1zIExM QyAyMDE3IEludCBDQQITAKDRa9XB6SMYWI7rZJyQXB6nPTCBpQYLKoZIhvcNAQkQAgsxgZWg gZIwezELMAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3JpZGExGTAXBgNVBAoMEEN1ZGEgU3lz dGVtcyBMTEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBDQTElMCMGA1UEAwwcQ3VkYSBTeXN0 ZW1zIExMQyAyMDE3IEludCBDQQITAKDRa9XB6SMYWI7rZJyQXB6nPTANBgkqhkiG9w0BAQEF AASCAgAhMubAE1EE8sx17lP3W5JOg/Ka5j9508aE+nraCu0R+4VEKX42cn7kqi0lxKC4Oyt6 dqQ9fo1JF08JOQX3IUxrFFbFQvx2rHKoiWqPIxxlYGL5l5nJVvEWKNorOCBHXOx6L5bZjKO/ JLErYpcxLwDdRPDQVkQpYp+IMw/5Gd6R80TzYs1EvJRypKbuuaEBneCG4EawWFWONshs9GVl Un4urvGs1p5TRIkvKNf1BJv1eAzDiEszmaHeVcQUt3goaq6iZEmCKyvBpqbAixLwtPkSWWXL Wbbdq9lUfBtYekTOJ2/SaeQKn5dv1NJNTySRYai30OCDlEtgqOGGd7+Y9+TPe+0C9eJk6qC2 X5C2uLO/nHtoblpQSQvuizU/KUJMYhjwJXvH8U0vfp7+NiKs0fNElxKYSLk0lJ1l7zkszxBj /Ss5vPv9+i6UavRyJR5pPkHZPUoxxxjwILphjM/AK++SS+iNRU6xgS2QddPacPj+vmA80TpH Iz5/lYm/cpTT7X2qtID1PAUwSP617SHi87oe5EexTz+2KTfDQaMKCFWYuPoYxuWj8h1EcYRW Nsi7x9ROLd0aOeFzACP4D2utaPKyi6vLJhXCoxI2i5qPoiJYvm8p9CvNoUipBM+oZ6bpBsvm uaJjlg9B7sqH82VrdRVfB5YTLmC/aEFC6r5rEXwZ+wAAAAAAAA== --------------ms090408070206030201050706-- From owner-freebsd-stable@freebsd.org Thu Feb 7 00:28:43 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 76AAF14B485C for ; Thu, 7 Feb 2019 00:28:43 +0000 (UTC) (envelope-from lyndon@orthanc.ca) Received: from orthanc.ca (orthanc.ca [208.79.93.154]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "orthanc.ca", Issuer "Let's Encrypt Authority X3" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 839898B92A for ; Thu, 7 Feb 2019 00:28:41 +0000 (UTC) (envelope-from lyndon@orthanc.ca) Received: from orthanc.ca (localhost [127.0.0.1]) by orthanc.ca (OpenSMTPD) with ESMTP id 10d12763 for ; Wed, 6 Feb 2019 16:28:26 -0800 (PST) From: Lyndon Nerenberg To: freebsd-stable@freebsd.org Subject: Intel Xeon D-2146NT SoC Support MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-ID: <62520.1549499306.1@orthanc.ca> Date: Wed, 06 Feb 2019 16:28:26 -0800 Message-Id: <42acb2d4e51fe182@orthanc.ca> X-Rspamd-Queue-Id: 839898B92A X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; spf=pass (mx1.freebsd.org: domain of lyndon@orthanc.ca designates 208.79.93.154 as permitted sender) smtp.mailfrom=lyndon@orthanc.ca X-Spamd-Result: default: False [-2.36 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.86)[-0.856,0]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:208.79.93.154]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-0.93)[-0.931,0]; RCVD_TLS_LAST(0.00)[]; MX_GOOD(-0.01)[orthanc.ca]; NEURAL_HAM_SHORT(-0.17)[-0.170,0]; DMARC_NA(0.00)[orthanc.ca]; IP_SCORE(-0.10)[ipnet: 208.79.88.0/21(-0.08), asn: 25795(-0.33), country: US(-0.07)]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:25795, ipnet:208.79.88.0/21, country:US]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 07 Feb 2019 00:28:43 -0000 [ I asked this on -hardware but didn't get any responses, so I'm widening the scope a bit. ] We're looking a buying a Supermicro system with the X11SDV-8C-TP8F motherboard. This uses a Xeon D-2146NT SoC. It's not clear what the embedded chipset is, so it's proving a bit tricky to confirm whether or not the board will get along with 11.2. In particular, we need to ensure that we can talk to each of the 12 SATA ports as a standalone (JBOD) disk (this will be a ZFS fileserver), and that the SFP+ ports will run with 10 Gb/s optics. If anyone is running this board (or anything else running that D-2146NT chip) I'd appreciate hearing from you. FWIW, the system we're looking at is the SSG-5019D8-TR12P: https://www.supermicro.com/products/system/1U/5019/SSG-5019D8-TR12P.cfm Thanks! --lyndon From owner-freebsd-stable@freebsd.org Thu Feb 7 01:06:35 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 14B4614B6A8D for ; Thu, 7 Feb 2019 01:06:35 +0000 (UTC) (envelope-from darius@dons.net.au) Received: from ipmail03.adl6.internode.on.net (ipmail03.adl6.internode.on.net [150.101.137.143]) by mx1.freebsd.org (Postfix) with ESMTP id 846A48CF0A for ; Thu, 7 Feb 2019 01:06:24 +0000 (UTC) (envelope-from darius@dons.net.au) Received: from unknown (HELO midget.dons.net.au) ([14.2.75.22]) by ipmail03.adl6.internode.on.net with ESMTP; 07 Feb 2019 11:31:11 +1030 Received: from midget.dons.net.au (localhost [127.0.0.1]) by midget.dons.net.au (8.15.2/8.15.2) with ESMTPS id x1710sUr061868 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO) for ; Thu, 7 Feb 2019 11:31:05 +1030 (ACDT) (envelope-from darius@dons.net.au) Received: (from mailnull@localhost) by midget.dons.net.au (8.15.2/8.15.2/Submit) id x170k7CH051103 for ; Thu, 7 Feb 2019 11:16:07 +1030 (ACDT) (envelope-from darius@dons.net.au) X-Authentication-Warning: midget.dons.net.au: mailnull set sender to using -f Received: from [203.31.81.59] ([203.31.81.59]) by [14.2.75.22] (envelope-sender ) (MIMEDefang) with ESMTP id x170k0Gx051098; Thu, 07 Feb 2019 11:16:07 +1030 Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 12.2 \(3445.102.3\)) Subject: Re: Intel Xeon D-2146NT SoC Support From: "O'Connor, Daniel" In-Reply-To: <42acb2d4e51fe182@orthanc.ca> Date: Thu, 7 Feb 2019 11:17:06 +1030 Cc: freebsd-stable Content-Transfer-Encoding: quoted-printable Message-Id: <9EF903B3-1D3B-46A5-9772-A22E94C29FD9@dons.net.au> References: <42acb2d4e51fe182@orthanc.ca> To: Lyndon Nerenberg X-Mailer: Apple Mail (2.3445.102.3) X-Spam-Score: 1.3 (*) No, score=1.3 required=5.0 tests=HELO_MISC_IP, RDNS_NONE autolearn=no autolearn_force=no version=3.4.1 X-Scanned-By: MIMEDefang 2.83 on 10.0.2.1 X-Rspamd-Queue-Id: 846A48CF0A X-Spamd-Bar: ++++ Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [4.46 / 15.00]; ARC_NA(0.00)[]; RCVD_COUNT_FIVE(0.00)[5]; FROM_HAS_DN(0.00)[]; MV_CASE(0.50)[]; NEURAL_SPAM_SHORT(0.83)[0.831,0]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; HAS_XAW(0.00)[]; AUTH_NA(1.00)[]; DMARC_NA(0.00)[dons.net.au]; NEURAL_SPAM_MEDIUM(0.87)[0.869,0]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; MX_GOOD(-0.01)[midget.dons.net.au]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_SPAM_LONG(0.99)[0.987,0]; R_SPF_NA(0.00)[]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:4739, ipnet:150.101.0.0/16, country:AU]; MID_RHS_MATCH_FROM(0.00)[]; IP_SCORE(0.38)[ipnet: 150.101.0.0/16(1.55), asn: 4739(0.40), country: AU(-0.04)]; RCVD_IN_DNSWL_LOW(-0.10)[143.137.101.150.list.dnswl.org : 127.0.5.1] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 07 Feb 2019 01:06:35 -0000 > On 7 Feb 2019, at 10:58, Lyndon Nerenberg wrote: >=20 > [ I asked this on -hardware but didn't get any responses, so I'm > widening the scope a bit. ] >=20 > We're looking a buying a Supermicro system with the X11SDV-8C-TP8F > motherboard. This uses a Xeon D-2146NT SoC. It's not clear what > the embedded chipset is, so it's proving a bit tricky to confirm > whether or not the board will get along with 11.2. If you go to OS compatibility and then go Skylake-D SoC you get to = https://www.supermicro.com/support/resources/OS/skylake-d.cfm (This is not really obvious though! I looked up the CPU in ark.intel.com = to find its codename first..) It says FreeBSD 11 works but no 11.1, 11.2 or 12.0. Personally I suspect = they *do* work fine just they didn't bother to test them. I certainly would be very surprised if 11.2 *didn't* work if 11.0 did = (and it would be a regression and should be fixed) however it's not my = money so.. :) -- Daniel O'Connor "The nice thing about standards is that there are so many of them to choose from." -- Andrew Tanenbaum From owner-freebsd-stable@freebsd.org Thu Feb 7 11:51:17 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DD8C114D6CAA for ; Thu, 7 Feb 2019 11:51:16 +0000 (UTC) (envelope-from borjam@sarenet.es) Received: from cu1176c.smtpx.saremail.com (cu1176c.smtpx.saremail.com [195.16.148.151]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id AA9C08624A for ; Thu, 7 Feb 2019 11:51:15 +0000 (UTC) (envelope-from borjam@sarenet.es) Received: from [172.16.8.5] (unknown [192.148.167.11]) by proxypop02.sare.net (Postfix) with ESMTPA id 03F969DC632; Thu, 7 Feb 2019 12:51:04 +0100 (CET) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 12.2 \(3445.102.3\)) Subject: Re: 9211 (LSI/SAS) issues on 11.2-STABLE From: Borja Marcos In-Reply-To: <76c295f5-fc2b-2c9f-78b1-163939afb24a@denninger.net> Date: Thu, 7 Feb 2019 12:51:03 +0100 Cc: freebsd-stable@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <1CCD5D4C-BE41-49DE-AF87-40EBFA8038B1@sarenet.es> References: <7bb25f55-fa77-f67e-11f3-b2240b01e25a@denninger.net> <9ea70420-0c06-ad9d-e8b7-f9d92fed20d8@denninger.net> <57ddc2f4-681c-e0aa-0484-42cee3876a05@denninger.net> <1FFC1686-E70F-4649-B170-34F90B773918@sarenet.es> <76c295f5-fc2b-2c9f-78b1-163939afb24a@denninger.net> To: Karl Denninger X-Mailer: Apple Mail (2.3445.102.3) X-Rspamd-Queue-Id: AA9C08624A X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dmarc=pass (policy=none) header.from=sarenet.es; spf=pass (mx1.freebsd.org: domain of borjam@sarenet.es designates 195.16.148.151 as permitted sender) smtp.mailfrom=borjam@sarenet.es X-Spamd-Result: default: False [-3.27 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.999,0]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:195.16.148.0/24]; MV_CASE(0.50)[]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_LAST(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MX_GOOD(-0.01)[cached: smtp.sarenet.es]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[151.148.16.195.list.dnswl.org : 127.0.10.0]; NEURAL_HAM_SHORT(-0.61)[-0.605,0]; DMARC_POLICY_ALLOW(-0.50)[sarenet.es,none]; IP_SCORE(-0.36)[ipnet: 195.16.128.0/19(-1.02), asn: 3262(-0.82), country: ES(0.05)]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:3262, ipnet:195.16.128.0/19, country:ES]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 07 Feb 2019 11:51:17 -0000 > On 6 Feb 2019, at 16:34, Karl Denninger wrote: >=20 > On 2/6/2019 09:18, Borja Marcos wrote: >>>> Number of Hardware Resets has incremented. There are no other = errors shown: >> What is _exactly_ that value? Is it related to the number of resets = sent from the HBA >> _or_ the device resetting by itself? > Good question. What counts as a "reset"; UNIT ATTENTION is what the > controller receives but whether that's a power reset, a reset = *command* > from the HBA or a firmware crash (yikes!) in the disk I'm not certain. In my youth I wrote software for tape drives. After a reset, no matter = how it was initiated (the device itself or the HBA) the device will give you a UNIT = ATTENTION if I remember well (25 years ago).=20 >>>> I'd throw possible shade at the backplane or cable /but I have = already >>>> swapped both out for spares without any change in behavior./ >> What about the power supply?=20 >>=20 > There are multiple other devices and the system board on that supply > (and thus voltage rails) but it too has been swapped out without > change. In fact at this point other than the system board and RAM > (which is ECC, and is showing no errors in the system's BMC log) > /everything /in the server case (HBA, SATA expander, backplane, power > supply and cables) has been swapped for spares. No change in = behavior. >=20 > Note that with 20.0.7.0 firmware in the HBA instead of a unit = attention > I get a *controller* reset (!!!) which detaches some random number of > devices from ZFS's point of view before it comes back up (depending on > what's active at the time) which is potentially catastrophic if it = hits > the system pool. I immediately went back to 19.0.0.0 firmware on the > HBA; I had upgraded to 20.0.7.0 since there had been good reports of > stability with it when I first saw this, thinking there was a drive > change that might have resulted in issues with it when running 19.0 > firmware on the card. I have a system running 12.0-RELEASE-p1 with a LSI2008, 15 SAS disks and = a SATA SSD and I haven=E2=80=99t seen any problems. This is heavily loaded with = just 8 GB of memory and a lot of stuff running.=20 mps0: port 0x9000-0x90ff mem = 0xdfff0000-0xdff fffff,0xdff80000-0xdffbffff irq 17 at device 0.0 numa-domain 0 on pci4 mps0: Firmware: 20.00.07.00, Driver: 21.02.00.00-fbsd mps0: IOCCapabilities: = 185c ses0: Enclosure Name: LSILOGIC SASX28 A.0 5021 > This system was completely stable for over a year on 11.1-STABLE and = in > fact hadn't been rebooted or logged a single "event" in over six = months; > the problems started immediately upon upgrade to 11.2-STABLE and > persists on 12.0-STABLE. The disks in question haven't changed either > (so it can't be a difference in firmware that is in a newer purchased > disk, for example.) But you are right, a panic because of a disk problem points to a bug. As = long as the ZFS pool is usable, trouble with one of its disks should just be logged. = Unless of course the disk is used for swap or the disk failure leads to the system being = unable to=20 complete a page in. Again, it shouldn=E2=80=99t happen. > I'm thinking perhaps *something* in the codebase change made the HBA = -> > SAS Expander combination trouble where it wasn't before; I've got a > couple of 16i HBAs on the way which will allow me to remove the SAS > expander to see if that causes the problem to disappear. I've got a > bunch of these Lenovo expanders and have been using them without any > sort of trouble in multiple machines; it's only when I went beyond = 11.1 > that I started having trouble with them. It might be some backplane misbehavior triggering a bug, complicated. Borja. From owner-freebsd-stable@freebsd.org Thu Feb 7 19:43:51 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3A00314BF38D for ; Thu, 7 Feb 2019 19:43:51 +0000 (UTC) (envelope-from leslie@b2bglobedata.com) Received: from NEW-01-4.privateemail.com (new-02-4.privateemail.com [198.54.122.48]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "privateemail.com", Issuer "COMODO RSA Domain Validation Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 6EADC707AD for ; Thu, 7 Feb 2019 19:43:49 +0000 (UTC) (envelope-from leslie@b2bglobedata.com) Received: from NEW-02.privateemail.com (unknown [10.20.150.220]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by NEW-01-4.privateemail.com (Postfix) with ESMTPS id 3072B821BF for ; Thu, 7 Feb 2019 19:43:40 +0000 (UTC) Received: from MTA-09.privateemail.com (unknown [10.20.147.19]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by NEW-02.privateemail.com (Postfix) with ESMTPS id 2A42960C1C for ; Thu, 7 Feb 2019 19:43:40 +0000 (UTC) Received: from MTA-09.privateemail.com (localhost [127.0.0.1]) by MTA-09.privateemail.com (Postfix) with ESMTP id 17DEC60045 for ; Thu, 7 Feb 2019 14:43:40 -0500 (EST) Received: from DESKTOP9H8BFK9 (unknown [10.20.151.214]) by MTA-09.privateemail.com (Postfix) with ESMTPA id 59AA560043 for ; Thu, 7 Feb 2019 19:43:39 +0000 (UTC) From: "Leslie Long" To: Subject: Digital Signage Expo - DSE 2019 Attendee Portal Date: Thu, 7 Feb 2019 14:43:08 -0500 Message-ID: MIME-Version: 1.0 X-Mailer: Microsoft Outlook 15.0 Thread-Index: AdS/HU4R3wiJzMmWToWTeyvUysn4Iw== Content-Language: en-us X-Virus-Scanned: ClamAV using ClamSMTP X-Rspamd-Queue-Id: 6EADC707AD X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; spf=pass (mx1.freebsd.org: domain of leslie@b2bglobedata.com designates 198.54.122.48 as permitted sender) smtp.mailfrom=leslie@b2bglobedata.com X-Spamd-Result: default: False [-2.08 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCVD_COUNT_FIVE(0.00)[5]; NEURAL_HAM_MEDIUM(-0.98)[-0.980,0]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:198.54.122.32/27]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-0.98)[-0.981,0]; MANY_INVISIBLE_PARTS(0.30)[4]; RCVD_TLS_LAST(0.00)[]; MX_GOOD(-0.01)[mx2.privateemail.com,mx1.privateemail.com]; NEURAL_HAM_SHORT(-0.02)[-0.024,0]; DMARC_NA(0.00)[b2bglobedata.com]; IP_SCORE(-0.08)[ipnet: 198.54.122.0/24(-0.25), asn: 22612(-0.08), country: US(-0.07)]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+]; ASN(0.00)[asn:22612, ipnet:198.54.122.0/24, country:US]; MID_RHS_MATCH_FROM(0.00)[] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 07 Feb 2019 19:43:51 -0000 Dear Exhibitor, May we wish you every success in the forthcoming exhibition/expo? Digital Signage Expo - DSE 2019 Attendees list is available now, all the contacts include only permission-based opt-in information. Hence, you directly reach the right point of contact. We can accord the insights on an excel spread-sheet or whichever the format your CRM supports to send invitations and to run an effective marketing campaign before and after the show. Attendees : . decision-makers Attendee list fields include: Company Name, Website, Contact Name, Title, Contact Number, Mailing Address and Contact Person Verified Business Email Address etc. Information provided is for perpetual and unlimited usage including telemarketing, direct marketing and email marketing initiatives. Please let me know your thoughts and interest, So that I can send you the Exhibitor discount costs of the lists. Swift response would be appreciated. Regards Leslie Digital Signage Expo - DSE 2019 Attendees Specialist From owner-freebsd-stable@freebsd.org Thu Feb 7 19:45:57 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id AE1A314BF47D for ; Thu, 7 Feb 2019 19:45:57 +0000 (UTC) (envelope-from tina.johnson@blueskytechnosol.com) Received: from n1nlsmtp02.shr.prod.ams1.secureserver.net (n1nlsmtp02.prod.ams1.secureserver.net [188.121.43.194]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "relay-hosting.secureserver.net", Issuer "Starfield Secure Certificate Authority - G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id F2D4670873 for ; Thu, 7 Feb 2019 19:45:46 +0000 (UTC) (envelope-from tina.johnson@blueskytechnosol.com) Received: from n3plcpnl0260.prod.ams3.secureserver.net ([160.153.155.16]) by : HOSTING RELAY : with ESMTP id rpJ1gknYx3vHCrpJ1gkySP; Thu, 07 Feb 2019 12:25:51 -0700 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=blueskytechnosol.com; s=default; h=Content-Type:MIME-Version:Message-ID: Date:Subject:To:From:Sender:Reply-To:Cc:Content-Transfer-Encoding:Content-ID: Content-Description:Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc :Resent-Message-ID:In-Reply-To:References:List-Id:List-Help:List-Unsubscribe: List-Subscribe:List-Post:List-Owner:List-Archive; bh=4PGA/FzqsiEVkBVXvhVo6YEClmGXCB8vNePyRcTrEcU=; b=dZvjWq1XTqqUidhTWayg2KEeEC WB5qgYAdDe6rgbb9oz4FXvoixL7HPWCOCYvp+L0W5QhQMLssxMeZLzRDKERt+Nb4OW0ZU7tX9Zu+4 r5ERM61pIo9ktjY5pKbNytHMyJ3UPAA4e1v7tRb3MUoYXNv0hrYN5h5GrzuMKfzAM4RQz7HSp7zK2 oTPsakUf2sIOyb5qGrPtBVrqiwObd90mRjssIThuOEsqgDXp8On5PvTGHfzaO06/9YcVmCkt029zb o2/3eXjG3mkRFLfZZbwbFMwj99tSLcPxonV4DJ2p5TU99vORWM6yMpoQ6Z56EbUqxkNCCNOcbhNVT 9SuXCDeQ==; Received: from [184.95.45.20] (port=3053 helo=Dell5CWP4BS) by n3plcpnl0260.prod.ams3.secureserver.net with esmtpsa (TLSv1.2:ECDHE-RSA-AES256-SHA384:256) (Exim 4.91) (envelope-from ) id 1grpJ1-00EKwO-6W for freebsd-stable@freebsd.org; Thu, 07 Feb 2019 12:25:51 -0700 From: To: Subject: Your Medical Specialties Date: Thu, 7 Feb 2019 14:25:24 -0500 Message-ID: <008301d4bf1a$fbd6a4b0$f383ee10$@blueskytechnosol.com> MIME-Version: 1.0 X-Mailer: Microsoft Outlook 15.0 Thread-Index: AdS/Gt49NAZuM+C2Qb+kw96MmxM0nA== Content-Language: en-us X-AntiAbuse: This header was added to track abuse, please include it with any abuse report X-AntiAbuse: Primary Hostname - n3plcpnl0260.prod.ams3.secureserver.net X-AntiAbuse: Original Domain - freebsd.org X-AntiAbuse: Originator/Caller UID/GID - [47 12] / [47 12] X-AntiAbuse: Sender Address Domain - blueskytechnosol.com X-Get-Message-Sender-Via: n3plcpnl0260.prod.ams3.secureserver.net: authenticated_id: tina.johnson@blueskytechnosol.com X-Authenticated-Sender: n3plcpnl0260.prod.ams3.secureserver.net: tina.johnson@blueskytechnosol.com X-Source: X-Source-Args: X-Source-Dir: X-CMAE-Envelope: MS4wfNoZ0wM72NEjMJYt/HI+nnlsMzvoBpBdPvkD38QLlnW/C/pOHZE4NqQApKr1VRIg9y/u/eSvwkeJzKTutUkyq184PKte7dxGZRkqxs5MG4NDwWv5JamA UVHiT+7w1vd/97V8htZkPqfF3gvEgkw1pfVkdx4Zc6PnC6s7IEXft5giVzD+nhLAEP/SkXiMKt8Ipq7wpq/wSVPX9LRzNDKVpOihyklmi4htLtmS4p3c3xhn X-Rspamd-Queue-Id: F2D4670873 X-Spamd-Bar: ++ Authentication-Results: mx1.freebsd.org; dkim=none (invalid DKIM record) header.d=blueskytechnosol.com header.s=default header.b=dZvjWq1X; spf=pass (mx1.freebsd.org: domain of tina.johnson@blueskytechnosol.com designates 188.121.43.194 as permitted sender) smtp.mailfrom=tina.johnson@blueskytechnosol.com X-Spamd-Result: default: False [2.27 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; MX_INVALID(0.50)[greylisted]; RWL_MAILSPIKE_GOOD(0.00)[194.43.121.188.rep.mailspike.net : 127.0.0.18]; R_SPF_ALLOW(-0.20)[+ip4:188.121.43.0/24]; HAS_X_SOURCE(0.00)[]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[blueskytechnosol.com:~]; HAS_X_ANTIABUSE(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+]; IP_SCORE(0.25)[ip: (0.44), ipnet: 188.121.40.0/22(0.63), asn: 26496(0.24), country: US(-0.07)]; ASN(0.00)[asn:26496, ipnet:188.121.40.0/22, country:US]; MID_RHS_MATCH_FROM(0.00)[]; HAS_X_AS(0.00)[tina.johnson@blueskytechnosol.com]; ARC_NA(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_SPAM_SHORT(0.59)[0.594,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; DMARC_NA(0.00)[blueskytechnosol.com]; NEURAL_SPAM_MEDIUM(0.51)[0.507,0]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_SPAM_LONG(0.73)[0.725,0]; RCVD_IN_DNSWL_NONE(0.00)[194.43.121.188.list.dnswl.org : 127.0.5.0]; FROM_NO_DN(0.00)[]; R_DKIM_PERMFAIL(0.00)[blueskytechnosol.com:s=default]; HAS_X_GMSV(0.00)[tina.johnson@blueskytechnosol.com]; RCVD_TLS_ALL(0.00)[] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 07 Feb 2019 19:45:58 -0000 Hi, Would you be interested in an email leads from the below mentioned titles? Title includes: * Obstetrics and Gynecologist * Urologist * Dermatologist * Emergency Medicine * Plastic Surgeons * Infectious Disease * Internal Medicine * Pediatrician * Neurologist * Anesthesiologist * Radiologist * General Practitioner * Family Practitioner The list comes with complete contact information like Contact name, Email address, Title, Company name, Phone number, Mailing address, etc. I'd be happy to send over few sample records on your request, and set up a time to discuss in detail. Have a great day! Regards, Tina Johnson / INFO Pro In the event that you don't wish to get messages from us answer back with "Unsubscribe" From owner-freebsd-stable@freebsd.org Fri Feb 8 11:01:24 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 35B2C14DC4EE for ; Fri, 8 Feb 2019 11:01:24 +0000 (UTC) (envelope-from petefrench@ingresso.co.uk) Received: from constantine.ingresso.co.uk (unknown [IPv6:2a02:b90:3002:411::3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id EC66874DEF for ; Fri, 8 Feb 2019 11:01:22 +0000 (UTC) (envelope-from petefrench@ingresso.co.uk) Received: from [2a02:b90:3002:411::6] (helo=dilbert.ingresso.co.uk) by constantine.ingresso.co.uk with esmtpsa (TLSv1.2:ECDHE-RSA-AES256-GCM-SHA384:256) (Exim 4.91 (FreeBSD)) (envelope-from ) id 1gs3uK-000BfV-NT; Fri, 08 Feb 2019 11:01:20 +0000 Received: from petefrench by dilbert.ingresso.co.uk with local (Exim 4.91 (FreeBSD)) (envelope-from ) id 1gs3uK-000Hnl-KL; Fri, 08 Feb 2019 11:01:20 +0000 To: bu7cher@yandex.ru, freebsd-stable@freebsd.org, petefrench@ingresso.co.uk Subject: Re: More CARP issues under 12 In-Reply-To: <4a350f47-eaca-5aca-9268-bf7a6618e71c@yandex.ru> Message-Id: From: Pete French Date: Fri, 08 Feb 2019 11:01:20 +0000 X-Rspamd-Queue-Id: EC66874DEF X-Spamd-Bar: ++ Authentication-Results: mx1.freebsd.org; dmarc=pass (policy=none) header.from=ingresso.co.uk; spf=pass (mx1.freebsd.org: domain of petefrench@ingresso.co.uk designates 2a02:b90:3002:411::3 as permitted sender) smtp.mailfrom=petefrench@ingresso.co.uk X-Spamd-Result: default: False [2.54 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RDNS_NONE(1.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+ip6:2a02:b90:3002:411::3]; NEURAL_SPAM_SHORT(0.59)[0.593,0]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; NEURAL_HAM_MEDIUM(-0.89)[-0.888,0]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MX_GOOD(-0.01)[us-smtp-inbound-1.mimecast.com, us-smtp-inbound-2.mimecast.com, us-smtp-inbound-1.mimecast.com, us-smtp-inbound-2.mimecast.com, us-smtp-inbound-1.mimecast.com, us-smtp-inbound-2.mimecast.com, us-smtp-inbound-1.mimecast.com, us-smtp-inbound-2.mimecast.com, us-smtp-inbound-1.mimecast.com, us-smtp-inbound-2.mimecast.com, us-smtp-inbound-1.mimecast.com, us-smtp-inbound-2.mimecast.com, us-smtp-inbound-1.mimecast.com, us-smtp-inbound-2.mimecast.com, us-smtp-inbound-1.mimecast.com, us-smtp-inbound-2.mimecast.com, us-smtp-inbound-1.mimecast.com, us-smtp-inbound-2.mimecast.com, us-smtp-inbound-1.mimecast.com, us-smtp-inbound-2.mimecast.com, us-smtp-inbound-1.mimecast.com, us-smtp-inbound-2.mimecast.com, us-smtp-inbound-1.mimecast.com, us-smtp-inbound-2.mimecast.com, us-smtp-inbound-1.mimecast.com, us-smtp-inbound-2.mimecast.com, us-smtp-inbound-1.mimecast.com, us-smtp-inbound-2.mimecast.com, us-smtp-inbound-1.mimecast.com, us-smtp-inbound-2.mimecast.com, us-smtp-inbound-1.mimecast.com, us-smtp-inbound-2.mi mecast.com,us-smtp-inbound-1.mimecast.com,us-smtp-inbound-2.mimecast.com,us-smtp-inbound-1.mimecast.com,us-smtp-inbound-2.mimecast.com,us-smtp-inbound-1.mimecast.com,us-smtp-inbound-2.mimecast.com,us-smtp-inbound-1.mimecast.com,us-smtp-inbound-2.mimecast.com,us-smtp-inbound-1.mimecast.com,us-smtp-inbound-2.mimecast.com,us-smtp-inbound-1.mimecast.com,us-smtp-inbound-2.mimecast.com,us-smtp-inbound-1.mimecast.com,us-smtp-inbound-2.mimecast.com,us-smtp-inbound-1.mimecast.com,us-smtp-inbound-2.mimecast.com,us-smtp-inbound-1.mimecast.com,us-smtp-inbound-2.mimecast.com,us-smtp-inbound-1.mimecast.com,us-smtp-inbound-2.mimecast.com,us-smtp-inbound-1.mimecast.com,us-smtp-inbound-2.mimecast.com,us-smtp-inbound-1.mimecast.com,us-smtp-inbound-2.mimecast.com]; DMARC_POLICY_ALLOW(-0.50)[ingresso.co.uk,none]; NEURAL_SPAM_LONG(0.16)[0.162,0]; RCVD_TLS_LAST(0.00)[]; FREEMAIL_TO(0.00)[yandex.ru]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:16082, ipnet:2a02:b90::/32, country:GB]; HFILTER_HOSTNAME_UNKNOWN(2.50)[]; IP_SCORE(-0.02)[country: GB(-0.09)] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 08 Feb 2019 11:01:24 -0000 So, another datapoint on this - I just PXE booted the 12.0-RELEASE image downloaded from https://mfsbsd.vx.sk/ and that works fine. Which means that it siether something which has crept in since 12.0-RELEASE or its something to do with my config on that machine. I did try and buld an mfsroot image of the kernel I am trying to deploy,. but that failed, which is a bit of a shame, as thats easier to try than the full upgrade (because rolling that back after a crash is tricky!). The laternative is to bild 12.0-RELEASE and see if that boots up. Not sure when I will get around to trying either of those though. -pete. From owner-freebsd-stable@freebsd.org Sat Feb 9 22:31:37 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D9D9414D0317 for ; Sat, 9 Feb 2019 22:31:36 +0000 (UTC) (envelope-from karl@denninger.net) Received: from colo1.denninger.net (colo1.denninger.net [104.236.120.189]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 39BB78562A for ; Sat, 9 Feb 2019 22:31:35 +0000 (UTC) (envelope-from karl@denninger.net) Received: from denninger.net (ip68-1-57-197.pn.at.cox.net [68.1.57.197]) by colo1.denninger.net (Postfix) with ESMTP id E255A2110AF for ; Sat, 9 Feb 2019 17:30:58 -0500 (EST) Received: from [192.168.10.12] (D2.Denninger.Net [192.168.10.12]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by denninger.net (Postfix) with ESMTPSA id 3AE33371A2 for ; Sat, 9 Feb 2019 16:30:58 -0600 (CST) From: Karl Denninger Subject: Serious ZFS Bootcode Problem (GPT NON-UEFI) To: freebsd-stable@freebsd.org Openpgp: preference=signencrypt Autocrypt: addr=karl@denninger.net; prefer-encrypt=mutual; keydata= mQINBFIX1zsBEADRcJfsQUl9oFeoMfLPJ1kql+3sIaYx0MfJAUhV9LnbWxr0fsWCskM1O4cV tHm5dqPkuPM4Ztc0jLotD1i9ubWvCHOlkLGxFOL+pFbjA+XZ7VKsC/xWmhMwJ3cM8HavK2OV SzEWQ/AEYtMi04IzGSwsxh/5/5R0mPHrsIomV5SbuiI0vjLuDj7fo6146AABI1ULzge4hBYW i/SHrqUrLORmUNBs6bxek79/B0Dzk5cIktD3LOfbT9EAa5J/osVkstMBhToJgQttaMIGv8SG CzpR/HwEokE+7DP+k2mLHnLj6H3kfugOF9pJH8Za4yFmw//s9cPXV8WwtZ2SKfVzn1unpKqf wmJ1PwJoom/d4fGvQDkgkGKRa6RGC6tPmXnqnx+YX4iCOdFfbP8L9rmk2sewDDVzHDU3I3ZZ 8hFIjMYM/QXXYszRatK0LCV0QPZuF7LCf4uQVKw1/oyJInsnH7+6a3c0h21x+CmSja9QJ+y0 yzgEN/nM89d6YTakfR+1xkYgodVmMy/bS8kmXbUUZG/CyeqCqc95RUySjKT2ECrf9GhhoQkl +D8n2MsrAUSMGB4GQSN+TIq9OBTpNuvATGSRuF9wnQcs1iSry+JNCpfRTyWp83uCNApe6oHU EET4Et6KDO3AvjvBMAX0TInTRGW2SQlJMuFKpc7Dg7tHK8zzqQARAQABtCNLYXJsIERlbm5p bmdlciA8a2FybEBkZW5uaW5nZXIubmV0PokCPAQTAQIAJgUCUhfXOwIbIwUJCWYBgAYLCQgH AwIEFQIIAwQWAgMBAh4BAheAAAoJEG6/sivc5s0PLxQP/i6x/QFx9G4Cw7C+LthhLXIm7NSH AtNbz2UjySEx2qkoQQjtsK6mcpEEaky4ky6t8gz0/SifIfJmSmyAx0UhUQ0WBv1vAXwtNrQQ jJd9Bj6l4c2083WaXyHPjt2u2Na6YFowyb4SaQb83hu/Zs25vkPQYJVVE0JX409MFVPUa6E3 zFbd1OTr3T4yNUy4gNeQZfzDqDS8slbIks2sXeoJrZ6qqXVI0ionoivOlaN4T6Q0UYyXtigj dQvvhMt0aNowKFjRqrmSDRpdz+o6yg7Mp7qEZ1V6EZk8KqQTH6htpCTQ8i79ttK4LG6bstSF Re6Fwq52nbrcANrcdmtZXqjo+SGbUqJ8b1ggrxAsJ5MEhRh2peKrCgI/TjQo+ZxfnqEoR4AI 46Cyiz+/lcVvlvmf2iPifS3EEdaH3Itfwt7MxFm6mQORYs6skHDw3tOYB2/AdCW6eRVYs2hB RMAG4uwApZfZDKgRoE95PJmQjeTBiGmRPcsQZtNESe7I7EjHtCDLwtJqvD4HkDDQwpzreT6W XkyIJ7ns7zDfA1E+AQhFR6rsTFGgQZRZKsVeov3SbhYKkCnVDCvb/PKQCAGkSZM9SvYG5Yax 8CMry3AefKktf9fqBFg8pWqtVxDwJr56dhi0GHXRu3jVI995rMGo1fLUG5fSxiZ8L5sAtokh 9WFmQpyl Message-ID: <911d001f-9e33-0521-51fe-f7d1383dfc62@denninger.net> Date: Sat, 9 Feb 2019 16:30:57 -0600 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:60.0) Gecko/20100101 Thunderbird/60.5.0 MIME-Version: 1.0 Content-Type: multipart/signed; protocol="application/pkcs7-signature"; micalg=sha-512; boundary="------------ms030102080404010107020608" X-Rspamd-Queue-Id: 39BB78562A X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-6.37 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; HAS_ATTACHMENT(0.00)[]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; MX_GOOD(-0.01)[px.denninger.net]; NEURAL_HAM_SHORT(-0.93)[-0.927,0]; FROM_EQ_ENVFROM(0.00)[]; IP_SCORE(-2.24)[ip: (-9.88), ipnet: 104.236.64.0/18(-3.96), asn: 14061(2.73), country: US(-0.07)]; R_DKIM_NA(0.00)[]; ASN(0.00)[asn:14061, ipnet:104.236.64.0/18, country:US]; MIME_TRACE(0.00)[0:+,1:+,2:+]; MID_RHS_MATCH_FROM(0.00)[]; RECEIVED_SPAMHAUS_PBL(0.00)[197.57.1.68.zen.spamhaus.org : 127.0.0.11]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.998,0]; FROM_HAS_DN(0.00)[]; SIGNED_SMIME(-2.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.20)[multipart/signed,multipart/alternative,text/plain]; RCVD_TLS_LAST(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; AUTH_NA(1.00)[]; RCPT_COUNT_ONE(0.00)[1]; DMARC_NA(0.00)[denninger.net]; R_SPF_NA(0.00)[] X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 09 Feb 2019 22:31:37 -0000 This is a cryptographically signed message in MIME format. --------------ms030102080404010107020608 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable FreeBSD 12.0-STABLE r343809 After upgrading to this (without material incident) zfs was telling me that the pools could be upgraded (this machine was running 11.1, then 11.= 2.) I did so, /and put the new bootcode on with gpart bootcode -b /boot/pmbr -p /boot/gptzfsboot -i .... da... /on both of the candidate (mirrored ZFS boot disk) devices, in the correct partition. Then I rebooted to test and..... /could not find the zsboot pool containing the kernel./ I booted the rescue image off my SD and checked -- the copy of gptzfsboot that I put on the boot partition is exactly identical to the one on the rescue image SD. Then, to be /absolutely sure /I wasn't going insane I grabbed the mini-memstick img for 12-RELEASE and tried THAT copy of gptzfsboot. /Nope; that won't boot either!/ Fortunately I had a spare drive slot so I stuck in a piece of spinning rust, gpart'ed THAT with an old-style UFS boot filesystem, wrote bootcode on that, mounted the ZFS "zsboot" filesystem and copied it over.=C2=A0 That boots fine (of course) and mounts the root pool, and off= it goes. I'm going to blow away the entire /usr/obj tree and rebuild the kernel to see if that gets me anything that's more-sane, but right now this looks pretty bad. BTW just to be absolutely sure I blew away the entire /usr/obj directory and rebuilt -- same size and checksum on the binary that I have installed, so..... Not sure what's going on here -- did something get moved? --=20 Karl Denninger karl@denninger.net /The Market Ticker/ /[S/MIME encrypted email preferred]/ --------------ms030102080404010107020608 Content-Type: application/pkcs7-signature; name="smime.p7s" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="smime.p7s" Content-Description: S/MIME Cryptographic Signature MIAGCSqGSIb3DQEHAqCAMIACAQExDzANBglghkgBZQMEAgMFADCABgkqhkiG9w0BBwEAAKCC DdgwggagMIIEiKADAgECAhMA5EiKghDOXrvfxYxjITXYDdhIMA0GCSqGSIb3DQEBCwUAMIGL MQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTESMBAGA1UEBwwJTmljZXZpbGxlMRkw FwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5c3RlbXMgQ0ExITAf BgNVBAMMGEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBDQTAeFw0xNzA4MTcxNjQyMTdaFw0yNzA4 MTUxNjQyMTdaMHsxCzAJBgNVBAYTAlVTMRAwDgYDVQQIDAdGbG9yaWRhMRkwFwYDVQQKDBBD dWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5c3RlbXMgQ0ExJTAjBgNVBAMMHEN1 ZGEgU3lzdGVtcyBMTEMgMjAxNyBJbnQgQ0EwggIiMA0GCSqGSIb3DQEBAQUAA4ICDwAwggIK AoICAQC1aJotNUI+W4jP7xQDO8L/b4XiF4Rss9O0B+3vMH7Njk85fZ052QhZpMVlpaaO+sCI KqG3oNEbuOHzJB/NDJFnqh7ijBwhdWutdsq23Ux6TvxgakyMPpT6TRNEJzcBVQA0kpby1DVD 0EKSK/FrWWBiFmSxg7qUfmIq/mMzgE6epHktyRM3OGq3dbRdOUgfumWrqHXOrdJz06xE9NzY vc9toqZnd79FUtE/nSZVm1VS3Grq7RKV65onvX3QOW4W1ldEHwggaZxgWGNiR/D4eosAGFxn uYeWlKEC70c99Mp1giWux+7ur6hc2E+AaTGh+fGeijO5q40OGd+dNMgK8Es0nDRw81lRcl24 SWUEky9y8DArgIFlRd6d3ZYwgc1DMTWkTavx3ZpASp5TWih6yI8ACwboTvlUYeooMsPtNa9E 6UQ1nt7VEi5syjxnDltbEFoLYcXBcqhRhFETJe9CdenItAHAtOya3w5+fmC2j/xJz29og1KH YqWHlo3Kswi9G77an+zh6nWkMuHs+03DU8DaOEWzZEav3lVD4u76bKRDTbhh0bMAk4eXriGL h4MUoX3Imfcr6JoyheVrAdHDL/BixbMH1UUspeRuqQMQ5b2T6pabXP0oOB4FqldWiDgJBGRd zWLgCYG8wPGJGYgHibl5rFiI5Ix3FQncipc6SdUzOQIDAQABo4IBCjCCAQYwHQYDVR0OBBYE FF3AXsKnjdPND5+bxVECGKtc047PMIHABgNVHSMEgbgwgbWAFBu1oRhUMNEzjODolDka5k4Q EDBioYGRpIGOMIGLMQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTESMBAGA1UEBwwJ TmljZXZpbGxlMRkwFwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5 c3RlbXMgQ0ExITAfBgNVBAMMGEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBDQYIJAKxAy1WBo2kY MBIGA1UdEwEB/wQIMAYBAf8CAQAwDgYDVR0PAQH/BAQDAgGGMA0GCSqGSIb3DQEBCwUAA4IC AQCB5686UCBVIT52jO3sz9pKuhxuC2npi8ZvoBwt/IH9piPA15/CGF1XeXUdu2qmhOjHkVLN gO7XB1G8CuluxofOIUce0aZGyB+vZ1ylHXlMeB0R82f5dz3/T7RQso55Y2Vog2Zb7PYTC5B9 oNy3ylsnNLzanYlcW3AAfzZcbxYuAdnuq0Im3EpGm8DoItUcf1pDezugKm/yKtNtY6sDyENj tExZ377cYA3IdIwqn1Mh4OAT/Rmh8au2rZAo0+bMYBy9C11Ex0hQ8zWcvPZBDn4v4RtO8g+K uQZQcJnO09LJNtw94W3d2mj4a7XrsKMnZKvm6W9BJIQ4Nmht4wXAtPQ1xA+QpxPTmsGAU0Cv HmqVC7XC3qxFhaOrD2dsvOAK6Sn3MEpH/YrfYCX7a7cz5zW3DsJQ6o3pYfnnQz+hnwLlz4MK 17NIA0WOdAF9IbtQqarf44+PEyUbKtz1r0KGeGLs+VGdd2FLA0e7yuzxJDYcaBTVwqaHhU2/ Fna/jGU7BhrKHtJbb/XlLeFJ24yvuiYKpYWQSSyZu1R/gvZjHeGb344jGBsZdCDrdxtQQcVA 6OxsMAPSUPMrlg9LWELEEYnVulQJerWxpUecGH92O06wwmPgykkz//UmmgjVSh7ErNvL0lUY UMfunYVO/O5hwhW+P4gviCXzBFeTtDZH259O7TCCBzAwggUYoAMCAQICEwCg0WvVwekjGFiO 62SckFwepz0wDQYJKoZIhvcNAQELBQAwezELMAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3Jp ZGExGTAXBgNVBAoMEEN1ZGEgU3lzdGVtcyBMTEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBD QTElMCMGA1UEAwwcQ3VkYSBTeXN0ZW1zIExMQyAyMDE3IEludCBDQTAeFw0xNzA4MTcyMTIx MjBaFw0yMjA4MTYyMTIxMjBaMFcxCzAJBgNVBAYTAlVTMRAwDgYDVQQIDAdGbG9yaWRhMRkw FwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRswGQYDVQQDDBJrYXJsQGRlbm5pbmdlci5uZXQw ggIiMA0GCSqGSIb3DQEBAQUAA4ICDwAwggIKAoICAQC+HVSyxVtJhy3Ohs+PAGRuO//Dha9A 16l5FPATr6wude9zjX5f2lrkRyU8vhCXTZW7WbvWZKpcZ8r0dtZmiK9uF58Ec6hhvfkxJzbg 96WHBw5Fumd5ahZzuCJDtCAWW8R7/KN+zwzQf1+B3MVLmbaXAFBuKzySKhKMcHbK3/wjUYTg y+3UK6v2SBrowvkUBC+jxNg3Wy12GsTXcUS/8FYIXgVVPgfZZrbJJb5HWOQpvvhILpPCD3xs YJFNKEPltXKWHT7Qtc2HNqikgNwj8oqOb+PeZGMiWapsatKm8mxuOOGOEBhAoTVTwUHlMNTg 6QUCJtuWFCK38qOCyk9Haj+86lUU8RG6FkRXWgMbNQm1mWREQhw3axgGLSntjjnznJr5vsvX SYR6c+XKLd5KQZcS6LL8FHYNjqVKHBYM+hDnrTZMqa20JLAF1YagutDiMRURU23iWS7bA9tM cXcqkclTSDtFtxahRifXRI7Epq2GSKuEXe/1Tfb5CE8QsbCpGsfSwv2tZ/SpqVG08MdRiXxN 5tmZiQWo15IyWoeKOXl/hKxA9KPuDHngXX022b1ly+5ZOZbxBAZZMod4y4b4FiRUhRI97r9l CxsP/EPHuuTIZ82BYhrhbtab8HuRo2ofne2TfAWY2BlA7ExM8XShMd9bRPZrNTokPQPUCWCg CdIATQIDAQABo4IBzzCCAcswPAYIKwYBBQUHAQEEMDAuMCwGCCsGAQUFBzABhiBodHRwOi8v b2NzcC5jdWRhc3lzdGVtcy5uZXQ6ODg4ODAJBgNVHRMEAjAAMBEGCWCGSAGG+EIBAQQEAwIF oDAOBgNVHQ8BAf8EBAMCBeAwHQYDVR0lBBYwFAYIKwYBBQUHAwIGCCsGAQUFBwMEMDMGCWCG SAGG+EIBDQQmFiRPcGVuU1NMIEdlbmVyYXRlZCBDbGllbnQgQ2VydGlmaWNhdGUwHQYDVR0O BBYEFLElmNWeVgsBPe7O8NiBzjvjYnpRMIHKBgNVHSMEgcIwgb+AFF3AXsKnjdPND5+bxVEC GKtc047PoYGRpIGOMIGLMQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTESMBAGA1UE BwwJTmljZXZpbGxlMRkwFwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRh IFN5c3RlbXMgQ0ExITAfBgNVBAMMGEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBDQYITAORIioIQ zl6738WMYyE12A3YSDAdBgNVHREEFjAUgRJrYXJsQGRlbm5pbmdlci5uZXQwDQYJKoZIhvcN AQELBQADggIBAJXboPFBMLMtaiUt4KEtJCXlHO/3ZzIUIw/eobWFMdhe7M4+0u3te0sr77QR dcPKR0UeHffvpth2Mb3h28WfN0FmJmLwJk+pOx4u6uO3O0E1jNXoKh8fVcL4KU79oEQyYkbu 2HwbXBU9HbldPOOZDnPLi0whi/sbFHdyd4/w/NmnPgzAsQNZ2BYT9uBNr+jZw4SsluQzXG1X lFL/qCBoi1N2mqKPIepfGYF6drbr1RnXEJJsuD+NILLooTNf7PMgHPZ4VSWQXLNeFfygoOOK FiO0qfxPKpDMA+FHa8yNjAJZAgdJX5Mm1kbqipvb+r/H1UAmrzGMbhmf1gConsT5f8KU4n3Q IM2sOpTQe7BoVKlQM/fpQi6aBzu67M1iF1WtODpa5QUPvj1etaK+R3eYBzi4DIbCIWst8MdA 1+fEeKJFvMEZQONpkCwrJ+tJEuGQmjoQZgK1HeloepF0WDcviiho5FlgtAij+iBPtwMuuLiL shAXA5afMX1hYM4l11JXntle12EQFP1r6wOUkpOdxceCcMVDEJBBCHW2ZmdEaXgAm1VU+fnQ qS/wNw/S0X3RJT1qjr5uVlp2Y0auG/eG0jy6TT0KzTJeR9tLSDXprYkN2l/Qf7/nT6Q03qyE QnnKiBXWAZXveafyU/zYa7t3PTWFQGgWoC4w6XqgPo4KV44OMYIFBzCCBQMCAQEwgZIwezEL MAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3JpZGExGTAXBgNVBAoMEEN1ZGEgU3lzdGVtcyBM TEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBDQTElMCMGA1UEAwwcQ3VkYSBTeXN0ZW1zIExM QyAyMDE3IEludCBDQQITAKDRa9XB6SMYWI7rZJyQXB6nPTANBglghkgBZQMEAgMFAKCCAkUw GAYJKoZIhvcNAQkDMQsGCSqGSIb3DQEHATAcBgkqhkiG9w0BCQUxDxcNMTkwMjA5MjIzMDU3 WjBPBgkqhkiG9w0BCQQxQgRAJYoFq5HXtCmgETnx2iGnKtqnqJ8W1i5/aGPG6Fyo/IFgsRlS AAvn46kznWbxXtX7GVPu76J1iBB5i84ugXeMDzBsBgkqhkiG9w0BCQ8xXzBdMAsGCWCGSAFl AwQBKjALBglghkgBZQMEAQIwCgYIKoZIhvcNAwcwDgYIKoZIhvcNAwICAgCAMA0GCCqGSIb3 DQMCAgFAMAcGBSsOAwIHMA0GCCqGSIb3DQMCAgEoMIGjBgkrBgEEAYI3EAQxgZUwgZIwezEL MAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3JpZGExGTAXBgNVBAoMEEN1ZGEgU3lzdGVtcyBM TEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBDQTElMCMGA1UEAwwcQ3VkYSBTeXN0ZW1zIExM QyAyMDE3IEludCBDQQITAKDRa9XB6SMYWI7rZJyQXB6nPTCBpQYLKoZIhvcNAQkQAgsxgZWg gZIwezELMAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3JpZGExGTAXBgNVBAoMEEN1ZGEgU3lz dGVtcyBMTEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBDQTElMCMGA1UEAwwcQ3VkYSBTeXN0 ZW1zIExMQyAyMDE3IEludCBDQQITAKDRa9XB6SMYWI7rZJyQXB6nPTANBgkqhkiG9w0BAQEF AASCAgBp/o1JWXfIYKwf+Im8I28MsRoYeC7mPRx7jmpyDG4JylY+mUb9MAADm3lO4PxPcic4 RNwXQc40GAc71ZOpHzas779KUm2Pq+bGlWrxENuAOd3FryvI+CyK+62Ti6YiV6IJxgBnglf5 4ooe7SroW7G+ga8MMp0io2asbtYxI2yCxlwmGd1WLT/vnaqJypzDVtpOsAZfe3386ufc7dr0 D285Xgd6hbhYLxy12ccWhyxR2tuDrTjBKy1TeQ/Zo85+Q+F0u4cKa+4UM/9JV7sVjOMF2+iq SL04p1OxZswfIcKdbqLKMZh/UfKp9OWS5Z93QLtA2uc4QYViIskCqM1YdqCJQ93i4fORChFH aiso+l+0UUwimZNrzVseLKDmQ9xm/7dWVxQLda+FEofgmmD83Sydcw/wZNcobX4Gj4H985gW XZtwt39+lId/93FvBp3rYLLkVwDtpJw1J+1qXIxqtJejCh+wnqZvAx2DuH1QJz8mrzNEGVHS /HKN/jLrLLVwgxlwzP1gZsthfW1AlSmDEj7tbsKIJtNLhJDXM+jHf8pgfjBCaYbgSOhGnQCb L/euvwyA6T60275fzLA5fUlVxLxHOU9jCoxeJPlBICLQF/A1XCv/iZuBegpBPaG0W6Bc6DER qF6/N7255Mlra8zGr05uVJhnhRQqYh6PKr1Y8fUlYwAAAAAAAA== --------------ms030102080404010107020608--