From owner-freebsd-stable@freebsd.org Mon Nov 26 18:34:20 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 79E4E113FDE8 for ; Mon, 26 Nov 2018 18:34:20 +0000 (UTC) (envelope-from jclarke@marcuscom.com) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id D9C5F8186D for ; Mon, 26 Nov 2018 18:34:19 +0000 (UTC) (envelope-from jclarke@marcuscom.com) Received: by mailman.ysv.freebsd.org (Postfix) id 9323A113FDE5; Mon, 26 Nov 2018 18:34:19 +0000 (UTC) Delivered-To: stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 68890113FDE4 for ; Mon, 26 Nov 2018 18:34:19 +0000 (UTC) (envelope-from jclarke@marcuscom.com) Received: from alln-iport-3.cisco.com (alln-iport-3.cisco.com [173.37.142.90]) (using TLSv1.2 with cipher DHE-RSA-SEED-SHA (128/128 bits)) (Client CN "iport.cisco.com", Issuer "HydrantID SSL ICA G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id A09DF81868; Mon, 26 Nov 2018 18:34:18 +0000 (UTC) (envelope-from jclarke@marcuscom.com) X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: =?us-ascii?q?A0AUAgBZPPxb/5JdJa1kGgEBAQEBAgE?= =?us-ascii?q?BAQEHAgEBAQGBZYFbKWYDTDMng3mUG4FgLXOYQw0fhE0ChCEiOBIBAwEBAgE?= =?us-ascii?q?BAm0cDIU9AQUjVhALDgoCAiYCAlcGAQwIAQGCUksBggGmOYEviiaBC4p+F4F?= =?us-ascii?q?AP4E4gj0ugwIiDoE/gxGCVwKJUYYLNI9yCZEpHolhhyeQD4ghgV0hgVVNIxW?= =?us-ascii?q?DJwmDNAECgkiKcCEDMAGKNoJLAQE?= X-IronPort-AV: E=Sophos;i="5.56,283,1539648000"; d="scan'208";a="204785088" Received: from rcdn-core-10.cisco.com ([173.37.93.146]) by alln-iport-3.cisco.com with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 26 Nov 2018 18:34:16 +0000 Received: from [192.168.10.244] (rtp-jclarke-nitro4.cisco.com [10.118.87.85]) by rcdn-core-10.cisco.com (8.15.2/8.15.2) with ESMTP id wAQIYF20021765; Mon, 26 Nov 2018 18:34:15 GMT Subject: Re: Panic on 11-STABLE with Xen guest To: John Baldwin , stable@freebsd.org Cc: =?UTF-8?Q?Roger_Pau_Monn=c3=a9?= References: <00d6d9ae-d5d8-ed88-34ee-2e67c0ca8904@marcuscom.com> <87ec7a7b-f64e-21b7-ac2c-790e2ff70247@FreeBSD.org> From: Joe Clarke Openpgp: preference=signencrypt Autocrypt: addr=jclarke@marcuscom.com; prefer-encrypt=mutual; keydata= xsDiBDo1cJ0RBADSZSmbmzdRr1CoRWWKmAyu0eaQimaLV1TsZEML/ksLyg6faXrKIA/MWc7M w4FmKkDjaZdFzobzabnKp2QwVadLqi1gYY2WsApKC0rSoqsPx5E847AmwNWXgjXiXORXmnZL mf5PZ2ECOEJC27sji5Nrh9GSw7OPp6c+EE20gMNVrwCgu3iK5vyGQfy0/wX/jcIvP0nHznUD /RvijiKomyaf6F5pibmouFNeuCDHc8lwx2giA/MCZl/nSkI2/UX27sULGNgvKNkVPu/AukXu zW3fIthsJgjQZUoi/BTe9kUP+RL3+RALXXuLv7b3xGRHJ8A1Rpy9H43fkjHZ945YNPrUvJlG LP5PNGBD1xC21X3EGAyywVynDskcA/4qgbJFkVzmPjFJUjq+RW1zw3UIb3bbkskl/wk5qd+M w2EhiSPTbEhJQAQUvqSGFWEGp2ANic7iYLdPXV/O6I1/guRRaY0eK77YkkCjz1snaKYnGSeI GHGwmHb6D+ZHzTqZqr6IssgEIUHjXfgOUTARQbL15nJTVRzDGUiT/65R3c0eSm9lIENsYXJr ZSA8amNsYXJrZUBjaXNjby5jb20+wl8EExECABcFAjyDqGQFCwcKAwQDFQMCAxYCAQIXgAAS CRDN7TXCWm4C3wdlR1BHAAEB5KkAn0kBda/9+uF6RfnDSFS7RExUU9DqAJ4knRckYiSASteC K03QVtEiXblL287ATQQ6NXCeEAQAhIURlK17jmIMdMIuScFU6xK+jkKgVVFrjlRH5vLV2spp jH/uQ57MMGuOcs7PckXCnPjBV8Tm32Tuw+fCyrbc2gt0ouiT/5WWj0EMeAfWew1zBXX2okGf LqS6gucVDS6tcEFN6PmJEmX+tWDcmiqx/xXiSfMVYiLMdlK+YDkMDDsAAwUD/3BWOyfdnBGH Kv28zx+5wq/2vhYnUYCAdVD2ZWCJizQTMbkcxEIKAwtAj6yqKq9ah82nt4VHl5ZejVe47jvR 2nXwJ5VQ9eITuTjTLDw+3qr9lN077VZ32hyb5ULJcW756j9Z3YB2FTANw6KHgChaSVVx9kYJ FlAggraU7mi39/wvwk4EGBECAAYFAjo1cJ4AEgkQze01wlpuAt8HZUdQRwABAQbdAJ9R8SzU Mluu9r93BMv6fAW9j6qTZgCfYcEAqOMJv+3Z+YxLiDtWcCY4Sfo= Message-ID: <33a9ab44-3abf-d669-c462-36b673070cd9@marcuscom.com> Date: Mon, 26 Nov 2018 13:34:15 -0500 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.14; rv:60.0) Gecko/20100101 Thunderbird/60.3.1 MIME-Version: 1.0 In-Reply-To: <87ec7a7b-f64e-21b7-ac2c-790e2ff70247@FreeBSD.org> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit X-Outbound-SMTP-Client: 10.118.87.85, rtp-jclarke-nitro4.cisco.com X-Outbound-Node: rcdn-core-10.cisco.com X-Rspamd-Queue-Id: D9C5F8186D X-Spamd-Result: default: False [-5.85 / 15.00]; ARC_NA(0.00)[]; FORGED_RECIPIENTS_FORWARDING(0.00)[]; RCVD_COUNT_FIVE(0.00)[6]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; FORWARDED(0.00)[stable@mailman.ysv.freebsd.org]; TO_DN_SOME(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[marcuscom.com]; AUTH_NA(1.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; RCVD_IN_DNSWL_MED(-0.20)[5.0.0.0.0.5.0.0.0.0.0.0.0.0.0.0.a.6.0.2.4.5.2.2.0.0.9.1.1.0.0.2.list.dnswl.org : 127.0.9.2]; MX_GOOD(-0.01)[cached: creme-brulee.marcuscom.com]; NEURAL_HAM_SHORT(-1.00)[-0.998,0]; R_SPF_NA(0.00)[]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; IP_SCORE(-3.64)[ip: (-9.87), ipnet: 2001:1900:2254::/48(-4.70), asn: 10310(-3.55), country: US(-0.09)]; ASN(0.00)[asn:10310, ipnet:2001:1900:2254::/48, country:US]; FORGED_RECIPIENTS(0.00)[jhb@FreeBSD.org ..,freebsd-stable@freebsd.org]; MID_RHS_MATCH_FROM(0.00)[] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 26 Nov 2018 18:34:20 -0000 On 11/26/18 13:31, John Baldwin wrote: > On 11/22/18 12:39 PM, Joe Clarke wrote: >> I believe after the commit 340016 for the dynamic IRQ layout, my Xen VM >> started to panic. I just upgraded the kernel today and saw this: >> >> xen: unable to map IRQ#2 >> panic: Unable to register interrupt override >> cpuid = 0 >> KDB: stack backtrace: >> #0 0xffffffff8060a4e7 at kdb_backtrace+0x67 >> #1 0xffffffff805c3787 at vpanic+0x177 >> #2 0xffffffff805c3603 at panic+0x43 >> #3 0xffffffff8093a766 at madt_parse_ints+0x96 >> #4 0xffffffff803353f9 at acpi_walk_subtables+0x29 >> #5 0xffffffff8093a5e6 at xenpv_register_pirqs+0x56 >> #6 0xffffffff80928296 at intr_init_sources+0x116 >> #7 0xffffffff8055eba8 at mi_startup+0x118 >> #8 0xffffffff8029902c at btext+0x2c >> >> The following kernel works: >> >> @(#)FreeBSD 11.2-STABLE #4: Thu Nov 1 02:24:07 EDT 2018 >> FreeBSD 11.2-STABLE #4: Thu Nov 1 02:24:07 EDT 2018 >> root@creme-brulee:/usr/obj/usr/src/sys/CREME-BRULEE >> >> The following kernel produces the panic above immediately on boot: >> >> @(#)FreeBSD 11.2-STABLE #5: Wed Nov 21 11:08:38 EST 2018 >> FreeBSD 11.2-STABLE #5: Wed Nov 21 11:08:38 EST 2018 >> root@creme-brulee:/usr/obj/usr/src/sys/CREME-BRULEE >> >> Attached is a screen grab of the console of the panic. > > Hmm, I don't see any obvious candidates of Xen changes that weren't included > in the MFC. I've added royger@ (who maintains Xen in FreeBSD) to the cc to > see if he has an idea. > > Roger, the main changes that aren't MFC'd to 11 from 12/head seem to be some > refcounting on event channels and PVHv2 vs PVHv1? Thanks for the follow-up, John. Apparently, there was an incomplete MFC. Roger added the missing bit today in r340982 which resolved the panic. Joe Joe > -- PGP Key : http://www.marcuscom.com/pgp.asc