From owner-freebsd-xen@FreeBSD.ORG Mon Feb 24 11:07:02 2014 Return-Path: Delivered-To: freebsd-xen@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id E7066B7F for ; Mon, 24 Feb 2014 11:07:01 +0000 (UTC) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:1900:2254:206c::16:87]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id D251A163B for ; Mon, 24 Feb 2014 11:07:01 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.7/8.14.7) with ESMTP id s1OB716G027777 for ; Mon, 24 Feb 2014 11:07:01 GMT (envelope-from owner-bugmaster@FreeBSD.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.8/8.14.8/Submit) id s1OB71ec027775 for freebsd-xen@FreeBSD.org; Mon, 24 Feb 2014 11:07:01 GMT (envelope-from owner-bugmaster@FreeBSD.org) Date: Mon, 24 Feb 2014 11:07:01 GMT Message-Id: <201402241107.s1OB71ec027775@freefall.freebsd.org> X-Authentication-Warning: freefall.freebsd.org: gnats set sender to owner-bugmaster@FreeBSD.org using -f From: FreeBSD bugmaster To: freebsd-xen@FreeBSD.org Subject: Current problem reports assigned to freebsd-xen@FreeBSD.org X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 24 Feb 2014 11:07:02 -0000 Note: to view an individual PR, use: http://www.freebsd.org/cgi/query-pr.cgi?pr=(number). The following is a listing of current problems submitted by FreeBSD users. These represent problem reports covering all versions including experimental development code and obsolete releases. S Tracker Resp. Description -------------------------------------------------------------------------------- o kern/183139 xen [xen] [patch] ifconfig options on xn0 lost after xen v o kern/180788 xen [xen] [panic] XEN PV kernel 9.2-BETA1 panics on boot o kern/180403 xen [xen] Problems with GENERIC and XENHVM kernels with Xe o kern/180402 xen [xen] XEN kernel does not load in XenClient 4.5.5 o kern/179814 xen [xen] mountroot fails with error=19 under Xen on 9-STA o kern/176471 xen [xen] xn driver crash on detach o kern/176053 xen [xen] [patch] i386: Correct wrong usage of vsnprintf() o kern/175954 xen [xen] XENHVM xn network driver extreme packet loss dur o kern/175822 xen [xen] FreeBSD 9.1 does not work with Xen 4.0 o kern/175757 xen [xen] [patch] xen pvhvm looses keyboard input from VNC o kern/171873 xen [xen] xn network device floods warning in dmesg o kern/171118 xen [xen] FreeBSD XENHVM guest doesn't shutdown cleanly o kern/166174 xen [xen] Problems ROOT MOUNT ERROR o kern/165418 xen [xen] Problems mounting root filesystem from XENHVM o kern/164630 xen [xen] XEN HVM kernel: run_interrupt_driven_hooks: stil o kern/164450 xen [xen] Failed to install FreeeBSD 9.0-RELEASE from CD i o kern/162677 xen [xen] FreeBSD not compatible with "Current Stable Xen" o kern/161318 xen [xen] sysinstall crashes with floating point exception o kern/155468 xen [xen] Xen PV i386 multi-kernel CPU system is not worki o kern/155353 xen [xen] [patch] put "nudging TOD" message under boot_ver o kern/154833 xen [xen]: xen 4.0 - DomU freebsd8.2RC3 i386, XEN kernel. o kern/154473 xen [xen] xen 4.0 - DomU freebsd8.1 i386, XEN kernel. Not o kern/154472 xen [xen] xen 4.0 - DomU freebsd8.1 i386 xen kernel reboot o kern/154428 xen [xen] xn0 network interface and PF - Massive performan o kern/153674 xen [xen] i386/XEN idle thread shows wrong percentages o kern/153672 xen [xen] [panic] i386/XEN panics under heavy fork load o kern/153620 xen [xen] Xen guest system clock drifts in AWS EC2 (FreeBS o kern/153477 xen [xen] XEN pmap code abuses vm page queue lock o kern/153150 xen [xen] xen/ec2: disable checksum offloading on interfac o kern/152228 xen [xen] [panic] Xen/PV panic with machdep.idle_mwait=1 o kern/144629 xen [xen] FreeBSD 8-RELEASE XEN pvm networking doesn't wor o kern/143398 xen [xen] FreeBSD 8-RELEASE XEN pvm networking doesn't wor o kern/143340 xen [xen] FreeBSD 8-RELEASE XEN pvm networking doesn't wor f kern/143069 xen [xen] [panic] Xen Kernel Panic - Memory modified after f kern/135667 xen ufs filesystem corruption on XEN DomU system f kern/135421 xen [xen] FreeBSD Xen PVM DomU network failure - netfronc. f kern/135178 xen [xen] Xen domU outgoing data transfer stall when TSO i p kern/135069 xen [xen] FreeBSD-current/Xen SMP doesn't function at all f i386/124516 xen [xen] FreeBSD-CURRENT Xen Kernel Segfaults when config o kern/118734 xen [xen] FreeBSD 6.3-RC1 and FreeBSD 7.0-BETA 4 fail to b 40 problems total. From owner-freebsd-xen@FreeBSD.ORG Mon Feb 24 17:19:48 2014 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 677696AA for ; Mon, 24 Feb 2014 17:19:48 +0000 (UTC) Received: from SMTP.CITRIX.COM (smtp.citrix.com [66.165.176.89]) (using TLSv1 with cipher RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 9B6591F66 for ; Mon, 24 Feb 2014 17:19:47 +0000 (UTC) X-IronPort-AV: E=Sophos;i="4.97,535,1389744000"; d="scan'208";a="105260857" Received: from accessns.citrite.net (HELO FTLPEX01CL02.citrite.net) ([10.9.154.239]) by FTLPIPO01.CITRIX.COM with ESMTP; 24 Feb 2014 17:19:45 +0000 Received: from [IPv6:::1] (10.80.16.47) by smtprelay.citrix.com (10.13.107.79) with Microsoft SMTP Server id 14.2.342.4; Mon, 24 Feb 2014 12:19:44 -0500 Message-ID: <530B7F2F.2010908@citrix.com> Date: Mon, 24 Feb 2014 18:19:43 +0100 From: =?UTF-8?B?Um9nZXIgUGF1IE1vbm7DqQ==?= User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.7; rv:24.0) Gecko/20100101 Thunderbird/24.3.0 MIME-Version: 1.0 To: Karl Pielorz , Subject: Re: FreeBSD 10-R 8 vCPU panics at boot under XenServer (on 8 'core' CPU) References: <6A3B878077F7D071847052C0@Mail-PC.tdx.co.uk> <5302311E.2040700@citrix.com> <1740E0FEE5963358491F4B37@study64.tdx.co.uk> In-Reply-To: <1740E0FEE5963358491F4B37@study64.tdx.co.uk> X-Enigmail-Version: 1.6 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 8bit X-DLP: MIA2 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 24 Feb 2014 17:19:48 -0000 On 17/02/14 21:00, Karl Pielorz wrote: > > --On 17 February 2014 16:56:14 +0100 Roger Pau Monné > wrote: > >> In order to provide more debug info, could you apply the following patch: >> >> http://xenbits.xen.org/people/royger/0001-xen-debug-Xen-PV-timer.patch >> >> It will expand the panic message a little bit. Also, after applying the >> patch you can manually edit sys/dev/xen/timer/timer.c and increase >> NUM_RETRIES to see if that solves the problem. > > Ok, tried adjusting the NUM_RETRIES #define in that patch (I left the > PCI passthroughs in place at the moment). I had no idea what to set it > to - so I went for 600. With it set at 600 that same guest now boots Ok > now every time I've tried. > > But I did notice the whole 'SMP AP CPU #x Launched!' takes forever, and > varies a lot (e.g. one boot it took nearly 2 minutes to launch all CPU's > and continue). > > I removed the PCI passthroughs on that guest, and it now flies through > the AP launches. Unfortunately though I need the passthroughs :( > > I've passed through the onboard LSI 2308 SAS controller (mps), and a > dual port PCI-E Intel NIC (igb) - all the passthroughs work on FreeBSD > once it's booted - but obviously, not without causing the slow AP CPU > launches. I've passed through a dual port BCE card (Broadcom NetXtreme II BCM5709) without problems. As a test, could you try to only pass the nic or the SAS controller to see if we can figure out if this is specific to one of the devices? > I also remembered I set 'hw.pci.enable_msi=1' and 'hw.pci.enable_msix=0' > in /etc/sysctl.conf - someone else found that was necessary to use the > LSI in passthrough mode. > > Aside from the slow launches, do you think (as they work) it's going to > cause issues leaving those passthroughs active? Not sure, still have to figure out what's going on. Roger. From owner-freebsd-xen@FreeBSD.ORG Mon Feb 24 22:30:33 2014 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id A1DBEA60 for ; Mon, 24 Feb 2014 22:30:33 +0000 (UTC) Received: from mail.tdx.com (mail.tdx.com [62.13.128.18]) by mx1.freebsd.org (Postfix) with ESMTP id 407B01E18 for ; Mon, 24 Feb 2014 22:30:32 +0000 (UTC) Received: from study64.tdx.co.uk (study64.tdx.co.uk [62.13.130.231]) (authenticated bits=0) by mail.tdx.com (8.14.3/8.14.3/) with ESMTP id s1OMUKML013266 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Mon, 24 Feb 2014 22:30:22 GMT Date: Mon, 24 Feb 2014 22:30:20 +0000 From: Karl Pielorz To: =?UTF-8?Q?Roger_Pau_Monn=C3=A9?= , freebsd-xen@freebsd.org Subject: Re: FreeBSD 10-R 8 vCPU panics at boot under XenServer (on 8 'core' CPU) Message-ID: In-Reply-To: <530B7F2F.2010908@citrix.com> References: <6A3B878077F7D071847052C0@Mail-PC.tdx.co.uk> <5302311E.2040700@citrix.com> <1740E0FEE5963358491F4B37@study64.tdx.co.uk> <530B7F2F.2010908@citrix.com> X-Mailer: Mulberry/4.0.8 (Mac OS X) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: quoted-printable Content-Disposition: inline X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 24 Feb 2014 22:30:33 -0000 --On 24 February 2014 18:19:43 +0100 Roger Pau Monn=C3=A9=20 wrote: > I've passed through a dual port BCE card (Broadcom NetXtreme II BCM5709) > without problems. As a test, could you try to only pass the nic or the > SAS controller to see if we can figure out if this is specific to one of > the devices? Ok, I tried several boots just passing through the LSI - all boots=20 succeeded. There's quite a variance between how long it takes to 'launch'=20 the CPU's. On a good run you'll get 'Netvsc initializing' small pause, then = Launches 5 CPU's, another small pause - and the remaining 2 launch. On a bad boot you'll get quite a long pause before the first launch, then a = few more pop in - then a very long pause before the final one(s) launch. I then changed to just passing through the NIC's - you get similar results=20 - it's markedly slower than if nothing is passed through, but not so slow=20 it fails. It's only if you pass through the NIC's and the LSI - it's *really* slow -=20 to the point that without upping the NUM_RETRIES in the patch you did it=20 often panics (unable to schedule timer). Some of these boots can take=20 minutes (but, shut down the VM and try it again and it'll complete=20 "relatively quickly" - i.e. 20-30 seconds). I can probably video some of the boots and give you a link off list to the=20 footage (that'd probably give you a better idea of the timing involved). I don't have the other machine running at the moment - so I can't do any=20 testing of what performance you actually get from the passed through=20 devices - they 'seem' to work ok from the limited testing I've done. -Karl From owner-freebsd-xen@FreeBSD.ORG Mon Mar 3 11:06:57 2014 Return-Path: Delivered-To: freebsd-xen@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id DF02AF54 for ; Mon, 3 Mar 2014 11:06:56 +0000 (UTC) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:1900:2254:206c::16:87]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id C648F962 for ; Mon, 3 Mar 2014 11:06:56 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.8/8.14.8) with ESMTP id s23B6umh008741 for ; Mon, 3 Mar 2014 11:06:56 GMT (envelope-from owner-bugmaster@FreeBSD.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.8/8.14.8/Submit) id s23B6u5O008739 for freebsd-xen@FreeBSD.org; Mon, 3 Mar 2014 11:06:56 GMT (envelope-from owner-bugmaster@FreeBSD.org) Date: Mon, 3 Mar 2014 11:06:56 GMT Message-Id: <201403031106.s23B6u5O008739@freefall.freebsd.org> X-Authentication-Warning: freefall.freebsd.org: gnats set sender to owner-bugmaster@FreeBSD.org using -f From: FreeBSD bugmaster To: freebsd-xen@FreeBSD.org Subject: Current problem reports assigned to freebsd-xen@FreeBSD.org X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 03 Mar 2014 11:06:57 -0000 Note: to view an individual PR, use: http://www.freebsd.org/cgi/query-pr.cgi?pr=(number). The following is a listing of current problems submitted by FreeBSD users. These represent problem reports covering all versions including experimental development code and obsolete releases. S Tracker Resp. Description -------------------------------------------------------------------------------- o kern/183139 xen [xen] [patch] ifconfig options on xn0 lost after xen v o kern/180788 xen [xen] [panic] XEN PV kernel 9.2-BETA1 panics on boot o kern/180403 xen [xen] Problems with GENERIC and XENHVM kernels with Xe o kern/180402 xen [xen] XEN kernel does not load in XenClient 4.5.5 o kern/179814 xen [xen] mountroot fails with error=19 under Xen on 9-STA o kern/176471 xen [xen] xn driver crash on detach o kern/176053 xen [xen] [patch] i386: Correct wrong usage of vsnprintf() o kern/175954 xen [xen] XENHVM xn network driver extreme packet loss dur o kern/175822 xen [xen] FreeBSD 9.1 does not work with Xen 4.0 o kern/175757 xen [xen] [patch] xen pvhvm looses keyboard input from VNC o kern/171873 xen [xen] xn network device floods warning in dmesg o kern/171118 xen [xen] FreeBSD XENHVM guest doesn't shutdown cleanly o kern/166174 xen [xen] Problems ROOT MOUNT ERROR o kern/165418 xen [xen] Problems mounting root filesystem from XENHVM o kern/164630 xen [xen] XEN HVM kernel: run_interrupt_driven_hooks: stil o kern/164450 xen [xen] Failed to install FreeeBSD 9.0-RELEASE from CD i o kern/162677 xen [xen] FreeBSD not compatible with "Current Stable Xen" o kern/161318 xen [xen] sysinstall crashes with floating point exception o kern/155468 xen [xen] Xen PV i386 multi-kernel CPU system is not worki o kern/155353 xen [xen] [patch] put "nudging TOD" message under boot_ver o kern/154833 xen [xen]: xen 4.0 - DomU freebsd8.2RC3 i386, XEN kernel. o kern/154473 xen [xen] xen 4.0 - DomU freebsd8.1 i386, XEN kernel. Not o kern/154472 xen [xen] xen 4.0 - DomU freebsd8.1 i386 xen kernel reboot o kern/154428 xen [xen] xn0 network interface and PF - Massive performan o kern/153674 xen [xen] i386/XEN idle thread shows wrong percentages o kern/153672 xen [xen] [panic] i386/XEN panics under heavy fork load o kern/153620 xen [xen] Xen guest system clock drifts in AWS EC2 (FreeBS o kern/153477 xen [xen] XEN pmap code abuses vm page queue lock o kern/153150 xen [xen] xen/ec2: disable checksum offloading on interfac o kern/152228 xen [xen] [panic] Xen/PV panic with machdep.idle_mwait=1 o kern/144629 xen [xen] FreeBSD 8-RELEASE XEN pvm networking doesn't wor o kern/143398 xen [xen] FreeBSD 8-RELEASE XEN pvm networking doesn't wor o kern/143340 xen [xen] FreeBSD 8-RELEASE XEN pvm networking doesn't wor f kern/143069 xen [xen] [panic] Xen Kernel Panic - Memory modified after f kern/135667 xen ufs filesystem corruption on XEN DomU system f kern/135421 xen [xen] FreeBSD Xen PVM DomU network failure - netfronc. f kern/135178 xen [xen] Xen domU outgoing data transfer stall when TSO i p kern/135069 xen [xen] FreeBSD-current/Xen SMP doesn't function at all f i386/124516 xen [xen] FreeBSD-CURRENT Xen Kernel Segfaults when config o kern/118734 xen [xen] FreeBSD 6.3-RC1 and FreeBSD 7.0-BETA 4 fail to b 40 problems total. From owner-freebsd-xen@FreeBSD.ORG Thu Mar 6 13:13:23 2014 Return-Path: Delivered-To: freebsd-xen@smarthost.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 94E4B45F; Thu, 6 Mar 2014 13:13:23 +0000 (UTC) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:1900:2254:206c::16:87]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 6AC9FD5; Thu, 6 Mar 2014 13:13:23 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.8/8.14.8) with ESMTP id s26DDNWY080371; Thu, 6 Mar 2014 13:13:23 GMT (envelope-from feld@freefall.freebsd.org) Received: (from feld@localhost) by freefall.freebsd.org (8.14.8/8.14.8/Submit) id s26DDNg9080370; Thu, 6 Mar 2014 13:13:23 GMT (envelope-from feld) Date: Thu, 6 Mar 2014 13:13:23 GMT Message-Id: <201403061313.s26DDNg9080370@freefall.freebsd.org> To: feld@feld.me, feld@FreeBSD.org, freebsd-xen@FreeBSD.org From: feld@FreeBSD.org Subject: Re: kern/171118: [xen] FreeBSD XENHVM guest doesn't shutdown cleanly X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 06 Mar 2014 13:13:23 -0000 Synopsis: [xen] FreeBSD XENHVM guest doesn't shutdown cleanly State-Changed-From-To: open->closed State-Changed-By: feld State-Changed-When: Thu Mar 6 13:13:23 UTC 2014 State-Changed-Why: Confirmed that this made it into 10.0-RELEASE http://www.freebsd.org/cgi/query-pr.cgi?pr=171118 From owner-freebsd-xen@FreeBSD.ORG Mon Mar 10 11:06:57 2014 Return-Path: Delivered-To: freebsd-xen@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id AE1D3212 for ; Mon, 10 Mar 2014 11:06:57 +0000 (UTC) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:1900:2254:206c::16:87]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 9220782B for ; Mon, 10 Mar 2014 11:06:57 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.8/8.14.8) with ESMTP id s2AB6vfW043440 for ; Mon, 10 Mar 2014 11:06:57 GMT (envelope-from owner-bugmaster@FreeBSD.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.8/8.14.8/Submit) id s2AB6vqs043438 for freebsd-xen@FreeBSD.org; Mon, 10 Mar 2014 11:06:57 GMT (envelope-from owner-bugmaster@FreeBSD.org) Date: Mon, 10 Mar 2014 11:06:57 GMT Message-Id: <201403101106.s2AB6vqs043438@freefall.freebsd.org> X-Authentication-Warning: freefall.freebsd.org: gnats set sender to owner-bugmaster@FreeBSD.org using -f From: FreeBSD bugmaster To: freebsd-xen@FreeBSD.org Subject: Current problem reports assigned to freebsd-xen@FreeBSD.org X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 10 Mar 2014 11:06:57 -0000 Note: to view an individual PR, use: http://www.freebsd.org/cgi/query-pr.cgi?pr=(number). The following is a listing of current problems submitted by FreeBSD users. These represent problem reports covering all versions including experimental development code and obsolete releases. S Tracker Resp. Description -------------------------------------------------------------------------------- o kern/183139 xen [xen] [patch] ifconfig options on xn0 lost after xen v o kern/180788 xen [xen] [panic] XEN PV kernel 9.2-BETA1 panics on boot o kern/180403 xen [xen] Problems with GENERIC and XENHVM kernels with Xe o kern/180402 xen [xen] XEN kernel does not load in XenClient 4.5.5 o kern/179814 xen [xen] mountroot fails with error=19 under Xen on 9-STA o kern/176471 xen [xen] xn driver crash on detach o kern/176053 xen [xen] [patch] i386: Correct wrong usage of vsnprintf() o kern/175954 xen [xen] XENHVM xn network driver extreme packet loss dur o kern/175822 xen [xen] FreeBSD 9.1 does not work with Xen 4.0 o kern/175757 xen [xen] [patch] xen pvhvm looses keyboard input from VNC o kern/171873 xen [xen] xn network device floods warning in dmesg o kern/166174 xen [xen] Problems ROOT MOUNT ERROR o kern/165418 xen [xen] Problems mounting root filesystem from XENHVM o kern/164630 xen [xen] XEN HVM kernel: run_interrupt_driven_hooks: stil o kern/164450 xen [xen] Failed to install FreeeBSD 9.0-RELEASE from CD i o kern/162677 xen [xen] FreeBSD not compatible with "Current Stable Xen" o kern/161318 xen [xen] sysinstall crashes with floating point exception o kern/155468 xen [xen] Xen PV i386 multi-kernel CPU system is not worki o kern/155353 xen [xen] [patch] put "nudging TOD" message under boot_ver o kern/154833 xen [xen]: xen 4.0 - DomU freebsd8.2RC3 i386, XEN kernel. o kern/154473 xen [xen] xen 4.0 - DomU freebsd8.1 i386, XEN kernel. Not o kern/154472 xen [xen] xen 4.0 - DomU freebsd8.1 i386 xen kernel reboot o kern/154428 xen [xen] xn0 network interface and PF - Massive performan o kern/153674 xen [xen] i386/XEN idle thread shows wrong percentages o kern/153672 xen [xen] [panic] i386/XEN panics under heavy fork load o kern/153620 xen [xen] Xen guest system clock drifts in AWS EC2 (FreeBS o kern/153477 xen [xen] XEN pmap code abuses vm page queue lock o kern/153150 xen [xen] xen/ec2: disable checksum offloading on interfac o kern/152228 xen [xen] [panic] Xen/PV panic with machdep.idle_mwait=1 o kern/144629 xen [xen] FreeBSD 8-RELEASE XEN pvm networking doesn't wor o kern/143398 xen [xen] FreeBSD 8-RELEASE XEN pvm networking doesn't wor o kern/143340 xen [xen] FreeBSD 8-RELEASE XEN pvm networking doesn't wor f kern/143069 xen [xen] [panic] Xen Kernel Panic - Memory modified after f kern/135667 xen ufs filesystem corruption on XEN DomU system f kern/135421 xen [xen] FreeBSD Xen PVM DomU network failure - netfronc. f kern/135178 xen [xen] Xen domU outgoing data transfer stall when TSO i p kern/135069 xen [xen] FreeBSD-current/Xen SMP doesn't function at all f i386/124516 xen [xen] FreeBSD-CURRENT Xen Kernel Segfaults when config o kern/118734 xen [xen] FreeBSD 6.3-RC1 and FreeBSD 7.0-BETA 4 fail to b 39 problems total. From owner-freebsd-xen@FreeBSD.ORG Mon Mar 17 11:06:57 2014 Return-Path: Delivered-To: freebsd-xen@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 7C547C22 for ; Mon, 17 Mar 2014 11:06:57 +0000 (UTC) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:1900:2254:206c::16:87]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 687C02B7 for ; Mon, 17 Mar 2014 11:06:57 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.8/8.14.8) with ESMTP id s2HB6viE011486 for ; Mon, 17 Mar 2014 11:06:57 GMT (envelope-from owner-bugmaster@FreeBSD.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.8/8.14.8/Submit) id s2HB6ukb011484 for freebsd-xen@FreeBSD.org; Mon, 17 Mar 2014 11:06:56 GMT (envelope-from owner-bugmaster@FreeBSD.org) Date: Mon, 17 Mar 2014 11:06:56 GMT Message-Id: <201403171106.s2HB6ukb011484@freefall.freebsd.org> X-Authentication-Warning: freefall.freebsd.org: gnats set sender to owner-bugmaster@FreeBSD.org using -f From: FreeBSD bugmaster To: freebsd-xen@FreeBSD.org Subject: Current problem reports assigned to freebsd-xen@FreeBSD.org X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 17 Mar 2014 11:06:57 -0000 Note: to view an individual PR, use: http://www.freebsd.org/cgi/query-pr.cgi?pr=(number). The following is a listing of current problems submitted by FreeBSD users. These represent problem reports covering all versions including experimental development code and obsolete releases. S Tracker Resp. Description -------------------------------------------------------------------------------- o kern/183139 xen [xen] [patch] ifconfig options on xn0 lost after xen v o kern/180788 xen [xen] [panic] XEN PV kernel 9.2-BETA1 panics on boot o kern/180403 xen [xen] Problems with GENERIC and XENHVM kernels with Xe o kern/180402 xen [xen] XEN kernel does not load in XenClient 4.5.5 o kern/179814 xen [xen] mountroot fails with error=19 under Xen on 9-STA o kern/176471 xen [xen] xn driver crash on detach o kern/176053 xen [xen] [patch] i386: Correct wrong usage of vsnprintf() o kern/175954 xen [xen] XENHVM xn network driver extreme packet loss dur o kern/175822 xen [xen] FreeBSD 9.1 does not work with Xen 4.0 o kern/175757 xen [xen] [patch] xen pvhvm looses keyboard input from VNC o kern/171873 xen [xen] xn network device floods warning in dmesg o kern/166174 xen [xen] Problems ROOT MOUNT ERROR o kern/165418 xen [xen] Problems mounting root filesystem from XENHVM o kern/164630 xen [xen] XEN HVM kernel: run_interrupt_driven_hooks: stil o kern/164450 xen [xen] Failed to install FreeeBSD 9.0-RELEASE from CD i o kern/162677 xen [xen] FreeBSD not compatible with "Current Stable Xen" o kern/161318 xen [xen] sysinstall crashes with floating point exception o kern/155468 xen [xen] Xen PV i386 multi-kernel CPU system is not worki o kern/155353 xen [xen] [patch] put "nudging TOD" message under boot_ver o kern/154833 xen [xen]: xen 4.0 - DomU freebsd8.2RC3 i386, XEN kernel. o kern/154473 xen [xen] xen 4.0 - DomU freebsd8.1 i386, XEN kernel. Not o kern/154472 xen [xen] xen 4.0 - DomU freebsd8.1 i386 xen kernel reboot o kern/154428 xen [xen] xn0 network interface and PF - Massive performan o kern/153674 xen [xen] i386/XEN idle thread shows wrong percentages o kern/153672 xen [xen] [panic] i386/XEN panics under heavy fork load o kern/153620 xen [xen] Xen guest system clock drifts in AWS EC2 (FreeBS o kern/153477 xen [xen] XEN pmap code abuses vm page queue lock o kern/153150 xen [xen] xen/ec2: disable checksum offloading on interfac o kern/152228 xen [xen] [panic] Xen/PV panic with machdep.idle_mwait=1 o kern/144629 xen [xen] FreeBSD 8-RELEASE XEN pvm networking doesn't wor o kern/143398 xen [xen] FreeBSD 8-RELEASE XEN pvm networking doesn't wor o kern/143340 xen [xen] FreeBSD 8-RELEASE XEN pvm networking doesn't wor f kern/143069 xen [xen] [panic] Xen Kernel Panic - Memory modified after f kern/135667 xen ufs filesystem corruption on XEN DomU system f kern/135421 xen [xen] FreeBSD Xen PVM DomU network failure - netfronc. f kern/135178 xen [xen] Xen domU outgoing data transfer stall when TSO i p kern/135069 xen [xen] FreeBSD-current/Xen SMP doesn't function at all f i386/124516 xen [xen] FreeBSD-CURRENT Xen Kernel Segfaults when config o kern/118734 xen [xen] FreeBSD 6.3-RC1 and FreeBSD 7.0-BETA 4 fail to b 39 problems total. From owner-freebsd-xen@FreeBSD.ORG Mon Mar 17 17:00:18 2014 Return-Path: Delivered-To: freebsd-xen@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id A6BEC7A1 for ; Mon, 17 Mar 2014 17:00:18 +0000 (UTC) Received: from mail.tdx.com (mail.tdx.com [62.13.128.18]) by mx1.freebsd.org (Postfix) with ESMTP id 6F115CD0 for ; Mon, 17 Mar 2014 17:00:14 +0000 (UTC) Received: from Mail-PC.tdx.co.uk (storm.tdx.co.uk [62.13.130.251]) (authenticated bits=0) by mail.tdx.com (8.14.3/8.14.3/) with ESMTP id s2HGx7nu089344 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO) for ; Mon, 17 Mar 2014 16:59:07 GMT Date: Mon, 17 Mar 2014 16:59:06 +0000 From: Karl Pielorz To: freebsd-xen@FreeBSD.org Subject: FBSD 10.0-S (r261289M) under XenServer 6.2 - Stuck sshd in urdlck? Message-ID: <4B8380EBE379080FAD3271FA@Mail-PC.tdx.co.uk> X-Mailer: Mulberry/4.0.8 (Win32) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit Content-Disposition: inline X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 17 Mar 2014 17:00:18 -0000 Hi, I setup a VM a while ago under XenServer 6.2 - it's an amd64 FBSD 10.0-S box (based on r261289) - it's running under Xen PVHVM. I set it up - and left it for a while (46 days). I went to ssh to it today, and got: " ssh_exchange_identification: Connection closed by remote host " Getting on to the boxes console there's lots of what look to be 'stuck' sshd processes? 0 3933 895 0 20 0 84868 6944 urdlck Is - 0:00.01 sshd: unknown [priv] (sshd) 22 3934 3933 0 20 0 0 0 - Z - 0:00.00 0 3935 3933 0 20 0 84868 6952 sbwait I - 0:00.00 sshd: unknown [pam] (sshd) 0 4338 895 0 20 0 84868 6944 urdlck Is - 0:00.01 sshd: unknown [priv] (sshd) 22 4339 4338 0 20 0 0 0 - Z - 0:00.00 Anyone know what 'urdlck' is? There's 126 of these processes, e.g. 5446 - I 0:00.00 sshd: unknown [pam] (sshd) 5450 - Is 0:00.01 sshd: unknown [priv] (sshd) 5452 - I 0:00.00 sshd: unknown [pam] (sshd) 5453 - Is 0:00.01 sshd: unknown [priv] (sshd) Bearing in mind the box is firewalled from ssh access, and no one (apart from me today) has attempted to get onto the box with ssh - this is a little concerning. Every about 5-10 connects will actually 'connect' - the rest just result in the 'key exchange' error. Kernel is GENERIC with: options NO_ADAPTIVE_MUTEXES options NO_ADAPTIVE_RWLOCKS options NO_ADAPTIVE_SX There's nothing logged in dmesg, or syslog. Is there anything worth doing to this VM before I restart it - i.e. to try and figure out what's happened? / troubleshoot? -Karl From owner-freebsd-xen@FreeBSD.ORG Mon Mar 17 17:18:24 2014 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 2D7A4DFF for ; Mon, 17 Mar 2014 17:18:24 +0000 (UTC) Received: from SMTP.CITRIX.COM (smtp.citrix.com [66.165.176.89]) (using TLSv1 with cipher RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 65D05ECB for ; Mon, 17 Mar 2014 17:18:22 +0000 (UTC) X-IronPort-AV: E=Sophos;i="4.97,671,1389744000"; d="scan'208";a="112190630" Received: from accessns.citrite.net (HELO FTLPEX01CL03.citrite.net) ([10.9.154.239]) by FTLPIPO01.CITRIX.COM with ESMTP; 17 Mar 2014 17:17:55 +0000 Received: from [IPv6:::1] (10.80.16.47) by smtprelay.citrix.com (10.13.107.80) with Microsoft SMTP Server id 14.2.342.4; Mon, 17 Mar 2014 13:17:54 -0400 Message-ID: <53272E41.3050409@citrix.com> Date: Mon, 17 Mar 2014 18:17:53 +0100 From: =?ISO-8859-1?Q?Roger_Pau_Monn=E9?= User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.7; rv:24.0) Gecko/20100101 Thunderbird/24.3.0 MIME-Version: 1.0 To: Karl Pielorz , Subject: Re: FBSD 10.0-S (r261289M) under XenServer 6.2 - Stuck sshd in urdlck? References: <4B8380EBE379080FAD3271FA@Mail-PC.tdx.co.uk> In-Reply-To: <4B8380EBE379080FAD3271FA@Mail-PC.tdx.co.uk> X-Enigmail-Version: 1.6 Content-Type: text/plain; charset="ISO-8859-1" Content-Transfer-Encoding: 7bit X-DLP: MIA2 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 17 Mar 2014 17:18:24 -0000 On 17/03/14 17:59, Karl Pielorz wrote: > > Hi, > > I setup a VM a while ago under XenServer 6.2 - it's an amd64 FBSD 10.0-S > box (based on r261289) - it's running under Xen PVHVM. > > I set it up - and left it for a while (46 days). I went to ssh to it > today, and got: > > " > ssh_exchange_identification: Connection closed by remote host > " > > Getting on to the boxes console there's lots of what look to be 'stuck' > sshd processes? > > 0 3933 895 0 20 0 84868 6944 urdlck Is - 0:00.01 sshd: unknown > [priv] (sshd) > 22 3934 3933 0 20 0 0 0 - Z - 0:00.00 > 0 3935 3933 0 20 0 84868 6952 sbwait I - 0:00.00 sshd: unknown > [pam] (sshd) > 0 4338 895 0 20 0 84868 6944 urdlck Is - 0:00.01 sshd: unknown > [priv] (sshd) > 22 4339 4338 0 20 0 0 0 - Z - 0:00.00 > > > Anyone know what 'urdlck' is? It seems like the process is stuck while trying to acquire a rw mutex in read mode. Could you obtain a backtrace of the process with gdb? Also a kernel-space dump might be useful, could you also run procstat -k ? > > There's 126 of these processes, e.g. > > 5446 - I 0:00.00 sshd: unknown [pam] (sshd) > 5450 - Is 0:00.01 sshd: unknown [priv] (sshd) > 5452 - I 0:00.00 sshd: unknown [pam] (sshd) > 5453 - Is 0:00.01 sshd: unknown [priv] (sshd) > > > Bearing in mind the box is firewalled from ssh access, and no one (apart > from me today) has attempted to get onto the box with ssh - this is a > little concerning. Every about 5-10 connects will actually 'connect' - > the rest just result in the 'key exchange' error. > > Kernel is GENERIC with: > > options NO_ADAPTIVE_MUTEXES > options NO_ADAPTIVE_RWLOCKS > options NO_ADAPTIVE_SX > > There's nothing logged in dmesg, or syslog. > > Is there anything worth doing to this VM before I restart it - i.e. to > try and figure out what's happened? / troubleshoot? > > -Karl > > _______________________________________________ > freebsd-xen@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-xen > To unsubscribe, send any mail to "freebsd-xen-unsubscribe@freebsd.org" From owner-freebsd-xen@FreeBSD.ORG Mon Mar 17 18:45:02 2014 Return-Path: Delivered-To: freebsd-xen@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 0EC998B4 for ; Mon, 17 Mar 2014 18:45:02 +0000 (UTC) Received: from mail.tdx.com (mail.tdx.com [62.13.128.18]) by mx1.freebsd.org (Postfix) with ESMTP id CA599A51 for ; Mon, 17 Mar 2014 18:45:01 +0000 (UTC) Received: from study64.tdx.co.uk (study64.tdx.co.uk [62.13.130.231]) (authenticated bits=0) by mail.tdx.com (8.14.3/8.14.3/) with ESMTP id s2HIiuZq098550 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Mon, 17 Mar 2014 18:44:57 GMT Date: Mon, 17 Mar 2014 18:44:56 +0000 From: Karl Pielorz To: =?UTF-8?Q?Roger_Pau_Monn=C3=A9?= , freebsd-xen@FreeBSD.org Subject: Re: FBSD 10.0-S (r261289M) under XenServer 6.2 - Stuck sshd in urdlck? Message-ID: <6534613783544E26A15CF44F@study64.tdx.co.uk> In-Reply-To: <53272E41.3050409@citrix.com> References: <4B8380EBE379080FAD3271FA@Mail-PC.tdx.co.uk> <53272E41.3050409@citrix.com> X-Mailer: Mulberry/4.0.8 (Mac OS X) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: quoted-printable Content-Disposition: inline X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 17 Mar 2014 18:45:02 -0000 --On 17 March 2014 18:17:53 +0100 Roger Pau Monn=C3=A9 = =20 wrote: >> Anyone know what 'urdlck' is? > > It seems like the process is stuck while trying to acquire a rw mutex in > read mode. Could you obtain a backtrace of the process with gdb? Ok, I think I did this right - let me know if I've not... # gdb /usr/sbin/sshd 5325 ... Attaching to program: /usr/sbin/sshd, process 5325 warning: current_sos: Can't read pathname for load map: Bad address [repeated several times] [lots of reading symbols from - 'no debugging symbols found' output] ... [New Thread 804006400 (LWP 100184/sshd)] [a few reading symbols - 'no debugging symbols found' output] Loaded symbols for /libexec/ld-elf.so.1 [Switching to Thread 804006400 (LWP 100184/sshd)] 0x00000008038eb89c in __error () from /lib/libthr.so.3 (gdb) bt #0 0x00000008038eb89c in __error () from /lib/libthr.so.3 #1 0x00000008038e921c in pthread_timedjoin_np () from /lib/libthr.so.3 #2 0x000000080064f9a2 in _rtld_get_stack_prot () from /libexec/ld-elf.so.1 #3 0x00000008006498c9 in r_debug_state () from /libexec/ld-elf.so.1 #4 0x00000008006470cd in .text () from /libexec/ld-elf.so.1 #5 0x0000000000000246 in ?? () #6 0x0000000000000000 in ?? () " > Also a > kernel-space dump might be useful, could you also run procstat -k ? procstat output is: " # procstat -k 5334 PID TID COMM TDNAME KSTACK 5334 100183 sshd - mi_switch=20 sleepq_catch_signals sleepq_wait_sig _sleep umtxq_sleep do_rw_rdlock=20 __umtx_op_rw_rdlock amd64_syscall Xfast_syscall " If you can briefly tell me how to do the kernel-space dump? Do I panic the=20 machine (i.e. cause a crash-dump?) somehow? Cheers & thanks for your reply, -Karl From owner-freebsd-xen@FreeBSD.ORG Tue Mar 18 08:44:33 2014 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 89048ECA for ; Tue, 18 Mar 2014 08:44:33 +0000 (UTC) Received: from SMTP.CITRIX.COM (smtp.citrix.com [66.165.176.89]) (using TLSv1 with cipher RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id BF56ECB5 for ; Tue, 18 Mar 2014 08:44:32 +0000 (UTC) X-IronPort-AV: E=Sophos;i="4.97,676,1389744000"; d="scan'208";a="112389170" Received: from accessns.citrite.net (HELO FTLPEX01CL02.citrite.net) ([10.9.154.239]) by FTLPIPO01.CITRIX.COM with ESMTP; 18 Mar 2014 08:44:29 +0000 Received: from [IPv6:::1] (10.80.16.47) by smtprelay.citrix.com (10.13.107.79) with Microsoft SMTP Server id 14.2.342.4; Tue, 18 Mar 2014 04:44:28 -0400 Message-ID: <5328076C.9000304@citrix.com> Date: Tue, 18 Mar 2014 09:44:28 +0100 From: =?UTF-8?B?Um9nZXIgUGF1IE1vbm7DqQ==?= User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.7; rv:24.0) Gecko/20100101 Thunderbird/24.3.0 MIME-Version: 1.0 To: Karl Pielorz , Subject: Re: FBSD 10.0-S (r261289M) under XenServer 6.2 - Stuck sshd in urdlck? References: <4B8380EBE379080FAD3271FA@Mail-PC.tdx.co.uk> <53272E41.3050409@citrix.com> <6534613783544E26A15CF44F@study64.tdx.co.uk> In-Reply-To: <6534613783544E26A15CF44F@study64.tdx.co.uk> X-Enigmail-Version: 1.6 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 8bit X-DLP: MIA2 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Mar 2014 08:44:33 -0000 On 17/03/14 19:44, Karl Pielorz wrote: > > > --On 17 March 2014 18:17:53 +0100 Roger Pau Monné > wrote: > >>> Anyone know what 'urdlck' is? >> >> It seems like the process is stuck while trying to acquire a rw mutex in >> read mode. Could you obtain a backtrace of the process with gdb? > > Ok, I think I did this right - let me know if I've not... > > # gdb /usr/sbin/sshd 5325 > ... > Attaching to program: /usr/sbin/sshd, process 5325 > > warning: current_sos: Can't read pathname for load map: Bad address > [repeated several times] > [lots of reading symbols from - 'no debugging symbols found' output] > ... > [New Thread 804006400 (LWP 100184/sshd)] > [a few reading symbols - 'no debugging symbols found' output] > Loaded symbols for /libexec/ld-elf.so.1 > [Switching to Thread 804006400 (LWP 100184/sshd)] > 0x00000008038eb89c in __error () from /lib/libthr.so.3 > (gdb) bt > #0 0x00000008038eb89c in __error () from /lib/libthr.so.3 > #1 0x00000008038e921c in pthread_timedjoin_np () from /lib/libthr.so.3 > #2 0x000000080064f9a2 in _rtld_get_stack_prot () from /libexec/ld-elf.so.1 > #3 0x00000008006498c9 in r_debug_state () from /libexec/ld-elf.so.1 > #4 0x00000008006470cd in .text () from /libexec/ld-elf.so.1 > #5 0x0000000000000246 in ?? () > #6 0x0000000000000000 in ?? () > " > >> Also a >> kernel-space dump might be useful, could you also run procstat -k ? > > procstat output is: > > " > # procstat -k 5334 > PID TID COMM TDNAME KSTACK > 5334 100183 sshd - mi_switch > sleepq_catch_signals sleepq_wait_sig _sleep umtxq_sleep do_rw_rdlock > __umtx_op_rw_rdlock amd64_syscall Xfast_syscall > " > > If you can briefly tell me how to do the kernel-space dump? Do I panic > the machine (i.e. cause a crash-dump?) somehow? The output of vmstat -ai might also be helpful to assure that event timers are working correctly. Also, does this VM have some PCI-passthrough? Did you migrate it? The xl configuration file used to create the domain would also be interesting. Also, could you try the same workload with a pristine GENERIC kernel? Roger. From owner-freebsd-xen@FreeBSD.ORG Tue Mar 18 09:47:31 2014 Return-Path: Delivered-To: freebsd-xen@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id B564C1A3 for ; Tue, 18 Mar 2014 09:47:31 +0000 (UTC) Received: from mail.tdx.com (mail.tdx.com [62.13.128.18]) by mx1.freebsd.org (Postfix) with ESMTP id 6456D3D5 for ; Tue, 18 Mar 2014 09:47:31 +0000 (UTC) Received: from Mail-PC.tdx.co.uk (storm.tdx.co.uk [62.13.130.251]) (authenticated bits=0) by mail.tdx.com (8.14.3/8.14.3/) with ESMTP id s2I9lRvm076801 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Tue, 18 Mar 2014 09:47:27 GMT Date: Tue, 18 Mar 2014 09:47:28 +0000 From: Karl Pielorz To: =?UTF-8?Q?Roger_Pau_Monn=C3=A9?= , freebsd-xen@FreeBSD.org Subject: Re: FBSD 10.0-S (r261289M) under XenServer 6.2 - Stuck sshd in urdlck? Message-ID: <0A15EC23852EB144F19A5228@Mail-PC.tdx.co.uk> In-Reply-To: <5328076C.9000304@citrix.com> References: <4B8380EBE379080FAD3271FA@Mail-PC.tdx.co.uk> <53272E41.3050409@citrix.com> <6534613783544E26A15CF44F@study64.tdx.co.uk> <5328076C.9000304@citrix.com> X-Mailer: Mulberry/4.0.8 (Win32) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: quoted-printable Content-Disposition: inline X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Mar 2014 09:47:31 -0000 --On 18 March 2014 09:44 +0100 Roger Pau Monn=C3=A9 =20 wrote: > The output of vmstat -ai might also be helpful to assure that event > timers are working correctly. Ok, that's at the bottom of this email. > Also, does this VM have some > PCI-passthrough? Did you migrate it? The xl configuration file used to > create the domain would also be interesting. VM has no passthrough (this is a completely separate system to the one I=20 was doing the passthrough work on), and was created 'from new' - from Xen=20 Center I did "VM, new VM" I used the "Other install media" template with 2 vCPU's and 2048Mb of RAM - = and fed it the FreeBSD 10.0-R amd64 install ISO. Single GPT partition, ufs=20 - and a small (2Gb SWAP partition). Once the system was running I installed subversion then did a svn checkout=20 of 'stable' source - rebuilt the world/kernel / installed the kernel/world=20 - and did the usual mergemaster updates. > Also, could you try the same workload with a pristine GENERIC kernel? Ok - I'll leave this VM 'as-is' If I get time I'll setup two new VM's - a=20 stock 10.0-R with stock GENERIC, and another one using the r261289M source=20 from this machine, but stock GENERIC kernel (the only mods I'd made were=20 the 'NO_ADAPTIVE_' changes as recommended by the xen man page). It may be a while before I know if sshd is going to get 'stuck' again - but = I'll keep an eye on them. -Karl vmstat Output: " # vmstat -ai interrupt total rate ??? 0 0 irq1: atkbd0 312 0 stray irq1 0 0 irq0: attimer0 0 0 stray irq0 0 0 irq3: 0 0 stray irq3 0 0 irq4: uart0 0 0 stray irq4 0 0 irq5: 0 0 stray irq5 0 0 irq6: 0 0 stray irq6 0 0 irq7: ppc0 0 0 stray irq7 0 0 irq8: atrtc0 0 0 stray irq8 0 0 irq9: acpi0 0 0 stray irq9 0 0 irq10: 0 0 stray irq10 0 0 irq11: 0 0 stray irq11 0 0 irq12: psm0 0 0 stray irq12 0 0 irq13: 0 0 stray irq13 0 0 irq14: ata0 0 0 stray irq14 0 0 irq15: ata1 2696605 0 stray irq15 0 0 irq16: 0 0 stray irq16 0 0 irq17: 0 0 stray irq17 0 0 irq18: 0 0 stray irq18 0 0 irq19: 0 0 stray irq19 0 0 irq20: 0 0 stray irq20 0 0 irq21: 0 0 stray irq21 0 0 irq22: 0 0 stray irq22 0 0 irq23: uhci0 21 0 stray irq23 0 0 irq24: 0 0 stray irq24 0 0 irq25: 0 0 stray irq25 0 0 irq26: 0 0 stray irq26 0 0 irq27: 0 0 stray irq27 0 0 irq28: 0 0 stray irq28 0 0 irq29: 0 0 stray irq29 0 0 irq30: xenpci0 0 0 stray irq30 0 0 irq31: 0 0 stray irq31 0 0 irq32: 0 0 stray irq32 0 0 irq33: 0 0 stray irq33 0 0 irq34: 0 0 stray irq34 0 0 irq35: 0 0 stray irq35 0 0 irq36: 0 0 stray irq36 0 0 irq37: 0 0 stray irq37 0 0 irq38: 0 0 stray irq38 0 0 irq39: 0 0 stray irq39 0 0 irq40: 0 0 stray irq40 0 0 irq41: 0 0 stray irq41 0 0 irq42: 0 0 stray irq42 0 0 irq43: 0 0 stray irq43 0 0 irq44: 0 0 stray irq44 0 0 irq45: 0 0 stray irq45 0 0 irq46: 0 0 stray irq46 0 0 irq47: 0 0 stray irq47 0 0 cpu0:timer 0 0 cpu0:xen 195870019 48 cpu1:xen 147437789 36 irq768: xen_et0:c0 124192981 30 stray irq768 0 0 irq769: xen_et0:c1 24519742 6 stray irq769 0 0 irq770: xenstore0 411992 0 stray irq770 0 0 irq771: xbd0 653984 0 stray irq771 0 0 irq772: xn0 34383547 8 stray irq772 0 0 cpu1:timer 0 0 irq773: cpu0:r 0 0 stray irq773 0 0 irq774: cpu0:itlb 0 0 stray irq774 0 0 irq775: cpu0:ipg 13761 0 stray irq775 0 0 irq776: cpu0:irg 19841089 4 stray irq776 0 0 irq777: cpu0:ic 0 0 stray irq777 0 0 irq778: cpu0:b 52076491 12 stray irq778 0 0 irq779: cpu0:st 0 0 stray irq779 0 0 irq780: cpu0:sp 0 0 stray irq780 0 0 irq781: cpu0:sth 0 0 stray irq781 0 0 irq782: cpu1:r 0 0 stray irq782 0 0 irq783: cpu1:itlb 0 0 stray irq783 0 0 irq784: cpu1:ipg 9162 0 stray irq784 0 0 irq785: cpu1:irg 16455346 4 stray irq785 0 0 irq786: cpu1:ic 0 0 stray irq786 0 0 irq787: cpu1:b 72199060 17 stray irq787 0 0 irq788: cpu1:st 0 0 stray irq788 0 0 irq789: cpu1:sp 0 0 stray irq789 0 0 irq790: cpu1:sth 0 0 stray irq790 0 0 Total 690761901 170 " From owner-freebsd-xen@FreeBSD.ORG Tue Mar 18 10:14:39 2014 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 4174AAAC for ; Tue, 18 Mar 2014 10:14:39 +0000 (UTC) Received: from mail-vc0-x233.google.com (mail-vc0-x233.google.com [IPv6:2607:f8b0:400c:c03::233]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id EECCE960 for ; Tue, 18 Mar 2014 10:14:38 +0000 (UTC) Received: by mail-vc0-f179.google.com with SMTP id ij19so6924497vcb.38 for ; Tue, 18 Mar 2014 03:14:38 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=references:in-reply-to:mime-version:content-transfer-encoding :content-type:message-id:cc:from:subject:date:to; bh=a3zCoX1CicK6CwRnF5gVVsff9XsX6XiGGFj2DPBJK7s=; b=PLvuovGE3BxgDMpNc/ZEYEh07VHhxth0KlhQw4mz7OdB6u0Bi33PsTlG1q3inZyCkp 094rGC19tuiqzv18wLaf7XmzQD5bya4glWg5mPsfhvMX+41YzwjD1QlcBq7sV3P+ai/S TCjzVHZFEnBwDDXIk8Q8P3jxa89/ffEleWEViulWp+tLqLuqLbzWzynbLb11LQ+tsLuB 0VxVBmeQFvWixCvoJaXOE3XNO/lQPaE/9Xh5rudqXobraeHT9UPod/wwTEKDNCuSuNLf hvLv3f5HFaw4x3vIoUjr93p7UnTjup61vxHGk/VbQEgwdWzHdlbbz62Goix2PGWR5vuR unUA== X-Received: by 10.220.95.139 with SMTP id d11mr11252755vcn.21.1395137678187; Tue, 18 Mar 2014 03:14:38 -0700 (PDT) Received: from [192.168.1.101] (179-236-4-200.user.veloxzone.com.br. [179.236.4.200]) by mx.google.com with ESMTPSA id ay4sm34668421vdc.6.2014.03.18.03.14.35 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Tue, 18 Mar 2014 03:14:36 -0700 (PDT) References: <4B8380EBE379080FAD3271FA@Mail-PC.tdx.co.uk> <53272E41.3050409@citrix.com> <6534613783544E26A15CF44F@study64.tdx.co.uk> <5328076C.9000304@citrix.com> <0A15EC23852EB144F19A5228@Mail-PC.tdx.co.uk> In-Reply-To: <0A15EC23852EB144F19A5228@Mail-PC.tdx.co.uk> Mime-Version: 1.0 (1.0) Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 Message-Id: <3F0F9C1A-5592-4BD7-959B-41E9FE82F3C4@gmail.com> X-Mailer: iPad Mail (9B206) From: Tiago Ribeiro Subject: Re: FBSD 10.0-S (r261289M) under XenServer 6.2 - Stuck sshd in urdlck? Date: Tue, 18 Mar 2014 07:14:35 -0300 To: Karl Pielorz Cc: "freebsd-xen@FreeBSD.org" X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Mar 2014 10:14:39 -0000 Em 18/03/2014, =C3=A0s 06:47, Karl Pielorz escreveu= : >=20 > --On 18 March 2014 09:44 +0100 Roger Pau Monn=C3=A9 = wrote: >=20 >> The output of vmstat -ai might also be helpful to assure that event >> timers are working correctly. >=20 > Ok, that's at the bottom of this email. >=20 >> Also, does this VM have some >> PCI-passthrough? Did you migrate it? The xl configuration file used to >> create the domain would also be interesting. >=20 > VM has no passthrough (this is a completely separate system to the one I w= as doing the passthrough work on), and was created 'from new' - from Xen Cen= ter I did "VM, new VM" >=20 > I used the "Other install media" template with 2 vCPU's and 2048Mb of RAM -= and fed it the FreeBSD 10.0-R amd64 install ISO. Single GPT partition, ufs -= and a small (2Gb SWAP partition). >=20 > Once the system was running I installed subversion then did a svn checkout= of 'stable' source - rebuilt the world/kernel / installed the kernel/world -= and did the usual mergemaster updates. >=20 >> Also, could you try the same workload with a pristine GENERIC kernel? >=20 > Ok - I'll leave this VM 'as-is' If I get time I'll setup two new VM's - a s= tock 10.0-R with stock GENERIC, and another one using the r261289M source fr= om this machine, but stock GENERIC kernel (the only mods I'd made were the '= NO_ADAPTIVE_' changes as recommended by the xen man page). >=20 > It may be a while before I know if sshd is going to get 'stuck' again - bu= t I'll keep an eye on them. >=20 > -Karl >=20 This problem seems to not be in virtualization, the FUG-BR are discussing th= is issue in SSH FreeBSD10.= From owner-freebsd-xen@FreeBSD.ORG Tue Mar 18 11:07:43 2014 Return-Path: Delivered-To: freebsd-xen@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 10503688 for ; Tue, 18 Mar 2014 11:07:43 +0000 (UTC) Received: from mail.tdx.com (mail.tdx.com [62.13.128.18]) by mx1.freebsd.org (Postfix) with ESMTP id C7596E3F for ; Tue, 18 Mar 2014 11:07:42 +0000 (UTC) Received: from Mail-PC.tdx.co.uk (storm.tdx.co.uk [62.13.130.251]) (authenticated bits=0) by mail.tdx.com (8.14.3/8.14.3/) with ESMTP id s2IB7dBr084193 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Tue, 18 Mar 2014 11:07:40 GMT Date: Tue, 18 Mar 2014 11:07:39 +0000 From: Karl Pielorz To: Tiago Ribeiro Subject: Re: FBSD 10.0-S (r261289M) under XenServer 6.2 - Stuck sshd in urdlck? Message-ID: <6BE837DA9C77A75B05B53672@Mail-PC.tdx.co.uk> In-Reply-To: <3F0F9C1A-5592-4BD7-959B-41E9FE82F3C4@gmail.com> References: <4B8380EBE379080FAD3271FA@Mail-PC.tdx.co.uk> <53272E41.3050409@citrix.com> <6534613783544E26A15CF44F@study64.tdx.co.uk> <5328076C.9000304@citrix.com> <0A15EC23852EB144F19A5228@Mail-PC.tdx.co.uk> <3F0F9C1A-5592-4BD7-959B-41E9FE82F3C4@gmail.com> X-Mailer: Mulberry/4.0.8 (Win32) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit Content-Disposition: inline Cc: freebsd-xen@FreeBSD.org X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Mar 2014 11:07:43 -0000 --On 18 March 2014 07:14 -0300 Tiago Ribeiro wrote: > This problem seems to not be in virtualization, the FUG-BR are discussing > this issue in SSH FreeBSD10. Hmmm that's interesting... None of our other 10.x boxes (bare metal) have had this issue yet - but being fair they're usually busy and at the moment get restarted regularly - so might be why we've not seen it on those. FUG-BR = Grupo Brasileiro de Usuarios de FreeBSD? - Do you know if they're going to raise the issue on the FreeBSD lists? [if they haven't already?] Thanks, -Karl From owner-freebsd-xen@FreeBSD.ORG Tue Mar 18 18:27:07 2014 Return-Path: Delivered-To: freebsd-xen@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id C3AA9D16 for ; Tue, 18 Mar 2014 18:27:07 +0000 (UTC) Received: from mail.tdx.com (mail.tdx.com [62.13.128.18]) by mx1.freebsd.org (Postfix) with ESMTP id 868FFA81 for ; Tue, 18 Mar 2014 18:27:07 +0000 (UTC) Received: from study64.tdx.co.uk (study64.tdx.co.uk [62.13.130.231]) (authenticated bits=0) by mail.tdx.com (8.14.3/8.14.3/) with ESMTP id s2IIR3Rs023465 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Tue, 18 Mar 2014 18:27:04 GMT Date: Tue, 18 Mar 2014 18:27:03 +0000 From: Karl Pielorz To: Tiago Ribeiro Subject: Re: FBSD 10.0-S (r261289M) under XenServer 6.2 - Stuck sshd in urdlck? Message-ID: <99F7D2597E4C027C4A2CA612@study64.tdx.co.uk> In-Reply-To: References: <4B8380EBE379080FAD3271FA@Mail-PC.tdx.co.uk> <53272E41.3050409@citrix.com> <6534613783544E26A15CF44F@study64.tdx.co.uk> <5328076C.9000304@citrix.com> <0A15EC23852EB144F19A5228@Mail-PC.tdx.co.uk> <3F0F9C1A-5592-4BD7-959B-41E9FE82F3C4@gmail.com> <6BE837DA9C77A75B05B53672@Mail-PC.tdx.co.uk> X-Mailer: Mulberry/4.0.8 (Mac OS X) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit Content-Disposition: inline Cc: freebsd-xen@FreeBSD.org X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Mar 2014 18:27:07 -0000 --On 18 March 2014 08:42:00 -0300 Tiago Ribeiro wrote: > I think some people report this error in oder list. > Here is part of email send to list: > >>> # ps afx >>> >>> 15961 - Is 0:00.02 sshd: wendell [priv] (sshd) >>> 15962 - Z 0:00.00 >>> >>> # uname -a >>> FreeBSD bacula 10.0-RELEASE FreeBSD 10.0-RELEASE #0 r260789: Thu Jan 16 >>> 22:34:59 UTC 2014 root@snap.freebsd.org:/usr/obj/usr/src/sys/GENERIC >>> amd64 Thanks, I found the thread using the above on -stable and have posted to that (it didn't mention urdlck - which is why I probably missed it the first time round with Google et'al). Regards and thanks for the replies, -Karl From owner-freebsd-xen@FreeBSD.ORG Mon Mar 24 11:06:56 2014 Return-Path: Delivered-To: freebsd-xen@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 8F7D42E2 for ; Mon, 24 Mar 2014 11:06:56 +0000 (UTC) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:1900:2254:206c::16:87]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 7BF99194 for ; Mon, 24 Mar 2014 11:06:56 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.8/8.14.8) with ESMTP id s2OB6ubu014071 for ; Mon, 24 Mar 2014 11:06:56 GMT (envelope-from owner-bugmaster@FreeBSD.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.8/8.14.8/Submit) id s2OB6usw014069 for freebsd-xen@FreeBSD.org; Mon, 24 Mar 2014 11:06:56 GMT (envelope-from owner-bugmaster@FreeBSD.org) Date: Mon, 24 Mar 2014 11:06:56 GMT Message-Id: <201403241106.s2OB6usw014069@freefall.freebsd.org> X-Authentication-Warning: freefall.freebsd.org: gnats set sender to owner-bugmaster@FreeBSD.org using -f From: FreeBSD bugmaster To: freebsd-xen@FreeBSD.org Subject: Current problem reports assigned to freebsd-xen@FreeBSD.org X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 24 Mar 2014 11:06:56 -0000 Note: to view an individual PR, use: http://www.freebsd.org/cgi/query-pr.cgi?pr=(number). The following is a listing of current problems submitted by FreeBSD users. These represent problem reports covering all versions including experimental development code and obsolete releases. S Tracker Resp. Description -------------------------------------------------------------------------------- o kern/183139 xen [xen] [patch] ifconfig options on xn0 lost after xen v o kern/180788 xen [xen] [panic] XEN PV kernel 9.2-BETA1 panics on boot o kern/180403 xen [xen] Problems with GENERIC and XENHVM kernels with Xe o kern/180402 xen [xen] XEN kernel does not load in XenClient 4.5.5 o kern/179814 xen [xen] mountroot fails with error=19 under Xen on 9-STA o kern/176471 xen [xen] xn driver crash on detach o kern/176053 xen [xen] [patch] i386: Correct wrong usage of vsnprintf() o kern/175954 xen [xen] XENHVM xn network driver extreme packet loss dur o kern/175822 xen [xen] FreeBSD 9.1 does not work with Xen 4.0 o kern/175757 xen [xen] [patch] xen pvhvm looses keyboard input from VNC o kern/171873 xen [xen] xn network device floods warning in dmesg o kern/166174 xen [xen] Problems ROOT MOUNT ERROR o kern/165418 xen [xen] Problems mounting root filesystem from XENHVM o kern/164630 xen [xen] XEN HVM kernel: run_interrupt_driven_hooks: stil o kern/164450 xen [xen] Failed to install FreeeBSD 9.0-RELEASE from CD i o kern/162677 xen [xen] FreeBSD not compatible with "Current Stable Xen" o kern/161318 xen [xen] sysinstall crashes with floating point exception o kern/155468 xen [xen] Xen PV i386 multi-kernel CPU system is not worki o kern/155353 xen [xen] [patch] put "nudging TOD" message under boot_ver o kern/154833 xen [xen]: xen 4.0 - DomU freebsd8.2RC3 i386, XEN kernel. o kern/154473 xen [xen] xen 4.0 - DomU freebsd8.1 i386, XEN kernel. Not o kern/154472 xen [xen] xen 4.0 - DomU freebsd8.1 i386 xen kernel reboot o kern/154428 xen [xen] xn0 network interface and PF - Massive performan o kern/153674 xen [xen] i386/XEN idle thread shows wrong percentages o kern/153672 xen [xen] [panic] i386/XEN panics under heavy fork load o kern/153620 xen [xen] Xen guest system clock drifts in AWS EC2 (FreeBS o kern/153477 xen [xen] XEN pmap code abuses vm page queue lock o kern/153150 xen [xen] xen/ec2: disable checksum offloading on interfac o kern/152228 xen [xen] [panic] Xen/PV panic with machdep.idle_mwait=1 o kern/144629 xen [xen] FreeBSD 8-RELEASE XEN pvm networking doesn't wor o kern/143398 xen [xen] FreeBSD 8-RELEASE XEN pvm networking doesn't wor o kern/143340 xen [xen] FreeBSD 8-RELEASE XEN pvm networking doesn't wor f kern/143069 xen [xen] [panic] Xen Kernel Panic - Memory modified after f kern/135667 xen ufs filesystem corruption on XEN DomU system f kern/135421 xen [xen] FreeBSD Xen PVM DomU network failure - netfronc. f kern/135178 xen [xen] Xen domU outgoing data transfer stall when TSO i p kern/135069 xen [xen] FreeBSD-current/Xen SMP doesn't function at all f i386/124516 xen [xen] FreeBSD-CURRENT Xen Kernel Segfaults when config o kern/118734 xen [xen] FreeBSD 6.3-RC1 and FreeBSD 7.0-BETA 4 fail to b 39 problems total. From owner-freebsd-xen@FreeBSD.ORG Mon Mar 24 21:35:16 2014 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id DCBBF122 for ; Mon, 24 Mar 2014 21:35:16 +0000 (UTC) Received: from plane.gmane.org (plane.gmane.org [80.91.229.3]) (using TLSv1 with cipher AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 94592D3B for ; Mon, 24 Mar 2014 21:35:15 +0000 (UTC) Received: from list by plane.gmane.org with local (Exim 4.69) (envelope-from ) id 1WSCWO-0007DE-48 for freebsd-xen@freebsd.org; Mon, 24 Mar 2014 22:35:04 +0100 Received: from 77.202.37.188.rev.vodafone.pt ([188.37.202.77]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Mon, 24 Mar 2014 22:35:04 +0100 Received: from miguelmclara by 77.202.37.188.rev.vodafone.pt with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Mon, 24 Mar 2014 22:35:04 +0100 X-Injected-Via-Gmane: http://gmane.org/ To: freebsd-xen@freebsd.org From: Miguel Clara Subject: Re: Panic with FreeBSD 10 RC2 on Netbsd Xen dom0 Date: Mon, 24 Mar 2014 21:18:27 +0000 (UTC) Lines: 21 Message-ID: References: <20131218001615.GA10501@moore.morphism.de> <52B24E18.7090109@gmail.com> <52B2AC26.2020301@citrix.com> <52CBB8D3.8090508@citrix.com> <6153b6b3-8ea9-4dc8-b039-7ab678e33b5e@email.android.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Complaints-To: usenet@ger.gmane.org X-Gmane-NNTP-Posting-Host: sea.gmane.org User-Agent: Loom/3.14 (http://gmane.org/) X-Loom-IP: 188.37.202.77 (Mozilla/5.0 (X11; FreeBSD amd64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/33.0.1750.152 Safari/537.36) X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 24 Mar 2014 21:35:16 -0000 Hi, sorry for the wait. I was looking into this this days... I'm considering changing the dom0, NetBSD has been stable for be, but I'm interested in having fetures like PCI PASSTROUGH work, which they don't at the moment. But even so I tried the propose r251297 and this one fails, and I believe this is the one o re-introduced the problem, I see this: --> #define NF_TSO_MAXBURST NetBSD doesn't support TSO, so it comes back to an would similar issue in FreeBSD 9, and I had a similar issue with Windows drivers, trying to use TSO... the dev also had to fix it... I understand those "pathces" are Linux Dom0 related.... I guess something dev's forget NETBSD is still there.... :P Anyway I'm not a dev so I could just be assuming stuff, but all I can tell is that with that release I still have the problem. From owner-freebsd-xen@FreeBSD.ORG Sat Mar 29 11:38:57 2014 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 120DDBE3 for ; Sat, 29 Mar 2014 11:38:57 +0000 (UTC) Received: from mail-qa0-x22a.google.com (mail-qa0-x22a.google.com [IPv6:2607:f8b0:400d:c00::22a]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id C96B378F for ; Sat, 29 Mar 2014 11:38:56 +0000 (UTC) Received: by mail-qa0-f42.google.com with SMTP id k15so6438568qaq.1 for ; Sat, 29 Mar 2014 04:38:56 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=kF17aS6mlHT3Lui22GnWgd1IubN1lmUHEIqP2msRO2E=; b=W2c0py4Qu7mI6aj7wRPLvHmV4mrg3+IRtxEVGvJlMWTblJMbTe0PHF0i3uyAk3e35W kRcFbiBM0nzfjTLv5lrAgX9e4L4ozhJwAxsVv2SLmThqXw0zKfPyNwF27e700gXAHgwz 9YSyJZXe8AfrvYu0mr9Ty5M649J0k5OyrNlHAZxEJDH+HnQQ9iRPVwOV5U/hUzSSa3c3 WGy0zHBFBkZLoNsWTnOlMhf+3xDTste5Nr+QOoVaXhoCmrCXuG301yQymWSK56d8ve4g DPhn82TQgmfZjvnvLfCpaCfy0OpDt5Nw4IpymP1eoiJIElX3uO+kOuct+IvfWlF6dkUN oGfw== MIME-Version: 1.0 X-Received: by 10.224.171.200 with SMTP id i8mr133861qaz.96.1396093135954; Sat, 29 Mar 2014 04:38:55 -0700 (PDT) Received: by 10.229.126.133 with HTTP; Sat, 29 Mar 2014 04:38:55 -0700 (PDT) Date: Sat, 29 Mar 2014 12:38:55 +0100 Message-ID: Subject: Terrible performance of XenServer 6.2 and FreeBSD 10.0-RELEASE guest From: Big Lebowski To: freebsd-xen@freebsd.org Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.17 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 29 Mar 2014 11:38:57 -0000 Hi all, I've just installed XenServer 6.2 along with all latest patches (SP1 and 014 update) on a machine that was previously a bare metal FreeBSD 9.2-R installation, running fast and smooth. That machine is a Quad Core cpu with 32GB of RAM: processor : 0 vendor_id : GenuineIntel cpu family : 6 model : 58 model name : Intel(R) Core(TM) i7-3770 CPU @ 3.40GHz stepping : 9 cpu MHz : 3400.086 cache size : 8192 KB physical id : 0 siblings : 1 core id : 0 cpu cores : 1 apicid : 0 initial apicid : 0 fdiv_bug : no hlt_bug : no f00f_bug : no coma_bug : no fpu : yes fpu_exception : yes cpuid level : 13 wp : yes flags : fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat clflush acpi mmx fxsr sse sse2 ss ht nx constant_tsc nonstop_tsc aperfmperf pni pclmulqdq vmx est ssse3 sse4_1 sse4_2 x2apic popcnt aes hypervisor ida arat tpr_shadow vnmi flexpriority ept vpid bogomips : 6835.86 clflush size : 64 cache_alignment : 64 address sizes : 36 bits physical, 48 bits virtual power management: and 2x 3TB SATA disks connected in software raid 1 (mdraid). After performing the updates on XenServer, I've installed first vm, FreeBSD 10.0-R amd64: FreeBSD poudriere 10.0-RELEASE FreeBSD 10.0-RELEASE #0 r260789: Thu Jan 16 22:34:59 UTC 2014 root@snap.freebsd.org:/usr/obj/usr/src/sys/GENERIC amd64 with 8 vcpu's, 8GB of RAM, and two vdisks, 8GB for /, and 100GB for /poudriere (both mounted with noatime). After playing a while with the vm (installing pkg, peforming portsnap fetch extract, installing poudriere) I've noticed extremely poor performance: * portsnap extract can take over 20 minutes to dump the ports tree * svnlite checkout of head/base takes ages and while it is happening, the vm is almost unusable: it freezes periodicaly so even typing in console is impossible, ls -la /usr/src takes few seconds to execute, the svnlite process displays checked files in chunks (it runs for a while, freezes, runs for a while again, and so on) I wonder if there's anything I am missing in running FreeBSD as XenServer guest? Linux vms on the same XenServer host are running faster by orders of magnitude, and fbsd is not just slower, its unusable. I'd appreciate any help! Regards, BL. From owner-freebsd-xen@FreeBSD.ORG Sat Mar 29 13:07:46 2014 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id E96481ED for ; Sat, 29 Mar 2014 13:07:46 +0000 (UTC) Received: from mail.feld.me (mail.feld.me [66.170.3.6]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client CN "mail.feld.me", Issuer "Gandi Standard SSL CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id A141FEA2 for ; Sat, 29 Mar 2014 13:07:46 +0000 (UTC) Received: from mail.feld.me (mail.feld.me [66.170.3.6]); by mail.feld.me (OpenSMTPD) with ESMTP id b7e85175; Sat, 29 Mar 2014 08:07:41 -0500 (CDT) Received: from feld@feld.me by mail.feld.me (Archiveopteryx 3.2.0) with esmtpsa id 1396098460-80816-3394/5/54; Sat, 29 Mar 2014 13:07:40 +0000 Content-Type: text/plain Mime-Version: 1.0 Subject: Re: Terrible performance of XenServer 6.2 and FreeBSD 10.0-RELEASE guest From: Mark Felder In-Reply-To: Date: Sat, 29 Mar 2014 08:07:38 -0500 Content-Transfer-Encoding: quoted-printable Message-Id: <8FDB514D-1A94-48B2-AE19-62923F327938@FreeBSD.org> References: To: Big Lebowski X-Mailer: Apple Mail (2.1874) Sender: feld@feld.me Cc: freebsd-xen@freebsd.org X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 29 Mar 2014 13:07:47 -0000 Is all this work being done over SSH? Do you have a pf firewall? Have = you disabled TSO? ifconfig xn0 -tso or sysctl net.inet.tcp.tso=3D0 My suspicion is that the slowness of the shell over the network is = making the machine seem slower than it should be. There are terrible = network issues with pf and tso on a XenServer environment. I'm not = otherwise aware of severe I/O issues on XenServer. I have a fairly large = cluster running almost all FreeBSD guests without any sort of issues = related to I/O. From owner-freebsd-xen@FreeBSD.ORG Sat Mar 29 13:30:30 2014 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id BC937C11; Sat, 29 Mar 2014 13:30:30 +0000 (UTC) Received: from mail-qg0-x230.google.com (mail-qg0-x230.google.com [IPv6:2607:f8b0:400d:c04::230]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 6CCB3152; Sat, 29 Mar 2014 13:30:30 +0000 (UTC) Received: by mail-qg0-f48.google.com with SMTP id j107so5523260qga.21 for ; Sat, 29 Mar 2014 06:30:29 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=44QR4J5WFDBIOfkOy0bnQTIdHdyDiTG7fY5dSGMjYRY=; b=krCGAHnrKbWcTCCjnfFFTrtySyBcxzuEBHuwL6T9sKxVQus0CXy+498FM/tADMeRiL 8PfvEi8hY6Cwt0jbWJKzvqAV+yPjfhghS/gDcc1vBsxBk37ISnHlWPjYGwmiACYQocKm tvS1NKW85sTsM6kj12QJ8ByXhzJ+O0FSLr0WQZ5C9tIqD+6f4iGF5DBUEOuKeOwDSHwd Ps4UrBF8UNREu1nQaY8751r+d3FvUKkR/skWMUIDf6Ve4wkN6oZ1C/PsdHrWJ0QBNp/A CMwYmP3J/ngBcG/aRoIxR5E5qcWT+HiMPRz5xaweceg6mPwMLZHG6WLs5znovEM6gwKu gqVg== MIME-Version: 1.0 X-Received: by 10.140.81.112 with SMTP id e103mr817004qgd.99.1396099829542; Sat, 29 Mar 2014 06:30:29 -0700 (PDT) Received: by 10.229.126.133 with HTTP; Sat, 29 Mar 2014 06:30:29 -0700 (PDT) In-Reply-To: <8FDB514D-1A94-48B2-AE19-62923F327938@FreeBSD.org> References: <8FDB514D-1A94-48B2-AE19-62923F327938@FreeBSD.org> Date: Sat, 29 Mar 2014 14:30:29 +0100 Message-ID: Subject: Re: Terrible performance of XenServer 6.2 and FreeBSD 10.0-RELEASE guest From: Big Lebowski To: Mark Felder Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.17 Cc: freebsd-xen@freebsd.org X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 29 Mar 2014 13:30:30 -0000 On Sat, Mar 29, 2014 at 2:07 PM, Mark Felder wrote: > Is all this work being done over SSH? Yes, this is done over SSH. > Do you have a pf firewall? No, I dont. > Have you disabled TSO? > > ifconfig xn0 -tso > > or > > sysctl net.inet.tcp.tso=0 > This was enabled, but I've now disabled it. However, the network I/O seems to be ok, on par with what I can achieve on Linux boxes. Its disk I/O that makes the system unusable. > > > My suspicion is that the slowness of the shell over the network is making > the machine seem slower than it should be. There are terrible network > issues with pf and tso on a XenServer environment. I'm not otherwise aware > of severe I/O issues on XenServer. I have a fairly large cluster running > almost all FreeBSD guests without any sort of issues related to I/O. > Thanks for the TSO tip! From owner-freebsd-xen@FreeBSD.ORG Sat Mar 29 14:17:21 2014 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 3977944D for ; Sat, 29 Mar 2014 14:17:21 +0000 (UTC) Received: from mail-qa0-x230.google.com (mail-qa0-x230.google.com [IPv6:2607:f8b0:400d:c00::230]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id EDCE16CB for ; Sat, 29 Mar 2014 14:17:20 +0000 (UTC) Received: by mail-qa0-f48.google.com with SMTP id m5so6341843qaj.21 for ; Sat, 29 Mar 2014 07:17:20 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=6IQ6PowYEdEDpFpb64l5m/T57JpprRg2pw92I1RqjkI=; b=Iue1/BiDBcvuXruF9ESnlKZMS91cI+PA6HGB2d2U/Kr2gOpmxZdzRMMxSDcbU++Vz9 z050AxMVJXK2gCMnbktxBwt5uA1lCPSPEnz24FjCmm/32lqpYH81c3+8B6BdHmdU/LHd 4XdHHFr8qEygCqHCR1qNOkqmNBNADInUt6SXbnycCGyaJruhbfXlOS8Ng2sziksm2CxD I2puUkDz6A3V66mvDvOidNGOKClELXhHQhXnfNaDkYlzUFXLkNHPIKZPET0W94H4FplO kVYsmGgVddTweGlA9QKPYY6b5PpRJ/9EHEWUR6unZ9XDhJw+yOmtT46HUyR3maKTunrr gxUw== MIME-Version: 1.0 X-Received: by 10.140.84.231 with SMTP id l94mr2533825qgd.75.1396102640093; Sat, 29 Mar 2014 07:17:20 -0700 (PDT) Received: by 10.229.126.133 with HTTP; Sat, 29 Mar 2014 07:17:20 -0700 (PDT) In-Reply-To: References: Date: Sat, 29 Mar 2014 15:17:20 +0100 Message-ID: Subject: Re: Terrible performance of XenServer 6.2 and FreeBSD 10.0-RELEASE guest From: Big Lebowski To: freebsd-xen@freebsd.org Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.17 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 29 Mar 2014 14:17:21 -0000 In addition to that, I've also noticed that even with xe guest utilitiest installed and started, neither halt nor shutdown -h now are working (they seem to stop the guest OS, but the vm stays up for the hypervisor and needs to be forced to shutdown/restart) and that the XenCenter console is not refreshing properly (it requires some additional movement, like cursor keys being used to refresh the screen). Regards, BL On Sat, Mar 29, 2014 at 12:38 PM, Big Lebowski wrote: > Hi all, > > I've just installed XenServer 6.2 along with all latest patches (SP1 and > 014 update) on a machine that was previously a bare metal FreeBSD 9.2-R > installation, running fast and smooth. > > That machine is a Quad Core cpu with 32GB of RAM: > > processor : 0 > vendor_id : GenuineIntel > cpu family : 6 > model : 58 > model name : Intel(R) Core(TM) i7-3770 CPU @ 3.40GHz > stepping : 9 > cpu MHz : 3400.086 > cache size : 8192 KB > physical id : 0 > siblings : 1 > core id : 0 > cpu cores : 1 > apicid : 0 > initial apicid : 0 > fdiv_bug : no > hlt_bug : no > f00f_bug : no > coma_bug : no > fpu : yes > fpu_exception : yes > cpuid level : 13 > wp : yes > flags : fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat clflush > acpi mmx fxsr sse sse2 ss ht nx constant_tsc nonstop_tsc aperfmperf pni > pclmulqdq vmx est ssse3 sse4_1 sse4_2 x2apic popcnt aes hypervisor ida arat > tpr_shadow vnmi flexpriority ept vpid > bogomips : 6835.86 > clflush size : 64 > cache_alignment : 64 > address sizes : 36 bits physical, 48 bits virtual > power management: > > and 2x 3TB SATA disks connected in software raid 1 (mdraid). > > After performing the updates on XenServer, I've installed first vm, > FreeBSD 10.0-R amd64: > > FreeBSD poudriere 10.0-RELEASE FreeBSD 10.0-RELEASE #0 r260789: Thu Jan 16 > 22:34:59 UTC 2014 root@snap.freebsd.org:/usr/obj/usr/src/sys/GENERIC > amd64 > > with 8 vcpu's, 8GB of RAM, and two vdisks, 8GB for /, and 100GB for > /poudriere (both mounted with noatime). After playing a while with the vm > (installing pkg, peforming portsnap fetch extract, installing poudriere) > I've noticed extremely poor performance: > > * portsnap extract can take over 20 minutes to dump the ports tree > * svnlite checkout of head/base takes ages and while it is happening, the > vm is almost unusable: it freezes periodicaly so even typing in console is > impossible, ls -la /usr/src takes few seconds to execute, the svnlite > process displays checked files in chunks (it runs for a while, freezes, > runs for a while again, and so on) > > I wonder if there's anything I am missing in running FreeBSD as XenServer > guest? Linux vms on the same XenServer host are running faster by orders of > magnitude, and fbsd is not just slower, its unusable. > > I'd appreciate any help! > > Regards, > BL. > From owner-freebsd-xen@FreeBSD.ORG Sat Mar 29 14:34:28 2014 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 67A309C9 for ; Sat, 29 Mar 2014 14:34:28 +0000 (UTC) Received: from mail-qc0-x22d.google.com (mail-qc0-x22d.google.com [IPv6:2607:f8b0:400d:c01::22d]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 250268B9 for ; Sat, 29 Mar 2014 14:34:28 +0000 (UTC) Received: by mail-qc0-f173.google.com with SMTP id r5so7188331qcx.18 for ; Sat, 29 Mar 2014 07:34:27 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=btdq0kBDjJ2pBtP6Q4XlRQyKoCjHf7QTasgypEgehBY=; b=fRwujEcNaxtTn7Bo373GPhFVHxJyo1n77EUkKTBCfeXOz7IpyXBqavSXd6sZIe88IY nCbSErLfdth9vU/D2Pt4Vc47Vbx6NMGnq7SWy+Cn2xEbCp61oUWCXiRiQI/cozsBG6eR pWn7H+aM25/I0vAqrG4L4yf7++JoneVqnpoU15rSwcpHip8NjqKvvaWRBA/yTypzZeDN RYXxWtvE065xgDUtsdPU0NPbtJvj+mCz7sYIW0lR5+30yQ60D/Lnx2/l7RmxziTTheEj eWvbRM7nmxa9Sji5cpI7A8V/hGN3S6gTlZUU2oZWis+txQvkfO4e8DRnGPNfSL0mbMSR 1YvQ== MIME-Version: 1.0 X-Received: by 10.140.81.112 with SMTP id e103mr1089963qgd.99.1396103667272; Sat, 29 Mar 2014 07:34:27 -0700 (PDT) Received: by 10.229.126.133 with HTTP; Sat, 29 Mar 2014 07:34:27 -0700 (PDT) In-Reply-To: References: Date: Sat, 29 Mar 2014 15:34:27 +0100 Message-ID: Subject: Re: Terrible performance of XenServer 6.2 and FreeBSD 10.0-RELEASE guest From: Big Lebowski To: freebsd-xen@freebsd.org Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.17 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 29 Mar 2014 14:34:28 -0000 To further clarify how does it looks like: * I am logging in via ssh * I am launching tmux with two windows * In first window I am starting svnlite checkout of base/head to /usr/src * I am immediately switching to second window - the OS is unusable even there, where the SSH delays caused by displaying lot of text should not be an issue When watching top, the OS has minimal load (around 0.1), often 100% idle, svnlite is consuming about 10-16% WCPU, and the system mostly freezes (it doesnt accept any keyboard input, nor updates the screen for a while, yet flashing the cursor) when svnlite is in getblk or kqread state. After few seconds it starts being responsive again (not causing any ssh timeouts or anything like that), does any keyboard input that was provided when it was freezed, and after few seconds freezes again. I am happy to provide any requested details, or even the machine for closer inspection. Right now I am trying to bump it up to -CURRENT to see if it happens as well on 11. Regards, BL On Sat, Mar 29, 2014 at 3:17 PM, Big Lebowski wrote: > In addition to that, I've also noticed that even with xe guest utilitiest > installed and started, neither halt nor shutdown -h now are working (they > seem to stop the guest OS, but the vm stays up for the hypervisor and needs > to be forced to shutdown/restart) and that the XenCenter console is not > refreshing properly (it requires some additional movement, like cursor keys > being used to refresh the screen). > > Regards, > BL > > > On Sat, Mar 29, 2014 at 12:38 PM, Big Lebowski wrote: > >> Hi all, >> >> I've just installed XenServer 6.2 along with all latest patches (SP1 and >> 014 update) on a machine that was previously a bare metal FreeBSD 9.2-R >> installation, running fast and smooth. >> >> That machine is a Quad Core cpu with 32GB of RAM: >> >> processor : 0 >> vendor_id : GenuineIntel >> cpu family : 6 >> model : 58 >> model name : Intel(R) Core(TM) i7-3770 CPU @ 3.40GHz >> stepping : 9 >> cpu MHz : 3400.086 >> cache size : 8192 KB >> physical id : 0 >> siblings : 1 >> core id : 0 >> cpu cores : 1 >> apicid : 0 >> initial apicid : 0 >> fdiv_bug : no >> hlt_bug : no >> f00f_bug : no >> coma_bug : no >> fpu : yes >> fpu_exception : yes >> cpuid level : 13 >> wp : yes >> flags : fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat clflush >> acpi mmx fxsr sse sse2 ss ht nx constant_tsc nonstop_tsc aperfmperf pni >> pclmulqdq vmx est ssse3 sse4_1 sse4_2 x2apic popcnt aes hypervisor ida arat >> tpr_shadow vnmi flexpriority ept vpid >> bogomips : 6835.86 >> clflush size : 64 >> cache_alignment : 64 >> address sizes : 36 bits physical, 48 bits virtual >> power management: >> >> and 2x 3TB SATA disks connected in software raid 1 (mdraid). >> >> After performing the updates on XenServer, I've installed first vm, >> FreeBSD 10.0-R amd64: >> >> FreeBSD poudriere 10.0-RELEASE FreeBSD 10.0-RELEASE #0 r260789: Thu Jan >> 16 22:34:59 UTC 2014 root@snap.freebsd.org:/usr/obj/usr/src/sys/GENERIC >> amd64 >> >> with 8 vcpu's, 8GB of RAM, and two vdisks, 8GB for /, and 100GB for >> /poudriere (both mounted with noatime). After playing a while with the vm >> (installing pkg, peforming portsnap fetch extract, installing poudriere) >> I've noticed extremely poor performance: >> >> * portsnap extract can take over 20 minutes to dump the ports tree >> * svnlite checkout of head/base takes ages and while it is happening, the >> vm is almost unusable: it freezes periodicaly so even typing in console is >> impossible, ls -la /usr/src takes few seconds to execute, the svnlite >> process displays checked files in chunks (it runs for a while, freezes, >> runs for a while again, and so on) >> >> I wonder if there's anything I am missing in running FreeBSD as XenServer >> guest? Linux vms on the same XenServer host are running faster by orders of >> magnitude, and fbsd is not just slower, its unusable. >> >> I'd appreciate any help! >> >> Regards, >> BL. >> > > From owner-freebsd-xen@FreeBSD.ORG Sat Mar 29 15:22:55 2014 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 6F5A61C3 for ; Sat, 29 Mar 2014 15:22:55 +0000 (UTC) Received: from mail-oa0-x229.google.com (mail-oa0-x229.google.com [IPv6:2607:f8b0:4003:c02::229]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 35856CA0 for ; Sat, 29 Mar 2014 15:22:55 +0000 (UTC) Received: by mail-oa0-f41.google.com with SMTP id j17so7412987oag.14 for ; Sat, 29 Mar 2014 08:22:54 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=9wnCLMV3kTqzJ18182HR56mYBCZ4gRB7qJ96hyxf9aQ=; b=xB5zn66bXV568nVWfeO0gUQPpGbu9qjtIorxHiGbEQ4p0Hfi/wzxubWkBHvWDUg/gp DSo4UlCqYJbRGaYB2+67IOAYdVPcUNWXOTqg4xQsLqlviPkK2sfTr8cwvn49RIIccaZb DKOtOTlgZTTLs/14qUDz1o0ScRSCVpAXpvlACdIRddxFmotFIujC91VF1qoVnAY5V15k S8WuOcaaba0BppI8cp9ChrNyGD0ds8bPXfv44FS1P4pw8pC1yzzk94Z1CVAQ2LlIa0P4 ObIEo3HSfMFt3tdwzm3CJP0WNfPp1ZKiFebf3TNYDNW1+aU+IZ+y9UqIWLsxG40l/iBZ AQ0A== MIME-Version: 1.0 X-Received: by 10.60.232.105 with SMTP id tn9mr12194191oec.11.1396106574539; Sat, 29 Mar 2014 08:22:54 -0700 (PDT) Received: by 10.76.170.4 with HTTP; Sat, 29 Mar 2014 08:22:54 -0700 (PDT) In-Reply-To: References: Date: Sat, 29 Mar 2014 11:22:54 -0400 Message-ID: Subject: Re: Terrible performance of XenServer 6.2 and FreeBSD 10.0-RELEASE guest From: Outback Dingo To: Big Lebowski Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.17 Cc: freebsd-xen@freebsd.org X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 29 Mar 2014 15:22:55 -0000 On Sat, Mar 29, 2014 at 10:34 AM, Big Lebowski wrote: > To further clarify how does it looks like: > > * I am logging in via ssh > * I am launching tmux with two windows > * In first window I am starting svnlite checkout of base/head to /usr/src > * I am immediately switching to second window - the OS is unusable even > there, where the SSH delays caused by displaying lot of text should not be > an issue > > When watching top, the OS has minimal load (around 0.1), often 100% idle, > svnlite is consuming about 10-16% WCPU, and the system mostly freezes (it > doesnt accept any keyboard input, nor updates the screen for a while, yet > flashing the cursor) when svnlite is in getblk or kqread state. After few > seconds it starts being responsive again (not causing any ssh timeouts or > anything like that), does any keyboard input that was provided when it was > freezed, and after few seconds freezes again. > > I am happy to provide any requested details, or even the machine for closer > inspection. Right now I am trying to bump it up to -CURRENT to see if it > happens as well on 11. > > Regards, > BL > > quite odd because we use XenServer 6.2 also with FreeBSD-10 and dont see > any degradation like you discuss, we also have xen utiities installed > we have used both ufs and zfs on fresh installs, recompiled from svn stable/10 > > On Sat, Mar 29, 2014 at 3:17 PM, Big Lebowski >wrote: > > > In addition to that, I've also noticed that even with xe guest > utilitiest > > installed and started, neither halt nor shutdown -h now are working (they > > seem to stop the guest OS, but the vm stays up for the hypervisor and > needs > > to be forced to shutdown/restart) and that the XenCenter console is not > > refreshing properly (it requires some additional movement, like cursor > keys > > being used to refresh the screen). > > > > Regards, > > BL > > > > > > On Sat, Mar 29, 2014 at 12:38 PM, Big Lebowski >wrote: > > > >> Hi all, > >> > >> I've just installed XenServer 6.2 along with all latest patches (SP1 and > >> 014 update) on a machine that was previously a bare metal FreeBSD 9.2-R > >> installation, running fast and smooth. > >> > >> That machine is a Quad Core cpu with 32GB of RAM: > >> > >> processor : 0 > >> vendor_id : GenuineIntel > >> cpu family : 6 > >> model : 58 > >> model name : Intel(R) Core(TM) i7-3770 CPU @ 3.40GHz > >> stepping : 9 > >> cpu MHz : 3400.086 > >> cache size : 8192 KB > >> physical id : 0 > >> siblings : 1 > >> core id : 0 > >> cpu cores : 1 > >> apicid : 0 > >> initial apicid : 0 > >> fdiv_bug : no > >> hlt_bug : no > >> f00f_bug : no > >> coma_bug : no > >> fpu : yes > >> fpu_exception : yes > >> cpuid level : 13 > >> wp : yes > >> flags : fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat clflush > >> acpi mmx fxsr sse sse2 ss ht nx constant_tsc nonstop_tsc aperfmperf pni > >> pclmulqdq vmx est ssse3 sse4_1 sse4_2 x2apic popcnt aes hypervisor ida > arat > >> tpr_shadow vnmi flexpriority ept vpid > >> bogomips : 6835.86 > >> clflush size : 64 > >> cache_alignment : 64 > >> address sizes : 36 bits physical, 48 bits virtual > >> power management: > >> > >> and 2x 3TB SATA disks connected in software raid 1 (mdraid). > >> > >> After performing the updates on XenServer, I've installed first vm, > >> FreeBSD 10.0-R amd64: > >> > >> FreeBSD poudriere 10.0-RELEASE FreeBSD 10.0-RELEASE #0 r260789: Thu Jan > >> 16 22:34:59 UTC 2014 root@snap.freebsd.org: > /usr/obj/usr/src/sys/GENERIC > >> amd64 > >> > >> with 8 vcpu's, 8GB of RAM, and two vdisks, 8GB for /, and 100GB for > >> /poudriere (both mounted with noatime). After playing a while with the > vm > >> (installing pkg, peforming portsnap fetch extract, installing poudriere) > >> I've noticed extremely poor performance: > >> > >> * portsnap extract can take over 20 minutes to dump the ports tree > >> * svnlite checkout of head/base takes ages and while it is happening, > the > >> vm is almost unusable: it freezes periodicaly so even typing in console > is > >> impossible, ls -la /usr/src takes few seconds to execute, the svnlite > >> process displays checked files in chunks (it runs for a while, freezes, > >> runs for a while again, and so on) > >> > >> I wonder if there's anything I am missing in running FreeBSD as > XenServer > >> guest? Linux vms on the same XenServer host are running faster by > orders of > >> magnitude, and fbsd is not just slower, its unusable. > >> > >> I'd appreciate any help! > >> > >> Regards, > >> BL. > >> > > > > > _______________________________________________ > freebsd-xen@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-xen > To unsubscribe, send any mail to "freebsd-xen-unsubscribe@freebsd.org" > From owner-freebsd-xen@FreeBSD.ORG Sat Mar 29 21:48:49 2014 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 1E5F46F5 for ; Sat, 29 Mar 2014 21:48:49 +0000 (UTC) Received: from mail.tdx.com (mail.tdx.com [62.13.128.18]) by mx1.freebsd.org (Postfix) with ESMTP id B6707EE0 for ; Sat, 29 Mar 2014 21:48:48 +0000 (UTC) Received: from study64.tdx.co.uk (study64.tdx.co.uk [62.13.130.231]) (authenticated bits=0) by mail.tdx.com (8.14.3/8.14.3/) with ESMTP id s2TLmeup038536 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Sat, 29 Mar 2014 21:48:41 GMT Date: Sat, 29 Mar 2014 21:48:40 +0000 From: Karl Pielorz To: Big Lebowski , freebsd-xen@freebsd.org Subject: Re: Terrible performance of XenServer 6.2 and FreeBSD 10.0-RELEASE guest Message-ID: In-Reply-To: References: X-Mailer: Mulberry/4.0.8 (Mac OS X) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit Content-Disposition: inline X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 29 Mar 2014 21:48:49 -0000 --On 29 March 2014 15:17:20 +0100 Big Lebowski wrote: > [snip] > > and that the XenCenter console is > not refreshing properly (it requires some additional movement, like > cursor keys being used to refresh the screen). fwiw I noticed that with every version of FreeBSD I've run under Xen - I did file a PR for it a while ago... It can often leave you to believe a command "hasn't finished yet" - e.g. " tar zxf /something.tar.gz " Will complete, but you won't get a prompt back until you hit enter / a key etc. causing the screen/console to refresh under XenCenter :( You end up thinking your tar is still running... -Karl From owner-freebsd-xen@FreeBSD.ORG Mon Mar 31 10:33:00 2014 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 5EB08A60 for ; Mon, 31 Mar 2014 10:33:00 +0000 (UTC) Received: from SMTP.CITRIX.COM (smtp.citrix.com [66.165.176.89]) (using TLSv1 with cipher RC4-SHA (128/128 bits)) (Client CN "mail.citrix.com", Issuer "Cybertrust Public SureServer SV CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id AF99088C for ; Mon, 31 Mar 2014 10:32:57 +0000 (UTC) X-IronPort-AV: E=Sophos;i="4.97,764,1389744000"; d="scan'208";a="116475267" Received: from accessns.citrite.net (HELO FTLPEX01CL02.citrite.net) ([10.9.154.239]) by FTLPIPO01.CITRIX.COM with ESMTP; 31 Mar 2014 10:32:50 +0000 Received: from [IPv6:::1] (10.80.16.47) by smtprelay.citrix.com (10.13.107.79) with Microsoft SMTP Server id 14.2.342.4; Mon, 31 Mar 2014 06:32:48 -0400 Message-ID: <5339444A.80605@citrix.com> Date: Mon, 31 Mar 2014 12:32:42 +0200 From: =?ISO-8859-1?Q?Roger_Pau_Monn=E9?= User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.7; rv:24.0) Gecko/20100101 Thunderbird/24.4.0 MIME-Version: 1.0 To: Big Lebowski , Subject: Re: Terrible performance of XenServer 6.2 and FreeBSD 10.0-RELEASE guest References: In-Reply-To: X-Enigmail-Version: 1.6 Content-Type: text/plain; charset="ISO-8859-1" Content-Transfer-Encoding: 7bit X-DLP: MIA2 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 31 Mar 2014 10:33:00 -0000 On 29/03/14 15:17, Big Lebowski wrote: > In addition to that, I've also noticed that even with xe guest utilitiest > installed and started, neither halt nor shutdown -h now are working (they > seem to stop the guest OS, but the vm stays up for the hypervisor and needs > to be forced to shutdown/restart) and that the XenCenter console is not > refreshing properly (it requires some additional movement, like cursor keys > being used to refresh the screen). I think you want `shutdown -p now`, which will poweroff the machine (-h just halts it). Roger. From owner-freebsd-xen@FreeBSD.ORG Mon Mar 31 10:49:37 2014 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 0C831CFE; Mon, 31 Mar 2014 10:49:37 +0000 (UTC) Received: from SMTP02.CITRIX.COM (smtp02.citrix.com [66.165.176.63]) (using TLSv1 with cipher RC4-SHA (128/128 bits)) (Client CN "mail.citrix.com", Issuer "Cybertrust Public SureServer SV CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 2E05999C; Mon, 31 Mar 2014 10:49:35 +0000 (UTC) X-IronPort-AV: E=Sophos;i="4.97,764,1389744000"; d="scan'208";a="115219661" Received: from accessns.citrite.net (HELO FTLPEX01CL02.citrite.net) ([10.9.154.239]) by FTLPIPO02.CITRIX.COM with ESMTP; 31 Mar 2014 10:49:27 +0000 Received: from [IPv6:::1] (10.80.16.47) by smtprelay.citrix.com (10.13.107.79) with Microsoft SMTP Server id 14.2.342.4; Mon, 31 Mar 2014 06:49:26 -0400 Message-ID: <5339482E.9020301@citrix.com> Date: Mon, 31 Mar 2014 12:49:18 +0200 From: =?ISO-8859-1?Q?Roger_Pau_Monn=E9?= User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.7; rv:24.0) Gecko/20100101 Thunderbird/24.4.0 MIME-Version: 1.0 To: Big Lebowski , Mark Felder Subject: Re: Terrible performance of XenServer 6.2 and FreeBSD 10.0-RELEASE guest References: <8FDB514D-1A94-48B2-AE19-62923F327938@FreeBSD.org> In-Reply-To: X-Enigmail-Version: 1.6 Content-Type: text/plain; charset="ISO-8859-1" Content-Transfer-Encoding: 7bit X-DLP: MIA1 Cc: freebsd-xen@freebsd.org X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 31 Mar 2014 10:49:37 -0000 On 29/03/14 14:30, Big Lebowski wrote: > This was enabled, but I've now disabled it. However, the network I/O seems > to be ok, on par with what I can achieve on Linux boxes. Its disk I/O that > makes the system unusable. I've done a `tar -Jxf src.txz` on identical boxes (which I think should generate a similar IO workload to what you are doing), one running FreeBSD natively, and the other running a FreeBSD PVHVM guest on top of Xen: Native: # time tar -Jxf src.txz real 2m15.280s user 0m10.021s sys 0m5.257s Xen guest: # time tar -Jxf src.txz real 3m13.366s user 0m11.430s sys 0m4.767s Which doesn't look that bad. When running under Xen I didn't experience any kind of noticeable slowness while running this workload on screen and switched to another console. If you think disk IO is the culprit, could you provide some synthetic workload with fio that can reproduce this? (Also the dmesg of the FreeBSD guest might be of interest) My test was done using OSS Xen 4.5 and a Linux Dom0 running kernel 3.13. Roger. From owner-freebsd-xen@FreeBSD.ORG Mon Mar 31 11:06:55 2014 Return-Path: Delivered-To: freebsd-xen@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id B5CEFC67 for ; Mon, 31 Mar 2014 11:06:55 +0000 (UTC) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:1900:2254:206c::16:87]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id A3192BBA for ; Mon, 31 Mar 2014 11:06:55 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.8/8.14.8) with ESMTP id s2VB6tNY058909 for ; Mon, 31 Mar 2014 11:06:55 GMT (envelope-from owner-bugmaster@FreeBSD.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.8/8.14.8/Submit) id s2VB6tC6058907 for freebsd-xen@FreeBSD.org; Mon, 31 Mar 2014 11:06:55 GMT (envelope-from owner-bugmaster@FreeBSD.org) Date: Mon, 31 Mar 2014 11:06:55 GMT Message-Id: <201403311106.s2VB6tC6058907@freefall.freebsd.org> X-Authentication-Warning: freefall.freebsd.org: gnats set sender to owner-bugmaster@FreeBSD.org using -f From: FreeBSD bugmaster To: freebsd-xen@FreeBSD.org Subject: Current problem reports assigned to freebsd-xen@FreeBSD.org X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 31 Mar 2014 11:06:55 -0000 Note: to view an individual PR, use: http://www.freebsd.org/cgi/query-pr.cgi?pr=(number). The following is a listing of current problems submitted by FreeBSD users. These represent problem reports covering all versions including experimental development code and obsolete releases. S Tracker Resp. Description -------------------------------------------------------------------------------- o kern/183139 xen [xen] [patch] ifconfig options on xn0 lost after xen v o kern/180788 xen [xen] [panic] XEN PV kernel 9.2-BETA1 panics on boot o kern/180403 xen [xen] Problems with GENERIC and XENHVM kernels with Xe o kern/180402 xen [xen] XEN kernel does not load in XenClient 4.5.5 o kern/179814 xen [xen] mountroot fails with error=19 under Xen on 9-STA o kern/176471 xen [xen] xn driver crash on detach o kern/176053 xen [xen] [patch] i386: Correct wrong usage of vsnprintf() o kern/175954 xen [xen] XENHVM xn network driver extreme packet loss dur o kern/175822 xen [xen] FreeBSD 9.1 does not work with Xen 4.0 o kern/175757 xen [xen] [patch] xen pvhvm looses keyboard input from VNC o kern/171873 xen [xen] xn network device floods warning in dmesg o kern/166174 xen [xen] Problems ROOT MOUNT ERROR o kern/165418 xen [xen] Problems mounting root filesystem from XENHVM o kern/164630 xen [xen] XEN HVM kernel: run_interrupt_driven_hooks: stil o kern/164450 xen [xen] Failed to install FreeeBSD 9.0-RELEASE from CD i o kern/162677 xen [xen] FreeBSD not compatible with "Current Stable Xen" o kern/161318 xen [xen] sysinstall crashes with floating point exception o kern/155468 xen [xen] Xen PV i386 multi-kernel CPU system is not worki o kern/155353 xen [xen] [patch] put "nudging TOD" message under boot_ver o kern/154833 xen [xen]: xen 4.0 - DomU freebsd8.2RC3 i386, XEN kernel. o kern/154473 xen [xen] xen 4.0 - DomU freebsd8.1 i386, XEN kernel. Not o kern/154472 xen [xen] xen 4.0 - DomU freebsd8.1 i386 xen kernel reboot o kern/154428 xen [xen] xn0 network interface and PF - Massive performan o kern/153674 xen [xen] i386/XEN idle thread shows wrong percentages o kern/153672 xen [xen] [panic] i386/XEN panics under heavy fork load o kern/153620 xen [xen] Xen guest system clock drifts in AWS EC2 (FreeBS o kern/153477 xen [xen] XEN pmap code abuses vm page queue lock o kern/153150 xen [xen] xen/ec2: disable checksum offloading on interfac o kern/152228 xen [xen] [panic] Xen/PV panic with machdep.idle_mwait=1 o kern/144629 xen [xen] FreeBSD 8-RELEASE XEN pvm networking doesn't wor o kern/143398 xen [xen] FreeBSD 8-RELEASE XEN pvm networking doesn't wor o kern/143340 xen [xen] FreeBSD 8-RELEASE XEN pvm networking doesn't wor f kern/143069 xen [xen] [panic] Xen Kernel Panic - Memory modified after f kern/135667 xen ufs filesystem corruption on XEN DomU system f kern/135421 xen [xen] FreeBSD Xen PVM DomU network failure - netfronc. f kern/135178 xen [xen] Xen domU outgoing data transfer stall when TSO i p kern/135069 xen [xen] FreeBSD-current/Xen SMP doesn't function at all f i386/124516 xen [xen] FreeBSD-CURRENT Xen Kernel Segfaults when config o kern/118734 xen [xen] FreeBSD 6.3-RC1 and FreeBSD 7.0-BETA 4 fail to b 39 problems total. From owner-freebsd-xen@FreeBSD.ORG Wed Apr 2 14:08:12 2014 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 030AA5F5 for ; Wed, 2 Apr 2014 14:08:12 +0000 (UTC) Received: from ezwind.net (bobby.ezwind.net [199.188.211.146]) by mx1.freebsd.org (Postfix) with ESMTP id C8C363FB for ; Wed, 2 Apr 2014 14:08:11 +0000 (UTC) Received: from jayPC by ezwind.net (MDaemon PRO v9.6.5) with ESMTP id 09-md50000158354.msg for ; Wed, 02 Apr 2014 09:07:53 -0500 X-Spam-Processed: ezwind.net, Wed, 02 Apr 2014 09:07:53 -0500 (not processed: spam filter heuristic analysis disabled) X-Authenticated-Sender: jwest@ezwind.net X-MDRemoteIP: 66.128.110.246 X-Return-Path: prvs=11698f6144=jwest@ezwind.net X-Envelope-From: jwest@ezwind.net X-MDaemon-Deliver-To: freebsd-xen@freebsd.org From: "Jay West" To: "'Big Lebowski'" , References: In-Reply-To: Subject: RE: Terrible performance of XenServer 6.2 and FreeBSD 10.0-RELEASE guest Date: Wed, 2 Apr 2014 09:11:02 -0500 Message-ID: <003301cf4e7d$6171a4f0$2454eed0$@ezwind.net> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Mailer: Microsoft Outlook 14.0 Thread-Index: AQFSynDJK21YPIOGAF2v+eR+WJsaqAD1RAvbm++60LA= Content-Language: en-us X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 02 Apr 2014 14:08:12 -0000 Freebsd shutdown -h has never worked "right" (what is right behavior is subjective) on xenserver. If the guest utilities are installed, use Xencenter to shutdown. If not, or, if you just prefer command line - you'll find that shutdown -p will actually take the vm down "correctly". Also - the slow screen display inside xencenter console has also always been an issue. I've never seen it work well. Not sure if this is a freebsd or xen based (with freebsd, as other guest os's seem to get it right) issue. Would love to see it fixed, but... we only use the xencenter console for freebsd long enough to assign an IP and open up ssh ;) Jay West, President EZwind.net 11 The Pines Court, Suite B Chesterfield, MO 63141 P: 314-781-1800 F: 314-558-9284 E: jwest@ezwind.net W: www.ezwind.net -----Original Message----- From: owner-freebsd-xen@freebsd.org [mailto:owner-freebsd-xen@freebsd.org] On Behalf Of Big Lebowski Sent: Saturday, March 29, 2014 9:17 AM To: freebsd-xen@freebsd.org Subject: Re: Terrible performance of XenServer 6.2 and FreeBSD 10.0-RELEASE guest In addition to that, I've also noticed that even with xe guest utilitiest installed and started, neither halt nor shutdown -h now are working (they seem to stop the guest OS, but the vm stays up for the hypervisor and needs to be forced to shutdown/restart) and that the XenCenter console is not refreshing properly (it requires some additional movement, like cursor keys being used to refresh the screen). Regards, BL On Sat, Mar 29, 2014 at 12:38 PM, Big Lebowski wrote: > Hi all, > > I've just installed XenServer 6.2 along with all latest patches (SP1 > and > 014 update) on a machine that was previously a bare metal FreeBSD > 9.2-R installation, running fast and smooth. > > That machine is a Quad Core cpu with 32GB of RAM: > > processor : 0 > vendor_id : GenuineIntel > cpu family : 6 > model : 58 > model name : Intel(R) Core(TM) i7-3770 CPU @ 3.40GHz stepping : 9 cpu > MHz : 3400.086 cache size : 8192 KB physical id : 0 siblings : 1 core > id : 0 cpu cores : 1 apicid : 0 initial apicid : 0 fdiv_bug : no > hlt_bug : no f00f_bug : no coma_bug : no fpu : yes fpu_exception : yes > cpuid level : 13 wp : yes flags : fpu de tsc msr pae mce cx8 apic sep > mtrr mca cmov pat clflush acpi mmx fxsr sse sse2 ss ht nx constant_tsc > nonstop_tsc aperfmperf pni pclmulqdq vmx est ssse3 sse4_1 sse4_2 > x2apic popcnt aes hypervisor ida arat tpr_shadow vnmi flexpriority ept > vpid bogomips : 6835.86 clflush size : 64 cache_alignment : 64 address > sizes : 36 bits physical, 48 bits virtual power management: > > and 2x 3TB SATA disks connected in software raid 1 (mdraid). > > After performing the updates on XenServer, I've installed first vm, > FreeBSD 10.0-R amd64: > > FreeBSD poudriere 10.0-RELEASE FreeBSD 10.0-RELEASE #0 r260789: Thu Jan 16 > 22:34:59 UTC 2014 root@snap.freebsd.org:/usr/obj/usr/src/sys/GENERIC > amd64 > > with 8 vcpu's, 8GB of RAM, and two vdisks, 8GB for /, and 100GB for > /poudriere (both mounted with noatime). After playing a while with the > vm (installing pkg, peforming portsnap fetch extract, installing > poudriere) I've noticed extremely poor performance: > > * portsnap extract can take over 20 minutes to dump the ports tree > * svnlite checkout of head/base takes ages and while it is happening, > the vm is almost unusable: it freezes periodicaly so even typing in > console is impossible, ls -la /usr/src takes few seconds to execute, > the svnlite process displays checked files in chunks (it runs for a > while, freezes, runs for a while again, and so on) > > I wonder if there's anything I am missing in running FreeBSD as > XenServer guest? Linux vms on the same XenServer host are running > faster by orders of magnitude, and fbsd is not just slower, its unusable. > > I'd appreciate any help! > > Regards, > BL. > _______________________________________________ freebsd-xen@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-xen To unsubscribe, send any mail to "freebsd-xen-unsubscribe@freebsd.org" From owner-freebsd-xen@FreeBSD.ORG Wed Apr 2 14:16:06 2014 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 57D9B8AD for ; Wed, 2 Apr 2014 14:16:06 +0000 (UTC) Received: from ezwind.net (bobby.ezwind.net [199.188.211.146]) by mx1.freebsd.org (Postfix) with ESMTP id 2BD726CF for ; Wed, 2 Apr 2014 14:16:05 +0000 (UTC) Received: from jayPC by ezwind.net (MDaemon PRO v9.6.5) with ESMTP id 42-md50000158237.msg for ; Wed, 02 Apr 2014 09:16:04 -0500 X-Spam-Processed: ezwind.net, Wed, 02 Apr 2014 09:16:04 -0500 (not processed: spam filter heuristic analysis disabled) X-Authenticated-Sender: jwest@ezwind.net X-MDRemoteIP: 66.128.110.246 X-Return-Path: prvs=11698f6144=jwest@ezwind.net X-Envelope-From: jwest@ezwind.net X-MDaemon-Deliver-To: freebsd-xen@freebsd.org From: "Jay West" To: Subject: Poor network performance Date: Wed, 2 Apr 2014 09:19:12 -0500 Message-ID: <003401cf4e7e$85ada7f0$9108f7d0$@ezwind.net> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Mailer: Microsoft Outlook 14.0 Thread-Index: Ac9OfbRdLDBzA+YIQ56m4bdC15BvQg== Content-Language: en-us X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 02 Apr 2014 14:16:06 -0000 Xenserver 6.2, Freebsd 10-Release We are noticing poor network performance. It is a stock install of 10-R with no special tuning, no custom kernel built, no extra modules loaded, and the xentools 4.1.3 installed. Question - I have heard that one should always use -tso, but all those discussions seem to be pf related. We do not have pf enabled at all so I have not gone that route. Should we be putting -tso in the vm's rc.conf ifconfig regardless? Jay West, President EZwind.net 11 The Pines Court, Suite B Chesterfield, MO 63141 P: 314-781-1800 F: 314-558-9284 E: jwest@ezwind.net W: www.ezwind.net From owner-freebsd-xen@FreeBSD.ORG Thu Apr 3 09:27:08 2014 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 437A2D56 for ; Thu, 3 Apr 2014 09:27:08 +0000 (UTC) Received: from cu01176a.smtpx.saremail.com (cu01176a.smtpx.saremail.com [195.16.150.151]) by mx1.freebsd.org (Postfix) with ESMTP id D73EF6E for ; Thu, 3 Apr 2014 09:27:07 +0000 (UTC) Received: from [172.16.2.46] (izaro.sarenet.es [192.148.167.11]) by proxypop03.sare.net (Postfix) with ESMTPSA id B6FBD9DD8CA; Thu, 3 Apr 2014 11:26:59 +0200 (CEST) Mime-Version: 1.0 (Mac OS X Mail 7.2 \(1874\)) Subject: Re: Poor network performance From: Egoitz Aurrekoetxea In-Reply-To: <003401cf4e7e$85ada7f0$9108f7d0$@ezwind.net> Date: Thu, 3 Apr 2014 11:26:58 +0200 Message-Id: <33E3E822-1122-4E75-A5F1-E468CB7AC696@sarenet.es> References: <003401cf4e7e$85ada7f0$9108f7d0$@ezwind.net> To: Jay West X-Mailer: Apple Mail (2.1874) Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.17 Cc: freebsd-xen@freebsd.org X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 03 Apr 2014 09:27:08 -0000 Hi Jay, Tso is a nic's feature. Nothing to do with packet filtering. Regards, Egoitz Aurrekoetxea Departamento de sistemas 944 209 470 Parque Tecnol=F3gico. Edificio 103 48170 Zamudio (Bizkaia) egoitz@sarenet.es www.sarenet.es Antes de imprimir este correo electr=F3nico piense si es necesario = hacerlo. El 02/04/2014, a las 16:19, Jay West escribi=F3: > Xenserver 6.2, Freebsd 10-Release >=20 > We are noticing poor network performance. It is a stock install of = 10-R with > no special tuning, no custom kernel built, no extra modules loaded, = and the > xentools 4.1.3 installed. >=20 > Question - I have heard that one should always use -tso, but all those > discussions seem to be pf related. We do not have pf enabled at all so = I > have not gone that route. Should we be putting -tso in the vm's = rc.conf > ifconfig regardless? >=20 > Jay West, President > EZwind.net > 11 The Pines Court, Suite B > Chesterfield, MO 63141 > P: 314-781-1800 > F: 314-558-9284 > E: jwest@ezwind.net > W: www.ezwind.net >=20 >=20 >=20 >=20 > _______________________________________________ > freebsd-xen@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-xen > To unsubscribe, send any mail to "freebsd-xen-unsubscribe@freebsd.org" From owner-freebsd-xen@FreeBSD.ORG Fri Apr 4 13:55:22 2014 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id CBBABCEE for ; Fri, 4 Apr 2014 13:55:22 +0000 (UTC) Received: from mail.feld.me (mail.feld.me [66.170.3.6]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client CN "mail.feld.me", Issuer "Gandi Standard SSL CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 6D413146 for ; Fri, 4 Apr 2014 13:55:22 +0000 (UTC) Received: from mail.feld.me (mail.feld.me [66.170.3.6]); by mail.feld.me (OpenSMTPD) with ESMTP id d3d428db; Fri, 4 Apr 2014 08:55:13 -0500 (CDT) Received: from feld@feld.me by mail.feld.me (Archiveopteryx 3.2.0) with esmtpsa id 1396619712-3468-3466/5/2; Fri, 4 Apr 2014 13:55:12 +0000 Content-Type: text/plain; charset=iso-8859-1 Mime-Version: 1.0 Subject: Re: Poor network performance From: Mark Felder In-Reply-To: <33E3E822-1122-4E75-A5F1-E468CB7AC696@sarenet.es> Date: Fri, 4 Apr 2014 08:55:10 -0500 Content-Transfer-Encoding: quoted-printable Message-Id: <5B18150E-50A3-4609-A3C2-979435686965@FreeBSD.org> References: <003401cf4e7e$85ada7f0$9108f7d0$@ezwind.net> <33E3E822-1122-4E75-A5F1-E468CB7AC696@sarenet.es> To: Egoitz Aurrekoetxea X-Mailer: Apple Mail (2.1874) Sender: feld@feld.me Cc: freebsd-xen@freebsd.org, Jay West X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Apr 2014 13:55:22 -0000 On Apr 3, 2014, at 4:26, Egoitz Aurrekoetxea wrote: > Hi Jay, >=20 > Tso is a nic's feature. Nothing to do with packet filtering. >=20 There is a known bug with TSO and pf on Xen. There is an open PR -- = kern/154428 From owner-freebsd-xen@FreeBSD.ORG Fri Apr 4 21:45:19 2014 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id EC63F378 for ; Fri, 4 Apr 2014 21:45:19 +0000 (UTC) Received: from egarden.fi (egarden.fi [78.47.154.139]) by mx1.freebsd.org (Postfix) with ESMTP id B0F776E7 for ; Fri, 4 Apr 2014 21:45:19 +0000 (UTC) Received: from [192.168.0.54] (cable-tku-50deed-114.dhcp.inet.fi [80.222.237.114]) by egarden.fi (Postfix) with ESMTPSA id D057E1156003 for ; Sat, 5 Apr 2014 00:39:25 +0300 (EEST) Message-ID: <533F268C.8040909@egarden.fi> Date: Sat, 05 Apr 2014 00:39:24 +0300 From: Jonni Nakari User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:24.0) Gecko/20100101 Thunderbird/24.2.0 MIME-Version: 1.0 To: freebsd-xen@freebsd.org Subject: Status of 64 bit DomU PVs? Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Apr 2014 21:45:20 -0000 Hello, what is the current status of 64 bit paravirtualized FreeBSD? The wiki page Xen wiki page [1] states that only i386 kernels can be run in fully paravirtualized mode. The wiki page hasn't been updated in a while. Has anything changed since the last update? I would like to run FreeBSD as a DomU on a AMD 64 bit machine that does not have hardware accelerated virtualization. That propably means that it's not feasible to run a HVM based DomU on the machine? I would also like the DomU to be 64 bit to provide more than 4 gigabytes of RAM to the ZFS serving FreeBSD. Or maybe I have misunderstood something. Is it possible to provide more than 4 GB RAM for a 32 bit DomU so that it can use all of it for ZFS caching? [1] https://wiki.freebsd.org/FreeBSD/Xen -- Jonni Nakari jonni@egarden.fi +358 50 4411 784 A: Because it disrupts the natural way of thinking. Q: Why is top posting frowned upon? From owner-freebsd-xen@FreeBSD.ORG Sat Apr 5 00:10:21 2014 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 1C12DBA; Sat, 5 Apr 2014 00:10:21 +0000 (UTC) Received: from mail-ve0-x229.google.com (mail-ve0-x229.google.com [IPv6:2607:f8b0:400c:c01::229]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id B857A30F; Sat, 5 Apr 2014 00:10:20 +0000 (UTC) Received: by mail-ve0-f169.google.com with SMTP id pa12so2061557veb.0 for ; Fri, 04 Apr 2014 17:10:19 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=references:in-reply-to:mime-version:content-transfer-encoding :content-type:message-id:cc:from:subject:date:to; bh=yPK2WNqt0VnpVQDimtivT/LLYAMD78PfEtUpczyxv6E=; b=oxBoZDM8aTn5ZQHCOSYOw/Y6KFJgODAA8WnrpoIzWVFUx3fB0dUknfAKv4rq5NDrO0 awA66tMUJN1pPlOTRsncVbi7+ZWZlhvBQF+fpcbRqmHXSwlz/+n/tQ2edC7c1TQ2Jr01 NhmcRh2KKtdt50vPh3xkUiqmqhyV0BC5U6eRotdB86yHNUeb78qg2IzLSIe8piTMkMc7 vsDWQQb2D17nxifDtXQ25lMwSBSXCDkNBMJBrUChN0FJLfL0Gt6Vd0vq/RB/tj0jMqfd aY9DQJX1oxNcLzswtnCNqqeMeYSOTzCB/+HKNALwe/KWKmrrZZP8n0fGfJclAWm2/jua HaKw== X-Received: by 10.58.238.35 with SMTP id vh3mr7441777vec.16.1396656619753; Fri, 04 Apr 2014 17:10:19 -0700 (PDT) Received: from [192.168.1.101] (189-13-67-210.user.veloxzone.com.br. [189.13.67.210]) by mx.google.com with ESMTPSA id ga9sm21046383vdc.22.2014.04.04.17.10.17 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Fri, 04 Apr 2014 17:10:18 -0700 (PDT) References: <003401cf4e7e$85ada7f0$9108f7d0$@ezwind.net> <33E3E822-1122-4E75-A5F1-E468CB7AC696@sarenet.es> <5B18150E-50A3-4609-A3C2-979435686965@FreeBSD.org> In-Reply-To: <5B18150E-50A3-4609-A3C2-979435686965@FreeBSD.org> Mime-Version: 1.0 (1.0) Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 Message-Id: <6C000DB6-BB6A-4134-A282-03C5AD62FCF2@gmail.com> X-Mailer: iPad Mail (9B206) From: Tiago Ribeiro Subject: Re: Poor network performance Date: Fri, 4 Apr 2014 21:10:22 -0300 To: Mark Felder Cc: "freebsd-xen@freebsd.org" , Jay West X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 05 Apr 2014 00:10:21 -0000 Em 04/04/2014, =C3=A0s 10:55, Mark Felder escreveu: >=20 > On Apr 3, 2014, at 4:26, Egoitz Aurrekoetxea wrote: >=20 >> Hi Jay, >>=20 >> Tso is a nic's feature. Nothing to do with packet filtering. >>=20 >=20 > There is a known bug with TSO and pf on Xen. There is an open PR -- kern/ It 's a big mistery for me, yesterday i install one freebsd10 with pf in one= dom0 xenserver, and the performance is ok, and i don't disable TSO. But one month ago, i install freebsd 10 in one dom0 debian 6.0 , and i have p= oor performance too, and disable or enable TSO do not make diference. Sorry for my poor english. From owner-freebsd-xen@FreeBSD.ORG Sat Apr 5 09:41:27 2014 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 2DB6EADB for ; Sat, 5 Apr 2014 09:41:27 +0000 (UTC) Received: from egarden.fi (egarden.fi [78.47.154.139]) by mx1.freebsd.org (Postfix) with ESMTP id A939E69C for ; Sat, 5 Apr 2014 09:41:26 +0000 (UTC) Received: from [192.168.0.10] (cable-tku-50deed-114.dhcp.inet.fi [80.222.237.114]) by egarden.fi (Postfix) with ESMTPSA id 0BD301156003 for ; Sat, 5 Apr 2014 12:41:23 +0300 (EEST) Message-ID: <533FCFC3.5060601@egarden.fi> Date: Sat, 05 Apr 2014 12:41:23 +0300 From: Jonni Nakari User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:24.0) Gecko/20100101 Thunderbird/24.2.0 MIME-Version: 1.0 To: freebsd-xen@freebsd.org Subject: Panics when booting i386 paravirtualized FreeBSD Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 05 Apr 2014 09:41:27 -0000 Hello, I'm having problems booting the i386 paravirtualized (KERNCONF=XEN) kernel (10.0R) on Xen 4.4. My hardware is an old machine with two, dual core AMD Opteron 285s. Most times the booting the DomU panics with message "panic: can't schedule timer" but sometimes it goes a bit further and panics with "panic: removing pages from non-current pmap". I added the full boot log of both panics and Xen Domu configuration to the end of this message. What could be causing those panics? Are there any recent developments of PV FreeBSD that I'm not aware of? I can compile custom kernels and help testing experimental patches. The machine is not capable of running HVM virtualized (no VT-x/AMD-V) so I would like to get paravirtualized version of FreeBSD running, but it seems to me that the state of PV FreeBSD is quite bad currently. If I manage to get the DomU running, can I expect it to support multiple processors? Can it handle more than 4 GB of RAM? I read from a previous post to this list that multiprocessor support might be broken, but that message was from over a year ago. Also the maximum RAM support support comes from an old source. Ideally I would like the FreeBSD DomU to serve ZVOLs and NFS to other DomUs. example of "can't schedule timer" panic: jonni@tara:/etc/xen$ sudo xl create maggie.pvfreebsd -c Parsing config from maggie.pvfreebsd WARNING: loader(8) metadata is missing! GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb APIC: Using the MPTable enumerator. SMP: Added CPU 0 (BSP) Copyright (c) 1992-2014 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 10.0-RELEASE #0: Sat Apr 5 07:11:56 EEST 2014 jonni@maggie:/usr/obj/usr/src/sys/XEN i386 FreeBSD clang version 3.3 (tags/RELEASE_33/final 183502) 20130610 WARNING: WITNESS option enabled, expect reduced performance. Xen reported: 2612.074 MHz processor. CPU: Dual Core AMD Opteron(tm) Processor 285 (2612.07-MHz 686-class CPU) Origin = "AuthenticAMD" Id = 0x20f12 Family = 0xf Model = 0x21 Stepping = 2 Features=0x1783fbff Features2=0x1 AMD Features=0xe2500800 AMD Features2=0x3 Data TLB: 32 entries, fully associative Instruction TLB: 32 entries, fully associative L1 data cache: 64 kbytes, 64 bytes/line, 1 lines/tag, 2-way associative L1 instruction cache: 64 kbytes, 64 bytes/line, 1 lines/tag, 2-way associative L2 internal cache: 1024 kbytes, 64 bytes/line, 1 lines/tag, 8-way associative WARNING: This architecture revision has known SMP hardware bugs which may cause random insta bility real memory = 536870912 (512 MB) Physical memory chunk(s): 0x0000000000873000 - 0x000000001f6a0fff, 518184960 bytes (126510 pages) avail memory = 515543040 (491 MB) random device not loaded; using insecure entropy ULE: setup cpu 0 nfslock: pseudo-device io: Falling back to random adaptor random: initialized mem: Pentium Pro MTRR support enabled null: xc0: on motherboard xenstore0: on motherboard Grant table initialized xen_et0: on motherboard Event timer "XENTIMER" frequency 1000000000 Hz quality 950 Timecounter "XENTIMER" frequency 1000000000 Hz quality 950 xen_et0: registered as a time-of-day clock (resolution 10000000us, adjustment 5.000000000s) Device configuration finished. procfs registered panic: can't schedule timer cpuid = 0 KDB: enter: panic [ thread pid 0 tid 100000 ] Stopped at kdb_enter+0x3d: movl $0,kdb_why db> bt Tracing pid 0 tid 100000 td 0xc068b710 kdb_enter(c042ffc7,c042ffc7,c041c2b4,c0748bd4,8b3b77b1,...) at kdb_enter+0x3d/frame 0xc0748b80 kassert_panic(c0748bd4,c0748c28,c008a9ca,c041c2b4,c01d3940,...) at kassert_panic+0x233/frame 0xc0748bbc panic(c041c2b4,c01d3940,246,c0633418,c08e1480,...) at panic+0x12/frame 0xc0748bc8 network_connect(c286162c,a3d70a,0,0,0,0,0) at network_connect+0x3e4a/frame 0xc0748c28 et_start(c286162c,a3d70a,0,0,0,c286162c,c0872cbc,229a5,1,1f4,0,3ce580,3ce580) at et_start+0x10b/frame 0xc0748c58 cpu_idleclock(1,0,c046c817,1f4,c26fda40,...) at cpu_idleclock+0x3eb/frame 0xc0748ca0 cpu_initclocks_bsp(c068bba8,0,c046c817,2a1,c04713b4,...) at cpu_initclocks_bsp+0xa83/frame 0xc0748cf8 cpu_initclocks_bsp(c04b59a4,c042754f,0,0,c0748d58,...) at cpu_initclocks_bsp+0x3af/frame 0xc0748d18 profclock_cnt(0,0,0,0,c0471534,...) at profclock_cnt+0x5bf/frame 0xc0748d30 mi_startup(0,0,742000,0,0,...) at mi_startup+0xf7/frame 0xc0748d58 btext() at btext+0x95 db> example of "removing pages from non-current pmap" panic: jonni@tara:/etc/xen$ sudo xl create maggie.pvfreebsd -c Parsing config from maggie.pvfreebsd WARNING: loader(8) metadata is missing! GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb APIC: Using the MPTable enumerator. SMP: Added CPU 0 (BSP) Copyright (c) 1992-2014 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 10.0-RELEASE #0: Sat Apr 5 07:11:56 EEST 2014 jonni@maggie:/usr/obj/usr/src/sys/XEN i386 FreeBSD clang version 3.3 (tags/RELEASE_33/final 183502) 20130610 WARNING: WITNESS option enabled, expect reduced performance. Xen reported: 2612.074 MHz processor. CPU: Dual Core AMD Opteron(tm) Processor 285 (2612.07-MHz 686-class CPU) Origin = "AuthenticAMD" Id = 0x20f12 Family = 0xf Model = 0x21 Stepping = 2 Features=0x1783fbff Features2=0x1 AMD Features=0xe2500800 AMD Features2=0x3 Data TLB: 32 entries, fully associative Instruction TLB: 32 entries, fully associative L1 data cache: 64 kbytes, 64 bytes/line, 1 lines/tag, 2-way associative L1 instruction cache: 64 kbytes, 64 bytes/line, 1 lines/tag, 2-way associative L2 internal cache: 1024 kbytes, 64 bytes/line, 1 lines/tag, 8-way associative WARNING: This architecture revision has known SMP hardware bugs which may cause random insta bility real memory = 536870912 (512 MB) Physical memory chunk(s): 0x0000000000873000 - 0x000000001f6a0fff, 518184960 bytes (126510 pages) avail memory = 515543040 (491 MB) random device not loaded; using insecure entropy ULE: setup cpu 0 nfslock: pseudo-device io: Falling back to random adaptor random: initialized mem: Pentium Pro MTRR support enabled null: xc0: on motherboard xenstore0: on motherboard Grant table initialized xen_et0: on motherboard Event timer "XENTIMER" frequency 1000000000 Hz quality 950 Timecounter "XENTIMER" frequency 1000000000 Hz quality 950 xen_et0: registered as a time-of-day clock (resolution 10000000us, adjustment 5.000000000s) Device configuration finished. procfs registered Timecounters tick every 10.000 msec tcp_init: net.inet.tcp.tcbhashsize auto tuned to 4096 lo0: bpf attached xctrl0: on xenstore0 xenbusb_front0: on xenstore0 xenbusb_add_device: Device device/suspend/event-channel ignored. State 6 xn0: at device/vif/0 on xenbusb_front0 xn0: bpf attached xn0: Ethernet address: 00:16:3e:7c:a1:9a xenbusb_back0: on xenstore0 xn0: backend features: feature-sg feature-gso-tcp4 xbd0: 10240MB at device/vbd/832 on xenbusb_front0 xbd0: attaching as ada1 GEOM: new disk ada1 random: unblocking device. TSC timecounter discards lower 1 bit(s) Timecounter "TSC-low" frequency 1306037000 Hz quality 800 WARNING: WITNESS option enabled, expect reduced performance. Trying to mount root from ufs:ada1p2 []... start_init: trying /sbin/init pid 26 (sh), uid 0: exited on signal 4 panic: removing pages from non-current pmap cpuid = 0 KDB: enter: panic [ thread pid 26 tid 100035 ] Stopped at kdb_enter+0x3d: movl $0,kdb_why db> bt Tracing pid 26 tid 100035 td 0xc2a73000 kdb_enter(c042ffc7,c042ffc7,c046acbe,d93b1984,c046acbe,...) at kdb_enter+0x3d/frame 0xd93b1918 kassert_panic(c04b7148,100,c046acbe,d93b1984,d93b1984,...) at kassert_panic+0x233/frame 0xd93b1954 kassert_panic(c046acbe,c0469fe4,e06,806,c0605668,...) at kassert_panic+0xea/frame 0xd93b1978 pmap_remove_pages(c08eaa3c,8,c04296b8,c08eaa3c,c2a79000,...) at pmap_remove_pages+0xb3/frame 0xd93b19e8 vmspace_exit(c2a73000,0,c04296b8,13f,4,...) at vmspace_exit+0xb1/frame 0xd93b1a10 exit1(c2a73000,4,1a,c2a79218,0,...) at exit1+0x654/frame 0xd93b1a70 sigexit(c2a73000,4,c0430060,b05,c2a78c48,...) at sigexit+0xbe4/frame 0xd93b1c20 postsig(4,0,c0436965,10d,0,...) at postsig+0x3b2/frame 0xd93b1cdc ast(d93b1d18) at ast+0x388/frame 0xd93b1d0c vm86_biosret() at vm86_biosret+0x9c/frame 0xbf7fcbc0 Xen configuration maggie.pvfreebsd kernel = "/root/freebsd_10.0_pv_kernel" extra = " vfs.root.mountfrom=ufs:ada1p2,machdep.idle_mwait=0,boot_verbose=1,kern.hz=100" memory = 512 name = "maggie.pvfreebsd" vif = [ 'bridge=xenbr0'] disk = [ 'phy:/dev/mapper/tara--vg-maggie,hdb,w' ] vcpus = 1 -- Jonni Nakari jonni@egarden.fi +358 50 4411 784 A: Because it disrupts the natural way of thinking. Q: Why is top posting frowned upon? From owner-freebsd-xen@FreeBSD.ORG Sat Apr 5 14:11:50 2014 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id EDE6D4E5 for ; Sat, 5 Apr 2014 14:11:50 +0000 (UTC) Received: from positron.dckd.nl (positron.dckd.nl [IPv6:2a02:898:62:f6::63]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id B501C247 for ; Sat, 5 Apr 2014 14:11:50 +0000 (UTC) Received: from [192.168.1.215] (wrt.dckd.nl [145.99.178.211]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by positron.dckd.nl (Postfix) with ESMTPSA id 3A163F800A; Sat, 5 Apr 2014 15:34:46 +0200 (CEST) Content-Type: text/plain; charset=windows-1252 Mime-Version: 1.0 (Mac OS X Mail 7.2 \(1874\)) Subject: Re: Panics when booting i386 paravirtualized FreeBSD From: Jeroen van der Ham In-Reply-To: <533FCFC3.5060601@egarden.fi> Date: Sat, 5 Apr 2014 15:34:45 +0200 Content-Transfer-Encoding: quoted-printable Message-Id: References: <533FCFC3.5060601@egarden.fi> To: Jonni Nakari X-Mailer: Apple Mail (2.1874) Cc: freebsd-xen@freebsd.org X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 05 Apr 2014 14:11:51 -0000 Hi, On 5 Apr 2014, at 11:41, Jonni Nakari wrote: > The machine is not capable of running HVM virtualized (no VT-x/AMD-V) = so I would like to get paravirtualized version of FreeBSD running, but = it seems to me that the state of PV FreeBSD is quite bad currently. If I = manage to get the DomU running, can I expect it to support multiple = processors? Can it handle more than 4 GB of RAM? I read from a previous = post to this list that multiprocessor support might be broken, but that = message was from over a year ago. Also the maximum RAM support support = comes from an old source. Ideally I would like the FreeBSD DomU to serve = ZVOLs and NFS to other DomUs. Whether or not you can run HVM does not depend on the CPU, but on XEN = and which loader you use (e.g. qemuloader). So the best thing you can do = is actually to run a HVM machine and use the stock kernel. That = automatically detects which PVHVM stuff may be available and uses it = when it is there. It should support multiple processors just fine, I have not tested the = RAM amount myself, but don=92t see a reason why it would be a problem. most important part of my config is this: kernel =3D '/usr/lib/xen-4.0/boot/hvmloader' device_model =3D '/usr/lib/xen-4.0/bin/qemu-dm' builder =3D =91hvm' Regards, Jeroen. From owner-freebsd-xen@FreeBSD.ORG Sat Apr 5 14:13:40 2014 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 532EFCCB for ; Sat, 5 Apr 2014 14:13:40 +0000 (UTC) Received: from mail-oa0-x234.google.com (mail-oa0-x234.google.com [IPv6:2607:f8b0:4003:c02::234]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 1E9022CB for ; Sat, 5 Apr 2014 14:13:40 +0000 (UTC) Received: by mail-oa0-f52.google.com with SMTP id l6so4735697oag.25 for ; Sat, 05 Apr 2014 07:13:39 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=3xpDHJt/kUfjfwsox+MwkVuNoV9CM4dEeyHICq01yMo=; b=sOMqApsO02L10kb7vvYwAJsLDf8HNwGLStFE27rdwiM/ME7m/TZ5t8KBoc2mOyAWqU jAEHR2546TgOiJir07oFbzqxguJnx2f8ePDvHfEt2Y+/wcZG0kCRkVhef8o4xO5psMW/ ONPUdfjKXf6t9Mh1Z/ogVX2F9ehbrjdbR3xTTTnty0WAu8EHBMYeyWEiZoPPrLN+DLSH FQUPsiSti1rCwZQFEyrSGzeMGwJ/8xayEQblHNcQKUunCYXPayAxHNzPOSV3ULpAg5Rt edySgGewmZk0Ob7IiPPkNOygUvPqf5NZFgWVkUWRbROqYpsMtc0fFE1dZoxNVgKKecBM 5K9A== MIME-Version: 1.0 X-Received: by 10.60.54.228 with SMTP id m4mr24262231oep.29.1396703697019; Sat, 05 Apr 2014 06:14:57 -0700 (PDT) Received: by 10.182.134.231 with HTTP; Sat, 5 Apr 2014 06:14:56 -0700 (PDT) Date: Sat, 5 Apr 2014 13:14:56 +0000 Message-ID: Subject: Re: Status of 64 bit DomU PVs? From: "Cherry G. Mathew" To: Jonni Nakari , freebsd-xen@freebsd.org Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.17 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 05 Apr 2014 14:13:40 -0000 Hi Jonni, Date: Sat, 05 Apr 2014 00:39:24 +0300 > From: Jonni Nakari > To: freebsd-xen@freebsd.org > Subject: Status of 64 bit DomU PVs? > Message-ID: <533F268C.8040909@egarden.fi> > Content-Type: text/plain; charset=ISO-8859-1; format=flowed > > Hello, > what is the current status of 64 bit paravirtualized FreeBSD? The wiki > page Xen wiki page [1] states that only i386 kernels can be run in fully > paravirtualized mode. The wiki page hasn't been updated in a while. Has > anything changed since the last update? > > I would like to run FreeBSD as a DomU on a AMD 64 bit machine that does > not have hardware accelerated virtualization. That propably means that > it's not feasible to run a HVM based DomU on the machine? I would also > like the DomU to be 64 bit to provide more than 4 gigabytes of RAM to > the ZFS serving FreeBSD. > > I've been working on this for quite some time now (perhaps too long), and the bad news is that, no, it's not ready for use - the code on the branch does bring us up to single user mode, but I'm reworking the pmap module with the wisdom of hindsight. The good news is that it should be ready for testing "soon" (May, 2014). With PV on 64bit, you should be able to have a 64bit address space with support for 47bit RAM (in theory). > Or maybe I have misunderstood something. Is it possible to provide more > than 4 GB RAM for a 32 bit DomU so that it can use all of it for ZFS > caching? > > On 64bit PV, the DomU is 64bit (although there used to be support for 32bit PV on 64bit hypervisor until the 3.x hypervisors, iirc). So yes, you should in *theory*, be able to have more than 4GB ram for your 64bit DomU. You're welcome to try the amd64_xen_pv svn branch, although it's very very early days, and I doubt it would be useful in any way for you other than to track progress or help with dev. Many Thanks, -- ~Cherry (cherry@FreeBSD.org) From owner-freebsd-xen@FreeBSD.ORG Sat Apr 5 17:52:58 2014 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 79D8A2E4 for ; Sat, 5 Apr 2014 17:52:58 +0000 (UTC) Received: from nm25-vm9.access.bullet.mail.gq1.yahoo.com (nm25-vm9.access.bullet.mail.gq1.yahoo.com [216.39.62.72]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 26140BA7 for ; Sat, 5 Apr 2014 17:52:57 +0000 (UTC) Received: from [216.39.60.172] by nm25.access.bullet.mail.gq1.yahoo.com with NNFMP; 05 Apr 2014 17:49:48 -0000 Received: from [216.39.60.161] by tm8.access.bullet.mail.gq1.yahoo.com with NNFMP; 05 Apr 2014 17:49:48 -0000 Received: from [127.0.0.1] by omp1027.access.mail.gq1.yahoo.com with NNFMP; 05 Apr 2014 17:49:48 -0000 X-Yahoo-Newman-Property: ymail-3 X-Yahoo-Newman-Id: 593152.16136.bm@omp1027.access.mail.gq1.yahoo.com Received: (qmail 6651 invoked by uid 60001); 5 Apr 2014 17:49:47 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1396720187; bh=aQYQBJl/NkVQ+X08tVWSYE5tapDQMdEYkNjn66EyiSA=; h=X-YMail-OSG:Received:X-Rocket-MIMEInfo:X-Mailer:Message-ID:Date:From:Reply-To:Subject:To:MIME-Version:Content-Type; b=OQ98dwTBlk8CI3r4g9d67r1T4HJYMaEAQZDVaKWuCJ5/WSwK9UCm90mMHasm59F2ca2fqQ7ay8Yuoma+EOdaCM1uNNR/8U+4RNAhQyEW5D1No8XJPUEDAXDNB8nY92gr4HfsfPSeN/H2A2JC3tHxjbzvlxBZgWDPgoVhZxdueZk= X-YMail-OSG: K8AF.QYVM1lehne6vzlSoe8gE19wxguGItxTEB0cge9GHaE rBH2cRyRil7LX7PJ3QG3Ak9Bv_oman6w1DZnN3wdQeccb4PfBkDrwgY0UD3D uja1rKVElJxxaHyKwww2eNP8SFZCBmRrDt5BjRygBIMr3EAUwbY5qTLOXqWx 5MM3TrdJQVzelOgpyrIEvH8T62d2YblAaFn34jzZvaeCuV2ZFUsOyJl3nVxH IjOrUDYXSGri7wlIzTXpnta.kbrkZQKMmjqFKb3A3Tcy1prpy1UwuwoK8L7K Xq7v1VHZIjSIv.K4_SDt9obsqL0Jh_otGaTU7Y632TgT6BU.uljMPnUv03eN oZna8PzdLMVd_btoV9AuNb94xSE0GwbbSTppxdAdDJu2z1CcDyfogtTtpPcM qM2ySmEoVtWvr8G9qgTqsHULj75ScAslarQBOOYGzswwbdHfezCOu5X34e5c gVjC3h0Pjl4X9xuSVCa9w4WUhkPiIUhsLHlcYNsatr1G7UknFQHB_Re2R_PC BNuF6kFu97x4GnMC_RP2Kdbs.w1rnX1gpLkkLfSWkM68JcuRd5.nc1o4VhEZ cnj4O2b_nZJJVDMELxGUhssRDK1u0nqSR23EYRnLPxP5v_tb0 Received: from [99.98.125.195] by web5803.biz.mail.ne1.yahoo.com via HTTP; Sat, 05 Apr 2014 10:49:47 PDT X-Rocket-MIMEInfo: 002.001, CgpQbGVhc2UgdGFrZSBtZSBvZmYgeW91ciBlbWFpbCBsaXN0CgpUaGFuayB5b3UKCm15IGVtYWlsIGlzwqAgaW5mb0BhY2ZpbHRlcnM0bGVzcy5jb20BMAEBAQE- X-Mailer: YahooMailWebService/0.8.182.648 Message-ID: <1396720187.31954.YahooMailNeo@web5803.biz.mail.ne1.yahoo.com> Date: Sat, 5 Apr 2014 10:49:47 -0700 (PDT) From: A/C Filters 4 Less Subject: Re: lukemarsden.com TAKE ME OFF YOUR EMAIL LIST To: "freebsd-xen@freebsd.org" MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.17 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list Reply-To: A/C Filters 4 Less List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 05 Apr 2014 17:52:58 -0000 =0A=0APlease take me off your email list=0A=0AThank you=0A=0Amy email is=A0= info@acfilters4less.com From owner-freebsd-xen@FreeBSD.ORG Sun Apr 6 17:08:09 2014 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id EC251E68 for ; Sun, 6 Apr 2014 17:08:09 +0000 (UTC) Received: from SMTP02.CITRIX.COM (smtp02.citrix.com [66.165.176.63]) (using TLSv1 with cipher RC4-SHA (128/128 bits)) (Client CN "mail.citrix.com", Issuer "Cybertrust Public SureServer SV CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 14D3517F for ; Sun, 6 Apr 2014 17:08:08 +0000 (UTC) X-IronPort-AV: E=Sophos;i="4.97,805,1389744000"; d="scan'208";a="117293681" Received: from accessns.citrite.net (HELO FTLPEX01CL03.citrite.net) ([10.9.154.239]) by FTLPIPO02.CITRIX.COM with ESMTP; 06 Apr 2014 17:08:00 +0000 Received: from [IPv6:::1] (10.80.16.47) by smtprelay.citrix.com (10.13.107.80) with Microsoft SMTP Server id 14.2.342.4; Sun, 6 Apr 2014 13:08:00 -0400 Message-ID: <534189F2.8030201@citrix.com> Date: Sun, 6 Apr 2014 19:08:02 +0200 From: =?ISO-8859-1?Q?Roger_Pau_Monn=E9?= User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.7; rv:24.0) Gecko/20100101 Thunderbird/24.4.0 MIME-Version: 1.0 To: Jonni Nakari , Subject: Re: Panics when booting i386 paravirtualized FreeBSD References: <533FCFC3.5060601@egarden.fi> In-Reply-To: <533FCFC3.5060601@egarden.fi> X-Enigmail-Version: 1.6 Content-Type: text/plain; charset="ISO-8859-1" Content-Transfer-Encoding: 7bit X-DLP: MIA1 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 06 Apr 2014 17:08:10 -0000 On 05/04/14 11:41, Jonni Nakari wrote: > Hello, > I'm having problems booting the i386 paravirtualized (KERNCONF=XEN) > kernel (10.0R) on Xen 4.4. My hardware is an old machine with two, dual > core AMD Opteron 285s. Most times the booting the DomU panics with > message "panic: can't schedule timer" but sometimes it goes a bit > further and panics with "panic: removing pages from non-current pmap". I > added the full boot log of both panics and Xen Domu configuration to the > end of this message. > > What could be causing those panics? Are there any recent developments of > PV FreeBSD that I'm not aware of? I can compile custom kernels and help > testing experimental patches. > > The machine is not capable of running HVM virtualized (no VT-x/AMD-V) so > I would like to get paravirtualized version of FreeBSD running, but it > seems to me that the state of PV FreeBSD is quite bad currently. If I > manage to get the DomU running, can I expect it to support multiple > processors? No, the Xen i386 PV port only supports UP. > Can it handle more than 4 GB of RAM? Theoretically yes, Xen only supports 32bit guests with PAE (which implies support for more than 4GB of RAM). > I read from a previous > post to this list that multiprocessor support might be broken, but that > message was from over a year ago. Also the maximum RAM support support > comes from an old source. Ideally I would like the FreeBSD DomU to serve > ZVOLs and NFS to other DomUs. > > example of "can't schedule timer" panic: > jonni@tara:/etc/xen$ sudo xl create maggie.pvfreebsd -c > Parsing config from maggie.pvfreebsd > WARNING: loader(8) metadata is missing! > GDB: no debug ports present > KDB: debugger backends: ddb > KDB: current backend: ddb > APIC: Using the MPTable enumerator. > SMP: Added CPU 0 (BSP) > Copyright (c) 1992-2014 The FreeBSD Project. > Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 > The Regents of the University of California. All rights reserved. > FreeBSD is a registered trademark of The FreeBSD Foundation. > FreeBSD 10.0-RELEASE #0: Sat Apr 5 07:11:56 EEST 2014 > jonni@maggie:/usr/obj/usr/src/sys/XEN i386 > FreeBSD clang version 3.3 (tags/RELEASE_33/final 183502) 20130610 > WARNING: WITNESS option enabled, expect reduced performance. > Xen reported: 2612.074 MHz processor. > CPU: Dual Core AMD Opteron(tm) Processor 285 (2612.07-MHz 686-class CPU) > Origin = "AuthenticAMD" Id = 0x20f12 Family = 0xf Model = 0x21 > Stepping = 2 > Features=0x1783fbff > 6,MMX,FXSR,SSE,SSE2,HTT> > Features2=0x1 > AMD Features=0xe2500800 > AMD Features2=0x3 > Data TLB: 32 entries, fully associative > Instruction TLB: 32 entries, fully associative > L1 data cache: 64 kbytes, 64 bytes/line, 1 lines/tag, 2-way associative > L1 instruction cache: 64 kbytes, 64 bytes/line, 1 lines/tag, 2-way > associative > L2 internal cache: 1024 kbytes, 64 bytes/line, 1 lines/tag, 8-way > associative > WARNING: This architecture revision has known SMP hardware bugs which > may cause random insta > bility > real memory = 536870912 (512 MB) > Physical memory chunk(s): > 0x0000000000873000 - 0x000000001f6a0fff, 518184960 bytes (126510 pages) > avail memory = 515543040 (491 MB) > random device not loaded; using insecure entropy > ULE: setup cpu 0 > nfslock: pseudo-device > io: > Falling back to random adaptor > random: initialized > mem: > Pentium Pro MTRR support enabled > null: > xc0: on motherboard > xenstore0: on motherboard > Grant table initialized > xen_et0: on motherboard > Event timer "XENTIMER" frequency 1000000000 Hz quality 950 > Timecounter "XENTIMER" frequency 1000000000 Hz quality 950 > xen_et0: registered as a time-of-day clock (resolution 10000000us, > adjustment 5.000000000s) > Device configuration finished. > procfs registered > panic: can't schedule timer > cpuid = 0 > KDB: enter: panic > [ thread pid 0 tid 100000 ] > Stopped at kdb_enter+0x3d: movl $0,kdb_why > db> bt > Tracing pid 0 tid 100000 td 0xc068b710 > kdb_enter(c042ffc7,c042ffc7,c041c2b4,c0748bd4,8b3b77b1,...) at > kdb_enter+0x3d/frame 0xc0748b80 > kassert_panic(c0748bd4,c0748c28,c008a9ca,c041c2b4,c01d3940,...) at > kassert_panic+0x233/frame 0xc0748bbc > panic(c041c2b4,c01d3940,246,c0633418,c08e1480,...) at panic+0x12/frame > 0xc0748bc8 > network_connect(c286162c,a3d70a,0,0,0,0,0) at > network_connect+0x3e4a/frame 0xc0748c28 > et_start(c286162c,a3d70a,0,0,0,c286162c,c0872cbc,229a5,1,1f4,0,3ce580,3ce580) > at et_start+0x10b/frame 0xc0748c58 > cpu_idleclock(1,0,c046c817,1f4,c26fda40,...) at > cpu_idleclock+0x3eb/frame 0xc0748ca0 > cpu_initclocks_bsp(c068bba8,0,c046c817,2a1,c04713b4,...) at > cpu_initclocks_bsp+0xa83/frame 0xc0748cf8 > cpu_initclocks_bsp(c04b59a4,c042754f,0,0,c0748d58,...) at > cpu_initclocks_bsp+0x3af/frame 0xc0748d18 > profclock_cnt(0,0,0,0,c0471534,...) at profclock_cnt+0x5bf/frame 0xc0748d30 > mi_startup(0,0,742000,0,0,...) at mi_startup+0xf7/frame 0xc0748d58 > btext() at btext+0x95 > db> Not sure where this is coming from, the PV timer is shared with PVHVM guests, and it seems to be working fine there. > > example of "removing pages from non-current pmap" panic: > jonni@tara:/etc/xen$ sudo xl create maggie.pvfreebsd -c > Parsing config from maggie.pvfreebsd > WARNING: loader(8) metadata is missing! > GDB: no debug ports present > KDB: debugger backends: ddb > KDB: current backend: ddb > APIC: Using the MPTable enumerator. > SMP: Added CPU 0 (BSP) > Copyright (c) 1992-2014 The FreeBSD Project. > Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 > The Regents of the University of California. All rights reserved. > FreeBSD is a registered trademark of The FreeBSD Foundation. > FreeBSD 10.0-RELEASE #0: Sat Apr 5 07:11:56 EEST 2014 > jonni@maggie:/usr/obj/usr/src/sys/XEN i386 > FreeBSD clang version 3.3 (tags/RELEASE_33/final 183502) 20130610 > WARNING: WITNESS option enabled, expect reduced performance. > Xen reported: 2612.074 MHz processor. > CPU: Dual Core AMD Opteron(tm) Processor 285 (2612.07-MHz 686-class CPU) > Origin = "AuthenticAMD" Id = 0x20f12 Family = 0xf Model = 0x21 > Stepping = 2 > Features=0x1783fbff > 6,MMX,FXSR,SSE,SSE2,HTT> > Features2=0x1 > AMD Features=0xe2500800 > AMD Features2=0x3 > Data TLB: 32 entries, fully associative > Instruction TLB: 32 entries, fully associative > L1 data cache: 64 kbytes, 64 bytes/line, 1 lines/tag, 2-way associative > L1 instruction cache: 64 kbytes, 64 bytes/line, 1 lines/tag, 2-way > associative > L2 internal cache: 1024 kbytes, 64 bytes/line, 1 lines/tag, 8-way > associative > WARNING: This architecture revision has known SMP hardware bugs which > may cause random insta > bility > real memory = 536870912 (512 MB) > Physical memory chunk(s): > 0x0000000000873000 - 0x000000001f6a0fff, 518184960 bytes (126510 pages) > avail memory = 515543040 (491 MB) > random device not loaded; using insecure entropy > ULE: setup cpu 0 > nfslock: pseudo-device > io: > Falling back to random adaptor > random: initialized > mem: > Pentium Pro MTRR support enabled > null: > xc0: on motherboard > xenstore0: on motherboard > Grant table initialized > xen_et0: on motherboard > Event timer "XENTIMER" frequency 1000000000 Hz quality 950 > Timecounter "XENTIMER" frequency 1000000000 Hz quality 950 > xen_et0: registered as a time-of-day clock (resolution 10000000us, > adjustment 5.000000000s) > Device configuration finished. > procfs registered > Timecounters tick every 10.000 msec > tcp_init: net.inet.tcp.tcbhashsize auto tuned to 4096 > lo0: bpf attached > xctrl0: on xenstore0 > xenbusb_front0: on xenstore0 > xenbusb_add_device: Device device/suspend/event-channel ignored. State 6 > xn0: at device/vif/0 on xenbusb_front0 > xn0: bpf attached > xn0: Ethernet address: 00:16:3e:7c:a1:9a > xenbusb_back0: on xenstore0 > xn0: backend features: feature-sg feature-gso-tcp4 > xbd0: 10240MB at device/vbd/832 on xenbusb_front0 > xbd0: attaching as ada1 > GEOM: new disk ada1 > random: unblocking device. > TSC timecounter discards lower 1 bit(s) > Timecounter "TSC-low" frequency 1306037000 Hz quality 800 > WARNING: WITNESS option enabled, expect reduced performance. > Trying to mount root from ufs:ada1p2 []... > start_init: trying /sbin/init > pid 26 (sh), uid 0: exited on signal 4 > panic: removing pages from non-current pmap > cpuid = 0 > KDB: enter: panic > [ thread pid 26 tid 100035 ] > Stopped at kdb_enter+0x3d: movl $0,kdb_why > db> bt > Tracing pid 26 tid 100035 td 0xc2a73000 > kdb_enter(c042ffc7,c042ffc7,c046acbe,d93b1984,c046acbe,...) at > kdb_enter+0x3d/frame 0xd93b1918 > kassert_panic(c04b7148,100,c046acbe,d93b1984,d93b1984,...) at > kassert_panic+0x233/frame 0xd93b1954 > kassert_panic(c046acbe,c0469fe4,e06,806,c0605668,...) at > kassert_panic+0xea/frame 0xd93b1978 > pmap_remove_pages(c08eaa3c,8,c04296b8,c08eaa3c,c2a79000,...) at > pmap_remove_pages+0xb3/frame 0xd93b19e8 > vmspace_exit(c2a73000,0,c04296b8,13f,4,...) at vmspace_exit+0xb1/frame > 0xd93b1a10 > exit1(c2a73000,4,1a,c2a79218,0,...) at exit1+0x654/frame 0xd93b1a70 > sigexit(c2a73000,4,c0430060,b05,c2a78c48,...) at sigexit+0xbe4/frame > 0xd93b1c20 > postsig(4,0,c0436965,10d,0,...) at postsig+0x3b2/frame 0xd93b1cdc > ast(d93b1d18) at ast+0x388/frame 0xd93b1d0c > vm86_biosret() at vm86_biosret+0x9c/frame 0xbf7fcbc0 I'm aware of this error, it can be solved by reverting r244237, although there's something clearly wrong in the i386 Xen pmap code. > Xen configuration maggie.pvfreebsd > kernel = "/root/freebsd_10.0_pv_kernel" > extra = " > vfs.root.mountfrom=ufs:ada1p2,machdep.idle_mwait=0,boot_verbose=1,kern.hz=100" The kern.hz=100 can be removed AFAIK. > > memory = 512 > name = "maggie.pvfreebsd" > vif = [ 'bridge=xenbr0'] > disk = [ > 'phy:/dev/mapper/tara--vg-maggie,hdb,w' > ] > vcpus = 1 > From owner-freebsd-xen@FreeBSD.ORG Sun Apr 6 17:09:12 2014 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 8DAD8E90 for ; Sun, 6 Apr 2014 17:09:12 +0000 (UTC) Received: from SMTP02.CITRIX.COM (smtp02.citrix.com [66.165.176.63]) (using TLSv1 with cipher RC4-SHA (128/128 bits)) (Client CN "mail.citrix.com", Issuer "Cybertrust Public SureServer SV CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id D4A4A187 for ; Sun, 6 Apr 2014 17:09:11 +0000 (UTC) X-IronPort-AV: E=Sophos;i="4.97,805,1389744000"; d="scan'208";a="117293786" Received: from accessns.citrite.net (HELO FTLPEX01CL03.citrite.net) ([10.9.154.239]) by FTLPIPO02.CITRIX.COM with ESMTP; 06 Apr 2014 17:09:09 +0000 Received: from [IPv6:::1] (10.80.16.47) by smtprelay.citrix.com (10.13.107.80) with Microsoft SMTP Server id 14.2.342.4; Sun, 6 Apr 2014 13:09:09 -0400 Message-ID: <53418A37.6030001@citrix.com> Date: Sun, 6 Apr 2014 19:09:11 +0200 From: =?windows-1252?Q?Roger_Pau_Monn=E9?= User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.7; rv:24.0) Gecko/20100101 Thunderbird/24.4.0 MIME-Version: 1.0 To: Jeroen van der Ham , Jonni Nakari Subject: Re: Panics when booting i386 paravirtualized FreeBSD References: <533FCFC3.5060601@egarden.fi> In-Reply-To: X-Enigmail-Version: 1.6 Content-Type: text/plain; charset="windows-1252" Content-Transfer-Encoding: 7bit X-DLP: MIA1 Cc: freebsd-xen@freebsd.org X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 06 Apr 2014 17:09:12 -0000 On 05/04/14 15:34, Jeroen van der Ham wrote: > Hi, > > On 5 Apr 2014, at 11:41, Jonni Nakari wrote: > >> The machine is not capable of running HVM virtualized (no VT-x/AMD-V) so I would like to get paravirtualized version of FreeBSD running, but it seems to me that the state of PV FreeBSD is quite bad currently. If I manage to get the DomU running, can I expect it to support multiple processors? Can it handle more than 4 GB of RAM? I read from a previous post to this list that multiprocessor support might be broken, but that message was from over a year ago. Also the maximum RAM support support comes from an old source. Ideally I would like the FreeBSD DomU to serve ZVOLs and NFS to other DomUs. > > Whether or not you can run HVM does not depend on the CPU, but on XEN and which loader you use (e.g. qemuloader). This is not true, Xen requires hardware virtualization extensions in the CPU in order to run HVM guests. Roger. From owner-freebsd-xen@FreeBSD.ORG Sun Apr 6 17:11:46 2014 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id C57A377 for ; Sun, 6 Apr 2014 17:11:46 +0000 (UTC) Received: from SMTP.CITRIX.COM (smtp.citrix.com [66.165.176.89]) (using TLSv1 with cipher RC4-SHA (128/128 bits)) (Client CN "mail.citrix.com", Issuer "Cybertrust Public SureServer SV CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 09285207 for ; Sun, 6 Apr 2014 17:11:45 +0000 (UTC) X-IronPort-AV: E=Sophos;i="4.97,805,1389744000"; d="scan'208";a="118494557" Received: from accessns.citrite.net (HELO FTLPEX01CL03.citrite.net) ([10.9.154.239]) by FTLPIPO01.CITRIX.COM with ESMTP; 06 Apr 2014 17:11:37 +0000 Received: from [IPv6:::1] (10.80.16.47) by smtprelay.citrix.com (10.13.107.80) with Microsoft SMTP Server id 14.2.342.4; Sun, 6 Apr 2014 13:11:37 -0400 Message-ID: <53418ACB.6030809@citrix.com> Date: Sun, 6 Apr 2014 19:11:39 +0200 From: =?ISO-8859-1?Q?Roger_Pau_Monn=E9?= User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.7; rv:24.0) Gecko/20100101 Thunderbird/24.4.0 MIME-Version: 1.0 To: "Cherry G. Mathew" , Jonni Nakari , Subject: Re: Status of 64 bit DomU PVs? References: In-Reply-To: X-Enigmail-Version: 1.6 Content-Type: text/plain; charset="ISO-8859-1" Content-Transfer-Encoding: 7bit X-DLP: MIA1 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 06 Apr 2014 17:11:46 -0000 On 05/04/14 15:14, Cherry G. Mathew wrote: > Hi Jonni, > > Date: Sat, 05 Apr 2014 00:39:24 +0300 >> From: Jonni Nakari >> To: freebsd-xen@freebsd.org >> Subject: Status of 64 bit DomU PVs? >> Message-ID: <533F268C.8040909@egarden.fi> >> Content-Type: text/plain; charset=ISO-8859-1; format=flowed >> >> Hello, >> what is the current status of 64 bit paravirtualized FreeBSD? The wiki >> page Xen wiki page [1] states that only i386 kernels can be run in fully >> paravirtualized mode. The wiki page hasn't been updated in a while. Has >> anything changed since the last update? >> >> I would like to run FreeBSD as a DomU on a AMD 64 bit machine that does >> not have hardware accelerated virtualization. That propably means that >> it's not feasible to run a HVM based DomU on the machine? I would also >> like the DomU to be 64 bit to provide more than 4 gigabytes of RAM to >> the ZFS serving FreeBSD. >> >> > I've been working on this for quite some time now (perhaps too long), and > the bad news is that, no, it's not ready for use - the code on the branch > does bring us up to single user mode, but I'm reworking the pmap module > with the wisdom of hindsight. The good news is that it should be ready for > testing "soon" (May, 2014). > > With PV on 64bit, you should be able to have a 64bit address space with > support for 47bit RAM (in theory). > > > >> Or maybe I have misunderstood something. Is it possible to provide more >> than 4 GB RAM for a 32 bit DomU so that it can use all of it for ZFS >> caching? >> >> > On 64bit PV, the DomU is 64bit (although there used to be support for 32bit > PV on 64bit hypervisor until the 3.x hypervisors, iirc). So yes, you should > in *theory*, be able to have more than 4GB ram for your 64bit DomU. Just to clarify, a 64-bit Xen Hypervisor is perfectly capable of running 32-bit PV guests, support for 32-bit guests has never been removed from the hypervisor. Roger. From owner-freebsd-xen@FreeBSD.ORG Mon Apr 7 11:06:55 2014 Return-Path: Delivered-To: freebsd-xen@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id A188CC90 for ; Mon, 7 Apr 2014 11:06:55 +0000 (UTC) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:1900:2254:206c::16:87]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 828A7C1F for ; Mon, 7 Apr 2014 11:06:55 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.8/8.14.8) with ESMTP id s37B6tPK071284 for ; Mon, 7 Apr 2014 11:06:55 GMT (envelope-from owner-bugmaster@FreeBSD.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.8/8.14.8/Submit) id s37B6tYw071282 for freebsd-xen@FreeBSD.org; Mon, 7 Apr 2014 11:06:55 GMT (envelope-from owner-bugmaster@FreeBSD.org) Date: Mon, 7 Apr 2014 11:06:55 GMT Message-Id: <201404071106.s37B6tYw071282@freefall.freebsd.org> X-Authentication-Warning: freefall.freebsd.org: gnats set sender to owner-bugmaster@FreeBSD.org using -f From: FreeBSD bugmaster To: freebsd-xen@FreeBSD.org Subject: Current problem reports assigned to freebsd-xen@FreeBSD.org X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 07 Apr 2014 11:06:55 -0000 Note: to view an individual PR, use: http://www.freebsd.org/cgi/query-pr.cgi?pr=(number). The following is a listing of current problems submitted by FreeBSD users. These represent problem reports covering all versions including experimental development code and obsolete releases. S Tracker Resp. Description -------------------------------------------------------------------------------- o kern/183139 xen [xen] [patch] ifconfig options on xn0 lost after xen v o kern/180788 xen [xen] [panic] XEN PV kernel 9.2-BETA1 panics on boot o kern/180403 xen [xen] Problems with GENERIC and XENHVM kernels with Xe o kern/180402 xen [xen] XEN kernel does not load in XenClient 4.5.5 o kern/179814 xen [xen] mountroot fails with error=19 under Xen on 9-STA o kern/176471 xen [xen] xn driver crash on detach o kern/176053 xen [xen] [patch] i386: Correct wrong usage of vsnprintf() o kern/175954 xen [xen] XENHVM xn network driver extreme packet loss dur o kern/175822 xen [xen] FreeBSD 9.1 does not work with Xen 4.0 o kern/175757 xen [xen] [patch] xen pvhvm looses keyboard input from VNC o kern/171873 xen [xen] xn network device floods warning in dmesg o kern/166174 xen [xen] Problems ROOT MOUNT ERROR o kern/165418 xen [xen] Problems mounting root filesystem from XENHVM o kern/164630 xen [xen] XEN HVM kernel: run_interrupt_driven_hooks: stil o kern/164450 xen [xen] Failed to install FreeeBSD 9.0-RELEASE from CD i o kern/162677 xen [xen] FreeBSD not compatible with "Current Stable Xen" o kern/161318 xen [xen] sysinstall crashes with floating point exception o kern/155468 xen [xen] Xen PV i386 multi-kernel CPU system is not worki o kern/155353 xen [xen] [patch] put "nudging TOD" message under boot_ver o kern/154833 xen [xen]: xen 4.0 - DomU freebsd8.2RC3 i386, XEN kernel. o kern/154473 xen [xen] xen 4.0 - DomU freebsd8.1 i386, XEN kernel. Not o kern/154472 xen [xen] xen 4.0 - DomU freebsd8.1 i386 xen kernel reboot o kern/154428 xen [xen] xn0 network interface and PF - Massive performan o kern/153674 xen [xen] i386/XEN idle thread shows wrong percentages o kern/153672 xen [xen] [panic] i386/XEN panics under heavy fork load o kern/153620 xen [xen] Xen guest system clock drifts in AWS EC2 (FreeBS o kern/153477 xen [xen] XEN pmap code abuses vm page queue lock o kern/153150 xen [xen] xen/ec2: disable checksum offloading on interfac o kern/152228 xen [xen] [panic] Xen/PV panic with machdep.idle_mwait=1 o kern/144629 xen [xen] FreeBSD 8-RELEASE XEN pvm networking doesn't wor o kern/143398 xen [xen] FreeBSD 8-RELEASE XEN pvm networking doesn't wor o kern/143340 xen [xen] FreeBSD 8-RELEASE XEN pvm networking doesn't wor f kern/143069 xen [xen] [panic] Xen Kernel Panic - Memory modified after f kern/135667 xen ufs filesystem corruption on XEN DomU system f kern/135421 xen [xen] FreeBSD Xen PVM DomU network failure - netfronc. f kern/135178 xen [xen] Xen domU outgoing data transfer stall when TSO i p kern/135069 xen [xen] FreeBSD-current/Xen SMP doesn't function at all f i386/124516 xen [xen] FreeBSD-CURRENT Xen Kernel Segfaults when config o kern/118734 xen [xen] FreeBSD 6.3-RC1 and FreeBSD 7.0-BETA 4 fail to b 39 problems total. From owner-freebsd-xen@FreeBSD.ORG Thu Apr 10 18:29:11 2014 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id B948EBB5 for ; Thu, 10 Apr 2014 18:29:11 +0000 (UTC) Received: from salmon.maths.tcd.ie (salmon.maths.tcd.ie [IPv6:2001:770:10:300::86e2:510b]) by mx1.freebsd.org (Postfix) with SMTP id 102EA1383 for ; Thu, 10 Apr 2014 18:29:10 +0000 (UTC) Received: from bloch.maths.tcd.ie ([IPv6:2001:770:10:300:225:64ff:fe38:e26f] helo=bloch.maths.tcd.ie) by salmon.maths.tcd.ie with SMTP id ; 10 Apr 2014 19:29:09 +0100 (BST) Received: by bloch.maths.tcd.ie (Postfix, from userid 103) id D88552E03F; Thu, 10 Apr 2014 19:29:08 +0100 (IST) Date: Thu, 10 Apr 2014 19:29:08 +0100 From: "Richard M. Timoney" To: freebsd-xen@freebsd.org Subject: XENHVM won't compile with clang FreeBSD 9.2 Message-ID: <20140410182908.GA85642@maths.tcd.ie> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.5.23 (2014-03-12) X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 10 Apr 2014 18:29:11 -0000 It seems to me I need gcc to compile a XENHVM kernel FreeBSD 9.2-STABLE I get (fatal) errors like this with clang /usr/src/sys/xen/evtchn/evtchn_dev.c:328:2: error: use of GNU old-style field designator extension [-Werror,-Wgnu-designator] d_name: "evtchn", ^~~~~~~ .d_name = --------------- /usr/obj/usr/src/usr.bin/clang/clang/clang --version FreeBSD clang version 3.4 (tags/RELEASE_34/final 197956) 20140216 Target: x86_64-unknown-freebsd9.2 Thread model: posix /usr/src # svn info Path: . Working Copy Root Path: /usr/src URL: http://svn.freebsd.org/base/stable/9 Relative URL: ^/stable/9 Repository Root: http://svn.freebsd.org/base Repository UUID: ccf9f872-aa2e-dd11-9fc8-001c23d0bc1f Revision: 264295 Node Kind: directory Schedule: normal Last Changed Author: gjb Last Changed Rev: 264290 Last Changed Date: 2014-04-09 04:39:57 +0100 (Wed, 09 Apr 2014) # grep clang /etc/make.conf CC=clang CXX=clang++ CPP=clang-cpp GENERIC and VT (and world) build with these clang settings. Yours, Richard -- Richard M. Timoney (richardt@maths.tcd.ie) Tel. +353-1-896 1196 School of Mathematics, Trinity College, Dublin 2, Ireland WWW http://www.maths.tcd.ie/~richardt FAX +353-1-896 2282 From owner-freebsd-xen@FreeBSD.ORG Fri Apr 11 03:06:51 2014 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id E89ECE4F for ; Fri, 11 Apr 2014 03:06:51 +0000 (UTC) Received: from plane.gmane.org (plane.gmane.org [80.91.229.3]) (using TLSv1 with cipher AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id A1816179E for ; Fri, 11 Apr 2014 03:06:50 +0000 (UTC) Received: from list by plane.gmane.org with local (Exim 4.69) (envelope-from ) id 1WYRnj-0008Hm-1W for freebsd-xen@freebsd.org; Fri, 11 Apr 2014 05:06:47 +0200 Received: from 77.202.37.188.rev.vodafone.pt ([188.37.202.77]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Fri, 11 Apr 2014 05:06:47 +0200 Received: from miguelmclara by 77.202.37.188.rev.vodafone.pt with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Fri, 11 Apr 2014 05:06:47 +0200 X-Injected-Via-Gmane: http://gmane.org/ To: freebsd-xen@freebsd.org From: Miguel Clara Subject: Re: Panic with FreeBSD 10 RC2 on Netbsd Xen dom0 Date: Fri, 11 Apr 2014 03:06:30 +0000 (UTC) Lines: 35 Message-ID: References: <20131218001615.GA10501@moore.morphism.de> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Complaints-To: usenet@ger.gmane.org X-Gmane-NNTP-Posting-Host: sea.gmane.org User-Agent: Loom/3.14 (http://gmane.org/) X-Loom-IP: 188.37.202.77 (Mozilla/5.0 (X11; FreeBSD amd64; rv:28.0) Gecko/20100101 Firefox/28.0) X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 11 Apr 2014 03:06:52 -0000 Markus Pfeiffer morphism.de> writes: > > Dear all, > > I tried installing FreeBSD10-RC2 under Netbsd XEN dom0 (xen 4.2.0). > Unfortunately when I try connecting to the guest with ssh, the machine panics. > > I managed to take a screenshot of the output at the time of the panic: > > http://imgur.com/MH8Z3Xz > > If needed I can probably upload the crashdump. > > Cheers, > Markus > I guess its the same issue as this: http://lists.freebsd.org/pipermail/freebsd-xen/2013-December/001838.html Tried reverting every change from 9.2 o netfront code, but never worked, so the issue must have been introduced somewhere else in the code! Do you still have a netbsd Dom0? I have but planing to move from it... its sad that FreeBSD doesn't work on a NetBSD Dom0 (and to make things more complicated FreeBSD 10 comes with XENHVM support by default ) I have a PR open about this: http://www.freebsd.org/cgi/query-pr.cgi?pr=188369 From owner-freebsd-xen@FreeBSD.ORG Sat Apr 12 15:59:32 2014 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 07F101D3 for ; Sat, 12 Apr 2014 15:59:32 +0000 (UTC) Received: from mail-ob0-x233.google.com (mail-ob0-x233.google.com [IPv6:2607:f8b0:4003:c01::233]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id C8E9B14F2 for ; Sat, 12 Apr 2014 15:59:31 +0000 (UTC) Received: by mail-ob0-f179.google.com with SMTP id va2so7347269obc.24 for ; Sat, 12 Apr 2014 08:59:31 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=rl6dcQQGaW+KGUX2p85EBE5Bm1HLAJzEynC/rejnjl0=; b=z5q7VmQjSkz/xTVYiRa71gPP7pdzKpG7HhN3gg6HEGyVra1/fR1FfJ27tAswKjOYXm eYb5uJ9OkiTieN1mWUf3G/oeoB2heDx4jl9qrjfp8GUC0BdgpYySa+MllyYaWvv+M5nu WumYpV2efEJt0xISSbd7miOlpW6dotXA5eVLo0ItJ6owKGCBcVqW2fwRN7lEdRpDBfLx igjtehlT9K8WuSwGCGruuxDXZj4P4DXAsHKcGemsZ8XScPwWl4RpHXqkudVE8MCuvvjD QfrB9we8RujJHE56N3em4PIVU4L6a0h0xrJNvUXMnYcqNZiP93frXUCoA/P3xV669Aia eRPw== MIME-Version: 1.0 X-Received: by 10.60.102.37 with SMTP id fl5mr410559oeb.65.1397318371118; Sat, 12 Apr 2014 08:59:31 -0700 (PDT) Received: by 10.182.161.6 with HTTP; Sat, 12 Apr 2014 08:59:31 -0700 (PDT) Date: Sat, 12 Apr 2014 11:59:31 -0400 Message-ID: Subject: FreeBSD 10 in XenServer 6.2 From: Anjan Upadhya To: freebsd-xen@freebsd.org Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.17 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 12 Apr 2014 15:59:32 -0000 Hi, We are experimenting with FreeBSD 10 GENERIC kernel on Citrix XenServer 6.2 and build number 70446c. Our assumption from reading the FBSD 10 docs is that now being a Xen guest is natively supported and we don't need to compile a custom kernel to make it work. However, we are seeing dismal performance on disk and network access. Its just generally very slow. We have installed the xe-guest-tools port and enabled it. The VM with FBSD has the highest processor priority and have 8 gigs of Ram. FreeBSD is installed with ZFS enabled. Any insight would be greatly appreciated. This is a high priority project for us and we need to resolve this rather quickly. Looking forward to your response. Regards, Anjan Upadhya. From owner-freebsd-xen@FreeBSD.ORG Sun Apr 13 09:50:52 2014 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id DD98A4C2 for ; Sun, 13 Apr 2014 09:50:52 +0000 (UTC) Received: from 3r6s4.syminet.com (3r6s4.syminet.com [74.80.234.42]) (using TLSv1 with cipher AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id B169F1B63 for ; Sun, 13 Apr 2014 09:50:52 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=shankerbalan.net; s=x; h=To:References:Message-Id:Content-Transfer-Encoding:Date:In-Reply-To:From:Subject:Mime-Version:Content-Type; bh=PTYGwiePiumm/zExZ8RHDD5LStrXoKhvG4jj8STCRcc=; b=g7l9X8j7xS/35u8R108ubXO9iTbxpqQgnSMhw635ofi+9LmNDzAfkP91QhOLi7DXICPzDHcFf3RnKeNBqxpi7G4zKteykD5NTSmM5NKOPqyFfTXoEGlWfutFz78DvG6u; Received: from [124.40.244.169] (helo=buffy.lan) by 3r6s4.syminet.com with esmtpsa (TLS1.0:RSA_AES_128_CBC_SHA1:16) (Exim 4.76) (envelope-from ) id 1WZGMz-0004zk-UM for freebsd-xen@freebsd.org; Sun, 13 Apr 2014 02:06:34 -0700 Content-Type: text/plain; charset=windows-1252 Mime-Version: 1.0 (Mac OS X Mail 7.2 \(1874\)) Subject: Re: FreeBSD 10 in XenServer 6.2 From: Shanker Balan In-Reply-To: Date: Sun, 13 Apr 2014 14:36:25 +0530 Content-Transfer-Encoding: quoted-printable Message-Id: <442548D5-B84A-4D1C-8A4E-86FB223CA795@shankerbalan.net> References: To: freebsd-xen@freebsd.org X-Mailer: Apple Mail (2.1874) X-Antiabuse: This header was added to track abuse, please include it with any abuse report X-Antiabuse: Primary Hostname - 3r6s4.syminet.com X-Antiabuse: Original Domain - freebsd.org X-Antiabuse: Originator/Caller UID/GID - [105 113] / [105 113] X-Antiabuse: Sender Address Domain - shankerbalan.net X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 13 Apr 2014 09:50:52 -0000 Comments inline. On 12-Apr-2014, at 9:29 pm, Anjan Upadhya wrote: > Hi, >=20 > We are experimenting with FreeBSD 10 GENERIC kernel on Citrix = XenServer 6.2 > and build number 70446c. >=20 > Our assumption from reading the FBSD 10 docs is that now being a Xen = guest > is natively supported and we don't need to compile a custom kernel to = make > it work. However, we are seeing dismal performance on disk and network > access. Its just generally very slow. I have FreeBSD 10 and 11 running on XenServer 6.2+CloudStack with = service packs installed. Performance seems Ok to me for my use cases. Do you have any specifics test which I can run to compare performance = with yours? I=92ll be happy to run them on my rig. Regards. @shankerbalan= From owner-freebsd-xen@FreeBSD.ORG Mon Apr 14 11:06:56 2014 Return-Path: Delivered-To: freebsd-xen@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 399972B0 for ; Mon, 14 Apr 2014 11:06:56 +0000 (UTC) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:1900:2254:206c::16:87]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 26EF81687 for ; Mon, 14 Apr 2014 11:06:56 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.8/8.14.8) with ESMTP id s3EB6udg026097 for ; Mon, 14 Apr 2014 11:06:56 GMT (envelope-from owner-bugmaster@FreeBSD.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.8/8.14.8/Submit) id s3EB6tBx026095 for freebsd-xen@FreeBSD.org; Mon, 14 Apr 2014 11:06:55 GMT (envelope-from owner-bugmaster@FreeBSD.org) Date: Mon, 14 Apr 2014 11:06:55 GMT Message-Id: <201404141106.s3EB6tBx026095@freefall.freebsd.org> X-Authentication-Warning: freefall.freebsd.org: gnats set sender to owner-bugmaster@FreeBSD.org using -f From: FreeBSD bugmaster To: freebsd-xen@FreeBSD.org Subject: Current problem reports assigned to freebsd-xen@FreeBSD.org X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 14 Apr 2014 11:06:56 -0000 Note: to view an individual PR, use: http://www.freebsd.org/cgi/query-pr.cgi?pr=(number). The following is a listing of current problems submitted by FreeBSD users. These represent problem reports covering all versions including experimental development code and obsolete releases. S Tracker Resp. Description -------------------------------------------------------------------------------- o kern/183139 xen [xen] [patch] ifconfig options on xn0 lost after xen v o kern/180788 xen [xen] [panic] XEN PV kernel 9.2-BETA1 panics on boot o kern/180403 xen [xen] Problems with GENERIC and XENHVM kernels with Xe o kern/180402 xen [xen] XEN kernel does not load in XenClient 4.5.5 o kern/179814 xen [xen] mountroot fails with error=19 under Xen on 9-STA o kern/176471 xen [xen] xn driver crash on detach o kern/176053 xen [xen] [patch] i386: Correct wrong usage of vsnprintf() o kern/175954 xen [xen] XENHVM xn network driver extreme packet loss dur o kern/175822 xen [xen] FreeBSD 9.1 does not work with Xen 4.0 o kern/175757 xen [xen] [patch] xen pvhvm looses keyboard input from VNC o kern/171873 xen [xen] xn network device floods warning in dmesg o kern/166174 xen [xen] Problems ROOT MOUNT ERROR o kern/165418 xen [xen] Problems mounting root filesystem from XENHVM o kern/164630 xen [xen] XEN HVM kernel: run_interrupt_driven_hooks: stil o kern/164450 xen [xen] Failed to install FreeeBSD 9.0-RELEASE from CD i o kern/162677 xen [xen] FreeBSD not compatible with "Current Stable Xen" o kern/161318 xen [xen] sysinstall crashes with floating point exception o kern/155468 xen [xen] Xen PV i386 multi-kernel CPU system is not worki o kern/155353 xen [xen] [patch] put "nudging TOD" message under boot_ver o kern/154833 xen [xen]: xen 4.0 - DomU freebsd8.2RC3 i386, XEN kernel. o kern/154473 xen [xen] xen 4.0 - DomU freebsd8.1 i386, XEN kernel. Not o kern/154472 xen [xen] xen 4.0 - DomU freebsd8.1 i386 xen kernel reboot o kern/154428 xen [xen] xn0 network interface and PF - Massive performan o kern/153674 xen [xen] i386/XEN idle thread shows wrong percentages o kern/153672 xen [xen] [panic] i386/XEN panics under heavy fork load o kern/153620 xen [xen] Xen guest system clock drifts in AWS EC2 (FreeBS o kern/153477 xen [xen] XEN pmap code abuses vm page queue lock o kern/153150 xen [xen] xen/ec2: disable checksum offloading on interfac o kern/152228 xen [xen] [panic] Xen/PV panic with machdep.idle_mwait=1 o kern/144629 xen [xen] FreeBSD 8-RELEASE XEN pvm networking doesn't wor o kern/143398 xen [xen] FreeBSD 8-RELEASE XEN pvm networking doesn't wor o kern/143340 xen [xen] FreeBSD 8-RELEASE XEN pvm networking doesn't wor f kern/143069 xen [xen] [panic] Xen Kernel Panic - Memory modified after f kern/135667 xen ufs filesystem corruption on XEN DomU system f kern/135421 xen [xen] FreeBSD Xen PVM DomU network failure - netfronc. f kern/135178 xen [xen] Xen domU outgoing data transfer stall when TSO i p kern/135069 xen [xen] FreeBSD-current/Xen SMP doesn't function at all f i386/124516 xen [xen] FreeBSD-CURRENT Xen Kernel Segfaults when config o kern/118734 xen [xen] FreeBSD 6.3-RC1 and FreeBSD 7.0-BETA 4 fail to b 39 problems total. From owner-freebsd-xen@FreeBSD.ORG Tue Apr 15 19:51:59 2014 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 95210C78 for ; Tue, 15 Apr 2014 19:51:59 +0000 (UTC) Received: from blu0-omc4-s7.blu0.hotmail.com (blu0-omc4-s7.blu0.hotmail.com [65.55.111.146]) by mx1.freebsd.org (Postfix) with ESMTP id 6234515F0 for ; Tue, 15 Apr 2014 19:51:59 +0000 (UTC) Received: from BLU170-W105 ([65.55.111.137]) by blu0-omc4-s7.blu0.hotmail.com with Microsoft SMTPSVC(6.0.3790.4675); Tue, 15 Apr 2014 12:50:53 -0700 X-TMN: [kLj7w+RviZGd7KiniY1+Yj6ueIMh2vSL] X-Originating-Email: [lakhindr@hotmail.com] Message-ID: From: Lakhinder Walia To: "freebsd-xen@freebsd.org" Subject: ixgbe, SR-IOV & XenServer Date: Tue, 15 Apr 2014 12:50:52 -0700 Importance: Normal MIME-Version: 1.0 X-OriginalArrivalTime: 15 Apr 2014 19:50:53.0268 (UTC) FILETIME=[02603140:01CF58E4] Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.17 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 15 Apr 2014 19:51:59 -0000 Hi. Am curious if anybody has gotten this driver to work for a virtual function= based 10gb Ethernet port --=20 FreeBSD 10.0 is running as a VM inside a XenServer 6.2.0 based server. Packets are able to get out of this VM (at least the Arp request broadcasts= do) to other VMs & to dom_0. No packet from outside is ever received into this virtual driver. Also referring to some old conversation on this mailing list: http://lists= .freebsd.org/pipermail/freebsd-xen/2013-December/001821.html Thanks. -Lakhinder = From owner-freebsd-xen@FreeBSD.ORG Fri Apr 18 14:57:48 2014 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 730D32FA for ; Fri, 18 Apr 2014 14:57:48 +0000 (UTC) Received: from mail-wi0-x22f.google.com (mail-wi0-x22f.google.com [IPv6:2a00:1450:400c:c05::22f]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 0F5AF18B5 for ; Fri, 18 Apr 2014 14:57:47 +0000 (UTC) Received: by mail-wi0-f175.google.com with SMTP id cc10so801277wib.8 for ; Fri, 18 Apr 2014 07:57:46 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=11k+NXatbveV1KUNW4EpNqNuIZqGQNhL7fXD2u7zg2s=; b=kTmCPz9w3HBKaWhnaHNYoTsZSvEJvwN9du47NAiieOfU1oPMNadb4TsPiXQjotvG8P rp553mpkMc93aD5p3oEKbE0bRNGXyYMa5rfK9fGis8RPX48BmxRa6FENGlwi+u7Ilx3W olFcl6A4PXKizYr1arTd40hmZQXtgdBmJ233QByvWhXUQtRSyt5NNkh3rjm5dz/4N3xA ltO9BFksVGX7/NAjijGdFJlUD4DgMq46OGQGkzTuaTSt2gg11SnQiTBACy/pj4A2rfN2 0QD0CL9mOBwdG7His9F54GnkYPQvheqZW0Ep9A7YoKpxPD003ueBdBUVTg0nIF5uL6RL E3yA== MIME-Version: 1.0 X-Received: by 10.180.76.244 with SMTP id n20mr2751948wiw.4.1397833066369; Fri, 18 Apr 2014 07:57:46 -0700 (PDT) Received: by 10.216.61.203 with HTTP; Fri, 18 Apr 2014 07:57:46 -0700 (PDT) Date: Fri, 18 Apr 2014 15:57:46 +0100 Message-ID: Subject: VM in Xen 4.1; poor packet forwarding performance on xn0 From: "seanrees@gmail.com" To: freebsd-xen@freebsd.org Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.17 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 18 Apr 2014 14:57:48 -0000 Hi there freebsd-xen, I tried first on freebsd-questions@ without success, so I thought to retry here. I run OpenVPN on a FreeBSD 10.0-Rp1 VM in Xen 4.1 (HVM). I am experiencing slow network performance on xn0 that seems to have developed after I upgraded to FreeBSD 10 (no other changes). I can only achieve about 0.5mbps through this interface when forwarding packets; packets in a single direction are fine (e.g; downloading to the VPS or pushing from the VPS) and clock in at many (>10 usually) mbps. Interestingly, my identical VM (configuration managed centrally) running on Xen 3.4 (HVM) does *not* have this issue. I did a little debugging and here's what I've noticed: - Not related to OpenVPN, repro'd using ssh -d. - Slow VM has a very low rate of context switches (~250) while forwarding, fast VM has a lot more (~2000) sampled over 5 seconds using systat -v. - I can't repro a context switch limit (tried a limited fork() bomb). - Tried with *and* without LRO and TSO on xn0 (and all combinations of LRO and TSO on/off) I started digging into the Xen drivers but I realised I am not equipped to debug this. I'm looking for suggestions on what to check. My provider is offering to move me to an older Xen host but I'd like to see if I can help identify a bug either in my configuration or perhaps in FreeBSD's Xen code. Sean From owner-freebsd-xen@FreeBSD.ORG Sat Apr 19 12:10:33 2014 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 4A50F758 for ; Sat, 19 Apr 2014 12:10:33 +0000 (UTC) Received: from mail-yh0-x22c.google.com (mail-yh0-x22c.google.com [IPv6:2607:f8b0:4002:c01::22c]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 0C46C1C94 for ; Sat, 19 Apr 2014 12:10:32 +0000 (UTC) Received: by mail-yh0-f44.google.com with SMTP id f10so2202091yha.3 for ; Sat, 19 Apr 2014 05:10:32 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=content-type:mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=Cwh6dymDAdQ3i+yaOwffMSw9BiR/IE7E052p9BTVvKU=; b=ky7GPOY7fBSCjHIiaOTzKuSuU2JNxtAVWrsYIBnY6beBnQlO4sXkrmTcv7Be5eMvTK gl6B+0kLYuPruwejnYp4YTq45WaNcJEeJJYb9fSTGPT029rpmXNr2TGIHeDOnya5dtVu J+M3Rnt3/uT9sadistnGk5mzsjpZBvt9onPHFpzuwdDelAi6P6rKScLv6PJ0HYiZ+NJM cZbfukuQk5062pOnbIpn5Qc8GvgPE2Z/nmt4paiG6XavACOZws+scn4qWUaAsytyeCEx d7K2b3h3Snb0f0+T8s+KYo3cTi8fVdzNqZJaNOYNz0QdInsClZFcTXOZ4+tfBZAO+wIl 6Pow== X-Received: by 10.236.119.99 with SMTP id m63mr9083061yhh.65.1397909432142; Sat, 19 Apr 2014 05:10:32 -0700 (PDT) Received: from [191.14.30.229] ([191.14.30.229]) by mx.google.com with ESMTPSA id c27sm58694994yhm.35.2014.04.19.05.10.29 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Sat, 19 Apr 2014 05:10:30 -0700 (PDT) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (1.0) Subject: Re: VM in Xen 4.1; poor packet forwarding performance on xn0 From: Tiago Ribeiro X-Mailer: iPhone Mail (11D167) In-Reply-To: Date: Sat, 19 Apr 2014 09:11:59 -0300 Content-Transfer-Encoding: quoted-printable Message-Id: <2C3A747F-DA88-4815-A930-7C5EB1CD6238@gmail.com> References: To: "seanrees@gmail.com" Cc: "freebsd-xen@freebsd.org" X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 19 Apr 2014 12:10:33 -0000 > Em 18/04/2014, =C3=A0s 11:57, "seanrees@gmail.com" es= creveu: >=20 > Hi there freebsd-xen, >=20 > I tried first on freebsd-questions@ without success, so I thought to retry= > here. >=20 > I run OpenVPN on a FreeBSD 10.0-Rp1 VM in Xen 4.1 (HVM). I am experiencing= > slow network performance on xn0 that seems to have developed after I > upgraded to FreeBSD 10 (no other changes). I can only achieve about 0.5mbp= s > through this interface when forwarding packets; packets in a single > direction are fine (e.g; downloading to the VPS or pushing from the VPS) > and clock in at many (>10 usually) mbps. >=20 > Interestingly, my identical VM (configuration managed centrally) running o= n > Xen 3.4 (HVM) does *not* have this issue. >=20 > I did a little debugging and here's what I've noticed: > - Not related to OpenVPN, repro'd using ssh -d. > - Slow VM has a very low rate of context switches (~250) while > forwarding, fast VM has a lot more (~2000) sampled over 5 seconds using > systat -v. > - I can't repro a context switch limit (tried a limited fork() bomb). > - Tried with *and* without LRO and TSO on xn0 (and all combinations of > LRO and TSO on/off) >=20 > I started digging into the Xen drivers but I realised I am not equipped to= > debug this. I'm looking for suggestions on what to check. My provider is > offering to move me to an older Xen host but I'd like to see if I can help= > identify a bug either in my configuration or perhaps in FreeBSD's Xen code= . >=20 > Sean > _____________________________________________ Do you use pf?=20= From owner-freebsd-xen@FreeBSD.ORG Sat Apr 19 13:17:35 2014 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 1F26BCE4 for ; Sat, 19 Apr 2014 13:17:35 +0000 (UTC) Received: from mail-we0-x22d.google.com (mail-we0-x22d.google.com [IPv6:2a00:1450:400c:c03::22d]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id AB59A1278 for ; Sat, 19 Apr 2014 13:17:34 +0000 (UTC) Received: by mail-we0-f173.google.com with SMTP id w61so2408559wes.32 for ; Sat, 19 Apr 2014 06:17:32 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=IkM+RePSNTSFA/KLVQV7Rp+LW4MDd/+JRQD6rpr9VF8=; b=mifDLHBeF+h6raFUslchaHroHNBfk/+lZvPpxf0sd2BNJuEM9e1KxUVRIS88WKvZAv GRQLX2fyoJuCkeLfvdvJaLIHcQU/xSJrmqbQWlmvHEKTCsW6KsR83gMV8RaemsCIkduz 3/nK22nO39F/7hFMucCaqwja8a8FPM5W3oLpOqMWPsRyDgrc36XlPW5XYWYMdOaHLUpE eRMZZaX5OALKzDbE8ZLtVDaSEEl8+u/8UPxfZvZOYWTaMdE3EX3+SwxgP/rrrX+E5KKY Q7yOJYGwJtTjGnZKAdpK12pfSmJp6I5OPfY3GK5bv/U/K3q7m5dF4QTM58JVIY4i4Siw 7a4A== MIME-Version: 1.0 X-Received: by 10.194.78.77 with SMTP id z13mr41115wjw.64.1397913452766; Sat, 19 Apr 2014 06:17:32 -0700 (PDT) Received: by 10.216.61.203 with HTTP; Sat, 19 Apr 2014 06:17:32 -0700 (PDT) In-Reply-To: <2C3A747F-DA88-4815-A930-7C5EB1CD6238@gmail.com> References: <2C3A747F-DA88-4815-A930-7C5EB1CD6238@gmail.com> Date: Sat, 19 Apr 2014 14:17:32 +0100 Message-ID: Subject: Re: VM in Xen 4.1; poor packet forwarding performance on xn0 From: "seanrees@gmail.com" To: Tiago Ribeiro Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.17 Cc: "freebsd-xen@freebsd.org" X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 19 Apr 2014 13:17:35 -0000 On Sat, Apr 19, 2014 at 1:11 PM, Tiago Ribeiro wrote: > > > > Em 18/04/2014, =C3=A0s 11:57, "seanrees@gmail.com" > escreveu: > > > > Hi there freebsd-xen, > > > > I tried first on freebsd-questions@ without success, so I thought to > retry > > here. > > > > I run OpenVPN on a FreeBSD 10.0-Rp1 VM in Xen 4.1 (HVM). I am > experiencing > > slow network performance on xn0 that seems to have developed after I > > upgraded to FreeBSD 10 (no other changes). I can only achieve about > 0.5mbps > > through this interface when forwarding packets; packets in a single > > direction are fine (e.g; downloading to the VPS or pushing from the VPS= ) > > and clock in at many (>10 usually) mbps. > > > > Interestingly, my identical VM (configuration managed centrally) runnin= g > on > > Xen 3.4 (HVM) does *not* have this issue. > > > > I did a little debugging and here's what I've noticed: > > - Not related to OpenVPN, repro'd using ssh -d. > > - Slow VM has a very low rate of context switches (~250) while > > forwarding, fast VM has a lot more (~2000) sampled over 5 seconds using > > systat -v. > > - I can't repro a context switch limit (tried a limited fork() bomb). > > - Tried with *and* without LRO and TSO on xn0 (and all combinations of > > LRO and TSO on/off) > > > > I started digging into the Xen drivers but I realised I am not equipped > to > > debug this. I'm looking for suggestions on what to check. My provider i= s > > offering to move me to an older Xen host but I'd like to see if I can > help > > identify a bug either in my configuration or perhaps in FreeBSD's Xen > code. > > > > Sean > > _____________________________________________ > > > Do you use pf? I do. Fairly simple ruleset: default deny, a few specific port allows, NAT. Sean From owner-freebsd-xen@FreeBSD.ORG Sat Apr 19 18:05:33 2014 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 602CC60A for ; Sat, 19 Apr 2014 18:05:33 +0000 (UTC) Received: from mail-wg0-f51.google.com (mail-wg0-f51.google.com [74.125.82.51]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id EB6C41D23 for ; Sat, 19 Apr 2014 18:05:32 +0000 (UTC) Received: by mail-wg0-f51.google.com with SMTP id k14so1484796wgh.22 for ; Sat, 19 Apr 2014 11:05:24 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:message-id:date:from:user-agent:mime-version:to :subject:content-type:content-transfer-encoding; bh=MVoDHNkAeA5A0FsKOkairSYT5CkN6ipL9cR7yl0ZVjs=; b=AEMRW8krJL09qxLebXXMvCw5XktWsVX+gShWA1Mt1Sh/rXBQIRLA2UyN6aY1yBCzZR cZBtVsDf2WwfPbmDIXc2TVYcL7TwRj1XeC5vofNpUtIM3YVtJxUVNXlJzGmCkCzS5wmS rzldBIaDhjAZ4UQcG5ArBrPUHGblx/NLvXniLFwYY4+Rl639TvdtYfoEbu+Jf34D4DE8 zXZufDslVUo5VSYEx90vXbeDZqsZyOaokN+kFrK2X3fNrgqL3O+HQycqRvVeKmE+fhYQ +wF3ybbaCK9B1fVUSdjlNTZJktSqP0ZS8I1vdYNByOooOoWt2w5/ExqX88eLHAlmSu6f hM5Q== X-Gm-Message-State: ALoCoQmtz27TYna/bnjS+japJlNkerddzYUPfkfjtNn0UeTEVjmMPt8GtV5XRLs2BEJtNQmvjfrK X-Received: by 10.180.93.41 with SMTP id cr9mr7373058wib.7.1397930227652; Sat, 19 Apr 2014 10:57:07 -0700 (PDT) Received: from [192.168.0.24] (cpc8-cmbg15-2-0-cust169.5-4.cable.virginm.net. [86.30.140.170]) by mx.google.com with ESMTPSA id f7sm28449204wjy.24.2014.04.19.10.57.06 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Sat, 19 Apr 2014 10:57:07 -0700 (PDT) Message-ID: <5352B8F2.8050706@linaro.org> Date: Sat, 19 Apr 2014 18:57:06 +0100 From: Julien Grall User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:24.0) Gecko/20100101 Thunderbird/24.4.0 MIME-Version: 1.0 To: roger.pau@citrix.com, freebsd-xen@freebsd.org Subject: Building Freebsd i386 with Xen support Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 19 Apr 2014 18:05:33 -0000 Hi Roger, I'm unable to build FreeBSD i386 current with Xen support (i.e GENERIC file): xen_nexus.o: In function `nexus_xen_alloc_msi': /usr/home/xentest/works/freebsd/sys/x86/xen/xen_nexus.c:129: undefined reference to `xen_msi_alloc' xen_nexus.o: In function `nexus_xen_release_msi': /usr/home/xentest/works/freebsd/sys/x86/xen/xen_nexus.c:136: undefined reference to `xen_msi_release' xen_nexus.o: In function `nexus_xen_alloc_msix': /usr/home/xentest/works/freebsd/sys/x86/xen/xen_nexus.c:115: undefined reference to `xen_msix_alloc' xen_nexus.o: In function `nexus_xen_release_msix': /usr/home/xentest/works/freebsd/sys/x86/xen/xen_nexus.c:122: undefined reference to `xen_msix_release' xen_nexus.o: In function `nexus_xen_map_msi': /usr/home/xentest/works/freebsd/sys/x86/xen/xen_nexus.c:143: undefined reference to `xen_msi_map' With the small patch below, I'm able to build FreeBSD i386. I'm not sure what is the process to submit a patch and who should I cc. diff --git a/sys/conf/files.i386 b/sys/conf/files.i386 index f92ceff..e784133 100644 --- a/sys/conf/files.i386 +++ b/sys/conf/files.i386 @@ -599,3 +599,4 @@ x86/xen/xen_intr.c optional xen | xenhvm x86/xen/xen_apic.c optional xenhvm x86/xen/xenpv.c optional xen | xenhvm x86/xen/xen_nexus.c optional xen | xenhvm +x86/xen/xen_msi.c optional xenhvm Regards, -- Julien Grall From owner-freebsd-xen@FreeBSD.ORG Sat Apr 19 18:11:30 2014 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 1BB61744 for ; Sat, 19 Apr 2014 18:11:30 +0000 (UTC) Received: from mail-wg0-f50.google.com (mail-wg0-f50.google.com [74.125.82.50]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id A60611E16 for ; Sat, 19 Apr 2014 18:11:29 +0000 (UTC) Received: by mail-wg0-f50.google.com with SMTP id x13so1460168wgg.33 for ; Sat, 19 Apr 2014 11:11:21 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:message-id:date:from:user-agent:mime-version:to :subject:references:in-reply-to:content-type :content-transfer-encoding; bh=Eb9dgmq4K3MvgCYP0DNKGYX6+NrGyr4VFMQVUW7KasQ=; b=Nwk6/llxun3rt/Bp0jQRGXLbCiFh2fMY/2aGg3947iZ84ONSD28ucmzxWTmwLvkaPX Uz+9S9FA2tIre5KBpHvWZWdRvf+M6+Jg6+QCFhLFMs4OH4pbjkRXm+Q0hJcecY4oPgqI SSLoe/sFkg0rJixU/L6aFqVV71AUfEnZ3kJWWDH/v0E7DrN8tmwI5MJVXmxOJDWbBZY5 268ho/hAcHyqvVUKJcoqxTHVkhsUE2GYK9t3jAN5QYOnw7XyaSYC0SzDKTLcTf+Mf+Lz Yuj/MSBstDSL4VQGZ2tJ5lj3OS5q9Eh6hkOZpYeoFmun6K6Iwu4SrVznlJStdJBurBu+ BWZw== X-Gm-Message-State: ALoCoQnuJU0RWEVcSEmWuSzCaKxmmb5HZUL+S2FNOWPILokNY2va+4ONamfQnP87+hsrpV381oLg X-Received: by 10.180.72.205 with SMTP id f13mr7403952wiv.45.1397931081013; Sat, 19 Apr 2014 11:11:21 -0700 (PDT) Received: from [192.168.0.24] (cpc8-cmbg15-2-0-cust169.5-4.cable.virginm.net. [86.30.140.170]) by mx.google.com with ESMTPSA id cv4sm48938317wjc.34.2014.04.19.11.11.20 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Sat, 19 Apr 2014 11:11:20 -0700 (PDT) Message-ID: <5352BC48.6000601@linaro.org> Date: Sat, 19 Apr 2014 19:11:20 +0100 From: Julien Grall User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:24.0) Gecko/20100101 Thunderbird/24.4.0 MIME-Version: 1.0 To: roger.pau@citrix.com, freebsd-xen@freebsd.org Subject: Re: Building Freebsd i386 with Xen support References: <5352B8F2.8050706@linaro.org> In-Reply-To: <5352B8F2.8050706@linaro.org> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 19 Apr 2014 18:11:30 -0000 On 19/04/14 18:57, Julien Grall wrote: > Hi Roger, > > I'm unable to build FreeBSD i386 current with Xen support > (i.e GENERIC file): Hrrmmm it's with your pvh DOM0 v3 branch. Sorry for the noise. -- Julien Grall From owner-freebsd-xen@FreeBSD.ORG Sun Apr 20 02:09:59 2014 Return-Path: Delivered-To: freebsd-xen@smarthost.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 2EF4A1D9; Sun, 20 Apr 2014 02:09:59 +0000 (UTC) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:1900:2254:206c::16:87]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 01F281935; Sun, 20 Apr 2014 02:09:59 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.8/8.14.8) with ESMTP id s3K29wov093955; Sun, 20 Apr 2014 02:09:58 GMT (envelope-from linimon@freefall.freebsd.org) Received: (from linimon@localhost) by freefall.freebsd.org (8.14.8/8.14.8/Submit) id s3K29wi6093954; Sun, 20 Apr 2014 02:09:58 GMT (envelope-from linimon) Date: Sun, 20 Apr 2014 02:09:58 GMT Message-Id: <201404200209.s3K29wi6093954@freefall.freebsd.org> To: linimon@FreeBSD.org, freebsd-bugs@FreeBSD.org, freebsd-xen@FreeBSD.org From: linimon@FreeBSD.org Subject: Re: kern/183397: [xen] [panic] Kernel panic at first incoming ssh under Xen 4.2 with NetBSD Dom0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 20 Apr 2014 02:09:59 -0000 Old Synopsis: Kernel panic at first incoming ssh New Synopsis: [xen] [panic] Kernel panic at first incoming ssh under Xen 4.2 with NetBSD Dom0 Responsible-Changed-From-To: freebsd-bugs->freebsd-xen Responsible-Changed-By: linimon Responsible-Changed-When: Sun Apr 20 02:09:04 UTC 2014 Responsible-Changed-Why: reclassify, to see if this will attract any attention. http://www.freebsd.org/cgi/query-pr.cgi?pr=183397 From owner-freebsd-xen@FreeBSD.ORG Sun Apr 20 02:33:42 2014 Return-Path: Delivered-To: freebsd-xen@smarthost.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id AA7F9A2B; Sun, 20 Apr 2014 02:33:42 +0000 (UTC) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:1900:2254:206c::16:87]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 7EC891B8D; Sun, 20 Apr 2014 02:33:42 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.8/8.14.8) with ESMTP id s3K2XgRF004774; Sun, 20 Apr 2014 02:33:42 GMT (envelope-from linimon@freefall.freebsd.org) Received: (from linimon@localhost) by freefall.freebsd.org (8.14.8/8.14.8/Submit) id s3K2XgYC004773; Sun, 20 Apr 2014 02:33:42 GMT (envelope-from linimon) Date: Sun, 20 Apr 2014 02:33:42 GMT Message-Id: <201404200233.s3K2XgYC004773@freefall.freebsd.org> To: miguelmclara@gmail.com, linimon@FreeBSD.org, freebsd-bugs@FreeBSD.org, freebsd-xen@FreeBSD.org From: linimon@FreeBSD.org Subject: Re: kern/188369: [xen] [panic] FreeBSD 10 XENHVM panic under NetBSD Dom0 (xn_txeof: WARNING: response is -1) X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 20 Apr 2014 02:33:42 -0000 Old Synopsis: FreeBSD 10 XENHVM panic under NetBSD Dom0 (xn_txeof: WARNING: response is -1) New Synopsis: [xen] [panic] FreeBSD 10 XENHVM panic under NetBSD Dom0 (xn_txeof: WARNING: response is -1) State-Changed-From-To: open->open State-Changed-By: linimon State-Changed-When: Sun Apr 20 01:48:45 UTC 2014 State-Changed-Why: Over to maintainer(s). Responsible-Changed-From-To: freebsd-bugs->freebsd-xen Responsible-Changed-By: linimon Responsible-Changed-When: Sun Apr 20 01:48:45 UTC 2014 Responsible-Changed-Why: http://www.freebsd.org/cgi/query-pr.cgi?pr=188369 From owner-freebsd-xen@FreeBSD.ORG Sun Apr 20 03:17:17 2014 Return-Path: Delivered-To: freebsd-xen@smarthost.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 801C348D; Sun, 20 Apr 2014 03:17:17 +0000 (UTC) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:1900:2254:206c::16:87]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 53BFD10BA; Sun, 20 Apr 2014 03:17:17 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.8/8.14.8) with ESMTP id s3K3HHCE020351; Sun, 20 Apr 2014 03:17:17 GMT (envelope-from linimon@freefall.freebsd.org) Received: (from linimon@localhost) by freefall.freebsd.org (8.14.8/8.14.8/Submit) id s3K3HH3N020350; Sun, 20 Apr 2014 03:17:17 GMT (envelope-from linimon) Date: Sun, 20 Apr 2014 03:17:17 GMT Message-Id: <201404200317.s3K3HH3N020350@freefall.freebsd.org> To: linimon@FreeBSD.org, freebsd-bugs@FreeBSD.org, freebsd-xen@FreeBSD.org From: linimon@FreeBSD.org Subject: Re: kern/186375: [xen] FreeBSD 10 is very unstable on Xen 4.1(XCP 1.6) X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 20 Apr 2014 03:17:17 -0000 Old Synopsis: FreeBSD 10 is very unstable on Xen 4.1(XCP 1.6) New Synopsis: [xen] FreeBSD 10 is very unstable on Xen 4.1(XCP 1.6) Responsible-Changed-From-To: freebsd-bugs->freebsd-xen Responsible-Changed-By: linimon Responsible-Changed-When: Sun Apr 20 03:17:04 UTC 2014 Responsible-Changed-Why: Over to maintainer(s). http://www.freebsd.org/cgi/query-pr.cgi?pr=186375 From owner-freebsd-xen@FreeBSD.ORG Sun Apr 20 03:34:42 2014 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id B0337C51 for ; Sun, 20 Apr 2014 03:34:42 +0000 (UTC) Received: from mail-ve0-x234.google.com (mail-ve0-x234.google.com [IPv6:2607:f8b0:400c:c01::234]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 66BFB1235 for ; Sun, 20 Apr 2014 03:34:42 +0000 (UTC) Received: by mail-ve0-f180.google.com with SMTP id jz11so5735722veb.11 for ; Sat, 19 Apr 2014 20:34:41 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=references:in-reply-to:mime-version:content-transfer-encoding :content-type:message-id:cc:from:subject:date:to; bh=jyQuSFDA9rjVFRLx+pYv0xv1s4WwDLR4zlgsL7BgsOE=; b=jlOaAfQiPwgHnlHtS28/JIAnH64/gzi0vARjtmVFoKtd14CV47Q7bl84a+H5SsbP4Y hCyexVrJrkps/mWnTZ7Q+lEfCMtb3Ywq7dcpaV66+NISgLGIlgcjMxaRlnqfMXZnSC0x S6b1ycASjE2fllh0u9OLPxuqClbXTJvbfjvIBiEbXefRIhQye6kBsFbV9jfksNG49L2o yZpbk9sHgnJhssBPRq+B+MMcu8LkbVtUAZEf0zrroQ8Pi+cDzxfC6Wgf49dQXfHbwuhl 0KA8ccBhscs+8eAdUBVUVu1KpyEEomJRi0vJcdYtxkczHvXxuGD0tyWUhTkfUCsGTzy+ s7tw== X-Received: by 10.220.159.4 with SMTP id h4mr23431515vcx.1.1397964881460; Sat, 19 Apr 2014 20:34:41 -0700 (PDT) Received: from [192.168.1.101] (189-13-78-68.user.veloxzone.com.br. [189.13.78.68]) by mx.google.com with ESMTPSA id dv2sm68396788vdb.2.2014.04.19.20.34.39 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Sat, 19 Apr 2014 20:34:40 -0700 (PDT) References: <2C3A747F-DA88-4815-A930-7C5EB1CD6238@gmail.com> In-Reply-To: Mime-Version: 1.0 (1.0) Message-Id: <42A9E3AE-0209-4038-A5D3-2713511BA59F@gmail.com> X-Mailer: iPad Mail (9B206) From: Tiago Ribeiro Subject: Re: VM in Xen 4.1; poor packet forwarding performance on xn0 Date: Sun, 20 Apr 2014 00:34:41 -0300 To: "seanrees@gmail.com" Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.17 Cc: "freebsd-xen@freebsd.org" X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 20 Apr 2014 03:34:42 -0000 Em 19/04/2014, =C3=A0s 10:17, "seanrees@gmail.com" escr= eveu: > On Sat, Apr 19, 2014 at 1:11 PM, Tiago Ribeiro wrote: >=20 >=20 > > Em 18/04/2014, =C3=A0s 11:57, "seanrees@gmail.com" e= screveu: > > > > Hi there freebsd-xen, > > > > I tried first on freebsd-questions@ without success, so I thought to ret= ry > > here. > > > > I run OpenVPN on a FreeBSD 10.0-Rp1 VM in Xen 4.1 (HVM). I am experienci= ng > > slow network performance on xn0 that seems to have developed after I > > upgraded to FreeBSD 10 (no other changes). I can only achieve about 0.5m= bps > > through this interface when forwarding packets; packets in a single > > direction are fine (e.g; downloading to the VPS or pushing from the VPS)= > > and clock in at many (>10 usually) mbps. > > > > Interestingly, my identical VM (configuration managed centrally) running= on > > Xen 3.4 (HVM) does *not* have this issue. > > > > I did a little debugging and here's what I've noticed: > > - Not related to OpenVPN, repro'd using ssh -d. > > - Slow VM has a very low rate of context switches (~250) while > > forwarding, fast VM has a lot more (~2000) sampled over 5 seconds using > > systat -v. > > - I can't repro a context switch limit (tried a limited fork() bomb). > > - Tried with *and* without LRO and TSO on xn0 (and all combinations of > > LRO and TSO on/off) > > > > I started digging into the Xen drivers but I realised I am not equipped t= o > > debug this. I'm looking for suggestions on what to check. My provider is= > > offering to move me to an older Xen host but I'd like to see if I can he= lp > > identify a bug either in my configuration or perhaps in FreeBSD's Xen co= de. > > > > Sean > > _____________________________________________ >=20 >=20 > Do you use pf? >=20 > I do. Fairly simple ruleset: default deny, a few specific port allows, NAT= . >=20 > Sean I can't help you, i'm very interested in this topic. I have case when i use x= enserver with freebsd 10, and pf with nat, and works ok, and case with dom0 d= ebian 6 and do not work, and one case with netbsd dom0, and freebsd 9 with k= ernel compiled for xen, and works fine.= From owner-freebsd-xen@FreeBSD.ORG Sun Apr 20 22:12:05 2014 Return-Path: Delivered-To: freebsd-xen@smarthost.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 6CAA6A8C; Sun, 20 Apr 2014 22:12:05 +0000 (UTC) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:1900:2254:206c::16:87]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4162819A5; Sun, 20 Apr 2014 22:12:05 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.8/8.14.8) with ESMTP id s3KMC5dE007216; Sun, 20 Apr 2014 22:12:05 GMT (envelope-from linimon@freefall.freebsd.org) Received: (from linimon@localhost) by freefall.freebsd.org (8.14.8/8.14.8/Submit) id s3KMC5Jx007215; Sun, 20 Apr 2014 22:12:05 GMT (envelope-from linimon) Date: Sun, 20 Apr 2014 22:12:05 GMT Message-Id: <201404202212.s3KMC5Jx007215@freefall.freebsd.org> To: linimon@FreeBSD.org, freebsd-bugs@FreeBSD.org, freebsd-xen@FreeBSD.org From: linimon@FreeBSD.org Subject: Re: kern/188261: [xen] FreeBSD DomU PVHVM guests cannot 'route' traffic for other Xen PV guests on same Dom0 Host. X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 20 Apr 2014 22:12:05 -0000 Old Synopsis: FreeBSD DomU PVHVM guests cannot 'route' traffic for other Xen PV guests on same Dom0 Host. New Synopsis: [xen] FreeBSD DomU PVHVM guests cannot 'route' traffic for other Xen PV guests on same Dom0 Host. Responsible-Changed-From-To: freebsd-bugs->freebsd-xen Responsible-Changed-By: linimon Responsible-Changed-When: Sun Apr 20 22:11:48 UTC 2014 Responsible-Changed-Why: Over to maintainer(s). http://www.freebsd.org/cgi/query-pr.cgi?pr=188261 From owner-freebsd-xen@FreeBSD.ORG Mon Apr 21 11:06:57 2014 Return-Path: Delivered-To: freebsd-xen@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id D525F1F8 for ; Mon, 21 Apr 2014 11:06:57 +0000 (UTC) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:1900:2254:206c::16:87]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id C28191984 for ; Mon, 21 Apr 2014 11:06:57 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.8/8.14.8) with ESMTP id s3LB6vul085928 for ; Mon, 21 Apr 2014 11:06:57 GMT (envelope-from owner-bugmaster@FreeBSD.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.8/8.14.8/Submit) id s3LB6vEY085926 for freebsd-xen@FreeBSD.org; Mon, 21 Apr 2014 11:06:57 GMT (envelope-from owner-bugmaster@FreeBSD.org) Date: Mon, 21 Apr 2014 11:06:57 GMT Message-Id: <201404211106.s3LB6vEY085926@freefall.freebsd.org> X-Authentication-Warning: freefall.freebsd.org: gnats set sender to owner-bugmaster@FreeBSD.org using -f From: FreeBSD bugmaster To: freebsd-xen@FreeBSD.org Subject: Current problem reports assigned to freebsd-xen@FreeBSD.org X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 21 Apr 2014 11:06:58 -0000 Note: to view an individual PR, use: http://www.freebsd.org/cgi/query-pr.cgi?pr=(number). The following is a listing of current problems submitted by FreeBSD users. These represent problem reports covering all versions including experimental development code and obsolete releases. S Tracker Resp. Description -------------------------------------------------------------------------------- o kern/188369 xen [xen] [panic] FreeBSD 10 XENHVM panic under NetBSD Dom o kern/188261 xen [xen] FreeBSD DomU PVHVM guests cannot 'route' traffic o kern/186375 xen [xen] FreeBSD 10 is very unstable on Xen 4.1(XCP 1.6) o kern/183397 xen [xen] [panic] Kernel panic at first incoming ssh under o kern/183139 xen [xen] [patch] ifconfig options on xn0 lost after xen v o kern/180788 xen [xen] [panic] XEN PV kernel 9.2-BETA1 panics on boot o kern/180403 xen [xen] Problems with GENERIC and XENHVM kernels with Xe o kern/180402 xen [xen] XEN kernel does not load in XenClient 4.5.5 o kern/179814 xen [xen] mountroot fails with error=19 under Xen on 9-STA o kern/176471 xen [xen] xn driver crash on detach o kern/176053 xen [xen] [patch] i386: Correct wrong usage of vsnprintf() o kern/175954 xen [xen] XENHVM xn network driver extreme packet loss dur o kern/175822 xen [xen] FreeBSD 9.1 does not work with Xen 4.0 o kern/175757 xen [xen] [patch] xen pvhvm looses keyboard input from VNC o kern/171873 xen [xen] xn network device floods warning in dmesg o kern/166174 xen [xen] Problems ROOT MOUNT ERROR o kern/165418 xen [xen] Problems mounting root filesystem from XENHVM o kern/164630 xen [xen] XEN HVM kernel: run_interrupt_driven_hooks: stil o kern/164450 xen [xen] Failed to install FreeeBSD 9.0-RELEASE from CD i o kern/162677 xen [xen] FreeBSD not compatible with "Current Stable Xen" o kern/161318 xen [xen] sysinstall crashes with floating point exception o kern/155468 xen [xen] Xen PV i386 multi-kernel CPU system is not worki o kern/155353 xen [xen] [patch] put "nudging TOD" message under boot_ver o kern/154833 xen [xen]: xen 4.0 - DomU freebsd8.2RC3 i386, XEN kernel. o kern/154473 xen [xen] xen 4.0 - DomU freebsd8.1 i386, XEN kernel. Not o kern/154472 xen [xen] xen 4.0 - DomU freebsd8.1 i386 xen kernel reboot o kern/154428 xen [xen] xn0 network interface and PF - Massive performan o kern/153674 xen [xen] i386/XEN idle thread shows wrong percentages o kern/153672 xen [xen] [panic] i386/XEN panics under heavy fork load o kern/153620 xen [xen] Xen guest system clock drifts in AWS EC2 (FreeBS o kern/153477 xen [xen] XEN pmap code abuses vm page queue lock o kern/153150 xen [xen] xen/ec2: disable checksum offloading on interfac o kern/152228 xen [xen] [panic] Xen/PV panic with machdep.idle_mwait=1 o kern/144629 xen [xen] FreeBSD 8-RELEASE XEN pvm networking doesn't wor o kern/143398 xen [xen] FreeBSD 8-RELEASE XEN pvm networking doesn't wor o kern/143340 xen [xen] FreeBSD 8-RELEASE XEN pvm networking doesn't wor f kern/143069 xen [xen] [panic] Xen Kernel Panic - Memory modified after f kern/135667 xen ufs filesystem corruption on XEN DomU system f kern/135421 xen [xen] FreeBSD Xen PVM DomU network failure - netfronc. f kern/135178 xen [xen] Xen domU outgoing data transfer stall when TSO i p kern/135069 xen [xen] FreeBSD-current/Xen SMP doesn't function at all f i386/124516 xen [xen] FreeBSD-CURRENT Xen Kernel Segfaults when config o kern/118734 xen [xen] FreeBSD 6.3-RC1 and FreeBSD 7.0-BETA 4 fail to b 43 problems total. From owner-freebsd-xen@FreeBSD.ORG Tue Apr 22 14:10:14 2014 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 3AB03D72 for ; Tue, 22 Apr 2014 14:10:14 +0000 (UTC) Received: from SMTP.CITRIX.COM (smtp.citrix.com [66.165.176.89]) (using TLSv1 with cipher RC4-SHA (128/128 bits)) (Client CN "mail.citrix.com", Issuer "Cybertrust Public SureServer SV CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 87F6E1A3B for ; Tue, 22 Apr 2014 14:10:12 +0000 (UTC) X-IronPort-AV: E=Sophos;i="4.97,904,1389744000"; d="scan'208,223";a="123367789" Received: from accessns.citrite.net (HELO FTLPEX01CL02.citrite.net) ([10.9.154.239]) by FTLPIPO01.CITRIX.COM with ESMTP; 22 Apr 2014 14:10:03 +0000 Received: from [IPv6:::1] (10.80.16.47) by smtprelay.citrix.com (10.13.107.79) with Microsoft SMTP Server id 14.3.123.3; Tue, 22 Apr 2014 10:10:03 -0400 Message-ID: <53567847.10203@citrix.com> Date: Tue, 22 Apr 2014 16:10:15 +0200 From: =?ISO-8859-1?Q?Roger_Pau_Monn=E9?= User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.7; rv:24.0) Gecko/20100101 Thunderbird/24.4.0 MIME-Version: 1.0 To: "seanrees@gmail.com" , Subject: Re: VM in Xen 4.1; poor packet forwarding performance on xn0 References: In-Reply-To: X-Enigmail-Version: 1.6 Content-Type: multipart/mixed; boundary="------------030009050109050005060006" X-DLP: MIA2 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 22 Apr 2014 14:10:14 -0000 --------------030009050109050005060006 Content-Type: text/plain; charset="ISO-8859-1" Content-Transfer-Encoding: 7bit On 18/04/14 16:57, seanrees@gmail.com wrote: > Hi there freebsd-xen, > > I tried first on freebsd-questions@ without success, so I thought to retry > here. > > I run OpenVPN on a FreeBSD 10.0-Rp1 VM in Xen 4.1 (HVM). I am experiencing > slow network performance on xn0 that seems to have developed after I > upgraded to FreeBSD 10 (no other changes). I can only achieve about 0.5mbps > through this interface when forwarding packets; packets in a single > direction are fine (e.g; downloading to the VPS or pushing from the VPS) > and clock in at many (>10 usually) mbps. > > Interestingly, my identical VM (configuration managed centrally) running on > Xen 3.4 (HVM) does *not* have this issue. Hello, The difference between Xen 3.4 and Xen 4.1 is that FreeBSD will make use of the vector callback, the PV timer and PV IPIs when running on Xen > 4.0 (which should provide better performance). I'm attaching a patch that will make FreeBSD behave the same way when running on either Xen 3.4 or Xen 4.1 (by disabling all this new additions), could you please give it a try? > > I did a little debugging and here's what I've noticed: > - Not related to OpenVPN, repro'd using ssh -d. > - Slow VM has a very low rate of context switches (~250) while > forwarding, fast VM has a lot more (~2000) sampled over 5 seconds using > systat -v. > - I can't repro a context switch limit (tried a limited fork() bomb). > - Tried with *and* without LRO and TSO on xn0 (and all combinations of > LRO and TSO on/off) I've got the feeling that the issue you are seeing is not related to the Xen version itself, but the Linux Dom0 kernel version (which I suppose is different in the Xen 3.4 and Xen 4.1 hosts). Could you ask your provider which Linux Dom0 kernel are they using on the different hosts? Roger. --------------030009050109050005060006 Content-Type: text/plain; charset="UTF-8"; x-mac-type=0; x-mac-creator=0; name="0001-.patch" Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename="0001-.patch" >From a866add6f87d726ae2c6ab5837d1b6eefb721be8 Mon Sep 17 00:00:00 2001 From: Roger Pau Monne Date: Tue, 22 Apr 2014 09:50:09 +0200 Subject: [PATCH] --- sys/x86/xen/hvm.c | 4 +++- 1 files changed, 3 insertions(+), 1 deletions(-) diff --git a/sys/x86/xen/hvm.c b/sys/x86/xen/hvm.c index 72811dc..8ad0f2d 100644 --- a/sys/x86/xen/hvm.c +++ b/sys/x86/xen/hvm.c @@ -626,6 +626,7 @@ xen_hvm_set_callback(device_t dev) xhp.domid = DOMID_SELF; xhp.index = HVM_PARAM_CALLBACK_IRQ; +#if 0 if (xen_feature(XENFEAT_hvm_callback_vector) != 0) { int error; @@ -638,6 +639,7 @@ xen_hvm_set_callback(device_t dev) printf("Xen HVM callback vector registration failed (%d). " "Falling back to emulated device interrupt\n", error); } +#endif xen_vector_callback_enabled = 0; if (dev == NULL) { /* @@ -783,7 +785,7 @@ xen_hvm_cpu_init(void) info.mfn = vtophys(vcpu_info) >> PAGE_SHIFT; info.offset = vtophys(vcpu_info) - trunc_page(vtophys(vcpu_info)); - rc = HYPERVISOR_vcpu_op(VCPUOP_register_vcpu_info, cpu, &info); + rc = 1; if (rc != 0) DPCPU_SET(vcpu_info, &HYPERVISOR_shared_info->vcpu_info[cpu]); else -- 1.7.7.5 (Apple Git-26) --------------030009050109050005060006-- From owner-freebsd-xen@FreeBSD.ORG Tue Apr 22 14:20:01 2014 Return-Path: Delivered-To: freebsd-xen@smarthost.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 80590326 for ; Tue, 22 Apr 2014 14:20:01 +0000 (UTC) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:1900:2254:206c::16:87]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 6B7381B61 for ; Tue, 22 Apr 2014 14:20:01 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.8/8.14.8) with ESMTP id s3MEK1Un075395 for ; Tue, 22 Apr 2014 14:20:01 GMT (envelope-from gnats@freefall.freebsd.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.8/8.14.8/Submit) id s3MEK1Vl075394; Tue, 22 Apr 2014 14:20:01 GMT (envelope-from gnats) Date: Tue, 22 Apr 2014 14:20:01 GMT Message-Id: <201404221420.s3MEK1Vl075394@freefall.freebsd.org> To: freebsd-xen@FreeBSD.org Cc: From: =?ISO-8859-1?Q?Roger_Pau_Monn=E9?= Subject: Re: kern/186375: [xen] FreeBSD 10 is very unstable on Xen 4.1(XCP 1.6) X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list Reply-To: =?ISO-8859-1?Q?Roger_Pau_Monn=E9?= List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 22 Apr 2014 14:20:01 -0000 The following reply was made to PR kern/186375; it has been noted by GNATS. From: =?ISO-8859-1?Q?Roger_Pau_Monn=E9?= To: , Cc: Subject: Re: kern/186375: [xen] FreeBSD 10 is very unstable on Xen 4.1(XCP 1.6) Date: Tue, 22 Apr 2014 16:16:59 +0200 Hello, In the PR you mention that the VM crashes/panics, could you please provide the complete logs of the crash and the panics? Without those it is impossible to diagnose the problem, much less try to fix it. I usually do buildkernel/buildworld/tindebox from a NFS share inside of a FreeBSD VM running on Xen 4.4/4.5, and so far I haven't seen any of this issues. Roger. From owner-freebsd-xen@FreeBSD.ORG Sat Apr 26 01:22:19 2014 Return-Path: Delivered-To: freebsd-xen@smarthost.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 3EE81F5A; Sat, 26 Apr 2014 01:22:19 +0000 (UTC) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:1900:2254:206c::16:87]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 1305910C9; Sat, 26 Apr 2014 01:22:19 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.8/8.14.8) with ESMTP id s3Q1MIdP004976; Sat, 26 Apr 2014 01:22:18 GMT (envelope-from linimon@freefall.freebsd.org) Received: (from linimon@localhost) by freefall.freebsd.org (8.14.8/8.14.8/Submit) id s3Q1MIBx004975; Sat, 26 Apr 2014 01:22:18 GMT (envelope-from linimon) Date: Sat, 26 Apr 2014 01:22:18 GMT Message-Id: <201404260122.s3Q1MIBx004975@freefall.freebsd.org> To: linimon@FreeBSD.org, freebsd-amd64@FreeBSD.org, freebsd-xen@FreeBSD.org From: linimon@FreeBSD.org Subject: Re: bin/188990: [xen] dhclient(8) does not accept DHCP Offer on FreeBSD 10 as Xen DomU Guest X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 26 Apr 2014 01:22:19 -0000 Old Synopsis: dhclient does not accept DHCP Offer on FreeBSD 10 as Xen DomU Guest New Synopsis: [xen] dhclient(8) does not accept DHCP Offer on FreeBSD 10 as Xen DomU Guest Responsible-Changed-From-To: freebsd-amd64->freebsd-xen Responsible-Changed-By: linimon Responsible-Changed-When: Sat Apr 26 01:21:47 UTC 2014 Responsible-Changed-Why: reclassify. http://www.freebsd.org/cgi/query-pr.cgi?pr=188990 From owner-freebsd-xen@FreeBSD.ORG Sat Apr 26 07:20:01 2014 Return-Path: Delivered-To: freebsd-xen@smarthost.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 7A3BEFC2 for ; Sat, 26 Apr 2014 07:20:01 +0000 (UTC) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:1900:2254:206c::16:87]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4C22E1C7D for ; Sat, 26 Apr 2014 07:20:01 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.8/8.14.8) with ESMTP id s3Q7K1tt037399 for ; Sat, 26 Apr 2014 07:20:01 GMT (envelope-from gnats@freefall.freebsd.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.8/8.14.8/Submit) id s3Q7K1Y5037398; Sat, 26 Apr 2014 07:20:01 GMT (envelope-from gnats) Date: Sat, 26 Apr 2014 07:20:01 GMT Message-Id: <201404260720.s3Q7K1Y5037398@freefall.freebsd.org> To: freebsd-xen@FreeBSD.org Cc: From: =?ISO-8859-1?Q?Roger_Pau_Monn=E9?= Subject: Re: bin/188990: [xen] dhclient(8) does not accept DHCP Offer on FreeBSD 10 as Xen DomU Guest X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list Reply-To: =?ISO-8859-1?Q?Roger_Pau_Monn=E9?= List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 26 Apr 2014 07:20:01 -0000 The following reply was made to PR bin/188990; it has been noted by GNATS. From: =?ISO-8859-1?Q?Roger_Pau_Monn=E9?= To: , Cc: Subject: Re: bin/188990: [xen] dhclient(8) does not accept DHCP Offer on FreeBSD 10 as Xen DomU Guest Date: Sat, 26 Apr 2014 09:15:50 +0200 Hello, Could you provide more info about the Dom0 kernel version? Roger. From owner-freebsd-xen@FreeBSD.ORG Sat Apr 26 08:30:01 2014 Return-Path: Delivered-To: freebsd-xen@smarthost.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 5DA35A9B for ; Sat, 26 Apr 2014 08:30:01 +0000 (UTC) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:1900:2254:206c::16:87]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4ABCC1298 for ; Sat, 26 Apr 2014 08:30:01 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.8/8.14.8) with ESMTP id s3Q8U10o073818 for ; Sat, 26 Apr 2014 08:30:01 GMT (envelope-from gnats@freefall.freebsd.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.8/8.14.8/Submit) id s3Q8U1QD073817; Sat, 26 Apr 2014 08:30:01 GMT (envelope-from gnats) Date: Sat, 26 Apr 2014 08:30:01 GMT Message-Id: <201404260830.s3Q8U1QD073817@freefall.freebsd.org> To: freebsd-xen@FreeBSD.org Cc: From: Thomas Zelch Subject: Re: bin/188990: [xen] dhclient(8) does not accept DHCP Offer on FreeBSD 10 as Xen DomU Guest X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list Reply-To: Thomas Zelch List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 26 Apr 2014 08:30:01 -0000 The following reply was made to PR bin/188990; it has been noted by GNATS. From: Thomas Zelch To: =?iso-8859-1?Q?Roger_Pau_Monn=E9?= Cc: bug-followup@FreeBSD.org Subject: Re: bin/188990: [xen] dhclient(8) does not accept DHCP Offer on FreeBSD 10 as Xen DomU Guest Date: Sat, 26 Apr 2014 10:29:03 +0200 Hi Roger, The Dom0 is running Arch Linux with the following Kernel: Linux central 3.14.1-1-ARCH #1 SMP PREEMPT Mon Apr 14 20:40:47 CEST 2014 = x86_64 GNU/Linux The Xen Version is 4.4.0. The DHCP Service is delivered by another DomU, running Arch Linux with = the same Kernel and dnsmasq 2.69. Regards, Thomas Am 26.04.2014 um 09:15 schrieb Roger Pau Monn=E9 : > Hello, >=20 > Could you provide more info about the Dom0 kernel version? >=20 > Roger. From owner-freebsd-xen@FreeBSD.ORG Sat Apr 26 08:40:01 2014 Return-Path: Delivered-To: freebsd-xen@smarthost.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 76BD5B2F for ; Sat, 26 Apr 2014 08:40:01 +0000 (UTC) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:1900:2254:206c::16:87]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 634F31345 for ; Sat, 26 Apr 2014 08:40:01 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.8/8.14.8) with ESMTP id s3Q8e1Wf077424 for ; Sat, 26 Apr 2014 08:40:01 GMT (envelope-from gnats@freefall.freebsd.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.8/8.14.8/Submit) id s3Q8e170077423; Sat, 26 Apr 2014 08:40:01 GMT (envelope-from gnats) Date: Sat, 26 Apr 2014 08:40:01 GMT Message-Id: <201404260840.s3Q8e170077423@freefall.freebsd.org> To: freebsd-xen@FreeBSD.org Cc: From: =?ISO-8859-1?Q?Roger_Pau_Monn=E9?= Subject: Re: bin/188990: [xen] dhclient(8) does not accept DHCP Offer on FreeBSD 10 as Xen DomU Guest X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list Reply-To: =?ISO-8859-1?Q?Roger_Pau_Monn=E9?= List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 26 Apr 2014 08:40:01 -0000 The following reply was made to PR bin/188990; it has been noted by GNATS. From: =?ISO-8859-1?Q?Roger_Pau_Monn=E9?= To: , Cc: Subject: Re: bin/188990: [xen] dhclient(8) does not accept DHCP Offer on FreeBSD 10 as Xen DomU Guest Date: Sat, 26 Apr 2014 10:35:12 +0200 Could you try to move the DNS server to another host? There have been reports of failures on if_xn when sending/receiving data to/from other guests on the same host. I know this is not a valid log-term solution, but it could help in identifying the problem, which is probably related to PR 188261. Roger. From owner-freebsd-xen@FreeBSD.ORG Sat Apr 26 11:57:18 2014 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 060C1136 for ; Sat, 26 Apr 2014 11:57:18 +0000 (UTC) Received: from mail-we0-x22c.google.com (mail-we0-x22c.google.com [IPv6:2a00:1450:400c:c03::22c]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 85F4313A3 for ; Sat, 26 Apr 2014 11:57:17 +0000 (UTC) Received: by mail-we0-f172.google.com with SMTP id k48so746516wev.17 for ; Sat, 26 Apr 2014 04:57:15 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=AQN45VvAUdSASvh1uH+KXB4+kj2GJkk6abAGYPWP/V8=; b=wT7o3NdSRDY2nzW405n/BgzShGbtSrF8/+1cVUpbTfpwxSft03qkQ3i8A/lHOxL0Ax 4lYYquvgS5QMJ4V8A4oH+JUuB5ievYO5kVw0g2CxJyYmFK2UL+ZUJx+8n8BbhEw2XJy2 vXvtwOZIojlO5c+4g7PQWk/+tG/R/M0UBM3sb4sEW75vlfbJHWpXUBWVXBQf4asDeA/H dGIYL5L8LlMxAVQO2/ewPK830Lo9a7MfNmfVj7Exe0GhgmE+j7r3n00bfHChEVSwrtxd Kn9ebAX84uOp9FEztwTtayBURTFMXbQUnuFexulU2ufjsmqrn4L9x+SGup4DvKsjRUrv 5mbg== MIME-Version: 1.0 X-Received: by 10.180.39.175 with SMTP id q15mr7679156wik.4.1398513435764; Sat, 26 Apr 2014 04:57:15 -0700 (PDT) Received: by 10.216.61.203 with HTTP; Sat, 26 Apr 2014 04:57:15 -0700 (PDT) In-Reply-To: <53567847.10203@citrix.com> References: <53567847.10203@citrix.com> Date: Sat, 26 Apr 2014 12:57:15 +0100 Message-ID: Subject: Re: VM in Xen 4.1; poor packet forwarding performance on xn0 From: "seanrees@gmail.com" To: =?UTF-8?Q?Roger_Pau_Monn=C3=A9?= Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.17 Cc: "freebsd-xen@freebsd.org" X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 26 Apr 2014 11:57:18 -0000 Hi Roger, Thanks for the patch -- sadly, it didn't work. No change. I did have to modify a bit for releng/10.0; for some reason patch refused to apply it cleanly. It looked fairly straightforward but I attached inline the patch I ultimately applied below just in case I got it wrong. Are there any other potential differences between Xen 3.4 and 4.1? (my provider migrated my problem VPS to a 3.4 host and the problem evaporated; I am trying this on a new 4.1 VPS that I was able to reproduce the problem on). Sean Index: hvm.c =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D --- hvm.c (revision 264963) +++ hvm.c (working copy) @@ -626,6 +626,7 @@ xhp.domid =3D DOMID_SELF; xhp.index =3D HVM_PARAM_CALLBACK_IRQ; +#if 0 if (xen_feature(XENFEAT_hvm_callback_vector) !=3D 0) { int error; @@ -638,6 +639,7 @@ printf("Xen HVM callback vector registration failed (%d). " "Falling back to emulated device interrupt\n", error); } +#endif xen_vector_callback_enabled =3D 0; if (dev =3D=3D NULL) { /* @@ -783,7 +785,7 @@ info.mfn =3D vtophys(vcpu_info) >> PAGE_SHIFT; info.offset =3D vtophys(vcpu_info) - trunc_page(vtophys(vcpu_info)); - rc =3D HYPERVISOR_vcpu_op(VCPUOP_register_vcpu_info, cpu, &info); + rc =3D 1; if (rc !=3D 0) DPCPU_SET(vcpu_info, &HYPERVISOR_shared_info->vcpu_info[cpu]); else On Tue, Apr 22, 2014 at 3:10 PM, Roger Pau Monn=C3=A9 wrote: > On 18/04/14 16:57, seanrees@gmail.com wrote: > > Hi there freebsd-xen, > > > > I tried first on freebsd-questions@ without success, so I thought to > retry > > here. > > > > I run OpenVPN on a FreeBSD 10.0-Rp1 VM in Xen 4.1 (HVM). I am > experiencing > > slow network performance on xn0 that seems to have developed after I > > upgraded to FreeBSD 10 (no other changes). I can only achieve about > 0.5mbps > > through this interface when forwarding packets; packets in a single > > direction are fine (e.g; downloading to the VPS or pushing from the VPS= ) > > and clock in at many (>10 usually) mbps. > > > > Interestingly, my identical VM (configuration managed centrally) runnin= g > on > > Xen 3.4 (HVM) does *not* have this issue. > > Hello, > > The difference between Xen 3.4 and Xen 4.1 is that FreeBSD will make use > of the vector callback, the PV timer and PV IPIs when running on Xen > > 4.0 (which should provide better performance). I'm attaching a patch > that will make FreeBSD behave the same way when running on either Xen > 3.4 or Xen 4.1 (by disabling all this new additions), could you please > give it a try? > > > > > I did a little debugging and here's what I've noticed: > > - Not related to OpenVPN, repro'd using ssh -d. > > - Slow VM has a very low rate of context switches (~250) while > > forwarding, fast VM has a lot more (~2000) sampled over 5 seconds using > > systat -v. > > - I can't repro a context switch limit (tried a limited fork() bomb). > > - Tried with *and* without LRO and TSO on xn0 (and all combinations o= f > > LRO and TSO on/off) > > I've got the feeling that the issue you are seeing is not related to the > Xen version itself, but the Linux Dom0 kernel version (which I suppose > is different in the Xen 3.4 and Xen 4.1 hosts). Could you ask your > provider which Linux Dom0 kernel are they using on the different hosts? > > Roger. > From owner-freebsd-xen@FreeBSD.ORG Sat Apr 26 12:06:47 2014 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id E3B2437F for ; Sat, 26 Apr 2014 12:06:47 +0000 (UTC) Received: from SMTP02.CITRIX.COM (smtp02.citrix.com [66.165.176.63]) (using TLSv1 with cipher RC4-SHA (128/128 bits)) (Client CN "mail.citrix.com", Issuer "Cybertrust Public SureServer SV CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 3D89014CD for ; Sat, 26 Apr 2014 12:06:46 +0000 (UTC) X-IronPort-AV: E=Sophos;i="4.97,933,1389744000"; d="scan'208";a="123878740" Received: from accessns.citrite.net (HELO FTLPEX01CL03.citrite.net) ([10.9.154.239]) by FTLPIPO02.CITRIX.COM with ESMTP; 26 Apr 2014 12:06:44 +0000 Received: from [IPv6:::1] (10.80.16.47) by smtprelay.citrix.com (10.13.107.80) with Microsoft SMTP Server id 14.3.181.6; Sat, 26 Apr 2014 08:06:44 -0400 Message-ID: <535BA152.6080300@citrix.com> Date: Sat, 26 Apr 2014 14:06:42 +0200 From: =?UTF-8?B?Um9nZXIgUGF1IE1vbm7DqQ==?= User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.7; rv:24.0) Gecko/20100101 Thunderbird/24.4.0 MIME-Version: 1.0 To: "seanrees@gmail.com" Subject: Re: VM in Xen 4.1; poor packet forwarding performance on xn0 References: <53567847.10203@citrix.com> In-Reply-To: X-Enigmail-Version: 1.6 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-DLP: MIA1 Cc: "freebsd-xen@freebsd.org" X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 26 Apr 2014 12:06:48 -0000 On 26/04/14 13:57, seanrees@gmail.com wrote: > Hi Roger, > > Thanks for the patch -- sadly, it didn't work. No change. Hello, > > I did have to modify a bit for releng/10.0; for some reason patch > refused to apply it cleanly. It looked fairly straightforward but I > attached inline the patch I ultimately applied below just in case I got > it wrong. Patch looks fine. > Are there any other potential differences between Xen 3.4 and 4.1? (my > provider migrated my problem VPS to a 3.4 host and the problem > evaporated; I am trying this on a new 4.1 VPS that I was able to > reproduce the problem on). I'm quite sure this is not related to the underlying Xen version, but to the Linux Dom0 kernel version your provider is using, could you ask them the Linux versions they are using on the 4.1 and 3.4 hosts? Roger. From owner-freebsd-xen@FreeBSD.ORG Mon Apr 28 11:06:58 2014 Return-Path: Delivered-To: freebsd-xen@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 84E26665 for ; Mon, 28 Apr 2014 11:06:58 +0000 (UTC) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:1900:2254:206c::16:87]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 6E3081AC2 for ; Mon, 28 Apr 2014 11:06:58 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.8/8.14.8) with ESMTP id s3SB6wtq086355 for ; Mon, 28 Apr 2014 11:06:58 GMT (envelope-from owner-bugmaster@FreeBSD.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.8/8.14.8/Submit) id s3SB6vAT086353 for freebsd-xen@FreeBSD.org; Mon, 28 Apr 2014 11:06:57 GMT (envelope-from owner-bugmaster@FreeBSD.org) Date: Mon, 28 Apr 2014 11:06:57 GMT Message-Id: <201404281106.s3SB6vAT086353@freefall.freebsd.org> X-Authentication-Warning: freefall.freebsd.org: gnats set sender to owner-bugmaster@FreeBSD.org using -f From: FreeBSD bugmaster To: freebsd-xen@FreeBSD.org Subject: Current problem reports assigned to freebsd-xen@FreeBSD.org X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 28 Apr 2014 11:06:58 -0000 Note: to view an individual PR, use: http://www.freebsd.org/cgi/query-pr.cgi?pr=(number). The following is a listing of current problems submitted by FreeBSD users. These represent problem reports covering all versions including experimental development code and obsolete releases. S Tracker Resp. Description -------------------------------------------------------------------------------- o bin/188990 xen [xen] dhclient(8) does not accept DHCP Offer on FreeBS o kern/188369 xen [xen] [panic] FreeBSD 10 XENHVM panic under NetBSD Dom o kern/188261 xen [xen] FreeBSD DomU PVHVM guests cannot 'route' traffic o kern/186375 xen [xen] FreeBSD 10 is very unstable on Xen 4.1(XCP 1.6) o kern/183397 xen [xen] [panic] Kernel panic at first incoming ssh under o kern/183139 xen [xen] [patch] ifconfig options on xn0 lost after xen v o kern/180788 xen [xen] [panic] XEN PV kernel 9.2-BETA1 panics on boot o kern/180403 xen [xen] Problems with GENERIC and XENHVM kernels with Xe o kern/180402 xen [xen] XEN kernel does not load in XenClient 4.5.5 o kern/179814 xen [xen] mountroot fails with error=19 under Xen on 9-STA o kern/176471 xen [xen] xn driver crash on detach o kern/176053 xen [xen] [patch] i386: Correct wrong usage of vsnprintf() o kern/175954 xen [xen] XENHVM xn network driver extreme packet loss dur o kern/175822 xen [xen] FreeBSD 9.1 does not work with Xen 4.0 o kern/175757 xen [xen] [patch] xen pvhvm looses keyboard input from VNC o kern/171873 xen [xen] xn network device floods warning in dmesg o kern/166174 xen [xen] Problems ROOT MOUNT ERROR o kern/165418 xen [xen] Problems mounting root filesystem from XENHVM o kern/164630 xen [xen] XEN HVM kernel: run_interrupt_driven_hooks: stil o kern/164450 xen [xen] Failed to install FreeeBSD 9.0-RELEASE from CD i o kern/162677 xen [xen] FreeBSD not compatible with "Current Stable Xen" o kern/161318 xen [xen] sysinstall crashes with floating point exception o kern/155468 xen [xen] Xen PV i386 multi-kernel CPU system is not worki o kern/155353 xen [xen] [patch] put "nudging TOD" message under boot_ver o kern/154833 xen [xen]: xen 4.0 - DomU freebsd8.2RC3 i386, XEN kernel. o kern/154473 xen [xen] xen 4.0 - DomU freebsd8.1 i386, XEN kernel. Not o kern/154472 xen [xen] xen 4.0 - DomU freebsd8.1 i386 xen kernel reboot o kern/154428 xen [xen] xn0 network interface and PF - Massive performan o kern/153674 xen [xen] i386/XEN idle thread shows wrong percentages o kern/153672 xen [xen] [panic] i386/XEN panics under heavy fork load o kern/153620 xen [xen] Xen guest system clock drifts in AWS EC2 (FreeBS o kern/153477 xen [xen] XEN pmap code abuses vm page queue lock o kern/153150 xen [xen] xen/ec2: disable checksum offloading on interfac o kern/152228 xen [xen] [panic] Xen/PV panic with machdep.idle_mwait=1 o kern/144629 xen [xen] FreeBSD 8-RELEASE XEN pvm networking doesn't wor o kern/143398 xen [xen] FreeBSD 8-RELEASE XEN pvm networking doesn't wor o kern/143340 xen [xen] FreeBSD 8-RELEASE XEN pvm networking doesn't wor f kern/143069 xen [xen] [panic] Xen Kernel Panic - Memory modified after f kern/135667 xen ufs filesystem corruption on XEN DomU system f kern/135421 xen [xen] FreeBSD Xen PVM DomU network failure - netfronc. f kern/135178 xen [xen] Xen domU outgoing data transfer stall when TSO i p kern/135069 xen [xen] FreeBSD-current/Xen SMP doesn't function at all f i386/124516 xen [xen] FreeBSD-CURRENT Xen Kernel Segfaults when config o kern/118734 xen [xen] FreeBSD 6.3-RC1 and FreeBSD 7.0-BETA 4 fail to b 44 problems total. From owner-freebsd-xen@FreeBSD.ORG Mon Apr 28 12:40:01 2014 Return-Path: Delivered-To: freebsd-xen@smarthost.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 52B9F856 for ; Mon, 28 Apr 2014 12:40:01 +0000 (UTC) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:1900:2254:206c::16:87]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 3E4A816DD for ; Mon, 28 Apr 2014 12:40:01 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.8/8.14.8) with ESMTP id s3SCe1LG022178 for ; Mon, 28 Apr 2014 12:40:01 GMT (envelope-from gnats@freefall.freebsd.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.8/8.14.8/Submit) id s3SCe1RX022177; Mon, 28 Apr 2014 12:40:01 GMT (envelope-from gnats) Date: Mon, 28 Apr 2014 12:40:01 GMT Message-Id: <201404281240.s3SCe1RX022177@freefall.freebsd.org> To: freebsd-xen@FreeBSD.org Cc: From: Kensaku MASUDA Subject: Re: kern/186375: [xen] FreeBSD 10 is very unstable on Xen 4.1(XCP 1.6) X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list Reply-To: Kensaku MASUDA List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 28 Apr 2014 12:40:01 -0000 The following reply was made to PR kern/186375; it has been noted by GNATS. From: Kensaku MASUDA To: =?ISO-8859-1?Q?Roger_Pau_Monn=E9?= Cc: bug-followup@freebsd.org Subject: Re: kern/186375: [xen] FreeBSD 10 is very unstable on Xen 4.1(XCP 1.6) Date: Mon, 28 Apr 2014 21:37:46 +0900 --001a11c2fcba26381004f8199545 Content-Type: multipart/alternative; boundary=001a11c2fcba26380d04f8199543 --001a11c2fcba26380d04f8199543 Content-Type: text/plain; charset=ISO-8859-1 Hello, Roger. In the PR you mention that the VM crashes/panics, could you please > provide the complete logs of the crash and the panics? Without those it > is impossible to diagnose the problem, much less try to fix it. > Sorry, It was already deleted with VM. and disassembled Xen 4.1(XCP 1.6) resource pool. Now, my resource pool is upgraded about Xen 4.2(XenServer 6.2 SP1). But I get same situation /w FreeBSD version 10-stable. And successfull collect log. a FreeBSD VM running on Xen 4.4/4.5, and so far I haven't seen any of > this issues. > FreeBSD 10 STABLE on Xen 4.2(XenServer 6.2) are stable than 10 RELEASE on Xen 4.1, But it was randomly stall/panic/crash. --001a11c2fcba26380d04f8199543 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Hello, Roger.

In the PR you mention that the VM crashes/panics, could you please
provide the complete logs of the crash and the panics? Without those it
is impossible to diagnose the problem, much less try to fix it.

Sorry, It was already deleted with VM. and disasse= mbled Xen 4.1(XCP 1.6) resource pool.
Now, my resource pool i= s upgraded about Xen 4.2(XenServer 6.2 SP1). But I get same situation /w Fr= eeBSD version 10-stable.
And successfull collect log.

a FreeBSD VM running on Xen 4.4/4.5, and so far I haven't seen any of this issues.
=A0
FreeBSD 10 STABLE on Xen 4.2(Xen= Server 6.2) are stable than 10 RELEASE on Xen 4.1, But it was randomly stal= l/panic/crash.
--001a11c2fcba26380d04f8199543-- --001a11c2fcba26381004f8199545 Content-Type: application/octet-stream; name="core.txt.4" Content-Disposition: attachment; filename="core.txt.4" Content-Transfer-Encoding: base64 X-Attachment-Id: f_hujqt2gv0 dGVzdC0wMS5ncmVnLmpwIGR1bXBlZCBjb3JlIC0gc2VlIC92YXIvY3Jhc2gvdm1jb3JlLjQKClN1 biBBcHIgMjcgMTQ6Mjg6NTQgSlNUIDIwMTQKCkZyZWVCU0QgdGVzdC0wMS5ncmVnLmpwIDEwLjAt U1RBQkxFIEZyZWVCU0QgMTAuMC1TVEFCTEUgIzYgcjI2NDkxNU06IFNhdCBBcHIgMjYgMTE6MDU6 NDEgSlNUIDIwMTQgICAgIHJvb3RAdGVzdC0wMS5ncmVnLmpwOi91c3Ivb2JqL3Vzci9zcmMvc3lz L0dFTkVSSUMgIGFtZDY0CgpwYW5pYzogcGFnZSBmYXVsdAoKR05VIGdkYiA2LjEuMSBbRnJlZUJT RF0KQ29weXJpZ2h0IDIwMDQgRnJlZSBTb2Z0d2FyZSBGb3VuZGF0aW9uLCBJbmMuCkdEQiBpcyBm cmVlIHNvZnR3YXJlLCBjb3ZlcmVkIGJ5IHRoZSBHTlUgR2VuZXJhbCBQdWJsaWMgTGljZW5zZSwg YW5kIHlvdSBhcmUKd2VsY29tZSB0byBjaGFuZ2UgaXQgYW5kL29yIGRpc3RyaWJ1dGUgY29waWVz IG9mIGl0IHVuZGVyIGNlcnRhaW4gY29uZGl0aW9ucy4KVHlwZSAic2hvdyBjb3B5aW5nIiB0byBz ZWUgdGhlIGNvbmRpdGlvbnMuClRoZXJlIGlzIGFic29sdXRlbHkgbm8gd2FycmFudHkgZm9yIEdE Qi4gIFR5cGUgInNob3cgd2FycmFudHkiIGZvciBkZXRhaWxzLgpUaGlzIEdEQiB3YXMgY29uZmln dXJlZCBhcyAiYW1kNjQtbWFyY2VsLWZyZWVic2QiLi4uCgpVbnJlYWQgcG9ydGlvbiBvZiB0aGUg a2VybmVsIG1lc3NhZ2UgYnVmZmVyOgoKCgpGYXRhbCB0cmFwIDEyOiBwYWdlIGZhdWx0IHdoaWxl IGluIGtlcm5lbCBtb2RlCmNwdWlkID0gMjsgYXBpYyBpZCA9IDA0CmZhdWx0IHZpcnR1YWwgYWRk cmVzcwk9IDB4MApmYXVsdCBjb2RlCQk9IHN1cGVydmlzb3IgcmVhZCBkYXRhLCBwYWdlIG5vdCBw cmVzZW50Cmluc3RydWN0aW9uIHBvaW50ZXIJPSAweDIwOjB4ZmZmZmZmZmY4MGNjN2EwOApzdGFj ayBwb2ludGVyCSAgICAgICAgPSAweDI4OjB4ZmZmZmZlMDA0ZTQ4ZDkwMApmcmFtZSBwb2ludGVy CSAgICAgICAgPSAweDI4OjB4ZmZmZmZlMDA0ZTQ4ZDk0MApjb2RlIHNlZ21lbnQJCT0gYmFzZSAw eDAsIGxpbWl0IDB4ZmZmZmYsIHR5cGUgMHgxYgoJCQk9IERQTCAwLCBwcmVzIDEsIGxvbmcgMSwg ZGVmMzIgMCwgZ3JhbiAxCnByb2Nlc3NvciBlZmxhZ3MJPSBpbnRlcnJ1cHQgZW5hYmxlZCwgcmVz dW1lLCBJT1BMID0gMApjdXJyZW50IHByb2Nlc3MJCT0gMTMgKGdfZXZlbnQpCnRyYXAgbnVtYmVy CQk9IDEyCnBhbmljOiBwYWdlIGZhdWx0CmNwdWlkID0gMgpLREI6IHN0YWNrIGJhY2t0cmFjZToK IzAgMHhmZmZmZmZmZjgwOTEwYzAwIGF0IGtkYl9iYWNrdHJhY2UrMHg2MAojMSAweGZmZmZmZmZm ODA4ZDYxNjUgYXQgcGFuaWMrMHgxNTUKIzIgMHhmZmZmZmZmZjgwY2M5Y2JmIGF0IHRyYXBfZmF0 YWwrMHgzOGYKIzMgMHhmZmZmZmZmZjgwY2M5ZmQ4IGF0IHRyYXBfcGZhdWx0KzB4MzA4CiM0IDB4 ZmZmZmZmZmY4MGNjOTY5MCBhdCB0cmFwKzB4NGEwCiM1IDB4ZmZmZmZmZmY4MGNiMDE3MiBhdCBj YWxsdHJhcCsweDgKIzYgMHhmZmZmZmZmZjgwOTE5Y2MzIGF0IHNidWZfcHV0Y19mdW5jKzB4NzMK IzcgMHhmZmZmZmZmZjgwOTE1YmFhIGF0IGt2cHJpbnRmKzB4MTAxYQojOCAweGZmZmZmZmZmODA5 MTljMzkgYXQgc2J1Zl92cHJpbnRmKzB4MjkKIzkgMHhmZmZmZmZmZjgwODNjYmU3IGF0IGdfY29u Zl9wcmludGZfZXNjYXBlZCsweDY3CiMxMCAweGZmZmZmZmZmODA4M2NkYmYgYXQgZ19jb25mX3Nw ZWNpZmljKzB4MTJmCiMxMSAweGZmZmZmZmZmODA4M2Q2ZTYgYXQgZ19ydW5fZXZlbnRzKzB4MTY2 CiMxMiAweGZmZmZmZmZmODA4YTZjZmEgYXQgZm9ya19leGl0KzB4OWEKIzEzIDB4ZmZmZmZmZmY4 MGNiMDZhZSBhdCBmb3JrX3RyYW1wb2xpbmUrMHhlClVwdGltZTogMWgxOW0xcwpEdW1waW5nIDE5 MCBvdXQgb2YgOTk3IE1COi4uOSUuLjE3JS4uMjYlLi4zNCUuLjQyJS4uNTElLi42OCUuLjc2JS4u ODQlLi45MyUKClJlYWRpbmcgc3ltYm9scyBmcm9tIC9ib290L2tlcm5lbC91bXMua28uc3ltYm9s cy4uLmRvbmUuCkxvYWRlZCBzeW1ib2xzIGZvciAvYm9vdC9rZXJuZWwvdW1zLmtvLnN5bWJvbHMK IzAgIGRvYWR1bXAgKHRleHRkdW1wPTx2YWx1ZSBvcHRpbWl6ZWQgb3V0PikgYXQgcGNwdS5oOjIx OQoyMTkJcGNwdS5oOiBObyBzdWNoIGZpbGUgb3IgZGlyZWN0b3J5LgoJaW4gcGNwdS5oCihrZ2Ri KSAjMCAgZG9hZHVtcCAodGV4dGR1bXA9PHZhbHVlIG9wdGltaXplZCBvdXQ+KSBhdCBwY3B1Lmg6 MjE5CiMxICAweGZmZmZmZmZmODA4ZDVkZTIgaW4ga2Vybl9yZWJvb3QgKGhvd3RvPTI2MCkKICAg IGF0IC91c3Ivc3JjL3N5cy9rZXJuL2tlcm5fc2h1dGRvd24uYzo0NTIKIzIgIDB4ZmZmZmZmZmY4 MDhkNjFhNCBpbiBwYW5pYyAoZm10PTx2YWx1ZSBvcHRpbWl6ZWQgb3V0PikKICAgIGF0IC91c3Iv c3JjL3N5cy9rZXJuL2tlcm5fc2h1dGRvd24uYzo3NTkKIzMgIDB4ZmZmZmZmZmY4MGNjOWNiZiBp biB0cmFwX2ZhdGFsIChmcmFtZT08dmFsdWUgb3B0aW1pemVkIG91dD4sIAogICAgZXZhPTx2YWx1 ZSBvcHRpbWl6ZWQgb3V0PikgYXQgL3Vzci9zcmMvc3lzL2FtZDY0L2FtZDY0L3RyYXAuYzo4ODEK IzQgIDB4ZmZmZmZmZmY4MGNjOWZkOCBpbiB0cmFwX3BmYXVsdCAoZnJhbWU9MHhmZmZmZmUwMDRl NDhkODUwLCAKICAgIHVzZXJtb2RlPTx2YWx1ZSBvcHRpbWl6ZWQgb3V0PikgYXQgL3Vzci9zcmMv c3lzL2FtZDY0L2FtZDY0L3RyYXAuYzo2OTIKIzUgIDB4ZmZmZmZmZmY4MGNjOTY5MCBpbiB0cmFw IChmcmFtZT0weGZmZmZmZTAwNGU0OGQ4NTApCiAgICBhdCAvdXNyL3NyYy9zeXMvYW1kNjQvYW1k NjQvdHJhcC5jOjQ1NgojNiAgMHhmZmZmZmZmZjgwY2IwMTcyIGluIGNhbGx0cmFwICgpCiAgICBh dCAvdXNyL3NyYy9zeXMvYW1kNjQvYW1kNjQvZXhjZXB0aW9uLlM6MjMyCiM3ICAweGZmZmZmZmZm ODBjYzdhMDggaW4gbWVtY3B5ICgpIGF0IC91c3Ivc3JjL3N5cy9hbWQ2NC9hbWQ2NC9zdXBwb3J0 LlM6MTQ3CiM4ICAweGZmZmZmZmZmODA5MTk5ZTcgaW4gc2J1Zl9leHRlbmQgKHM9MHhmZmZmZjgw MDI2MDRlMjYyLCAKICAgIGFkZGxlbj08dmFsdWUgb3B0aW1pemVkIG91dD4pIGF0IC91c3Ivc3Jj L3N5cy9rZXJuL3N1YnJfc2J1Zi5jOjE2MwojOSAgMHhmZmZmZmZmZjgwOTE5Y2MzIGluIHNidWZf cHV0Y19mdW5jIChjPTk4LCBhcmc9MHhmZmZmZjgwMDI2MDRlMjYyKQogICAgYXQgL3Vzci9zcmMv c3lzL2tlcm4vc3Vicl9zYnVmLmM6Mzc1CiMxMCAweGZmZmZmZmZmODA5MTViYWEgaW4ga3Zwcmlu dGYgKGZtdD0weGZmZmZmZmZmODBlY2QzZDQgIiIsIAogICAgZnVuYz0weGZmZmZmZmZmODA5MTlj NTAgPHNidWZfcHV0Y19mdW5jPiwgYXJnPTB4ZmZmZmY4MDAyNjA0ZTI2MiwgcmFkaXg9Q2Fubm90 IGFjY2VzcyBtZW1vcnkgYXQgYWRkcmVzcyAweGEKKQogICAgYXQgL3Vzci9zcmMvc3lzL2tlcm4v c3Vicl9wcmYuYzo4MTAKIzExIDB4ZmZmZmZmZmY4MDkxOWMzOSBpbiBzYnVmX3ZwcmludGYgKHM9 MHhmZmZmZjgwMDI2MDRlMjYyLCAKICAgIGZtdD0weGZmZmZmODAwMjYwNGUyNDAgIiIsIGFwPTB4 ZmZmZmZlMDAwMDRhMjA5MCkKICAgIGF0IC91c3Ivc3JjL3N5cy9rZXJuL3N1YnJfc2J1Zi5jOjU1 NAojMTIgMHhmZmZmZmZmZjgwODNjYmU3IGluIGdfY29uZl9wcmludGZfZXNjYXBlZCAoc2I9MHhm ZmZmZjgwMDI2MDRlMjQwLCAKICAgIGZtdD0weDApIGF0IC91c3Ivc3JjL3N5cy9nZW9tL2dlb21f ZHVtcC5jOjE2NgojMTMgMHhmZmZmZmZmZjgwODNjZGJmIGluIGdfY29uZl9zcGVjaWZpYyAoc2I9 MHhmZmZmZjgwMDI2MDRlMjQwLCBtcD0weDAsIAogICAgZ3A9MHgwLCBwcD0weDAsIGNwPTB4MCkg YXQgL3Vzci9zcmMvc3lzL2dlb20vZ2VvbV9kdW1wLmM6MjM4CiMxNCAweGZmZmZmZmZmODA4M2Q2 ZTYgaW4gZ19ydW5fZXZlbnRzICgpCiAgICBhdCAvdXNyL3NyYy9zeXMvZ2VvbS9nZW9tX2V2ZW50 LmM6MjU3CiMxNSAweGZmZmZmZmZmODA4YTZjZmEgaW4gZm9ya19leGl0ICgKICAgIGNhbGxvdXQ9 MHhmZmZmZmZmZjgwODNmNTgwIDxnX2V2ZW50X3Byb2Nib2R5PiwgYXJnPTB4MCwgCiAgICBmcmFt ZT0weGZmZmZmZTAwNGU0OGRjMDApIGF0IC91c3Ivc3JjL3N5cy9rZXJuL2tlcm5fZm9yay5jOjk5 NQojMTYgMHhmZmZmZmZmZjgwY2IwNmFlIGluIGZvcmtfdHJhbXBvbGluZSAoKQogICAgYXQgL3Vz ci9zcmMvc3lzL2FtZDY0L2FtZDY0L2V4Y2VwdGlvbi5TOjYwNgojMTcgMHgwMDAwMDAwMDAwMDAw MDAwIGluID8/ICgpCkN1cnJlbnQgbGFuZ3VhZ2U6ICBhdXRvOyBjdXJyZW50bHkgbWluaW1hbAoo a2dkYikgCgotLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0KcHMgLWF4bHd3CgpVSUQgICBQSUQgIFBQSUQgQ1BVICBQ UkkgTkkgICBWU1ogICAgICAgICAgICAgICBSU1MgTVdDSEFOICAgU1RBVCBUVCAgICAgIFRJTUUg Q09NTUFORAogIDAgICAgIDAgICAgIDAgICAwICAgLTggIDAgICAgIDAgICAgICAgICAgICAgICAg IDAgLSAgICAgICAgRExzICAgLSAgIDA6MDAuMDUgW2tlcm5lbF0KICAwICAgICAxICAgICAwICAg MCAgIDIwICAwICA5NDYwICAgICAgICAgICAgICAgICAwIHdhaXQgICAgIERMcyAgIC0gICAwOjAw LjAzIFtpbml0XQogIDAgICAgIDIgICAgIDAgICAwICAtMTYgIDAgICAgIDAgICAgICAgICAgICAg ICAgIDAgY2NiX3NjYW4gREwgICAgLSAgIDA6MDAuMDAgW2NhbV0KICAwICAgICAzICAgICAwICAg MCAgLTE2ICAwICAgICAwICAgICAgICAgICAgICAgICAwIGJhbGxvb24gIERMICAgIC0gICAwOjAw LjAwIFtiYWxsb29uXQogIDAgICAgIDQgICAgIDAgICAwICAtMTYgIDAgICAgIDAgICAgICAgICAg ICAgICAgIDAgd2FpdGluZ18gREwgICAgLSAgIDA6MDAuMDAgW3NjdHBfaXRlcmF0b3JdCiAgMCAg ICAgNSAgICAgMCAgIDAgIC0xNiAgMCAgICAgMCAgICAgICAgICAgICAgICAgMCBwc2xlZXAgICBE TCAgICAtICAgMDowMC4wMiBbcGFnZWRhZW1vbl0KICAwICAgICA2ICAgICAwICAgMCAgLTE2ICAw ICAgICAwICAgICAgICAgICAgICAgICAwIHBzbGVlcCAgIERMICAgIC0gICAwOjAwLjAwIFt2bWRh ZW1vbl0KICAwICAgICA3ICAgICAwICAgMCAgMTU1ICAwICAgICAwICAgICAgICAgICAgICAgICAw IHBnemVybyAgIERMICAgIC0gICAwOjAwLjAwIFtwYWdlemVyb10KICAwICAgICA4ICAgICAwICAg MCAgLTE2ICAwICAgICAwICAgICAgICAgICAgICAgICAwIHBzbGVlcCAgIERMICAgIC0gICAwOjAw LjAxIFtidWZkYWVtb25dCiAgMCAgICAgOSAgICAgMCAgIDAgIC0xNiAgMCAgICAgMCAgICAgICAg ICAgICAgICAgMCB2bHJ1d3QgICBETCAgICAtICAgMDowMC4wMCBbdm5scnVdCiAgMCAgICAxMCAg ICAgMCAgIDAgIC0xNiAgMCAgICAgMCAgICAgICAgICAgICAgICAgMCBhdWRpdF93byBETCAgICAt ICAgMDowMC4wMCBbYXVkaXRdCiAgMCAgICAxMSAgICAgMCAgIDAgIDE1NSAgMCAgICAgMCAgICAg ICAgICAgICAgICAgMCAtICAgICAgICBSTCAgICAtICAzMDo1OS4xMyBbaWRsZV0KICAwICAgIDEy ICAgICAwICAgMCAgLTkyICAwICAgICAwICAgICAgICAgICAgICAgICAwIC0gICAgICAgIFJMICAg IC0gICAwOjAyLjQyIFtpbnRyXQogIDAgICAgMTMgICAgIDAgICAwICAgLTggIDAgICAgIDAgICAg ICAgICAgICAgICAgIDAgLSAgICAgICAgREwgICAgLSAgIDA6MDAuMjggW2dlb21dCiAgMCAgICAx NCAgICAgMCAgIDAgIC0xNiAgMCAgICAgMCAgICAgICAgICAgICAgICAgMCAtICAgICAgICBSTCAg ICAtICAgMDowMC4wOSBbcmFuZF9oYXJ2ZXN0cV0KICAwICAgIDE1ICAgICAwICAgMCAgLTY4ICAw ICAgICAwICAgICAgICAgICAgICAgICAwIC0gICAgICAgIERMICAgIC0gICAwOjAwLjA1IFt1c2Jd CiAgMCAgICAxNiAgICAgMCAgIDAgIC0xNiAgMCAgICAgMCAgICAgICAgICAgICAgICAgMCB3YWl0 ZXYgICBETCAgICAtICAgMDowMC4wNCBbeGVud2F0Y2hdCiAgMCAgICAxNyAgICAgMCAgIDAgIC0x NiAgMCAgICAgMCAgICAgICAgICAgICAgICAgMCB4YnJlYWQgICBETCAgICAtICAgMDowMC4wMCBb eGVuc3RvcmVfcmN2XQogIDAgICAgMTggICAgIDAgICAwICAgMTYgIDAgICAgIDAgICAgICAgICAg ICAgICAgIDAgc3luY2VyICAgREwgICAgLSAgIDA6MDAuMDIgW3N5bmNlcl0KICAwICAgIDE5ICAg ICAwICAgMCAgIDIwICAwICAgICAwICAgICAgICAgICAgICAgICAwIHNkZmx1c2ggIERMICAgIC0g ICAwOjAwLjAxIFtzb2Z0ZGVwZmx1c2hdCiAgMCAgIDQ1OSAgICAgMSAgIDAgICA1MiAgMCAxNDYw OCAgICAgICAgICAgICAgICAgMCBzZWxlY3QgICBEcyAgICAtICAgMDowMC4wMCBbZGhjbGllbnRd CiA2NSAgIDQ5NSAgICAgMSAgIDAgICAyMCAgMCAxNDYwOCAgICAgICAgICAgICAgICAgMCBzZWxl Y3QgICBEcyAgICAtICAgMDowMC4wMCBbZGhjbGllbnRdCiAgMCAgIDUwNSAgICAgMSAgIDAgICAy NSAgMCAxNDYwOCAgICAgICAgICAgICAgICAgMCBzZWxlY3QgICBEcyAgICAtICAgMDowMC4wMCBb ZGhjbGllbnRdCiA2NSAgIDUxNSAgICAgMSAgIDAgICAyMCAgMCAxNDYwOCAgICAgICAgICAgICAg ICAgMCBzZWxlY3QgICBEcyAgICAtICAgMDowMC4wMCBbZGhjbGllbnRdCiAgMCAgIDUyNSAgICAg MSAgIDAgICAyNCAgMCAxNDYwOCAgICAgICAgICAgICAgICAgMCBzZWxlY3QgICBEcyAgICAtICAg MDowMC4wMCBbZGhjbGllbnRdCiA2NSAgIDUzNSAgICAgMSAgIDAgICAyMCAgMCAxNDYwOCAgICAg ICAgICAgICAgICAgMCBzZWxlY3QgICBEcyAgICAtICAgMDowMC4wMCBbZGhjbGllbnRdCiAgMCAg IDU0MCAgICAgMSAgIDAgICAyMCAgMCAxNjY4MCAgICAgICAgICAgICAgICAgMCBzZWxlY3QgICBE cyAgICAtICAgMDowMC4wMCBbbW91c2VkXQogIDAgICA1NTcgICAgIDEgICAwICAgMjAgIDAgMTMx NjQgICAgICAgICAgICAgICAgIDAgc2VsZWN0ICAgRHMgICAgLSAgIDA6MDAuMDAgW2RldmRdCiAg MCAgIDY1MSAgICAgMSAgIDAgICAyMCAgMCAxNDQ4NCAgICAgICAgICAgICAgICAgMCBzZWxlY3Qg ICBEcyAgICAtICAgMDowMC4wMiBbc3lzbG9nZF0KICAwICAgNzQwICAgICAxICAgMCAgIDIwICAw IDI1NDI0ICAgICAgICAgICAgICAgICAwIHNlbGVjdCAgIERzICAgIC0gICAwOjAwLjA2IFtudHBk XQogIDAgICA3NTUgICAgIDEgICAwICAgMjAgIDAgMTcwNDggICAgICAgICAgICAgICAgIDAgd2Fp dCAgICAgRCAgICAgLSAgIDA6MDAuMDIgW3NoXQogIDAgICA4OTkgICAgIDEgICAwICAgNTIgIDAg NjExNjAgICAgICAgICAgICAgICAgIDAgc2VsZWN0ICAgRHMgICAgLSAgIDA6MDAuMDIgW3NzaGRd CiAgMCAgIDkzNCAgICAgMSAgIDAgICAyMCAgMCAyNDA4NCAgICAgICAgICAgICAgICAgMCBzZWxl Y3QgICBEcyAgICAtICAgMDowMC4wNCBbc2VuZG1haWxdCiAyNSAgIDk0OCAgICAgMSAgIDAgICAy MCAgMCAyNDA4NCAgICAgICAgICAgICAgICAgMCBwYXVzZSAgICBEcyAgICAtICAgMDowMC4wMSBb c2VuZG1haWxdCiAgMCAgIDk1OCAgICAgMSAgIDAgICAyMyAgMCAxNjU3NiAgICAgICAgICAgICAg ICAgMCBuYW5zbHAgICBEcyAgICAtICAgMDowMC4wMiBbY3Jvbl0KICAwICAgOTk5ICAgICAxICAg MCAgIDIwICAwIDUwMTY4IDE3OTc5MjE0MzIyNDY2ODE2IGdfd2FpdGZvIERzICAgIC0gICAwOjAw LjI5IFtic25tcGRdCiAgMCAgMTAwNiAgICAgMSAgIDAgICAyMCAgMCA0NzcwOCAgICAgICAgICAg ICAgICAgMCB3YWl0ICAgICBEV3MgICAtICAgMDowMC4wMCBbbG9naW5dCiAgMCAgMTAwNyAgICAg MSAgIDAgICA1MiAgMCAxNDQ3MiAgICAgICAgICAgICAgICAgMCB0dHlpbiAgICBEcysgICAtICAg MDowMC4wMSBbZ2V0dHldCiAgMCAgMTAwOCAgICAgMSAgIDAgICA1MiAgMCAxNDQ3MiAgICAgICAg ICAgICAgICAgMCB0dHlpbiAgICBEcysgICAtICAgMDowMC4wMSBbZ2V0dHldCiAgMCAgMTAwOSAg ICAgMSAgIDAgICA1MiAgMCAxNDQ3MiAgICAgICAgICAgICAgICAgMCB0dHlpbiAgICBEcysgICAt ICAgMDowMC4wMSBbZ2V0dHldCiAgMCAgMTAxMCAgICAgMSAgIDAgICA1MiAgMCAxNDQ3MiAgICAg ICAgICAgICAgICAgMCB0dHlpbiAgICBEcysgICAtICAgMDowMC4wMSBbZ2V0dHldCiAgMCAgMTAx MSAgICAgMSAgIDAgICA1MiAgMCAxNDQ3MiAgICAgICAgICAgICAgICAgMCB0dHlpbiAgICBEcysg ICAtICAgMDowMC4wMSBbZ2V0dHldCiAgMCAgMTAxMiAgICAgMSAgIDAgICA1MiAgMCAxNDQ3MiAg ICAgICAgICAgICAgICAgMCB0dHlpbiAgICBEcysgICAtICAgMDowMC4wMCBbZ2V0dHldCiAgMCAg MTAxMyAgICAgMSAgIDAgICA1MiAgMCAxNDQ3MiAgICAgICAgICAgICAgICAgMCB0dHlpbiAgICBE cysgICAtICAgMDowMC4wMSBbZ2V0dHldCiAgMCAgMTYwMCAgMTAwNiAgIDAgICAyMCAgMCAyMzU1 NiAgICAgICAgICAgICAgICAgMCBwYXVzZSAgICBEVyAgICAtICAgMDowMC4wMCBbY3NoXQogIDAg IDI3NDMgIDE2MDAgICAwICAgMjAgIDAgIDkxMTIgICAgICAgICAgICAgICAgIDAgc2VsZWN0ICAg RCsgICAgLSAgIDA6MDAuMDAgW21ha2VdCiAgMCAgMjc0OCAgMjc0MyAgIDAgICA1MiAgMCAxNzA0 OCAgICAgICAgICAgICAgICAgMCB3YWl0ICAgICBEVyAgICAtICAgMDowMC4wMCBbc2hdCiAgMCAg Mjc0OSAgMjc0OCAgIDAgICAyMCAgMCAgOTExMiAgICAgICAgICAgICAgICAgMCBzZWxlY3QgICBE ICAgICAtICAgMDowMC4wMCBbbWFrZV0KICAwIDMyMDAyICAgICAwICAgMCAgLTE2ICAwICAgICAw ICAgICAgICAgICAgICAgICAwIC0gICAgICAgIERMICAgIC0gICAwOjAwLjAwIFtuZXduZnMgMF0K ICAwIDMyMzY0ICAgICAwICAgMCAgLTE2ICAwICAgICAwICAgICAgICAgICAgICAgICAwIC0gICAg ICAgIERMICAgIC0gICAwOjAwLjAwIFtuZXduZnMgMV0KICAwIDQ5NTkzICAyNzQ5ICAgMCAgIDI3 ICAwIDE3MDQ4ICAgICAgICAgICAgICAgICAwIHdhaXQgICAgIEQgICAgIC0gICAwOjAwLjAwIFtz aF0KICAwIDQ5NTk0IDQ5NTkzICAgMCAgIDIwICAwICA5MTEyICAgICAgICAgICAgICAgICAwIHNl bGVjdCAgIEQgICAgIC0gICAwOjAwLjAwIFttYWtlXQogIDAgNDk1OTkgNDk1OTQgICAwICAgMzYg IDAgMTcwNDggICAgICAgICAgICAgICAgIDAgd2FpdCAgICAgRCAgICAgLSAgIDA6MDAuMDAgW3No XQogIDAgNjE2ODcgNDk1OTkgICAwICAgMjAgIDAgIDkxMTIgICAgICAgICAgICAgICAgIDAgc2Vs ZWN0ICAgRCAgICAgLSAgIDA6MDAuMDAgW21ha2VdCiAgMCA2OTMxMCA2MTY4NyAgIDAgICAzMSAg MCAxNzA0OCAgICAgICAgICAgICAgICAgMCB3YWl0ICAgICBEICAgICAtICAgMDowMC4wMCBbc2hd CiAgMCA3MzM5MiA2OTMxMCAgIDAgICAyMiAgMCAzMzY4OCAxNzk3OTIxODMyMzUzOTk0MCBzZWxl Y3QgICBEICAgICAtICAgMDowMC4wMCBbbWFrZV0KICAwIDc1NzcxIDczMzkyICAgMCAgIDUyICAw IDE3MDQ4ICAgICAgICAgICAgICAgICAwIHdhaXQgICAgIEQgICAgIC0gICAwOjAwLjAwIFtzaF0K ICAwIDc1NzcyIDc1NzcxICAgMCAgIDUyICAwIDMzMTA0ICAgICAgICAgICAgICAgICAwIHdhaXQg ICAgIEQgICAgIC0gICAwOjAwLjAwIFtjY10KICAwIDc1NzczIDc1NzcyICAgMCAgIDIwICAwIDMz MTA0ICAgICAgICAgICAgICAgICAwIC0gICAgICAgIFIgICAgIC0gICAwOjAwLjAwIFtjY10KICAw IDc1Nzc0ICAgNzU1ICAgMCAgIDUyICAwIDE3MDQ4ICAgICAgICAgICAgICAgICAwIHBpcGVyZCAg IEQgICAgIC0gICAwOjAwLjAwIFtzaF0KICAwIDc1Nzc4IDczMzkyICAgMCAgIDIzICAwIDE3MDQ4 ICAgICAgICAgICAgICAgICAwIHdhaXQgICAgIEQgICAgIC0gICAwOjAwLjAwIFtzaF0KICAwIDc1 NzgyIDczMzkyICAgMCAgIDMxICAwIDE3MDQ4ICAgICAgICAgICAgICAgICAwIHdhaXQgICAgIEQg ICAgIC0gICAwOjAwLjAwIFtzaF0KICAwIDc1Nzg0IDczMzkyICAgMCAgIDMxICAwIDE3MDQ4ICAg ICAgICAgICAgICAgICAwIHdhaXQgICAgIEQgICAgIC0gICAwOjAwLjAwIFtzaF0KICAwIDc1Nzg4 IDc1Nzc0ICAgMCAgIDUyICAwIDE3MDQ4ICAgICAgICAgICAgICAgICAwIHdhaXQgICAgIEQgICAg IC0gICAwOjAwLjAwIFtzaF0KICAwIDc1Nzg5IDc1Nzc4ICAgMCAgIDMzICAwIDMzMTA0ICAgICAg ICAgICAgICAgICAwIHdhaXQgICAgIEQgICAgIC0gICAwOjAwLjAwIFtjY10KICAwIDc1NzkwIDc1 Nzg0ICAgMCAgIDM4ICAwIDMzMTA0ICAgICAgICAgICAgICAgICAwIHdhaXQgICAgIEQgICAgIC0g ICAwOjAwLjAwIFtjY10KICAwIDc1NzkxIDc1NzgyICAgMCAgIDQzICAwIDMzMTA0ICAgICAgICAg ICAgICAgICAwIC0gICAgICAgIFIgICAgIC0gICAwOjAwLjAwIFtjY10KICAwIDc1NzkyIDc1Nzg4 ICAgMCAgIDcyICAwIDE3MDQ4ICAgICAgICAgICAgICAgICAwIC0gICAgICAgIFJFICAgIC0gICAw OjAwLjAwIFtzaF0KICAwIDc1NzkzIDc1Nzg4ICAgMCAgIDIwICAwIDE2OTY0ICAgICAgICAgICAg ICAgICAwIC0gICAgICAgIFIgICAgIC0gICAwOjAwLjAwIFtiY10KICAwIDc1Nzk3IDc1NzkzICAg MCAtMTAwICAwICAgICAwICAgICAgICAgICAgICAgICAwIC0gICAgICAgIFpXICAgIC0gICAwOjAw LjAwIDxkZWZ1bmN0PgogIDAgNzU3OTggNzU3OTAgICAwICAgNDMgIDAgMzMxMDQgICAgICAgICAg ICAgICAgIDAgLSAgICAgICAgUiAgICAgLSAgIDA6MDAuMDAgW2NjXQogIDAgNzU3OTkgNzU3ODkg ICAwICAgMzQgIDAgMzMxMDQgICAgICAgICAgICAgICAgIDAgLSAgICAgICAgUiAgICAgLSAgIDA6 MDAuMDAgW2NjXQoKLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tCnZtc3RhdCAtcwoKIDE1MTM3NTMxIGNwdSBjb250 ZXh0IHN3aXRjaGVzCiAxMDIwOTE5NiBkZXZpY2UgaW50ZXJydXB0cwogICAxNzMyNjkgc29mdHdh cmUgaW50ZXJydXB0cwogMzIyMDg4MzkgdHJhcHMKIDE5Nzc4MDUyIHN5c3RlbSBjYWxscwogICAg ICAxMzMga2VybmVsIHRocmVhZHMgY3JlYXRlZAogICAgMjM1MzUgIGZvcmsoKSBjYWxscwogICAg NTIxMzEgdmZvcmsoKSBjYWxscwogICAgICAgIDAgcmZvcmsoKSBjYWxscwogICAgICAgIDAgc3dh cCBwYWdlciBwYWdlaW5zCiAgICAgICAgMCBzd2FwIHBhZ2VyIHBhZ2VzIHBhZ2VkIGluCiAgICAg ICAgMCBzd2FwIHBhZ2VyIHBhZ2VvdXRzCiAgICAgICAgMCBzd2FwIHBhZ2VyIHBhZ2VzIHBhZ2Vk IG91dAogICAgMTEyNTEgdm5vZGUgcGFnZXIgcGFnZWlucwogICAgOTc1MzUgdm5vZGUgcGFnZXIg cGFnZXMgcGFnZWQgaW4KICAgICAgICAwIHZub2RlIHBhZ2VyIHBhZ2VvdXRzCiAgICAgICAgMCB2 bm9kZSBwYWdlciBwYWdlcyBwYWdlZCBvdXQKICAgICAgICA4IHBhZ2UgZGFlbW9uIHdha2V1cHMK ICAgICAgICAwIHBhZ2VzIGV4YW1pbmVkIGJ5IHRoZSBwYWdlIGRhZW1vbgogICAgMTQ3ODEgcGFn ZXMgcmVhY3RpdmF0ZWQKICAxNDEzNjE5IGNvcHktb24td3JpdGUgZmF1bHRzCiAgICAgMjQwNyBj b3B5LW9uLXdyaXRlIG9wdGltaXplZCBmYXVsdHMKIDI3MTI5MTk2IHplcm8gZmlsbCBwYWdlcyB6 ZXJvZWQKICAgICAgOTc1IHplcm8gZmlsbCBwYWdlcyBwcmV6ZXJvZWQKICAgICAgMjk5IGludHJh bnNpdCBibG9ja2luZyBwYWdlIGZhdWx0cwogMjkwODE1MDMgdG90YWwgVk0gZmF1bHRzIHRha2Vu CiAgICAxNzI1NyBwYWdlIGZhdWx0cyByZXF1aXJpbmcgSS9PCiAgICAgICAgMCBwYWdlcyBhZmZl Y3RlZCBieSBrZXJuZWwgdGhyZWFkIGNyZWF0aW9uCiAgMTQ4NjEzOCBwYWdlcyBhZmZlY3RlZCBi eSAgZm9yaygpCiAgMjU0OTI1MyBwYWdlcyBhZmZlY3RlZCBieSB2Zm9yaygpCiAgICAgICAgMCBw YWdlcyBhZmZlY3RlZCBieSByZm9yaygpCiAgICAgICAgMCBwYWdlcyBjYWNoZWQKIDMxOTg4MjM3 IHBhZ2VzIGZyZWVkCiAgICAgICAgMCBwYWdlcyBmcmVlZCBieSBkYWVtb24KICAgICAgICAwIHBh Z2VzIGZyZWVkIGJ5IGV4aXRpbmcgcHJvY2Vzc2VzCiAgICAyMjA3NyBwYWdlcyBhY3RpdmUKICAg MTY0NzM2IHBhZ2VzIGluYWN0aXZlCiAgICAgIDIxNiBwYWdlcyBpbiBWTSBjYWNoZQogICAgMzQ1 MzkgcGFnZXMgd2lyZWQgZG93bgogICAgMjY3ODcgcGFnZXMgZnJlZQogICAgIDQwOTYgYnl0ZXMg cGVyIHBhZ2UKIDM4MTYwODAzIHRvdGFsIG5hbWUgbG9va3VwcwogICAgICAgICAgY2FjaGUgaGl0 cyAoOTElIHBvcyArIDUlIG5lZykgc3lzdGVtIDAlIHBlci1kaXJlY3RvcnkKICAgICAgICAgIGRl bGV0aW9ucyAwJSwgZmFsc2VoaXRzIDAlLCB0b29sb25nIDAlCgotLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0Kdm1z dGF0IC1tCgogICAgICAgICBUeXBlIEluVXNlIE1lbVVzZSBIaWdoVXNlIFJlcXVlc3RzICBTaXpl KHMpCiAgICAgICAgIGNkZXYgICAgIDYgICAgIDJLICAgICAgIC0gICAgICAgIDYgIDI1NgogICAg ICBlbnRyb3B5ICAxMDI2ICAgIDY1SyAgICAgICAtICAgICAxMDM2ICAzMiw2NCw0MDk2CiAgICAg ZmlsZWRlc2MgICAgNzEgICAxNDRLICAgICAgIC0gICAgNzU4MDEgIDIwNDgsNDA5NgogICAgICAg IHNpZ2lvICAgICAxICAgICAxSyAgICAgICAtICAgICAgICAxICA2NAogICAgIGZpbGVjYXBzICAg ICAzICAgICAxSyAgICAgICAtICAgICAgICA5ICAxNgogICAgICBrZHRyYWNlICAgMjU1ICAgIDUx SyAgICAgICAtICAgIDc1OTgzICA2NCwyNTYKICAgICAgICAga2VudiAgICA2OSAgICAxMUsgICAg ICAgLSAgICAgICA3MyAgMTYsMzIsNjQsMTI4CiAgICAgICBrcXVldWUgICAgIDAgICAgIDBLICAg ICAgIC0gICAgICAxMTAgIDI1NiwyMDQ4CiAgICBwcm9jLWFyZ3MgICAgNDIgICAgIDNLICAgICAg IC0gICAgNTIzMzMgIDE2LDMyLDY0LDEyOCwyNTYKICAgICAgQ0FNIFNJTSAgICAgMyAgICAgMUsg ICAgICAgLSAgICAgICAgMyAgMjU2CiAgICAgICAgaGhvb2sgICAgIDIgICAgIDFLICAgICAgIC0g ICAgICAgIDIgIDI1NgogICAgICBpdGhyZWFkICAgMTg5ICAgIDM1SyAgICAgICAtICAgICAgMTg5 ICAzMiwxMjgsMjU2CiAgICAgIHNjc2lfY2QgICAgIDAgICAgIDBLICAgICAgIC0gICAgICAgODgg IDE2CiAgICAgICBLVFJBQ0UgICAxMDAgICAgMTNLICAgICAgIC0gICAgICAxMDAgIDEyOAogICAg ICAgbGlua2VyICAgMTYwICAgIDMxSyAgICAgICAtICAgICAyMDI0ICAxNiwzMiw2NCwxMjgsMjU2 LDUxMiwxMDI0LDIwNDgsNDA5NgogICAgICAgIGxvY2tmICAgIDI5ICAgICAzSyAgICAgICAtICAg MTIxNzg1ICA2NCwxMjgKICAgbG9naW5jbGFzcyAgICAgMyAgICAgMUsgICAgICAgLSAgICAgICAz NiAgNjQKICAgICAgIGRldmJ1ZiAgMTQ1OCAgMzM0M0sgICAgICAgLSAgICAgMTUxNCAgMTYsMzIs NjQsMTI4LDI1Niw1MTIsMTAyNCwyMDQ4LDQwOTYKICAgICAgICAgdGVtcCAgICAxNSAgICAgMUsg ICAgICAgLSAgIDEyNjM2MyAgMTYsMzIsNjQsMTI4LDI1Niw1MTIsMTAyNCwyMDQ4LDQwOTYKICAg ICAgIGlwNm9wdCAgICAgMCAgICAgMEsgICAgICAgLSAgICAgICAgMiAgMzIKICAgICAgIGlwNm5k cCAxODQ0Njc0NDA3MzcwODUxMTE1NiAxODAxNDM5ODUwOTQxNjk1NksgICAgICAgLSAgICAgICA0 MSAgMzIsNjQsMTI4CiAgICAgICBtb2R1bGUgICA0NzcgICAgNjBLICAgICAgIC0gICAgICA0Nzcg IDEyOAogICAgIG10eF9wb29sICAgICAyICAgIDE2SyAgICAgICAtICAgICAgICAyICAKICAgICBw bWNob29rcyAgICAgMSAgICAgMUsgICAgICAgLSAgICAgICAgMSAgMTI4CiAgICAgICAgIHBncnAg ICAgMzUgICAgIDVLICAgICAgIC0gICAgMTk3ODYgIDEyOAogICAgICBzZXNzaW9uICAgIDI1ICAg ICA0SyAgICAgICAtICAgICAgIDUwICAxMjgKICAgICAgICAgcHJvYyAgICAgMiAgICAxNksgICAg ICAgLSAgICAgICAgMiAgCiAgICAgIHN1YnByb2MgICAyMTggICAzNjFLICAgICAgIC0gICAgNzU5 NDcgIDUxMiw0MDk2CiAgICAgICAgIGNyZWQgICAgNjYgICAgMTFLICAgICAgIC0gICA1NzcwODQg IDY0LDI1NgogICAgICAgcGxpbWl0ICAgIDEzICAgICA0SyAgICAgICAtICAgICAgIDQxICAyNTYK ICAgICAgdWlkaW5mbyAgICAgNCAgICAgM0sgICAgICAgLSAgICAgICAyOCAgMTI4LDIwNDgKICAg ICAgQ0FNIFhQVCAgICAxOCAgICAgMksgICAgICAgLSAgICAgICAzNCAgMzIsNjQsMTI4LDUxMiwx MDI0LDIwNDgKICAgICBwY2lfbGluayAgICAgOCAgICAgMUsgICAgICAgLSAgICAgICAgOCAgMTYs MTI4CiAgICAgICBzeXNjdGwgICAgIDAgICAgIDBLICAgICAgIC0gICAgIDMyMzEgIDE2LDMyLDY0 CiAgICBzeXNjdGxvaWQgIDIzMzEgICAxMTVLICAgICAgIC0gICAgIDI0MTEgIDE2LDMyLDY0LDEy OAogICAgc3lzY3RsdG1wICAgICAwICAgICAwSyAgICAgICAtICAgIDM4Mzk4ICAxNiwzMiw2NCwx MjgsNDA5NgogICAgICAgICAgeGJkICAgIDM0ICAgIDEwSyAgICAgICAtICAgICAgIDM0ICA2NCw0 MDk2CiAgICAgIHRpZGhhc2ggICAgIDEgICAgMTZLICAgICAgIC0gICAgICAgIDEgIAogICAgICBj YWxsb3V0ICAgICA1ICAyMTg0SyAgICAgICAtICAgICAgICA1ICAKICAgICAgICAgdW10eCAgIDM3 OCAgICA0OEsgICAgICAgLSAgICAgIDM3OCAgMTI4CiAgICAgcDEwMDMuMWIgICAgIDEgICAgIDFL ICAgICAgIC0gICAgICAgIDEgIDE2CiAgICAgICAgIFNXQVAgICAgIDIgICAxNDFLICAgICAgIC0g ICAgICAgIDIgIDY0CiAgICAgICAgICBidXMgIDEwMzYgICAgODZLICAgICAgIC0gICAgIDMzNDMg IDE2LDMyLDY0LDEyOCwyNTYsMTAyNAogICAgICAgYnVzLXNjICAgIDQ2ICAgMTc0SyAgICAgICAt ICAgICAxNDM4ICAxNiwzMiw2NCwxMjgsMjU2LDUxMiwxMDI0LDIwNDgsNDA5NgogICAgICBkZXZz dGF0ICAgICA0ICAgICA5SyAgICAgICAtICAgICAgICA0ICAzMiw0MDk2CiBldmVudGhhbmRsZXIg ICAgODcgICAgIDdLICAgICAgIC0gICAgICAgODcgIDY0LDEyOAogICAgICAgICBrb2JqICAgMzI1 ICAxMzAwSyAgICAgICAtICAgICAgNDg2ICA0MDk2CiAgICAgIFBlci1jcHUgICAgIDEgICAgIDFL ICAgICAgIC0gICAgICAgIDEgIDMyCiAgICAgICBERVZGUzMgICAgOTkgICAgMjVLICAgICAgIC0g ICAgICAxMTEgIDI1NgogICAgICAgREVWRlMxICAgIDgyICAgIDQxSyAgICAgICAtICAgICAgIDg3 ICA1MTIKICAgICAgICAgcm1hbiAgIDEzMSAgICAxNksgICAgICAgLSAgICAgIDU2NyAgMzIsMTI4 CiAgICAgICAgIHNidWYgICAgIDggICAgIDFLICAgICAgIC0gICAgMTQzMTEgIDE2LDMyLDY0LDEy OCwyNTYsNTEyLDEwMjQsMjA0OCw0MDk2CiAgICAgICAgREVWRlMgICAgMTIgICAgIDFLICAgICAg IC0gICAgICAgMTMgIDE2LDEyOAogICAgICAgREVWRlNQICAgICA3ICAgICAxSyAgICAgICAtICAg ICAgICA3ICA2NAogICAgICAgIHN0YWNrICAgICAwICAgICAwSyAgICAgICAtICAgICAgICAyICAy NTYKICAgIHRhc2txdWV1ZSAgICAxNSAgICAgM0sgICAgICAgLSAgICAgICAxNSAgMTYsMzIsMjU2 CiAgICAgICBVbml0bm8gICAgMjAgICAgIDJLICAgICAgIC0gICAgMjg1MDQgIDMyLDY0CiAgICAg ICAgIHZtZW0gICAgIDMgICAgMjhLICAgICAgIC0gICAgICAgIDcgIDEwMjQsMjA0OCw0MDk2CiAg ICAgaW9jdGxvcHMgICAgIDAgICAgIDBLICAgICAgIC0gICAgNzE5MTMgIDE2LDMyLDY0LDEyOCwy NTYsNTEyLDEwMjQKICAgICAgIHNlbGVjdCAgIDExNCAgICAxNUsgICAgICAgLSAgICAgIDExNCAg MTI4CiAgICAgICAgICBpb3YgICAgIDAgICAgIDBLICAgICAgIC0gIDE2OTQzNjMgIDE2LDMyLDY0 LDEyOCwyNTYsNTEyCiAgICAgICAgICBtc2cgICAgIDQgICAgMzBLICAgICAgIC0gICAgICAgIDQg IDIwNDgsNDA5NgogICAgICAgICAgc2VtICAgICA0ICAgMTA2SyAgICAgICAtICAgICAgICA0ICAy MDQ4LDQwOTYKICAgICAgICAgIHNobSAgICAgMSAgICAyMEsgICAgICAgLSAgICAgICAgMSAgCiAg ICAgICAgICB0dHkgICAgMTggICAgMThLICAgICAgIC0gICAgICAgMjAgIDEwMjQsMjA0OAogICAg IG1idWZfdGFnICAgICAwICAgICAwSyAgICAgICAtICAgIDI4MTc4ICAzMiwxMjgKICAgICAgICBz aG1mZCAgICAgMSAgICAgOEsgICAgICAgLSAgICAgICAgMSAgCiAgICAgICBzb25hbWUgICAgIDkg ICAgIDFLICAgICAgIC0gICAgMTIzNDAgIDE2LDMyLDEyOAogICAgICAgICAgcGNiICAgIDI3ICAg Mjc3SyAgICAgICAtICAgICAgMjQwICAxNiwzMiwxMjgsMTAyNCwyMDQ4CiAgICAgICBiaW9idWYg ICAgNjEgICAgNjFLICAgICAgIC0gICAgICA3MjAgIDEwMjQKICAgICB2ZnNjYWNoZSAgICAgMSAg MTAyNEsgICAgICAgLSAgICAgICAgMSAgCiAgIGNsX3NhdmVidWYgICAgIDAgICAgIDBLICAgICAg IC0gICAgICAgNzMgIDY0CiAgICAgdmZzX2hhc2ggICAgIDEgICA1MTJLICAgICAgIC0gICAgICAg IDEgIAogICAgICAgdm5vZGVzICAgICAxICAgICAxSyAgICAgICAtICAgICAgICAxICAyNTYKICAg ICAgICBtb3VudCAgIDE4NCAgICAgOEsgICAgICAgLSAgICAgIDI1NCAgMTYsMzIsNjQsMTI4LDI1 NgogIHZub2RlbWFya2VyICAgICAwICAgICAwSyAgICAgICAtICAgICAxNDcyICA1MTIKICAgICAg ICAgIEJQRiAgICAyOCAgICA1M0sgICAgICAgLSAgICAgICAyOSAgMTI4LDUxMiwyMDQ4LDQwOTYK ICAgICAgICBpZm5ldCAgICAgNSAgICAgOUsgICAgICAgLSAgICAgICAgNSAgMTI4LDIwNDgKICAg ICAgIGlmYWRkciAgICA1MCAgICAxOUsgICAgICAgLSAgICAgICA1MyAgMzIsNjQsMTI4LDI1Niw1 MTIsMjA0OCw0MDk2CiAgZXRoZXJfbXVsdGkgICAgOTYgICAgIDZLICAgICAgIC0gICAgICAxMzIg IDE2LDMyLDY0CiAgICAgICAgY2xvbmUgICAgIDcgICAgIDFLICAgICAgIC0gICAgICAgIDkgIDE2 LDEyOAogICAgICAgYXJwY29tICAgICAzICAgICAxSyAgICAgICAtICAgICAgICAzICAxNgogICAg ICBsbHRhYmxlICAgIDM3ICAgIDEySyAgICAgICAtICAgICAgIDQyICAyNTYsNTEyCiAgICAgICBO RlMgZmggNDUyOTcgIDE0MTZLICAgICAgIC0gIDQ0MTE5ODQgIDE2LDMyCiAgICAgcm91dGV0Ymwg ICAgNjkgICAgIDlLICAgICAgIC0gICAgIDU0ODcgIDMyLDY0LDEyOCwyNTYsNTEyCiAgICAgICAg IGlnbXAgICAgIDQgICAgIDFLICAgICAgIC0gICAgICAgIDQgIDI1NgogICAgIGluX211bHRpICAg ICA0ICAgICAxSyAgICAgICAtICAgICAgICA3ICAyNTYKICAgIHNjdHBfYV9pdCAgICAgMCAgICAg MEsgICAgICAgLSAgICAgICAxMSAgMTYKICAgICBzY3RwX3ZyZiAgICAgMSAgICAgMUsgICAgICAg LSAgICAgICAgMSAgNjQKICAgICBzY3RwX2lmYSAgICAxMiAgICAgMksgICAgICAgLSAgICAgICAx MiAgMTI4CiAgICAgc2N0cF9pZm4gICAgIDQgICAgIDFLICAgICAgIC0gICAgICAgIDQgIDEyOAog ICAgc2N0cF9pdGVyICAgICAwICAgICAwSyAgICAgICAtICAgICAgIDExICAyNTYKICAgIGhvc3Rj YWNoZSAgICAgMSAgICAyOEsgICAgICAgLSAgICAgICAgMSAgCiAgICAgc3luY2FjaGUgICAgIDEg ICAgNjRLICAgICAgIC0gICAgICAgIDEgIAogICAgIGZyYWdtZW50ICAgICAwICAgICAwSyAgICAg ICAtICAgICAgIDcyICA2NCwxMjgKICAgIGluNl9tdWx0aSAgICA2MCAgICAgN0sgICAgICAgLSAg ICAgICA2MCAgMzIsMjU2CiAgICAgICAgICBtbGQgICAgIDQgICAgIDFLICAgICAgIC0gICAgICAg IDQgIDEyOAogICAgICAgICAgcnBjICAgIDI1ICAgICA5SyAgICAgICAtICAyNTM4MDkzICA2NCwx MjgsNTEyLDEwMjQKYXVkaXRfZXZjbGFzcyAgIDE4NyAgICAgNksgICAgICAgLSAgICAgIDIyOCAg MzIKICAgICAgcGFnZWRlcCAgICAgMiAgICA2NUsgICAgICAgLSAgICAgIDExNyAgMjU2CiAgICAg aW5vZGVkZXAgICAgMTEgICA1MTdLICAgICAgIC0gICAgNDA1NzAgIDUxMgogICAgYm1zYWZlbWFw ICAgICAzICAgICA5SyAgICAgICAtICAgIDQwMTIwICAyNTYKICAgICAgIG5ld2JsayAgICAgNyAg MTAyNksgICAgICAgLSAgICAyMzYzOSAgMjU2CiAgICAgaW5kaXJkZXAgICAgIDAgICAgIDBLICAg ICAgIC0gICAgICAgIDIgIDEyOAogICAgIGZyZWVmcmFnICAgICAwICAgICAwSyAgICAgICAtICAg ICAgNTE2ICAxMjgKICAgICBmcmVlYmxrcyAgICA1MyAgICAxNEsgICAgICAgLSAgICAyMTM5MSAg MjU2CiAgICAgZnJlZWZpbGUgICAgIDAgICAgIDBLICAgICAgIC0gICAgMzk5NTQgIDY0CiAgICAg ICBkaXJhZGQgICAgIDAgICAgIDBLICAgICAgIC0gICAgNDExODMgIDEyOAogICAgICAgIG1rZGly ICAgICAwICAgICAwSyAgICAgICAtICAgICAgIDI4ICAxMjgKICAgICAgIGRpcnJlbSAgICAgMCAg ICAgMEsgICAgICAgLSAgICA0MTE3NSAgMTI4CiAgICBuZXdkaXJibGsgICAgIDAgICAgIDBLICAg ICAgIC0gICAgICAgMTQgIDY0CiAgICAgZnJlZXdvcmsgICAgNTQgICAgIDdLICAgICAgIC0gICAg MjE3ODAgIDE2LDEyOAogICAgICBqYWRkcmVmICAgICA0ICAgICAxSyAgICAgICAtICAgIDQxMjEx ICAxMjgKICAgICAganJlbXJlZiAgICAgMCAgICAgMEsgICAgICAgLSAgICA0MTIwMyAgMTI4CiAg ICAgICBqbXZyZWYgICAgIDAgICAgIDBLICAgICAgIC0gICAgICAgMjIgIDEyOAogICAgICBqbmV3 YmxrICAgICA0ICAgICAxSyAgICAgICAtICAgIDIzNjM4ICAxMjgKICAgIGpmcmVlZnJhZyAgICAg MCAgICAgMEsgICAgICAgLSAgICAgIDUxNiAgMTI4CiAgICAgICAgIGpzZWcgICAgMTQgICAgIDJL ICAgICAgIC0gICAgIDI4MzkgIDEyOAogICAgICBqc2VnZGVwICAgIDU3ICAgICA0SyAgICAgICAt ICAgMTA2NTY4ICA2NAogICAgICAgIHNiZGVwICAgICAwICAgICAwSyAgICAgICAtICAgICAgMzg3 ICA2NAogICAgIHNhdmVkaW5vICAgICAwICAgICAwSyAgICAgICAtICAgICAyNTA0ICAyNTYKICAg ICAgamJsb2NrcyAgICAgMiAgICAgMUsgICAgICAgLSAgICAgICAgMiAgMTI4LDI1NgogICAgICBz b2Z0ZGVwICAgICAxICAgICAxSyAgICAgICAtICAgICAgICAxICA1MTIKICB1ZnNfZGlyaGFzaCAg ICAzMiAgICAgN0sgICAgICAgLSAgICAgICA0OCAgMTYsMzIsNjQsMTI4LDI1Niw1MTIKICAgIHVm c19xdW90YSAgICAgMSAgIDUxMksgICAgICAgLSAgICAgICAgMSAgCiAgICB1ZnNfbW91bnQgICAg IDMgICAgMTNLICAgICAgIC0gICAgICAgIDMgIDUxMiw0MDk2CiAgICB2bV9wZ2RhdGEgICAgIDIg ICAxMjlLICAgICAgIC0gICAgICAgIDIgIDEyOAogICAgICBVTUFIYXNoICAgICAyICAgICAzSyAg ICAgICAtICAgICAgICA1ICA1MTIsMTAyNCwyMDQ4Ck5GU0NMIGRpcm9mZmRpcm9mZiAgICAzNSAg ICAxOEsgICAgICAgLSAgICAgICAzOCAgNTEyCiAgICAgICB4ZW5idXMgICAgMTQgICAgIDJLICAg ICAgIC0gICAgICAgNzcgIDE2LDMyLDY0LDI1NgogICAgIHhlbnN0b3JlICAgICA3ICAgICAxSyAg ICAgICAtICAgICAxNDM5ICAxNiwzMiw2NCwxMjgsMjU2CiAgICBuZXduZnNtbnQgICAgIDQgICAg IDRLICAgICAgIC0gICAgICAgIDQgIDEwMjQKICAgIHBmc19ub2RlcyAgICAyMSAgICAgNksgICAg ICAgLSAgICAgICAyMSAgMjU2CiAgICAgIG1lbWRlc2MgICAgIDEgICAgIDRLICAgICAgIC0gICAg ICAgIDEgIDQwOTYKICAgICAgICAgR0VPTSAgICA1OSAgICAxMksgICAgICAgLSAgICAgIDgxMiAg MTYsMzIsNjQsMTI4LDI1Niw1MTIsMTAyNCwyMDQ4CiAgICAgICBmZWVkZXIgICAgIDcgICAgIDFL ICAgICAgIC0gICAgICAgIDcgIDMyCiAgICAgIENBTSBERVYgICAgIDQgICAgIDhLICAgICAgIC0g ICAgICAgMTMgIDIwNDgKICAgICBhdGtiZGRldiAgICAgMiAgICAgMUsgICAgICAgLSAgICAgICAg MiAgNjQKICAgICAgQ0FNIENDQiAgICAgMCAgICAgMEsgICAgICAgLSAgICAgMTcyNCAgMjA0OAog ICAgcmFpZF9kYXRhICAgICAwICAgICAwSyAgICAgICAtICAgICAgIDcyICAzMiwxMjgsMjU2CiAg ICAgYWNwaWludHIgICAgIDEgICAgIDFLICAgICAgIC0gICAgICAgIDEgIDY0CiAgICAgICAgIFVB UlQgICAgIDMgICAgIDNLICAgICAgIC0gICAgICAgIDMgIDE2LDEwMjQKICAgICAgIGFjcGljYSAg NDg1NiAgIDQ4N0sgICAgICAgLSAgICA3NTA2NSAgMTYsMzIsNjQsMTI4LDI1Niw1MTIsMTAyNCw0 MDk2Cm1kX252aWRpYV9kYXRhICAgICAwICAgICAwSyAgICAgICAtICAgICAgIDExICA1MTIKICAg ICBDQU0gcGF0aCAgICAgNSAgICAgMUsgICAgICAgLSAgICAgICA0NCAgMzIKICBtZF9zaWlfZGF0 YSAgICAgMCAgICAgMEsgICAgICAgLSAgICAgICAxMSAgNTEyCiAgICAgYWNwaXRhc2sgICAgIDEg ICAgIDhLICAgICAgIC0gICAgICAgIDEgIAogICAgICBhdGFfcGNpICAgICAxICAgICAxSyAgICAg ICAtICAgICAgICAxICA2NAogICAgICBhY3Bpc2VtICAgIDE3ICAgICAzSyAgICAgICAtICAgICAg IDE3ICAxMjgKICAgQ0FNIHBlcmlwaCAgICAgNCAgICAgMUsgICAgICAgLSAgICAgICAxOCAgMTYs MzIsNjQsMTI4LDI1NgogICAgICBhY3BpZGV2ICAgIDM3ICAgICAzSyAgICAgICAtICAgICAgIDM3 ICA2NAogICAgICAgYXBtZGV2ICAgICAxICAgICAxSyAgICAgICAtICAgICAgICAxICAxMjgKICAg bWFkdF90YWJsZSAgICAgMCAgICAgMEsgICAgICAgLSAgICAgICAgMSAgNDA5NgogICAgQ0FNIHF1 ZXVlICAgICA3ICAgICAzSyAgICAgICAtICAgICAgIDM1ICAxNiwzMiw1MTIKQ0FNIGRldiBxdWV1 ZSAgICAgMyAgICAgMUsgICAgICAgLSAgICAgICAgMyAgNjQKICAgICAgaW9fYXBpYyAgICAgMSAg ICAgNEsgICAgICAgLSAgICAgICAgMSAgNDA5NgogICAgICAgaXNhZGV2ICAgICA2ICAgICAxSyAg ICAgICAtICAgICAgICA2ICAxMjgKICAgICAgICAgIE1DQSAgICAgNCAgICAgMUsgICAgICAgLSAg ICAgICAgNCAgMTI4CiAgICAgbmV4dXNkZXYgICAgIDQgICAgIDFLICAgICAgIC0gICAgICAgIDQg IDE2CiAgICAgICBrYmRtdXggICAgIDYgICAgMThLICAgICAgIC0gICAgICAgIDYgIDE2LDUxMiwx MDI0LDIwNDgKICAgICAgICAgIFVTQiAgICAxNCAgICAzOEsgICAgICAgLSAgICAgICAxNSAgMTYs MTI4LDUxMiw0MDk2CiAgICAgICBVU0JkZXYgICAgMTUgICAgIDdLICAgICAgIC0gICAgICAgMTUg IDMyLDY0LDEyOCwyNTYsNTEyLDQwOTYKICAgICBwcGJ1c2RldiAgICAgMiAgICAgMUsgICAgICAg LSAgICAgICAgMiAgMjU2CiAgICAgIHhlbl9odm0gICAgIDIgICAgIDhLICAgICAgIC0gICAgICAg IDIgIDQwOTYKICAgICB4ZW5faW50ciAgICA0NSAgICAgNksgICAgICAgLSAgICAgICA0NSAgMTI4 CgotLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0Kdm1zdGF0IC16CgpJVEVNICAgICAgICAgICAgICAgICAgIFNJWkUg IExJTUlUICAgICBVU0VEICAgICBGUkVFICAgICAgUkVRIEZBSUwgU0xFRVAKClVNQSBLZWdzOiAg ICAgICAgICAgICAgIDM4NCwgICAgICAwLCAgICAgIDk4LCAgICAgICAyLCAgICAgIDk4LCAgIDAs ICAgMApVTUEgWm9uZXM6ICAgICAgICAgICAgIDExNTIsICAgICAgMCwgICAgICA5OCwgICAgICAg MSwgICAgICA5OCwgICAwLCAgIDAKVU1BIFNsYWJzOiAgICAgICAgICAgICAgIDgwLCAgICAgIDAs ICAgIDMwOTYsICAgICAgIDQsICAgIDQ0NDQsICAgMCwgICAwClVNQSBSQ250U2xhYnM6ICAgICAg ICAgICA4OCwgICAgICAwLCAgICAxMDgxLCAgICAgIDQ0LCAgICAxNzEyLCAgIDAsICAgMApVTUEg SGFzaDogICAgICAgICAgICAgICAyNTYsICAgICAgMCwgICAgICAgNywgICAgICAgOCwgICAgICAg OSwgICAwLCAgIDAKNCBCdWNrZXQ6ICAgICAgICAgICAgICAgIDMyLCAgICAgIDAsICAgICAgIDMs ICAgICA4NzIsICAgMTY5NzksICAgMCwgICAwCjYgQnVja2V0OiAgICAgICAgICAgICAgICA0OCwg ICAgICAwLCAgICAgIDIwLCAgICAgODEwLCAgIDE0MDA4LCAgIDAsICAgMAo4IEJ1Y2tldDogICAg ICAgICAgICAgICAgNjQsICAgICAgMCwgICAgICAxOSwgICAgIDc4NywgICA2MzA4NiwgICAwLCAg IDAKMTIgQnVja2V0OiAgICAgICAgICAgICAgIDk2LCAgICAgIDAsICAgICAgMTgsICAgICA2Mzgs ICAgNDkwMzcsICAgMCwgICAwCjE2IEJ1Y2tldDogICAgICAgICAgICAgIDEyOCwgICAgICAwLCAg ICAgMTMwLCAgICAgNzM4LCAgIDcyOTkzLCAgMTcsICAgMAozMiBCdWNrZXQ6ICAgICAgICAgICAg ICAyNTYsICAgICAgMCwgICAgICA4NiwgICAgIDM0OSwgICA0NzU2OSwgIDQ5LCAgIDAKNjQgQnVj a2V0OiAgICAgICAgICAgICAgNTEyLCAgICAgIDAsICAgICAxMzgsICAgICAzMTAsICAgMjkyMzUs OTMwMSwgICAwCjEyOCBCdWNrZXQ6ICAgICAgICAgICAgMTAyNCwgICAgICAwLCAgICA4NTU1LCAg ICAgIDQxLCAgIDM1OTAwLCAgIDAsICAgMAp2bWVtIGJ0YWc6ICAgICAgICAgICAgICAgNTYsICAg ICAgMCwgICAgMjgzOSwgICAgIDIxNCwgICAgMzA0OCwgIDQzLCAgIDAKVk0gT0JKRUNUOiAgICAg ICAgICAgICAgMjU2LCAgICAgIDAsICAgMzQ1MTYsICAgICAyNTQsIDEwNDQwNDYsICAgMCwgICAw ClJBRElYIE5PREU6ICAgICAgICAgICAgIDE0NCwgICAgICAwLCAgIDI3MTkxLCAgICAxMTg2LCAz MDI4MjU3LCAgIDAsICAgMApNQVA6ICAgICAgICAgICAgICAgICAgICAyNDAsICAgICAgMCwgICAg ICAgMywgICAgICA2MSwgICAgICAgMywgICAwLCAgIDAKS01BUCBFTlRSWTogICAgICAgICAgICAg MTI4LCAgICAgIDAsICAgICAgIDUsICAgICAyNzQsICAgICAgIDUsICAgMCwgICAwCk1BUCBFTlRS WTogICAgICAgICAgICAgIDEyOCwgICAgICAwLCAgICAgOTc4LCAgICAxOTA1LCAyMzM4OTE1LCAg IDAsICAgMApWTVNQQUNFOiAgICAgICAgICAgICAgICA0NDgsICAgICAgMCwgICAgICA1MSwgICAg IDE4MywgICA3NTY2OSwgICAwLCAgIDAKZmFrZXBnOiAgICAgICAgICAgICAgICAgMTA0LCAgICAg IDAsICAgICAgIDAsICAgICAgIDAsICAgICAgIDAsICAgMCwgICAwCm10X3pvbmU6ICAgICAgICAg ICAgICAgNDExMiwgICAgICAwLCAgICAgMzQ2LCAgICAgICAwLCAgICAgMzQ2LCAgIDAsICAgMAox NjogICAgICAgICAgICAgICAgICAgICAgMTYsICAgICAgMCwgICAgMTM0NCwgICAgIDQxMywgICA4 MTM0OCwgICAwLCAgIDAKMzI6ICAgICAgICAgICAgICAgICAgICAgIDMyLCAgICAgIDAsICAgNDY2 MzksICAgICAyMzYsIDQ0OTA1NzAsICAgMCwgICAwCjY0OiAgICAgICAgICAgICAgICAgICAgICA2 NCwgICAgICAwLDE4NDQ2NzQ0MDczNzA4NTE1ODE3LCAxMDQxMTkzLCAyMzcxOTAxLCAgIDAsICAg MAoxMjg6ICAgICAgICAgICAgICAgICAgICAxMjgsICAgICAgMCwgICAgNTc3NCwgICAgIDczNiwg IDQzMzM3MywgICAwLCAgIDAKMjU2OiAgICAgICAgICAgICAgICAgICAgMjU2LCAgICAgIDAsICAg ICA3NzIsICAgICAzMzgsICAzODI3MDgsICAgMCwgICAwCjUxMjogICAgICAgICAgICAgICAgICAg IDUxMiwgICAgICAwLCAgICAgMzkzLCAgICAgMTkxLCAyNTg3NzkwLCAgIDAsICAgMAoxMDI0OiAg ICAgICAgICAgICAgICAgIDEwMjQsICAgICAgMCwgICAgIDEwNCwgICAgIDE4NCwgICA1NTQxMywg ICAwLCAgIDAKMjA0ODogICAgICAgICAgICAgICAgICAyMDQ4LCAgICAgIDAsICAgICAgOTQsICAg ICAgNjYsICAgNzc4OTUsICAgMCwgICAwCjQwOTY6ICAgICAgICAgICAgICAgICAgNDA5NiwgICAg ICAwLCAgICAgNDYyLCAgICAgIDQ0LCAgIDc2NjA2LCAgIDAsICAgMAo2NCBwY3B1OiAgICAgICAg ICAgICAgICAgIDgsICAgICAgMCwgICAgMTcwMCwgICAgIDIyMCwgICAgMTcwMCwgICAwLCAgIDAK U0xFRVBRVUVVRTogICAgICAgICAgICAgIDgwLCAgICAgIDAsICAgICAxOTAsICAgICAzMzcsICAg ICAxOTAsICAgMCwgICAwCkZpbGVzOiAgICAgICAgICAgICAgICAgICA4MCwgICAgICAwLCAgICAg MTUwLCAgICAgNjAwLCAyNjk1MjQ4LCAgIDAsICAgMApUVVJOU1RJTEU6ICAgICAgICAgICAgICAx MzYsICAgICAgMCwgICAgIDE5MCwgICAgIDEzMCwgICAgIDE5MCwgICAwLCAgIDAKcmxfZW50cnk6 ICAgICAgICAgICAgICAgIDQwLCAgICAgIDAsICAgICAxMjYsICAgICAzNzQsICAgICAxMjYsICAg MCwgICAwCnVtdHggcGk6ICAgICAgICAgICAgICAgICA5NiwgICAgICAwLCAgICAgICAwLCAgICAg ICAwLCAgICAgICAwLCAgIDAsICAgMApNQUMgbGFiZWxzOiAgICAgICAgICAgICAgNDAsICAgICAg MCwgICAgICAgMCwgICAgICAgMCwgICAgICAgMCwgICAwLCAgIDAKUFJPQzogICAgICAgICAgICAg ICAgICAxMjA4LCAgICAgIDAsICAgICAgNzIsICAgICAgNzIsICAgNzU4MDAsICAgMCwgICAwClRI UkVBRDogICAgICAgICAgICAgICAgMTE2OCwgICAgICAwLCAgICAgMTgxLCAgICAgICA4LCAgICAg MTgxLCAgIDAsICAgMApjcHVzZXQ6ICAgICAgICAgICAgICAgICAgNzIsICAgICAgMCwgICAgICA1 OSwgICAgIDQ5MSwgICAgIDE3MSwgICAwLCAgIDAKYXVkaXRfcmVjb3JkOiAgICAgICAgICAxMjQ4 LCAgICAgIDAsICAgICAgIDAsICAgICAgIDAsICAgICAgIDAsICAgMCwgICAwCm1idWZfcGFja2V0 OiAgICAgICAgICAgIDI1NiwgMzk3NjUwLCAgICAgICAwLCAgICAgNTAwLCAgICAzNzM1LCAgIDAs ICAgMAptYnVmOiAgICAgICAgICAgICAgICAgICAyNTYsIDM5NzY1MCwgICAgIDE5NSwgICAgMTkz MCwyMDA1MzEzNSwgICAwLCAgIDAKbWJ1Zl9jbHVzdGVyOiAgICAgICAgICAyMDQ4LCAgNjIxMzIs ICAgICA1MDAsICAgICA3MDYsICA0NDQwODQsICAgMCwgICAwCm1idWZfanVtYm9fcGFnZTogICAg ICAgNDA5NiwgIDMxMDY1LCAgICAgMTkzLCAgICAgMjg1LCAzOTMwNjk4LCAgIDAsICAgMAptYnVm X2p1bWJvXzlrOiAgICAgICAgIDkyMTYsICAyNzYxMiwgICAgICAgMCwgICAgICAgMCwgICAgICAg MCwgICAwLCAgIDAKbWJ1Zl9qdW1ib18xNms6ICAgICAgIDE2Mzg0LCAgMjA3MDgsICAgICAgIDAs ICAgICAgIDAsICAgICAgIDAsICAgMCwgICAwCm1idWZfZXh0X3JlZmNudDogICAgICAgICAgNCwg ICAgICAwLCAgICAgICAwLCAgICAgICAwLCAgICAgICAwLCAgIDAsICAgMApnX2JpbzogICAgICAg ICAgICAgICAgICAyNDgsICAgICAgMCwgICAgICAgMCwgICAgIDQzMiwgICAyMjU1NCwgICAwLCAg IDAKRE1BUl9NQVBfRU5UUlk6ICAgICAgICAgMTIwLCAgICAgIDAsICAgICAgIDAsICAgICAgIDAs ICAgICAgIDAsICAgMCwgICAwCnR0eWlucTogICAgICAgICAgICAgICAgIDE2MCwgICAgICAwLCAg ICAgMTIwLCAgICAgIDgwLCAgICAgNDgwLCAgIDAsICAgMAp0dHlvdXRxOiAgICAgICAgICAgICAg ICAyNTYsICAgICAgMCwgICAgICA2NCwgICAgIDEzMSwgICAgIDI1NiwgICAwLCAgIDAKYXRhX3Jl cXVlc3Q6ICAgICAgICAgICAgMzM2LCAgICAgIDAsICAgICAgIDAsICAgICAxMjEsICAgIDE2OTYs ICAgMCwgICAwCnZ0bmV0X3R4X2hkcjogICAgICAgICAgICAyNCwgICAgICAwLCAgICAgICAwLCAg ICAgICAwLCAgICAgICAwLCAgIDAsICAgMApGUFVfc2F2ZV9hcmVhOiAgICAgICAgICA1MTIsICAg ICAgMCwgICAgICAgMCwgICAgICAgMCwgICAgICAgMCwgICAwLCAgIDAKVk5PREU6ICAgICAgICAg ICAgICAgICAgNDcyLCAgICAgIDAsICAgNDYyMDcsICAgICAgNDksICAyMDM5MDksICAgMCwgICAw ClZOT0RFUE9MTDogICAgICAgICAgICAgIDExMiwgICAgICAwLCAgICAgICAwLCAgICAgICAwLCAg ICAgICAwLCAgIDAsICAgMApCVUYgVFJJRTogICAgICAgICAgICAgICAxNDQsICAgICAgMCwgICAg ICAzMiwgICAgNzAxNSwgICAzMzAzMiwgICAwLCAgIDAKUyBWRlMgQ2FjaGU6ICAgICAgICAgICAg MTA4LCAgICAgIDAsICAgICA4ODgsICAgIDEzODcsICAxMzcwMjAsICAgMCwgICAwClNUUyBWRlMg Q2FjaGU6ICAgICAgICAgIDE0OCwgICAgICAwLCAgIDI0ODAwLCAgICAxNDM0LCAgODQ5ODQ3LCAg IDAsICAgMApMIFZGUyBDYWNoZTogICAgICAgICAgICAzMjgsICAgICAgMCwgICAgICAgMCwgICAg ICAgMCwgICAgICAgMCwgICAwLCAgIDAKTFRTIFZGUyBDYWNoZTogICAgICAgICAgMzY4LCAgICAg IDAsICAgICA0OTcsICAgICAyMzMsICAgIDE3NDYsICAgMCwgICAwCk5BTUVJOiAgICAgICAgICAg ICAgICAgMTAyNCwgICAgICAwLCAgICAgICAyLCAgICAgIDc4LCA2MTc5Mzk3LCAgIDAsICAgMApO Q0xOT0RFOiAgICAgICAgICAgICAgICA1MjgsICAgICAgMCwgICA0NTI5NywgICAgICAyMSwgIDE2 Mjk0MiwgICAwLCAgIDAKRElSSEFTSDogICAgICAgICAgICAgICAxMDI0LCAgICAgIDAsICAgICAg NDgsICAgICAgMzIsICAgICAgODIsICAgMCwgICAwCnBpcGU6ICAgICAgICAgICAgICAgICAgIDc0 NCwgICAgICAwLCAgICAgIDIwLCAgICAgIDg1LCAgIDQxNjcxLCAgIDAsICAgMApwcm9jZGVzYzog ICAgICAgICAgICAgICAxMjgsICAgICAgMCwgICAgICAgMCwgICAgICAgMCwgICAgICAgMCwgICAw LCAgIDAKTW91bnRwb2ludHM6ICAgICAgICAgICAgODE2LCAgICAgIDAsICAgICAgIDYsICAgICAg MzQsICAgICAgIDYsICAgMCwgICAwCmtzaWdpbmZvOiAgICAgICAgICAgICAgIDExMiwgICAgICAw LCAgICAgMTM0LCAgICAgNDk2LCAgICAgMjkyLCAgIDAsICAgMAppdGltZXI6ICAgICAgICAgICAg ICAgICAzNTIsICAgICAgMCwgICAgICAgMSwgICAgICA2NSwgICAgICAgMiwgICAwLCAgIDAKS05P VEU6ICAgICAgICAgICAgICAgICAgMTI4LCAgICAgIDAsICAgICAgIDAsICAgICA1MjcsICAgICA3 MTgsICAgMCwgICAwCnNvY2tldDogICAgICAgICAgICAgICAgIDY5NiwgIDMxOTEwLCAgICAgIDQ1 LCAgICAgIDUwLCAgICA1OTk1LCAgIDAsICAgMAp1bnBjYjogICAgICAgICAgICAgICAgICAyNDAs ICAzMTkyMCwgICAgICAxMSwgICAgIDI0NSwgICAgMTk5MCwgICAwLCAgIDAKaXBxOiAgICAgICAg ICAgICAgICAgICAgIDU2LCAgIDE5ODgsICAgICAgIDAsICAgICAyODQsICAgICAgNDgsICAgMCwg ICAwCnVkcF9pbnBjYjogICAgICAgICAgICAgIDM5MiwgIDMxOTEwLCAgICAgIDE5LCAgICAgMTAx LCAgICAzOTI4LCAgIDAsICAgMAp1ZHBjYjogICAgICAgICAgICAgICAgICAgMTYsICAzMjEyOCwg ICAgICAxOSwgICAgIDQ4MywgICAgMzkyOCwgICAwLCAgIDAKdGNwX2lucGNiOiAgICAgICAgICAg ICAgMzkyLCAgMzE5MTAsICAgICAgIDcsICAgICAgODMsICAgICAgNDIsICAgMCwgICAwCnRjcGNi OiAgICAgICAgICAgICAgICAgMTAyNCwgIDMxOTEyLCAgICAgICA3LCAgICAgIDMzLCAgICAgIDQy LCAgIDAsICAgMAp0Y3B0dzogICAgICAgICAgICAgICAgICAgODgsICAgNjM5MCwgICAgICAgMCwg ICAgIDEzNSwgICAgICAgOCwgICAwLCAgIDAKc3luY2FjaGU6ICAgICAgICAgICAgICAgMTYwLCAg MTUzNzUsICAgICAgIDAsICAgICAgIDAsICAgICAgIDAsICAgMCwgICAwCmhvc3RjYWNoZTogICAg ICAgICAgICAgIDEzNiwgIDE1MzcwLCAgICAgICAwLCAgICAgIDg3LCAgICAgICAyLCAgIDAsICAg MAp0Y3ByZWFzczogICAgICAgICAgICAgICAgNDAsICAgMzkwMCwgICAgICAgMCwgICAgIDUwMCwg IDQ3NjU0MywgICAwLCAgIDAKc2Fja2hvbGU6ICAgICAgICAgICAgICAgIDMyLCAgICAgIDAsICAg ICAgIDAsICAgICA1MDAsICAgMjU5MjksICAgMCwgICAwCnNjdHBfZXA6ICAgICAgICAgICAgICAg MTQwOCwgIDMxOTEwLCAgICAgICAwLCAgICAgICAwLCAgICAgICAwLCAgIDAsICAgMApzY3RwX2Fz b2M6ICAgICAgICAgICAgIDIzNTIsICA0MDAwMCwgICAgICAgMCwgICAgICAgMCwgICAgICAgMCwg ICAwLCAgIDAKc2N0cF9sYWRkcjogICAgICAgICAgICAgIDQ4LCAgODAwMTIsICAgICAgIDAsICAg ICAzMzIsICAgICAgMTEsICAgMCwgICAwCnNjdHBfcmFkZHI6ICAgICAgICAgICAgIDcyOCwgIDgw MDAwLCAgICAgICAwLCAgICAgICAwLCAgICAgICAwLCAgIDAsICAgMApzY3RwX2NodW5rOiAgICAg ICAgICAgICAxMzYsIDQwMDAyNiwgICAgICAgMCwgICAgICAgMCwgICAgICAgMCwgICAwLCAgIDAK c2N0cF9yZWFkcTogICAgICAgICAgICAgMTA0LCA0MDAwMjYsICAgICAgIDAsICAgICAgIDAsICAg ICAgIDAsICAgMCwgICAwCnNjdHBfc3RyZWFtX21zZ19vdXQ6ICAgIDEwNCwgNDAwMDI2LCAgICAg ICAwLCAgICAgICAwLCAgICAgICAwLCAgIDAsICAgMApzY3RwX2FzY29uZjogICAgICAgICAgICAg NDAsIDQwMDAwMCwgICAgICAgMCwgICAgICAgMCwgICAgICAgMCwgICAwLCAgIDAKc2N0cF9hc2Nv bmZfYWNrOiAgICAgICAgIDQ4LCA0MDAwNjAsICAgICAgIDAsICAgICAgIDAsICAgICAgIDAsICAg MCwgICAwCnJpcGNiOiAgICAgICAgICAgICAgICAgIDM5MiwgIDMxOTEwLCAgICAgICAzLCAgICAg IDg3LCAgICAgICA5LCAgIDAsICAgMApydGVudHJ5OiAgICAgICAgICAgICAgICAyMDAsICAgICAg MCwgICAgICA0MCwgICAgIDIyMCwgICAgICA0NywgICAwLCAgIDAKc2VsZmQ6ICAgICAgICAgICAg ICAgICAgIDU2LCAgICAgIDAsICAgICAxNjEsICAgICA2MjAsIDExODA4ODAsICAgMCwgICAwClNX QVBNRVRBOiAgICAgICAgICAgICAgIDI4OCwgMTI0MjY3LCAgICAgICAwLCAgICAgICAwLCAgICAg ICAwLCAgIDAsICAgMApGRlMgaW5vZGU6ICAgICAgICAgICAgICAxNjgsICAgICAgMCwgICAgIDg3 NywgICAgIDI5NiwgICA0MDkwOCwgICAwLCAgIDAKRkZTMSBkaW5vZGU6ICAgICAgICAgICAgMTI4 LCAgICAgIDAsICAgICAgIDAsICAgICAgIDAsICAgICAgIDAsICAgMCwgICAwCkZGUzIgZGlub2Rl OiAgICAgICAgICAgIDI1NiwgICAgICAwLCAgICAgODc3LCAgICAgMjkzLCAgIDQwOTA4LCAgIDAs ICAgMAoKCi0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLQp2bXN0YXQgLWkKCmludGVycnVwdCAgICAgICAgICAgICAg ICAgICAgICAgICAgdG90YWwgICAgICAgcmF0ZQppcnExOiBhdGtiZDAgICAgICAgICAgICAgICAg ICAgICAgICAgNTcwICAgICAgICAgMTMKaXJxMTU6IGF0YTEgICAgICAgICAgICAgICAgICAgICAg ICAgMzM4OSAgICAgICAgIDgyCmlycTIzOiB1aGNpMCAgICAgICAgICAgICAgICAgICAgICAgNzU2 NDYgICAgICAgMTg0NQpjcHUwOnhlbiAgICAgICAgICAgICAgICAgICAgICAgICAxNDk5Njc1ICAg ICAgMzY1NzcKY3B1MTp4ZW4gICAgICAgICAgICAgICAgICAgICAgICAgMTY2NzE0NyAgICAgIDQw NjYyCmNwdTI6eGVuICAgICAgICAgICAgICAgICAgICAgICAgIDE2MzQ3ODggICAgICAzOTg3Mgpj cHUzOnhlbiAgICAgICAgICAgICAgICAgICAgICAgICA1MDIwMzczICAgICAxMjI0NDgKaXJxNzY4 OiB4ZW5fZXQwOmMwICAgICAgICAgICAgICAgIDQ3MjM0OCAgICAgIDExNTIwCmlycTc2OTogeGVu X2V0MDpjMSAgICAgICAgICAgICAgICA0NjE0OTQgICAgICAxMTI1NQppcnE3NzA6IHhlbl9ldDA6 YzIgICAgICAgICAgICAgICAgNDY3NDY3ICAgICAgMTE0MDEKaXJxNzcxOiB4ZW5fZXQwOmMzICAg ICAgICAgICAgICAgIDQ5NjE3MCAgICAgIDEyMTAxCmlycTc3MjogeGVuc3RvcmUwICAgICAgICAg ICAgICAgICAgICA5MDUgICAgICAgICAyMgppcnE3NzM6IHhiZDAgICAgICAgICAgICAgICAgICAg ICAgICA5NTA5ICAgICAgICAyMzEKaXJxNzc0OiB4bjAgICAgICAgICAgICAgICAgICAgICAgNDI5 NDA4MyAgICAgMTA0NzMzCmlycTc3NTogeG4xICAgICAgICAgICAgICAgICAgICAgICAgMTIyMDYg ICAgICAgIDI5NwppcnE3NzY6IHhuMiAgICAgICAgICAgICAgICAgICAgICAgMTAyODgyICAgICAg IDI1MDkKaXJxNzc3OiBjcHUwOnIgICAgICAgICAgICAgICAgICAgICAgIDIzNSAgICAgICAgICA1 CmlycTc3OTogY3B1MDppcGcgICAgICAgICAgICAgICAgICAgIDk4MjQgICAgICAgIDIzOQppcnE3 ODA6IGNwdTA6aXJnICAgICAgICAgICAgICAgICAgMTY2NDEzICAgICAgIDQwNTgKaXJxNzgyOiBj cHUwOmIgICAgICAgICAgICAgICAgICAgIDg3NzA1NiAgICAgIDIxMzkxCmlycTc4NTogY3B1MDpz dGggICAgICAgICAgICAgICAgICAgICAgIDEgICAgICAgICAgMAppcnE3ODY6IGNwdTE6ciAgICAg ICAgICAgICAgICAgICAgICAgMjQzICAgICAgICAgIDUKaXJxNzg4OiBjcHUxOmlwZyAgICAgICAg ICAgICAgICAgICAxMDgxMyAgICAgICAgMjYzCmlycTc4OTogY3B1MTppcmcgICAgICAgICAgICAg ICAgICAxNTgzMTMgICAgICAgMzg2MQppcnE3OTE6IGNwdTE6YiAgICAgICAgICAgICAgICAgICAg OTg2Mjc4ICAgICAgMjQwNTUKaXJxNzk0OiBjcHUxOnN0aCAgICAgICAgICAgICAgICAgICAgICAg MSAgICAgICAgICAwCmlycTc5NTogY3B1MjpyICAgICAgICAgICAgICAgICAgICAgICAyMzQgICAg ICAgICAgNQppcnE3OTc6IGNwdTI6aXBnICAgICAgICAgICAgICAgICAgIDExMjQ4ICAgICAgICAy NzQKaXJxNzk4OiBjcHUyOmlyZyAgICAgICAgICAgICAgICAgIDE1NzM0NCAgICAgICAzODM3Cmly cTgwMDogY3B1MjpiICAgICAgICAgICAgICAgICAgIDEwMjM3MjQgICAgICAyNDk2OAppcnE4MDQ6 IGNwdTM6ciAgICAgICAgICAgICAgICAgICAgICAgMjA5ICAgICAgICAgIDUKaXJxODA2OiBjcHUz OmlwZyAgICAgICAgICAgICAgICAgICAgNTUzMCAgICAgICAgMTM0CmlycTgwNzogY3B1Mzppcmcg ICAgICAgICAgICAgICAgICAxNzMwNTggICAgICAgNDIyMAppcnE4MDk6IGNwdTM6YiAgICAgICAg ICAgICAgICAgICAgMjMyMDAyICAgICAgIDU2NTgKaXJxODEyOiBjcHUzOnN0aCAgICAgICAgICAg ICAgICAgICAgICAgMSAgICAgICAgICAwClRvdGFsICAgICAgICAgICAgICAgICAgICAgICAgICAg MjAwMzExNzkgICAgIDQ4ODU2NQoKLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tCnBzdGF0IC1UCgoxNTAvMzE5MDcg ZmlsZXMKME0vODE4TSBzd2FwIHNwYWNlCgotLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0KcHN0YXQgLXMKCkRldmlj ZSAgICAgICAgICA1MTItYmxvY2tzICAgICBVc2VkICAgIEF2YWlsIENhcGFjaXR5Ci9kZXYvYWRh MHAzICAgICAgICAxNjc3MDU2ICAgICAgICAwICAxNjc3MDU2ICAgICAwJQoKLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tCmlvc3RhdAoKaW9zdGF0OiBrdm1fcmVhZChfdGtfbmluKTogaW52YWxpZCBhZGRyZXNzICgw eDApCmlvc3RhdDogZGlzYWJsaW5nIFRUWSBzdGF0aXN0aWNzCiAgICAgICAgICAgIGFkYTAgICAg ICAgICAgICAgIGNkMCAgICAgICAgICAgIHBhc3MwICAgICAgICAgICAgIGNwdQogIEtCL3QgdHBz ICBNQi9zICAgS0IvdCB0cHMgIE1CL3MgICBLQi90IHRwcyAgTUIvcyAgdXMgbmkgc3kgaW4gaWQK IDE4LjUxIDI3MiAgNC45MiAgIDAuMDAgICA0ICAwLjAwICAgMC4wMCAgIDAgIDAuMDAgIDI4ICAw IDExICA2IDU1CgotLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0KaXBjcyAtYQoKTWVzc2FnZSBRdWV1ZXM6ClQgICAg ICAgICAgIElEICAgICAgICAgIEtFWSBNT0RFICAgICAgICBPV05FUiAgICBHUk9VUCAgICBDUkVB VE9SICBDR1JPVVAgICAgICAgICAgICAgICAgIENCWVRFUyAgICAgICAgICAgICAgICAgUU5VTSAg ICAgICAgICAgICAgIFFCWVRFUyAgICAgICAgTFNQSUQgICAgICAgIExSUElEIFNUSU1FICAgIFJU SU1FICAgIENUSU1FICAgCgpTaGFyZWQgTWVtb3J5OgpUICAgICAgICAgICBJRCAgICAgICAgICBL RVkgTU9ERSAgICAgICAgT1dORVIgICAgR1JPVVAgICAgQ1JFQVRPUiAgQ0dST1VQICAgICAgICAg TkFUVENIICAgICAgICBTRUdTWiAgICAgICAgIENQSUQgICAgICAgICBMUElEIEFUSU1FICAgIERU SU1FICAgIENUSU1FICAgCgpTZW1hcGhvcmVzOgpUICAgICAgICAgICBJRCAgICAgICAgICBLRVkg TU9ERSAgICAgICAgT1dORVIgICAgR1JPVVAgICAgQ1JFQVRPUiAgQ0dST1VQICAgICAgICAgIE5T RU1TIE9USU1FICAgIENUSU1FICAgCgoKLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tCmlwY3MgLVQKCm1zZ2luZm86 Cgltc2dtYXg6ICAgICAgICAxNjM4NAkobWF4IGNoYXJhY3RlcnMgaW4gYSBtZXNzYWdlKQoJbXNn bW5pOiAgICAgICAgICAgNDAJKCMgb2YgbWVzc2FnZSBxdWV1ZXMpCgltc2dtbmI6ICAgICAgICAg MjA0OAkobWF4IGNoYXJhY3RlcnMgaW4gYSBtZXNzYWdlIHF1ZXVlKQoJbXNndHFsOiAgICAgICAg ICAgNDAJKG1heCAjIG9mIG1lc3NhZ2VzIGluIHN5c3RlbSkKCW1zZ3NzejogICAgICAgICAgICA4 CShzaXplIG9mIGEgbWVzc2FnZSBzZWdtZW50KQoJbXNnc2VnOiAgICAgICAgIDIwNDgJKCMgb2Yg bWVzc2FnZSBzZWdtZW50cyBpbiBzeXN0ZW0pCgpzaG1pbmZvOgoJc2htbWF4OiAgICA1MzY4NzA5 MTIJKG1heCBzaGFyZWQgbWVtb3J5IHNlZ21lbnQgc2l6ZSkKCXNobW1pbjogICAgICAgICAgICAx CShtaW4gc2hhcmVkIG1lbW9yeSBzZWdtZW50IHNpemUpCglzaG1tbmk6ICAgICAgICAgIDE5Mgko bWF4IG51bWJlciBvZiBzaGFyZWQgbWVtb3J5IGlkZW50aWZpZXJzKQoJc2htc2VnOiAgICAgICAg ICAxMjgJKG1heCBzaGFyZWQgbWVtb3J5IHNlZ21lbnRzIHBlciBwcm9jZXNzKQoJc2htYWxsOiAg ICAgICAxMzEwNzIJKG1heCBhbW91bnQgb2Ygc2hhcmVkIG1lbW9yeSBpbiBwYWdlcykKCnNlbWlu Zm86CglzZW1tbmk6ICAgICAgICAgICA1MAkoIyBvZiBzZW1hcGhvcmUgaWRlbnRpZmllcnMpCglz ZW1tbnM6ICAgICAgICAgIDM0MAkoIyBvZiBzZW1hcGhvcmVzIGluIHN5c3RlbSkKCXNlbW1udTog ICAgICAgICAgMTUwCSgjIG9mIHVuZG8gc3RydWN0dXJlcyBpbiBzeXN0ZW0pCglzZW1tc2w6ICAg ICAgICAgIDM0MAkobWF4ICMgb2Ygc2VtYXBob3JlcyBwZXIgaWQpCglzZW1vcG06ICAgICAgICAg IDEwMAkobWF4ICMgb2Ygb3BlcmF0aW9ucyBwZXIgc2Vtb3AgY2FsbCkKCXNlbXVtZTogICAgICAg ICAgIDUwCShtYXggIyBvZiB1bmRvIGVudHJpZXMgcGVyIHByb2Nlc3MpCglzZW11c3o6ICAgICAg ICAgIDYzMgkoc2l6ZSBpbiBieXRlcyBvZiB1bmRvIHN0cnVjdHVyZSkKCXNlbXZteDogICAgICAg IDMyNzY3CShzZW1hcGhvcmUgbWF4aW11bSB2YWx1ZSkKCXNlbWFlbTogICAgICAgIDE2Mzg0CShh ZGp1c3Qgb24gZXhpdCBtYXggdmFsdWUpCgoKLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tCm5mc3N0YXQKCkNsaWVu dCBJbmZvOgpScGMgQ291bnRzOgogIEdldGF0dHIgICBTZXRhdHRyICAgIExvb2t1cCAgUmVhZGxp bmsgICAgICBSZWFkICAgICBXcml0ZSAgICBDcmVhdGUgICAgUmVtb3ZlCiAgICAgICAgOCAgICAg ICAgIDAgICAgICAgICAwICAgICAgICAgMCAgICAgICAgIDAgICAgICAgICAwICAgICAgICAgMCAg ICAgICAgIDAKICAgUmVuYW1lICAgICAgTGluayAgIFN5bWxpbmsgICAgIE1rZGlyICAgICBSbWRp ciAgIFJlYWRkaXIgIFJkaXJQbHVzICAgIEFjY2VzcwogICAgICAgIDAgICAgICAgICAwICAgICAg ICAgMCAgICAgICAgIDAgICAgICAgICAwICAgICAgICAgMCAgICAgICAgIDAgICAgICAgICAwCiAg ICBNa25vZCAgICBGc3N0YXQgICAgRnNpbmZvICBQYXRoQ29uZiAgICBDb21taXQKICAgICAgICAw ICAgICAgICAgNCAgICAgICAgIDQgICAgICAgICAwICAgICAgICAgMApScGMgSW5mbzoKIFRpbWVk T3V0ICAgSW52YWxpZCBYIFJlcGxpZXMgICBSZXRyaWVzICBSZXF1ZXN0cwogICAgICAgIDAgICAg ICAgICAwICAgICAgICAgMCAgICAgICAgIDAgICAgICAgIDE2CkNhY2hlIEluZm86CkF0dHIgSGl0 cyAgICBNaXNzZXMgTGt1cCBIaXRzICAgIE1pc3NlcyBCaW9SIEhpdHMgICAgTWlzc2VzIEJpb1cg SGl0cyAgICBNaXNzZXMKICAgICAgICAwICAgICAgICAgMCAgICAgICAgIDAgICAgICAgICAwICAg ICAgICAgMCAgICAgICAgIDAgICAgICAgICAwICAgICAgICAgMApCaW9STEhpdHMgICAgTWlzc2Vz IEJpb0QgSGl0cyAgICBNaXNzZXMgRGlyRSBIaXRzICAgIE1pc3NlcyBBY2NzIEhpdHMgICAgTWlz c2VzCiAgICAgICAgMCAgICAgICAgIDAgICAgICAgICAwICAgICAgICAgMCAgICAgICAgIDAgICAg ICAgICAwICAgICAgICAgMCAgICAgICAgIDAKClNlcnZlciBJbmZvOgogIEdldGF0dHIgICBTZXRh dHRyICAgIExvb2t1cCAgUmVhZGxpbmsgICAgICBSZWFkICAgICBXcml0ZSAgICBDcmVhdGUgICAg UmVtb3ZlCiAgICAgICAgMCAgICAgICAgIDAgICAgICAgICAwICAgICAgICAgMCAgICAgICAgIDAg ICAgICAgICAwICAgICAgICAgMCAgICAgICAgIDAKICAgUmVuYW1lICAgICAgTGluayAgIFN5bWxp bmsgICAgIE1rZGlyICAgICBSbWRpciAgIFJlYWRkaXIgIFJkaXJQbHVzICAgIEFjY2VzcwogICAg ICAgIDAgICAgICAgICAwICAgICAgICAgMCAgICAgICAgIDAgICAgICAgICAwICAgICAgICAgMCAg ICAgICAgIDAgICAgICAgICAwCiAgICBNa25vZCAgICBGc3N0YXQgICAgRnNpbmZvICBQYXRoQ29u ZiAgICBDb21taXQKICAgICAgICAwICAgICAgICAgMCAgICAgICAgIDAgICAgICAgICAwICAgICAg ICAgMApTZXJ2ZXIgUmV0LUZhaWxlZAogICAgICAgICAgICAgICAgMApTZXJ2ZXIgRmF1bHRzCiAg ICAgICAgICAgIDAKU2VydmVyIENhY2hlIFN0YXRzOgogICBJbnByb2cgICAgICBJZGVtICBOb24t aWRlbSAgICBNaXNzZXMKICAgICAgICAwICAgICAgICAgMCAgICAgICAgIDAgICAgICAgICAwClNl cnZlciBXcml0ZSBHYXRoZXJpbmc6CiBXcml0ZU9wcyAgV3JpdGVSUEMgICBPcHNhdmVkCiAgICAg ICAgMCAgICAgICAgIDAgICAgICAgICAwCgotLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0KbmV0c3RhdCAtcwoKdGNw OgoJMzM5NTkyOCBwYWNrZXRzIHNlbnQKCQkyNjE3MjY5IGRhdGEgcGFja2V0cyAoMTAyNDA4OTM5 NyBieXRlcykKCQkyNDMxIGRhdGEgcGFja2V0cyAoMzMxODY2NCBieXRlcykgcmV0cmFuc21pdHRl ZAoJCTAgZGF0YSBwYWNrZXRzIHVubmVjZXNzYXJpbHkgcmV0cmFuc21pdHRlZAoJCTAgcmVzZW5k cyBpbml0aWF0ZWQgYnkgTVRVIGRpc2NvdmVyeQoJCTc3NjE0MiBhY2stb25seSBwYWNrZXRzICg1 ODU4IGRlbGF5ZWQpCgkJMCBVUkcgb25seSBwYWNrZXRzCgkJMCB3aW5kb3cgcHJvYmUgcGFja2V0 cwoJCTM2IHdpbmRvdyB1cGRhdGUgcGFja2V0cwoJCTUwIGNvbnRyb2wgcGFja2V0cwoJMzA4MTcy MCBwYWNrZXRzIHJlY2VpdmVkCgkJMjM3NjY5NCBhY2tzIChmb3IgMTAyNDA4OTQxNyBieXRlcykK CQkyNzk1OSBkdXBsaWNhdGUgYWNrcwoJCTAgYWNrcyBmb3IgdW5zZW50IGRhdGEKCQkyNDM4NTY1 IHBhY2tldHMgKDgxOTQ0MDU2NSBieXRlcykgcmVjZWl2ZWQgaW4tc2VxdWVuY2UKCQk1NzcxIGNv bXBsZXRlbHkgZHVwbGljYXRlIHBhY2tldHMgKDc3OTIyNzIgYnl0ZXMpCgkJMCBvbGQgZHVwbGlj YXRlIHBhY2tldHMKCQkwIHBhY2tldHMgd2l0aCBzb21lIGR1cC4gZGF0YSAoMCBieXRlcyBkdXBl ZCkKCQk0NzY0Nzcgb3V0LW9mLW9yZGVyIHBhY2tldHMgKDc3OTk3MjAxMCBieXRlcykKCQkwIHBh Y2tldHMgKDAgYnl0ZXMpIG9mIGRhdGEgYWZ0ZXIgd2luZG93CgkJMCB3aW5kb3cgcHJvYmVzCgkJ MyB3aW5kb3cgdXBkYXRlIHBhY2tldHMKCQkwIHBhY2tldHMgcmVjZWl2ZWQgYWZ0ZXIgY2xvc2UK CQkwIGRpc2NhcmRlZCBmb3IgYmFkIGNoZWNrc3VtcwoJCTAgZGlzY2FyZGVkIGZvciBiYWQgaGVh ZGVyIG9mZnNldCBmaWVsZHMKCQkwIGRpc2NhcmRlZCBiZWNhdXNlIHBhY2tldCB0b28gc2hvcnQK CQkwIGRpc2NhcmRlZCBkdWUgdG8gbWVtb3J5IHByb2JsZW1zCgkyNyBjb25uZWN0aW9uIHJlcXVl c3RzCgkwIGNvbm5lY3Rpb24gYWNjZXB0cwoJMCBiYWQgY29ubmVjdGlvbiBhdHRlbXB0cwoJMCBs aXN0ZW4gcXVldWUgb3ZlcmZsb3dzCgkwIGlnbm9yZWQgUlNUcyBpbiB0aGUgd2luZG93cwoJMjcg Y29ubmVjdGlvbnMgZXN0YWJsaXNoZWQgKGluY2x1ZGluZyBhY2NlcHRzKQoJMzUgY29ubmVjdGlv bnMgY2xvc2VkIChpbmNsdWRpbmcgMCBkcm9wcykKCQkxMiBjb25uZWN0aW9ucyB1cGRhdGVkIGNh Y2hlZCBSVFQgb24gY2xvc2UKCQkxMiBjb25uZWN0aW9ucyB1cGRhdGVkIGNhY2hlZCBSVFQgdmFy aWFuY2Ugb24gY2xvc2UKCQkwIGNvbm5lY3Rpb25zIHVwZGF0ZWQgY2FjaGVkIHNzdGhyZXNoIG9u IGNsb3NlCgkwIGVtYnJ5b25pYyBjb25uZWN0aW9ucyBkcm9wcGVkCgkyMDY0ODAxIHNlZ21lbnRz IHVwZGF0ZWQgcnR0IChvZiAyMDY2MTc4IGF0dGVtcHRzKQoJMjEgcmV0cmFuc21pdCB0aW1lb3V0 cwoJCTAgY29ubmVjdGlvbnMgZHJvcHBlZCBieSByZXhtaXQgdGltZW91dAoJMCBwZXJzaXN0IHRp bWVvdXRzCgkJMCBjb25uZWN0aW9ucyBkcm9wcGVkIGJ5IHBlcnNpc3QgdGltZW91dAoJMCBDb25u ZWN0aW9ucyAoZmluX3dhaXRfMikgZHJvcHBlZCBiZWNhdXNlIG9mIHRpbWVvdXQKCTAga2VlcGFs aXZlIHRpbWVvdXRzCgkJMCBrZWVwYWxpdmUgcHJvYmVzIHNlbnQKCQkwIGNvbm5lY3Rpb25zIGRy b3BwZWQgYnkga2VlcGFsaXZlCgk3OTc3NiBjb3JyZWN0IEFDSyBoZWFkZXIgcHJlZGljdGlvbnMK CTIxNDM0MiBjb3JyZWN0IGRhdGEgcGFja2V0IGhlYWRlciBwcmVkaWN0aW9ucwoJMCBzeW5jYWNo ZSBlbnRyaWVzIGFkZGVkCgkJMCByZXRyYW5zbWl0dGVkCgkJMCBkdXBzeW4KCQkwIGRyb3BwZWQK CQkwIGNvbXBsZXRlZAoJCTAgYnVja2V0IG92ZXJmbG93CgkJMCBjYWNoZSBvdmVyZmxvdwoJCTAg cmVzZXQKCQkwIHN0YWxlCgkJMCBhYm9ydGVkCgkJMCBiYWRhY2sKCQkwIHVucmVhY2gKCQkwIHpv bmUgZmFpbHVyZXMKCTAgY29va2llcyBzZW50CgkwIGNvb2tpZXMgcmVjZWl2ZWQKCTIgaG9zdGNh Y2hlIGVudHJpZXMgYWRkZWQKCQkwIGJ1Y2tldCBvdmVyZmxvdwoJMTA5MCBTQUNLIHJlY292ZXJ5 IGVwaXNvZGVzCgkyNDA5IHNlZ21lbnQgcmV4bWl0cyBpbiBTQUNLIHJlY292ZXJ5IGVwaXNvZGVz CgkzMzA1MDg0IGJ5dGUgcmV4bWl0cyBpbiBTQUNLIHJlY292ZXJ5IGVwaXNvZGVzCgk1OTk1MSBT QUNLIG9wdGlvbnMgKFNBQ0sgYmxvY2tzKSByZWNlaXZlZAoJMzYxMjUwIFNBQ0sgb3B0aW9ucyAo U0FDSyBibG9ja3MpIHNlbnQKCTAgU0FDSyBzY29yZWJvYXJkIG92ZXJmbG93CgkwIHBhY2tldHMg d2l0aCBFQ04gQ0UgYml0IHNldAoJMCBwYWNrZXRzIHdpdGggRUNOIEVDVCgwKSBiaXQgc2V0Cgkw IHBhY2tldHMgd2l0aCBFQ04gRUNUKDEpIGJpdCBzZXQKCTAgc3VjY2Vzc2Z1bCBFQ04gaGFuZHNo YWtlcwoJMCB0aW1lcyBFQ04gcmVkdWNlZCB0aGUgY29uZ2VzdGlvbiB3aW5kb3cKdWRwOgoJMTc0 OTEgZGF0YWdyYW1zIHJlY2VpdmVkCgkwIHdpdGggaW5jb21wbGV0ZSBoZWFkZXIKCTAgd2l0aCBi YWQgZGF0YSBsZW5ndGggZmllbGQKCTggd2l0aCBiYWQgY2hlY2tzdW0KCTAgd2l0aCBubyBjaGVj a3N1bQoJMzIwMSBkcm9wcGVkIGR1ZSB0byBubyBzb2NrZXQKCTExMzU1IGJyb2FkY2FzdC9tdWx0 aWNhc3QgZGF0YWdyYW1zIHVuZGVsaXZlcmVkCgkwIGRyb3BwZWQgZHVlIHRvIGZ1bGwgc29ja2V0 IGJ1ZmZlcnMKCTAgbm90IGZvciBoYXNoZWQgcGNiCgkyOTI3IGRlbGl2ZXJlZAoJMjA0OSBkYXRh Z3JhbXMgb3V0cHV0CgkwIHRpbWVzIG11bHRpY2FzdCBzb3VyY2UgZmlsdGVyIG1hdGNoZWQKaXA6 CgkzMTEyMzQ0IHRvdGFsIHBhY2tldHMgcmVjZWl2ZWQKCTAgYmFkIGhlYWRlciBjaGVja3N1bXMK CTAgd2l0aCBzaXplIHNtYWxsZXIgdGhhbiBtaW5pbXVtCgkwIHdpdGggZGF0YSBzaXplIDwgZGF0 YSBsZW5ndGgKCTAgd2l0aCBpcCBsZW5ndGggPiBtYXggaXAgcGFja2V0IHNpemUKCTAgd2l0aCBo ZWFkZXIgbGVuZ3RoIDwgZGF0YSBzaXplCgkwIHdpdGggZGF0YSBsZW5ndGggPCBoZWFkZXIgbGVu Z3RoCgkwIHdpdGggYmFkIG9wdGlvbnMKCTAgd2l0aCBpbmNvcnJlY3QgdmVyc2lvbiBudW1iZXIK CTk2IGZyYWdtZW50cyByZWNlaXZlZAoJMCBmcmFnbWVudHMgZHJvcHBlZCAoZHVwIG9yIG91dCBv ZiBzcGFjZSkKCTAgZnJhZ21lbnRzIGRyb3BwZWQgYWZ0ZXIgdGltZW91dAoJNDggcGFja2V0cyBy ZWFzc2VtYmxlZCBvawoJMzA5NTQ0NyBwYWNrZXRzIGZvciB0aGlzIGhvc3QKCTE2ODQyIHBhY2tl dHMgZm9yIHVua25vd24vdW5zdXBwb3J0ZWQgcHJvdG9jb2wKCTAgcGFja2V0cyBmb3J3YXJkZWQg KDAgcGFja2V0cyBmYXN0IGZvcndhcmRlZCkKCTcgcGFja2V0cyBub3QgZm9yd2FyZGFibGUKCTAg cGFja2V0cyByZWNlaXZlZCBmb3IgdW5rbm93biBtdWx0aWNhc3QgZ3JvdXAKCTAgcmVkaXJlY3Rz IHNlbnQKCTMzOTk0MjkgcGFja2V0cyBzZW50IGZyb20gdGhpcyBob3N0Cgk2IHBhY2tldHMgc2Vu dCB3aXRoIGZhYnJpY2F0ZWQgaXAgaGVhZGVyCgkwIG91dHB1dCBwYWNrZXRzIGRyb3BwZWQgZHVl IHRvIG5vIGJ1ZnMsIGV0Yy4KCTAgb3V0cHV0IHBhY2tldHMgZGlzY2FyZGVkIGR1ZSB0byBubyBy b3V0ZQoJMCBvdXRwdXQgZGF0YWdyYW1zIGZyYWdtZW50ZWQKCTAgZnJhZ21lbnRzIGNyZWF0ZWQK CTAgZGF0YWdyYW1zIHRoYXQgY2FuJ3QgYmUgZnJhZ21lbnRlZAoJMCB0dW5uZWxpbmcgcGFja2V0 cyB0aGF0IGNhbid0IGZpbmQgZ2lmCgkwIGRhdGFncmFtcyB3aXRoIGJhZCBhZGRyZXNzIGluIGhl YWRlcgppY21wOgoJNyBjYWxscyB0byBpY21wX2Vycm9yCgkwIGVycm9ycyBub3QgZ2VuZXJhdGVk IGluIHJlc3BvbnNlIHRvIGFuIGljbXAgbWVzc2FnZQoJT3V0cHV0IGhpc3RvZ3JhbToKCQllY2hv IHJlcGx5OiAzCgkJZGVzdGluYXRpb24gdW5yZWFjaGFibGU6IDcKCTAgbWVzc2FnZXMgd2l0aCBi YWQgY29kZSBmaWVsZHMKCTAgbWVzc2FnZXMgbGVzcyB0aGFuIHRoZSBtaW5pbXVtIGxlbmd0aAoJ MCBtZXNzYWdlcyB3aXRoIGJhZCBjaGVja3N1bQoJMCBtZXNzYWdlcyB3aXRoIGJhZCBsZW5ndGgK CTAgbXVsdGljYXN0IGVjaG8gcmVxdWVzdHMgaWdub3JlZAoJMCBtdWx0aWNhc3QgdGltZXN0YW1w IHJlcXVlc3RzIGlnbm9yZWQKCUlucHV0IGhpc3RvZ3JhbToKCQlkZXN0aW5hdGlvbiB1bnJlYWNo YWJsZTogMQoJCWVjaG86IDMKCTMgbWVzc2FnZSByZXNwb25zZXMgZ2VuZXJhdGVkCgkwIGludmFs aWQgcmV0dXJuIGFkZHJlc3NlcwoJMCBubyByZXR1cm4gcm91dGVzCmlnbXA6Cgk2NCBtZXNzYWdl cyByZWNlaXZlZAoJMCBtZXNzYWdlcyByZWNlaXZlZCB3aXRoIHRvbyBmZXcgYnl0ZXMKCTAgbWVz c2FnZXMgcmVjZWl2ZWQgd2l0aCB3cm9uZyBUVEwKCTAgbWVzc2FnZXMgcmVjZWl2ZWQgd2l0aCBi YWQgY2hlY2tzdW0KCTAgVjEvVjIgbWVtYmVyc2hpcCBxdWVyaWVzIHJlY2VpdmVkCgkwIFYzIG1l bWJlcnNoaXAgcXVlcmllcyByZWNlaXZlZAoJMCBtZW1iZXJzaGlwIHF1ZXJpZXMgcmVjZWl2ZWQg d2l0aCBpbnZhbGlkIGZpZWxkKHMpCgkwIGdlbmVyYWwgcXVlcmllcyByZWNlaXZlZAoJMCBncm91 cCBxdWVyaWVzIHJlY2VpdmVkCgkwIGdyb3VwLXNvdXJjZSBxdWVyaWVzIHJlY2VpdmVkCgkwIGdy b3VwLXNvdXJjZSBxdWVyaWVzIGRyb3BwZWQKCTE2IG1lbWJlcnNoaXAgcmVwb3J0cyByZWNlaXZl ZAoJMCBtZW1iZXJzaGlwIHJlcG9ydHMgcmVjZWl2ZWQgd2l0aCBpbnZhbGlkIGZpZWxkKHMpCgkw IG1lbWJlcnNoaXAgcmVwb3J0cyByZWNlaXZlZCBmb3IgZ3JvdXBzIHRvIHdoaWNoIHdlIGJlbG9u ZwoJNCBWMyByZXBvcnRzIHJlY2VpdmVkIHdpdGhvdXQgUm91dGVyIEFsZXJ0CgkwIG1lbWJlcnNo aXAgcmVwb3J0cyBzZW50CmFycDoKCTE3IEFSUCByZXF1ZXN0cyBzZW50CgkxNjAgQVJQIHJlcGxp ZXMgc2VudAoJNDQxOCBBUlAgcmVxdWVzdHMgcmVjZWl2ZWQKCTE4IEFSUCByZXBsaWVzIHJlY2Vp dmVkCgk0NDQyIEFSUCBwYWNrZXRzIHJlY2VpdmVkCgkwIHRvdGFsIHBhY2tldHMgZHJvcHBlZCBk dWUgdG8gbm8gQVJQIGVudHJ5Cgk1IEFSUCBlbnRyeXMgdGltZWQgb3V0CgkwIER1cGxpY2F0ZSBJ UHMgc2VlbgppcDY6CgkyNzAyMyB0b3RhbCBwYWNrZXRzIHJlY2VpdmVkCgkwIHdpdGggc2l6ZSBz bWFsbGVyIHRoYW4gbWluaW11bQoJMCB3aXRoIGRhdGEgc2l6ZSA8IGRhdGEgbGVuZ3RoCgkwIHdp dGggYmFkIG9wdGlvbnMKCTAgd2l0aCBpbmNvcnJlY3QgdmVyc2lvbiBudW1iZXIKCTQ4IGZyYWdt ZW50cyByZWNlaXZlZAoJMCBmcmFnbWVudHMgZHJvcHBlZCAoZHVwIG9yIG91dCBvZiBzcGFjZSkK CTAgZnJhZ21lbnRzIGRyb3BwZWQgYWZ0ZXIgdGltZW91dAoJMCBmcmFnbWVudHMgdGhhdCBleGNl ZWRlZCBsaW1pdAoJMjQgcGFja2V0cyByZWFzc2VtYmxlZCBvawoJODA2MyBwYWNrZXRzIGZvciB0 aGlzIGhvc3QKCTAgcGFja2V0cyBmb3J3YXJkZWQKCTAgcGFja2V0cyBub3QgZm9yd2FyZGFibGUK CTAgcmVkaXJlY3RzIHNlbnQKCTM2MyBwYWNrZXRzIHNlbnQgZnJvbSB0aGlzIGhvc3QKCTAgcGFj a2V0cyBzZW50IHdpdGggZmFicmljYXRlZCBpcCBoZWFkZXIKCTAgb3V0cHV0IHBhY2tldHMgZHJv cHBlZCBkdWUgdG8gbm8gYnVmcywgZXRjLgoJMCBvdXRwdXQgcGFja2V0cyBkaXNjYXJkZWQgZHVl IHRvIG5vIHJvdXRlCgkwIG91dHB1dCBkYXRhZ3JhbXMgZnJhZ21lbnRlZAoJMCBmcmFnbWVudHMg Y3JlYXRlZAoJMCBkYXRhZ3JhbXMgdGhhdCBjYW4ndCBiZSBmcmFnbWVudGVkCgkwIHBhY2tldHMg dGhhdCB2aW9sYXRlZCBzY29wZSBydWxlcwoJNDI2NSBtdWx0aWNhc3QgcGFja2V0cyB3aGljaCB3 ZSBkb24ndCBqb2luCglJbnB1dCBoaXN0b2dyYW06CgkJaG9wIGJ5IGhvcDogMzc0NAoJCVVEUDog Mzc0MwoJCWZyYWdtZW50OiA0OAoJCUlDTVA2OiAxNzIwCgkJT1NQRjogMzM4NwoJCVBJTTogOTEz CgkJIzExMjogMTM0NjgKCU1idWYgc3RhdGlzdGljczoKCQkyIG9uZSBtYnVmCgkJMjcwMjEgb25l IGV4dCBtYnVmCgkJMCB0d28gb3IgbW9yZSBleHQgbWJ1ZgoJMCBwYWNrZXRzIHdob3NlIGhlYWRl cnMgYXJlIG5vdCBjb250aWd1b3VzCgkwIHR1bm5lbGluZyBwYWNrZXRzIHRoYXQgY2FuJ3QgZmlu ZCBnaWYKCTAgcGFja2V0cyBkaXNjYXJkZWQgYmVjYXVzZSBvZiB0b28gbWFueSBoZWFkZXJzCgkw IGZhaWx1cmVzIG9mIHNvdXJjZSBhZGRyZXNzIHNlbGVjdGlvbgoJc291cmNlIGFkZHJlc3NlcyBv biBhbiBvdXRnb2luZyBJL0YKCQk4IGxpbmstbG9jYWxzCgkJMzIgZ2xvYmFscwoJc291cmNlIGFk ZHJlc3NlcyBvZiBzYW1lIHNjb3BlCgkJNiBsaW5rLWxvY2FscwoJCTMyIGdsb2JhbHMKCXNvdXJj ZSBhZGRyZXNzZXMgb2YgYSBkaWZmZXJlbnQgc2NvcGUKCQkyIGxpbmstbG9jYWxzCglTb3VyY2Ug YWRkcmVzc2VzIHNlbGVjdGlvbiBydWxlIGFwcGxpZWQ6CgkJNDAgZmlyc3QgY2FuZGlkYXRlCgkJ MzIgYXBwcm9wcmlhdGUgc2NvcGUKaWNtcDY6CgkxNzc2OCBjYWxscyB0byBpY21wNl9lcnJvcgoJ MCBlcnJvcnMgbm90IGdlbmVyYXRlZCBpbiByZXNwb25zZSB0byBhbiBpY21wNiBtZXNzYWdlCgkw IGVycm9ycyBub3QgZ2VuZXJhdGVkIGJlY2F1c2Ugb2YgcmF0ZSBsaW1pdGF0aW9uCglPdXRwdXQg aGlzdG9ncmFtOgoJCU1MRHYxIGxpc3RlbmVyIHJlcG9ydDogMzI0CgkJcm91dGVyIHNvbGljaXRh dGlvbjogMgoJCW5laWdoYm9yIHNvbGljaXRhdGlvbjogOAoJCW5laWdoYm9yIGFkdmVydGlzZW1l bnQ6IDQKCQlNTER2MiBsaXN0ZW5lciByZXBvcnQ6IDkKCTAgbWVzc2FnZXMgd2l0aCBiYWQgY29k ZSBmaWVsZHMKCTAgbWVzc2FnZXMgPCBtaW5pbXVtIGxlbmd0aAoJMCBiYWQgY2hlY2tzdW1zCgkw IG1lc3NhZ2VzIHdpdGggYmFkIGxlbmd0aAoJSW5wdXQgaGlzdG9ncmFtOgoJCW11bHRpY2FzdCBs aXN0ZW5lciBxdWVyeTogMTA4CgkJcm91dGVyIGFkdmVydGlzZW1lbnQ6IDEwNjkKCQluZWlnaGJv ciBzb2xpY2l0YXRpb246IDQKCQluZWlnaGJvciBhZHZlcnRpc2VtZW50OiAxNAoJCXJlZGlyZWN0 OiA0CglIaXN0b2dyYW0gb2YgZXJyb3IgbWVzc2FnZXMgdG8gYmUgZ2VuZXJhdGVkOgoJCTAgbm8g cm91dGUKCQkwIGFkbWluaXN0cmF0aXZlbHkgcHJvaGliaXRlZAoJCTAgYmV5b25kIHNjb3BlCgkJ MCBhZGRyZXNzIHVucmVhY2hhYmxlCgkJMCBwb3J0IHVucmVhY2hhYmxlCgkJMCBwYWNrZXQgdG9v IGJpZwoJCTAgdGltZSBleGNlZWQgdHJhbnNpdAoJCTAgdGltZSBleGNlZWQgcmVhc3NlbWJseQoJ CTAgZXJyb25lb3VzIGhlYWRlciBmaWVsZAoJCTE3NzY4IHVucmVjb2duaXplZCBuZXh0IGhlYWRl cgoJCTAgdW5yZWNvZ25pemVkIG9wdGlvbgoJCTAgcmVkaXJlY3QKCQkwIHVua25vd24KCTAgbWVz c2FnZSByZXNwb25zZXMgZ2VuZXJhdGVkCgkwIG1lc3NhZ2VzIHdpdGggdG9vIG1hbnkgTkQgb3B0 aW9ucwoJMCBtZXNzYWdlcyB3aXRoIGJhZCBORCBvcHRpb25zCgkwIGJhZCBuZWlnaGJvciBzb2xp Y2l0YXRpb24gbWVzc2FnZXMKCTAgYmFkIG5laWdoYm9yIGFkdmVydGlzZW1lbnQgbWVzc2FnZXMK CTAgYmFkIHJvdXRlciBzb2xpY2l0YXRpb24gbWVzc2FnZXMKCTAgYmFkIHJvdXRlciBhZHZlcnRp c2VtZW50IG1lc3NhZ2VzCgkwIGJhZCByZWRpcmVjdCBtZXNzYWdlcwoJMCBwYXRoIE1UVSBjaGFu Z2VzCnJpcDY6CgkxNzc2OCBtZXNzYWdlcyByZWNlaXZlZAoJMCBjaGVja3N1bSBjYWxjdWxhdGlv bnMgb24gaW5ib3VuZAoJMCBtZXNzYWdlcyB3aXRoIGJhZCBjaGVja3N1bQoJMTc3NjggbWVzc2Fn ZXMgZHJvcHBlZCBkdWUgdG8gbm8gc29ja2V0CgkxNzc2OCBtdWx0aWNhc3QgbWVzc2FnZXMgZHJv cHBlZCBkdWUgdG8gbm8gc29ja2V0CgkwIG1lc3NhZ2VzIGRyb3BwZWQgZHVlIHRvIGZ1bGwgc29j a2V0IGJ1ZmZlcnMKCTE4NDQ2NzQ0MDczNzA5NTMzODQ4IGRlbGl2ZXJlZAoJMCBkYXRhZ3JhbXMg b3V0cHV0CgotLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0KbmV0c3RhdCAtbQoKbmV0c3RhdDogaW52YWxpZCBhZGRy ZXNzICgweDApCjE5NS8yNDMwLzI2MjUgbWJ1ZnMgaW4gdXNlIChjdXJyZW50L2NhY2hlL3RvdGFs KQowLzEyMDYvMTIwNi82MjEzMiBtYnVmIGNsdXN0ZXJzIGluIHVzZSAoY3VycmVudC9jYWNoZS90 b3RhbC9tYXgpCjAvNTAwIG1idWYrY2x1c3RlcnMgb3V0IG9mIHBhY2tldCBzZWNvbmRhcnkgem9u ZSBpbiB1c2UgKGN1cnJlbnQvY2FjaGUpCjE5My8yODUvNDc4LzMxMDY1IDRrIChwYWdlIHNpemUp IGp1bWJvIGNsdXN0ZXJzIGluIHVzZSAoY3VycmVudC9jYWNoZS90b3RhbC9tYXgpCjAvMC8wLzI3 NjEyIDlrIGp1bWJvIGNsdXN0ZXJzIGluIHVzZSAoY3VycmVudC9jYWNoZS90b3RhbC9tYXgpCjAv MC8wLzIwNzA4IDE2ayBqdW1ibyBjbHVzdGVycyBpbiB1c2UgKGN1cnJlbnQvY2FjaGUvdG90YWwv bWF4KQo4MjBLLzQxNTlLLzQ5ODBLIGJ5dGVzIGFsbG9jYXRlZCB0byBuZXR3b3JrIChjdXJyZW50 L2NhY2hlL3RvdGFsKQowLzAvMCByZXF1ZXN0cyBmb3IgbWJ1ZnMgZGVuaWVkIChtYnVmcy9jbHVz dGVycy9tYnVmK2NsdXN0ZXJzKQowLzAvMCByZXF1ZXN0cyBmb3IgbWJ1ZnMgZGVsYXllZCAobWJ1 ZnMvY2x1c3RlcnMvbWJ1ZitjbHVzdGVycykKMC8wLzAgcmVxdWVzdHMgZm9yIGp1bWJvIGNsdXN0 ZXJzIGRlbGF5ZWQgKDRrLzlrLzE2aykKMC8wLzAgcmVxdWVzdHMgZm9yIGp1bWJvIGNsdXN0ZXJz IGRlbmllZCAoNGsvOWsvMTZrKQoKLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tCm5ldHN0YXQgLWFucgoKUm91dGlu ZyB0YWJsZXMKCkludGVybmV0OgpEZXN0aW5hdGlvbiAgICAgICAgR2F0ZXdheSAgICAgICAgICAg IEZsYWdzICAgIE5ldGlmIEV4cGlyZQpkZWZhdWx0ICAgICAgICAgICAgMTcyLjMxLjEuMjUzICAg ICAgIFVHUyAgICAgICB4bjAKMTI3LjAuMC4xICAgICAgICAgIGxpbmsjMSAgICAgICAgICAgICBV SCAgICAgICAgbG8wCjE3Mi4zMS4xLjAvMjQgICAgICBsaW5rIzIgICAgICAgICAgICAgVSAgICAg ICAgIHhuMAoxNzIuMzEuMS4xODMgICAgICAgbGluayMyICAgICAgICAgICAgIFVIUyAgICAgICBs bzAKMTcyLjMxLjIuMC8yNCAgICAgIGxpbmsjMyAgICAgICAgICAgICBVICAgICAgICAgeG4xCjE3 Mi4zMS4yLjE2NSAgICAgICBsaW5rIzMgICAgICAgICAgICAgVUhTICAgICAgIGxvMAoxNzIuMzEu My4wLzI0ICAgICAgbGluayM0ICAgICAgICAgICAgIFUgICAgICAgICB4bjIKMTcyLjMxLjMuMTg5 ICAgICAgIGxpbmsjNCAgICAgICAgICAgICBVSFMgICAgICAgbG8wCgpJbnRlcm5ldDY6CkRlc3Rp bmF0aW9uICAgICAgICAgICAgICAgICAgICAgICBHYXRld2F5ICAgICAgICAgICAgICAgICAgICAg ICBGbGFncyAgICAgIE5ldGlmIEV4cGlyZQo6Oi85NiAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgOjoxICAgICAgICAgICAgICAgICAgICAgICAgICAgVUdSUyAgICAgICAgbG8wID0+CmRlZmF1 bHQgICAgICAgICAgICAgICAgICAgICAgICAgICBmZTgwOjoxNGI4OmI5ZmY6ZmVjMzo1OGU4JXhu MiBVRyAgICAgICAgICB4bjIKOjoxICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGxpbmsj MSAgICAgICAgICAgICAgICAgICAgICAgIFVIICAgICAgICAgIGxvMAo6OmZmZmY6MC4wLjAuMC85 NiAgICAgICAgICAgICAgICAgOjoxICAgICAgICAgICAgICAgICAgICAgICAgICAgVUdSUyAgICAg ICAgbG8wCjIwMDE6MjAwOjA6ODgwNzo6MWQgICAgICAgICAgICAgICBmZTgwOjozODU1OjNiZmY6 ZmU0NDpkZDY2JXhuMCBVR0hEICAgICAgICB4bjAKMjAwMTo0MTg6M2ZmOjo1MyAgICAgICAgICAg ICAgICAgIGZlODA6OjM4NTU6M2JmZjpmZTQ0OmRkNjYleG4wIFVHSEQgICAgICAgIHhuMAoyMDAx OjQxODozZmY6OjE6NTMgICAgICAgICAgICAgICAgZmU4MDo6Mzg1NTozYmZmOmZlNDQ6ZGQ2NiV4 bjAgVUdIRCAgICAgICAgeG4wCjIwMDE6NDcwOmZjNDc6MTAwMTo6LzY0ICAgICAgICAgICBsaW5r IzIgICAgICAgICAgICAgICAgICAgICAgICBVICAgICAgICAgICB4bjAKMjAwMTo0NzA6ZmM0Nzox MDAxOjE4OWQ6NDdmZjpmZTZkOjc5ZTIgbGluayMyICAgICAgICAgICAgICAgICAgICAgICAgVUhT ICAgICAgICAgbG8wCjIwMDE6NDcwOmZjNDc6MTAwMjo6LzY0ICAgICAgICAgICBsaW5rIzMgICAg ICAgICAgICAgICAgICAgICAgICBVICAgICAgICAgICB4bjEKMjAwMTo0NzA6ZmM0NzoxMDAyOjY4 M2E6M2ZmOmZlM2Q6NmNlMyBsaW5rIzMgICAgICAgICAgICAgICAgICAgICAgICBVSFMgICAgICAg ICBsbzAKMjAwMTo0NzA6ZmM0NzoxMDAzOjovNjQgICAgICAgICAgIGxpbmsjNCAgICAgICAgICAg ICAgICAgICAgICAgIFUgICAgICAgICAgIHhuMgoyMDAxOjQ3MDpmYzQ3OjEwMDM6NmM2ZTpmM2Zm OmZlNDQ6YmZhZSBsaW5rIzQgICAgICAgICAgICAgICAgICAgICAgICBVSFMgICAgICAgICBsbzAK MjQwMDo4NTAwOjEzMDE6MTA1MjoxNTc6NzoxNTQ6MTM0IGZlODA6OjM4NTU6M2JmZjpmZTQ0OmRk NjYleG4wIFVHSEQgICAgICAgIHhuMApmZTgwOjovMTAgICAgICAgICAgICAgICAgICAgICAgICAg OjoxICAgICAgICAgICAgICAgICAgICAgICAgICAgVUdSUyAgICAgICAgbG8wCmZlODA6OiVsbzAv NjQgICAgICAgICAgICAgICAgICAgICBsaW5rIzEgICAgICAgICAgICAgICAgICAgICAgICBVICAg ICAgICAgICBsbzAKZmU4MDo6MSVsbzAgICAgICAgICAgICAgICAgICAgICAgIGxpbmsjMSAgICAg ICAgICAgICAgICAgICAgICAgIFVIUyAgICAgICAgIGxvMApmZTgwOjoleG4wLzY0ICAgICAgICAg ICAgICAgICAgICAgbGluayMyICAgICAgICAgICAgICAgICAgICAgICAgVSAgICAgICAgICAgeG4w CmZlODA6OjE4OWQ6NDdmZjpmZTZkOjc5ZTIleG4wICAgICBsaW5rIzIgICAgICAgICAgICAgICAg ICAgICAgICBVSFMgICAgICAgICBsbzAKZmU4MDo6JXhuMS82NCAgICAgICAgICAgICAgICAgICAg IGxpbmsjMyAgICAgICAgICAgICAgICAgICAgICAgIFUgICAgICAgICAgIHhuMQpmZTgwOjo2ODNh OjNmZjpmZTNkOjZjZTMleG4xICAgICAgbGluayMzICAgICAgICAgICAgICAgICAgICAgICAgVUhT ICAgICAgICAgbG8wCmZlODA6OiV4bjIvNjQgICAgICAgICAgICAgICAgICAgICBsaW5rIzQgICAg ICAgICAgICAgICAgICAgICAgICBVICAgICAgICAgICB4bjIKZmU4MDo6NmM2ZTpmM2ZmOmZlNDQ6 YmZhZSV4bjIgICAgIGxpbmsjNCAgICAgICAgICAgICAgICAgICAgICAgIFVIUyAgICAgICAgIGxv MApmZjAxOjolbG8wLzMyICAgICAgICAgICAgICAgICAgICAgOjoxICAgICAgICAgICAgICAgICAg ICAgICAgICAgVSAgICAgICAgICAgbG8wCmZmMDE6OiV4bjAvMzIgICAgICAgICAgICAgICAgICAg ICBmZTgwOjoxODlkOjQ3ZmY6ZmU2ZDo3OWUyJXhuMCBVICAgICAgICAgICB4bjAKZmYwMTo6JXhu MS8zMiAgICAgICAgICAgICAgICAgICAgIGZlODA6OjY4M2E6M2ZmOmZlM2Q6NmNlMyV4bjEgIFUg ICAgICAgICAgIHhuMQpmZjAxOjoleG4yLzMyICAgICAgICAgICAgICAgICAgICAgZmU4MDo6NmM2 ZTpmM2ZmOmZlNDQ6YmZhZSV4bjIgVSAgICAgICAgICAgeG4yCmZmMDI6Oi8xNiAgICAgICAgICAg ICAgICAgICAgICAgICA6OjEgICAgICAgICAgICAgICAgICAgICAgICAgICBVR1JTICAgICAgICBs bzAKZmYwMjo6JWxvMC8zMiAgICAgICAgICAgICAgICAgICAgIDo6MSAgICAgICAgICAgICAgICAg ICAgICAgICAgIFUgICAgICAgICAgIGxvMApmZjAyOjoleG4wLzMyICAgICAgICAgICAgICAgICAg ICAgZmU4MDo6MTg5ZDo0N2ZmOmZlNmQ6NzllMiV4bjAgVSAgICAgICAgICAgeG4wCmZmMDI6OiV4 bjEvMzIgICAgICAgICAgICAgICAgICAgICBmZTgwOjo2ODNhOjNmZjpmZTNkOjZjZTMleG4xICBV ICAgICAgICAgICB4bjEKZmYwMjo6JXhuMi8zMiAgICAgICAgICAgICAgICAgICAgIGZlODA6OjZj NmU6ZjNmZjpmZTQ0OmJmYWUleG4yIFUgICAgICAgICAgIHhuMgoKLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tCm5l dHN0YXQgLWFuQQoKQWN0aXZlIEludGVybmV0IGNvbm5lY3Rpb25zIChpbmNsdWRpbmcgc2VydmVy cykKVGNwY2IgICAgICAgICAgICBQcm90byBSZWN2LVEgU2VuZC1RIExvY2FsIEFkZHJlc3MgICAg ICBGb3JlaWduIEFkZHJlc3MgICAgKHN0YXRlKQpmZmZmZjgwMDAyYzc0NDAwIHRjcDQgICAgICAg MCAgICAgIDAgMTcyLjMxLjEuMTgzLjc2MiAgIDE3Mi4zMS4xLjI2LjIwNDkgICBDTE9TRV9XQUlU CmZmZmZmODAwMDJjODk0MDAgdGNwNCAgICAgICAwICAgICAgMCAxNzIuMzEuMS4xODMuMTAwNSAg MTcyLjMxLjEuMjYuMjA0OSAgIEVTVEFCTElTSEVECmZmZmZmODAwMDJjOGFjMDAgdGNwNCAgICAg ICAwICAgICAgMCAxNzIuMzEuMS4xODMuODA2ICAgMTcyLjMxLjEuMjYuMjA0OSAgIEVTVEFCTElT SEVECmZmZmZmODAwMDJjNjA4MDAgdGNwNCAgICAgICAwICAgICAgMCAxMjcuMC4wLjEuMjUgICAg ICAgKi4qICAgICAgICAgICAgICAgIExJU1RFTgpmZmZmZjgwMDAyYzYwYzAwIHRjcDQgICAgICAg MCAgICAgIDAgKi4yMiAgICAgICAgICAgICAgICouKiAgICAgICAgICAgICAgICBMSVNURU4KZmZm ZmY4MDAwMmM2MTAwMCB0Y3A2ICAgICAgIDAgICAgICAwICouMjIgICAgICAgICAgICAgICAqLiog ICAgICAgICAgICAgICAgTElTVEVOCmZmZmZmODAwMDJjOGE4MDAgdGNwNCAgICAgICAwICAgICAg MCAxNzIuMzEuMS4xODMuNzM0ICAgMTcyLjMxLjEuMjYuMjA0OSAgIENMT1NFX1dBSVQKZmZmZmY4 MDAwMmFlNjMxMCB1ZHA0ICAgICAgIDAgICAgICAwICouMTYxICAgICAgICAgICAgICAqLiogICAg ICAgICAgICAgICAgCmZmZmZmODAwMDJhZTY0OTggdWRwNCAgICAgICAwICAgICAgMCAqLiogICAg ICAgICAgICAgICAgKi4qICAgICAgICAgICAgICAgIApmZmZmZjgwMDAyYWZkZGM4IHVkcDQgICAg ICAgMCAgICAgIDAgMTI3LjAuMC4xLjYzMjMzICAgIDEyNy4wLjAuMS4xNjIgICAgICAKZmZmZmY4 MDAwMmFmZTE4OCB1ZHA0ICAgICAgIDAgICAgICAwIDE3Mi4zMS4zLjE4OS4xMjMgICAqLiogICAg ICAgICAgICAgICAgCmZmZmZmODAwMDJhZmUzMTAgdWRwNiAgICAgICAwICAgICAgMCAyMDAxOjQ3 MDpmYzQ3OjEwLjEgKi4qICAgICAgICAgICAgICAgIApmZmZmZjgwMDAyYWZlNDk4IHVkcDYgICAg ICAgMCAgICAgIDAgZmU4MDo6NmM2ZTpmM2ZmOi4xICouKiAgICAgICAgICAgICAgICAKZmZmZmY4 MDAwMmFmZTYyMCB1ZHA0ICAgICAgIDAgICAgICAwIDE3Mi4zMS4yLjE2NS4xMjMgICAqLiogICAg ICAgICAgICAgICAgCmZmZmZmODAwMDJhZmU3YTggdWRwNiAgICAgICAwICAgICAgMCAyMDAxOjQ3 MDpmYzQ3OjEwLjEgKi4qICAgICAgICAgICAgICAgIApmZmZmZjgwMDAyYWZlOTMwIHVkcDYgICAg ICAgMCAgICAgIDAgZmU4MDo6NjgzYTozZmY6Zi4xICouKiAgICAgICAgICAgICAgICAKZmZmZmY4 MDAwMmFmZWFiOCB1ZHA0ICAgICAgIDAgICAgICAwIDE3Mi4zMS4xLjE4My4xMjMgICAqLiogICAg ICAgICAgICAgICAgCmZmZmZmODAwMDJhZmVjNDAgdWRwNiAgICAgICAwICAgICAgMCAyMDAxOjQ3 MDpmYzQ3OjEwLjEgKi4qICAgICAgICAgICAgICAgIApmZmZmZjgwMDAyYWZlZGM4IHVkcDYgICAg ICAgMCAgICAgIDAgZmU4MDo6MTg5ZDo0N2ZmOi4xICouKiAgICAgICAgICAgICAgICAKZmZmZmY4 MDAwMmFmZjAwMCB1ZHA0ICAgICAgIDAgICAgICAwIDEyNy4wLjAuMS4xMjMgICAgICAqLiogICAg ICAgICAgICAgICAgCmZmZmZmODAwMDJhZmYxODggdWRwNiAgICAgICAwICAgICAgMCBmZTgwOjox JWxvMC4xMjMgICAgKi4qICAgICAgICAgICAgICAgIApmZmZmZjgwMDAyYWZmMzEwIHVkcDYgICAg ICAgMCAgICAgIDAgOjoxLjEyMyAgICAgICAgICAgICouKiAgICAgICAgICAgICAgICAKZmZmZmY4 MDAwMmFmZjQ5OCB1ZHA2ICAgICAgIDAgICAgICAwICouMTIzICAgICAgICAgICAgICAqLiogICAg ICAgICAgICAgICAgCmZmZmZmODAwMDJhZmY2MjAgdWRwNCAgICAgICAwICAgICAgMCAqLjEyMyAg ICAgICAgICAgICAgKi4qICAgICAgICAgICAgICAgIApmZmZmZjgwMDAyYTYxOTMwIHVkcDQgICAg ICAgMCAgICAgIDAgKi41MTQgICAgICAgICAgICAgICouKiAgICAgICAgICAgICAgICAKZmZmZmY4 MDAwMmE2MWFiOCB1ZHA2ICAgICAgIDAgICAgICAwICouNTE0ICAgICAgICAgICAgICAqLiogICAg ICAgICAgICAgICAgCkFjdGl2ZSBVTklYIGRvbWFpbiBzb2NrZXRzCkFkZHJlc3MgIFR5cGUgICBS ZWN2LVEgU2VuZC1RICAgIElub2RlICAgICBDb25uICAgICBSZWZzICBOZXh0cmVmIEFkZHIKZmZm ZmY4MDAwMmU1MjBmMCBzdHJlYW0gICAgICAwICAgICAgMCBmZmZmZjgwMDAyZTk5MWQ4ICAgICAg ICAwICAgICAgICAwICAgICAgICAwIC92YXIvcnVuL3NubXBkLnNvY2sKZmZmZmY4MDAwMmFkMzc4 MCBzdHJlYW0gICAgICAwICAgICAgMCAgICAgICAgMCBmZmZmZjgwMDAyYWQzODcwICAgICAgICAw ICAgICAgICAwIC92YXIvcnVuL2RldmQucGlwZQpmZmZmZjgwMDAyYWQzODcwIHN0cmVhbSAgICAg IDAgICAgICAwICAgICAgICAwIGZmZmZmODAwMDJhZDM3ODAgICAgICAgIDAgICAgICAgIDAKZmZm ZmY4MDAwMmIzN2E1MCBzdHJlYW0gICAgICAwICAgICAgMCBmZmZmZjgwMDAyYTFlMDAwICAgICAg ICAwICAgICAgICAwICAgICAgICAwIC92YXIvcnVuL2RldmQucGlwZQpmZmZmZjgwMDAyYjM3Nzgw IGRncmFtICAgICAgIDAgICAgICAwICAgICAgICAwIGZmZmZmODAwMDJiMzc4NzAgICAgICAgIDAg ZmZmZmY4MDAwMmIwZjVhMApmZmZmZjgwMDAyYjBmNWEwIGRncmFtICAgICAgIDAgICAgICAwICAg ICAgICAwIGZmZmZmODAwMDJiMzc4NzAgICAgICAgIDAgZmZmZmY4MDAwMmU1MjJkMApmZmZmZjgw MDAyZTUyMWUwIGRncmFtICAgICAgIDAgICAgICAwICAgICAgICAwIGZmZmZmODAwMDJiMzc5NjAg ICAgICAgIDAgICAgICAgIDAKZmZmZmY4MDAwMmU1MjJkMCBkZ3JhbSAgICAgICAwICAgICAgMCAg ICAgICAgMCBmZmZmZjgwMDAyYjM3ODcwICAgICAgICAwIGZmZmZmODAwMDJiMzdiNDAKZmZmZmY4 MDAwMmIzN2I0MCBkZ3JhbSAgICAgICAwICAgICAgMCAgICAgICAgMCBmZmZmZjgwMDAyYjM3ODcw ICAgICAgICAwICAgICAgICAwCmZmZmZmODAwMDJiMzc4NzAgZGdyYW0gICAgICAgMCAgICAgIDAg ZmZmZmY4MDAwMmJhYTc2MCAgICAgICAgMCBmZmZmZjgwMDAyYjM3NzgwICAgICAgICAwIC92YXIv cnVuL2xvZ3ByaXYKZmZmZmY4MDAwMmIzNzk2MCBkZ3JhbSAgICAgICAwICAgICAgMCBmZmZmZjgw MDAyYmFhOTM4ICAgICAgICAwIGZmZmZmODAwMDJlNTIxZTAgICAgICAgIDAgL3Zhci9ydW4vbG9n CgotLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0KbmV0c3RhdCAtYUwKCkN1cnJlbnQgbGlzdGVuIHF1ZXVlIHNpemVz IChxbGVuL2luY3FsZW4vbWF4cWxlbikKUHJvdG8gTGlzdGVuICAgICAgICAgTG9jYWwgQWRkcmVz cyAgICAgICAgIAp0Y3A0ICAwLzAvMTAgICAgICAgICBsb2NhbGhvc3Quc210cCAgICAgICAgIAp0 Y3A0ICAwLzAvMTI4ICAgICAgICAqLnNzaCAgICAgICAgICAgICAgICAgIAp0Y3A2ICAwLzAvMTI4 ICAgICAgICAqLnNzaCAgICAgICAgICAgICAgICAgIAp1bml4ICAwLzAvMTAgICAgICAgICAvdmFy L3J1bi9zbm1wZC5zb2NrCnVuaXggIDAvMC80ICAgICAgICAgIC92YXIvcnVuL2RldmQucGlwZQoK LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tCmZzdGF0Cgpmc3RhdDogY2FuJ3QgcmVhZCBmaWxlIDEgYXQgMHgyMDAw MDdmZmZmZmZmZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmlsZSAyIGF0IDB4NDAwMDAwMDAwMWZmZmZm CmZzdGF0OiBjYW4ndCByZWFkIGZpbGUgNCBhdCAweDc4MDAwMGZmZmYKZnN0YXQ6IGNhbid0IHJl YWQgZmlsZSA3IGF0IDB4MjAwMDA3ZmZmZmZmZmZmCmZzdGF0OiBjYW4ndCByZWFkIGZpbGUgOCBh dCAweDQwMDAwMDAwMDFmZmZmZgpmc3RhdDogY2FuJ3QgcmVhZCBmaWxlIDEwIGF0IDB4NzgwMDAw ZmZmZgpmc3RhdDogY2FuJ3QgcmVhZCBmaWxlIDEzIGF0IDB4MjAwMDA3ZmZmZmZmZmZmCmZzdGF0 OiBjYW4ndCByZWFkIGZpbGUgMTQgYXQgMHg0MDAwMDAwMDAxZmZmZmYKZnN0YXQ6IGNhbid0IHJl YWQgZmlsZSAxNiBhdCAweDc4MDAwMGZmZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmlsZSAxIGF0IDB4 MjAwMDA3ZmZmZmZmZmZmCmZzdGF0OiBjYW4ndCByZWFkIGZpbGUgMiBhdCAweDQwMDAwMDAwMDFm ZmZmZgpmc3RhdDogY2FuJ3QgcmVhZCBmaWxlIDQgYXQgMHg3ODAwMDBmZmZmCmZzdGF0OiBjYW4n dCByZWFkIGZpbGUgNyBhdCAweDIwMDAwN2ZmZmZmZmZmZgpmc3RhdDogY2FuJ3QgcmVhZCBmaWxl IDggYXQgMHg0MDAwMDAwMDAxZmZmZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmlsZSAxMCBhdCAweDc4 MDAwMGZmZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmlsZSAxMyBhdCAweDIwMDAwN2ZmZmZmZmZmZgpm c3RhdDogY2FuJ3QgcmVhZCBmaWxlIDE0IGF0IDB4NDAwMDAwMDAwMWZmZmZmCmZzdGF0OiBjYW4n dCByZWFkIGZpbGUgMTYgYXQgMHg3ODAwMDBmZmZmCmZzdGF0OiBjYW4ndCByZWFkIGZpbGUgMSBh dCAweDIwMDAwN2ZmZmZmZmZmZgpmc3RhdDogY2FuJ3QgcmVhZCBmaWxlIDIgYXQgMHg0MDAwMDAw MDAxZmZmZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmlsZSAxIGF0IDB4MjAwMDA3ZmZmZmZmZmZmCmZz dGF0OiBjYW4ndCByZWFkIGZpbGUgMiBhdCAweDQwMDAwMDAwMDFmZmZmZgpmc3RhdDogY2FuJ3Qg cmVhZCBmaWxlIDQgYXQgMHg3ODAwMDBmZmZmCmZzdGF0OiBjYW4ndCByZWFkIGZpbGUgNyBhdCAw eDIwMDAwN2ZmZmZmZmZmZgpmc3RhdDogY2FuJ3QgcmVhZCBmaWxlIDggYXQgMHg0MDAwMDAwMDAx ZmZmZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmlsZSAxMCBhdCAweDc4MDAwMGZmZmYKZnN0YXQ6IGNh bid0IHJlYWQgZmlsZSAxMyBhdCAweDIwMDAwN2ZmZmZmZmZmZgpmc3RhdDogY2FuJ3QgcmVhZCBm aWxlIDE0IGF0IDB4NDAwMDAwMDAwMWZmZmZmCmZzdGF0OiBjYW4ndCByZWFkIGZpbGUgMTYgYXQg MHg3ODAwMDBmZmZmCmZzdGF0OiBjYW4ndCByZWFkIGZpbGUgMSBhdCAweDIwMDAwN2ZmZmZmZmZm Zgpmc3RhdDogY2FuJ3QgcmVhZCBmaWxlIDIgYXQgMHg0MDAwMDAwMDAxZmZmZmYKZnN0YXQ6IGNh bid0IHJlYWQgZmlsZSA0IGF0IDB4NzgwMDAwZmZmZgpmc3RhdDogY2FuJ3QgcmVhZCBmaWxlIDcg YXQgMHgyMDAwMDdmZmZmZmZmZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmlsZSA4IGF0IDB4NDAwMDAw MDAwMWZmZmZmCmZzdGF0OiBjYW4ndCByZWFkIGZpbGUgMTAgYXQgMHg3ODAwMDBmZmZmCmZzdGF0 OiBjYW4ndCByZWFkIGZpbGUgMTMgYXQgMHgyMDAwMDdmZmZmZmZmZmYKZnN0YXQ6IGNhbid0IHJl YWQgZmlsZSAxNCBhdCAweDQwMDAwMDAwMDFmZmZmZgpmc3RhdDogY2FuJ3QgcmVhZCBmaWxlIDE2 IGF0IDB4NzgwMDAwZmZmZgpmc3RhdDogY2FuJ3QgcmVhZCBmaWxlIDEgYXQgMHgyMDAwMDdmZmZm ZmZmZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmlsZSAyIGF0IDB4NDAwMDAwMDAwMWZmZmZmCmZzdGF0 OiBjYW4ndCByZWFkIGZpbGUgNCBhdCAweDc4MDAwMGZmZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmls ZSA3IGF0IDB4MjAwMDA3ZmZmZmZmZmZmCmZzdGF0OiBjYW4ndCByZWFkIGZpbGUgOCBhdCAweDQw MDAwMDAwMDFmZmZmZgpmc3RhdDogY2FuJ3QgcmVhZCBmaWxlIDEwIGF0IDB4NzgwMDAwZmZmZgpm c3RhdDogY2FuJ3QgcmVhZCBmaWxlIDEzIGF0IDB4MjAwMDA3ZmZmZmZmZmZmCmZzdGF0OiBjYW4n dCByZWFkIGZpbGUgMTQgYXQgMHg0MDAwMDAwMDAxZmZmZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmls ZSAxNiBhdCAweDc4MDAwMGZmZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmlsZSAxIGF0IDB4MjAwMDA3 ZmZmZmZmZmZmCmZzdGF0OiBjYW4ndCByZWFkIGZpbGUgMiBhdCAweDQwMDAwMDAwMDFmZmZmZgpm c3RhdDogY2FuJ3QgcmVhZCBmaWxlIDEgYXQgMHgyMDAwMDdmZmZmZmZmZmYKZnN0YXQ6IGNhbid0 IHJlYWQgZmlsZSAyIGF0IDB4NDAwMDAwMDAwMWZmZmZmCmZzdGF0OiBjYW4ndCByZWFkIGZpbGUg NCBhdCAweDc4MDAwMGZmZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmlsZSA3IGF0IDB4MjAwMDA3ZmZm ZmZmZmZmCmZzdGF0OiBjYW4ndCByZWFkIGZpbGUgOCBhdCAweDQwMDAwMDAwMDFmZmZmZgpmc3Rh dDogY2FuJ3QgcmVhZCBmaWxlIDEwIGF0IDB4NzgwMDAwZmZmZgpmc3RhdDogY2FuJ3QgcmVhZCBm aWxlIDEzIGF0IDB4MjAwMDA3ZmZmZmZmZmZmCmZzdGF0OiBjYW4ndCByZWFkIGZpbGUgMTQgYXQg MHg0MDAwMDAwMDAxZmZmZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmlsZSAxNiBhdCAweDc4MDAwMGZm ZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmlsZSAxIGF0IDB4MjAwMDA3ZmZmZmZmZmZmCmZzdGF0OiBj YW4ndCByZWFkIGZpbGUgMiBhdCAweDQwMDAwMDAwMDFmZmZmZgpmc3RhdDogY2FuJ3QgcmVhZCBm aWxlIDQgYXQgMHg3ODAwMDBmZmZmCmZzdGF0OiBjYW4ndCByZWFkIGZpbGUgNyBhdCAweDIwMDAw N2ZmZmZmZmZmZgpmc3RhdDogY2FuJ3QgcmVhZCBmaWxlIDggYXQgMHg0MDAwMDAwMDAxZmZmZmYK ZnN0YXQ6IGNhbid0IHJlYWQgZmlsZSAxMCBhdCAweDc4MDAwMGZmZmYKZnN0YXQ6IGNhbid0IHJl YWQgZmlsZSAxMyBhdCAweDIwMDAwN2ZmZmZmZmZmZgpmc3RhdDogY2FuJ3QgcmVhZCBmaWxlIDE0 IGF0IDB4NDAwMDAwMDAwMWZmZmZmCmZzdGF0OiBjYW4ndCByZWFkIGZpbGUgMTYgYXQgMHg3ODAw MDBmZmZmCmZzdGF0OiBjYW4ndCByZWFkIGZpbGUgMSBhdCAweDIwMDAwN2ZmZmZmZmZmZgpmc3Rh dDogY2FuJ3QgcmVhZCBmaWxlIDIgYXQgMHg0MDAwMDAwMDAxZmZmZmYKZnN0YXQ6IGNhbid0IHJl YWQgZmlsZSA0IGF0IDB4NzgwMDAwZmZmZgpmc3RhdDogY2FuJ3QgcmVhZCBmaWxlIDcgYXQgMHgy MDAwMDdmZmZmZmZmZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmlsZSA4IGF0IDB4NDAwMDAwMDAwMWZm ZmZmCmZzdGF0OiBjYW4ndCByZWFkIGZpbGUgMTAgYXQgMHg3ODAwMDBmZmZmCmZzdGF0OiBjYW4n dCByZWFkIGZpbGUgMTMgYXQgMHgyMDAwMDdmZmZmZmZmZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmls ZSAxNCBhdCAweDQwMDAwMDAwMDFmZmZmZgpmc3RhdDogY2FuJ3QgcmVhZCBmaWxlIDE2IGF0IDB4 NzgwMDAwZmZmZgpmc3RhdDogY2FuJ3QgcmVhZCBmaWxlIDEgYXQgMHgyMDAwMDdmZmZmZmZmZmYK ZnN0YXQ6IGNhbid0IHJlYWQgZmlsZSAyIGF0IDB4NDAwMDAwMDAwMWZmZmZmCmZzdGF0OiBjYW4n dCByZWFkIGZpbGUgNCBhdCAweDc4MDAwMGZmZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmlsZSA3IGF0 IDB4MjAwMDA3ZmZmZmZmZmZmCmZzdGF0OiBjYW4ndCByZWFkIGZpbGUgOCBhdCAweDQwMDAwMDAw MDFmZmZmZgpmc3RhdDogY2FuJ3QgcmVhZCBmaWxlIDEwIGF0IDB4NzgwMDAwZmZmZgpmc3RhdDog Y2FuJ3QgcmVhZCBmaWxlIDEgYXQgMHgyMDAwMDdmZmZmZmZmZmYKZnN0YXQ6IGNhbid0IHJlYWQg ZmlsZSAyIGF0IDB4NDAwMDAwMDAwMWZmZmZmCmZzdGF0OiBjYW4ndCByZWFkIGZpbGUgNCBhdCAw eDc4MDAwMGZmZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmlsZSA3IGF0IDB4MjAwMDA3ZmZmZmZmZmZm CmZzdGF0OiBjYW4ndCByZWFkIGZpbGUgOCBhdCAweDQwMDAwMDAwMDFmZmZmZgpmc3RhdDogY2Fu J3QgcmVhZCBmaWxlIDEwIGF0IDB4NzgwMDAwZmZmZgpmc3RhdDogY2FuJ3QgcmVhZCBmaWxlIDEz IGF0IDB4MjAwMDA3ZmZmZmZmZmZmCmZzdGF0OiBjYW4ndCByZWFkIGZpbGUgMTQgYXQgMHg0MDAw MDAwMDAxZmZmZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmlsZSAxNiBhdCAweDc4MDAwMGZmZmYKZnN0 YXQ6IGNhbid0IHJlYWQgZmlsZSAxIGF0IDB4MjAwMDA3ZmZmZmZmZmZmCmZzdGF0OiBjYW4ndCBy ZWFkIGZpbGUgMiBhdCAweDQwMDAwMDAwMDFmZmZmZgpmc3RhdDogY2FuJ3QgcmVhZCBmaWxlIDQg YXQgMHg3ODAwMDBmZmZmCmZzdGF0OiBjYW4ndCByZWFkIGZpbGUgNyBhdCAweDIwMDAwN2ZmZmZm ZmZmZgpmc3RhdDogY2FuJ3QgcmVhZCBmaWxlIDggYXQgMHg0MDAwMDAwMDAxZmZmZmYKZnN0YXQ6 IGNhbid0IHJlYWQgZmlsZSAxMCBhdCAweDc4MDAwMGZmZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmls ZSAxMyBhdCAweDIwMDAwN2ZmZmZmZmZmZgpmc3RhdDogY2FuJ3QgcmVhZCBmaWxlIDE0IGF0IDB4 NDAwMDAwMDAwMWZmZmZmCmZzdGF0OiBjYW4ndCByZWFkIGZpbGUgMTYgYXQgMHg3ODAwMDBmZmZm CmZzdGF0OiBjYW4ndCByZWFkIGZpbGUgMSBhdCAweDIwMDAwN2ZmZmZmZmZmZgpmc3RhdDogY2Fu J3QgcmVhZCBmaWxlIDIgYXQgMHg0MDAwMDAwMDAxZmZmZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmls ZSA0IGF0IDB4NzgwMDAwZmZmZgpmc3RhdDogY2FuJ3QgcmVhZCBmaWxlIDcgYXQgMHgyMDAwMDdm ZmZmZmZmZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmlsZSA4IGF0IDB4NDAwMDAwMDAwMWZmZmZmCmZz dGF0OiBjYW4ndCByZWFkIGZpbGUgMTAgYXQgMHg3ODAwMDBmZmZmCmZzdGF0OiBjYW4ndCByZWFk IGZpbGUgMTMgYXQgMHgyMDAwMDdmZmZmZmZmZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmlsZSAxNCBh dCAweDQwMDAwMDAwMDFmZmZmZgpmc3RhdDogY2FuJ3QgcmVhZCBmaWxlIDE2IGF0IDB4NzgwMDAw ZmZmZgpmc3RhdDogY2FuJ3QgcmVhZCBmaWxlIDEgYXQgMHgyMDAwMDdmZmZmZmZmZmYKZnN0YXQ6 IGNhbid0IHJlYWQgZmlsZSAyIGF0IDB4NDAwMDAwMDAwMWZmZmZmCmZzdGF0OiBjYW4ndCByZWFk IGZpbGUgNCBhdCAweDc4MDAwMGZmZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmlsZSA3IGF0IDB4MjAw MDA3ZmZmZmZmZmZmCmZzdGF0OiBjYW4ndCByZWFkIGZpbGUgOCBhdCAweDQwMDAwMDAwMDFmZmZm Zgpmc3RhdDogY2FuJ3QgcmVhZCBmaWxlIDEwIGF0IDB4NzgwMDAwZmZmZgpmc3RhdDogY2FuJ3Qg cmVhZCBmaWxlIDEzIGF0IDB4MjAwMDA3ZmZmZmZmZmZmCmZzdGF0OiBjYW4ndCByZWFkIGZpbGUg MTQgYXQgMHg0MDAwMDAwMDAxZmZmZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmlsZSAxNiBhdCAweDc4 MDAwMGZmZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmlsZSAxIGF0IDB4MjAwMDA3ZmZmZmZmZmZmCmZz dGF0OiBjYW4ndCByZWFkIGZpbGUgMiBhdCAweDQwMDAwMDAwMDFmZmZmZgpmc3RhdDogY2FuJ3Qg cmVhZCBmaWxlIDQgYXQgMHg3ODAwMDBmZmZmCmZzdGF0OiBjYW4ndCByZWFkIGZpbGUgNyBhdCAw eDIwMDAwN2ZmZmZmZmZmZgpmc3RhdDogY2FuJ3QgcmVhZCBmaWxlIDggYXQgMHg0MDAwMDAwMDAx ZmZmZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmlsZSAxMCBhdCAweDc4MDAwMGZmZmYKZnN0YXQ6IGNh bid0IHJlYWQgZmlsZSAxMyBhdCAweDIwMDAwN2ZmZmZmZmZmZgpmc3RhdDogY2FuJ3QgcmVhZCBm aWxlIDE0IGF0IDB4NDAwMDAwMDAwMWZmZmZmCmZzdGF0OiBjYW4ndCByZWFkIGZpbGUgMTYgYXQg MHg3ODAwMDBmZmZmCmZzdGF0OiBjYW4ndCByZWFkIGZpbGUgMSBhdCAweDIwMDAwN2ZmZmZmZmZm Zgpmc3RhdDogY2FuJ3QgcmVhZCBmaWxlIDIgYXQgMHg0MDAwMDAwMDAxZmZmZmYKZnN0YXQ6IGNh bid0IHJlYWQgZmlsZSA0IGF0IDB4NzgwMDAwZmZmZgpmc3RhdDogY2FuJ3QgcmVhZCBmaWxlIDcg YXQgMHgyMDAwMDdmZmZmZmZmZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmlsZSA4IGF0IDB4NDAwMDAw MDAwMWZmZmZmCmZzdGF0OiBjYW4ndCByZWFkIGZpbGUgMTAgYXQgMHg3ODAwMDBmZmZmCmZzdGF0 OiBjYW4ndCByZWFkIGZpbGUgMTMgYXQgMHgyMDAwMDdmZmZmZmZmZmYKZnN0YXQ6IGNhbid0IHJl YWQgZmlsZSAxNCBhdCAweDQwMDAwMDAwMDFmZmZmZgpmc3RhdDogY2FuJ3QgcmVhZCBmaWxlIDE2 IGF0IDB4NzgwMDAwZmZmZgpmc3RhdDogY2FuJ3QgcmVhZCBmaWxlIDEgYXQgMHgyMDAwMDdmZmZm ZmZmZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmlsZSAyIGF0IDB4NDAwMDAwMDAwMWZmZmZmCmZzdGF0 OiBjYW4ndCByZWFkIGZpbGUgNCBhdCAweDc4MDAwMGZmZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmls ZSA3IGF0IDB4MjAwMDA3ZmZmZmZmZmZmCmZzdGF0OiBjYW4ndCByZWFkIGZpbGUgOCBhdCAweDQw MDAwMDAwMDFmZmZmZgpmc3RhdDogY2FuJ3QgcmVhZCBmaWxlIDEwIGF0IDB4NzgwMDAwZmZmZgpm c3RhdDogY2FuJ3QgcmVhZCBmaWxlIDEzIGF0IDB4MjAwMDA3ZmZmZmZmZmZmCmZzdGF0OiBjYW4n dCByZWFkIGZpbGUgMTQgYXQgMHg0MDAwMDAwMDAxZmZmZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmls ZSAxNiBhdCAweDc4MDAwMGZmZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmlsZSAxIGF0IDB4MjAwMDA3 ZmZmZmZmZmZmCmZzdGF0OiBjYW4ndCByZWFkIGZpbGUgMiBhdCAweDQwMDAwMDAwMDFmZmZmZgpm c3RhdDogY2FuJ3QgcmVhZCBmaWxlIDQgYXQgMHg3ODAwMDBmZmZmCmZzdGF0OiBjYW4ndCByZWFk IGZpbGUgNyBhdCAweDIwMDAwN2ZmZmZmZmZmZgpmc3RhdDogY2FuJ3QgcmVhZCBmaWxlIDggYXQg MHg0MDAwMDAwMDAxZmZmZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmlsZSAxMCBhdCAweDc4MDAwMGZm ZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmlsZSAxMyBhdCAweDIwMDAwN2ZmZmZmZmZmZgpmc3RhdDog Y2FuJ3QgcmVhZCBmaWxlIDE0IGF0IDB4NDAwMDAwMDAwMWZmZmZmCmZzdGF0OiBjYW4ndCByZWFk IGZpbGUgMTYgYXQgMHg3ODAwMDBmZmZmCmZzdGF0OiBjYW4ndCByZWFkIGZpbGUgMSBhdCAweDIw MDAwN2ZmZmZmZmZmZgpmc3RhdDogY2FuJ3QgcmVhZCBmaWxlIDIgYXQgMHg0MDAwMDAwMDAxZmZm ZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmlsZSA0IGF0IDB4NzgwMDAwZmZmZgpmc3RhdDogY2FuJ3Qg cmVhZCBmaWxlIDcgYXQgMHgyMDAwMDdmZmZmZmZmZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmlsZSA4 IGF0IDB4NDAwMDAwMDAwMWZmZmZmCmZzdGF0OiBjYW4ndCByZWFkIGZpbGUgMTAgYXQgMHg3ODAw MDBmZmZmCmZzdGF0OiBjYW4ndCByZWFkIGZpbGUgMTMgYXQgMHgyMDAwMDdmZmZmZmZmZmYKZnN0 YXQ6IGNhbid0IHJlYWQgZmlsZSAxNCBhdCAweDQwMDAwMDAwMDFmZmZmZgpmc3RhdDogY2FuJ3Qg cmVhZCBmaWxlIDE2IGF0IDB4NzgwMDAwZmZmZgpmc3RhdDogY2FuJ3QgcmVhZCBmaWxlIDEgYXQg MHgyMDAwMDdmZmZmZmZmZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmlsZSAyIGF0IDB4NDAwMDAwMDAw MWZmZmZmCmZzdGF0OiBjYW4ndCByZWFkIGZpbGUgNCBhdCAweDc4MDAwMGZmZmYKZnN0YXQ6IGNh bid0IHJlYWQgZmlsZSA3IGF0IDB4MjAwMDA3ZmZmZmZmZmZmCmZzdGF0OiBjYW4ndCByZWFkIGZp bGUgOCBhdCAweDQwMDAwMDAwMDFmZmZmZgpmc3RhdDogY2FuJ3QgcmVhZCBmaWxlIDEwIGF0IDB4 NzgwMDAwZmZmZgpmc3RhdDogY2FuJ3QgcmVhZCBmaWxlIDEzIGF0IDB4MjAwMDA3ZmZmZmZmZmZm CmZzdGF0OiBjYW4ndCByZWFkIGZpbGUgMTQgYXQgMHg0MDAwMDAwMDAxZmZmZmYKZnN0YXQ6IGNh bid0IHJlYWQgZmlsZSAxNiBhdCAweDc4MDAwMGZmZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmlsZSAx IGF0IDB4MjAwMDA3ZmZmZmZmZmZmCmZzdGF0OiBjYW4ndCByZWFkIGZpbGUgMiBhdCAweDQwMDAw MDAwMDFmZmZmZgpmc3RhdDogY2FuJ3QgcmVhZCBmaWxlIDQgYXQgMHg3ODAwMDBmZmZmCmZzdGF0 OiBjYW4ndCByZWFkIGZpbGUgNyBhdCAweDIwMDAwN2ZmZmZmZmZmZgpmc3RhdDogY2FuJ3QgcmVh ZCBmaWxlIDggYXQgMHg0MDAwMDAwMDAxZmZmZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmlsZSAxMCBh dCAweDc4MDAwMGZmZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmlsZSAxMyBhdCAweDIwMDAwN2ZmZmZm ZmZmZgpmc3RhdDogY2FuJ3QgcmVhZCBmaWxlIDE0IGF0IDB4NDAwMDAwMDAwMWZmZmZmCmZzdGF0 OiBjYW4ndCByZWFkIGZpbGUgMTYgYXQgMHg3ODAwMDBmZmZmCmZzdGF0OiBjYW4ndCByZWFkIGZp bGUgMSBhdCAweDIwMDAwN2ZmZmZmZmZmZgpmc3RhdDogY2FuJ3QgcmVhZCBmaWxlIDIgYXQgMHg0 MDAwMDAwMDAxZmZmZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmlsZSA0IGF0IDB4NzgwMDAwZmZmZgpm c3RhdDogY2FuJ3QgcmVhZCBmaWxlIDcgYXQgMHgyMDAwMDdmZmZmZmZmZmYKZnN0YXQ6IGNhbid0 IHJlYWQgZmlsZSA4IGF0IDB4NDAwMDAwMDAwMWZmZmZmCmZzdGF0OiBjYW4ndCByZWFkIGZpbGUg MTAgYXQgMHg3ODAwMDBmZmZmCmZzdGF0OiBjYW4ndCByZWFkIGZpbGUgMTMgYXQgMHgyMDAwMDdm ZmZmZmZmZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmlsZSAxNCBhdCAweDQwMDAwMDAwMDFmZmZmZgpm c3RhdDogY2FuJ3QgcmVhZCBmaWxlIDE2IGF0IDB4NzgwMDAwZmZmZgpmc3RhdDogY2FuJ3QgcmVh ZCBmaWxlIDEgYXQgMHgyMDAwMDdmZmZmZmZmZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmlsZSAyIGF0 IDB4NDAwMDAwMDAwMWZmZmZmCmZzdGF0OiBjYW4ndCByZWFkIGZpbGUgMSBhdCAweDIwMDAwN2Zm ZmZmZmZmZgpmc3RhdDogY2FuJ3QgcmVhZCBmaWxlIDIgYXQgMHg0MDAwMDAwMDAxZmZmZmYKZnN0 YXQ6IGNhbid0IHJlYWQgZmlsZSAxIGF0IDB4MjAwMDA3ZmZmZmZmZmZmCmZzdGF0OiBjYW4ndCBy ZWFkIGZpbGUgMiBhdCAweDQwMDAwMDAwMDFmZmZmZgpmc3RhdDogY2FuJ3QgcmVhZCBmaWxlIDEg YXQgMHgyMDAwMDdmZmZmZmZmZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmlsZSAyIGF0IDB4NDAwMDAw MDAwMWZmZmZmCmZzdGF0OiBjYW4ndCByZWFkIGZpbGUgMSBhdCAweDIwMDAwN2ZmZmZmZmZmZgpm c3RhdDogY2FuJ3QgcmVhZCBmaWxlIDIgYXQgMHg0MDAwMDAwMDAxZmZmZmYKZnN0YXQ6IGNhbid0 IHJlYWQgZmlsZSAxIGF0IDB4MjAwMDA3ZmZmZmZmZmZmCmZzdGF0OiBjYW4ndCByZWFkIGZpbGUg MiBhdCAweDQwMDAwMDAwMDFmZmZmZgpmc3RhdDogY2FuJ3QgcmVhZCBmaWxlIDEgYXQgMHgyMDAw MDdmZmZmZmZmZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmlsZSAyIGF0IDB4NDAwMDAwMDAwMWZmZmZm CmZzdGF0OiBjYW4ndCByZWFkIGZpbGUgMSBhdCAweDIwMDAwN2ZmZmZmZmZmZgpmc3RhdDogY2Fu J3QgcmVhZCBmaWxlIDIgYXQgMHg0MDAwMDAwMDAxZmZmZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmls ZSAxIGF0IDB4MjAwMDA3ZmZmZmZmZmZmCmZzdGF0OiBjYW4ndCByZWFkIGZpbGUgMiBhdCAweDQw MDAwMDAwMDFmZmZmZgpmc3RhdDogY2FuJ3QgcmVhZCBmaWxlIDQgYXQgMHg3ODAwMDBmZmZmCmZz dGF0OiBjYW4ndCByZWFkIGZpbGUgNyBhdCAweDIwMDAwN2ZmZmZmZmZmZgpmc3RhdDogY2FuJ3Qg cmVhZCBmaWxlIDggYXQgMHg0MDAwMDAwMDAxZmZmZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmlsZSAx MCBhdCAweDc4MDAwMGZmZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmlsZSAxMyBhdCAweDIwMDAwN2Zm ZmZmZmZmZgpmc3RhdDogY2FuJ3QgcmVhZCBmaWxlIDEgYXQgMHgyMDAwMDdmZmZmZmZmZmYKZnN0 YXQ6IGNhbid0IHJlYWQgZmlsZSAyIGF0IDB4NDAwMDAwMDAwMWZmZmZmCmZzdGF0OiBjYW4ndCBy ZWFkIGZpbGUgMSBhdCAweDIwMDAwN2ZmZmZmZmZmZgpmc3RhdDogY2FuJ3QgcmVhZCBmaWxlIDIg YXQgMHg0MDAwMDAwMDAxZmZmZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmlsZSA0IGF0IDB4NzgwMDAw ZmZmZgpmc3RhdDogY2FuJ3QgcmVhZCBmaWxlIDEgYXQgMHgyMDAwMDdmZmZmZmZmZmYKZnN0YXQ6 IGNhbid0IHJlYWQgZmlsZSAyIGF0IDB4NDAwMDAwMDAwMWZmZmZmCmZzdGF0OiBjYW4ndCByZWFk IGZpbGUgNCBhdCAweDc4MDAwMGZmZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmlsZSAxIGF0IDB4MjAw MDA3ZmZmZmZmZmZmCmZzdGF0OiBjYW4ndCByZWFkIGZpbGUgMiBhdCAweDQwMDAwMDAwMDFmZmZm Zgpmc3RhdDogY2FuJ3QgcmVhZCBmaWxlIDQgYXQgMHg3ODAwMDBmZmZmCmZzdGF0OiBjYW4ndCBy ZWFkIGZpbGUgMSBhdCAweDIwMDAwN2ZmZmZmZmZmZgpmc3RhdDogY2FuJ3QgcmVhZCBmaWxlIDIg YXQgMHg0MDAwMDAwMDAxZmZmZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmlsZSA0IGF0IDB4NzgwMDAw ZmZmZgpmc3RhdDogY2FuJ3QgcmVhZCBmaWxlIDcgYXQgMHgyMDAwMDdmZmZmZmZmZmYKZnN0YXQ6 IGNhbid0IHJlYWQgZmlsZSA4IGF0IDB4NDAwMDAwMDAwMWZmZmZmCmZzdGF0OiBjYW4ndCByZWFk IGZpbGUgMTAgYXQgMHg3ODAwMDBmZmZmCmZzdGF0OiBjYW4ndCByZWFkIGZpbGUgMSBhdCAweDIw MDAwN2ZmZmZmZmZmZgpmc3RhdDogY2FuJ3QgcmVhZCBmaWxlIDIgYXQgMHg0MDAwMDAwMDAxZmZm ZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmlsZSA0IGF0IDB4NzgwMDAwZmZmZgpmc3RhdDogY2FuJ3Qg cmVhZCBmaWxlIDcgYXQgMHgyMDAwMDdmZmZmZmZmZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmlsZSA4 IGF0IDB4NDAwMDAwMDAwMWZmZmZmCmZzdGF0OiBjYW4ndCByZWFkIGZpbGUgMTAgYXQgMHg3ODAw MDBmZmZmCmZzdGF0OiBjYW4ndCByZWFkIGZpbGUgMTMgYXQgMHgyMDAwMDdmZmZmZmZmZmYKZnN0 YXQ6IGNhbid0IHJlYWQgZmlsZSAxNCBhdCAweDQwMDAwMDAwMDFmZmZmZgpmc3RhdDogY2FuJ3Qg cmVhZCBmaWxlIDE2IGF0IDB4NzgwMDAwZmZmZgpmc3RhdDogY2FuJ3QgcmVhZCBmaWxlIDE5IGF0 IDB4MjAwMDA3ZmZmZmZmZmZmCmZzdGF0OiBjYW4ndCByZWFkIGZpbGUgMjAgYXQgMHg0MDAwMDAw MDAxZmZmZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmlsZSAyMiBhdCAweDc4MDAwMGZmZmYKZnN0YXQ6 IGNhbid0IHJlYWQgZmlsZSAyMyBhdCAweDEKZnN0YXQ6IGNhbid0IHJlYWQgZmlsZSAxIGF0IDB4 MjAwMDA3ZmZmZmZmZmZmCmZzdGF0OiBjYW4ndCByZWFkIGZpbGUgMiBhdCAweDQwMDAwMDAwMDFm ZmZmZgpmc3RhdDogY2FuJ3QgcmVhZCBmaWxlIDQgYXQgMHg3ODAwMDBmZmZmCmZzdGF0OiBjYW4n dCByZWFkIGZpbGUgNyBhdCAweDIwMDAwN2ZmZmZmZmZmZgpmc3RhdDogY2FuJ3QgcmVhZCBmaWxl IDggYXQgMHg0MDAwMDAwMDAxZmZmZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmlsZSAxMCBhdCAweDc4 MDAwMGZmZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmlsZSAxMyBhdCAweDIwMDAwN2ZmZmZmZmZmZgpm c3RhdDogY2FuJ3QgcmVhZCBmaWxlIDE0IGF0IDB4NDAwMDAwMDAwMWZmZmZmCmZzdGF0OiBjYW4n dCByZWFkIGZpbGUgMTYgYXQgMHg3ODAwMDBmZmZmCmZzdGF0OiBjYW4ndCByZWFkIGZpbGUgMTkg YXQgMHgyMDAwMDdmZmZmZmZmZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmlsZSAxIGF0IDB4MjAwMDA3 ZmZmZmZmZmZmCmZzdGF0OiBjYW4ndCByZWFkIGZpbGUgMiBhdCAweDQwMDAwMDAwMDFmZmZmZgpm c3RhdDogY2FuJ3QgcmVhZCBmaWxlIDQgYXQgMHg3ODAwMDBmZmZmCmZzdGF0OiBjYW4ndCByZWFk IGZpbGUgMSBhdCAweDIwMDAwN2ZmZmZmZmZmZgpmc3RhdDogY2FuJ3QgcmVhZCBmaWxlIDIgYXQg MHg0MDAwMDAwMDAxZmZmZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmlsZSA0IGF0IDB4NzgwMDAwZmZm Zgpmc3RhdDogY2FuJ3QgcmVhZCBmaWxlIDEgYXQgMHgyMDAwMDAwMDAwMDAwMDAKZnN0YXQ6IGNh bid0IHJlYWQgZmlsZSAyIGF0IDB4NDAwMDAwMDAwMDAwMDAwCmZzdGF0OiBjYW4ndCByZWFkIGZp bGUgNyBhdCAweDIwMDAwMDAwMDAwMDAwMgpmc3RhdDogY2FuJ3QgcmVhZCBmaWxlIDggYXQgMHg0 MDAwMDAwMDAwMDAwMDAKZnN0YXQ6IGNhbid0IHJlYWQgZmlsZSAxIGF0IDB4MjAwMDA3ZmZmZmZm ZmZmCmZzdGF0OiBjYW4ndCByZWFkIGZpbGUgMiBhdCAweDQwMDAwMDAwMDFmZmZmZgpmc3RhdDog Y2FuJ3QgcmVhZCBmaWxlIDQgYXQgMHg3ODAwMDBmZmZmCmZzdGF0OiBjYW4ndCByZWFkIGZpbGUg NyBhdCAweDIwMDAwN2ZmZmZmZmZmZgpmc3RhdDogY2FuJ3QgcmVhZCBmaWxlIDggYXQgMHg0MDAw MDAwMDAxZmZmZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmlsZSAxIGF0IDB4MjAwMDAwMDAwMDAwMDAw CmZzdGF0OiBjYW4ndCByZWFkIGZpbGUgMiBhdCAweDQwMDAwMDAwMDAwMDAwMApmc3RhdDogY2Fu J3QgcmVhZCBmaWxlIDcgYXQgMHgyMDAwMDAwMDAwMDAwMDIKZnN0YXQ6IGNhbid0IHJlYWQgZmls ZSA4IGF0IDB4NDAwMDAwMDAwMDAwMDAwCmZzdGF0OiBjYW4ndCByZWFkIGZpbGUgMSBhdCAweDIw MDAwN2ZmZmZmZmZmZgpmc3RhdDogY2FuJ3QgcmVhZCBmaWxlIDIgYXQgMHg0MDAwMDAwMDAxZmZm ZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmlsZSA0IGF0IDB4NzgwMDAwZmZmZgpmc3RhdDogY2FuJ3Qg cmVhZCBmaWxlIDcgYXQgMHgyMDAwMDdmZmZmZmZmZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmlsZSA4 IGF0IDB4NDAwMDAwMDAwMWZmZmZmCmZzdGF0OiBjYW4ndCByZWFkIGZpbGUgMSBhdCAweDIwMDAw MDAwMDAwMDAwMApmc3RhdDogY2FuJ3QgcmVhZCBmaWxlIDIgYXQgMHg0MDAwMDAwMDAwMDAwMDAK ZnN0YXQ6IGNhbid0IHJlYWQgZmlsZSA3IGF0IDB4MjAwMDAwMDAwMDAwMDAyCmZzdGF0OiBjYW4n dCByZWFkIGZpbGUgOCBhdCAweDQwMDAwMDAwMDAwMDAwMApmc3RhdDogY2FuJ3QgcmVhZCBmaWxl IDEgYXQgMHgyMDAwMDdmZmZmZmZmZmYKZnN0YXQ6IGNhbid0IHJlYWQgZmlsZSAyIGF0IDB4NDAw MDAwMDAwMWZmZmZmCmZzdGF0OiBjYW4ndCByZWFkIGZpbGUgNCBhdCAweDc4MDAwMGZmZmYKZnN0 YXQ6IGNhbid0IHJlYWQgZmlsZSA3IGF0IDB4MjAwMDA3ZmZmZmZmZmZmCmZzdGF0OiBjYW4ndCBy ZWFkIGZpbGUgOCBhdCAweDQwMDAwMDAwMDFmZmZmZgpVU0VSICAgICBDTUQgICAgICAgICAgUElE ICAgRkQgTU9VTlQgICAgICBJTlVNIE1PREUgICAgICAgICBTWnxEViBSL1cKcm9vdCAgICAgY2Mg ICAgICAgICA3NTc5OSByb290IC8gICAgICAgICAgICAgMiBkcnd4ci14ci14ICAgIDEwMjQgIHIK cm9vdCAgICAgY2MgICAgICAgICA3NTc5OSAgIHdkIC0gICAgICAgICAtICAgPyhuZXduZnMpICAg IC0Kcm9vdCAgICAgY2MgICAgICAgICA3NTc5OSB0ZXh0IC0gICAgICAgICAtICAgPyhuZXduZnMp ICAgIC0Kcm9vdCAgICAgY2MgICAgICAgICA3NTc5OSBjdHR5IC9kZXYgICAgICAgICA0OCBjcnct LS0tLS0tICAgdHR5djAgcncKcm9vdCAgICAgY2MgICAgICAgICA3NTc5OSAgICAwIC8gICAgICAg IDI0MjI4OCAtcnctLS0tLS0tICAgIDEwNjYgcncKcm9vdCAgICAgY2MgICAgICAgICA3NTc5OSAg ICA2KiBwaXBlIGZmZmZmODAwMDJhNGU3MzAgPC0+IGZmZmZmODAwMDJhNGU1ZDAgICAgICAwIHJ3 CnJvb3QgICAgIGNjICAgICAgICAgNzU3OTkgICAxMiogcGlwZSBmZmZmZjgwMDAyYTRlNzMwIDwt PiBmZmZmZjgwMDAyYTRlNWQwICAgICAgMCBydwpyb290ICAgICBjYyAgICAgICAgIDc1Nzk4IHJv b3QgLyAgICAgICAgICAgICAyIGRyd3hyLXhyLXggICAgMTAyNCAgcgpyb290ICAgICBjYyAgICAg ICAgIDc1Nzk4ICAgd2QgLSAgICAgICAgIC0gICA/KG5ld25mcykgICAgLQpyb290ICAgICBjYyAg ICAgICAgIDc1Nzk4IHRleHQgLSAgICAgICAgIC0gICA/KG5ld25mcykgICAgLQpyb290ICAgICBj YyAgICAgICAgIDc1Nzk4IGN0dHkgL2RldiAgICAgICAgIDQ4IGNydy0tLS0tLS0gICB0dHl2MCBy dwpyb290ICAgICBjYyAgICAgICAgIDc1Nzk4ICAgIDAgLyAgICAgICAgMjQyMjkzIC1ydy0tLS0t LS0gICAgMTA2MSBydwpyb290ICAgICBjYyAgICAgICAgIDc1Nzk4ICAgIDYqIHBpcGUgZmZmZmY4 MDAwMmEwNTczMCA8LT4gZmZmZmY4MDAwMmEwNTVkMCAgICAgIDAgcncKcm9vdCAgICAgY2MgICAg ICAgICA3NTc5OCAgIDEyKiBwaXBlIGZmZmZmODAwMDJhMDU3MzAgPC0+IGZmZmZmODAwMDJhMDU1 ZDAgICAgICAwIHJ3CnJvb3QgICAgIGJjICAgICAgICAgNzU3OTMgcm9vdCAvICAgICAgICAgICAg IDIgZHJ3eHIteHIteCAgICAxMDI0ICByCnJvb3QgICAgIGJjICAgICAgICAgNzU3OTMgICB3ZCAv ICAgICAgICAgICAgIDIgZHJ3eHIteHIteCAgICAxMDI0ICByCnJvb3QgICAgIGJjICAgICAgICAg NzU3OTMgdGV4dCAvICAgICAgICA0ODE4NTAgLXIteHIteHIteCAgIDYwOTQ0ICByCnJvb3QgICAg IGJjICAgICAgICAgNzU3OTMgICAgMCogcGlwZSBmZmZmZjgwMDJkYjBlYmEwIDwtPiBmZmZmZjgw MDJkYjBlZDAwICAgICAgMCBydwpyb290ICAgICBjYyAgICAgICAgIDc1NzkxIHJvb3QgLyAgICAg ICAgICAgICAyIGRyd3hyLXhyLXggICAgMTAyNCAgcgpyb290ICAgICBjYyAgICAgICAgIDc1Nzkx ICAgd2QgLSAgICAgICAgIC0gICA/KG5ld25mcykgICAgLQpyb290ICAgICBjYyAgICAgICAgIDc1 NzkxIHRleHQgLSAgICAgICAgIC0gICA/KG5ld25mcykgICAgLQpyb290ICAgICBjYyAgICAgICAg IDc1NzkxIGN0dHkgL2RldiAgICAgICAgIDQ4IGNydy0tLS0tLS0gICB0dHl2MCBydwpyb290ICAg ICBjYyAgICAgICAgIDc1NzkxICAgIDAgLyAgICAgICAgMjQwNzc5IC1ydy0tLS0tLS0gICAgMTA2 NiBydwpyb290ICAgICBjYyAgICAgICAgIDc1NzkxICAgIDYqIHBpcGUgZmZmZmY4MDAwMmEwNzQ0 OCA8LT4gZmZmZmY4MDAwMmEwNzJlOCAgICAgIDAgcncKcm9vdCAgICAgY2MgICAgICAgICA3NTc5 MSAgIDEyKiBwaXBlIGZmZmZmODAwMDJhMDc0NDggPC0+IGZmZmZmODAwMDJhMDcyZTggICAgICAw IHJ3CnJvb3QgICAgIGNjICAgICAgICAgNzU3OTAgcm9vdCAvICAgICAgICAgICAgIDIgZHJ3eHIt eHIteCAgICAxMDI0ICByCnJvb3QgICAgIGNjICAgICAgICAgNzU3OTAgICB3ZCAtICAgICAgICAg LSAgID8obmV3bmZzKSAgICAtCnJvb3QgICAgIGNjICAgICAgICAgNzU3OTAgdGV4dCAtICAgICAg ICAgLSAgID8obmV3bmZzKSAgICAtCnJvb3QgICAgIGNjICAgICAgICAgNzU3OTAgY3R0eSAvZGV2 ICAgICAgICAgNDggY3J3LS0tLS0tLSAgIHR0eXYwIHJ3CnJvb3QgICAgIGNjICAgICAgICAgNzU3 OTAgICAgMCAvICAgICAgICAyNDIyOTMgLXJ3LS0tLS0tLSAgICAxMDYxIHJ3CnJvb3QgICAgIGNj ICAgICAgICAgNzU3OTAgICAgNiogcGlwZSBmZmZmZjgwMDAyYTA1NzMwIDwtPiBmZmZmZjgwMDAy YTA1NWQwICAgICAgMCBydwpyb290ICAgICBjYyAgICAgICAgIDc1NzkwICAgMTIqIHBpcGUgZmZm ZmY4MDAwMmEwNTczMCA8LT4gZmZmZmY4MDAwMmEwNTVkMCAgICAgIDAgcncKcm9vdCAgICAgY2Mg ICAgICAgICA3NTc4OSByb290IC8gICAgICAgICAgICAgMiBkcnd4ci14ci14ICAgIDEwMjQgIHIK cm9vdCAgICAgY2MgICAgICAgICA3NTc4OSAgIHdkIC0gICAgICAgICAtICAgPyhuZXduZnMpICAg IC0Kcm9vdCAgICAgY2MgICAgICAgICA3NTc4OSB0ZXh0IC0gICAgICAgICAtICAgPyhuZXduZnMp ICAgIC0Kcm9vdCAgICAgY2MgICAgICAgICA3NTc4OSBjdHR5IC9kZXYgICAgICAgICA0OCBjcnct LS0tLS0tICAgdHR5djAgcncKcm9vdCAgICAgY2MgICAgICAgICA3NTc4OSAgICAwIC8gICAgICAg IDI0MjI4OCAtcnctLS0tLS0tICAgIDEwNjYgcncKcm9vdCAgICAgY2MgICAgICAgICA3NTc4OSAg ICA2KiBwaXBlIGZmZmZmODAwMDJhNGU3MzAgPC0+IGZmZmZmODAwMDJhNGU1ZDAgICAgICAwIHJ3 CnJvb3QgICAgIGNjICAgICAgICAgNzU3ODkgICAxMiogcGlwZSBmZmZmZjgwMDAyYTRlNzMwIDwt PiBmZmZmZjgwMDAyYTRlNWQwICAgICAgMCBydwpyb290ICAgICBzaCAgICAgICAgIDc1Nzg4IHJv b3QgLyAgICAgICAgICAgICAyIGRyd3hyLXhyLXggICAgMTAyNCAgcgpyb290ICAgICBzaCAgICAg ICAgIDc1Nzg4ICAgd2QgLyAgICAgICAgICAgICAyIGRyd3hyLXhyLXggICAgMTAyNCAgcgpyb290 ICAgICBzaCAgICAgICAgIDc1Nzg4IHRleHQgLyAgICAgICAgODAyNjQwIC1yLXhyLXhyLXggIDE0 MjEyMCAgcgpyb290ICAgICBzaCAgICAgICAgIDc1Nzg4ICAgIDAgL2RldiAgICAgICAgIDE1IGNy dy1ydy1ydy0gICAgbnVsbCAgcgpyb290ICAgICBzaCAgICAgICAgIDc1Nzg0IHJvb3QgLyAgICAg ICAgICAgICAyIGRyd3hyLXhyLXggICAgMTAyNCAgcgpyb290ICAgICBzaCAgICAgICAgIDc1Nzg0 ICAgd2QgLSAgICAgICAgIC0gICA/KG5ld25mcykgICAgLQpyb290ICAgICBzaCAgICAgICAgIDc1 Nzg0IHRleHQgLyAgICAgICAgODAyNjQwIC1yLXhyLXhyLXggIDE0MjEyMCAgcgpyb290ICAgICBz aCAgICAgICAgIDc1Nzg0IGN0dHkgL2RldiAgICAgICAgIDQ4IGNydy0tLS0tLS0gICB0dHl2MCBy dwpyb290ICAgICBzaCAgICAgICAgIDc1Nzg0ICAgIDAgLyAgICAgICAgMjQyMjkzIC1ydy0tLS0t LS0gICAgMTA2MSBydwpyb290ICAgICBzaCAgICAgICAgIDc1Nzg0ICAgIDYqIHBpcGUgZmZmZmY4 MDAwMmEwNTczMCA8LT4gZmZmZmY4MDAwMmEwNTVkMCAgICAgIDAgcncKcm9vdCAgICAgc2ggICAg ICAgICA3NTc4NCAgIDEyKiBwaXBlIGZmZmZmODAwMDJhMDU3MzAgPC0+IGZmZmZmODAwMDJhMDU1 ZDAgICAgICAwIHJ3CnJvb3QgICAgIHNoICAgICAgICAgNzU3ODIgcm9vdCAvICAgICAgICAgICAg IDIgZHJ3eHIteHIteCAgICAxMDI0ICByCnJvb3QgICAgIHNoICAgICAgICAgNzU3ODIgICB3ZCAt ICAgICAgICAgLSAgID8obmV3bmZzKSAgICAtCnJvb3QgICAgIHNoICAgICAgICAgNzU3ODIgdGV4 dCAvICAgICAgICA4MDI2NDAgLXIteHIteHIteCAgMTQyMTIwICByCnJvb3QgICAgIHNoICAgICAg ICAgNzU3ODIgY3R0eSAvZGV2ICAgICAgICAgNDggY3J3LS0tLS0tLSAgIHR0eXYwIHJ3CnJvb3Qg ICAgIHNoICAgICAgICAgNzU3ODIgICAgMCAvICAgICAgICAyNDA3NzkgLXJ3LS0tLS0tLSAgICAx MDY2IHJ3CnJvb3QgICAgIHNoICAgICAgICAgNzU3ODIgICAgNiogcGlwZSBmZmZmZjgwMDAyYTA3 NDQ4IDwtPiBmZmZmZjgwMDAyYTA3MmU4ICAgICAgMCBydwpyb290ICAgICBzaCAgICAgICAgIDc1 NzgyICAgMTIqIHBpcGUgZmZmZmY4MDAwMmEwNzQ0OCA8LT4gZmZmZmY4MDAwMmEwNzJlOCAgICAg IDAgcncKcm9vdCAgICAgc2ggICAgICAgICA3NTc3OCByb290IC8gICAgICAgICAgICAgMiBkcnd4 ci14ci14ICAgIDEwMjQgIHIKcm9vdCAgICAgc2ggICAgICAgICA3NTc3OCAgIHdkIC0gICAgICAg ICAtICAgPyhuZXduZnMpICAgIC0Kcm9vdCAgICAgc2ggICAgICAgICA3NTc3OCB0ZXh0IC8gICAg ICAgIDgwMjY0MCAtci14ci14ci14ICAxNDIxMjAgIHIKcm9vdCAgICAgc2ggICAgICAgICA3NTc3 OCBjdHR5IC9kZXYgICAgICAgICA0OCBjcnctLS0tLS0tICAgdHR5djAgcncKcm9vdCAgICAgc2gg ICAgICAgICA3NTc3OCAgICAwIC8gICAgICAgIDI0MjI4OCAtcnctLS0tLS0tICAgIDEwNjYgcncK cm9vdCAgICAgc2ggICAgICAgICA3NTc3OCAgICA2KiBwaXBlIGZmZmZmODAwMDJhNGU3MzAgPC0+ IGZmZmZmODAwMDJhNGU1ZDAgICAgICAwIHJ3CnJvb3QgICAgIHNoICAgICAgICAgNzU3NzggICAx MiogcGlwZSBmZmZmZjgwMDAyYTRlNzMwIDwtPiBmZmZmZjgwMDAyYTRlNWQwICAgICAgMCBydwpy b290ICAgICBzaCAgICAgICAgIDc1Nzc0IHJvb3QgLyAgICAgICAgICAgICAyIGRyd3hyLXhyLXgg ICAgMTAyNCAgcgpyb290ICAgICBzaCAgICAgICAgIDc1Nzc0ICAgd2QgLyAgICAgICAgICAgICAy IGRyd3hyLXhyLXggICAgMTAyNCAgcgpyb290ICAgICBzaCAgICAgICAgIDc1Nzc0IHRleHQgLyAg ICAgICAgODAyNjQwIC1yLXhyLXhyLXggIDE0MjEyMCAgcgpyb290ICAgICBzaCAgICAgICAgIDc1 Nzc0ICAgIDAgL2RldiAgICAgICAgIDE1IGNydy1ydy1ydy0gICAgbnVsbCAgcgpyb290ICAgICBz aCAgICAgICAgIDc1Nzc0ICAgIDYgLSAgICAgICAgIC0gICAgICAgICBiYWQgICAgLQpyb290ICAg ICBjYyAgICAgICAgIDc1NzczIHJvb3QgLyAgICAgICAgICAgICAyIGRyd3hyLXhyLXggICAgMTAy NCAgcgpyb290ICAgICBjYyAgICAgICAgIDc1NzczICAgd2QgLSAgICAgICAgIC0gICA/KG5ld25m cykgICAgLQpyb290ICAgICBjYyAgICAgICAgIDc1NzczIHRleHQgLSAgICAgICAgIC0gICA/KG5l d25mcykgICAgLQpyb290ICAgICBjYyAgICAgICAgIDc1NzczIGN0dHkgL2RldiAgICAgICAgIDQ4 IGNydy0tLS0tLS0gICB0dHl2MCBydwpyb290ICAgICBjYyAgICAgICAgIDc1NzczICAgIDAgLyAg ICAgICAgMjQyMjkyIC1ydy0tLS0tLS0gICAgMTA2NCBydwpyb290ICAgICBjYyAgICAgICAgIDc1 NzczICAgIDYqIHBpcGUgZmZmZmY4MDAwMmEwNjE2MCA8LT4gZmZmZmY4MDAwMmEwNjAwMCAgICAg IDAgcncKcm9vdCAgICAgY2MgICAgICAgICA3NTc3MyAgIDEyKiBwaXBlIGZmZmZmODAwMDJhMDYx NjAgPC0+IGZmZmZmODAwMDJhMDYwMDAgICAgICAwIHJ3CnJvb3QgICAgIGNjICAgICAgICAgNzU3 NzIgcm9vdCAvICAgICAgICAgICAgIDIgZHJ3eHIteHIteCAgICAxMDI0ICByCnJvb3QgICAgIGNj ICAgICAgICAgNzU3NzIgICB3ZCAtICAgICAgICAgLSAgID8obmV3bmZzKSAgICAtCnJvb3QgICAg IGNjICAgICAgICAgNzU3NzIgdGV4dCAtICAgICAgICAgLSAgID8obmV3bmZzKSAgICAtCnJvb3Qg ICAgIGNjICAgICAgICAgNzU3NzIgY3R0eSAvZGV2ICAgICAgICAgNDggY3J3LS0tLS0tLSAgIHR0 eXYwIHJ3CnJvb3QgICAgIGNjICAgICAgICAgNzU3NzIgICAgMCAvICAgICAgICAyNDIyOTIgLXJ3 LS0tLS0tLSAgICAxMDY0IHJ3CnJvb3QgICAgIGNjICAgICAgICAgNzU3NzIgICAgNiogcGlwZSBm ZmZmZjgwMDAyYTA2MTYwIDwtPiBmZmZmZjgwMDAyYTA2MDAwICAgICAgMCBydwpyb290ICAgICBj YyAgICAgICAgIDc1NzcyICAgMTIqIHBpcGUgZmZmZmY4MDAwMmEwNjE2MCA8LT4gZmZmZmY4MDAw MmEwNjAwMCAgICAgIDAgcncKcm9vdCAgICAgc2ggICAgICAgICA3NTc3MSByb290IC8gICAgICAg ICAgICAgMiBkcnd4ci14ci14ICAgIDEwMjQgIHIKcm9vdCAgICAgc2ggICAgICAgICA3NTc3MSAg IHdkIC0gICAgICAgICAtICAgPyhuZXduZnMpICAgIC0Kcm9vdCAgICAgc2ggICAgICAgICA3NTc3 MSB0ZXh0IC8gICAgICAgIDgwMjY0MCAtci14ci14ci14ICAxNDIxMjAgIHIKcm9vdCAgICAgc2gg ICAgICAgICA3NTc3MSBjdHR5IC9kZXYgICAgICAgICA0OCBjcnctLS0tLS0tICAgdHR5djAgcncK cm9vdCAgICAgc2ggICAgICAgICA3NTc3MSAgICAwIC8gICAgICAgIDI0MjI5MiAtcnctLS0tLS0t ICAgIDEwNjQgcncKcm9vdCAgICAgc2ggICAgICAgICA3NTc3MSAgICA2KiBwaXBlIGZmZmZmODAw MDJhMDYxNjAgPC0+IGZmZmZmODAwMDJhMDYwMDAgICAgICAwIHJ3CnJvb3QgICAgIHNoICAgICAg ICAgNzU3NzEgICAxMiogcGlwZSBmZmZmZjgwMDAyYTA2MTYwIDwtPiBmZmZmZjgwMDAyYTA2MDAw ICAgICAgMCBydwpyb290ICAgICBtYWtlICAgICAgIDczMzkyIHJvb3QgLyAgICAgICAgICAgICAy IGRyd3hyLXhyLXggICAgMTAyNCAgcgpyb290ICAgICBtYWtlICAgICAgIDczMzkyICAgd2QgLSAg ICAgICAgIC0gICA/KG5ld25mcykgICAgLQpyb290ICAgICBtYWtlICAgICAgIDczMzkyIHRleHQg LyAgICAgICAgNDgxNjM4IC1yLXhyLXhyLXggIDY5MDg5NiAgcgpyb290ICAgICBtYWtlICAgICAg IDczMzkyIGN0dHkgL2RldiAgICAgICAgIDQ4IGNydy0tLS0tLS0gICB0dHl2MCBydwpyb290ICAg ICBtYWtlICAgICAgIDczMzkyICAgIDAgLyAgICAgICAgMjQwNzgwIC1ydy0tLS0tLS0gICAgIDMy OSBydwpyb290ICAgICBtYWtlICAgICAgIDczMzkyICAgIDYqIHBpcGUgZmZmZmY4MDAyZGFmMDE2 MCA8LT4gZmZmZmY4MDAyZGFmMDAwMCAgICAgIDAgcncKcm9vdCAgICAgbWFrZSAgICAgICA3MzM5 MiAgIDEyKiBwaXBlIGZmZmZmODAwMmRhZjAxNjAgPC0+IGZmZmZmODAwMmRhZjAwMDAgICAgICAw IHJ3CnJvb3QgICAgIHNoICAgICAgICAgNjkzMTAgcm9vdCAvICAgICAgICAgICAgIDIgZHJ3eHIt eHIteCAgICAxMDI0ICByCnJvb3QgICAgIHNoICAgICAgICAgNjkzMTAgICB3ZCAtICAgICAgICAg LSAgID8obmV3bmZzKSAgICAtCnJvb3QgICAgIHNoICAgICAgICAgNjkzMTAgdGV4dCAvICAgICAg ICA4MDI2NDAgLXIteHIteHIteCAgMTQyMTIwICByCnJvb3QgICAgIHNoICAgICAgICAgNjkzMTAg Y3R0eSAvZGV2ICAgICAgICAgNDggY3J3LS0tLS0tLSAgIHR0eXYwIHJ3CnJvb3QgICAgIHNoICAg ICAgICAgNjkzMTAgICAgMCAvICAgICAgICAyNDA3ODAgLXJ3LS0tLS0tLSAgICAgMzI5IHJ3CnJv b3QgICAgIHNoICAgICAgICAgNjkzMTAgICAgNiogcGlwZSBmZmZmZjgwMDJkYWYwMTYwIDwtPiBm ZmZmZjgwMDJkYWYwMDAwICAgICAgMCBydwpyb290ICAgICBzaCAgICAgICAgIDY5MzEwICAgMTIq IHBpcGUgZmZmZmY4MDAyZGFmMDE2MCA8LT4gZmZmZmY4MDAyZGFmMDAwMCAgICAgIDAgcncKcm9v dCAgICAgbWFrZSAgICAgICA2MTY4NyByb290IC8gICAgICAgICAgICAgMiBkcnd4ci14ci14ICAg IDEwMjQgIHIKcm9vdCAgICAgbWFrZSAgICAgICA2MTY4NyAgIHdkIC0gICAgICAgICAtICAgPyhu ZXduZnMpICAgIC0Kcm9vdCAgICAgbWFrZSAgICAgICA2MTY4NyB0ZXh0IC8gICAgICAgIDQ4MTYz OCAtci14ci14ci14ICA2OTA4OTYgIHIKcm9vdCAgICAgbWFrZSAgICAgICA2MTY4NyBjdHR5IC9k ZXYgICAgICAgICA0OCBjcnctLS0tLS0tICAgdHR5djAgcncKcm9vdCAgICAgbWFrZSAgICAgICA2 MTY4NyAgICAwIC8gICAgICAgIDI0MjI5MCAtcnctLS0tLS0tICAgICAxNzIgcncKcm9vdCAgICAg bWFrZSAgICAgICA2MTY4NyAgICA2KiBwaXBlIGZmZmZmODAwMDJhZjU3MzAgPC0+IGZmZmZmODAw MDJhZjU1ZDAgICAgICAwIHJ3CnJvb3QgICAgIG1ha2UgICAgICAgNjE2ODcgICAxMiogcGlwZSBm ZmZmZjgwMDAyYWY1NzMwIDwtPiBmZmZmZjgwMDAyYWY1NWQwICAgICAgMCBydwpyb290ICAgICBz aCAgICAgICAgIDQ5NTk5IHJvb3QgLyAgICAgICAgICAgICAyIGRyd3hyLXhyLXggICAgMTAyNCAg cgpyb290ICAgICBzaCAgICAgICAgIDQ5NTk5ICAgd2QgLSAgICAgICAgIC0gICA/KG5ld25mcykg ICAgLQpyb290ICAgICBzaCAgICAgICAgIDQ5NTk5IHRleHQgLyAgICAgICAgODAyNjQwIC1yLXhy LXhyLXggIDE0MjEyMCAgcgpyb290ICAgICBzaCAgICAgICAgIDQ5NTk5IGN0dHkgL2RldiAgICAg ICAgIDQ4IGNydy0tLS0tLS0gICB0dHl2MCBydwpyb290ICAgICBzaCAgICAgICAgIDQ5NTk5ICAg IDAgLyAgICAgICAgMjQyMjkwIC1ydy0tLS0tLS0gICAgIDE3MiBydwpyb290ICAgICBzaCAgICAg ICAgIDQ5NTk5ICAgIDYqIHBpcGUgZmZmZmY4MDAwMmFmNTczMCA8LT4gZmZmZmY4MDAwMmFmNTVk MCAgICAgIDAgcncKcm9vdCAgICAgc2ggICAgICAgICA0OTU5OSAgIDEyKiBwaXBlIGZmZmZmODAw MDJhZjU3MzAgPC0+IGZmZmZmODAwMDJhZjU1ZDAgICAgICAwIHJ3CnJvb3QgICAgIG1ha2UgICAg ICAgNDk1OTQgcm9vdCAvICAgICAgICAgICAgIDIgZHJ3eHIteHIteCAgICAxMDI0ICByCnJvb3Qg ICAgIG1ha2UgICAgICAgNDk1OTQgICB3ZCAtICAgICAgICAgLSAgID8obmV3bmZzKSAgICAtCnJv b3QgICAgIG1ha2UgICAgICAgNDk1OTQgdGV4dCAvICAgICAgICA0ODE2MzggLXIteHIteHIteCAg NjkwODk2ICByCnJvb3QgICAgIG1ha2UgICAgICAgNDk1OTQgY3R0eSAvZGV2ICAgICAgICAgNDgg Y3J3LS0tLS0tLSAgIHR0eXYwIHJ3CnJvb3QgICAgIG1ha2UgICAgICAgNDk1OTQgICAgMCAvICAg ICAgICAyNDA3NzAgLXJ3LS0tLS0tLSAgICAxMTc2IHJ3CnJvb3QgICAgIG1ha2UgICAgICAgNDk1 OTQgICAgNiogcGlwZSBmZmZmZjgwMDAyOTZlZDAwIDwtPiBmZmZmZjgwMDAyOTZlYmEwICAgICAg MCBydwpyb290ICAgICBtYWtlICAgICAgIDQ5NTk0ICAgMTIqIHBpcGUgZmZmZmY4MDAwMjk2ZWQw MCA8LT4gZmZmZmY4MDAwMjk2ZWJhMCAgICAgIDAgcncKcm9vdCAgICAgc2ggICAgICAgICA0OTU5 MyByb290IC8gICAgICAgICAgICAgMiBkcnd4ci14ci14ICAgIDEwMjQgIHIKcm9vdCAgICAgc2gg ICAgICAgICA0OTU5MyAgIHdkIC0gICAgICAgICAtICAgPyhuZXduZnMpICAgIC0Kcm9vdCAgICAg c2ggICAgICAgICA0OTU5MyB0ZXh0IC8gICAgICAgIDgwMjY0MCAtci14ci14ci14ICAxNDIxMjAg IHIKcm9vdCAgICAgc2ggICAgICAgICA0OTU5MyBjdHR5IC9kZXYgICAgICAgICA0OCBjcnctLS0t LS0tICAgdHR5djAgcncKcm9vdCAgICAgc2ggICAgICAgICA0OTU5MyAgICAwIC8gICAgICAgIDI0 MDc3MCAtcnctLS0tLS0tICAgIDExNzYgcncKcm9vdCAgICAgc2ggICAgICAgICA0OTU5MyAgICA2 KiBwaXBlIGZmZmZmODAwMDI5NmVkMDAgPC0+IGZmZmZmODAwMDI5NmViYTAgICAgICAwIHJ3CnJv b3QgICAgIHNoICAgICAgICAgNDk1OTMgICAxMiogcGlwZSBmZmZmZjgwMDAyOTZlZDAwIDwtPiBm ZmZmZjgwMDAyOTZlYmEwICAgICAgMCBydwpyb290ICAgICBuZXduZnMgMSAgIDMyMzY0IHJvb3Qg LyAgICAgICAgICAgICAyIGRyd3hyLXhyLXggICAgMTAyNCAgcgpyb290ICAgICBuZXduZnMgMSAg IDMyMzY0ICAgd2QgLyAgICAgICAgICAgICAyIGRyd3hyLXhyLXggICAgMTAyNCAgcgpyb290ICAg ICBuZXduZnMgMCAgIDMyMDAyIHJvb3QgLyAgICAgICAgICAgICAyIGRyd3hyLXhyLXggICAgMTAy NCAgcgpyb290ICAgICBuZXduZnMgMCAgIDMyMDAyICAgd2QgLyAgICAgICAgICAgICAyIGRyd3hy LXhyLXggICAgMTAyNCAgcgpyb290ICAgICBtYWtlICAgICAgICAyNzQ5IHJvb3QgLyAgICAgICAg ICAgICAyIGRyd3hyLXhyLXggICAgMTAyNCAgcgpyb290ICAgICBtYWtlICAgICAgICAyNzQ5ICAg d2QgLSAgICAgICAgIC0gICA/KG5ld25mcykgICAgLQpyb290ICAgICBtYWtlICAgICAgICAyNzQ5 IHRleHQgLyAgICAgICAgNDgxNjM4IC1yLXhyLXhyLXggIDY5MDg5NiAgcgpyb290ICAgICBtYWtl ICAgICAgICAyNzQ5IGN0dHkgL2RldiAgICAgICAgIDQ4IGNydy0tLS0tLS0gICB0dHl2MCBydwpy b290ICAgICBtYWtlICAgICAgICAyNzQ5ICAgIDAgLyAgICAgICAgMjQwNzc1IC1ydy0tLS0tLS0g ICAgIDg2NCBydwpyb290ICAgICBtYWtlICAgICAgICAyNzQ5ICAgIDYqIHBpcGUgZmZmZmY4MDAw MmEwNjQ0OCA8LT4gZmZmZmY4MDAwMmEwNjJlOCAgICAgIDAgcncKcm9vdCAgICAgbWFrZSAgICAg ICAgMjc0OSAgIDEyKiBwaXBlIGZmZmZmODAwMDJhMDY0NDggPC0+IGZmZmZmODAwMDJhMDYyZTgg ICAgICAwIHJ3CnJvb3QgICAgIHNoICAgICAgICAgIDI3NDggcm9vdCAvICAgICAgICAgICAgIDIg ZHJ3eHIteHIteCAgICAxMDI0ICByCnJvb3QgICAgIHNoICAgICAgICAgIDI3NDggICB3ZCAtICAg ICAgICAgLSAgID8obmV3bmZzKSAgICAtCnJvb3QgICAgIHNoICAgICAgICAgIDI3NDggdGV4dCAv ICAgICAgICA4MDI2NDAgLXIteHIteHIteCAgMTQyMTIwICByCnJvb3QgICAgIHNoICAgICAgICAg IDI3NDggY3R0eSAvZGV2ICAgICAgICAgNDggY3J3LS0tLS0tLSAgIHR0eXYwIHJ3CnJvb3QgICAg IHNoICAgICAgICAgIDI3NDggICAgMCAvICAgICAgICAyNDA3NzUgLXJ3LS0tLS0tLSAgICAgODY0 IHJ3CnJvb3QgICAgIHNoICAgICAgICAgIDI3NDggICAgNiogcGlwZSBmZmZmZjgwMDAyYTA2NDQ4 IDwtPiBmZmZmZjgwMDAyYTA2MmU4ICAgICAgMCBydwpyb290ICAgICBzaCAgICAgICAgICAyNzQ4 ICAgMTIqIHBpcGUgZmZmZmY4MDAwMmEwNjQ0OCA8LT4gZmZmZmY4MDAwMmEwNjJlOCAgICAgIDAg cncKcm9vdCAgICAgbWFrZSAgICAgICAgMjc0MyByb290IC8gICAgICAgICAgICAgMiBkcnd4ci14 ci14ICAgIDEwMjQgIHIKcm9vdCAgICAgbWFrZSAgICAgICAgMjc0MyAgIHdkIC0gICAgICAgICAt ICAgPyhuZXduZnMpICAgIC0Kcm9vdCAgICAgbWFrZSAgICAgICAgMjc0MyB0ZXh0IC8gICAgICAg IDQ4MTYzOCAtci14ci14ci14ICA2OTA4OTYgIHIKcm9vdCAgICAgbWFrZSAgICAgICAgMjc0MyBj dHR5IC9kZXYgICAgICAgICA0OCBjcnctLS0tLS0tICAgdHR5djAgcncKcm9vdCAgICAgbWFrZSAg ICAgICAgMjc0MyAgICAwIC9kZXYgICAgICAgICA0OCBjcnctLS0tLS0tICAgdHR5djAgcncKcm9v dCAgICAgbWFrZSAgICAgICAgMjc0MyAgICA2IC9kZXYgICAgICAgICA0OCBjcnctLS0tLS0tICAg dHR5djAgcncKcm9vdCAgICAgbWFrZSAgICAgICAgMjc0MyAgIDEyIC9kZXYgICAgICAgICA0OCBj cnctLS0tLS0tICAgdHR5djAgcncKcm9vdCAgICAgY3NoICAgICAgICAgMTYwMCByb290IC8gICAg ICAgICAgICAgMiBkcnd4ci14ci14ICAgIDEwMjQgIHIKcm9vdCAgICAgY3NoICAgICAgICAgMTYw MCAgIHdkIC0gICAgICAgICAtICAgPyhuZXduZnMpICAgIC0Kcm9vdCAgICAgY3NoICAgICAgICAg MTYwMCB0ZXh0IC8gICAgICAgIDgwMjYwNiAtci14ci14ci14ICAzODIzNTIgIHIKcm9vdCAgICAg Y3NoICAgICAgICAgMTYwMCBjdHR5IC9kZXYgICAgICAgICA0OCBjcnctLS0tLS0tICAgdHR5djAg cncKcm9vdCAgICAgZ2V0dHkgICAgICAgMTAxMyByb290IC8gICAgICAgICAgICAgMiBkcnd4ci14 ci14ICAgIDEwMjQgIHIKcm9vdCAgICAgZ2V0dHkgICAgICAgMTAxMyAgIHdkIC8gICAgICAgICAg ICAgMiBkcnd4ci14ci14ICAgIDEwMjQgIHIKcm9vdCAgICAgZ2V0dHkgICAgICAgMTAxMyB0ZXh0 IC8gICAgICAgIDQ4NTc2MiAtci14ci14ci14ICAgMjgzMzYgIHIKcm9vdCAgICAgZ2V0dHkgICAg ICAgMTAxMyBjdHR5IC9kZXYgICAgICAgICA1NSBjcnctLS0tLS0tICAgdHR5djcgcncKcm9vdCAg ICAgZ2V0dHkgICAgICAgMTAxMyAgICAwIC9kZXYgICAgICAgICA1NSBjcnctLS0tLS0tICAgdHR5 djcgcncKcm9vdCAgICAgZ2V0dHkgICAgICAgMTAxMiByb290IC8gICAgICAgICAgICAgMiBkcnd4 ci14ci14ICAgIDEwMjQgIHIKcm9vdCAgICAgZ2V0dHkgICAgICAgMTAxMiAgIHdkIC8gICAgICAg ICAgICAgMiBkcnd4ci14ci14ICAgIDEwMjQgIHIKcm9vdCAgICAgZ2V0dHkgICAgICAgMTAxMiB0 ZXh0IC8gICAgICAgIDQ4NTc2MiAtci14ci14ci14ICAgMjgzMzYgIHIKcm9vdCAgICAgZ2V0dHkg ICAgICAgMTAxMiBjdHR5IC9kZXYgICAgICAgICA1NCBjcnctLS0tLS0tICAgdHR5djYgcncKcm9v dCAgICAgZ2V0dHkgICAgICAgMTAxMiAgICAwIC9kZXYgICAgICAgICA1NCBjcnctLS0tLS0tICAg dHR5djYgcncKcm9vdCAgICAgZ2V0dHkgICAgICAgMTAxMSByb290IC8gICAgICAgICAgICAgMiBk cnd4ci14ci14ICAgIDEwMjQgIHIKcm9vdCAgICAgZ2V0dHkgICAgICAgMTAxMSAgIHdkIC8gICAg ICAgICAgICAgMiBkcnd4ci14ci14ICAgIDEwMjQgIHIKcm9vdCAgICAgZ2V0dHkgICAgICAgMTAx MSB0ZXh0IC8gICAgICAgIDQ4NTc2MiAtci14ci14ci14ICAgMjgzMzYgIHIKcm9vdCAgICAgZ2V0 dHkgICAgICAgMTAxMSBjdHR5IC9kZXYgICAgICAgICA1MyBjcnctLS0tLS0tICAgdHR5djUgcncK cm9vdCAgICAgZ2V0dHkgICAgICAgMTAxMSAgICAwIC9kZXYgICAgICAgICA1MyBjcnctLS0tLS0t ICAgdHR5djUgcncKcm9vdCAgICAgZ2V0dHkgICAgICAgMTAxMCByb290IC8gICAgICAgICAgICAg MiBkcnd4ci14ci14ICAgIDEwMjQgIHIKcm9vdCAgICAgZ2V0dHkgICAgICAgMTAxMCAgIHdkIC8g ICAgICAgICAgICAgMiBkcnd4ci14ci14ICAgIDEwMjQgIHIKcm9vdCAgICAgZ2V0dHkgICAgICAg MTAxMCB0ZXh0IC8gICAgICAgIDQ4NTc2MiAtci14ci14ci14ICAgMjgzMzYgIHIKcm9vdCAgICAg Z2V0dHkgICAgICAgMTAxMCBjdHR5IC9kZXYgICAgICAgICA1MiBjcnctLS0tLS0tICAgdHR5djQg cncKcm9vdCAgICAgZ2V0dHkgICAgICAgMTAxMCAgICAwIC9kZXYgICAgICAgICA1MiBjcnctLS0t LS0tICAgdHR5djQgcncKcm9vdCAgICAgZ2V0dHkgICAgICAgMTAwOSByb290IC8gICAgICAgICAg ICAgMiBkcnd4ci14ci14ICAgIDEwMjQgIHIKcm9vdCAgICAgZ2V0dHkgICAgICAgMTAwOSAgIHdk IC8gICAgICAgICAgICAgMiBkcnd4ci14ci14ICAgIDEwMjQgIHIKcm9vdCAgICAgZ2V0dHkgICAg ICAgMTAwOSB0ZXh0IC8gICAgICAgIDQ4NTc2MiAtci14ci14ci14ICAgMjgzMzYgIHIKcm9vdCAg ICAgZ2V0dHkgICAgICAgMTAwOSBjdHR5IC9kZXYgICAgICAgICA1MSBjcnctLS0tLS0tICAgdHR5 djMgcncKcm9vdCAgICAgZ2V0dHkgICAgICAgMTAwOSAgICAwIC9kZXYgICAgICAgICA1MSBjcnct LS0tLS0tICAgdHR5djMgcncKcm9vdCAgICAgZ2V0dHkgICAgICAgMTAwOCByb290IC8gICAgICAg ICAgICAgMiBkcnd4ci14ci14ICAgIDEwMjQgIHIKcm9vdCAgICAgZ2V0dHkgICAgICAgMTAwOCAg IHdkIC8gICAgICAgICAgICAgMiBkcnd4ci14ci14ICAgIDEwMjQgIHIKcm9vdCAgICAgZ2V0dHkg ICAgICAgMTAwOCB0ZXh0IC8gICAgICAgIDQ4NTc2MiAtci14ci14ci14ICAgMjgzMzYgIHIKcm9v dCAgICAgZ2V0dHkgICAgICAgMTAwOCBjdHR5IC9kZXYgICAgICAgICA1MCBjcnctLS0tLS0tICAg dHR5djIgcncKcm9vdCAgICAgZ2V0dHkgICAgICAgMTAwOCAgICAwIC9kZXYgICAgICAgICA1MCBj cnctLS0tLS0tICAgdHR5djIgcncKcm9vdCAgICAgZ2V0dHkgICAgICAgMTAwNyByb290IC8gICAg ICAgICAgICAgMiBkcnd4ci14ci14ICAgIDEwMjQgIHIKcm9vdCAgICAgZ2V0dHkgICAgICAgMTAw NyAgIHdkIC8gICAgICAgICAgICAgMiBkcnd4ci14ci14ICAgIDEwMjQgIHIKcm9vdCAgICAgZ2V0 dHkgICAgICAgMTAwNyB0ZXh0IC8gICAgICAgIDQ4NTc2MiAtci14ci14ci14ICAgMjgzMzYgIHIK cm9vdCAgICAgZ2V0dHkgICAgICAgMTAwNyBjdHR5IC9kZXYgICAgICAgICA0OSBjcnctLS0tLS0t ICAgdHR5djEgcncKcm9vdCAgICAgZ2V0dHkgICAgICAgMTAwNyAgICAwIC9kZXYgICAgICAgICA0 OSBjcnctLS0tLS0tICAgdHR5djEgcncKcm9vdCAgICAgbG9naW4gICAgICAgMTAwNiByb290IC8g ICAgICAgICAgICAgMiBkcnd4ci14ci14ICAgIDEwMjQgIHIKcm9vdCAgICAgbG9naW4gICAgICAg MTAwNiAgIHdkIC8gICAgICAgIDExMjM1ODQgZHJ3eHIteHIteCAgICAgNTEyICByCnJvb3QgICAg IGxvZ2luICAgICAgIDEwMDYgdGV4dCAvICAgICAgICA0ODM3NzAgLXItc3IteHIteCAgIDI1ODgw ICByCnJvb3QgICAgIGxvZ2luICAgICAgIDEwMDYgY3R0eSAvZGV2ICAgICAgICAgNDggY3J3LS0t LS0tLSAgIHR0eXYwIHJ3CnJvb3QgICAgIGxvZ2luICAgICAgIDEwMDYgICAgMCAvZGV2ICAgICAg ICAgNDggY3J3LS0tLS0tLSAgIHR0eXYwIHJ3CnJvb3QgICAgIGJzbm1wZCAgICAgICA5OTkgcm9v dCAvICAgICAgICAgICAgIDIgZHJ3eHIteHIteCAgICAxMDI0ICByCnJvb3QgICAgIGJzbm1wZCAg ICAgICA5OTkgICB3ZCAvICAgICAgICAgICAgIDIgZHJ3eHIteHIteCAgICAxMDI0ICByCnJvb3Qg ICAgIGJzbm1wZCAgICAgICA5OTkgdGV4dCAvICAgICAgICA0ODQ4MTkgLXIteHIteHIteCAgMTI2 MDE2ICByCnJvb3QgICAgIGJzbm1wZCAgICAgICA5OTkgICAgMCAvZGV2ICAgICAgICAgMTUgY3J3 LXJ3LXJ3LSAgICBudWxsIHJ3CnJvb3QgICAgIGJzbm1wZCAgICAgICA5OTkgICAgNiAvZGV2ICAg ICAgICAgMTUgY3J3LXJ3LXJ3LSAgICBudWxsIHJ3CnJvb3QgICAgIGJzbm1wZCAgICAgICA5OTkg ICAxMiAvZGV2ICAgICAgICAgMTUgY3J3LXJ3LXJ3LSAgICBudWxsIHJ3CnJvb3QgICAgIGNyb24g ICAgICAgICA5NTggcm9vdCAvICAgICAgICAgICAgIDIgZHJ3eHIteHIteCAgICAxMDI0ICByCnJv b3QgICAgIGNyb24gICAgICAgICA5NTggICB3ZCAvICAgICAgICA3MjIzMjUgZHJ3eHIteC0tLSAg ICAgNTEyICByCnJvb3QgICAgIGNyb24gICAgICAgICA5NTggdGV4dCAvICAgICAgICA0ODUxMTIg LXIteHIteHIteCAgIDQxMzM2ICByCnJvb3QgICAgIGNyb24gICAgICAgICA5NTggICAgMCAvZGV2 ICAgICAgICAgMTUgY3J3LXJ3LXJ3LSAgICBudWxsIHJ3CnNtbXNwICAgIHNlbmRtYWlsICAgICA5 NDggcm9vdCAvICAgICAgICAgICAgIDIgZHJ3eHIteHIteCAgICAxMDI0ICByCnNtbXNwICAgIHNl bmRtYWlsICAgICA5NDggICB3ZCAvICAgICAgICA3MjIzNDQgZHJ3eHJ3eC0tLSAgICAgNTEyICBy CnNtbXNwICAgIHNlbmRtYWlsICAgICA5NDggdGV4dCAvICAgICAgICA1NjIzMDYgLXIteHItc3It eCAgNjkyNTA0ICByCnNtbXNwICAgIHNlbmRtYWlsICAgICA5NDggICAgMCAvZGV2ICAgICAgICAg MTUgY3J3LXJ3LXJ3LSAgICBudWxsICByCnJvb3QgICAgIHNlbmRtYWlsICAgICA5MzQgcm9vdCAv ICAgICAgICAgICAgIDIgZHJ3eHIteHIteCAgICAxMDI0ICByCnJvb3QgICAgIHNlbmRtYWlsICAg ICA5MzQgICB3ZCAvICAgICAgICA3MjIzNDMgZHJ3eHIteHIteCAgICAgNTEyICByCnJvb3QgICAg IHNlbmRtYWlsICAgICA5MzQgdGV4dCAvICAgICAgICA1NjIzMDYgLXIteHItc3IteCAgNjkyNTA0 ICByCnJvb3QgICAgIHNlbmRtYWlsICAgICA5MzQgICAgMCAvZGV2ICAgICAgICAgMTUgY3J3LXJ3 LXJ3LSAgICBudWxsICByCnJvb3QgICAgIHNzaGQgICAgICAgICA4OTkgcm9vdCAvICAgICAgICAg ICAgIDIgZHJ3eHIteHIteCAgICAxMDI0ICByCnJvb3QgICAgIHNzaGQgICAgICAgICA4OTkgICB3 ZCAvICAgICAgICAgICAgIDIgZHJ3eHIteHIteCAgICAxMDI0ICByCnJvb3QgICAgIHNzaGQgICAg ICAgICA4OTkgdGV4dCAvICAgICAgICA0ODE3NjggLXIteHIteHIteCAgMjk3NzEyICByCnJvb3Qg ICAgIHNzaGQgICAgICAgICA4OTkgICAgMCAvZGV2ICAgICAgICAgMTUgY3J3LXJ3LXJ3LSAgICBu dWxsIHJ3CnJvb3QgICAgIHNoICAgICAgICAgICA3NTUgcm9vdCAvICAgICAgICAgICAgIDIgZHJ3 eHIteHIteCAgICAxMDI0ICByCnJvb3QgICAgIHNoICAgICAgICAgICA3NTUgICB3ZCAvICAgICAg ICAgICAgIDIgZHJ3eHIteHIteCAgICAxMDI0ICByCnJvb3QgICAgIHNoICAgICAgICAgICA3NTUg dGV4dCAvICAgICAgICA4MDI2NDAgLXIteHIteHIteCAgMTQyMTIwICByCnJvb3QgICAgIHNoICAg ICAgICAgICA3NTUgICAgMCAvZGV2ICAgICAgICAgMTUgY3J3LXJ3LXJ3LSAgICBudWxsICByCnJv b3QgICAgIHNoICAgICAgICAgICA3NTUgICAgNiAtICAgICAgICAgLSAgICAgICAgIGJhZCAgICAt CnJvb3QgICAgIG50cGQgICAgICAgICA3NDAgcm9vdCAvICAgICAgICAgICAgIDIgZHJ3eHIteHIt eCAgICAxMDI0ICByCnJvb3QgICAgIG50cGQgICAgICAgICA3NDAgICB3ZCAvICAgICAgICAgICAg IDIgZHJ3eHIteHIteCAgICAxMDI0ICByCnJvb3QgICAgIG50cGQgICAgICAgICA3NDAgdGV4dCAv ICAgICAgICA0ODU4MTUgLXIteHIteHIteCAgNDMyNzIwICByCnJvb3QgICAgIG50cGQgICAgICAg ICA3NDAgICAgMCAvZGV2ICAgICAgICAgMTUgY3J3LXJ3LXJ3LSAgICBudWxsIHJ3CnJvb3QgICAg IG50cGQgICAgICAgICA3NDAgICAgNiAvZGV2ICAgICAgICAgMTUgY3J3LXJ3LXJ3LSAgICBudWxs IHJ3CnJvb3QgICAgIG50cGQgICAgICAgICA3NDAgICAxMiAvZGV2ICAgICAgICAgMTUgY3J3LXJ3 LXJ3LSAgICBudWxsIHJ3CnJvb3QgICAgIG50cGQgICAgICAgICA3NDAgICAxOCogbG9jYWwgZGdy YW0gZmZmZmY4MDAwMmIzN2I0MCA8LT4gZmZmZmY4MDAwMmIzNzg3MApyb290ICAgICBzeXNsb2dk ICAgICAgNjUxIHJvb3QgLyAgICAgICAgICAgICAyIGRyd3hyLXhyLXggICAgMTAyNCAgcgpyb290 ICAgICBzeXNsb2dkICAgICAgNjUxICAgd2QgLyAgICAgICAgICAgICAyIGRyd3hyLXhyLXggICAg MTAyNCAgcgpyb290ICAgICBzeXNsb2dkICAgICAgNjUxIHRleHQgLyAgICAgICAgNDgzMDk5IC1y LXhyLXhyLXggICA0MDMzNiAgcgpyb290ICAgICBzeXNsb2dkICAgICAgNjUxICAgIDAgL2RldiAg ICAgICAgIDE1IGNydy1ydy1ydy0gICAgbnVsbCBydwpyb290ICAgICBzeXNsb2dkICAgICAgNjUx ICAgIDYgL2RldiAgICAgICAgIDE1IGNydy1ydy1ydy0gICAgbnVsbCBydwpyb290ICAgICBzeXNs b2dkICAgICAgNjUxICAgMTIgL2RldiAgICAgICAgIDE1IGNydy1ydy1ydy0gICAgbnVsbCBydwpy b290ICAgICBzeXNsb2dkICAgICAgNjUxICAgMTggLyAgICAgICAgNzIyNDg1IC1ydy0tLS0tLS0g ICAgICAgMyAgdwpyb290ICAgICBkZXZkICAgICAgICAgNTU3IHJvb3QgLyAgICAgICAgICAgICAy IGRyd3hyLXhyLXggICAgMTAyNCAgcgpyb290ICAgICBkZXZkICAgICAgICAgNTU3ICAgd2QgLyAg ICAgICAgICAgICAyIGRyd3hyLXhyLXggICAgMTAyNCAgcgpyb290ICAgICBkZXZkICAgICAgICAg NTU3IHRleHQgLyAgICAgICAgMzIyNjU3IC1yLXhyLXhyLXggIDYzMzQ2NCAgcgpyb290ICAgICBk ZXZkICAgICAgICAgNTU3ICAgIDAgL2RldiAgICAgICAgIDE1IGNydy1ydy1ydy0gICAgbnVsbCBy dwpyb290ICAgICBkZXZkICAgICAgICAgNTU3ICAgIDYgL2RldiAgICAgICAgIDE1IGNydy1ydy1y dy0gICAgbnVsbCBydwpyb290ICAgICBtb3VzZWQgICAgICAgNTQwIHJvb3QgLyAgICAgICAgICAg ICAyIGRyd3hyLXhyLXggICAgMTAyNCAgcgpyb290ICAgICBtb3VzZWQgICAgICAgNTQwICAgd2Qg LyAgICAgICAgICAgICAyIGRyd3hyLXhyLXggICAgMTAyNCAgcgpyb290ICAgICBtb3VzZWQgICAg ICAgNTQwIHRleHQgLyAgICAgICAgNDg1NzkyIC1yLXhyLXhyLXggICAzOTIzMiAgcgpyb290ICAg ICBtb3VzZWQgICAgICAgNTQwICAgIDAgL2RldiAgICAgICAgIDE1IGNydy1ydy1ydy0gICAgbnVs bCBydwpfZGhjcCAgICBkaGNsaWVudCAgICAgNTM1IHJvb3QgLyAgICAgICAgNzIyMzIxIGRyLXhy LXhyLXggICAgIDUxMiAgcgpfZGhjcCAgICBkaGNsaWVudCAgICAgNTM1ICAgd2QgLyAgICAgICAg NzIyMzIxIGRyLXhyLXhyLXggICAgIDUxMiAgcgpfZGhjcCAgICBkaGNsaWVudCAgICAgNTM1IGph aWwgLyAgICAgICAgNzIyMzIxIGRyLXhyLXhyLXggICAgIDUxMiAgcgpfZGhjcCAgICBkaGNsaWVu dCAgICAgNTM1IHRleHQgLyAgICAgICAgMzIyNjUwIC1yLXhyLXhyLXggICA5MjczNiAgcgpfZGhj cCAgICBkaGNsaWVudCAgICAgNTM1ICAgIDAgL2RldiAgICAgICAgIDE1IGNydy1ydy1ydy0gICAg bnVsbCBydwpfZGhjcCAgICBkaGNsaWVudCAgICAgNTM1ICAgIDYgL2RldiAgICAgICAgIDE1IGNy dy1ydy1ydy0gICAgbnVsbCBydwpyb290ICAgICBkaGNsaWVudCAgICAgNTI1IHJvb3QgLyAgICAg ICAgICAgICAyIGRyd3hyLXhyLXggICAgMTAyNCAgcgpyb290ICAgICBkaGNsaWVudCAgICAgNTI1 ICAgd2QgLyAgICAgICAgICAgICAyIGRyd3hyLXhyLXggICAgMTAyNCAgcgpyb290ICAgICBkaGNs aWVudCAgICAgNTI1IHRleHQgLyAgICAgICAgMzIyNjUwIC1yLXhyLXhyLXggICA5MjczNiAgcgpy b290ICAgICBkaGNsaWVudCAgICAgNTI1ICAgIDAgL2RldiAgICAgICAgIDE1IGNydy1ydy1ydy0g ICAgbnVsbCBydwpyb290ICAgICBkaGNsaWVudCAgICAgNTI1ICAgIDYgL2RldiAgICAgICAgIDE1 IGNydy1ydy1ydy0gICAgbnVsbCBydwpfZGhjcCAgICBkaGNsaWVudCAgICAgNTE1IHJvb3QgLyAg ICAgICAgNzIyMzIxIGRyLXhyLXhyLXggICAgIDUxMiAgcgpfZGhjcCAgICBkaGNsaWVudCAgICAg NTE1ICAgd2QgLyAgICAgICAgNzIyMzIxIGRyLXhyLXhyLXggICAgIDUxMiAgcgpfZGhjcCAgICBk aGNsaWVudCAgICAgNTE1IGphaWwgLyAgICAgICAgNzIyMzIxIGRyLXhyLXhyLXggICAgIDUxMiAg cgpfZGhjcCAgICBkaGNsaWVudCAgICAgNTE1IHRleHQgLyAgICAgICAgMzIyNjUwIC1yLXhyLXhy LXggICA5MjczNiAgcgpfZGhjcCAgICBkaGNsaWVudCAgICAgNTE1ICAgIDAgL2RldiAgICAgICAg IDE1IGNydy1ydy1ydy0gICAgbnVsbCBydwpfZGhjcCAgICBkaGNsaWVudCAgICAgNTE1ICAgIDYg L2RldiAgICAgICAgIDE1IGNydy1ydy1ydy0gICAgbnVsbCBydwpyb290ICAgICBkaGNsaWVudCAg ICAgNTA1IHJvb3QgLyAgICAgICAgICAgICAyIGRyd3hyLXhyLXggICAgMTAyNCAgcgpyb290ICAg ICBkaGNsaWVudCAgICAgNTA1ICAgd2QgLyAgICAgICAgICAgICAyIGRyd3hyLXhyLXggICAgMTAy NCAgcgpyb290ICAgICBkaGNsaWVudCAgICAgNTA1IHRleHQgLyAgICAgICAgMzIyNjUwIC1yLXhy LXhyLXggICA5MjczNiAgcgpyb290ICAgICBkaGNsaWVudCAgICAgNTA1ICAgIDAgL2RldiAgICAg ICAgIDE1IGNydy1ydy1ydy0gICAgbnVsbCBydwpyb290ICAgICBkaGNsaWVudCAgICAgNTA1ICAg IDYgL2RldiAgICAgICAgIDE1IGNydy1ydy1ydy0gICAgbnVsbCBydwpfZGhjcCAgICBkaGNsaWVu dCAgICAgNDk1IHJvb3QgLyAgICAgICAgNzIyMzIxIGRyLXhyLXhyLXggICAgIDUxMiAgcgpfZGhj cCAgICBkaGNsaWVudCAgICAgNDk1ICAgd2QgLyAgICAgICAgNzIyMzIxIGRyLXhyLXhyLXggICAg IDUxMiAgcgpfZGhjcCAgICBkaGNsaWVudCAgICAgNDk1IGphaWwgLyAgICAgICAgNzIyMzIxIGRy LXhyLXhyLXggICAgIDUxMiAgcgpfZGhjcCAgICBkaGNsaWVudCAgICAgNDk1IHRleHQgLyAgICAg ICAgMzIyNjUwIC1yLXhyLXhyLXggICA5MjczNiAgcgpfZGhjcCAgICBkaGNsaWVudCAgICAgNDk1 ICAgIDAgL2RldiAgICAgICAgIDE1IGNydy1ydy1ydy0gICAgbnVsbCBydwpfZGhjcCAgICBkaGNs aWVudCAgICAgNDk1ICAgIDYgL2RldiAgICAgICAgIDE1IGNydy1ydy1ydy0gICAgbnVsbCBydwpy b290ICAgICBkaGNsaWVudCAgICAgNDU5IHJvb3QgLyAgICAgICAgICAgICAyIGRyd3hyLXhyLXgg ICAgMTAyNCAgcgpyb290ICAgICBkaGNsaWVudCAgICAgNDU5ICAgd2QgLyAgICAgICAgICAgICAy IGRyd3hyLXhyLXggICAgMTAyNCAgcgpyb290ICAgICBkaGNsaWVudCAgICAgNDU5IHRleHQgLyAg ICAgICAgMzIyNjUwIC1yLXhyLXhyLXggICA5MjczNiAgcgpyb290ICAgICBkaGNsaWVudCAgICAg NDU5ICAgIDAgL2RldiAgICAgICAgIDE1IGNydy1ydy1ydy0gICAgbnVsbCBydwpyb290ICAgICBk aGNsaWVudCAgICAgNDU5ICAgIDYgL2RldiAgICAgICAgIDE1IGNydy1ydy1ydy0gICAgbnVsbCBy dwpyb290ICAgICBpbml0ICAgICAgICAgICAxIHJvb3QgLyAgICAgICAgICAgICAyIGRyd3hyLXhy LXggICAgMTAyNCAgcgpyb290ICAgICBpbml0ICAgICAgICAgICAxICAgd2QgLyAgICAgICAgICAg ICAyIGRyd3hyLXhyLXggICAgMTAyNCAgcgpyb290ICAgICBpbml0ICAgICAgICAgICAxIHRleHQg LyAgICAgICAgMzIyNjY3IC1yLXhyLXhyLXggIDk2NjcxMiAgcgpyb290ICAgICBrZXJuZWwgICAg ICAgICAwIHJvb3QgLyAgICAgICAgICAgICAyIGRyd3hyLXhyLXggICAgMTAyNCAgcgpyb290ICAg ICBrZXJuZWwgICAgICAgICAwICAgd2QgLyAgICAgICAgICAgICAyIGRyd3hyLXhyLXggICAgMTAy NCAgcgoKLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tCmRtZXNnCgpDb3B5cmlnaHQgKGMpIDE5OTItMjAxNCBUaGUg RnJlZUJTRCBQcm9qZWN0LgpDb3B5cmlnaHQgKGMpIDE5NzksIDE5ODAsIDE5ODMsIDE5ODYsIDE5 ODgsIDE5ODksIDE5OTEsIDE5OTIsIDE5OTMsIDE5OTQKCVRoZSBSZWdlbnRzIG9mIHRoZSBVbml2 ZXJzaXR5IG9mIENhbGlmb3JuaWEuIEFsbCByaWdodHMgcmVzZXJ2ZWQuCkZyZWVCU0QgaXMgYSBy ZWdpc3RlcmVkIHRyYWRlbWFyayBvZiBUaGUgRnJlZUJTRCBGb3VuZGF0aW9uLgpGcmVlQlNEIDEw LjAtU1RBQkxFICM2IHIyNjQ5MTVNOiBTYXQgQXByIDI2IDExOjA1OjQxIEpTVCAyMDE0CiAgICBy b290QHRlc3QtMDEuZ3JlZy5qcDovdXNyL29iai91c3Ivc3JjL3N5cy9HRU5FUklDIGFtZDY0CkZy ZWVCU0QgY2xhbmcgdmVyc2lvbiAzLjQgKHRhZ3MvUkVMRUFTRV8zNC9maW5hbCAxOTc5NTYpIDIw MTQwMjE2ClhFTjogSHlwZXJ2aXNvciB2ZXJzaW9uIDQuMSBkZXRlY3RlZC4KQ1BVOiBJbnRlbChS KSBYZW9uKFIpIENQVSAgICAgICAgICAgWDMzMjAgIEAgMi41MEdIeiAoMjUwMC4zMC1NSHogSzgt Y2xhc3MgQ1BVKQogIE9yaWdpbiA9ICJHZW51aW5lSW50ZWwiICBJZCA9IDB4MTA2NzcgIEZhbWls eSA9IDB4NiAgTW9kZWwgPSAweDE3ICBTdGVwcGluZyA9IDcKICBGZWF0dXJlcz0weDc4MWZiZmY8 RlBVLFZNRSxERSxQU0UsVFNDLE1TUixQQUUsTUNFLENYOCxBUElDLFNFUCxNVFJSLFBHRSxNQ0Es Q01PVixQQVQsTU1YLEZYU1IsU1NFLFNTRTI+CiAgRmVhdHVyZXMyPTB4ODEyODIyMDE8U1NFMyxT U1NFMyxDWDE2LFNTRTQuMSx4MkFQSUMsVFNDRExULEhWPgogIEFNRCBGZWF0dXJlcz0weDIwMTAw ODAwPFNZU0NBTEwsTlgsTE0+CiAgQU1EIEZlYXR1cmVzMj0weDE8TEFIRj4KcmVhbCBtZW1vcnkg ID0gMTA2OTU0NzUyMCAoMTAyMCBNQikKYXZhaWwgbWVtb3J5ID0gMTAwNzcxNDMwNCAoOTYxIE1C KQpFdmVudCB0aW1lciAiTEFQSUMiIHF1YWxpdHkgNDAwCkFDUEkgQVBJQyBUYWJsZTogPFhlbiBI Vk0+CkZyZWVCU0QvU01QOiBNdWx0aXByb2Nlc3NvciBTeXN0ZW0gRGV0ZWN0ZWQ6IDQgQ1BVcwpG cmVlQlNEL1NNUDogNCBwYWNrYWdlKHMpIHggMSBjb3JlKHMpCiBjcHUwIChCU1ApOiBBUElDIElE OiAgMAogY3B1MSAoQVApOiBBUElDIElEOiAgMgogY3B1MiAoQVApOiBBUElDIElEOiAgNAogY3B1 MyAoQVApOiBBUElDIElEOiAgNgppb2FwaWMwOiBDaGFuZ2luZyBBUElDIElEIHRvIDEKTUFEVDog Rm9yY2luZyBhY3RpdmUtbG93IHBvbGFyaXR5IGFuZCBsZXZlbCB0cmlnZ2VyIGZvciBTQ0kKaW9h cGljMCA8VmVyc2lvbiAxLjE+IGlycXMgMC00NyBvbiBtb3RoZXJib2FyZAprYmQxIGF0IGtiZG11 eDAKcmFuZG9tOiA8U29mdHdhcmUsIFlhcnJvdz4gaW5pdGlhbGl6ZWQKeGVuX2V0MDogPFhlbiBQ ViBDbG9jaz4gb24gbW90aGVyYm9hcmQKRXZlbnQgdGltZXIgIlhFTlRJTUVSIiBmcmVxdWVuY3kg MTAwMDAwMDAwMCBIeiBxdWFsaXR5IDk1MApUaW1lY291bnRlciAiWEVOVElNRVIiIGZyZXF1ZW5j eSAxMDAwMDAwMDAwIEh6IHF1YWxpdHkgOTUwCmFjcGkwOiA8WGVuPiBvbiBtb3RoZXJib2FyZAph Y3BpMDogUG93ZXIgQnV0dG9uIChmaXhlZCkKYWNwaTA6IFNsZWVwIEJ1dHRvbiAoZml4ZWQpCmFj cGkwOiByZXNlcnZhdGlvbiBvZiAwLCBhMDAwMCAoMykgZmFpbGVkCmNwdTA6IDxBQ1BJIENQVT4g b24gYWNwaTAKY3B1MTogPEFDUEkgQ1BVPiBvbiBhY3BpMApjcHUyOiA8QUNQSSBDUFU+IG9uIGFj cGkwCmNwdTM6IDxBQ1BJIENQVT4gb24gYWNwaTAKaHBldDA6IDxIaWdoIFByZWNpc2lvbiBFdmVu dCBUaW1lcj4gaW9tZW0gMHhmZWQwMDAwMC0weGZlZDAwM2ZmIG9uIGFjcGkwClRpbWVjb3VudGVy ICJIUEVUIiBmcmVxdWVuY3kgNjI1MDAwMDAgSHogcXVhbGl0eSA5NTAKYXR0aW1lcjA6IDxBVCB0 aW1lcj4gcG9ydCAweDQwLTB4NDMgaXJxIDAgb24gYWNwaTAKVGltZWNvdW50ZXIgImk4MjU0IiBm cmVxdWVuY3kgMTE5MzE4MiBIeiBxdWFsaXR5IDAKRXZlbnQgdGltZXIgImk4MjU0IiBmcmVxdWVu Y3kgMTE5MzE4MiBIeiBxdWFsaXR5IDEwMAphdHJ0YzA6IDxBVCByZWFsdGltZSBjbG9jaz4gcG9y dCAweDcwLTB4NzEgaXJxIDggb24gYWNwaTAKRXZlbnQgdGltZXIgIlJUQyIgZnJlcXVlbmN5IDMy NzY4IEh6IHF1YWxpdHkgMApUaW1lY291bnRlciAiQUNQSS1mYXN0IiBmcmVxdWVuY3kgMzU3OTU0 NSBIeiBxdWFsaXR5IDkwMAphY3BpX3RpbWVyMDogPDMyLWJpdCB0aW1lciBhdCAzLjU3OTU0NU1I ej4gcG9ydCAweDFmNDgtMHgxZjRiIG9uIGFjcGkwCnBjaWIwOiA8QUNQSSBIb3N0LVBDSSBicmlk Z2U+IHBvcnQgMHhjZjgtMHhjZmYgb24gYWNwaTAKcGNpMDogPEFDUEkgUENJIGJ1cz4gb24gcGNp YjAKaXNhYjA6IDxQQ0ktSVNBIGJyaWRnZT4gYXQgZGV2aWNlIDEuMCBvbiBwY2kwCmlzYTA6IDxJ U0EgYnVzPiBvbiBpc2FiMAphdGFwY2kwOiA8SW50ZWwgUElJWDMgV0RNQTIgY29udHJvbGxlcj4g cG9ydCAweDFmMC0weDFmNywweDNmNiwweDE3MC0weDE3NywweDM3NiwweGM0MjAtMHhjNDJmIGF0 IGRldmljZSAxLjEgb24gcGNpMAphdGEwOiA8QVRBIGNoYW5uZWw+IGF0IGNoYW5uZWwgMCBvbiBh dGFwY2kwCmF0YTE6IDxBVEEgY2hhbm5lbD4gYXQgY2hhbm5lbCAxIG9uIGF0YXBjaTAKdWhjaTA6 IDxJbnRlbCA4MjM3MVNCIChQSUlYMykgVVNCIGNvbnRyb2xsZXI+IHBvcnQgMHhjNDAwLTB4YzQx ZiBpcnEgMjMgYXQgZGV2aWNlIDEuMiBvbiBwY2kwCnVzYnVzMDogY29udHJvbGxlciBkaWQgbm90 IHN0b3AKdXNidXMwIG9uIHVoY2kwCnBjaTA6IDxicmlkZ2U+IGF0IGRldmljZSAxLjMgKG5vIGRy aXZlciBhdHRhY2hlZCkKdmdhcGNpMDogPFZHQS1jb21wYXRpYmxlIGRpc3BsYXk+IG1lbSAweGYw MDAwMDAwLTB4ZjFmZmZmZmYsMHhmMzAwMDAwMC0weGYzMDAwZmZmIGlycSAyNCBhdCBkZXZpY2Ug Mi4wIG9uIHBjaTAKdmdhcGNpMDogQm9vdCB2aWRlbyBkZXZpY2UKeGVucGNpMDogPFhlbiBQbGF0 Zm9ybSBEZXZpY2U+IHBvcnQgMHhjMDAwLTB4YzBmZiBtZW0gMHhmMjAwMDAwMC0weGYyZmZmZmZm IGlycSAzMCBhdCBkZXZpY2UgMy4wIG9uIHBjaTAKeGVuc3RvcmUwOiA8WGVuU3RvcmU+IG9uIHhl bnBjaTAKYXRrYmRjMDogPEtleWJvYXJkIGNvbnRyb2xsZXIgKGk4MDQyKT4gcG9ydCAweDYwLDB4 NjQgaXJxIDEgb24gYWNwaTAKYXRrYmQwOiA8QVQgS2V5Ym9hcmQ+IGlycSAxIG9uIGF0a2JkYzAK a2JkMCBhdCBhdGtiZDAKYXRrYmQwOiBbR0lBTlQtTE9DS0VEXQpwc20wOiA8UFMvMiBNb3VzZT4g aXJxIDEyIG9uIGF0a2JkYzAKcHNtMDogW0dJQU5ULUxPQ0tFRF0KcHNtMDogbW9kZWwgSW50ZWxs aU1vdXNlIEV4cGxvcmVyLCBkZXZpY2UgSUQgNApmZGMwOiA8ZmxvcHB5IGRyaXZlIGNvbnRyb2xs ZXI+IHBvcnQgMHgzZjAtMHgzZjUsMHgzZjcgaXJxIDYgZHJxIDIgb24gYWNwaTAKZmRjMDogZG9l cyBub3QgcmVzcG9uZApkZXZpY2VfYXR0YWNoOiBmZGMwIGF0dGFjaCByZXR1cm5lZCA2CnVhcnQw OiA8MTY1NTAgb3IgY29tcGF0aWJsZT4gcG9ydCAweDNmOC0weDNmZiBpcnEgNCBmbGFncyAweDEw IG9uIGFjcGkwCnBwYzA6IDxQYXJhbGxlbCBwb3J0PiBwb3J0IDB4Mzc4LTB4MzdmIGlycSA3IG9u IGFjcGkwCnBwYzA6IEdlbmVyaWMgY2hpcHNldCAoTklCQkxFLW9ubHkpIGluIENPTVBBVElCTEUg bW9kZQpwcGJ1czA6IDxQYXJhbGxlbCBwb3J0IGJ1cz4gb24gcHBjMApscHQwOiA8UHJpbnRlcj4g b24gcHBidXMwCmxwdDA6IEludGVycnVwdC1kcml2ZW4gcG9ydApwcGkwOiA8UGFyYWxsZWwgSS9P PiBvbiBwcGJ1czAKb3JtMDogPElTQSBPcHRpb24gUk9NPiBhdCBpb21lbSAweGM5MDAwLTB4Yzk3 ZmYgb24gaXNhMApzYzA6IDxTeXN0ZW0gY29uc29sZT4gYXQgZmxhZ3MgMHgxMDAgb24gaXNhMApz YzA6IFZHQSA8MTYgdmlydHVhbCBjb25zb2xlcywgZmxhZ3M9MHgzMDA+CnZnYTA6IDxHZW5lcmlj IElTQSBWR0E+IGF0IHBvcnQgMHgzYzAtMHgzZGYgaW9tZW0gMHhhMDAwMC0weGJmZmZmIG9uIGlz YTAKZmRjMDogTm8gRkRPVVQgcmVnaXN0ZXIhClRpbWVjb3VudGVycyB0aWNrIGV2ZXJ5IDEwLjAw MCBtc2VjCnVzYnVzMDogMTJNYnBzIEZ1bGwgU3BlZWQgVVNCIHYxLjAKeGN0cmwwOiA8WGVuIENv bnRyb2wgRGV2aWNlPiBvbiB4ZW5zdG9yZTAKdWdlbjAuMTogPEludGVsPiBhdCB1c2J1czAKdWh1 YjA6IDxJbnRlbCBVSENJIHJvb3QgSFVCLCBjbGFzcyA5LzAsIHJldiAxLjAwLzEuMDAsIGFkZHIg MT4gb24gdXNidXMwCnhlbmJ1c2JfZnJvbnQwOiA8WGVuIEZyb250ZW5kIERldmljZXM+IG9uIHhl bnN0b3JlMApjZDAgYXQgYXRhMSBidXMgMCBzY2J1czEgdGFyZ2V0IDEgbHVuIDAKY2QwOiA8UUVN VSBRRU1VIERWRC1ST00gMC4xMD4gUmVtb3ZhYmxlIENELVJPTSBTQ1NJLTAgZGV2aWNlIApjZDA6 IFNlcmlhbCBOdW1iZXIgUU0wMDAwNApjZDA6IDE2LjcwME1CL3MgdHJhbnNmZXJzIChXRE1BMiwg QVRBUEkgMTJieXRlcywgUElPIDY1NTM0Ynl0ZXMpCmNkMDogQXR0ZW1wdCB0byBxdWVyeSBkZXZp Y2Ugc2l6ZSBmYWlsZWQ6IE5PVCBSRUFEWSwgTWVkaXVtIG5vdCBwcmVzZW50CnVodWIwOiAyIHBv cnRzIHdpdGggMiByZW1vdmFibGUsIHNlbGYgcG93ZXJlZAp4bjA6IDxWaXJ0dWFsIE5ldHdvcmsg SW50ZXJmYWNlPiBhdCBkZXZpY2UvdmlmLzAgb24geGVuYnVzYl9mcm9udDAKeG4wOiBFdGhlcm5l dCBhZGRyZXNzOiAxYTo5ZDo0Nzo2ZDo3OTplMgp4bjE6IDxWaXJ0dWFsIE5ldHdvcmsgSW50ZXJm YWNlPiBhdCBkZXZpY2UvdmlmLzEgb24geGVuYnVzYl9mcm9udDAKeG4xOiBFdGhlcm5ldCBhZGRy ZXNzOiA2YTozYTowMzozZDo2YzplMwp4bjI6IDxWaXJ0dWFsIE5ldHdvcmsgSW50ZXJmYWNlPiBh dCBkZXZpY2UvdmlmLzIgb24geGVuYnVzYl9mcm9udDAKeG4yOiBFdGhlcm5ldCBhZGRyZXNzOiA2 ZTo2ZTpmMzo0NDpiZjphZQp4ZW5idXNiX2JhY2swOiA8WGVuIEJhY2tlbmQgRGV2aWNlcz4gb24g eGVuc3RvcmUwCnhuMDogYmFja2VuZCBmZWF0dXJlczogZmVhdHVyZS1zZyBmZWF0dXJlLWdzby10 Y3A0CnhiZDA6IDE2Mzg0TUIgPFZpcnR1YWwgQmxvY2sgRGV2aWNlPiBhdCBkZXZpY2UvdmJkLzc2 OCBvbiB4ZW5idXNiX2Zyb250MAp4YmQwOiBhdHRhY2hpbmcgYXMgYWRhMApyYW5kb206IHVuYmxv Y2tpbmcgZGV2aWNlLgp4YmQwOiBmZWF0dXJlczogd3JpdGVfYmFycmllcgp4YmQwOiBzeW5jaHJv bml6ZSBjYWNoZSBjb21tYW5kcyBlbmFibGVkLgp4bjE6IGJhY2tlbmQgZmVhdHVyZXM6IGZlYXR1 cmUtc2cgZmVhdHVyZS1nc28tdGNwNAp4bjI6IGJhY2tlbmQgZmVhdHVyZXM6IGZlYXR1cmUtc2cg ZmVhdHVyZS1nc28tdGNwNApTTVA6IEFQIENQVSAjMyBMYXVuY2hlZCEKU01QOiBBUCBDUFUgIzIg TGF1bmNoZWQhClNNUDogQVAgQ1BVICMxIExhdW5jaGVkIQpSb290IG1vdW50IHdhaXRpbmcgZm9y OiB1c2J1czAKdWdlbjAuMjogPFFFTVUgMC4xMC4yPiBhdCB1c2J1czAKVHJ5aW5nIHRvIG1vdW50 IHJvb3QgZnJvbSB1ZnM6L2Rldi9hZGEwcDIgW3J3XS4uLgpTZXR0aW5nIGhvc3R1dWlkOiA3ZjJl ZDE0Ni1jMjMyLTQ2ZWEtMmFiNS00YTBmNTIxMTkwNjMuClNldHRpbmcgaG9zdGlkOiAweGM4MDI4 NTljLgpFbnRyb3B5IGhhcnZlc3Rpbmc6IGludGVycnVwdHMgZXRoZXJuZXQgcG9pbnRfdG9fcG9p bnQgc3dpLgpTdGFydGluZyBmaWxlIHN5c3RlbSBjaGVja3M6Ci9kZXYvYWRhMHAyOiBGSUxFIFNZ U1RFTSBDTEVBTjsgU0tJUFBJTkcgQ0hFQ0tTCi9kZXYvYWRhMHAyOiBjbGVhbiwgMzMyNzkxOSBm cmVlICg4MzU5IGZyYWdzLCA0MTQ5NDUgYmxvY2tzLCAwLjIlIGZyYWdtZW50YXRpb24pCk1vdW50 aW5nIGxvY2FsIGZpbGUgc3lzdGVtczouCldyaXRpbmcgZW50cm9weSBmaWxlOi4KU2V0dGluZyBo b3N0bmFtZTogdGVzdC0wMS5ncmVnLmpwLgp4bjA6IDIgbGluayBzdGF0ZXMgY29hbGVzY2VkCnhu MTogMiBsaW5rIHN0YXRlcyBjb2FsZXNjZWQKeG4yOiAyIGxpbmsgc3RhdGVzIGNvYWxlc2NlZApT dGFydGluZyBOZXR3b3JrOiBsbzAgeG4wIHhuMSB4bjIuCmxvMDogZmxhZ3M9ODA0OTxVUCxMT09Q QkFDSyxSVU5OSU5HLE1VTFRJQ0FTVD4gbWV0cmljIDAgbXR1IDE2Mzg0CglvcHRpb25zPTYwMDAw MzxSWENTVU0sVFhDU1VNLFJYQ1NVTV9JUFY2LFRYQ1NVTV9JUFY2PgoJaW5ldDYgOjoxIHByZWZp eGxlbiAxMjggCglpbmV0NiBmZTgwOjoxJWxvMCBwcmVmaXhsZW4gNjQgc2NvcGVpZCAweDEgCglp bmV0IDEyNy4wLjAuMSBuZXRtYXNrIDB4ZmYwMDAwMDAgCgluZDYgb3B0aW9ucz0yMTxQRVJGT1JN TlVELEFVVE9fTElOS0xPQ0FMPgp4bjA6IGZsYWdzPTg4NDM8VVAsQlJPQURDQVNULFJVTk5JTkcs U0lNUExFWCxNVUxUSUNBU1Q+IG1ldHJpYyAwIG10dSAxNTAwCglvcHRpb25zPTUwMzxSWENTVU0s VFhDU1VNLFRTTzQsTFJPPgoJZXRoZXIgMWE6OWQ6NDc6NmQ6Nzk6ZTIKCWluZXQ2IGZlODA6OjE4 OWQ6NDdmZjpmZTZkOjc5ZTIleG4wIHByZWZpeGxlbiA2NCBzY29wZWlkIDB4MiAKCWluZXQ2IDIw MDE6NDcwOmZjNDc6MTAwMToxODlkOjQ3ZmY6ZmU2ZDo3OWUyIHByZWZpeGxlbiA2NCBhdXRvY29u ZiAKCW5kNiBvcHRpb25zPTIzPFBFUkZPUk1OVUQsQUNDRVBUX1JUQURWLEFVVE9fTElOS0xPQ0FM PgoJbWVkaWE6IEV0aGVybmV0IG1hbnVhbAoJc3RhdHVzOiBhY3RpdmUKeG4xOiBmbGFncz04ODQz PFVQLEJST0FEQ0FTVCxSVU5OSU5HLFNJTVBMRVgsTVVMVElDQVNUPiBtZXRyaWMgMCBtdHUgMTUw MAoJb3B0aW9ucz01MDM8UlhDU1VNLFRYQ1NVTSxUU080LExSTz4KCWV0aGVyIDZhOjNhOjAzOjNk OjZjOmUzCglpbmV0NiBmZTgwOjo2ODNhOjNmZjpmZTNkOjZjZTMleG4xIHByZWZpeGxlbiA2NCBz Y29wZWlkIDB4MyAKCWluZXQ2IDIwMDE6NDcwOmZjNDc6MTAwMjo2ODNhOjNmZjpmZTNkOjZjZTMg cHJlZml4bGVuIDY0IGF1dG9jb25mIAoJbmQ2IG9wdGlvbnM9MjM8UEVSRk9STU5VRCxBQ0NFUFRf UlRBRFYsQVVUT19MSU5LTE9DQUw+CgltZWRpYTogRXRoZXJuZXQgbWFudWFsCglzdGF0dXM6IGFj dGl2ZQp4bjI6IGZsYWdzPTg4NDM8VVAsQlJPQURDQVNULFJVTk5JTkcsU0lNUExFWCxNVUxUSUNB U1Q+IG1ldHJpYyAwIG10dSAxNTAwCglvcHRpb25zPTUwMzxSWENTVU0sVFhDU1VNLFRTTzQsTFJP PgoJZXRoZXIgNmU6NmU6ZjM6NDQ6YmY6YWUKCWluZXQ2IGZlODA6OjZjNmU6ZjNmZjpmZTQ0OmJm YWUleG4yIHByZWZpeGxlbiA2NCBzY29wZWlkIDB4NCAKCWluZXQ2IDIwMDE6NDcwOmZjNDc6MTAw Mzo2YzZlOmYzZmY6ZmU0NDpiZmFlIHByZWZpeGxlbiA2NCBhdXRvY29uZiAKCW5kNiBvcHRpb25z PTIzPFBFUkZPUk1OVUQsQUNDRVBUX1JUQURWLEFVVE9fTElOS0xPQ0FMPgoJbWVkaWE6IEV0aGVy bmV0IG1hbnVhbAoJc3RhdHVzOiBhY3RpdmUKU3RhcnRpbmcgZGV2ZC4KU3RhcnRpbmcgZGhjbGll bnQuCnVtczA6IDxFbmRwb2ludDEgSW50ZXJydXB0IFBpcGU+IG9uIHVzYnVzMApESENQUkVRVUVT VCBvbiB4bjAgdG8gMjU1LjI1NS4yNTUuMjU1IHBvcnQgNjcKREhDUEFDSyBmcm9tIDE3Mi4zMS4x LjI5CnVtczA6IDMgYnV0dG9ucyBhbmQgW1pdIGNvb3JkaW5hdGVzIElEPTAKYm91bmQgdG8gMTcy LjMxLjEuMTgzIC0tIHJlbmV3YWwgaW4gMTgwMCBzZWNvbmRzLgpTdGFydGluZyBkaGNsaWVudC4K REhDUFJFUVVFU1Qgb24geG4xIHRvIDI1NS4yNTUuMjU1LjI1NSBwb3J0IDY3CkRIQ1BBQ0sgZnJv bSAxNzIuMzEuMi4yOApib3VuZCB0byAxNzIuMzEuMi4xNjUgLS0gcmVuZXdhbCBpbiAxODAwIHNl Y29uZHMuClN0YXJ0aW5nIGRoY2xpZW50LgpESENQUkVRVUVTVCBvbiB4bjIgdG8gMjU1LjI1NS4y NTUuMjU1IHBvcnQgNjcKREhDUEFDSyBmcm9tIDE3Mi4zMS4zLjI5CmJvdW5kIHRvIDE3Mi4zMS4z LjE4OSAtLSByZW5ld2FsIGluIDE4MDAgc2Vjb25kcy4KU3RhcnRpbmcgdW1zMCBtb3VzZWQuCmFk ZCBuZXQgZmU4MDo6OiBnYXRld2F5IDo6MQphZGQgbmV0IGZmMDI6OjogZ2F0ZXdheSA6OjEKYWRk IG5ldCA6OmZmZmY6MC4wLjAuMDogZ2F0ZXdheSA6OjEKYWRkIG5ldCA6OjAuMC4wLjA6IGdhdGV3 YXkgOjoxCk1vdW50aW5nIE5GUyBmaWxlIHN5c3RlbXM6LgpFTEYgbGRjb25maWcgcGF0aDogL2xp YiAvdXNyL2xpYiAvdXNyL2xpYi9jb21wYXQgL3Vzci9sb2NhbC9saWIgL3Vzci9sb2NhbC9saWIv Y29tcGF0L3BrZyAvdXNyL2xvY2FsL2xpYi9jb21wYXQvcGtnCjMyLWJpdCBjb21wYXRpYmlsaXR5 IGxkY29uZmlnIHBhdGg6IC91c3IvbGliMzIKQ3JlYXRpbmcgYW5kL29yIHRyaW1taW5nIGxvZyBm aWxlcy4KU3RhcnRpbmcgc3lzbG9nZC4KU2V0dGluZyBkYXRlIHZpYSBudHAuCjI3IEFwciAxMzow ODoyNCBudHBkYXRlWzY1NF06IHN0ZXAgdGltZSBzZXJ2ZXIgMjExLjEyNS4xMjAuMzEgb2Zmc2V0 IC00Ljk5Nzk3NyBzZWMKTm8gY29yZSBkdW1wcyBmb3VuZC4KQ2xlYXJpbmcgL3RtcCAoWCByZWxh dGVkKS4KVXBkYXRpbmcgbW90ZDouCk1vdW50aW5nIGxhdGUgZmlsZSBzeXN0ZW1zOi4KU3RhcnRp bmcgbnRwZC4KU3RhcnRpbmcgeGVuZ3Vlc3QuCkNvbmZpZ3VyaW5nIHN5c2NvbnM6IGJsYW5rdGlt ZS4KUGVyZm9ybWluZyBzYW5pdHkgY2hlY2sgb24gc3NoZCBjb25maWd1cmF0aW9uLgpTdGFydGlu ZyBzc2hkLgpTdGFydGluZyBzZW5kbWFpbF9zdWJtaXQuClN0YXJ0aW5nIHNlbmRtYWlsX21zcF9x dWV1ZS4KU3RhcnRpbmcgY3Jvbi4KU3RhcnRpbmcgYnNubXBkLgpTdGFydGluZyBiYWNrZ3JvdW5k IGZpbGUgc3lzdGVtIGNoZWNrcyBpbiA2MCBzZWNvbmRzLgoKU3VuIEFwciAyNyAxMzowODoyNiBK U1QgMjAxNApBcHIgMjcgMTM6MTM6NTYgdGVzdC0wMSBsb2dpbjogUk9PVCBMT0dJTiAocm9vdCkg T04gdHR5djAKc2E2X3JlY292ZXJzY29wZTogZW1iZWRkZWQgc2NvcGUgbWlzbWF0Y2g6IGZlODA6 Mzo6ZThiZTo3ZWZmOmZlN2Y6ZTIyOSUyLiBzaW42X3Njb3BlX2lkIHdhcyBvdmVycmlkZGVuLnNh Nl9yZWNvdmVyc2NvcGU6IGVtYmVkZGVkIHNjb3BlIG1pc21hdGNoOiBmZTgwOjQ6OjE0Yjg6Yjlm ZjpmZWMzOjU4ZTglMy4gc2luNl9zY29wZV9pZCB3YXMgb3ZlcnJpZGRlbi5zYTZfcmVjb3ZlcnNj b3BlOiBlbWJlZGRlZCBzY29wZSBtaXNtYXRjaDogZmU4MDozOjo0MDI6MjJmZjpmZWNlOmZmMTMl NC4gc2luNl9zY29wZV9pZCB3YXMgb3ZlcnJpZGRlbi5zYTZfcmVjb3ZlcnNjb3BlOiBlbWJlZGRl ZCBzY29wZSBtaXNtYXRjaDogZmU4MDoyOjozNGVjOjEwZmY6ZmVkMzpjOGM5JTMuIHNpbjZfc2Nv cGVfaWQgd2FzIG92ZXJyaWRkZW4uc2E2X3JlY292ZXJzY29wZTogZW1iZWRkZWQgc2NvcGUgbWlz bWF0Y2g6IGZlODA6Mzo6ZThiZTo3ZWZmOmZlN2Y6ZTIyOSUyLiBzaW42X3Njb3BlX2lkIHdhcyBv dmVycmlkZGVuLnNhNl9yZWNvdmVyc2NvcGU6IGVtYmVkZGVkIHNjb3BlIG1pc21hdGNoOiBmZTgw OjQ6OjE0Yjg6YjlmZjpmZWMzOjU4ZTglMy4gc2luNl9zY29wZV9pZCB3YXMgb3ZlcnJpZGRlbi5z YTZfcmVjb3ZlcnNjb3BlOiBlbWJlZGRlZCBzY29wZSBtaXNtYXRjaDogZmU4MDozOjo0MDI6MjJm ZjpmZWNlOmZmMTMlNC4gc2luNl9zY29wZV9pZCB3YXMgb3ZlcnJpZGRlbi5zYTZfcmVjb3ZlcnNj b3BlOiBlbWJlZGRlZCBzY29wZSBtaXNtYXRjaDogZmU4MDoyOjozNGVjOjEwZmY6ZmVkMzpjOGM5 JTMuIHNpbjZfc2NvcGVfaWQgd2FzIG92ZXJyaWRkZW4uc2E2X3JlY292ZXJzY29wZTogZW1iZWRk ZWQgc2NvcGUgbWlzbWF0Y2g6IGZlODA6Mzo6ZThiZTo3ZWZmOmZlN2Y6ZTIyOSU0LiBzaW42X3Nj b3BlX2lkIHdhcyBvdmVycmlkZGVuLnNhNl9yZWNvdmVyc2NvcGU6IGVtYmVkZGVkIHNjb3BlIG1p c21hdGNoOiBmZTgwOjI6OmM4NTg6Y2ZmOmZlMzc6YzcwMiUzLiBzaW42X3Njb3BlX2lkIHdhcyBv dmVycmlkZGVuLnNhNl9yZWNvdmVyc2NvcGU6IGVtYmVkZGVkIHNjb3BlIG1pc21hdGNoOiBmZTgw OjM6OmU4YmU6N2VmZjpmZTdmOmUyMjklNC4gc2luNl9zY29wZV9pZCB3YXMgb3ZlcnJpZGRlbi5z YTZfcmVjb3ZlcnNjb3BlOiBlbWJlZGRlZCBzY29wZSBtaXNtYXRjaDogZmU4MDoyOjpjODU4OmNm ZjpmZTM3OmM3MDIlMy4gc2luNl9zY29wZV9pZCB3YXMgb3ZlcnJpZGRlbi4KCgpGYXRhbCB0cmFw IDEyOiBwYWdlIGZhdWx0IHdoaWxlIGluIGtlcm5lbCBtb2RlCmNwdWlkID0gMjsgYXBpYyBpZCA9 IDA0CmZhdWx0IHZpcnR1YWwgYWRkcmVzcwk9IDB4MApmYXVsdCBjb2RlCQk9IHN1cGVydmlzb3Ig cmVhZCBkYXRhLCBwYWdlIG5vdCBwcmVzZW50Cmluc3RydWN0aW9uIHBvaW50ZXIJPSAweDIwOjB4 ZmZmZmZmZmY4MGNjN2EwOApzdGFjayBwb2ludGVyCSAgICAgICAgPSAweDI4OjB4ZmZmZmZlMDA0 ZTQ4ZDkwMApmcmFtZSBwb2ludGVyCSAgICAgICAgPSAweDI4OjB4ZmZmZmZlMDA0ZTQ4ZDk0MApj b2RlIHNlZ21lbnQJCT0gYmFzZSAweDAsIGxpbWl0IDB4ZmZmZmYsIHR5cGUgMHgxYgoJCQk9IERQ TCAwLCBwcmVzIDEsIGxvbmcgMSwgZGVmMzIgMCwgZ3JhbiAxCnByb2Nlc3NvciBlZmxhZ3MJPSBp bnRlcnJ1cHQgZW5hYmxlZCwgcmVzdW1lLCBJT1BMID0gMApjdXJyZW50IHByb2Nlc3MJCT0gMTMg KGdfZXZlbnQpCnRyYXAgbnVtYmVyCQk9IDEyCnBhbmljOiBwYWdlIGZhdWx0CmNwdWlkID0gMgpL REI6IHN0YWNrIGJhY2t0cmFjZToKIzAgMHhmZmZmZmZmZjgwOTEwYzAwIGF0IGtkYl9iYWNrdHJh Y2UrMHg2MAojMSAweGZmZmZmZmZmODA4ZDYxNjUgYXQgcGFuaWMrMHgxNTUKIzIgMHhmZmZmZmZm ZjgwY2M5Y2JmIGF0IHRyYXBfZmF0YWwrMHgzOGYKIzMgMHhmZmZmZmZmZjgwY2M5ZmQ4IGF0IHRy YXBfcGZhdWx0KzB4MzA4CiM0IDB4ZmZmZmZmZmY4MGNjOTY5MCBhdCB0cmFwKzB4NGEwCiM1IDB4 ZmZmZmZmZmY4MGNiMDE3MiBhdCBjYWxsdHJhcCsweDgKIzYgMHhmZmZmZmZmZjgwOTE5Y2MzIGF0 IHNidWZfcHV0Y19mdW5jKzB4NzMKIzcgMHhmZmZmZmZmZjgwOTE1YmFhIGF0IGt2cHJpbnRmKzB4 MTAxYQojOCAweGZmZmZmZmZmODA5MTljMzkgYXQgc2J1Zl92cHJpbnRmKzB4MjkKIzkgMHhmZmZm ZmZmZjgwODNjYmU3IGF0IGdfY29uZl9wcmludGZfZXNjYXBlZCsweDY3CiMxMCAweGZmZmZmZmZm ODA4M2NkYmYgYXQgZ19jb25mX3NwZWNpZmljKzB4MTJmCiMxMSAweGZmZmZmZmZmODA4M2Q2ZTYg YXQgZ19ydW5fZXZlbnRzKzB4MTY2CiMxMiAweGZmZmZmZmZmODA4YTZjZmEgYXQgZm9ya19leGl0 KzB4OWEKIzEzIDB4ZmZmZmZmZmY4MGNiMDZhZSBhdCBmb3JrX3RyYW1wb2xpbmUrMHhlClVwdGlt ZTogMWgxOW0xcwpEdW1waW5nIDE5MCBvdXQgb2YgOTk3IE1COi4uOSUuLjE3JS4uMjYlLi4zNCUu LjQyJS4uNTElLi42OCUuLjc2JS4uODQlLi45MyUKCi0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLQprZXJuZWwgY29u ZmlnCgpvcHRpb25zCUNPTkZJR19BVVRPR0VORVJBVEVECmlkZW50CUdFTkVSSUMKbWFjaGluZQlh bWQ2NApjcHUJSEFNTUVSCm1ha2VvcHRpb25zCVdJVEhfQ1RGPTEKbWFrZW9wdGlvbnMJREVCVUc9 LWdkd2FyZi0yCm9wdGlvbnMJWEVOSFZNCm9wdGlvbnMJVVNCX0RFQlVHCm9wdGlvbnMJQVRIX0VO QUJMRV8xMU4Kb3B0aW9ucwlBSF9BUjU0MTZfSU5URVJSVVBUX01JVElHQVRJT04Kb3B0aW9ucwlB SF9TVVBQT1JUX0FSNTQxNgpvcHRpb25zCUlFRUU4MDIxMV9TVVBQT1JUX01FU0gKb3B0aW9ucwlJ RUVFODAyMTFfQU1QRFVfQUdFCm9wdGlvbnMJSUVFRTgwMjExX0RFQlVHCm9wdGlvbnMJU0NfUElY RUxfTU9ERQpvcHRpb25zCVZFU0EKb3B0aW9ucwlBSERfUkVHX1BSRVRUWV9QUklOVApvcHRpb25z CUFIQ19SRUdfUFJFVFRZX1BSSU5UCm9wdGlvbnMJQVRBX1NUQVRJQ19JRApvcHRpb25zCUFDUElf RE1BUgpvcHRpb25zCVNNUApvcHRpb25zCUtEQl9UUkFDRQpvcHRpb25zCUtEQgpvcHRpb25zCUlO Q0xVREVfQ09ORklHX0ZJTEUKb3B0aW9ucwlEREJfQ1RGCm9wdGlvbnMJS0RUUkFDRV9IT09LUwpv cHRpb25zCUtEVFJBQ0VfRlJBTUUKb3B0aW9ucwlNQUMKb3B0aW9ucwlQUk9DREVTQwpvcHRpb25z CUNBUEFCSUxJVElFUwpvcHRpb25zCUNBUEFCSUxJVFlfTU9ERQpvcHRpb25zCUFVRElUCm9wdGlv bnMJSFdQTUNfSE9PS1MKb3B0aW9ucwlLQkRfSU5TVEFMTF9DREVWCm9wdGlvbnMJUFJJTlRGX0JV RlJfU0laRT0xMjgKb3B0aW9ucwlfS1BPU0lYX1BSSU9SSVRZX1NDSEVEVUxJTkcKb3B0aW9ucwlT WVNWU0VNCm9wdGlvbnMJU1lTVk1TRwpvcHRpb25zCVNZU1ZTSE0Kb3B0aW9ucwlTVEFDSwpvcHRp b25zCUtUUkFDRQpvcHRpb25zCVNDU0lfREVMQVk9NTAwMApvcHRpb25zCUNPTVBBVF9GUkVFQlNE NwpvcHRpb25zCUNPTVBBVF9GUkVFQlNENgpvcHRpb25zCUNPTVBBVF9GUkVFQlNENQpvcHRpb25z CUNPTVBBVF9GUkVFQlNENApvcHRpb25zCUNPTVBBVF9GUkVFQlNEMzIKb3B0aW9ucwlHRU9NX0xB QkVMCm9wdGlvbnMJR0VPTV9SQUlECm9wdGlvbnMJR0VPTV9QQVJUX0dQVApvcHRpb25zCVBTRVVE T0ZTCm9wdGlvbnMJUFJPQ0ZTCm9wdGlvbnMJQ0Q5NjYwCm9wdGlvbnMJTVNET1NGUwpvcHRpb25z CU5GU19ST09UCm9wdGlvbnMJTkZTTE9DS0QKb3B0aW9ucwlORlNECm9wdGlvbnMJTkZTQ0wKb3B0 aW9ucwlNRF9ST09UCm9wdGlvbnMJUVVPVEEKb3B0aW9ucwlVRlNfR0pPVVJOQUwKb3B0aW9ucwlV RlNfRElSSEFTSApvcHRpb25zCVVGU19BQ0wKb3B0aW9ucwlTT0ZUVVBEQVRFUwpvcHRpb25zCUZG UwpvcHRpb25zCVNDVFAKb3B0aW9ucwlUQ1BfT0ZGTE9BRApvcHRpb25zCUlORVQ2Cm9wdGlvbnMJ SU5FVApvcHRpb25zCVBSRUVNUFRJT04Kb3B0aW9ucwlTQ0hFRF9VTEUKb3B0aW9ucwlORVdfUENJ QgpvcHRpb25zCUdFT01fUEFSVF9NQlIKb3B0aW9ucwlHRU9NX1BBUlRfRUJSX0NPTVBBVApvcHRp b25zCUdFT01fUEFSVF9FQlIKb3B0aW9ucwlHRU9NX1BBUlRfQlNECmRldmljZQlpc2EKZGV2aWNl CW1lbQpkZXZpY2UJaW8KZGV2aWNlCXVhcnRfbnM4MjUwCmRldmljZQljcHVmcmVxCmRldmljZQlh Y3BpCmRldmljZQlwY2kKZGV2aWNlCWZkYwpkZXZpY2UJYWhjaQpkZXZpY2UJYXRhCmRldmljZQlt dnMKZGV2aWNlCXNpaXMKZGV2aWNlCWFoYwpkZXZpY2UJYWhkCmRldmljZQllc3AKZGV2aWNlCWhw dGlvcApkZXZpY2UJaXNwCmRldmljZQltcHQKZGV2aWNlCW1wcwpkZXZpY2UJc3ltCmRldmljZQl0 cm0KZGV2aWNlCWFkdgpkZXZpY2UJYWR3CmRldmljZQlhaWMKZGV2aWNlCWJ0CmRldmljZQlpc2Np CmRldmljZQlzY2J1cwpkZXZpY2UJY2gKZGV2aWNlCWRhCmRldmljZQlzYQpkZXZpY2UJY2QKZGV2 aWNlCXBhc3MKZGV2aWNlCXNlcwpkZXZpY2UJYW1yCmRldmljZQlhcmNtc3IKZGV2aWNlCWNpc3MK ZGV2aWNlCWRwdApkZXZpY2UJaHB0bXYKZGV2aWNlCWhwdG5yCmRldmljZQlocHRycgpkZXZpY2UJ aHB0Mjd4eApkZXZpY2UJaWlyCmRldmljZQlpcHMKZGV2aWNlCW1seQpkZXZpY2UJdHdhCmRldmlj ZQl0d3MKZGV2aWNlCWFhYwpkZXZpY2UJYWFjcApkZXZpY2UJYWFjcmFpZApkZXZpY2UJaWRhCmRl dmljZQltZmkKZGV2aWNlCW1seApkZXZpY2UJdHdlCmRldmljZQlhdGtiZGMKZGV2aWNlCWF0a2Jk CmRldmljZQlwc20KZGV2aWNlCWtiZG11eApkZXZpY2UJdmdhCmRldmljZQlzcGxhc2gKZGV2aWNl CXNjCmRldmljZQlhZ3AKZGV2aWNlCWNiYgpkZXZpY2UJcGNjYXJkCmRldmljZQljYXJkYnVzCmRl dmljZQl1YXJ0CmRldmljZQlwcGMKZGV2aWNlCXBwYnVzCmRldmljZQlscHQKZGV2aWNlCXBwaQpk ZXZpY2UJcHVjCmRldmljZQlieGUKZGV2aWNlCWRlCmRldmljZQllbQpkZXZpY2UJaWdiCmRldmlj ZQlpeGdiZQpkZXZpY2UJbGUKZGV2aWNlCXRpCmRldmljZQl0eHAKZGV2aWNlCXZ4CmRldmljZQlt aWlidXMKZGV2aWNlCWFlCmRldmljZQlhZ2UKZGV2aWNlCWFsYwpkZXZpY2UJYWxlCmRldmljZQli Y2UKZGV2aWNlCWJmZQpkZXZpY2UJYmdlCmRldmljZQljYXMKZGV2aWNlCWRjCmRldmljZQlldApk ZXZpY2UJZnhwCmRldmljZQlnZW0KZGV2aWNlCWhtZQpkZXZpY2UJam1lCmRldmljZQlsZ2UKZGV2 aWNlCW1zawpkZXZpY2UJbmZlCmRldmljZQluZ2UKZGV2aWNlCXBjbgpkZXZpY2UJcmUKZGV2aWNl CXJsCmRldmljZQlzZgpkZXZpY2UJc2dlCmRldmljZQlzaXMKZGV2aWNlCXNrCmRldmljZQlzdGUK ZGV2aWNlCXN0Z2UKZGV2aWNlCXRsCmRldmljZQl0eApkZXZpY2UJdmdlCmRldmljZQl2cgpkZXZp Y2UJd2IKZGV2aWNlCXhsCmRldmljZQljcwpkZXZpY2UJZWQKZGV2aWNlCWV4CmRldmljZQllcApk ZXZpY2UJZmUKZGV2aWNlCXNuCmRldmljZQl4ZQpkZXZpY2UJd2xhbgpkZXZpY2UJd2xhbl93ZXAK ZGV2aWNlCXdsYW5fY2NtcApkZXZpY2UJd2xhbl90a2lwCmRldmljZQl3bGFuX2FtcnIKZGV2aWNl CWFuCmRldmljZQlhdGgKZGV2aWNlCWF0aF9wY2kKZGV2aWNlCWF0aF9oYWwKZGV2aWNlCWF0aF9y YXRlX3NhbXBsZQpkZXZpY2UJaXB3CmRldmljZQlpd2kKZGV2aWNlCWl3bgpkZXZpY2UJbWFsbwpk ZXZpY2UJbXdsCmRldmljZQlyYWwKZGV2aWNlCXdpCmRldmljZQl3cGkKZGV2aWNlCWxvb3AKZGV2 aWNlCXJhbmRvbQpkZXZpY2UJcGFkbG9ja19ybmcKZGV2aWNlCXJkcmFuZF9ybmcKZGV2aWNlCWV0 aGVyCmRldmljZQl2bGFuCmRldmljZQl0dW4KZGV2aWNlCW1kCmRldmljZQlnaWYKZGV2aWNlCWZh aXRoCmRldmljZQlmaXJtd2FyZQpkZXZpY2UJYnBmCmRldmljZQl1aGNpCmRldmljZQlvaGNpCmRl dmljZQllaGNpCmRldmljZQl4aGNpCmRldmljZQl1c2IKZGV2aWNlCXVrYmQKZGV2aWNlCXVtYXNz CmRldmljZQlzb3VuZApkZXZpY2UJc25kX2NtaQpkZXZpY2UJc25kX2NzYQpkZXZpY2UJc25kX2Vt dTEwa3gKZGV2aWNlCXNuZF9lczEzN3gKZGV2aWNlCXNuZF9oZGEKZGV2aWNlCXNuZF9pY2gKZGV2 aWNlCXNuZF92aWE4MjMzCmRldmljZQltbWMKZGV2aWNlCW1tY3NkCmRldmljZQlzZGhjaQpkZXZp Y2UJdmlydGlvCmRldmljZQl2aXJ0aW9fcGNpCmRldmljZQl2dG5ldApkZXZpY2UJdmlydGlvX2Js awpkZXZpY2UJdmlydGlvX3Njc2kKZGV2aWNlCXZpcnRpb19iYWxsb29uCmRldmljZQloeXBlcnYK ZGV2aWNlCXhlbnBjaQpkZXZpY2UJdm14CgotLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0KZGRiIGNhcHR1cmUgYnVm ZmVyCgpkZGI6IGRkYl9jYXB0dXJlOiBrdm1fbmxpc3QK --001a11c2fcba26381004f8199545 Content-Type: application/octet-stream; name="info.4" Content-Disposition: attachment; filename="info.4" Content-Transfer-Encoding: base64 X-Attachment-Id: f_hujqy8m71 RHVtcCBoZWFkZXIgZnJvbSBkZXZpY2UgL2Rldi9hZGEwcDMKICBBcmNoaXRlY3R1cmU6IGFtZDY0 CiAgQXJjaGl0ZWN0dXJlIFZlcnNpb246IDIKICBEdW1wIExlbmd0aDogMjAwMTE0MTc2QiAoMTkw IE1CKQogIEJsb2Nrc2l6ZTogNTEyCiAgRHVtcHRpbWU6IFN1biBBcHIgMjcgMTQ6Mjc6MDMgMjAx NAogIEhvc3RuYW1lOiB0ZXN0LTAxLmdyZWcuanAKICBNYWdpYzogRnJlZUJTRCBLZXJuZWwgRHVt cAogIFZlcnNpb24gU3RyaW5nOiBGcmVlQlNEIDEwLjAtU1RBQkxFICM2IHIyNjQ5MTVNOiBTYXQg QXByIDI2IDExOjA1OjQxIEpTVCAyMDE0CiAgICByb290QHRlc3QtMDEuZ3JlZy5qcDovdXNyL29i ai91c3Ivc3JjL3N5cy9HRU5FUklDCiAgUGFuaWMgU3RyaW5nOiBwYWdlIGZhdWx0CiAgRHVtcCBQ YXJpdHk6IDE3MzMyMDY4OTIKICBCb3VuZHM6IDQKICBEdW1wIFN0YXR1czogZ29vZAo= --001a11c2fcba26381004f8199545-- From owner-freebsd-xen@FreeBSD.ORG Mon Apr 28 15:50:01 2014 Return-Path: Delivered-To: freebsd-xen@smarthost.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 816002F8 for ; Mon, 28 Apr 2014 15:50:01 +0000 (UTC) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:1900:2254:206c::16:87]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 53A771D4F for ; Mon, 28 Apr 2014 15:50:01 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.8/8.14.8) with ESMTP id s3SFo1YS086380 for ; Mon, 28 Apr 2014 15:50:01 GMT (envelope-from gnats@freefall.freebsd.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.8/8.14.8/Submit) id s3SFo1Jq086365; Mon, 28 Apr 2014 15:50:01 GMT (envelope-from gnats) Date: Mon, 28 Apr 2014 15:50:01 GMT Message-Id: <201404281550.s3SFo1Jq086365@freefall.freebsd.org> To: freebsd-xen@FreeBSD.org Cc: From: =?ISO-8859-1?Q?Roger_Pau_Monn=E9?= Subject: Re: kern/186375: [xen] FreeBSD 10 is very unstable on Xen 4.1(XCP 1.6) X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list Reply-To: =?ISO-8859-1?Q?Roger_Pau_Monn=E9?= List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 28 Apr 2014 15:50:01 -0000 The following reply was made to PR kern/186375; it has been noted by GNATS. From: =?ISO-8859-1?Q?Roger_Pau_Monn=E9?= To: Kensaku MASUDA Cc: Subject: Re: kern/186375: [xen] FreeBSD 10 is very unstable on Xen 4.1(XCP 1.6) Date: Mon, 28 Apr 2014 17:49:03 +0200 On 28/04/14 14:37, Kensaku MASUDA wrote: > Hello, Roger. > > In the PR you mention that the VM crashes/panics, could you please > provide the complete logs of the crash and the panics? Without those it > is impossible to diagnose the problem, much less try to fix it. > > > Sorry, It was already deleted with VM. and disassembled Xen 4.1(XCP 1.6) > resource pool. > Now, my resource pool is upgraded about Xen 4.2(XenServer 6.2 SP1). But > I get same situation /w FreeBSD version 10-stable. > And successfull collect log. > > a FreeBSD VM running on Xen 4.4/4.5, and so far I haven't seen any of > this issues. > > > FreeBSD 10 STABLE on Xen 4.2(XenServer 6.2) are stable than 10 RELEASE > on Xen 4.1, But it was randomly stall/panic/crash. I'm not sure I understand your last sentence correctly, sorry. Do you mean that 10-STABLE works fine on XenServer 6.2 and 10-RELEASE doesn't? The dump provided seems to be from 10-STABLE, so I guess both are affected? The crash itself doesn't happen on Xen code (it's in geom AFAICT), so it's kind of hard for me to figure out what's going on there. The following line in ps output seems quite worrying: 0 999 1 0 20 0 50168 17979214322466816 g_waitfo Ds - 0:00.29 [bsnmpd] bsnmpd seems to be using a huge amount of memory, have you tried disabling it? Also, from vmstat -m: ip6ndp 18446744073708511156 18014398509416956K - 41 32,64,128 Can you provide a little more info about the VM itself, from the logs I see it has 4CPUs and 1024MB of RAM. Which kind of workload were you running inside of it when the crash happened? Could you try installing a vanilla 10-RELEASE VM using the ISOs on ftp.freebsd.org, and run the same workload (without xe-guest-utilities, bsnmpd or anything not strictly necessary). Roger. From owner-freebsd-xen@FreeBSD.ORG Mon Apr 28 17:56:23 2014 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 2711685D for ; Mon, 28 Apr 2014 17:56:23 +0000 (UTC) Received: from mail-we0-x233.google.com (mail-we0-x233.google.com [IPv6:2a00:1450:400c:c03::233]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id B106F1BB2 for ; Mon, 28 Apr 2014 17:56:22 +0000 (UTC) Received: by mail-we0-f179.google.com with SMTP id x48so6799356wes.10 for ; Mon, 28 Apr 2014 10:56:21 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=M+RYB/lwQt6dxqRrdO11bht2Cd1aTpBGsF7tc0a89kk=; b=DICM8jwQuYN23Z8jaXJ4a+zlLZpAp4LtuGJSIcuWYt59PTXpyyiUpM5EQMR6X1VCbA G7z5yR8XJaeL9T+Ku7jnSZ7guwoWHWSRSpxNkMdWX+sG+HpdWwcKN67mKlILvePtAsR3 gFbao4ytpCbq/x/RkL+uyOVyaml9fP70M94xOCW+8JU+4LeeWVeb/N5+3QALOcwRZS/K CUtmSfR8fURBs5G7bxf4PMwzGucHXEYScPw1dxf0YtWkmi7t4FfC6HTLdFM/Qdyfw6Xn 36IvSaIXQA6GS2dDYxQIRiezN+IZ7UAQ19eXnS1ImXxUUy+PCJWoRXJzou8URLrGM6fJ VlUQ== MIME-Version: 1.0 X-Received: by 10.180.39.175 with SMTP id q15mr16569176wik.4.1398707780938; Mon, 28 Apr 2014 10:56:20 -0700 (PDT) Received: by 10.216.61.203 with HTTP; Mon, 28 Apr 2014 10:56:20 -0700 (PDT) In-Reply-To: <535BA152.6080300@citrix.com> References: <53567847.10203@citrix.com> <535BA152.6080300@citrix.com> Date: Mon, 28 Apr 2014 18:56:20 +0100 Message-ID: Subject: Re: VM in Xen 4.1; poor packet forwarding performance on xn0 From: "seanrees@gmail.com" To: =?UTF-8?Q?Roger_Pau_Monn=C3=A9?= Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.17 Cc: "freebsd-xen@freebsd.org" X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 28 Apr 2014 17:56:23 -0000 Hi Roger, This is what they provided me: - The Xen 4.x node is running a custom 3.1.1 kernel. - The Xen 3.x node is running a 2.6.18 kernel. They didn't elaborate on the customisations. :( Sean On Sat, Apr 26, 2014 at 1:06 PM, Roger Pau Monn=C3=A9 wrote: > On 26/04/14 13:57, seanrees@gmail.com wrote: > > Hi Roger, > > > > Thanks for the patch -- sadly, it didn't work. No change. > > Hello, > > > > > I did have to modify a bit for releng/10.0; for some reason patch > > refused to apply it cleanly. It looked fairly straightforward but I > > attached inline the patch I ultimately applied below just in case I got > > it wrong. > > Patch looks fine. > > > Are there any other potential differences between Xen 3.4 and 4.1? (my > > provider migrated my problem VPS to a 3.4 host and the problem > > evaporated; I am trying this on a new 4.1 VPS that I was able to > > reproduce the problem on). > > I'm quite sure this is not related to the underlying Xen version, but to > the Linux Dom0 kernel version your provider is using, could you ask them > the Linux versions they are using on the 4.1 and 3.4 hosts? > > Roger. > From owner-freebsd-xen@FreeBSD.ORG Tue Apr 29 21:20:10 2014 Return-Path: Delivered-To: freebsd-xen@smarthost.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id A664DD1A for ; Tue, 29 Apr 2014 21:20:10 +0000 (UTC) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:1900:2254:206c::16:87]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 87DB61ABC for ; Tue, 29 Apr 2014 21:20:10 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.8/8.14.8) with ESMTP id s3TLKAs8029814 for ; Tue, 29 Apr 2014 21:20:10 GMT (envelope-from gnats@freefall.freebsd.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.8/8.14.8/Submit) id s3TLKACw029813; Tue, 29 Apr 2014 21:20:10 GMT (envelope-from gnats) Date: Tue, 29 Apr 2014 21:20:10 GMT Message-Id: <201404292120.s3TLKACw029813@freefall.freebsd.org> To: freebsd-xen@FreeBSD.org Cc: From: Thomas Zelch Subject: Re: bin/188990: [xen] dhclient(8) does not accept DHCP Offer on FreeBSD 10 as Xen DomU Guest X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list Reply-To: Thomas Zelch List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 Apr 2014 21:20:10 -0000 The following reply was made to PR bin/188990; it has been noted by GNATS. From: Thomas Zelch To: =?iso-8859-1?Q?Roger_Pau_Monn=E9?= Cc: bug-followup@FreeBSD.org, thomaszelch@gmail.com Subject: Re: bin/188990: [xen] dhclient(8) does not accept DHCP Offer on FreeBSD 10 as Xen DomU Guest Date: Tue, 29 Apr 2014 23:11:31 +0200 Hi Roger, I have just tried. When using a different Host for DHCP, everything seems to work fine. Any Ideas why this might be? If the problem is related to PR 188261, is there any way that i might = help narrow the problem down? Thomas Am 26.04.2014 um 10:35 schrieb Roger Pau Monn=E9 : > Could you try to move the DNS server to another host? There have been > reports of failures on if_xn when sending/receiving data to/from other > guests on the same host. >=20 > I know this is not a valid log-term solution, but it could help in > identifying the problem, which is probably related to PR 188261. >=20 > Roger. From owner-freebsd-xen@FreeBSD.ORG Mon May 5 11:06:55 2014 Return-Path: Delivered-To: freebsd-xen@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 00739FF5 for ; Mon, 5 May 2014 11:06:54 +0000 (UTC) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:1900:2254:206c::16:87]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id D5EAB1D0C for ; Mon, 5 May 2014 11:06:54 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.8/8.14.8) with ESMTP id s45B6s3f083334 for ; Mon, 5 May 2014 11:06:54 GMT (envelope-from owner-bugmaster@FreeBSD.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.8/8.14.8/Submit) id s45B6sSl083332 for freebsd-xen@FreeBSD.org; Mon, 5 May 2014 11:06:54 GMT (envelope-from owner-bugmaster@FreeBSD.org) Date: Mon, 5 May 2014 11:06:54 GMT Message-Id: <201405051106.s45B6sSl083332@freefall.freebsd.org> X-Authentication-Warning: freefall.freebsd.org: gnats set sender to owner-bugmaster@FreeBSD.org using -f From: FreeBSD bugmaster To: freebsd-xen@FreeBSD.org Subject: Current problem reports assigned to freebsd-xen@FreeBSD.org X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 05 May 2014 11:06:55 -0000 Note: to view an individual PR, use: http://www.freebsd.org/cgi/query-pr.cgi?pr=(number). The following is a listing of current problems submitted by FreeBSD users. These represent problem reports covering all versions including experimental development code and obsolete releases. S Tracker Resp. Description -------------------------------------------------------------------------------- o bin/188990 xen [xen] dhclient(8) does not accept DHCP Offer on FreeBS o kern/188369 xen [xen] [panic] FreeBSD 10 XENHVM panic under NetBSD Dom o kern/188261 xen [xen] FreeBSD DomU PVHVM guests cannot 'route' traffic o kern/186375 xen [xen] FreeBSD 10 is very unstable on Xen 4.1(XCP 1.6) o kern/183397 xen [xen] [panic] Kernel panic at first incoming ssh under o kern/183139 xen [xen] [patch] ifconfig options on xn0 lost after xen v o kern/180788 xen [xen] [panic] XEN PV kernel 9.2-BETA1 panics on boot o kern/180403 xen [xen] Problems with GENERIC and XENHVM kernels with Xe o kern/180402 xen [xen] XEN kernel does not load in XenClient 4.5.5 o kern/179814 xen [xen] mountroot fails with error=19 under Xen on 9-STA o kern/176471 xen [xen] xn driver crash on detach o kern/176053 xen [xen] [patch] i386: Correct wrong usage of vsnprintf() o kern/175954 xen [xen] XENHVM xn network driver extreme packet loss dur o kern/175822 xen [xen] FreeBSD 9.1 does not work with Xen 4.0 o kern/175757 xen [xen] [patch] xen pvhvm looses keyboard input from VNC o kern/171873 xen [xen] xn network device floods warning in dmesg o kern/166174 xen [xen] Problems ROOT MOUNT ERROR o kern/165418 xen [xen] Problems mounting root filesystem from XENHVM o kern/164630 xen [xen] XEN HVM kernel: run_interrupt_driven_hooks: stil o kern/164450 xen [xen] Failed to install FreeeBSD 9.0-RELEASE from CD i o kern/162677 xen [xen] FreeBSD not compatible with "Current Stable Xen" o kern/161318 xen [xen] sysinstall crashes with floating point exception o kern/155468 xen [xen] Xen PV i386 multi-kernel CPU system is not worki o kern/155353 xen [xen] [patch] put "nudging TOD" message under boot_ver o kern/154833 xen [xen]: xen 4.0 - DomU freebsd8.2RC3 i386, XEN kernel. o kern/154473 xen [xen] xen 4.0 - DomU freebsd8.1 i386, XEN kernel. Not o kern/154472 xen [xen] xen 4.0 - DomU freebsd8.1 i386 xen kernel reboot o kern/154428 xen [xen] xn0 network interface and PF - Massive performan o kern/153674 xen [xen] i386/XEN idle thread shows wrong percentages o kern/153672 xen [xen] [panic] i386/XEN panics under heavy fork load o kern/153620 xen [xen] Xen guest system clock drifts in AWS EC2 (FreeBS o kern/153477 xen [xen] XEN pmap code abuses vm page queue lock o kern/153150 xen [xen] xen/ec2: disable checksum offloading on interfac o kern/152228 xen [xen] [panic] Xen/PV panic with machdep.idle_mwait=1 o kern/144629 xen [xen] FreeBSD 8-RELEASE XEN pvm networking doesn't wor o kern/143398 xen [xen] FreeBSD 8-RELEASE XEN pvm networking doesn't wor o kern/143340 xen [xen] FreeBSD 8-RELEASE XEN pvm networking doesn't wor f kern/143069 xen [xen] [panic] Xen Kernel Panic - Memory modified after f kern/135667 xen ufs filesystem corruption on XEN DomU system f kern/135421 xen [xen] FreeBSD Xen PVM DomU network failure - netfronc. f kern/135178 xen [xen] Xen domU outgoing data transfer stall when TSO i p kern/135069 xen [xen] FreeBSD-current/Xen SMP doesn't function at all f i386/124516 xen [xen] FreeBSD-CURRENT Xen Kernel Segfaults when config o kern/118734 xen [xen] FreeBSD 6.3-RC1 and FreeBSD 7.0-BETA 4 fail to b 44 problems total. From owner-freebsd-xen@FreeBSD.ORG Mon May 12 11:06:55 2014 Return-Path: Delivered-To: freebsd-xen@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id B02F8CAB for ; Mon, 12 May 2014 11:06:55 +0000 (UTC) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:1900:2254:206c::16:87]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 9D92626EC for ; Mon, 12 May 2014 11:06:55 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.8/8.14.8) with ESMTP id s4CB6tqL068054 for ; Mon, 12 May 2014 11:06:55 GMT (envelope-from owner-bugmaster@FreeBSD.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.8/8.14.8/Submit) id s4CB6tOi068052 for freebsd-xen@FreeBSD.org; Mon, 12 May 2014 11:06:55 GMT (envelope-from owner-bugmaster@FreeBSD.org) Date: Mon, 12 May 2014 11:06:55 GMT Message-Id: <201405121106.s4CB6tOi068052@freefall.freebsd.org> X-Authentication-Warning: freefall.freebsd.org: gnats set sender to owner-bugmaster@FreeBSD.org using -f From: FreeBSD bugmaster To: freebsd-xen@FreeBSD.org Subject: Current problem reports assigned to freebsd-xen@FreeBSD.org X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 12 May 2014 11:06:55 -0000 Note: to view an individual PR, use: http://www.freebsd.org/cgi/query-pr.cgi?pr=(number). The following is a listing of current problems submitted by FreeBSD users. These represent problem reports covering all versions including experimental development code and obsolete releases. S Tracker Resp. Description -------------------------------------------------------------------------------- o bin/188990 xen [xen] dhclient(8) does not accept DHCP Offer on FreeBS o kern/188369 xen [xen] [panic] FreeBSD 10 XENHVM panic under NetBSD Dom o kern/188261 xen [xen] FreeBSD DomU PVHVM guests cannot 'route' traffic o kern/186375 xen [xen] FreeBSD 10 is very unstable on Xen 4.1(XCP 1.6) o kern/183397 xen [xen] [panic] Kernel panic at first incoming ssh under o kern/183139 xen [xen] [patch] ifconfig options on xn0 lost after xen v o kern/180788 xen [xen] [panic] XEN PV kernel 9.2-BETA1 panics on boot o kern/180403 xen [xen] Problems with GENERIC and XENHVM kernels with Xe o kern/180402 xen [xen] XEN kernel does not load in XenClient 4.5.5 o kern/179814 xen [xen] mountroot fails with error=19 under Xen on 9-STA o kern/176471 xen [xen] xn driver crash on detach o kern/176053 xen [xen] [patch] i386: Correct wrong usage of vsnprintf() o kern/175954 xen [xen] XENHVM xn network driver extreme packet loss dur o kern/175822 xen [xen] FreeBSD 9.1 does not work with Xen 4.0 o kern/175757 xen [xen] [patch] xen pvhvm looses keyboard input from VNC o kern/171873 xen [xen] xn network device floods warning in dmesg o kern/166174 xen [xen] Problems ROOT MOUNT ERROR o kern/165418 xen [xen] Problems mounting root filesystem from XENHVM o kern/164630 xen [xen] XEN HVM kernel: run_interrupt_driven_hooks: stil o kern/164450 xen [xen] Failed to install FreeeBSD 9.0-RELEASE from CD i o kern/162677 xen [xen] FreeBSD not compatible with "Current Stable Xen" o kern/161318 xen [xen] sysinstall crashes with floating point exception o kern/155468 xen [xen] Xen PV i386 multi-kernel CPU system is not worki o kern/155353 xen [xen] [patch] put "nudging TOD" message under boot_ver o kern/154833 xen [xen]: xen 4.0 - DomU freebsd8.2RC3 i386, XEN kernel. o kern/154473 xen [xen] xen 4.0 - DomU freebsd8.1 i386, XEN kernel. Not o kern/154472 xen [xen] xen 4.0 - DomU freebsd8.1 i386 xen kernel reboot o kern/154428 xen [xen] xn0 network interface and PF - Massive performan o kern/153674 xen [xen] i386/XEN idle thread shows wrong percentages o kern/153672 xen [xen] [panic] i386/XEN panics under heavy fork load o kern/153620 xen [xen] Xen guest system clock drifts in AWS EC2 (FreeBS o kern/153477 xen [xen] XEN pmap code abuses vm page queue lock o kern/153150 xen [xen] xen/ec2: disable checksum offloading on interfac o kern/152228 xen [xen] [panic] Xen/PV panic with machdep.idle_mwait=1 o kern/144629 xen [xen] FreeBSD 8-RELEASE XEN pvm networking doesn't wor o kern/143398 xen [xen] FreeBSD 8-RELEASE XEN pvm networking doesn't wor o kern/143340 xen [xen] FreeBSD 8-RELEASE XEN pvm networking doesn't wor f kern/143069 xen [xen] [panic] Xen Kernel Panic - Memory modified after f kern/135667 xen ufs filesystem corruption on XEN DomU system f kern/135421 xen [xen] FreeBSD Xen PVM DomU network failure - netfronc. f kern/135178 xen [xen] Xen domU outgoing data transfer stall when TSO i p kern/135069 xen [xen] FreeBSD-current/Xen SMP doesn't function at all f i386/124516 xen [xen] FreeBSD-CURRENT Xen Kernel Segfaults when config o kern/118734 xen [xen] FreeBSD 6.3-RC1 and FreeBSD 7.0-BETA 4 fail to b 44 problems total. From owner-freebsd-xen@FreeBSD.ORG Fri May 16 19:31:20 2014 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 04C0314C for ; Fri, 16 May 2014 19:31:20 +0000 (UTC) Received: from o3.shared.sendgrid.net (o3.shared.sendgrid.net [208.117.48.85]) by mx1.freebsd.org (Postfix) with SMTP id A91312051 for ; Fri, 16 May 2014 19:31:19 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=sendgrid.info; h=from:mime-version:to:cc:subject:content-type:content-transfer-encoding; s=smtpapi; bh=b3syEcaUFBjrYZyY7zGNRe+0YJY=; b=EFrAN0WewhROLv3GUA uIavXn4/EFlmnAGpTtdX6xN/WJrK+ntzxCKPBRKQU2OuUXQFycAx/J2iksFh5YDB UOUY+cFrwmHw366/67dBNWGUZxzl7cRTD/F26F1vz+iEOvHaeoooW43E9e/QW8qM R+1pxYS/yxDnmThZRegOmVaSg= Received: by mf200.sendgrid.net with SMTP id mf200.22537.53766784F Fri, 16 May 2014 19:31:16 +0000 (UTC) Received: from mail.tarsnap.com (unknown [10.100.60.97]) by ismtpd-007 (SG) with ESMTP id 14606845db7.767b.e1f52 for ; Fri, 16 May 2014 19:31:16 +0000 (GMT) Received: (qmail 89879 invoked from network); 16 May 2014 19:31:15 -0000 Received: from unknown (HELO clamshell.daemonology.net) (127.0.0.1) by ec2-107-20-205-189.compute-1.amazonaws.com with ESMTP; 16 May 2014 19:31:15 -0000 Received: (qmail 2850 invoked from network); 16 May 2014 19:29:47 -0000 Received: from unknown (HELO clamshell.daemonology.net) (127.0.0.1) by clamshell.daemonology.net with SMTP; 16 May 2014 19:29:47 -0000 Message-ID: <5376672B.9050605@freebsd.org> Date: Fri, 16 May 2014 12:29:47 -0700 From: Colin Percival User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:24.0) Gecko/20100101 Thunderbird/24.0 MIME-Version: 1.0 To: "freebsd-xen@freebsd.org" Subject: Xen/HVM support in stable/9: GENERIC + xenhvm.ko X-Enigmail-Version: 1.5.2 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-SG-EID: RUbAm5H8PjswBj/QH+sYVehaJogg3iBnZcyVi1bw/Iz648MnUnz3EaKzY7l8FryVtlsom6AL7kT22exY/4cPqlMfdo9kcLLZttonHztwJiwpirh7CMRiz/kAb55SHcYPFSczhkQHFlTDDAHrf3DFP+Y1h5yKm3B5pTTTSxve7Ek= Cc: =?ISO-8859-1?Q?Roger_Pau_Monn=E9?= X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 16 May 2014 19:31:20 -0000 Hi all, As of r266269, stable/9 can run in Xen/HVM environments using the GENERIC kernel configuration plus a new xenhvm.ko. This will allow FreeBSD 9.3 to run in Xen using "official release binaries" as long as xenhvm_load="YES" is placed in /boot/loader.conf. -- Colin Percival Security Officer Emeritus, FreeBSD | The power to serve Founder, Tarsnap | www.tarsnap.com | Online backups for the truly paranoid From owner-freebsd-xen@FreeBSD.ORG Sat May 17 14:57:11 2014 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id F2ED4505; Sat, 17 May 2014 14:57:10 +0000 (UTC) Received: from mail.feld.me (mail.feld.me [66.170.3.6]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.feld.me", Issuer "Gandi Standard SSL CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 780752A7B; Sat, 17 May 2014 14:57:10 +0000 (UTC) Received: from mail.feld.me (mail.feld.me [66.170.3.6]); by mail.feld.me (OpenSMTPD) with ESMTP id 6dd6779a; Sat, 17 May 2014 09:57:01 -0500 (CDT) Received: from feld@feld.me by mail.feld.me (Archiveopteryx 3.2.0) with esmtpa id 1400338620-91116-91112/5/6; Sat, 17 May 2014 14:57:00 +0000 Subject: Re: Xen/HVM support in stable/9: GENERIC + xenhvm.ko From: Mark Felder In-Reply-To: <5376672B.9050605@freebsd.org> Date: Sat, 17 May 2014 09:56:54 -0500 Message-Id: <6D07EC21-BCED-4506-96B1-E77B4A8869D8@FreeBSD.org> References: <5376672B.9050605@freebsd.org> To: Colin Percival X-Mailer: Apple Mail (2.1878.2) Sender: feld@feld.me Cc: freebsd-xen@freebsd.org, Roger Pau =?ISO-8859-1?q?Monn=E9?= X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 17 May 2014 14:57:11 -0000 On May 16, 2014, at 14:29, Colin Percival wrote: > Hi all, > > As of r266269, stable/9 can run in Xen/HVM environments using the GENERIC > kernel configuration plus a new xenhvm.ko. This will allow FreeBSD 9.3 to > run in Xen using "official release binaries" as long as xenhvm_load="YES" > is placed in /boot/loader.conf. > This is FANTASTIC news! I will begin testing as time permits... :-) From owner-freebsd-xen@FreeBSD.ORG Mon May 19 11:06:57 2014 Return-Path: Delivered-To: freebsd-xen@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 28AE1641 for ; Mon, 19 May 2014 11:06:57 +0000 (UTC) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:1900:2254:206c::16:87]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 15A062DDB for ; Mon, 19 May 2014 11:06:57 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.8/8.14.8) with ESMTP id s4JB6uRg080257 for ; Mon, 19 May 2014 11:06:56 GMT (envelope-from owner-bugmaster@FreeBSD.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.8/8.14.8/Submit) id s4JB6uNl080254 for freebsd-xen@FreeBSD.org; Mon, 19 May 2014 11:06:56 GMT (envelope-from owner-bugmaster@FreeBSD.org) Date: Mon, 19 May 2014 11:06:56 GMT Message-Id: <201405191106.s4JB6uNl080254@freefall.freebsd.org> X-Authentication-Warning: freefall.freebsd.org: gnats set sender to owner-bugmaster@FreeBSD.org using -f From: FreeBSD bugmaster To: freebsd-xen@FreeBSD.org Subject: Current problem reports assigned to freebsd-xen@FreeBSD.org X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 May 2014 11:06:57 -0000 Note: to view an individual PR, use: http://www.freebsd.org/cgi/query-pr.cgi?pr=(number). The following is a listing of current problems submitted by FreeBSD users. These represent problem reports covering all versions including experimental development code and obsolete releases. S Tracker Resp. Description -------------------------------------------------------------------------------- o bin/188990 xen [xen] dhclient(8) does not accept DHCP Offer on FreeBS o kern/188369 xen [xen] [panic] FreeBSD 10 XENHVM panic under NetBSD Dom o kern/188261 xen [xen] FreeBSD DomU PVHVM guests cannot 'route' traffic o kern/186375 xen [xen] FreeBSD 10 is very unstable on Xen 4.1(XCP 1.6) o kern/183397 xen [xen] [panic] Kernel panic at first incoming ssh under o kern/183139 xen [xen] [patch] ifconfig options on xn0 lost after xen v o kern/180788 xen [xen] [panic] XEN PV kernel 9.2-BETA1 panics on boot o kern/180403 xen [xen] Problems with GENERIC and XENHVM kernels with Xe o kern/180402 xen [xen] XEN kernel does not load in XenClient 4.5.5 o kern/179814 xen [xen] mountroot fails with error=19 under Xen on 9-STA o kern/176471 xen [xen] xn driver crash on detach o kern/176053 xen [xen] [patch] i386: Correct wrong usage of vsnprintf() o kern/175954 xen [xen] XENHVM xn network driver extreme packet loss dur o kern/175822 xen [xen] FreeBSD 9.1 does not work with Xen 4.0 o kern/175757 xen [xen] [patch] xen pvhvm looses keyboard input from VNC o kern/171873 xen [xen] xn network device floods warning in dmesg o kern/166174 xen [xen] Problems ROOT MOUNT ERROR o kern/165418 xen [xen] Problems mounting root filesystem from XENHVM o kern/164630 xen [xen] XEN HVM kernel: run_interrupt_driven_hooks: stil o kern/164450 xen [xen] Failed to install FreeeBSD 9.0-RELEASE from CD i o kern/162677 xen [xen] FreeBSD not compatible with "Current Stable Xen" o kern/161318 xen [xen] sysinstall crashes with floating point exception o kern/155468 xen [xen] Xen PV i386 multi-kernel CPU system is not worki o kern/155353 xen [xen] [patch] put "nudging TOD" message under boot_ver o kern/154833 xen [xen]: xen 4.0 - DomU freebsd8.2RC3 i386, XEN kernel. o kern/154473 xen [xen] xen 4.0 - DomU freebsd8.1 i386, XEN kernel. Not o kern/154472 xen [xen] xen 4.0 - DomU freebsd8.1 i386 xen kernel reboot o kern/154428 xen [xen] xn0 network interface and PF - Massive performan o kern/153674 xen [xen] i386/XEN idle thread shows wrong percentages o kern/153672 xen [xen] [panic] i386/XEN panics under heavy fork load o kern/153620 xen [xen] Xen guest system clock drifts in AWS EC2 (FreeBS o kern/153477 xen [xen] XEN pmap code abuses vm page queue lock o kern/153150 xen [xen] xen/ec2: disable checksum offloading on interfac o kern/152228 xen [xen] [panic] Xen/PV panic with machdep.idle_mwait=1 o kern/144629 xen [xen] FreeBSD 8-RELEASE XEN pvm networking doesn't wor o kern/143398 xen [xen] FreeBSD 8-RELEASE XEN pvm networking doesn't wor o kern/143340 xen [xen] FreeBSD 8-RELEASE XEN pvm networking doesn't wor f kern/143069 xen [xen] [panic] Xen Kernel Panic - Memory modified after f kern/135667 xen ufs filesystem corruption on XEN DomU system f kern/135421 xen [xen] FreeBSD Xen PVM DomU network failure - netfronc. f kern/135178 xen [xen] Xen domU outgoing data transfer stall when TSO i p kern/135069 xen [xen] FreeBSD-current/Xen SMP doesn't function at all f i386/124516 xen [xen] FreeBSD-CURRENT Xen Kernel Segfaults when config o kern/118734 xen [xen] FreeBSD 6.3-RC1 and FreeBSD 7.0-BETA 4 fail to b 44 problems total. From owner-freebsd-xen@FreeBSD.ORG Mon May 26 11:06:57 2014 Return-Path: Delivered-To: freebsd-xen@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 276EDFC5 for ; Mon, 26 May 2014 11:06:57 +0000 (UTC) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:1900:2254:206c::16:87]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 13AB92500 for ; Mon, 26 May 2014 11:06:57 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.8/8.14.8) with ESMTP id s4QB6uYW032250 for ; Mon, 26 May 2014 11:06:56 GMT (envelope-from owner-bugmaster@FreeBSD.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.8/8.14.8/Submit) id s4QB6uvi032247 for freebsd-xen@FreeBSD.org; Mon, 26 May 2014 11:06:56 GMT (envelope-from owner-bugmaster@FreeBSD.org) Date: Mon, 26 May 2014 11:06:56 GMT Message-Id: <201405261106.s4QB6uvi032247@freefall.freebsd.org> X-Authentication-Warning: freefall.freebsd.org: gnats set sender to owner-bugmaster@FreeBSD.org using -f From: FreeBSD bugmaster To: freebsd-xen@FreeBSD.org Subject: Current problem reports assigned to freebsd-xen@FreeBSD.org X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 26 May 2014 11:06:57 -0000 Note: to view an individual PR, use: http://www.freebsd.org/cgi/query-pr.cgi?pr=(number). The following is a listing of current problems submitted by FreeBSD users. These represent problem reports covering all versions including experimental development code and obsolete releases. S Tracker Resp. Description -------------------------------------------------------------------------------- o bin/188990 xen [xen] dhclient(8) does not accept DHCP Offer on FreeBS o kern/188369 xen [xen] [panic] FreeBSD 10 XENHVM panic under NetBSD Dom o kern/188261 xen [xen] FreeBSD DomU PVHVM guests cannot 'route' traffic o kern/186375 xen [xen] FreeBSD 10 is very unstable on Xen 4.1(XCP 1.6) o kern/183397 xen [xen] [panic] Kernel panic at first incoming ssh under o kern/183139 xen [xen] [patch] ifconfig options on xn0 lost after xen v o kern/180788 xen [xen] [panic] XEN PV kernel 9.2-BETA1 panics on boot o kern/180403 xen [xen] Problems with GENERIC and XENHVM kernels with Xe o kern/180402 xen [xen] XEN kernel does not load in XenClient 4.5.5 o kern/179814 xen [xen] mountroot fails with error=19 under Xen on 9-STA o kern/176471 xen [xen] xn driver crash on detach o kern/176053 xen [xen] [patch] i386: Correct wrong usage of vsnprintf() o kern/175954 xen [xen] XENHVM xn network driver extreme packet loss dur o kern/175822 xen [xen] FreeBSD 9.1 does not work with Xen 4.0 o kern/175757 xen [xen] [patch] xen pvhvm looses keyboard input from VNC o kern/171873 xen [xen] xn network device floods warning in dmesg o kern/166174 xen [xen] Problems ROOT MOUNT ERROR o kern/165418 xen [xen] Problems mounting root filesystem from XENHVM o kern/164630 xen [xen] XEN HVM kernel: run_interrupt_driven_hooks: stil o kern/164450 xen [xen] Failed to install FreeeBSD 9.0-RELEASE from CD i o kern/162677 xen [xen] FreeBSD not compatible with "Current Stable Xen" o kern/161318 xen [xen] sysinstall crashes with floating point exception o kern/155468 xen [xen] Xen PV i386 multi-kernel CPU system is not worki o kern/155353 xen [xen] [patch] put "nudging TOD" message under boot_ver o kern/154833 xen [xen]: xen 4.0 - DomU freebsd8.2RC3 i386, XEN kernel. o kern/154473 xen [xen] xen 4.0 - DomU freebsd8.1 i386, XEN kernel. Not o kern/154472 xen [xen] xen 4.0 - DomU freebsd8.1 i386 xen kernel reboot o kern/154428 xen [xen] xn0 network interface and PF - Massive performan o kern/153674 xen [xen] i386/XEN idle thread shows wrong percentages o kern/153672 xen [xen] [panic] i386/XEN panics under heavy fork load o kern/153620 xen [xen] Xen guest system clock drifts in AWS EC2 (FreeBS o kern/153477 xen [xen] XEN pmap code abuses vm page queue lock o kern/153150 xen [xen] xen/ec2: disable checksum offloading on interfac o kern/152228 xen [xen] [panic] Xen/PV panic with machdep.idle_mwait=1 o kern/144629 xen [xen] FreeBSD 8-RELEASE XEN pvm networking doesn't wor o kern/143398 xen [xen] FreeBSD 8-RELEASE XEN pvm networking doesn't wor o kern/143340 xen [xen] FreeBSD 8-RELEASE XEN pvm networking doesn't wor f kern/143069 xen [xen] [panic] Xen Kernel Panic - Memory modified after f kern/135667 xen ufs filesystem corruption on XEN DomU system f kern/135421 xen [xen] FreeBSD Xen PVM DomU network failure - netfronc. f kern/135178 xen [xen] Xen domU outgoing data transfer stall when TSO i p kern/135069 xen [xen] FreeBSD-current/Xen SMP doesn't function at all f i386/124516 xen [xen] FreeBSD-CURRENT Xen Kernel Segfaults when config o kern/118734 xen [xen] FreeBSD 6.3-RC1 and FreeBSD 7.0-BETA 4 fail to b 44 problems total. From owner-freebsd-xen@FreeBSD.ORG Sat May 31 07:57:55 2014 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id A16B7354; Sat, 31 May 2014 07:57:55 +0000 (UTC) Received: from mail-qa0-x22e.google.com (mail-qa0-x22e.google.com [IPv6:2607:f8b0:400d:c00::22e]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 51A242136; Sat, 31 May 2014 07:57:55 +0000 (UTC) Received: by mail-qa0-f46.google.com with SMTP id w8so124456qac.19 for ; Sat, 31 May 2014 00:57:54 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=hEo18SUuPznCuY9l2PWUDCSs5A9xT1/W7mJz4S1aqgo=; b=DxGWJweBmyvoNlz0NpTEwdaD/+XJInf4Q16zfCUkkD2/Hn0KKfjTqCERmqd+DXOges RBsfYHaAb1Se1CO7BoPCPvT/rgCOSgKKOBl+4qd/onWUamyc0ocHyDkNdFI4XWYEm1hk /HyQ9gHFzv7GMdfWqtkgbPtaJZXeFyzuuI7C2BV2R1eK/FzREU+TpbF77bG1LiMpiVRI 3EmZ+hC+v2BdiStM+e+LSy3aLEkSC+bLiRUOt10EeeaZUx7QtlQnpKHeuT3qq8EA+FFo w9yvBIKzw62JvI1VRJPBKxh7Ot+A74W35KUcQT7ukI4vAKqWl7Ri/9IxoRXNDCTRJfTX 7C3w== MIME-Version: 1.0 X-Received: by 10.140.102.161 with SMTP id w30mr27319184qge.108.1401523074493; Sat, 31 May 2014 00:57:54 -0700 (PDT) Received: by 10.140.80.202 with HTTP; Sat, 31 May 2014 00:57:54 -0700 (PDT) Received: by 10.140.80.202 with HTTP; Sat, 31 May 2014 00:57:54 -0700 (PDT) In-Reply-To: References: Date: Sat, 31 May 2014 17:57:54 +1000 Message-ID: Subject: Re. FreeBSD10 release on AWS EC2(Xen) with Intel SR-IOV(ixv) driver. From: Jarrod Lee Petz To: freebsd-xen@freebsd.org, jfvogel@gmail.com, cperciva@freebsd.org Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.18 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 31 May 2014 07:57:55 -0000 Hi Jack & Colin, Tried a ec2 c3 instance today and hit the same issue you noted on the mailling list below last year http://lists.freebsd.org/pipermail/freebsd-xen/2013-December/001817.html The driver loads and shows a link status of active. But DHCP or other traffic fails. ix0: mem 0xf3000000-0xf3003fff,0xf3004000-0xf3007fff at device 3.0 on pci0 Just curious to know if either of you had any more information on a potential workaround? Happy to provide access to an ec2 instance for you to work/debug on if need be. Regards Jarrod From owner-freebsd-xen@FreeBSD.ORG Wed Jun 4 08:00:16 2014 Return-Path: Delivered-To: freebsd-xen@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 715921F2 for ; Wed, 4 Jun 2014 08:00:16 +0000 (UTC) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 3AD152252 for ; Wed, 4 Jun 2014 08:00:16 +0000 (UTC) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.14.8/8.14.8) with ESMTP id s5480GZo050043 for ; Wed, 4 Jun 2014 09:00:16 +0100 (BST) (envelope-from bz-noreply@freebsd.org) Message-Id: <201406040800.s5480GZo050043@kenobi.freebsd.org> From: bz-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bugzilla] Commit Needs MFC MIME-Version: 1.0 X-Bugzilla-Type: whine X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated Date: Wed, 04 Jun 2014 08:00:16 +0000 Content-Type: text/plain X-Content-Filtered-By: Mailman/MimeDel 2.1.18 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Jun 2014 08:00:16 -0000 Hi, You have a bug in the "Needs MFC" state which has not been touched in 7 days. This email serves as a reminder that you may want to MFC this bug or marked it as completed. In the event you have a longer MFC timeout you may update this bug with a comment and I won't remind you again for 7 days. This reminder is an experimental feature. Please file a bug or mail bugmeister@ with concerns. This search was scheduled by eadler@FreeBSD.org. (1 bugs) Bug 135069: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=135069 Severity: Affects Only Me Priority: Normal Hardware: Any Assignee: freebsd-xen@FreeBSD.org Status: Needs MFC Resolution: Summary: [xen] FreeBSD-current/Xen SMP doesn't function at all after the AP's are loaded From owner-freebsd-xen@FreeBSD.ORG Thu Jun 5 08:00:14 2014 Return-Path: Delivered-To: freebsd-xen@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 374A879A for ; Thu, 5 Jun 2014 08:00:14 +0000 (UTC) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 0E1E12B51 for ; Thu, 5 Jun 2014 08:00:14 +0000 (UTC) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.14.8/8.14.8) with ESMTP id s5580DkB039645 for ; Thu, 5 Jun 2014 09:00:13 +0100 (BST) (envelope-from bz-noreply@freebsd.org) Message-Id: <201406050800.s5580DkB039645@kenobi.freebsd.org> From: bz-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bugzilla] Commit Needs MFC MIME-Version: 1.0 X-Bugzilla-Type: whine X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated Date: Thu, 05 Jun 2014 08:00:13 +0000 Content-Type: text/plain X-Content-Filtered-By: Mailman/MimeDel 2.1.18 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Jun 2014 08:00:14 -0000 Hi, You have a bug in the "Needs MFC" state which has not been touched in 7 days. This email serves as a reminder that you may want to MFC this bug or marked it as completed. In the event you have a longer MFC timeout you may update this bug with a comment and I won't remind you again for 7 days. This reminder is an experimental feature. Please file a bug or mail bugmeister@ with concerns. This search was scheduled by eadler@FreeBSD.org. (1 bugs) Bug 135069: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=135069 Severity: Affects Only Me Priority: Normal Hardware: Any Assignee: freebsd-xen@FreeBSD.org Status: Needs MFC Resolution: Summary: [xen] FreeBSD-current/Xen SMP doesn't function at all after the AP's are loaded From owner-freebsd-xen@FreeBSD.ORG Thu Jun 5 09:23:24 2014 Return-Path: Delivered-To: freebsd-xen@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id B8D95827 for ; Thu, 5 Jun 2014 09:23:24 +0000 (UTC) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id A06DA232F for ; Thu, 5 Jun 2014 09:23:24 +0000 (UTC) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.14.8/8.14.8) with ESMTP id s559NOtR041623 for ; Thu, 5 Jun 2014 10:23:24 +0100 (BST) (envelope-from bz-noreply@freebsd.org) From: bz-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 135069] [xen] FreeBSD-current/Xen SMP doesn't function at all after the AP's are loaded Date: Thu, 05 Jun 2014 09:23:24 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: unspecified X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: royger@freebsd.org X-Bugzilla-Status: Issue Resolved X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status cc resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Jun 2014 09:23:24 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D135069 Roger Pau Monn=C3=A9 changed: What |Removed |Added ---------------------------------------------------------------------------- Status|Needs MFC |Issue Resolved CC| |royger@freebsd.org Resolution|--- |Works As Intended --- Comment #6 from Roger Pau Monn=C3=A9 --- The i386 Xen PV port is broken and unmaintained, closing the issue. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@FreeBSD.ORG Thu Jun 5 12:21:59 2014 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 2B69C15C for ; Thu, 5 Jun 2014 12:21:59 +0000 (UTC) Received: from egarden.fi (egarden.fi [78.47.154.139]) by mx1.freebsd.org (Postfix) with ESMTP id E2A272425 for ; Thu, 5 Jun 2014 12:21:58 +0000 (UTC) Received: from [192.168.2.42] (itmill.masterplanet.fi [194.100.97.79]) by egarden.fi (Postfix) with ESMTPSA id 86895115A005 for ; Thu, 5 Jun 2014 15:14:27 +0300 (EEST) Message-ID: <53905F22.104@egarden.fi> Date: Thu, 05 Jun 2014 15:14:26 +0300 From: Jonni Nakari User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:24.0) Gecko/20100101 Thunderbird/24.5.0 MIME-Version: 1.0 To: freebsd-xen@freebsd.org Subject: Re: Status of 64 bit DomU PVs? References: In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Jun 2014 12:21:59 -0000 On 05.04.2014 16:14, Cherry G. Mathew wrote: > You're welcome to try the amd64_xen_pv svn branch, although it's very > very early days, and I doubt it would be useful in any way for you > other than to track progress or help with dev. Hello, is the amd64_xen_pv branch under developement? It's been about 5 weeks since the last commit. I would like to know the status of this project. -- Jonni Nakari jonni@egarden.fi +358 50 4411 784 From owner-freebsd-xen@FreeBSD.ORG Thu Jun 5 14:01:45 2014 Return-Path: Delivered-To: freebsd-xen@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 773B6B5 for ; Thu, 5 Jun 2014 14:01:45 +0000 (UTC) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 5D1A62109 for ; Thu, 5 Jun 2014 14:01:45 +0000 (UTC) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.14.8/8.14.8) with ESMTP id s55E1jAD095878 for ; Thu, 5 Jun 2014 15:01:45 +0100 (BST) (envelope-from bz-noreply@freebsd.org) From: bz-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 118734] [xen] FreeBSD 6.3-RC1 and FreeBSD 7.0-BETA 4 fail to boot under Xen fully virtualized Date: Thu, 05 Jun 2014 14:01:45 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: unspecified X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: royger@freebsd.org X-Bugzilla-Status: Issue Resolved X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status cc resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Jun 2014 14:01:45 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D118734 Roger Pau Monn=C3=A9 changed: What |Removed |Added ---------------------------------------------------------------------------- Status|In Discussion |Issue Resolved CC| |royger@freebsd.org Resolution|--- |FIXED --- Comment #4 from Roger Pau Monn=C3=A9 --- All current supported releases work fine as (PV)HVM guests, closing the iss= ue. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@FreeBSD.ORG Thu Jun 5 14:08:55 2014 Return-Path: Delivered-To: freebsd-xen@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id D88E91CB for ; Thu, 5 Jun 2014 14:08:55 +0000 (UTC) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id BFC672164 for ; Thu, 5 Jun 2014 14:08:55 +0000 (UTC) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.14.8/8.14.8) with ESMTP id s55E8tXQ021239 for ; Thu, 5 Jun 2014 15:08:55 +0100 (BST) (envelope-from bz-noreply@freebsd.org) From: bz-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 143340] [xen] FreeBSD 8-RELEASE XEN pvm networking doesn't work on solaris dom0's Date: Thu, 05 Jun 2014 14:08:55 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: unspecified X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: royger@freebsd.org X-Bugzilla-Status: In Discussion X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Jun 2014 14:08:55 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D143340 --- Comment #4 from Roger Pau Monn=C3=A9 --- *** Bug 143398 has been marked as a duplicate of this bug. *** --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@FreeBSD.ORG Thu Jun 5 14:08:55 2014 Return-Path: Delivered-To: freebsd-xen@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 8DDB51C9 for ; Thu, 5 Jun 2014 14:08:55 +0000 (UTC) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 74A572161 for ; Thu, 5 Jun 2014 14:08:55 +0000 (UTC) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.14.8/8.14.8) with ESMTP id s55E8tlQ021233 for ; Thu, 5 Jun 2014 15:08:55 +0100 (BST) (envelope-from bz-noreply@freebsd.org) From: bz-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 143398] [xen] FreeBSD 8-RELEASE XEN pvm networking doesn't work on solaris dom0's Date: Thu, 05 Jun 2014 14:08:55 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: unspecified X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: royger@freebsd.org X-Bugzilla-Status: Issue Resolved X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status cc resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Jun 2014 14:08:55 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D143398 Roger Pau Monn=C3=A9 changed: What |Removed |Added ---------------------------------------------------------------------------- Status|In Discussion |Issue Resolved CC| |royger@freebsd.org Resolution|--- |DUPLICATE --- Comment #2 from Roger Pau Monn=C3=A9 --- *** This bug has been marked as a duplicate of bug 143340 *** --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@FreeBSD.ORG Thu Jun 5 14:12:09 2014 Return-Path: Delivered-To: freebsd-xen@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 4DF5A2F6 for ; Thu, 5 Jun 2014 14:12:09 +0000 (UTC) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 34BE821FB for ; Thu, 5 Jun 2014 14:12:09 +0000 (UTC) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.14.8/8.14.8) with ESMTP id s55EC9eP039395 for ; Thu, 5 Jun 2014 15:12:09 +0100 (BST) (envelope-from bz-noreply@freebsd.org) From: bz-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 143340] [xen] FreeBSD 8-RELEASE XEN pvm networking doesn't work on solaris dom0's Date: Thu, 05 Jun 2014 14:12:09 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: unspecified X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: royger@freebsd.org X-Bugzilla-Status: Issue Resolved X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status cc resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Jun 2014 14:12:09 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D143340 Roger Pau Monn=C3=A9 changed: What |Removed |Added ---------------------------------------------------------------------------- Status|In Discussion |Issue Resolved CC| |royger@freebsd.org Resolution|--- |FIXED --- Comment #5 from Roger Pau Monn=C3=A9 --- AFAICT current netfront code correctly handles both "feature-sg" and "feature-gso-tcpv4", so I'm marking the bug as fixed. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@FreeBSD.ORG Thu Jun 5 14:25:30 2014 Return-Path: Delivered-To: freebsd-xen@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 76AB7A5E for ; Thu, 5 Jun 2014 14:25:30 +0000 (UTC) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 5CEF8235C for ; Thu, 5 Jun 2014 14:25:30 +0000 (UTC) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.14.8/8.14.8) with ESMTP id s55EPU0Q067039 for ; Thu, 5 Jun 2014 15:25:30 +0100 (BST) (envelope-from bz-noreply@freebsd.org) From: bz-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 135421] [xen] FreeBSD Xen PVM DomU network failure - netfronc.c driver crashes when downloading/uploading files Date: Thu, 05 Jun 2014 14:25:30 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 8.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: royger@freebsd.org X-Bugzilla-Status: Issue Resolved X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status cc resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Jun 2014 14:25:30 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D135421 Roger Pau Monn=C3=A9 changed: What |Removed |Added ---------------------------------------------------------------------------- Status|In Discussion |Issue Resolved CC| |royger@freebsd.org Resolution|--- |FIXED --- Comment #4 from Roger Pau Monn=C3=A9 --- No feedback in more than 3 years, closing the bug as fixed. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@FreeBSD.ORG Thu Jun 5 14:26:42 2014 Return-Path: Delivered-To: freebsd-xen@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id CB4C7A96 for ; Thu, 5 Jun 2014 14:26:42 +0000 (UTC) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id B27CE236D for ; Thu, 5 Jun 2014 14:26:42 +0000 (UTC) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.14.8/8.14.8) with ESMTP id s55EQgMv079283 for ; Thu, 5 Jun 2014 15:26:42 +0100 (BST) (envelope-from bz-noreply@freebsd.org) From: bz-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 135667] ufs filesystem corruption on XEN DomU system Date: Thu, 05 Jun 2014 14:26:42 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 8.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: royger@freebsd.org X-Bugzilla-Status: Issue Resolved X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status cc resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Jun 2014 14:26:42 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D135667 Roger Pau Monn=C3=A9 changed: What |Removed |Added ---------------------------------------------------------------------------- Status|In Discussion |Issue Resolved CC| |royger@freebsd.org Resolution|--- |FIXED --- Comment #6 from Roger Pau Monn=C3=A9 --- No feedback in more than 3 years, closing the issue as fixed. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@FreeBSD.ORG Thu Jun 5 14:36:44 2014 Return-Path: Delivered-To: freebsd-xen@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id D4277D9B for ; Thu, 5 Jun 2014 14:36:44 +0000 (UTC) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id BB1582477 for ; Thu, 5 Jun 2014 14:36:44 +0000 (UTC) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.14.8/8.14.8) with ESMTP id s55Eai7A008597 for ; Thu, 5 Jun 2014 15:36:44 +0100 (BST) (envelope-from bz-noreply@freebsd.org) From: bz-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 154473] [xen] xen 4.0 - DomU freebsd8.1 i386, XEN kernel. Not Work SMP Date: Thu, 05 Jun 2014 14:36:41 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: unspecified X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: royger@freebsd.org X-Bugzilla-Status: Issue Resolved X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status cc resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Jun 2014 14:36:44 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D154473 Roger Pau Monn=C3=A9 changed: What |Removed |Added ---------------------------------------------------------------------------- Status|In Discussion |Issue Resolved CC| |royger@freebsd.org Resolution|--- |DUPLICATE --- Comment #2 from Roger Pau Monn=C3=A9 --- *** This bug has been marked as a duplicate of bug 154833 *** --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@FreeBSD.ORG Thu Jun 5 14:36:45 2014 Return-Path: Delivered-To: freebsd-xen@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 2BD41D9D for ; Thu, 5 Jun 2014 14:36:45 +0000 (UTC) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 1337B247A for ; Thu, 5 Jun 2014 14:36:45 +0000 (UTC) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.14.8/8.14.8) with ESMTP id s55EaiS8008658 for ; Thu, 5 Jun 2014 15:36:44 +0100 (BST) (envelope-from bz-noreply@freebsd.org) From: bz-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 154833] [xen]: xen 4.0 - DomU freebsd8.2RC3 i386, XEN kernel. Not Work SMP Date: Thu, 05 Jun 2014 14:36:41 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: unspecified X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: royger@freebsd.org X-Bugzilla-Status: In Discussion X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Jun 2014 14:36:45 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D154833 --- Comment #5 from Roger Pau Monn=C3=A9 --- *** Bug 154473 has been marked as a duplicate of this bug. *** --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@FreeBSD.ORG Thu Jun 5 14:37:51 2014 Return-Path: Delivered-To: freebsd-xen@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 1F4E0E00 for ; Thu, 5 Jun 2014 14:37:51 +0000 (UTC) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 05EEF248C for ; Thu, 5 Jun 2014 14:37:51 +0000 (UTC) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.14.8/8.14.8) with ESMTP id s55EbofZ019718 for ; Thu, 5 Jun 2014 15:37:50 +0100 (BST) (envelope-from bz-noreply@freebsd.org) From: bz-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 154833] [xen]: xen 4.0 - DomU freebsd8.2RC3 i386, XEN kernel. Not Work SMP Date: Thu, 05 Jun 2014 14:37:51 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: unspecified X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: royger@freebsd.org X-Bugzilla-Status: Issue Resolved X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status cc resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Jun 2014 14:37:51 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D154833 Roger Pau Monn=C3=A9 changed: What |Removed |Added ---------------------------------------------------------------------------- Status|In Discussion |Issue Resolved CC| |royger@freebsd.org Resolution|--- |Works As Intended --- Comment #6 from Roger Pau Monn=C3=A9 --- FreeBSD i386 XEN PV kernels don't support SMP, and they are unmaintained, closing the issue. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@FreeBSD.ORG Thu Jun 5 14:40:58 2014 Return-Path: Delivered-To: freebsd-xen@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 3BB7AB3 for ; Thu, 5 Jun 2014 14:40:58 +0000 (UTC) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 22AF52549 for ; Thu, 5 Jun 2014 14:40:58 +0000 (UTC) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.14.8/8.14.8) with ESMTP id s55EewA7035488 for ; Thu, 5 Jun 2014 15:40:58 +0100 (BST) (envelope-from bz-noreply@freebsd.org) From: bz-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 143069] [xen] [panic] Xen Kernel Panic - Memory modified after free (8.0-RELEASE) Date: Thu, 05 Jun 2014 14:40:57 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 8.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: royger@freebsd.org X-Bugzilla-Status: Issue Resolved X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status cc resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Jun 2014 14:40:58 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D143069 Roger Pau Monn=C3=A9 changed: What |Removed |Added ---------------------------------------------------------------------------- Status|In Discussion |Issue Resolved CC| |royger@freebsd.org Resolution|--- |FIXED --- Comment #4 from Roger Pau Monn=C3=A9 --- Closed since no feedback has been received for more than 3 years and Colin Percival fixes probably solved the issue. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@FreeBSD.ORG Thu Jun 5 14:45:51 2014 Return-Path: Delivered-To: freebsd-xen@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 8D8483AE for ; Thu, 5 Jun 2014 14:45:51 +0000 (UTC) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 7469625A8 for ; Thu, 5 Jun 2014 14:45:51 +0000 (UTC) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.14.8/8.14.8) with ESMTP id s55EjpCu039469 for ; Thu, 5 Jun 2014 15:45:51 +0100 (BST) (envelope-from bz-noreply@freebsd.org) From: bz-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 124516] [xen] FreeBSD-CURRENT Xen Kernel Segfaults when configuring apache Date: Thu, 05 Jun 2014 14:45:51 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: i386 X-Bugzilla-Version: unspecified X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: royger@freebsd.org X-Bugzilla-Status: Issue Resolved X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status cc resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Jun 2014 14:45:51 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D124516 Roger Pau Monn=C3=A9 changed: What |Removed |Added ---------------------------------------------------------------------------- Status|In Discussion |Issue Resolved CC| |royger@freebsd.org Resolution|--- |Unable to Reproduce --- Comment #5 from Roger Pau Monn=C3=A9 --- Closing due to inability to reproduce the bug as reported by Colin Percival. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@FreeBSD.ORG Thu Jun 5 14:48:00 2014 Return-Path: Delivered-To: freebsd-xen@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 943683F1 for ; Thu, 5 Jun 2014 14:48:00 +0000 (UTC) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 7B15E25BD for ; Thu, 5 Jun 2014 14:48:00 +0000 (UTC) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.14.8/8.14.8) with ESMTP id s55Em05w040461 for ; Thu, 5 Jun 2014 15:48:00 +0100 (BST) (envelope-from bz-noreply@freebsd.org) From: bz-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 155468] [xen] Xen PV i386 multi-kernel CPU system is not working Date: Thu, 05 Jun 2014 14:48:00 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 8.2-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: royger@freebsd.org X-Bugzilla-Status: Issue Resolved X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status cc resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Jun 2014 14:48:00 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D155468 Roger Pau Monn=C3=A9 changed: What |Removed |Added ---------------------------------------------------------------------------- Status|In Discussion |Issue Resolved CC| |royger@freebsd.org Resolution|--- |Works As Intended --- Comment #2 from Roger Pau Monn=C3=A9 --- FreeBSD i386 Xen PV kernel doesn't support SMP and is unmaintained, closing= the issue. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@FreeBSD.ORG Thu Jun 5 14:50:53 2014 Return-Path: Delivered-To: freebsd-xen@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id F38604FE for ; Thu, 5 Jun 2014 14:50:52 +0000 (UTC) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id DA0E125ED for ; Thu, 5 Jun 2014 14:50:52 +0000 (UTC) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.14.8/8.14.8) with ESMTP id s55Eoq2Z043877 for ; Thu, 5 Jun 2014 15:50:52 +0100 (BST) (envelope-from bz-noreply@freebsd.org) From: bz-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 154472] [xen] xen 4.0 - DomU freebsd8.1 i386 xen kernel rebooting on compile port libgcrypt Date: Thu, 05 Jun 2014 14:50:52 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: unspecified X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: royger@freebsd.org X-Bugzilla-Status: Issue Resolved X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status cc resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Jun 2014 14:50:53 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D154472 Roger Pau Monn=C3=A9 changed: What |Removed |Added ---------------------------------------------------------------------------- Status|In Discussion |Issue Resolved CC| |royger@freebsd.org Resolution|--- |DUPLICATE --- Comment #4 from Roger Pau Monn=C3=A9 --- *** This bug has been marked as a duplicate of bug 140313 *** --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@FreeBSD.ORG Thu Jun 5 14:50:53 2014 Return-Path: Delivered-To: freebsd-xen@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 4EC38500 for ; Thu, 5 Jun 2014 14:50:53 +0000 (UTC) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 357FD25EF for ; Thu, 5 Jun 2014 14:50:53 +0000 (UTC) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.14.8/8.14.8) with ESMTP id s55EorY5043884 for ; Thu, 5 Jun 2014 15:50:53 +0100 (BST) (envelope-from bz-noreply@freebsd.org) From: bz-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 140313] [xen] [panic] FreeBSD8 RC2 as PV domU crashes during configure of security/libgcrypt Date: Thu, 05 Jun 2014 14:50:52 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: unspecified X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: royger@freebsd.org X-Bugzilla-Status: Loop Closed X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Jun 2014 14:50:53 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D140313 Roger Pau Monn=C3=A9 changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |al@o.dp.ua --- Comment #8 from Roger Pau Monn=C3=A9 --- *** Bug 154472 has been marked as a duplicate of this bug. *** --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@FreeBSD.ORG Thu Jun 5 15:09:03 2014 Return-Path: Delivered-To: freebsd-xen@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 2A0B09BF for ; Thu, 5 Jun 2014 15:09:03 +0000 (UTC) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 1182727DE for ; Thu, 5 Jun 2014 15:09:03 +0000 (UTC) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.14.8/8.14.8) with ESMTP id s55F92w4011890 for ; Thu, 5 Jun 2014 16:09:02 +0100 (BST) (envelope-from bz-noreply@freebsd.org) From: bz-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 162677] [xen] FreeBSD not compatible with "Current Stable Xen" Date: Thu, 05 Jun 2014 15:09:03 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: unspecified X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: royger@freebsd.org X-Bugzilla-Status: Issue Resolved X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status cc resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Jun 2014 15:09:03 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D162677 Roger Pau Monn=C3=A9 changed: What |Removed |Added ---------------------------------------------------------------------------- Status|In Discussion |Issue Resolved CC| |royger@freebsd.org Resolution|--- |Unable to Reproduce --- Comment #3 from Roger Pau Monn=C3=A9 --- I can confirm that supported FreeBSD versions work on current Xen releases. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@FreeBSD.ORG Thu Jun 5 16:13:24 2014 Return-Path: Delivered-To: freebsd-xen@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 063A2BD9 for ; Thu, 5 Jun 2014 16:13:24 +0000 (UTC) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id E16772F2D for ; Thu, 5 Jun 2014 16:13:23 +0000 (UTC) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.14.8/8.14.8) with ESMTP id s55GDNu6076432 for ; Thu, 5 Jun 2014 17:13:23 +0100 (BST) (envelope-from bz-noreply@freebsd.org) From: bz-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 175757] [xen] [patch] xen pvhvm looses keyboard input from VNC Date: Thu, 05 Jun 2014 16:13:24 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: unspecified X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: royger@freebsd.org X-Bugzilla-Status: Issue Resolved X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status cc resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Jun 2014 16:13:24 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D175757 Roger Pau Monn=C3=A9 changed: What |Removed |Added ---------------------------------------------------------------------------- Status|In Discussion |Issue Resolved CC| |royger@freebsd.org Resolution|--- |FIXED --- Comment #2 from Roger Pau Monn=C3=A9 --- Patch has been committed. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@FreeBSD.ORG Thu Jun 5 16:15:29 2014 Return-Path: Delivered-To: freebsd-xen@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 5927DD13 for ; Thu, 5 Jun 2014 16:15:29 +0000 (UTC) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4088F2F4D for ; Thu, 5 Jun 2014 16:15:29 +0000 (UTC) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.14.8/8.14.8) with ESMTP id s55GFT21082829 for ; Thu, 5 Jun 2014 17:15:29 +0100 (BST) (envelope-from bz-noreply@freebsd.org) From: bz-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 166174] [xen] Problems ROOT MOUNT ERROR Date: Thu, 05 Jun 2014 16:15:29 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: unspecified X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: royger@freebsd.org X-Bugzilla-Status: Issue Resolved X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status cc resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Jun 2014 16:15:29 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D166174 Roger Pau Monn=C3=A9 changed: What |Removed |Added ---------------------------------------------------------------------------- Status|In Discussion |Issue Resolved CC| |royger@freebsd.org Resolution|--- |FIXED --- Comment #7 from Roger Pau Monn=C3=A9 --- Fixed in FreeBSD 8.4 --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@FreeBSD.ORG Thu Jun 5 16:24:35 2014 Return-Path: Delivered-To: freebsd-xen@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 4D51FEEB for ; Thu, 5 Jun 2014 16:24:35 +0000 (UTC) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 34C802028 for ; Thu, 5 Jun 2014 16:24:35 +0000 (UTC) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.14.8/8.14.8) with ESMTP id s55GOZEe090869 for ; Thu, 5 Jun 2014 17:24:35 +0100 (BST) (envelope-from bz-noreply@freebsd.org) From: bz-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 176471] [xen] xn driver crash on detach Date: Thu, 05 Jun 2014 16:24:33 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: royger@freebsd.org X-Bugzilla-Status: Issue Resolved X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status cc resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Jun 2014 16:24:35 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D176471 Roger Pau Monn=C3=A9 changed: What |Removed |Added ---------------------------------------------------------------------------- Status|In Discussion |Issue Resolved CC| |royger@freebsd.org Resolution|--- |FIXED --- Comment #10 from Roger Pau Monn=C3=A9 --- Fixed and MCFed to stable-9. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@FreeBSD.ORG Thu Jun 5 16:26:04 2014 Return-Path: Delivered-To: freebsd-xen@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id EE060F28 for ; Thu, 5 Jun 2014 16:26:04 +0000 (UTC) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id D55982036 for ; Thu, 5 Jun 2014 16:26:04 +0000 (UTC) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.14.8/8.14.8) with ESMTP id s55GQ4N2008072 for ; Thu, 5 Jun 2014 17:26:04 +0100 (BST) (envelope-from bz-noreply@freebsd.org) From: bz-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 165418] [xen] Problems mounting root filesystem from XENHVM Date: Thu, 05 Jun 2014 16:26:05 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: unspecified X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: royger@freebsd.org X-Bugzilla-Status: Issue Resolved X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status cc resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Jun 2014 16:26:05 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D165418 Roger Pau Monn=C3=A9 changed: What |Removed |Added ---------------------------------------------------------------------------- Status|In Discussion |Issue Resolved CC| |royger@freebsd.org Resolution|--- |FIXED --- Comment #7 from Roger Pau Monn=C3=A9 --- The translation layer in blkfront has been updated to use the new adaX synt= ax, and the fix has been MFCed to stable-9. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@FreeBSD.ORG Wed Jun 18 13:04:03 2014 Return-Path: Delivered-To: freebsd-xen@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id A7F7F159 for ; Wed, 18 Jun 2014 13:04:03 +0000 (UTC) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 8A518204D for ; Wed, 18 Jun 2014 13:04:03 +0000 (UTC) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.14.8/8.14.8) with ESMTP id s5ID43uh037730 for ; Wed, 18 Jun 2014 14:04:03 +0100 (BST) (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 188261] [xen] FreeBSD DomU PVHVM guests cannot 'route' traffic for other Xen PV guests on same Dom0 Host. Date: Wed, 18 Jun 2014 13:04:03 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 9.2-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: kpielorz@tdx.co.uk X-Bugzilla-Status: In Discussion X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 18 Jun 2014 13:04:03 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=188261 --- Comment #2 from kpielorz@tdx.co.uk --- Having setup a test system with FreeBSD 9.2-STABLE, 10-STABLE, 11-CURRENT etc. this bug still exists on all of those, regardless of version. For a 'Client' (i.e. a guest VM trying to route traffic through the other FreeBSD 'router' machine) you can do: ifconfig xn0 -txcsum And it will fix that single client. No amount of option fiddling (other than restarting in HVM mode) will fix the 'router' machine - i.e. it's not possible to fix the 'router' machine so that clients don't need any fix. I've been unable to test disabling txcsum on Windows clients running on the same XenServer as I can't see where I can do that. -- You are receiving this mail because: You are the assignee for the bug. From owner-freebsd-xen@FreeBSD.ORG Wed Jun 18 13:16:06 2014 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id C06876F0 for ; Wed, 18 Jun 2014 13:16:06 +0000 (UTC) Received: from mail.tdx.com (mail.tdx.com [62.13.128.18]) by mx1.freebsd.org (Postfix) with ESMTP id 69CEA2196 for ; Wed, 18 Jun 2014 13:16:05 +0000 (UTC) Received: from Mail-PC.tdx.co.uk (storm.tdx.co.uk [62.13.130.251]) (authenticated bits=0) by mail.tdx.com (8.14.3/8.14.3/) with ESMTP id s5IDBclR044719 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO) for ; Wed, 18 Jun 2014 14:11:39 +0100 (BST) Date: Wed, 18 Jun 2014 14:11:38 +0100 From: Karl Pielorz To: freebsd-xen@freebsd.org Subject: re. pr188261 - any way I can investigate further? Message-ID: <7B689F2C8C07F01AD552CA61@Mail-PC.tdx.co.uk> X-Mailer: Mulberry/4.0.8 (Win32) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit Content-Disposition: inline X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 18 Jun 2014 13:16:06 -0000 Hi, I submitted a PR a while ago (pr188261) - or now, Bugzilla I've updated this recently - as I found doing 'ifconfig xn0 -txcsum' on a "client" will fix the issue, for just that client - but I'm still unable to fix the 'router' VM in such a way as all clients don't need a fix. I have a test system setup with all this now (and all of 9.2-S, 10-S, and 11-Current have the issue) - is anyone able to point me in the right direction of what I can do to investigate this further? (i.e. debug things, packet captures, etc. etc.) We could really do with getting this fixed - we use FreeBSD as routers on a few systems - as as they move to Xen we end up having to either setup 2 pools (and be very, very careful about what machines we put on each) in order to avoid this - or face running them in HVM mode for which the performance is very, very poor. -Karl From owner-freebsd-xen@FreeBSD.ORG Fri Jun 20 09:36:10 2014 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id B95DAEA6; Fri, 20 Jun 2014 09:36:10 +0000 (UTC) Received: from SMTP.CITRIX.COM (smtp.citrix.com [66.165.176.89]) (using TLSv1 with cipher RC4-SHA (128/128 bits)) (Client CN "mail.citrix.com", Issuer "Cybertrust Public SureServer SV CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id A41112989; Fri, 20 Jun 2014 09:36:09 +0000 (UTC) X-IronPort-AV: E=Sophos;i="5.01,513,1400025600"; d="scan'208";a="145670617" Received: from accessns.citrite.net (HELO FTLPEX01CL02.citrite.net) ([10.9.154.239]) by FTLPIPO01.CITRIX.COM with ESMTP; 20 Jun 2014 09:36:00 +0000 Received: from [127.0.0.1] (10.80.16.47) by smtprelay.citrix.com (10.13.107.79) with Microsoft SMTP Server id 14.3.181.6; Fri, 20 Jun 2014 05:35:59 -0400 Message-ID: <53A40079.9000804@citrix.com> Date: Fri, 20 Jun 2014 11:35:53 +0200 From: =?ISO-8859-1?Q?Roger_Pau_Monn=E9?= User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.7; rv:24.0) Gecko/20100101 Thunderbird/24.6.0 MIME-Version: 1.0 To: , "freebsd-xen@freebsd.org" , Subject: FreeBSD and memory balloon drivers X-Enigmail-Version: 1.6 Content-Type: text/plain; charset="ISO-8859-1" Content-Transfer-Encoding: 7bit X-DLP: MIA1 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 20 Jun 2014 09:36:10 -0000 Hello, I've been looking into the Xen balloon driver, because I've experienced problems when ballooning memory down which AFAICT are also present in the VirtIO balloon driver. The problem I've experienced is that when ballooning memory down, we basically allocate a bunch of memory as WIRED, to make sure nobody tries to swap it do disk, since it will crash the kernel because the memory is not populated. Due to this massive amount of memory allocated as WIRED, user-space programs that try to use mlock will fail because we hit the limit in vm.max_wired. I'm not sure what's the best way to deal with this limitation, should vm.max_wired be changed from the balloon drivers when ballooning down/up? Is there anyway to remove the pages ballooned down from the memory accounting of wired pages? Thanks, Roger. From owner-freebsd-xen@FreeBSD.ORG Fri Jun 20 09:55:10 2014 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 069257A0 for ; Fri, 20 Jun 2014 09:55:10 +0000 (UTC) Received: from SMTP02.CITRIX.COM (smtp02.citrix.com [66.165.176.63]) (using TLSv1 with cipher RC4-SHA (128/128 bits)) (Client CN "mail.citrix.com", Issuer "Cybertrust Public SureServer SV CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 511A72B46 for ; Fri, 20 Jun 2014 09:55:08 +0000 (UTC) X-IronPort-AV: E=Sophos;i="5.01,513,1400025600"; d="scan'208";a="145378281" Received: from accessns.citrite.net (HELO FTLPEX01CL01.citrite.net) ([10.9.154.239]) by FTLPIPO02.CITRIX.COM with ESMTP; 20 Jun 2014 09:55:00 +0000 Received: from [127.0.0.1] (10.80.16.47) by smtprelay.citrix.com (10.13.107.78) with Microsoft SMTP Server id 14.3.181.6; Fri, 20 Jun 2014 05:54:59 -0400 Message-ID: <53A404EF.4070400@citrix.com> Date: Fri, 20 Jun 2014 11:54:55 +0200 From: =?ISO-8859-1?Q?Roger_Pau_Monn=E9?= User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.7; rv:24.0) Gecko/20100101 Thunderbird/24.6.0 MIME-Version: 1.0 To: Karl Pielorz , Subject: Re: re. pr188261 - any way I can investigate further? References: <7B689F2C8C07F01AD552CA61@Mail-PC.tdx.co.uk> In-Reply-To: <7B689F2C8C07F01AD552CA61@Mail-PC.tdx.co.uk> X-Enigmail-Version: 1.6 Content-Type: text/plain; charset="ISO-8859-1" Content-Transfer-Encoding: 7bit X-DLP: MIA1 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 20 Jun 2014 09:55:10 -0000 On 18/06/14 15:11, Karl Pielorz wrote: > > Hi, > > I submitted a PR a while ago (pr188261) - or now, Bugzilla > > > I've updated this recently - as I found doing 'ifconfig xn0 -txcsum' on > a "client" will fix the issue, for just that client - but I'm still > unable to fix the 'router' VM in such a way as all clients don't need a > fix. > > I have a test system setup with all this now (and all of 9.2-S, 10-S, > and 11-Current have the issue) - is anyone able to point me in the right > direction of what I can do to investigate this further? (i.e. debug > things, packet captures, etc. etc.) > > We could really do with getting this fixed - we use FreeBSD as routers > on a few systems - as as they move to Xen we end up having to either > setup 2 pools (and be very, very careful about what machines we put on > each) in order to avoid this - or face running them in HVM mode for > which the performance is very, very poor. I suggest that you try to bring this to freebsd-net, I certainly don't have the network skills to know what's going on, maybe someone can provide more insight there which could help track this down (I can certainly help as much as possible with the Xen part). If not I will try to get a look, but I cannot tell when is that going to happen, I've got my plate quite full right now. Roger. From owner-freebsd-xen@FreeBSD.ORG Fri Jun 20 13:28:33 2014 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id ED9D49CD; Fri, 20 Jun 2014 13:28:33 +0000 (UTC) Received: from kib.kiev.ua (kib.kiev.ua [IPv6:2001:470:d5e7:1::1]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 77303216D; Fri, 20 Jun 2014 13:28:33 +0000 (UTC) Received: from tom.home (kostik@localhost [127.0.0.1]) by kib.kiev.ua (8.14.9/8.14.9) with ESMTP id s5KDSG66027116; Fri, 20 Jun 2014 16:28:16 +0300 (EEST) (envelope-from kostikbel@gmail.com) DKIM-Filter: OpenDKIM Filter v2.8.3 kib.kiev.ua s5KDSG66027116 Received: (from kostik@localhost) by tom.home (8.14.9/8.14.8/Submit) id s5KDSGDQ027115; Fri, 20 Jun 2014 16:28:16 +0300 (EEST) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: tom.home: kostik set sender to kostikbel@gmail.com using -f Date: Fri, 20 Jun 2014 16:28:16 +0300 From: Konstantin Belousov To: Roger Pau Monn? Subject: Re: FreeBSD and memory balloon drivers Message-ID: <20140620132816.GH3991@kib.kiev.ua> References: <53A40079.9000804@citrix.com> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="i+R2Fnv74iOC5F2I" Content-Disposition: inline In-Reply-To: <53A40079.9000804@citrix.com> User-Agent: Mutt/1.5.23 (2014-03-12) X-Spam-Status: No, score=-2.0 required=5.0 tests=ALL_TRUSTED,BAYES_00, DKIM_ADSP_CUSTOM_MED,FREEMAIL_FROM,NML_ADSP_CUSTOM_MED autolearn=no autolearn_force=no version=3.4.0 X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on tom.home Cc: virtualization@FreeBSD.org, "freebsd-xen@freebsd.org" , bryanv@FreeBSD.org X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 20 Jun 2014 13:28:34 -0000 --i+R2Fnv74iOC5F2I Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Fri, Jun 20, 2014 at 11:35:53AM +0200, Roger Pau Monn? wrote: > Hello, >=20 > I've been looking into the Xen balloon driver, because I've experienced > problems when ballooning memory down which AFAICT are also present in > the VirtIO balloon driver. The problem I've experienced is that when > ballooning memory down, we basically allocate a bunch of memory as > WIRED, to make sure nobody tries to swap it do disk, since it will crash > the kernel because the memory is not populated. Due to this massive > amount of memory allocated as WIRED, user-space programs that try to use > mlock will fail because we hit the limit in vm.max_wired. >=20 > I'm not sure what's the best way to deal with this limitation, should > vm.max_wired be changed from the balloon drivers when ballooning > down/up? Is there anyway to remove the pages ballooned down from the > memory accounting of wired pages? You could change the type of pages the ballon driver is allocating. Instead of wired pages, you may request unmanaged, by passing NULL object to vm_page_alloc(). This would also save on the trie nodes for managing the radix trie for the object. There are still plinks or listq to keep track of the allocated pages. --i+R2Fnv74iOC5F2I Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iQIcBAEBAgAGBQJTpDbvAAoJEJDCuSvBvK1BgikP+gPdzLt8XtsevQkU8vfpCtJj ZnRdVneYSdHC6JBe+wUI0eT4/gQ9bIUD8eHYeVrVSW4JG0Br4SrpU0fTigfHi14j udk2+tcTmUFw7Ksx2l8L8qKGatWacZXZwF9adZfazvulwmMKmzou2bOcO9V9bBMb 8XgamaNFDldAl2KYyFP2k93ozuSTjgww1WhjooFcbhdlVgDDYzK+SNpk17BgDD+b 9FXjkiIKBNtH+xTznmL5zYAmrr4pCAy0MaOElawnR7oRlm0h9/9E49efm6jAcXrn ntnkfzlScTSRBtk/ZxIMpkK87LUfY80VkGnSentkSAUBqqEr217Ifnqf/Kbn8Y0v Zh0HGP2nF1J1TwqhEbsgQMGEBHjwzjx/vX39NX5pJfnCQ9Okb6mJMkzCR/8iIysI mNgYa0EOzg5wo022GiO18iWinAhklYFhIc+rc65Ot9qOSq5Y2lhp1xks1HTEnuC6 ircTeK5do0II/boxvv5j3pefjnUEc39iwSuKuKx4enFDErN3tQjJ/G2NqdqfYPH7 rhl4UMX1X0vIxLraOT1ZNIlJupj1gSfuAxgcEMdl54Upx9nE8IeSfy0F8UN8Kj5n js6brUwv06sHX9FUN5Ixo10ifZRqktzV9YcEEzaVYrTsM9+IFC3UgEt8QQ3CQubW sphwPTjgF7JM8TWS+fWf =dJ1f -----END PGP SIGNATURE----- --i+R2Fnv74iOC5F2I-- From owner-freebsd-xen@FreeBSD.ORG Fri Jun 20 15:15:50 2014 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 41C71B2E; Fri, 20 Jun 2014 15:15:50 +0000 (UTC) Received: from SMTP02.CITRIX.COM (smtp02.citrix.com [66.165.176.63]) (using TLSv1 with cipher RC4-SHA (128/128 bits)) (Client CN "mail.citrix.com", Issuer "Cybertrust Public SureServer SV CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 326532B84; Fri, 20 Jun 2014 15:15:48 +0000 (UTC) X-IronPort-AV: E=Sophos;i="5.01,514,1400025600"; d="scan'208,223";a="145480682" Received: from accessns.citrite.net (HELO FTLPEX01CL02.citrite.net) ([10.9.154.239]) by FTLPIPO02.CITRIX.COM with ESMTP; 20 Jun 2014 15:15:45 +0000 Received: from [127.0.0.1] (10.80.16.47) by smtprelay.citrix.com (10.13.107.79) with Microsoft SMTP Server id 14.3.181.6; Fri, 20 Jun 2014 11:15:45 -0400 Message-ID: <53A4501F.4020201@citrix.com> Date: Fri, 20 Jun 2014 17:15:43 +0200 From: =?ISO-8859-1?Q?Roger_Pau_Monn=E9?= User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.7; rv:24.0) Gecko/20100101 Thunderbird/24.6.0 MIME-Version: 1.0 To: Konstantin Belousov Subject: Re: FreeBSD and memory balloon drivers References: <53A40079.9000804@citrix.com> <20140620132816.GH3991@kib.kiev.ua> In-Reply-To: <20140620132816.GH3991@kib.kiev.ua> X-Enigmail-Version: 1.6 Content-Type: multipart/mixed; boundary="------------080308010102010404060706" X-DLP: MIA1 Cc: virtualization@FreeBSD.org, "freebsd-xen@freebsd.org" , bryanv@FreeBSD.org X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 20 Jun 2014 15:15:50 -0000 --------------080308010102010404060706 Content-Type: text/plain; charset="ISO-8859-1" Content-Transfer-Encoding: 7bit -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On 20/06/14 15:28, Konstantin Belousov wrote: > On Fri, Jun 20, 2014 at 11:35:53AM +0200, Roger Pau Monn? wrote: >> Hello, >> >> I've been looking into the Xen balloon driver, because I've >> experienced problems when ballooning memory down which AFAICT are >> also present in the VirtIO balloon driver. The problem I've >> experienced is that when ballooning memory down, we basically >> allocate a bunch of memory as WIRED, to make sure nobody tries to >> swap it do disk, since it will crash the kernel because the >> memory is not populated. Due to this massive amount of memory >> allocated as WIRED, user-space programs that try to use mlock >> will fail because we hit the limit in vm.max_wired. >> >> I'm not sure what's the best way to deal with this limitation, >> should vm.max_wired be changed from the balloon drivers when >> ballooning down/up? Is there anyway to remove the pages ballooned >> down from the memory accounting of wired pages? > > You could change the type of pages the ballon driver is > allocating. Instead of wired pages, you may request unmanaged, by > passing NULL object to vm_page_alloc(). This would also save on > the trie nodes for managing the radix trie for the object. There > are still plinks or listq to keep track of the allocated pages. Thanks for the info, I have the following patch which fixes the usage of WIRED for both the Xen and the VirtIO balloon drivers, could someone please test the VirtIO side? Roger. -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.12 (Darwin) iQEcBAEBAgAGBQJTpFAfAAoJEKXZdqUyumTA1TQH/22YpAGCQ8oa0hmpfE8oovxz q8EDRyfDoogEswNYwboI8cBP7GSbuBbe1Z0MTiMHtwyHzqGhJM5B7jKioqFsqxvc /Qfld8z3vDD94/5iaMX64dV2/VKkLwypR2uU5PkN018FTAJ0FFycC336xVjD8eUz /DCRQIZRUzNlcrZYlOtSALR2M9bM1/f2++e2C6L7kbSsF4BAH2wmRcdtM1uBMO6/ CnD7ctZsnxxdS05eLWMpv6jfcRH8yDM3vPaHgXa223q74TU1Rh7AFw/TPsyBvBY2 cDUnYLZdUx0NQJfPM9MKGLe8P5o3WLVO1hfGmrZHdmjE2B18mNfzg4SS0CUQhQ0= =hctw -----END PGP SIGNATURE----- --------------080308010102010404060706 Content-Type: text/plain; charset="UTF-8"; x-mac-type=0; x-mac-creator=0; name="0001-xen-virtio-fix-balloon-drivers-to-not-mark-pages-as-.patch" Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename*0="0001-xen-virtio-fix-balloon-drivers-to-not-mark-pages-as-.pa"; filename*1="tch" >From 2ed0f82b16753c96e96acc1e26a75a0fd2ee7d34 Mon Sep 17 00:00:00 2001 From: Roger Pau Monne Date: Fri, 20 Jun 2014 16:34:31 +0200 Subject: [PATCH] xen/virtio: fix balloon drivers to not mark pages as WIRED Prevent the Xen and VirtIO balloon drivers from marking pages as wired. This prevents them from increasing the system wired page count, which can lead to mlock failing because of hitting the limit in vm.max_wired. Also, in the Xen case make sure pages are zeroed before giving them back to the hypervisor, or else we might be leaking data. Sponsored by: Citrix Systems R&D Reviewed by: xxx Approved by: xxx dev/virtio/balloon/virtio_balloon.c: - Don't allocate pages with VM_ALLOC_WIRED. dev/xen/balloon/balloon.c: - Don't allocate pages with VM_ALLOC_WIRED. - Make sure pages are zeroed before giving them back to the hypervisor. --- sys/dev/virtio/balloon/virtio_balloon.c | 4 +--- sys/dev/xen/balloon/balloon.c | 13 ++++++++++--- 2 files changed, 11 insertions(+), 6 deletions(-) diff --git a/sys/dev/virtio/balloon/virtio_balloon.c b/sys/dev/virtio/balloon/virtio_balloon.c index d540099..6d00ef3 100644 --- a/sys/dev/virtio/balloon/virtio_balloon.c +++ b/sys/dev/virtio/balloon/virtio_balloon.c @@ -438,8 +438,7 @@ vtballoon_alloc_page(struct vtballoon_softc *sc) { vm_page_t m; - m = vm_page_alloc(NULL, 0, VM_ALLOC_NORMAL | VM_ALLOC_WIRED | - VM_ALLOC_NOOBJ); + m = vm_page_alloc(NULL, 0, VM_ALLOC_NORMAL | VM_ALLOC_NOOBJ); if (m != NULL) sc->vtballoon_current_npages++; @@ -450,7 +449,6 @@ static void vtballoon_free_page(struct vtballoon_softc *sc, vm_page_t m) { - vm_page_unwire(m, PQ_INACTIVE); vm_page_free(m); sc->vtballoon_current_npages--; } diff --git a/sys/dev/xen/balloon/balloon.c b/sys/dev/xen/balloon/balloon.c index fa56c86..a7ca1e4 100644 --- a/sys/dev/xen/balloon/balloon.c +++ b/sys/dev/xen/balloon/balloon.c @@ -255,7 +255,6 @@ increase_reservation(unsigned long nr_pages) set_phys_to_machine(pfn, frame_list[i]); - vm_page_unwire(page, PQ_INACTIVE); vm_page_free(page); } @@ -286,18 +285,26 @@ decrease_reservation(unsigned long nr_pages) for (i = 0; i < nr_pages; i++) { if ((page = vm_page_alloc(NULL, 0, VM_ALLOC_NORMAL | VM_ALLOC_NOOBJ | - VM_ALLOC_WIRED | VM_ALLOC_ZERO)) == NULL) { + VM_ALLOC_ZERO)) == NULL) { nr_pages = i; need_sleep = 1; break; } + if ((page->flags & PG_ZERO) == 0) { + /* + * Zero the page, or else we might be leaking + * important data to other domains on the same + * host. + */ + pmap_zero_page(page); + } + pfn = (VM_PAGE_TO_PHYS(page) >> PAGE_SHIFT); frame_list[i] = PFNTOMFN(pfn); set_phys_to_machine(pfn, INVALID_P2M_ENTRY); if (balloon_append(page) != 0) { - vm_page_unwire(page, PQ_INACTIVE); vm_page_free(page); nr_pages = i; -- 1.7.7.5 (Apple Git-26) --------------080308010102010404060706-- From owner-freebsd-xen@FreeBSD.ORG Fri Jun 20 15:26:20 2014 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 69FBDF8A; Fri, 20 Jun 2014 15:26:20 +0000 (UTC) Received: from kib.kiev.ua (kib.kiev.ua [IPv6:2001:470:d5e7:1::1]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id EF5242C76; Fri, 20 Jun 2014 15:26:19 +0000 (UTC) Received: from tom.home (kostik@localhost [127.0.0.1]) by kib.kiev.ua (8.14.9/8.14.9) with ESMTP id s5KFQAMZ054571; Fri, 20 Jun 2014 18:26:10 +0300 (EEST) (envelope-from kostikbel@gmail.com) DKIM-Filter: OpenDKIM Filter v2.8.3 kib.kiev.ua s5KFQAMZ054571 Received: (from kostik@localhost) by tom.home (8.14.9/8.14.8/Submit) id s5KFQABo054570; Fri, 20 Jun 2014 18:26:10 +0300 (EEST) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: tom.home: kostik set sender to kostikbel@gmail.com using -f Date: Fri, 20 Jun 2014 18:26:10 +0300 From: Konstantin Belousov To: Roger Pau Monn? Subject: Re: FreeBSD and memory balloon drivers Message-ID: <20140620152610.GI3991@kib.kiev.ua> References: <53A40079.9000804@citrix.com> <20140620132816.GH3991@kib.kiev.ua> <53A4501F.4020201@citrix.com> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="OrKNV1jnpyJzuZNm" Content-Disposition: inline In-Reply-To: <53A4501F.4020201@citrix.com> User-Agent: Mutt/1.5.23 (2014-03-12) X-Spam-Status: No, score=-2.0 required=5.0 tests=ALL_TRUSTED,BAYES_00, DKIM_ADSP_CUSTOM_MED,FREEMAIL_FROM,NML_ADSP_CUSTOM_MED autolearn=no autolearn_force=no version=3.4.0 X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on tom.home Cc: virtualization@FreeBSD.org, "freebsd-xen@freebsd.org" , bryanv@FreeBSD.org X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 20 Jun 2014 15:26:20 -0000 --OrKNV1jnpyJzuZNm Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Fri, Jun 20, 2014 at 05:15:43PM +0200, Roger Pau Monn? wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 >=20 > On 20/06/14 15:28, Konstantin Belousov wrote: > > On Fri, Jun 20, 2014 at 11:35:53AM +0200, Roger Pau Monn? wrote: > >> Hello, > >>=20 > >> I've been looking into the Xen balloon driver, because I've > >> experienced problems when ballooning memory down which AFAICT are > >> also present in the VirtIO balloon driver. The problem I've > >> experienced is that when ballooning memory down, we basically > >> allocate a bunch of memory as WIRED, to make sure nobody tries to > >> swap it do disk, since it will crash the kernel because the > >> memory is not populated. Due to this massive amount of memory > >> allocated as WIRED, user-space programs that try to use mlock > >> will fail because we hit the limit in vm.max_wired. > >>=20 > >> I'm not sure what's the best way to deal with this limitation, > >> should vm.max_wired be changed from the balloon drivers when > >> ballooning down/up? Is there anyway to remove the pages ballooned > >> down from the memory accounting of wired pages? > >=20 > > You could change the type of pages the ballon driver is > > allocating. Instead of wired pages, you may request unmanaged, by > > passing NULL object to vm_page_alloc(). This would also save on > > the trie nodes for managing the radix trie for the object. There > > are still plinks or listq to keep track of the allocated pages. >=20 > Thanks for the info, I have the following patch which fixes the usage > of WIRED for both the Xen and the VirtIO balloon drivers, could > someone please test the VirtIO side? I briefly looked at the xen balloon. You do not need balloon_append(). Use struct vm_page plinks field to link the pages. --OrKNV1jnpyJzuZNm Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iQIcBAEBAgAGBQJTpFKRAAoJEJDCuSvBvK1Bbu4QAIt2ojo9JMTih/B2Y4S5vveD GRqLa3YUfOetBMt4xKbGKTmWcIzCcHBe1MIZ1qY8iufQErYwC5Kw0F0AxnSV2BEV TJReZbrWzlyKKIQZTTqgHf6ZUOIKI2rO1tSt5fj9fMBDSrbteqQOKdSd5saWfd1y g/xOFYjdB6iLtKhS+Q/1/CtwYmxTZKbzGf0D0LSa9dDsAEuL/i3SyNvNSUqXN6D3 uj6w78L0sTDx24zI31oEWbxWI5eII4tdTgMkDFZpa6c5/VRNAHo8dmCTDBTSy9M2 IcvgMWkOhPHNe+GG8IO1nupPcyby7vhlAymo0ubuH+QrnfWZNaTzpZgfE+bNtDkD wHwz4GRY/fheslBDkHf8KkQIASFpeE3uvgt2bktkJCTG53ER5Sr1CmLCjfic9xkF E2h6KoiK+5QsMBOy1UYO47La7apSEoPB8QrLrXf9V7Jjg3ZFLNNG0FbcGvfdD1Xp Fu8Fl+1ZIjuWrzA/UKjLaUzk5YrplWhWKbN1W9sndz7snFv+I3y2KVyi/AR2dcsq A50ctrx+qMrI4sDtjH3LpTRqI1xhAtIU3fveAKGWN19EYiJkgYCVaPmwTnz1L1c/ u5/szDWuegfaYQGjOr5yt/Zy/CBSiQwE1BiWUM4CXAZWXFxa9yRJASif+CmdILSM nMyMR7xeCqFadeLZc6Hh =+WSD -----END PGP SIGNATURE----- --OrKNV1jnpyJzuZNm-- From owner-freebsd-xen@FreeBSD.ORG Fri Jun 20 16:56:30 2014 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 8FCEFE9; Fri, 20 Jun 2014 16:56:30 +0000 (UTC) Received: from SMTP02.CITRIX.COM (smtp02.citrix.com [66.165.176.63]) (using TLSv1 with cipher RC4-SHA (128/128 bits)) (Client CN "mail.citrix.com", Issuer "Cybertrust Public SureServer SV CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 3E4A32496; Fri, 20 Jun 2014 16:56:28 +0000 (UTC) X-IronPort-AV: E=Sophos;i="5.01,514,1400025600"; d="scan'208,223";a="145521367" Received: from accessns.citrite.net (HELO FTLPEX01CL02.citrite.net) ([10.9.154.239]) by FTLPIPO02.CITRIX.COM with ESMTP; 20 Jun 2014 16:56:24 +0000 Received: from [127.0.0.1] (10.80.16.47) by smtprelay.citrix.com (10.13.107.79) with Microsoft SMTP Server id 14.3.181.6; Fri, 20 Jun 2014 12:56:24 -0400 Message-ID: <53A467B4.8070501@citrix.com> Date: Fri, 20 Jun 2014 18:56:20 +0200 From: =?ISO-8859-1?Q?Roger_Pau_Monn=E9?= User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.7; rv:24.0) Gecko/20100101 Thunderbird/24.6.0 MIME-Version: 1.0 To: Konstantin Belousov Subject: Re: FreeBSD and memory balloon drivers References: <53A40079.9000804@citrix.com> <20140620132816.GH3991@kib.kiev.ua> <53A4501F.4020201@citrix.com> <20140620152610.GI3991@kib.kiev.ua> In-Reply-To: <20140620152610.GI3991@kib.kiev.ua> X-Enigmail-Version: 1.6 Content-Type: multipart/mixed; boundary="------------090506020608050903030305" X-DLP: MIA1 Cc: virtualization@FreeBSD.org, "freebsd-xen@freebsd.org" , bryanv@FreeBSD.org X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 20 Jun 2014 16:56:30 -0000 --------------090506020608050903030305 Content-Type: text/plain; charset="ISO-8859-1" Content-Transfer-Encoding: 7bit -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On 20/06/14 17:26, Konstantin Belousov wrote: > On Fri, Jun 20, 2014 at 05:15:43PM +0200, Roger Pau Monn? wrote: >> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 >> >> On 20/06/14 15:28, Konstantin Belousov wrote: >>> On Fri, Jun 20, 2014 at 11:35:53AM +0200, Roger Pau Monn? >>> wrote: >>>> Hello, >>>> >>>> I've been looking into the Xen balloon driver, because I've >>>> experienced problems when ballooning memory down which AFAICT >>>> are also present in the VirtIO balloon driver. The problem >>>> I've experienced is that when ballooning memory down, we >>>> basically allocate a bunch of memory as WIRED, to make sure >>>> nobody tries to swap it do disk, since it will crash the >>>> kernel because the memory is not populated. Due to this >>>> massive amount of memory allocated as WIRED, user-space >>>> programs that try to use mlock will fail because we hit the >>>> limit in vm.max_wired. >>>> >>>> I'm not sure what's the best way to deal with this >>>> limitation, should vm.max_wired be changed from the balloon >>>> drivers when ballooning down/up? Is there anyway to remove >>>> the pages ballooned down from the memory accounting of wired >>>> pages? >>> >>> You could change the type of pages the ballon driver is >>> allocating. Instead of wired pages, you may request unmanaged, >>> by passing NULL object to vm_page_alloc(). This would also >>> save on the trie nodes for managing the radix trie for the >>> object. There are still plinks or listq to keep track of the >>> allocated pages. >> >> Thanks for the info, I have the following patch which fixes the >> usage of WIRED for both the Xen and the VirtIO balloon drivers, >> could someone please test the VirtIO side? > I briefly looked at the xen balloon. You do not need > balloon_append(). Use struct vm_page plinks field to link the > pages. Sure, thanks for the review, here is an updated version. Roger. -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.12 (Darwin) iQEcBAEBAgAGBQJTpGe0AAoJEKXZdqUyumTA5acH/jQ+Iwjw+QTwUtsh9ZLs7Gm0 h7XaCwa/gASEjzcxK2smIBuKA10LUSoulcYkC3cUWXqaPwFega14JcbySBRI06Z1 1bU50DL8TPLuQIzrVWZgtA+QsZkwEu/jhijr0AMxTcnm6Wq1LV5QRDoqhD0kRiHu kEW1ez832y/0j+oeQAq0aR67zVw7hoIouH9eLaWXS4Vgxz5YQ2Pal1BMAY/OCgua xyF7BHia9KsGTKZ9pPUQfQAW5eJrwAxR0AitQjmOwRKtWyRqymZxhYHjLYOgOKQJ w93aLRVeG2oo0NNC6a9JD/c64sGHLABg37mnSTRL/v9gTj9I1DcFoid2q0iDGbM= =8nDn -----END PGP SIGNATURE----- --------------090506020608050903030305 Content-Type: text/plain; charset="UTF-8"; x-mac-type=0; x-mac-creator=0; name="0001-xen-virtio-fix-balloon-drivers-to-not-mark-pages-as-.patch" Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename*0="0001-xen-virtio-fix-balloon-drivers-to-not-mark-pages-as-.pa"; filename*1="tch" >From e5c898b1b2b734fdc4aa2acf645efd481f09b71d Mon Sep 17 00:00:00 2001 From: Roger Pau Monne Date: Fri, 20 Jun 2014 16:34:31 +0200 Subject: [PATCH] xen/virtio: fix balloon drivers to not mark pages as WIRED Prevent the Xen and VirtIO balloon drivers from marking pages as wired. This prevents them from increasing the system wired page count, which can lead to mlock failing because of hitting the limit in vm.max_wired. In the Xen case make sure pages are zeroed before giving them back to the hypervisor, or else we might be leaking data. Also remove the balloon_{append/retrieve} and link pages directly into the ballooned_pages queue using the plinks.q field in the page struct. Sponsored by: Citrix Systems R&D Reviewed by: xxx Approved by: xxx dev/virtio/balloon/virtio_balloon.c: - Don't allocate pages with VM_ALLOC_WIRED. dev/xen/balloon/balloon.c: - Don't allocate pages with VM_ALLOC_WIRED. - Make sure pages are zeroed before giving them back to the hypervisor. - Remove the balloon_entry struct and the balloon_{append/retrieve} functions and use the page plinks.q entry to link the pages directly into the ballooned_pages queue. --- sys/dev/virtio/balloon/virtio_balloon.c | 4 +- sys/dev/xen/balloon/balloon.c | 87 ++++++++----------------------- 2 files changed, 23 insertions(+), 68 deletions(-) diff --git a/sys/dev/virtio/balloon/virtio_balloon.c b/sys/dev/virtio/balloon/virtio_balloon.c index d540099..6d00ef3 100644 --- a/sys/dev/virtio/balloon/virtio_balloon.c +++ b/sys/dev/virtio/balloon/virtio_balloon.c @@ -438,8 +438,7 @@ vtballoon_alloc_page(struct vtballoon_softc *sc) { vm_page_t m; - m = vm_page_alloc(NULL, 0, VM_ALLOC_NORMAL | VM_ALLOC_WIRED | - VM_ALLOC_NOOBJ); + m = vm_page_alloc(NULL, 0, VM_ALLOC_NORMAL | VM_ALLOC_NOOBJ); if (m != NULL) sc->vtballoon_current_npages++; @@ -450,7 +449,6 @@ static void vtballoon_free_page(struct vtballoon_softc *sc, vm_page_t m) { - vm_page_unwire(m, PQ_INACTIVE); vm_page_free(m); sc->vtballoon_current_npages--; } diff --git a/sys/dev/xen/balloon/balloon.c b/sys/dev/xen/balloon/balloon.c index fa56c86..0d2bba2 100644 --- a/sys/dev/xen/balloon/balloon.c +++ b/sys/dev/xen/balloon/balloon.c @@ -94,13 +94,8 @@ SYSCTL_ULONG(_dev_xen_balloon, OID_AUTO, low_mem, CTLFLAG_RD, SYSCTL_ULONG(_dev_xen_balloon, OID_AUTO, high_mem, CTLFLAG_RD, &bs.balloon_high, 0, "High-mem balloon"); -struct balloon_entry { - vm_page_t page; - STAILQ_ENTRY(balloon_entry) list; -}; - /* List of ballooned pages, threaded through the mem_map array. */ -static STAILQ_HEAD(,balloon_entry) ballooned_pages; +static TAILQ_HEAD(,vm_page) ballooned_pages; /* Main work function, always executed in process context. */ static void balloon_process(void *unused); @@ -110,47 +105,6 @@ static void balloon_process(void *unused); #define WPRINTK(fmt, args...) \ printk(KERN_WARNING "xen_mem: " fmt, ##args) -/* balloon_append: add the given page to the balloon. */ -static int -balloon_append(vm_page_t page) -{ - struct balloon_entry *entry; - - mtx_assert(&balloon_mutex, MA_OWNED); - - entry = malloc(sizeof(struct balloon_entry), M_BALLOON, M_NOWAIT); - if (!entry) - return (ENOMEM); - entry->page = page; - STAILQ_INSERT_HEAD(&ballooned_pages, entry, list); - bs.balloon_low++; - - return (0); -} - -/* balloon_retrieve: rescue a page from the balloon, if it is not empty. */ -static vm_page_t -balloon_retrieve(void) -{ - vm_page_t page; - struct balloon_entry *entry; - - mtx_assert(&balloon_mutex, MA_OWNED); - - if (STAILQ_EMPTY(&ballooned_pages)) - return (NULL); - - entry = STAILQ_FIRST(&ballooned_pages); - STAILQ_REMOVE_HEAD(&ballooned_pages, list); - - page = entry->page; - free(entry, M_BALLOON); - - bs.balloon_low--; - - return (page); -} - static unsigned long current_target(void) { @@ -203,7 +157,6 @@ static int increase_reservation(unsigned long nr_pages) { unsigned long pfn, i; - struct balloon_entry *entry; vm_page_t page; long rc; struct xen_memory_reservation reservation = { @@ -217,10 +170,9 @@ increase_reservation(unsigned long nr_pages) if (nr_pages > nitems(frame_list)) nr_pages = nitems(frame_list); - for (entry = STAILQ_FIRST(&ballooned_pages), i = 0; - i < nr_pages; i++, entry = STAILQ_NEXT(entry, list)) { - KASSERT(entry, ("ballooned_pages list corrupt")); - page = entry->page; + for (page = TAILQ_FIRST(&ballooned_pages), i = 0; + i < nr_pages; i++, page = TAILQ_NEXT(page, plinks.q)) { + KASSERT(page != NULL, ("ballooned_pages list corrupt")); frame_list[i] = (VM_PAGE_TO_PHYS(page) >> PAGE_SHIFT); } @@ -245,8 +197,10 @@ increase_reservation(unsigned long nr_pages) } for (i = 0; i < nr_pages; i++) { - page = balloon_retrieve(); - KASSERT(page, ("balloon_retrieve failed")); + page = TAILQ_FIRST(&ballooned_pages); + KASSERT(page != NULL, ("Unable to get ballooned page")); + TAILQ_REMOVE(&ballooned_pages, page, plinks.q); + bs.balloon_low--; pfn = (VM_PAGE_TO_PHYS(page) >> PAGE_SHIFT); KASSERT((xen_feature(XENFEAT_auto_translated_physmap) || @@ -255,7 +209,6 @@ increase_reservation(unsigned long nr_pages) set_phys_to_machine(pfn, frame_list[i]); - vm_page_unwire(page, PQ_INACTIVE); vm_page_free(page); } @@ -286,24 +239,27 @@ decrease_reservation(unsigned long nr_pages) for (i = 0; i < nr_pages; i++) { if ((page = vm_page_alloc(NULL, 0, VM_ALLOC_NORMAL | VM_ALLOC_NOOBJ | - VM_ALLOC_WIRED | VM_ALLOC_ZERO)) == NULL) { + VM_ALLOC_ZERO)) == NULL) { nr_pages = i; need_sleep = 1; break; } + if ((page->flags & PG_ZERO) == 0) { + /* + * Zero the page, or else we might be leaking + * important data to other domains on the same + * host. + */ + pmap_zero_page(page); + } + pfn = (VM_PAGE_TO_PHYS(page) >> PAGE_SHIFT); frame_list[i] = PFNTOMFN(pfn); set_phys_to_machine(pfn, INVALID_P2M_ENTRY); - if (balloon_append(page) != 0) { - vm_page_unwire(page, PQ_INACTIVE); - vm_page_free(page); - - nr_pages = i; - need_sleep = 1; - break; - } + TAILQ_INSERT_HEAD(&ballooned_pages, page, plinks.q); + bs.balloon_low++; } set_xen_guest_handle(reservation.extent_start, frame_list); @@ -438,7 +394,8 @@ balloon_init(void *arg) /* Initialise the balloon with excess memory space. */ for (pfn = xen_start_info->nr_pages; pfn < max_pfn; pfn++) { page = PHYS_TO_VM_PAGE(pfn << PAGE_SHIFT); - balloon_append(page); + TAILQ_INSERT_HEAD(&ballooned_pages, page, plinks.q); + bs.balloon_low++; } #undef max_pfn #endif -- 1.7.7.5 (Apple Git-26) --------------090506020608050903030305-- From owner-freebsd-xen@FreeBSD.ORG Sat Jun 21 05:31:31 2014 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id C40B42EB; Sat, 21 Jun 2014 05:31:31 +0000 (UTC) Received: from kib.kiev.ua (kib.kiev.ua [IPv6:2001:470:d5e7:1::1]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4AD20218C; Sat, 21 Jun 2014 05:31:31 +0000 (UTC) Received: from tom.home (kostik@localhost [127.0.0.1]) by kib.kiev.ua (8.14.9/8.14.9) with ESMTP id s5L5VLb5073107; Sat, 21 Jun 2014 08:31:21 +0300 (EEST) (envelope-from kostikbel@gmail.com) DKIM-Filter: OpenDKIM Filter v2.8.3 kib.kiev.ua s5L5VLb5073107 Received: (from kostik@localhost) by tom.home (8.14.9/8.14.8/Submit) id s5L5VLdo073106; Sat, 21 Jun 2014 08:31:21 +0300 (EEST) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: tom.home: kostik set sender to kostikbel@gmail.com using -f Date: Sat, 21 Jun 2014 08:31:21 +0300 From: Konstantin Belousov To: Roger Pau Monn? Subject: Re: FreeBSD and memory balloon drivers Message-ID: <20140621053121.GK3991@kib.kiev.ua> References: <53A40079.9000804@citrix.com> <20140620132816.GH3991@kib.kiev.ua> <53A4501F.4020201@citrix.com> <20140620152610.GI3991@kib.kiev.ua> <53A467B4.8070501@citrix.com> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="N7OK10pvBj1bDp4V" Content-Disposition: inline In-Reply-To: <53A467B4.8070501@citrix.com> User-Agent: Mutt/1.5.23 (2014-03-12) X-Spam-Status: No, score=-2.0 required=5.0 tests=ALL_TRUSTED,BAYES_00, DKIM_ADSP_CUSTOM_MED,FREEMAIL_FROM,NML_ADSP_CUSTOM_MED autolearn=no autolearn_force=no version=3.4.0 X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on tom.home Cc: virtualization@FreeBSD.org, "freebsd-xen@freebsd.org" , bryanv@FreeBSD.org X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 21 Jun 2014 05:31:31 -0000 --N7OK10pvBj1bDp4V Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Fri, Jun 20, 2014 at 06:56:20PM +0200, Roger Pau Monn? wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 >=20 > On 20/06/14 17:26, Konstantin Belousov wrote: > > On Fri, Jun 20, 2014 at 05:15:43PM +0200, Roger Pau Monn? wrote: > >> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 > >>=20 > >> On 20/06/14 15:28, Konstantin Belousov wrote: > >>> On Fri, Jun 20, 2014 at 11:35:53AM +0200, Roger Pau Monn? > >>> wrote: > >>>> Hello, > >>>>=20 > >>>> I've been looking into the Xen balloon driver, because I've=20 > >>>> experienced problems when ballooning memory down which AFAICT > >>>> are also present in the VirtIO balloon driver. The problem > >>>> I've experienced is that when ballooning memory down, we > >>>> basically allocate a bunch of memory as WIRED, to make sure > >>>> nobody tries to swap it do disk, since it will crash the > >>>> kernel because the memory is not populated. Due to this > >>>> massive amount of memory allocated as WIRED, user-space > >>>> programs that try to use mlock will fail because we hit the > >>>> limit in vm.max_wired. > >>>>=20 > >>>> I'm not sure what's the best way to deal with this > >>>> limitation, should vm.max_wired be changed from the balloon > >>>> drivers when ballooning down/up? Is there anyway to remove > >>>> the pages ballooned down from the memory accounting of wired > >>>> pages? > >>>=20 > >>> You could change the type of pages the ballon driver is=20 > >>> allocating. Instead of wired pages, you may request unmanaged, > >>> by passing NULL object to vm_page_alloc(). This would also > >>> save on the trie nodes for managing the radix trie for the > >>> object. There are still plinks or listq to keep track of the > >>> allocated pages. > >>=20 > >> Thanks for the info, I have the following patch which fixes the > >> usage of WIRED for both the Xen and the VirtIO balloon drivers, > >> could someone please test the VirtIO side? > > I briefly looked at the xen balloon. You do not need > > balloon_append(). Use struct vm_page plinks field to link the > > pages. >=20 > Sure, thanks for the review, here is an updated version. It looks fine to me. >=20 > Roger. >=20 > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1.4.12 (Darwin) >=20 > iQEcBAEBAgAGBQJTpGe0AAoJEKXZdqUyumTA5acH/jQ+Iwjw+QTwUtsh9ZLs7Gm0 > h7XaCwa/gASEjzcxK2smIBuKA10LUSoulcYkC3cUWXqaPwFega14JcbySBRI06Z1 > 1bU50DL8TPLuQIzrVWZgtA+QsZkwEu/jhijr0AMxTcnm6Wq1LV5QRDoqhD0kRiHu > kEW1ez832y/0j+oeQAq0aR67zVw7hoIouH9eLaWXS4Vgxz5YQ2Pal1BMAY/OCgua > xyF7BHia9KsGTKZ9pPUQfQAW5eJrwAxR0AitQjmOwRKtWyRqymZxhYHjLYOgOKQJ > w93aLRVeG2oo0NNC6a9JD/c64sGHLABg37mnSTRL/v9gTj9I1DcFoid2q0iDGbM=3D > =3D8nDn > -----END PGP SIGNATURE----- > >From e5c898b1b2b734fdc4aa2acf645efd481f09b71d Mon Sep 17 00:00:00 2001 > From: Roger Pau Monne > Date: Fri, 20 Jun 2014 16:34:31 +0200 > Subject: [PATCH] xen/virtio: fix balloon drivers to not mark pages as WIR= ED >=20 > Prevent the Xen and VirtIO balloon drivers from marking pages as > wired. This prevents them from increasing the system wired page count, > which can lead to mlock failing because of hitting the limit in > vm.max_wired. >=20 > In the Xen case make sure pages are zeroed before giving them back to > the hypervisor, or else we might be leaking data. Also remove the > balloon_{append/retrieve} and link pages directly into the > ballooned_pages queue using the plinks.q field in the page struct. >=20 > Sponsored by: Citrix Systems R&D > Reviewed by: xxx > Approved by: xxx >=20 > dev/virtio/balloon/virtio_balloon.c: > - Don't allocate pages with VM_ALLOC_WIRED. >=20 > dev/xen/balloon/balloon.c: > - Don't allocate pages with VM_ALLOC_WIRED. > - Make sure pages are zeroed before giving them back to the > hypervisor. > - Remove the balloon_entry struct and the balloon_{append/retrieve} > functions and use the page plinks.q entry to link the pages > directly into the ballooned_pages queue. > --- > sys/dev/virtio/balloon/virtio_balloon.c | 4 +- > sys/dev/xen/balloon/balloon.c | 87 ++++++++-----------------= ------ > 2 files changed, 23 insertions(+), 68 deletions(-) >=20 > diff --git a/sys/dev/virtio/balloon/virtio_balloon.c b/sys/dev/virtio/bal= loon/virtio_balloon.c > index d540099..6d00ef3 100644 > --- a/sys/dev/virtio/balloon/virtio_balloon.c > +++ b/sys/dev/virtio/balloon/virtio_balloon.c > @@ -438,8 +438,7 @@ vtballoon_alloc_page(struct vtballoon_softc *sc) > { > vm_page_t m; > =20 > - m =3D vm_page_alloc(NULL, 0, VM_ALLOC_NORMAL | VM_ALLOC_WIRED | > - VM_ALLOC_NOOBJ); > + m =3D vm_page_alloc(NULL, 0, VM_ALLOC_NORMAL | VM_ALLOC_NOOBJ); > if (m !=3D NULL) > sc->vtballoon_current_npages++; > =20 > @@ -450,7 +449,6 @@ static void > vtballoon_free_page(struct vtballoon_softc *sc, vm_page_t m) > { > =20 > - vm_page_unwire(m, PQ_INACTIVE); > vm_page_free(m); > sc->vtballoon_current_npages--; > } > diff --git a/sys/dev/xen/balloon/balloon.c b/sys/dev/xen/balloon/balloon.c > index fa56c86..0d2bba2 100644 > --- a/sys/dev/xen/balloon/balloon.c > +++ b/sys/dev/xen/balloon/balloon.c > @@ -94,13 +94,8 @@ SYSCTL_ULONG(_dev_xen_balloon, OID_AUTO, low_mem, CTLF= LAG_RD, > SYSCTL_ULONG(_dev_xen_balloon, OID_AUTO, high_mem, CTLFLAG_RD, > &bs.balloon_high, 0, "High-mem balloon"); > =20 > -struct balloon_entry { > - vm_page_t page; > - STAILQ_ENTRY(balloon_entry) list; > -}; > - > /* List of ballooned pages, threaded through the mem_map array. */ > -static STAILQ_HEAD(,balloon_entry) ballooned_pages; > +static TAILQ_HEAD(,vm_page) ballooned_pages; > =20 > /* Main work function, always executed in process context. */ > static void balloon_process(void *unused); > @@ -110,47 +105,6 @@ static void balloon_process(void *unused); > #define WPRINTK(fmt, args...) \ > printk(KERN_WARNING "xen_mem: " fmt, ##args) > =20 > -/* balloon_append: add the given page to the balloon. */ > -static int > -balloon_append(vm_page_t page) > -{ > - struct balloon_entry *entry; > - > - mtx_assert(&balloon_mutex, MA_OWNED); > - > - entry =3D malloc(sizeof(struct balloon_entry), M_BALLOON, M_NOWAIT); > - if (!entry) > - return (ENOMEM); > - entry->page =3D page; > - STAILQ_INSERT_HEAD(&ballooned_pages, entry, list); > - bs.balloon_low++; > - > - return (0); > -} > - > -/* balloon_retrieve: rescue a page from the balloon, if it is not empty.= */ > -static vm_page_t > -balloon_retrieve(void) > -{ > - vm_page_t page; > - struct balloon_entry *entry; > - > - mtx_assert(&balloon_mutex, MA_OWNED); > - > - if (STAILQ_EMPTY(&ballooned_pages)) > - return (NULL); > - > - entry =3D STAILQ_FIRST(&ballooned_pages); > - STAILQ_REMOVE_HEAD(&ballooned_pages, list); > - > - page =3D entry->page; > - free(entry, M_BALLOON); > -=09 > - bs.balloon_low--; > - > - return (page); > -} > - > static unsigned long=20 > current_target(void) > { > @@ -203,7 +157,6 @@ static int > increase_reservation(unsigned long nr_pages) > { > unsigned long pfn, i; > - struct balloon_entry *entry; > vm_page_t page; > long rc; > struct xen_memory_reservation reservation =3D { > @@ -217,10 +170,9 @@ increase_reservation(unsigned long nr_pages) > if (nr_pages > nitems(frame_list)) > nr_pages =3D nitems(frame_list); > =20 > - for (entry =3D STAILQ_FIRST(&ballooned_pages), i =3D 0; > - i < nr_pages; i++, entry =3D STAILQ_NEXT(entry, list)) { > - KASSERT(entry, ("ballooned_pages list corrupt")); > - page =3D entry->page; > + for (page =3D TAILQ_FIRST(&ballooned_pages), i =3D 0; > + i < nr_pages; i++, page =3D TAILQ_NEXT(page, plinks.q)) { > + KASSERT(page !=3D NULL, ("ballooned_pages list corrupt")); > frame_list[i] =3D (VM_PAGE_TO_PHYS(page) >> PAGE_SHIFT); > } > =20 > @@ -245,8 +197,10 @@ increase_reservation(unsigned long nr_pages) > } > =20 > for (i =3D 0; i < nr_pages; i++) { > - page =3D balloon_retrieve(); > - KASSERT(page, ("balloon_retrieve failed")); > + page =3D TAILQ_FIRST(&ballooned_pages); > + KASSERT(page !=3D NULL, ("Unable to get ballooned page")); > + TAILQ_REMOVE(&ballooned_pages, page, plinks.q); > + bs.balloon_low--; > =20 > pfn =3D (VM_PAGE_TO_PHYS(page) >> PAGE_SHIFT); > KASSERT((xen_feature(XENFEAT_auto_translated_physmap) || > @@ -255,7 +209,6 @@ increase_reservation(unsigned long nr_pages) > =20 > set_phys_to_machine(pfn, frame_list[i]); > =20 > - vm_page_unwire(page, PQ_INACTIVE); > vm_page_free(page); > } > =20 > @@ -286,24 +239,27 @@ decrease_reservation(unsigned long nr_pages) > for (i =3D 0; i < nr_pages; i++) { > if ((page =3D vm_page_alloc(NULL, 0,=20 > VM_ALLOC_NORMAL | VM_ALLOC_NOOBJ |=20 > - VM_ALLOC_WIRED | VM_ALLOC_ZERO)) =3D=3D NULL) { > + VM_ALLOC_ZERO)) =3D=3D NULL) { > nr_pages =3D i; > need_sleep =3D 1; > break; > } > =20 > + if ((page->flags & PG_ZERO) =3D=3D 0) { > + /* > + * Zero the page, or else we might be leaking > + * important data to other domains on the same > + * host. > + */ > + pmap_zero_page(page); > + } > + > pfn =3D (VM_PAGE_TO_PHYS(page) >> PAGE_SHIFT); > frame_list[i] =3D PFNTOMFN(pfn); > =20 > set_phys_to_machine(pfn, INVALID_P2M_ENTRY); > - if (balloon_append(page) !=3D 0) { > - vm_page_unwire(page, PQ_INACTIVE); > - vm_page_free(page); > - > - nr_pages =3D i; > - need_sleep =3D 1; > - break; > - } > + TAILQ_INSERT_HEAD(&ballooned_pages, page, plinks.q); > + bs.balloon_low++; > } > =20 > set_xen_guest_handle(reservation.extent_start, frame_list); > @@ -438,7 +394,8 @@ balloon_init(void *arg) > /* Initialise the balloon with excess memory space. */ > for (pfn =3D xen_start_info->nr_pages; pfn < max_pfn; pfn++) { > page =3D PHYS_TO_VM_PAGE(pfn << PAGE_SHIFT); > - balloon_append(page); > + TAILQ_INSERT_HEAD(&ballooned_pages, page, plinks.q); > + bs.balloon_low++; > } > #undef max_pfn > #endif > --=20 > 1.7.7.5 (Apple Git-26) >=20 --N7OK10pvBj1bDp4V Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iQIcBAEBAgAGBQJTpRioAAoJEJDCuSvBvK1BSxEP/1Oxdr7ActnPpw7M6pRHqXMe 63ZkiIdwovfBdABA/Qs/+EAgCuPxbZmaD3e3b/1ypi/qXihB4kbnWTTneXUei5NF 7Xot0YppkCmnKLiGiku3rV/biIFjmTJg5aCsrKdTpQfHCG1WInDwWZTW4UlMwkf2 j05qqBY6CeI8ckvmGDDZPpVAtnUnMI0AQOV2hve77kN3zWisxHG3qsBpCFIsDLAk 9eNBKasKHVWZlDTj1SHT9Fk3UgEqNOoSdOPgeMA+RMNAerLlg6uQXkdFZL8+nCA9 KzChvmglVepdC46qwai2UgkCr7ikEy6btijb4d+3pr0+XbzlfOCJ5nduwaYN72Uz 7qgxpX3AgagBIdLfv1zBtWX7K1fbQVkCLIe0pwPqKw8fAUP1lu2TmjsU+Ziq6wLa ncN0Lafh3sihUt6rsrW2GGFTtXiWqJqtb2QHdLYgxA7F27OupxLXl+ZXFgqTHSdc BXOFsE6NxtGkf8U9dnNHgHVDDyXKTMzy8/VblRxw2VIBSPV4ilCOXuE8E0+3/ASg mFZv2o8Yr7SO5OHouZAdKYvtW29Ch4YYl1HvJJt+ZHgZmvGQiv9HUqzPJvgOGrKK tNth+Vcbp14xEhgHrnuJeymtAa39hhBXJVvgOQJRJsWpyhhycLCAaIgr8h0qC8A/ Ax1qZuC61xLOmFWRHPMf =fFv2 -----END PGP SIGNATURE----- --N7OK10pvBj1bDp4V-- From owner-freebsd-xen@FreeBSD.ORG Thu Jun 26 01:39:15 2014 Return-Path: Delivered-To: freebsd-xen@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 98DD057A for ; Thu, 26 Jun 2014 01:39:15 +0000 (UTC) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 7FAE82C01 for ; Thu, 26 Jun 2014 01:39:15 +0000 (UTC) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.14.8/8.14.8) with ESMTP id s5Q1dF91028850 for ; Thu, 26 Jun 2014 02:39:15 +0100 (BST) (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 190919] [patch] [xenhvm] stable/9 buildworld is broken with MODULES_WITH_WORLD=yes (again) Date: Thu, 26 Jun 2014 01:39:15 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 9.2-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: Needs Triage X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 26 Jun 2014 01:39:15 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=190919 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|freebsd-bugs@FreeBSD.org |freebsd-xen@FreeBSD.org --- Comment #1 from Mark Linimon --- Over to maintainers. -- You are receiving this mail because: You are the assignee for the bug. From owner-freebsd-xen@FreeBSD.ORG Thu Jun 26 01:57:23 2014 Return-Path: Delivered-To: freebsd-xen@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id CF0F2C72 for ; Thu, 26 Jun 2014 01:57:23 +0000 (UTC) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id B65A12DAB for ; Thu, 26 Jun 2014 01:57:23 +0000 (UTC) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.14.8/8.14.8) with ESMTP id s5Q1vNL1072426 for ; Thu, 26 Jun 2014 02:57:23 +0100 (BST) (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 191173] [xen] Poor file write performance on xen blockfront Date: Thu, 26 Jun 2014 01:57:23 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: Needs Triage X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to short_desc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 26 Jun 2014 01:57:23 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=191173 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|freebsd-bugs@FreeBSD.org |freebsd-xen@FreeBSD.org Summary|Poor file write performance |[xen] Poor file write |on xen blockfront |performance on xen | |blockfront --- Comment #1 from Mark Linimon --- Over to maintainers. -- You are receiving this mail because: You are the assignee for the bug. From owner-freebsd-xen@FreeBSD.ORG Thu Jun 26 20:34:16 2014 Return-Path: Delivered-To: freebsd-xen@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 1904BF3A for ; Thu, 26 Jun 2014 20:34:16 +0000 (UTC) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 0091825F2 for ; Thu, 26 Jun 2014 20:34:16 +0000 (UTC) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.14.8/8.14.8) with ESMTP id s5QKYFIN058577 for ; Thu, 26 Jun 2014 21:34:15 +0100 (BST) (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 191173] [xen] Poor file write performance on xen blockfront Date: Thu, 26 Jun 2014 20:34:16 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: feld@FreeBSD.org X-Bugzilla-Status: Needs Triage X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: royger@freebsd.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 26 Jun 2014 20:34:16 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=191173 Mark Felder changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |feld@FreeBSD.org Assignee|freebsd-xen@FreeBSD.org |royger@freebsd.org --- Comment #2 from Mark Felder --- Please detail in the bug report the hardware in question. I've also seen what I believe could be similar behavior on FreeBSD 10 VMs, but only on one cluster with older CPUs. The more data points we have the more likely this can be narrowed down. Thanks! -- You are receiving this mail because: You are the assignee for the bug. From owner-freebsd-xen@FreeBSD.ORG Fri Jul 4 14:40:25 2014 Return-Path: Delivered-To: freebsd-xen@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 9024C194 for ; Fri, 4 Jul 2014 14:40:25 +0000 (UTC) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 6F1D920A2 for ; Fri, 4 Jul 2014 14:40:25 +0000 (UTC) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.14.8/8.14.8) with ESMTP id s64EeP8k018993 for ; Fri, 4 Jul 2014 15:40:25 +0100 (BST) (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 190919] [patch] [xenhvm] stable/9 buildworld is broken with MODULES_WITH_WORLD=yes (again) Date: Fri, 04 Jul 2014 14:40:25 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 9.2-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: royger@freebsd.org X-Bugzilla-Status: Needs Triage X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: cperciva@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Jul 2014 14:40:25 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D190919 Roger Pau Monn=C3=A9 changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |royger@freebsd.org Assignee|freebsd-xen@FreeBSD.org |cperciva@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@FreeBSD.ORG Fri Jul 4 14:45:57 2014 Return-Path: Delivered-To: freebsd-xen@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id EACF3400 for ; Fri, 4 Jul 2014 14:45:57 +0000 (UTC) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id D22B52159 for ; Fri, 4 Jul 2014 14:45:57 +0000 (UTC) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.14.8/8.14.8) with ESMTP id s64EjvDE027913 for ; Fri, 4 Jul 2014 15:45:57 +0100 (BST) (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 186375] [xen] FreeBSD 10 is very unstable on Xen 4.1(XCP 1.6) Date: Fri, 04 Jul 2014 14:45:57 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: unspecified X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: royger@freebsd.org X-Bugzilla-Status: In Discussion X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Jul 2014 14:45:58 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D186375 Roger Pau Monn=C3=A9 changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |royger@freebsd.org --- Comment #4 from Roger Pau Monn=C3=A9 --- Unless the questions asked above are answered I'm just going to close the b= ug as timed out in 7 days. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@FreeBSD.ORG Fri Jul 4 14:46:50 2014 Return-Path: Delivered-To: freebsd-xen@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 9941F504 for ; Fri, 4 Jul 2014 14:46:50 +0000 (UTC) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 806F12166 for ; Fri, 4 Jul 2014 14:46:50 +0000 (UTC) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.14.8/8.14.8) with ESMTP id s64EkoTm028465 for ; Fri, 4 Jul 2014 15:46:50 +0100 (BST) (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 180788] [xen] [panic] XEN PV kernel 9.2-BETA1 panics on boot Date: Fri, 04 Jul 2014 14:46:50 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 9.2-BETA1 X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: royger@freebsd.org X-Bugzilla-Status: Issue Resolved X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status cc resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Jul 2014 14:46:50 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D180788 Roger Pau Monn=C3=A9 changed: What |Removed |Added ---------------------------------------------------------------------------- Status|In Discussion |Issue Resolved CC| |royger@freebsd.org Resolution|--- |FIXED --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@FreeBSD.ORG Fri Jul 4 14:53:07 2014 Return-Path: Delivered-To: freebsd-xen@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 1A9D67B3 for ; Fri, 4 Jul 2014 14:53:07 +0000 (UTC) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 01D13220E for ; Fri, 4 Jul 2014 14:53:07 +0000 (UTC) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.14.8/8.14.8) with ESMTP id s64Er6BN058918 for ; Fri, 4 Jul 2014 15:53:06 +0100 (BST) (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 180402] [xen] XEN kernel does not load in XenClient 4.5.5 Date: Fri, 04 Jul 2014 14:53:06 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 9.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: royger@freebsd.org X-Bugzilla-Status: Issue Resolved X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status cc resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Jul 2014 14:53:07 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D180402 Roger Pau Monn=C3=A9 changed: What |Removed |Added ---------------------------------------------------------------------------- Status|In Discussion |Issue Resolved CC| |royger@freebsd.org Resolution|--- |Works As Intended --- Comment #2 from Roger Pau Monn=C3=A9 --- I have very little knowledge about XenClient, but I think the issue is that= you are trying to load a PV kernel inside of an HVM guest, which is never going= to work. PV kernels need to be started in a special way by the toolstack/hypervisor, so just installing FreeBSD from an ISO and trying to replace the GENERIC kernel with a XEN one is not going to work. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@FreeBSD.ORG Fri Jul 4 14:56:14 2014 Return-Path: Delivered-To: freebsd-xen@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 7C6AB7F5 for ; Fri, 4 Jul 2014 14:56:14 +0000 (UTC) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 63833221D for ; Fri, 4 Jul 2014 14:56:14 +0000 (UTC) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.14.8/8.14.8) with ESMTP id s64EuEtW062810 for ; Fri, 4 Jul 2014 15:56:14 +0100 (BST) (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 179814] [xen] mountroot fails with error=19 under Xen on 9-STABLE Date: Fri, 04 Jul 2014 14:56:14 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 9.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: royger@freebsd.org X-Bugzilla-Status: Issue Resolved X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status cc resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Jul 2014 14:56:14 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D179814 Roger Pau Monn=C3=A9 changed: What |Removed |Added ---------------------------------------------------------------------------- Status|In Discussion |Issue Resolved CC| |royger@freebsd.org Resolution|--- |Works As Intended --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@FreeBSD.ORG Fri Jul 4 15:02:09 2014 Return-Path: Delivered-To: freebsd-xen@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 642BBA26 for ; Fri, 4 Jul 2014 15:02:09 +0000 (UTC) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4B12B22D0 for ; Fri, 4 Jul 2014 15:02:09 +0000 (UTC) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.14.8/8.14.8) with ESMTP id s64F29Lr012983 for ; Fri, 4 Jul 2014 16:02:09 +0100 (BST) (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 164450] [xen] Failed to install FreeeBSD 9.0-RELEASE from CD in a Citrix XenServer VM Date: Fri, 04 Jul 2014 15:02:09 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 9.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: royger@freebsd.org X-Bugzilla-Status: Timeout X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status cc resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Jul 2014 15:02:09 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D164450 Roger Pau Monn=C3=A9 changed: What |Removed |Added ---------------------------------------------------------------------------- Status|In Discussion |Timeout CC| |royger@freebsd.org Resolution|--- |Works As Intended --- Comment #4 from Roger Pau Monn=C3=A9 --- XenServer 5.x is EOL so I'm just going to close this bug. FreeBSD works fin= e on the 6.x series. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@FreeBSD.ORG Fri Jul 4 15:05:12 2014 Return-Path: Delivered-To: freebsd-xen@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 9A39DA7A for ; Fri, 4 Jul 2014 15:05:12 +0000 (UTC) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 81A2622EA for ; Fri, 4 Jul 2014 15:05:12 +0000 (UTC) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.14.8/8.14.8) with ESMTP id s64F5Cwi067994 for ; Fri, 4 Jul 2014 16:05:12 +0100 (BST) (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 161318] [xen] sysinstall crashes with floating point exception Date: Fri, 04 Jul 2014 15:05:12 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 9.0-BETA3 X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: royger@freebsd.org X-Bugzilla-Status: Issue Resolved X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status cc resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Jul 2014 15:05:12 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D161318 Roger Pau Monn=C3=A9 changed: What |Removed |Added ---------------------------------------------------------------------------- Status|In Discussion |Issue Resolved CC| |royger@freebsd.org Resolution|--- |Unable to Reproduce --- Comment #2 from Roger Pau Monn=C3=A9 --- I haven't been able to reproduce this issue with current FreeBSD version. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@FreeBSD.ORG Fri Jul 4 15:11:18 2014 Return-Path: Delivered-To: freebsd-xen@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 4043DC58 for ; Fri, 4 Jul 2014 15:11:18 +0000 (UTC) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 26C9D2399 for ; Fri, 4 Jul 2014 15:11:18 +0000 (UTC) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.14.8/8.14.8) with ESMTP id s64FBIMa044853 for ; Fri, 4 Jul 2014 16:11:18 +0100 (BST) (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 164630] [xen] XEN HVM kernel: run_interrupt_driven_hooks: still waiting after 60 seconds for xenbusb_nop_confighook_cb Date: Fri, 04 Jul 2014 15:11:18 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: unspecified X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: royger@freebsd.org X-Bugzilla-Status: Timeout X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status cc resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Jul 2014 15:11:18 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D164630 Roger Pau Monn=C3=A9 changed: What |Removed |Added ---------------------------------------------------------------------------- Status|In Discussion |Timeout CC| |royger@freebsd.org Resolution|--- |Unable to Reproduce --- Comment #2 from Roger Pau Monn=C3=A9 --- I haven't been able to reproduce this issue with any current FreeBSD versio= n. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@FreeBSD.ORG Sat Jul 5 20:51:45 2014 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 16B98DAA for ; Sat, 5 Jul 2014 20:51:45 +0000 (UTC) Received: from o3.shared.sendgrid.net (o3.shared.sendgrid.net [208.117.48.85]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 93A302CB9 for ; Sat, 5 Jul 2014 20:51:43 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=sendgrid.info; h=from:mime-version:to:subject:content-type:content-transfer-encoding; s=smtpapi; bh=1eSPP0FuloPLv/aq8wSaz0VqVZU=; b=TkYctBu9Xa90IABrmS ehnWMIcqmJdJS6CV/39xMzzjYJvb9mC6xVusQ5hwkWBw02yOoXNcwGz27PuZN+AM M/4ztAkGTb8y5zhdQv41T5gUAIiFJOpdULXjgObB6xkaxS3/nr5dvdg43X+ojhNj fIot/FLyBkSh1sPZMk0Z09Qgo= Received: by mf173.sendgrid.net with SMTP id mf173.35834.53B8655816 2014-07-05 20:51:36.542413524 +0000 UTC Received: from mail.tarsnap.com (unknown [10.100.60.108]) by ismtpd-024.iad1.sendgrid.net (SG) with ESMTP id 147084be0ff.922.83fcc1 for ; Sat, 05 Jul 2014 20:51:36 +0000 (GMT) Received: (qmail 10775 invoked from network); 5 Jul 2014 20:51:35 -0000 Received: from unknown (HELO clamshell.daemonology.net) (127.0.0.1) by ec2-107-20-205-189.compute-1.amazonaws.com with ESMTP; 5 Jul 2014 20:51:35 -0000 Received: (qmail 2421 invoked from network); 5 Jul 2014 20:50:02 -0000 Received: from unknown (HELO clamshell.daemonology.net) (127.0.0.1) by clamshell.daemonology.net with SMTP; 5 Jul 2014 20:50:02 -0000 Message-ID: <53B864FA.8040805@freebsd.org> Date: Sat, 05 Jul 2014 13:50:02 -0700 From: Colin Percival User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:24.0) Gecko/20100101 Thunderbird/24.0 MIME-Version: 1.0 To: "freebsd-xen@freebsd.org" Subject: RFC: Dropping "defenestrated" EC2 image builds X-Enigmail-Version: 1.5.2 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-SG-EID: RUbAm5H8PjswBj/QH+sYVehaJogg3iBnZcyVi1bw/IxA9an/4VsXBYC+rZVi/cbyUhAH6XaQeuTkKppuiqgJDbdJmEEXblTxd4eDqXmYWUA+uYG15Fljj6u3REBbWQ8bFO6essawsCzLDYTgV3Suw8cjlSgUNiUBt71dq10bDEQ= X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 05 Jul 2014 20:51:45 -0000 Hi FreeBSD/Xen people, Now that Amazon has released the T2 family of instances, it is possible to run FreeBSD on all five types of instances -- "general purpose", "high RAM", "high CPU", "high I/O", and "low cost" -- without having it pretend to be Windows. As a result, I'm considering no longer building "defenestrated" EC2 images; this would simplify my image-building code significantly, and avoid situations where users accidentally use the defenestrated images and end up paying for a Windows license they don't need. The downside is that it would not be possible to launch future FreeBSD releases onto older EC2 instance types. For "on-demand" usage, this shouldn't be a problem -- the older instances are in all ways inferior to the newer instances -- but if someone has paid Reserved Instance then they might want to be able to use FreeBSD on it. (Launching an older AMI and upgrading would still work, of course.) Thoughts? -- Colin Percival Security Officer Emeritus, FreeBSD | The power to serve Founder, Tarsnap | www.tarsnap.com | Online backups for the truly paranoid From owner-freebsd-xen@FreeBSD.ORG Thu Jul 10 17:20:51 2014 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id DFCE1B23; Thu, 10 Jul 2014 17:20:51 +0000 (UTC) Received: from mail-qc0-x22d.google.com (mail-qc0-x22d.google.com [IPv6:2607:f8b0:400d:c01::22d]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 7D5E420BB; Thu, 10 Jul 2014 17:20:51 +0000 (UTC) Received: by mail-qc0-f173.google.com with SMTP id c9so2298069qcz.18 for ; Thu, 10 Jul 2014 10:20:50 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=date:from:to:subject:message-id:mime-version:content-type :content-disposition:user-agent; bh=8IEwjDYZt+I7jHCQ8Z5d2P7AZWH+oZuQxLqpEkkenZY=; b=RpITGyw2pL+o6xxlxvgy9CduemWvdJa0b6WL7B3gQvZl+zzCB0TlGQ+fn6cD+5yUxD X6L4nJQlaS8hIGU3Rgf1wx2NQfRU5AKlcKXL96hxfkllj9tBwEYweCC9ytnuSvfj89FV gOas475uip9/28izLloTTWm4ofv2yqXDodQr2I09w9qevUUGoNy1i8noT4k9j4xMQynw iggl2+ZF06qSTjC2B1ZYTC5oCLc2e4zZj+59RMSdOt4/VO290nh24zHjAADXucJt2ypb 0flcsCA/xeOaMQI/CdJkNpXiBP5p1qoKQgqNsh7Vn+Lq9kIVc/SAdms/+lVBOQKUun5h mCvw== X-Received: by 10.140.29.201 with SMTP id b67mr63479991qgb.44.1405012850681; Thu, 10 Jul 2014 10:20:50 -0700 (PDT) Received: from pwnie.vrt.sourcefire.com (moist.vrt.sourcefire.com. [198.148.79.134]) by mx.google.com with ESMTPSA id c52sm35746305qgc.32.2014.07.10.10.20.49 for (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 10 Jul 2014 10:20:50 -0700 (PDT) Date: Thu, 10 Jul 2014 13:20:48 -0400 From: Shawn Webb To: freebsd-xen@freebsd.org Subject: Kernel Panic on 11-CURRENT/XEN:amd64 Message-ID: <20140710172048.GA41807@pwnie.vrt.sourcefire.com> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="opJtzjQTFsWo+cga" Content-Disposition: inline X-PGP-Key: http://pgp.mit.edu/pks/lookup?op=vindex&search=0x6A84658F52456EEE User-Agent: Mutt/1.5.23 (2014-03-12) X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 10 Jul 2014 17:20:52 -0000 --opJtzjQTFsWo+cga Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Hey All, I just migrated from 10.0-RELEASE to 11-CURRENT on my RootBSD VPS. I'm getting a kernel panic now. Below are links to two screenshots. Screenshot 1: http://imgur.com/Gi2WPMK Screenshot 2: http://imgur.com/QgimECm Thanks, Shawn --opJtzjQTFsWo+cga Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iQIcBAEBAgAGBQJTvstvAAoJEGqEZY9SRW7uH3sP/Rxm/ARQhcrlLy275Dq1lKoy ZgYcCgK/JyE+IBzfJi6yTEfLfzLbNGMjZySbpO8fPn221sfKUdKPD7XuBGBrEBjM paVD4aZJ5Szvxj0wDJ6Yu2AoX7SIBbc/sfOBwXnwAtms5UdPM8in45YZEvVMz+dN pduybo2QEt40LVNfZBQJ0OPTjGypqU/D1tQtu4gjoA6g3NLNtv5zS4DSvm40zMJx rP8U37uwiR1kgASPWozrpRjzjMlR6+kpS7G+hS8OHLBbbmXagVh/uKDygW1W1fYc WOa7Jv+IBOHLNDbxSMlXKOlOnu7JaiGHgvnxWPBC0wRQlyJRJi16uaS8+jC43GFy 0n/DjqnWDx60bDADY4CGooXF8Wo38ETPofaULjWaXJ/l9I5pyIFVX7mFAz9t1gPv 3jZ4/ztc66esYUBhVtHltBgCer/HEJydUDQxhzDm4z9undUW4cByO6Mg2svJd0Dj 6CMEsmCq/ZKBUQN3Pd8xCfA0J9weG4T53eA18khLSQ2EUkVx7vCIxyApzOhQosK8 1zsYoy6TKyjTSqfR4c8MnSbJM9k1z8h+V0Aq3FE3ESMBXgXM9Rd2fKwg4A/Kt6LK GPKbg9sWbF0YIJC6eQdvPclVWNcmDaTN+Dfuvm8t9opNZH12kzn4xQ122GoKl0Cw L9LSySkcRiCHYhPAR4gk =HHzX -----END PGP SIGNATURE----- --opJtzjQTFsWo+cga-- From owner-freebsd-xen@FreeBSD.ORG Mon Jul 14 17:27:33 2014 Return-Path: Delivered-To: freebsd-xen@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 805CFEDB for ; Mon, 14 Jul 2014 17:27:33 +0000 (UTC) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 67DBF2ED1 for ; Mon, 14 Jul 2014 17:27:33 +0000 (UTC) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.14.8/8.14.8) with ESMTP id s6EHRXrO044272 for ; Mon, 14 Jul 2014 17:27:33 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 164630] [xen] XEN HVM kernel: run_interrupt_driven_hooks: still waiting after 60 seconds for xenbusb_nop_confighook_cb Date: Mon, 14 Jul 2014 17:27:33 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: unspecified X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mcdouga9@egr.msu.edu X-Bugzilla-Status: Timeout X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 14 Jul 2014 17:27:33 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=164630 mcdouga9@egr.msu.edu changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |mcdouga9@egr.msu.edu --- Comment #3 from mcdouga9@egr.msu.edu --- I can still reproduce this issue. I just installed FreeBSD 9.3-RELEASE, compiled and installed a kernel from the XENHVM config file on the following platforms: XenServer 6.2SP1 (Xen 4.1) 70446c XS62ESP1002 XenServer "6.5" (Xen 4.4) 86858c XenServer Creedence Alpha 4 The reason is because r256423 was merged to 10 as r256757 but not to 9 yet. 10 works great. In the meantime I am still using feld@'s patch every time I have to compile 9: https://feld.me/freebsd/freebsd9-xen-cdrom-fix.patch It would be appreciated if it could be incorporated into 9. Thanks. -- You are receiving this mail because: You are the assignee for the bug. From owner-freebsd-xen@FreeBSD.ORG Mon Jul 14 17:28:46 2014 Return-Path: Delivered-To: freebsd-xen@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 367C5F37 for ; Mon, 14 Jul 2014 17:28:46 +0000 (UTC) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 1DC1E2EE8 for ; Mon, 14 Jul 2014 17:28:46 +0000 (UTC) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.14.8/8.14.8) with ESMTP id s6EHSj5R056782 for ; Mon, 14 Jul 2014 17:28:45 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 164630] [xen] XEN HVM kernel: run_interrupt_driven_hooks: still waiting after 60 seconds for xenbusb_nop_confighook_cb Date: Mon, 14 Jul 2014 17:28:46 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: unspecified X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mcdouga9@egr.msu.edu X-Bugzilla-Status: Timeout X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 14 Jul 2014 17:28:46 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=164630 --- Comment #4 from mcdouga9@egr.msu.edu --- Created attachment 144662 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=144662&action=edit Backport of r256423 to 9 by Mark Felder -- You are receiving this mail because: You are the assignee for the bug. From owner-freebsd-xen@FreeBSD.ORG Tue Jul 15 20:05:59 2014 Return-Path: Delivered-To: freebsd-xen@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 19643B70 for ; Tue, 15 Jul 2014 20:05:59 +0000 (UTC) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id EE0AA2ED6 for ; Tue, 15 Jul 2014 20:05:58 +0000 (UTC) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.14.8/8.14.8) with ESMTP id s6FK5wKV007741 for ; Tue, 15 Jul 2014 20:05:58 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 164630] [xen] XEN HVM kernel: run_interrupt_driven_hooks: still waiting after 60 seconds for xenbusb_nop_confighook_cb Date: Tue, 15 Jul 2014 20:05:58 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: unspecified X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: feld@FreeBSD.org X-Bugzilla-Status: Timeout X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 15 Jul 2014 20:05:59 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=164630 Mark Felder changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |feld@FreeBSD.org --- Comment #5 from Mark Felder --- (In reply to mcdouga9 from comment #3) > I can still reproduce this issue. I just installed FreeBSD 9.3-RELEASE, > compiled and installed a kernel from the XENHVM config file on the following > platforms: > > XenServer 6.2SP1 (Xen 4.1) 70446c XS62ESP1002 > XenServer "6.5" (Xen 4.4) 86858c XenServer Creedence Alpha 4 > > The reason is because r256423 was merged to 10 as r256757 but not to 9 yet. > 10 works great. > > In the meantime I am still using feld@'s patch every time I have to compile > 9: https://feld.me/freebsd/freebsd9-xen-cdrom-fix.patch > > It would be appreciated if it could be incorporated into 9. Thanks. Please note on FreeBSD 9.3 you do not need to build a XENHVM kernel. Just add xenhvm_load="YES" to loader.conf I'm surprised this wasn't backported to 9-STABLE. (It wasn't my patch; I believe I just fixed it slightly to patch to 9 cleanly) -- You are receiving this mail because: You are the assignee for the bug. From owner-freebsd-xen@FreeBSD.ORG Tue Jul 15 20:10:10 2014 Return-Path: Delivered-To: freebsd-xen@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 01FCCD3D for ; Tue, 15 Jul 2014 20:10:10 +0000 (UTC) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id DD31B2F28 for ; Tue, 15 Jul 2014 20:10:09 +0000 (UTC) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.14.8/8.14.8) with ESMTP id s6FKA96G011222 for ; Tue, 15 Jul 2014 20:10:09 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 164630] [xen] XEN HVM kernel: run_interrupt_driven_hooks: still waiting after 60 seconds for xenbusb_nop_confighook_cb Date: Tue, 15 Jul 2014 20:10:10 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: unspecified X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: feld@FreeBSD.org X-Bugzilla-Status: Needs MFC X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 15 Jul 2014 20:10:10 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=164630 Mark Felder changed: What |Removed |Added ---------------------------------------------------------------------------- Status|Timeout |Needs MFC Resolution|Unable to Reproduce |--- --- Comment #6 from Mark Felder --- Yes, checking the source of 9-STABLE shows this wasn't backported. Very unfortunate this missed 9.3-RELEASE. I had been concentrating on 10.0 internally so much because of various other fixes I appear to have missed testing this during the BETA/RC stage. -- You are receiving this mail because: You are the assignee for the bug. From owner-freebsd-xen@FreeBSD.ORG Wed Jul 16 07:10:34 2014 Return-Path: Delivered-To: freebsd-xen@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id AA80B7B5 for ; Wed, 16 Jul 2014 07:10:34 +0000 (UTC) Received: from cu01176a.smtpx.saremail.com (cu01176a.smtpx.saremail.com [195.16.150.151]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 445DC2691 for ; Wed, 16 Jul 2014 07:10:33 +0000 (UTC) Received: from [172.16.2.46] (izaro.sarenet.es [192.148.167.11]) by proxypop03.sare.net (Postfix) with ESMTPSA id A096E9DC87D for ; Wed, 16 Jul 2014 09:10:29 +0200 (CEST) From: Egoitz Aurrekoetxea Message-Id: <459C5673-083F-4E6D-905C-77F741E17983@sarenet.es> Mime-Version: 1.0 (Mac OS X Mail 7.3 \(1878.6\)) Subject: Re: [Bug 164630] [xen] XEN HVM kernel: run_interrupt_driven_hooks: still waiting after 60 seconds for xenbusb_nop_confighook_cb Date: Wed, 16 Jul 2014 09:10:27 +0200 References: To: freebsd-xen@FreeBSD.org In-Reply-To: X-Mailer: Apple Mail (2.1878.6) Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.18 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 16 Jul 2014 07:10:34 -0000 Good morning, In 10-RELEASE is solved. Regards, Egoitz Aurrekoetxea Departamento de sistemas 944 209 470 Parque Tecnol=F3gico. Edificio 103 48170 Zamudio (Bizkaia) egoitz@sarenet.es www.sarenet.es Antes de imprimir este correo electr=F3nico piense si es necesario = hacerlo. El 14/07/2014, a las 19:27, bugzilla-noreply@freebsd.org escribi=F3: > https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D164630 >=20 > mcdouga9@egr.msu.edu changed: >=20 > What |Removed |Added > = --------------------------------------------------------------------------= -- > CC| |mcdouga9@egr.msu.edu >=20 > --- Comment #3 from mcdouga9@egr.msu.edu --- > I can still reproduce this issue. I just installed FreeBSD = 9.3-RELEASE, > compiled and installed a kernel from the XENHVM config file on the = following > platforms: >=20 > XenServer 6.2SP1 (Xen 4.1) 70446c XS62ESP1002 > XenServer "6.5" (Xen 4.4) 86858c XenServer Creedence Alpha 4 >=20 > The reason is because r256423 was merged to 10 as r256757 but not to 9 = yet. 10 > works great. >=20 > In the meantime I am still using feld@'s patch every time I have to = compile 9: > https://feld.me/freebsd/freebsd9-xen-cdrom-fix.patch >=20 > It would be appreciated if it could be incorporated into 9. Thanks. >=20 > --=20 > You are receiving this mail because: > You are the assignee for the bug. > _______________________________________________ > freebsd-xen@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-xen > To unsubscribe, send any mail to "freebsd-xen-unsubscribe@freebsd.org"