From owner-freebsd-xen@freebsd.org Fri Oct 11 07:06:36 2019 Return-Path: Delivered-To: freebsd-xen@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 323AE13FF82 for ; Fri, 11 Oct 2019 07:06:36 +0000 (UTC) (envelope-from roger.pau@citrix.com) Received: from esa6.hc3370-68.iphmx.com (esa6.hc3370-68.iphmx.com [216.71.155.175]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "esa6.hc3370-68.iphmx.com", Issuer "HydrantID SSL ICA G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 46qJsQ3JyCz458T for ; Fri, 11 Oct 2019 07:06:34 +0000 (UTC) (envelope-from roger.pau@citrix.com) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=citrix.com; s=securemail; t=1570777594; h=date:from:to:cc:subject:message-id:references: mime-version:in-reply-to; bh=/EG7RCAISkEAcnXgqN+CPCI/ZyRyVj4JCeeIBbqVTuM=; b=N8c5ZoabAwVp1Zqiz/vnx1oeqKKnokGP6/arJ1eojqf0oDR50pGhN3Cv uBNI/GZMowS2uUKcIgwCWJXJ/ffDRwCkXUcmXWgafRnfLV5eVT8n4pWUi OQlDIk5l+5OXMIlIf2eX0R1si5rXk+VK3LcDaUVVJeli148RLvpE5A+66 s=; Received-SPF: None (esa6.hc3370-68.iphmx.com: no sender authenticity information available from domain of roger.pau@citrix.com) identity=pra; client-ip=162.221.158.21; receiver=esa6.hc3370-68.iphmx.com; envelope-from="roger.pau@citrix.com"; x-sender="roger.pau@citrix.com"; x-conformance=sidf_compatible Received-SPF: Pass (esa6.hc3370-68.iphmx.com: domain of roger.pau@citrix.com designates 162.221.158.21 as permitted sender) identity=mailfrom; client-ip=162.221.158.21; receiver=esa6.hc3370-68.iphmx.com; envelope-from="roger.pau@citrix.com"; x-sender="roger.pau@citrix.com"; x-conformance=sidf_compatible; x-record-type="v=spf1"; x-record-text="v=spf1 ip4:209.167.231.154 ip4:178.63.86.133 ip4:195.66.111.40/30 ip4:85.115.9.32/28 ip4:199.102.83.4 ip4:192.28.146.160 ip4:192.28.146.107 ip4:216.52.6.88 ip4:216.52.6.188 ip4:162.221.158.21 ip4:162.221.156.83 ip4:168.245.78.127 ~all" Received-SPF: None (esa6.hc3370-68.iphmx.com: no sender authenticity information available from domain of postmaster@mail.citrix.com) identity=helo; client-ip=162.221.158.21; receiver=esa6.hc3370-68.iphmx.com; envelope-from="roger.pau@citrix.com"; x-sender="postmaster@mail.citrix.com"; x-conformance=sidf_compatible IronPort-SDR: ByadXV3Vm57xfitQVD0rVs0WXHKFU78wjMWTUFg5eNJE0ESmeoJN5wZrK85Q/9wiJo6W3peeJB zOv6SOqHfBj02z+g85hWBOCG26XnHzbu5hCJMnXiaHuCOQHUYBsvCX+G3Hj8CaxgeVKKWUxQmd XiaOAj2bjU2MOQ0fQmjfPIJ1hj9KoUoHmiX44dOTEviQ8DeGRXP7My/Y9h6lRYWt3NF9CnMZGd M7kuv5tG0DdpT4SP1x114Py/ceT159sHo1qQJ2kCqaAANPGxtUZYh6+xkkcET7L/ULEDAS3a+R DAU= X-SBRS: 2.7 X-MesageID: 7066010 X-Ironport-Server: esa6.hc3370-68.iphmx.com X-Remote-IP: 162.221.158.21 X-Policy: $RELAYED X-IronPort-AV: E=Sophos;i="5.67,283,1566878400"; d="scan'208";a="7066010" Date: Fri, 11 Oct 2019 09:06:21 +0200 From: Roger Pau =?iso-8859-1?Q?Monn=E9?= To: Brian Buhrow CC: Subject: Re: i/o is very slow on FreeBSD dom0 with Xen-4.12 and Freebsd-12 Message-ID: <20191011070621.GA1004@Air-de-Roger> References: <201910102323.x9ANNACe003999@lothlorien.nfbcal.org> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Disposition: inline In-Reply-To: <201910102323.x9ANNACe003999@lothlorien.nfbcal.org> User-Agent: Mutt/1.12.2 (2019-09-21) X-ClientProxiedBy: AMSPEX02CAS01.citrite.net (10.69.22.112) To AMSPEX02CL02.citrite.net (10.69.22.126) X-Rspamd-Queue-Id: 46qJsQ3JyCz458T X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=citrix.com header.s=securemail header.b=N8c5Zoab; dmarc=pass (policy=none) header.from=citrix.com; spf=pass (mx1.freebsd.org: domain of roger.pau@citrix.com designates 216.71.155.175 as permitted sender) smtp.mailfrom=roger.pau@citrix.com X-Spamd-Result: default: False [-5.44 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[citrix.com:s=securemail]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; RCVD_DKIM_ARC_DNSWL_MED(-0.50)[]; DWL_DNSWL_LOW(-1.00)[citrix.com.dwl.dnswl.org : 127.0.9.1]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_MED(-0.20)[175.155.71.216.list.dnswl.org : 127.0.3.2]; DKIM_TRACE(0.00)[citrix.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[citrix.com,none]; RCVD_COUNT_ZERO(0.00)[0]; FROM_EQ_ENVFROM(0.00)[]; MID_RHS_NOT_FQDN(0.50)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:16417, ipnet:216.71.154.0/23, country:US]; IP_SCORE(-1.24)[ip: (-2.33), ipnet: 216.71.154.0/23(-2.55), asn: 16417(-1.27), country: US(-0.05)] X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 11 Oct 2019 07:06:36 -0000 On Thu, Oct 10, 2019 at 04:23:10PM -0700, Brian Buhrow wrote: > hello. I'm trying to get a FreeBSD-12 xen server up and running and > have run into the issue that i/o seems to be very slow for the dom0, which > is FreeBSD-12.0-stable, and Xen is xen-4.12. > I followed the instructions for making FreeBSD a dom0 as written in > 21.8 of the FreeBSD handbook. All went well until I rebooted the machine > with the /boot/xen kern loading. The dom0 boots, but takes about 2 hours > to get to the login prompt and, on the console, when ever I press > control-t, it says what ever process is currently running is in biord. > I'm familiar with NetBSD and how to make it run xen, and am familiar with > FreeBSD as well. Stil, I'm sure I'm doing something wrong that's simple, > or, I missed some instruction that will seem obvious in retrospect. > If anyone can help me shed light on the trouble, that would be great! Thanks for testing it out. What you do is correct, I think there's either an issue in Xen or the firmware. > Below are my /boot/loader.conf and a transcript of a sample boot. > Note that it took about 2 hours to get from the initial loading of the > kernel to the getty error messages. > -thanks > -Brian > > > boot_serial="YES" # -h: Use serial console > comconsole_speed="115200" # Set the current serial console speed > comconsole_port="0x2f8" # Set the current serial console port > #console="vidconsole" # A comma separated list of console(s) > console="comconsole" # A comma separated list of console(s) > geom_mirror_load="YES" # RAID1 disk driver (see gmirror(8)) > ipmi_load="YES" # Ripmi driver > if_tap_load="YES" # Load bridge driver. > if_vlan_load="YES" # Load vlan driver. > # Turn on Xen (BB 10/08/2019) > xen_kernel="/boot/xen" > xen_cmdline="dom0_mem=4096m dom0_max_vcpus=4 dom0=pvh console=com2,vga clocksource=hpet com2=115200,8n1 guest_loglvl=all loglvl=all" Any reason to force the clock source to HPET? Not that's it's wrong, I'm just curious about why you need that. Can you change dom0=pvh to dom0=pvh,verbose and also add iommu=verbose,debug and sync_console and post the boot log again. There's no need to wait for 2h, just post what you get up to the point where the box freezes. [...] > Trying to mount root from ufs:/dev/gpt/gptroot [rw]... > uhub0: 6 ports with 6 removable, self powered > uhub6: 6 ports with 6 removable, self powered > cd0 at ata4 bus 0 scbus2 target 0 lun 0 > cd0: Removable CD-ROM SCSI device > cd0: 150.000MB/s transfers (SATA 1.x, UDMA2, ATAPI 12bytes, PIO 8192bytes) > cd0: Attempt to query device size failed: NOT READY, Medium not present - tray closed > usb_alloc_device: set address 2 failed (USB_ERR_TIMEOUT, ignored) > usbd_setup_device_deusbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT > usbd_req_re_enumerate: addr=2, set address failed! (USB_ERR_TIMEOUT, ignored) > usbd_setup_device_deusbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT > usbd_req_re_enumerate: addr=2, set address failed! (USB_ERR_TIMEOUT, ignored) > usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT > ugen1.2: at usbus1 (disconnected) > uhub_reattach_port: could nGEOM_MIRROR: Device mirror/gm0 launched (1/2). > GEOM_MIRROR: Device gm0: rebuilding provider ada1. > WARNING: /mnt was not properly dismounted The above timeouts point out that at least the usb controller is not working properly. Let's see if we can get more data with the new options on the command line. Thanks, Roger.