From owner-freebsd-virtualization@FreeBSD.ORG Mon Jun 17 11:06:54 2013 Return-Path: Delivered-To: freebsd-virtualization@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id 7FDB721C for ; Mon, 17 Jun 2013 11:06:54 +0000 (UTC) (envelope-from owner-bugmaster@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:1900:2254:206c::16:87]) by mx1.freebsd.org (Postfix) with ESMTP id 6E5F41C27 for ; Mon, 17 Jun 2013 11:06:54 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.7/8.14.7) with ESMTP id r5HB6s82012920 for ; Mon, 17 Jun 2013 11:06:54 GMT (envelope-from owner-bugmaster@FreeBSD.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.7/8.14.7/Submit) id r5HB6skI012918 for freebsd-virtualization@FreeBSD.org; Mon, 17 Jun 2013 11:06:54 GMT (envelope-from owner-bugmaster@FreeBSD.org) Date: Mon, 17 Jun 2013 11:06:54 GMT Message-Id: <201306171106.r5HB6skI012918@freefall.freebsd.org> X-Authentication-Warning: freefall.freebsd.org: gnats set sender to owner-bugmaster@FreeBSD.org using -f From: FreeBSD bugmaster To: freebsd-virtualization@FreeBSD.org Subject: Current problem reports assigned to freebsd-virtualization@FreeBSD.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 17 Jun 2013 11:06:54 -0000 Note: to view an individual PR, use: http://www.freebsd.org/cgi/query-pr.cgi?pr=(number). The following is a listing of current problems submitted by FreeBSD users. These represent problem reports covering all versions including experimental development code and obsolete releases. S Tracker Resp. Description -------------------------------------------------------------------------------- o kern/170096 virtualization[vimage] Dynamically-attached network interface will c o kern/169991 virtualization[run] [vimage] panic after device plugged in o kern/165252 virtualization[vimage] [pf] [panic] kernel panics with VIMAGE and PF o kern/161094 virtualization[vimage] [pf] [panic] kernel panic with pf + VIMAGE wh o kern/160541 virtualization[vimage][pf][patch] panic: userret: Returning on td 0x o kern/160496 virtualization[vimage] [pf] [patch] kernel panic with pf + VIMAGE o kern/148155 virtualization[vimage] [pf] Kernel panic with PF + VIMAGE kernel opt a kern/147950 virtualization[vimage] [carp] VIMAGE + CARP = kernel crash s kern/143808 virtualization[pf] pf does not work inside jail a kern/141696 virtualization[rum] [vimage] [panic] rum(4)+ vimage = kernel panic 10 problems total. From owner-freebsd-virtualization@FreeBSD.ORG Tue Jun 18 08:17:00 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id 935AF7C3; Tue, 18 Jun 2013 08:17:00 +0000 (UTC) (envelope-from carlopmart@gmail.com) Received: from mail-we0-x234.google.com (mail-we0-x234.google.com [IPv6:2a00:1450:400c:c03::234]) by mx1.freebsd.org (Postfix) with ESMTP id 04B7B1484; Tue, 18 Jun 2013 08:16:59 +0000 (UTC) Received: by mail-we0-f180.google.com with SMTP id w56so3158940wes.11 for ; Tue, 18 Jun 2013 01:16:59 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=ld1hquJ7QDMPajlJft4e8HYwEY8FrrCopiZ4uzeLD2g=; b=sLscnv3/5HcjWguTUfrpzfen2UQC8TyX1LsyjnGerk/sz4p1MCyyC2xWg9uBuJNM6Z 5TuRlqiwdKqxKLgf4hAMTAFIF8Inb30zYa+pKA9kHG3wP652IsI/4xjQNxNZqANaVs3w u+5wMY3mJiHuRR1GzbXzW2APf7dZT6xK9wf6NqQ4TpItaqiYq006x9M+EUQIIymzKi01 6GQjb0iVsAhevRvhl2KcFdnLNP0EdrR7e5pFRH7LP+2ADnpMNvSyMuV6bFhUOQRXic0w SbZyqH7ZBacfQNZ3dAq9yBKgfdyYObzVfgHVumYNvhZ4fRLu8CDL8JDtYn5pzp8gPA0M P5xQ== MIME-Version: 1.0 X-Received: by 10.180.74.162 with SMTP id u2mr1215919wiv.36.1371543418981; Tue, 18 Jun 2013 01:16:58 -0700 (PDT) Received: by 10.194.76.178 with HTTP; Tue, 18 Jun 2013 01:16:58 -0700 (PDT) In-Reply-To: References: Date: Tue, 18 Jun 2013 08:16:58 +0000 Message-ID: Subject: Fwd: Avoid sharing interrupts in FreeBSD under ESXi From: "C. L. Martinez" To: freebsd-net@freebsd.org, freebsd-virtualization@freebsd.org Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Jun 2013 08:17:00 -0000 Hi all, First, sorry for the cross-posting. I have installed a FreeBSD 8.4 vm under an ESXi 5.1 U1 server. All works ok, except for interrupt usage between mpt and nic interfaces: root@fbsdtst:~ # vmstat -i interrupt total rate irq1: atkbd0 6 0 irq6: fdc0 9 0 irq16: em2 mpt2 945924 1 irq17: em3 em6 2124484 4 irq18: em0 em4 em7+ 5950584 11 irq19: em1 em5 em8+ 2317830055 4499 cpu0: timer 206119496 400 Total 2532970558 4916 I have enabled the following options in loader.conf: hw.pci.enable_msi="0" hw.pci.enable_msix="0" without a result. Is it possible to avoid to share interrupts in FreeBSD when it is running as a vm? Exists some kernel option to resolve this (via sysctl or compiling a new kernel)? Thanks. From owner-freebsd-virtualization@FreeBSD.ORG Tue Jun 18 09:06:44 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) by hub.freebsd.org (Postfix) with ESMTP id 1DBCF97C; Tue, 18 Jun 2013 09:06:44 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: from mail-qa0-x22f.google.com (mail-qa0-x22f.google.com [IPv6:2607:f8b0:400d:c00::22f]) by mx1.freebsd.org (Postfix) with ESMTP id C2BA518DC; Tue, 18 Jun 2013 09:06:43 +0000 (UTC) Received: by mail-qa0-f47.google.com with SMTP id i13so2026910qae.20 for ; Tue, 18 Jun 2013 02:06:43 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:cc:content-type; bh=GTdZLZEzqwc7fsPifKGadSbEkr/gkI1EfxHpyWbN+pI=; b=rUck29GubBrzrFoSTTSTu0evkvCs3C1WCP3GERpicWz2MLYA4fI9+hastvjb9sdhzV 7MIZ+jo8c2JAESZIb5DEMvZOGDuHxswHo/EPEE75eEqSi2rNPEGKHAs8GuXX+9Va1rF+ 7FR2lJ+umHceUeR+2FJMSfrLP1XjqZZmTR72NoiX8hEFjjUCUQrmMf5U2SEDW1M6k17s x3soDD1P6CDh/CTbv25wcFDJyOIXT/drq2dUX7TnrMPUHSi6sUmhOi/4Tu+S7S6qMPfx oa8/dU+IUsb7oSMY4bcPmsDd2ndz7NzwouiPcfRGLYfJjC+IOQ1PV0AkPyPbIsD+r7+w +zaw== MIME-Version: 1.0 X-Received: by 10.224.11.6 with SMTP id r6mr1726794qar.65.1371546403280; Tue, 18 Jun 2013 02:06:43 -0700 (PDT) Sender: adrian.chadd@gmail.com Received: by 10.224.5.65 with HTTP; Tue, 18 Jun 2013 02:06:43 -0700 (PDT) In-Reply-To: References: Date: Tue, 18 Jun 2013 02:06:43 -0700 X-Google-Sender-Auth: tLcwrgLzkx_NScEasQHEBV2cIIs Message-ID: Subject: Re: Avoid sharing interrupts in FreeBSD under ESXi From: Adrian Chadd To: "C. L. Martinez" Content-Type: text/plain; charset=ISO-8859-1 Cc: freebsd-net@freebsd.org, freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Jun 2013 09:06:44 -0000 ... you mean if mpt and em share an interrupt, things get wedged? adrian On 18 June 2013 01:16, C. L. Martinez wrote: > Hi all, > > First, sorry for the cross-posting. > > I have installed a FreeBSD 8.4 vm under an ESXi 5.1 U1 server. All > works ok, except for interrupt usage between mpt and nic interfaces: > > root@fbsdtst:~ # vmstat -i > interrupt total rate > irq1: atkbd0 6 0 > irq6: fdc0 9 0 > irq16: em2 mpt2 945924 1 > irq17: em3 em6 2124484 4 > irq18: em0 em4 em7+ 5950584 11 > irq19: em1 em5 em8+ 2317830055 4499 > cpu0: timer 206119496 400 > Total 2532970558 4916 > > I have enabled the following options in loader.conf: > > hw.pci.enable_msi="0" > hw.pci.enable_msix="0" > > without a result. Is it possible to avoid to share interrupts in > FreeBSD when it is running as a vm? Exists some kernel option to > resolve this (via sysctl or compiling a new kernel)? > > Thanks. > _______________________________________________ > freebsd-net@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" From owner-freebsd-virtualization@FreeBSD.ORG Tue Jun 18 09:09:23 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) by hub.freebsd.org (Postfix) with ESMTP id 217B9A78; Tue, 18 Jun 2013 09:09:23 +0000 (UTC) (envelope-from carlopmart@gmail.com) Received: from mail-wg0-x234.google.com (mail-wg0-x234.google.com [IPv6:2a00:1450:400c:c00::234]) by mx1.freebsd.org (Postfix) with ESMTP id 5BE181907; Tue, 18 Jun 2013 09:09:22 +0000 (UTC) Received: by mail-wg0-f52.google.com with SMTP id b12so3245767wgh.7 for ; Tue, 18 Jun 2013 02:09:21 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=hV9RBcBMeIgnxMog6pdMpQtzCMdoSemu+1AE1Or+FdI=; b=FRkiPWqm8XWlfR+wh9Bg3VmyuR0anK/2UjX9xtiNqzwvkTxd1XBWrMzXLu2jptTv7D N3Wh7DNxp0OgnPjEFES38rpPFzLHECwXqFKps5LpaEyGdN6+G3YJBqdej9LMpeh9vTvD dr8P4QgIZCelx6VWxGZ2pXVzuRSXW2/hretZFpi+mcOZoD6x4NoV8sRIm1E8Af4KLz1K oikua7LeREvjssnWwZqEm0eiiNrVCtUfTeXyGAaGT/jAPYpDVYretcWU25C3gaROVigE 9T8Mn6pq1c2FXMdEEaIhfaHYxNBO4LbRkcIYdpImQtZRjA2lj6JNvLJd2G8a8WgrwMy4 ukJQ== MIME-Version: 1.0 X-Received: by 10.180.100.35 with SMTP id ev3mr7070627wib.12.1371546561389; Tue, 18 Jun 2013 02:09:21 -0700 (PDT) Received: by 10.194.76.178 with HTTP; Tue, 18 Jun 2013 02:09:21 -0700 (PDT) In-Reply-To: References: Date: Tue, 18 Jun 2013 09:09:21 +0000 Message-ID: Subject: Re: Avoid sharing interrupts in FreeBSD under ESXi From: "C. L. Martinez" To: Adrian Chadd Content-Type: text/plain; charset=UTF-8 Cc: freebsd-net@freebsd.org, freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Jun 2013 09:09:23 -0000 On Tue, Jun 18, 2013 at 9:06 AM, Adrian Chadd wrote: > ... you mean if mpt and em share an interrupt, things get wedged? > > > > adrian > Yes. From owner-freebsd-virtualization@FreeBSD.ORG Wed Jun 19 11:13:31 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id D050A5DB; Wed, 19 Jun 2013 11:13:31 +0000 (UTC) (envelope-from jeroen@dckd.nl) Received: from positron.dckd.nl (positron.dckd.nl [IPv6:2a02:898:62:f6::63]) by mx1.freebsd.org (Postfix) with ESMTP id 976F719A7; Wed, 19 Jun 2013 11:13:31 +0000 (UTC) Received: from wcw-staff-214-39.wireless.uva.nl (wcw-staff-214-39.wireless.uva.nl [145.18.214.39]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) by positron.dckd.nl (Postfix) with ESMTPSA id 2DF7AF8012; Wed, 19 Jun 2013 13:13:21 +0200 (CEST) Content-Type: text/plain; charset=iso-8859-1 Mime-Version: 1.0 (Mac OS X Mail 6.5 \(1508\)) Subject: Re: FreeBSD PVHVM call for testing From: Jeroen van der Ham In-Reply-To: <51B9FF53.2020901@citrix.com> Date: Wed, 19 Jun 2013 13:13:20 +0200 Content-Transfer-Encoding: quoted-printable Message-Id: <2C70BC9B-5964-498F-AAE2-E5024160E3E5@dckd.nl> References: <519131D8.9010307@citrix.com> <519E54DE.5090304@citrix.com> <51B5E730.6070007@citrix.com> <51B9FF53.2020901@citrix.com> To: =?iso-8859-1?Q?Roger_Pau_Monn=E9?= X-Mailer: Apple Mail (2.1508) Cc: freebsd-xen@freebsd.org, "Justin T. Gibbs" , xen-devel , freebsd-virtualization@freebsd.org, xen-users@lists.xen.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 19 Jun 2013 11:13:31 -0000 Hi, I've just built a new kernel based on pvhvm_v17, but it panicked on = boot. I still have a xen console attached, so I can provide additional = information if someone gives me the right commands. Jeroen. From owner-freebsd-virtualization@FreeBSD.ORG Wed Jun 19 11:34:13 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) by hub.freebsd.org (Postfix) with ESMTP id 5F1AEBDE; Wed, 19 Jun 2013 11:34:13 +0000 (UTC) (envelope-from roger.pau@citrix.com) Received: from SMTP.EU.CITRIX.COM (smtp.eu.citrix.com [46.33.159.39]) by mx1.freebsd.org (Postfix) with ESMTP id AF60C1A73; Wed, 19 Jun 2013 11:34:12 +0000 (UTC) X-IronPort-AV: E=Sophos;i="4.87,896,1363132800"; d="scan'208";a="5821509" Received: from lonpex01cl01.citrite.net ([10.30.203.101]) by LONPIPO01.EU.CITRIX.COM with ESMTP/TLS/AES128-SHA; 19 Jun 2013 11:34:05 +0000 Received: from [192.168.1.30] (10.30.203.1) by LONPEX01CL01.citrite.net (10.30.203.101) with Microsoft SMTP Server id 14.2.342.4; Wed, 19 Jun 2013 12:34:04 +0100 Message-ID: <51C1972B.50703@citrix.com> Date: Wed, 19 Jun 2013 13:34:03 +0200 From: =?ISO-8859-1?Q?Roger_Pau_Monn=E9?= User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.7; rv:17.0) Gecko/20130509 Thunderbird/17.0.6 MIME-Version: 1.0 To: Jeroen van der Ham Subject: Re: FreeBSD PVHVM call for testing References: <519131D8.9010307@citrix.com> <519E54DE.5090304@citrix.com> <51B5E730.6070007@citrix.com> <51B9FF53.2020901@citrix.com> <2C70BC9B-5964-498F-AAE2-E5024160E3E5@dckd.nl> In-Reply-To: <2C70BC9B-5964-498F-AAE2-E5024160E3E5@dckd.nl> Content-Type: text/plain; charset="ISO-8859-1" Content-Transfer-Encoding: 7bit X-Originating-IP: [10.30.203.1] Cc: freebsd-xen@freebsd.org, "Justin T. Gibbs" , xen-devel , freebsd-virtualization@freebsd.org, xen-users@lists.xen.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 19 Jun 2013 11:34:13 -0000 On 19/06/13 13:13, Jeroen van der Ham wrote: > Hi, > > I've just built a new kernel based on pvhvm_v17, but it panicked on boot. > > I still have a xen console attached, so I can provide additional information if someone gives me the right commands. > > Jeroen. > Could you provide the boot log of the DomU, backtrace, Xen version and Dom0 kernel version? From owner-freebsd-virtualization@FreeBSD.ORG Wed Jun 19 12:16:19 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) by hub.freebsd.org (Postfix) with ESMTP id EF9849E6; Wed, 19 Jun 2013 12:16:19 +0000 (UTC) (envelope-from jeroen@dckd.nl) Received: from positron.dckd.nl (positron.dckd.nl [94.142.246.99]) by mx1.freebsd.org (Postfix) with ESMTP id 965031CBB; Wed, 19 Jun 2013 12:16:19 +0000 (UTC) Received: from nb-vdham.science.uva.nl (nb-vdham.science.uva.nl [146.50.52.179]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) by positron.dckd.nl (Postfix) with ESMTPSA id 0BC17F8012; Wed, 19 Jun 2013 14:16:17 +0200 (CEST) Content-Type: text/plain; charset=iso-8859-1 Mime-Version: 1.0 (Mac OS X Mail 6.5 \(1508\)) Subject: Re: FreeBSD PVHVM call for testing From: Jeroen van der Ham In-Reply-To: <51C1972B.50703@citrix.com> Date: Wed, 19 Jun 2013 14:16:16 +0200 Content-Transfer-Encoding: quoted-printable Message-Id: References: <519131D8.9010307@citrix.com> <519E54DE.5090304@citrix.com> <51B5E730.6070007@citrix.com> <51B9FF53.2020901@citrix.com> <2C70BC9B-5964-498F-AAE2-E5024160E3E5@dckd.nl> <51C1972B.50703@citrix.com> To: =?iso-8859-1?Q?Roger_Pau_Monn=E9?= X-Mailer: Apple Mail (2.1508) Cc: freebsd-xen@freebsd.org, "Justin T. Gibbs" , xen-devel , freebsd-virtualization@freebsd.org, xen-users@lists.xen.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 19 Jun 2013 12:16:20 -0000 On 19 Jun 2013, at 13:34, Roger Pau Monn=E9 = wrote: >=20 > Could you provide the boot log of the DomU, backtrace, Xen version and > Dom0 kernel version? I did not have a console attached when it rebooted, so I did not have a = log of the initial boot. Now that I did, I see that it fails to mount = its root volume. It had been running previously on pvhvm_v10 for about two weeks without = problems. I updated my local git, and recompiled the kernel and = rebooted. Then this happened. In order: Booting... GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb Copyright (c) 1992-2013 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights = reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 10.0-CURRENT #2 r+6ff8d00-dirty: Tue Jun 18 12:55:16 CEST 2013 root@image01:/usr/obj/root/freebsd/sys/XENHVM amd64 FreeBSD clang version 3.3 (trunk 178860) 20130405 WARNING: WITNESS option enabled, expect reduced performance. XEN: Hypervisor version 4.0 detected. CPU: Quad-Core AMD Opteron(tm) Processor 2374 HE (2200.07-MHz K8-class = CPU) Origin =3D "AuthenticAMD" Id =3D 0x100f42 Family =3D 0x10 Model =3D = 0x4 Stepping =3D 2 = Features=3D0x1781fbff Features2=3D0x80802001 AMD Features=3D0xe2500800 AMD Features2=3D0x1f3 real memory =3D 536870912 (512 MB) avail memory =3D 472260608 (450 MB) Event timer "LAPIC" quality 400 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs FreeBSD/SMP: 1 package(s) x 2 core(s) cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 2 random device not loaded; using insecure entropy ioapic0: Changing APIC ID to 1 MADT: Forcing active-low polarity and level trigger for SCI ioapic0 irqs 0-47 on motherboard kbd1 at kbdmux0 xen_et0: on motherboard Event timer "XENTIMER" frequency 1000000000 Hz quality 950 Timecounter "XENTIMER" frequency 1000000000 Hz quality 950 acpi0: on motherboard acpi0: Power Button (fixed) acpi0: Sleep Button (fixed) acpi0: reservation of 0, a0000 (3) failed cpu0: on acpi0 cpu1: on acpi0 attimer0: port 0x40-0x43 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 atrtc0: port 0x70-0x71 irq 8 on acpi0 Event timer "RTC" frequency 32768 Hz quality 0 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <32-bit timer at 3.579545MHz> port 0x1f48-0x1f4b on acpi0 pcib0: port 0xcf8-0xcff on acpi0 pci0: on pcib0 isab0: at device 1.0 on pci0 isa0: on isab0 atapci0: port = 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xc300-0xc30f at device 1.1 on pci0 ata0: at channel 0 on atapci0 ata1: at channel 1 on atapci0 pci0: at device 1.3 (no driver attached) vgapci0: mem = 0xf0000000-0xf1ffffff,0xf3000000-0xf3000fff at device 2.0 on pci0 xenpci0: port 0xc000-0xc0ff mem = 0xf2000000-0xf2ffffff irq 28 at device 3.0 on pci0 xenstore0: on xenpci0 atkbdc0: port 0x60,0x64 irq 1 on acpi0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] psm0: irq 12 on atkbdc0 psm0: [GIANT-LOCKED] psm0: model IntelliMouse Explorer, device ID 4 fdc0: port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on = acpi0 fdc0: does not respond device_attach: fdc0 attach returned 6 uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 uart0: console (9600,n,8,1) ppc0: port 0x378-0x37f irq 7 on acpi0 ppc0: Generic chipset (NIBBLE-only) in COMPATIBLE mode ppbus0: on ppc0 lpt0: on ppbus0 lpt0: Interrupt-driven port ppi0: on ppbus0 orm0: at iomem 0xc9000-0xc97ff on isa0 sc0: at flags 0x100 on isa0 sc0: VGA <16 virtual consoles, flags=3D0x300> vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on = isa0 fdc0: No FDOUT register! Timecounters tick every 10.000 msec xenbusb_front0: on xenstore0 cd0 at ata1 bus 0 scbus1 target 0 lun 0 cd0: Removable CD-ROM SCSI-0 device cd0: 16.700MB/s transfers (WDMA2, ATAPI 12bytes, PIO 65534bytes) cd0: cd present [360385 x 2048 byte records] xn0: at device/vif/0 on xenbusb_front0 xn0: Ethernet address: 00:16:3e:2f:b7:22 xn1: at device/vif/1 on xenbusb_front0 xn1: Ethernet address: 00:16:3e:3e:64:c5 xenbusb_back0: on xenstore0 xctrl0: on xenstore0 xn0: backend features: feature-sg feature-gso-tcp4 xn1: backend features: feature-sg feature-gso-tcp4 xbd0: 20480MB at device/vbd/768 on xenbusb_front0 xbd0: attaching as ada0 xbd0: disk supports cache flush using: barriers xbd1: 703MB at device/vbd/5632 on xenbusb_front0 xbd1: attaching as ada2 xbd1: disk supports cache flush using: barriers SMP: AP CPU #1 Launched! WARNING: WITNESS option enabled, expect reduced performance. Trying to mount root from ufs:/dev/ad0p2 [rw]... mountroot: waiting for device /dev/ad0p2 ... Mounting from ufs:/dev/ad0p2 failed with error 19. Loader variables: vfs.root.mountfrom=3Dufs:/dev/ad0p2 vfs.root.mountfrom.options=3Drw Manual root filesystem specification: : [options] Mount using filesystem and with the specified (optional) option list. eg. ufs:/dev/da0s1a zfs:tank cd9660:/dev/acd0 ro (which is equivalent to: mount -t cd9660 -o ro /dev/acd0 /) ? List valid disk boot devices . Yield 1 second (for background tasks) Abort manual input mountroot> panic: mountroot: unable to (re-)mount root. cpuid =3D 1 KDB: enter: panic [ thread pid 1 tid 100002 ] Stopped at kdb_enter+0x3e: movq $0,kdb_why db> trace Tracing pid 1 tid 100002 td 0xfffffe0003384920 kdb_enter() at kdb_enter+0x3e/frame 0xffffff80002347d0 vpanic() at vpanic+0x146/frame 0xffffff8000234810 panic() at panic+0x43/frame 0xffffff8000234870 vfs_mountroot() at vfs_mountroot+0x1dc7/frame 0xffffff8000234b20 start_init() at start_init+0x62/frame 0xffffff8000234bb0 fork_exit() at fork_exit+0x84/frame 0xffffff8000234bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000234bf0 --- trap 0, rip =3D 0, rsp =3D 0xffffff8000234cb0, rbp =3D 0 --- jeroen@soleus01 ~]$ sudo xm info host : soleus01.soleus.nu release : 2.6.32-5-xen-amd64 version : #1 SMP Mon Oct 3 07:53:54 UTC 2011 machine : x86_64 nr_cpus : 8 nr_nodes : 2 cores_per_socket : 4 threads_per_core : 1 cpu_mhz : 2200 hw_caps : = 178bf3ff:efd3fbff:00000000:00001310:00802001:00000000:000037ff:00000000 virt_caps : hvm total_memory : 65534 free_memory : 6865 node_to_cpu : node0:0-3 node1:4-7 node_to_memory : node0:3134 node1:3731 node_to_dma32_mem : node0:3128 node1:0 max_node_id : 1 xen_major : 4 xen_minor : 0 xen_extra : .1 xen_caps : xen-3.0-x86_64 xen-3.0-x86_32p hvm-3.0-x86_32 = hvm-3.0-x86_32p hvm-3.0-x86_64 xen_scheduler : credit xen_pagesize : 4096 platform_params : virt_start=3D0xffff800000000000 xen_changeset : unavailable xen_commandline : placeholder dom0_mem=3D1852M cc_compiler : gcc version 4.4.5 (Debian 4.4.5-10) cc_compile_by : waldi cc_compile_domain : debian.org cc_compile_date : Wed Jan 12 14:04:06 UTC 2011 xend_config_format : 4 [jeroen@soleus01 ~]$ uname -a Linux soleus01.soleus.nu 2.6.32-5-xen-amd64 #1 SMP Mon Oct 3 07:53:54 = UTC 2011 x86_64 GNU/Linux= From owner-freebsd-virtualization@FreeBSD.ORG Wed Jun 19 12:21:06 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) by hub.freebsd.org (Postfix) with ESMTP id 11EB6D02; Wed, 19 Jun 2013 12:21:06 +0000 (UTC) (envelope-from roger.pau@citrix.com) Received: from SMTP.EU.CITRIX.COM (smtp.eu.citrix.com [46.33.159.39]) by mx1.freebsd.org (Postfix) with ESMTP id D11271D30; Wed, 19 Jun 2013 12:21:04 +0000 (UTC) X-IronPort-AV: E=Sophos;i="4.87,896,1363132800"; d="scan'208";a="5824075" Received: from lonpex01cl03.citrite.net ([10.30.203.103]) by LONPIPO01.EU.CITRIX.COM with ESMTP/TLS/AES128-SHA; 19 Jun 2013 12:20:52 +0000 Received: from [192.168.1.30] (10.30.203.1) by LONPEX01CL03.citrite.net (10.30.203.103) with Microsoft SMTP Server id 14.2.342.4; Wed, 19 Jun 2013 13:20:51 +0100 Message-ID: <51C1A223.6030305@citrix.com> Date: Wed, 19 Jun 2013 14:20:51 +0200 From: =?ISO-8859-1?Q?Roger_Pau_Monn=E9?= User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.7; rv:17.0) Gecko/20130509 Thunderbird/17.0.6 MIME-Version: 1.0 To: Jeroen van der Ham Subject: Re: FreeBSD PVHVM call for testing References: <519131D8.9010307@citrix.com> <519E54DE.5090304@citrix.com> <51B5E730.6070007@citrix.com> <51B9FF53.2020901@citrix.com> <2C70BC9B-5964-498F-AAE2-E5024160E3E5@dckd.nl> <51C1972B.50703@citrix.com> In-Reply-To: Content-Type: text/plain; charset="ISO-8859-1" Content-Transfer-Encoding: 8bit X-Originating-IP: [10.30.203.1] Cc: freebsd-xen@freebsd.org, "Justin T. Gibbs" , xen-devel , freebsd-virtualization@freebsd.org, xen-users@lists.xen.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 19 Jun 2013 12:21:06 -0000 On 19/06/13 14:16, Jeroen van der Ham wrote: > > On 19 Jun 2013, at 13:34, Roger Pau Monné wrote: >> >> Could you provide the boot log of the DomU, backtrace, Xen version and >> Dom0 kernel version? > > I did not have a console attached when it rebooted, so I did not have a log of the initial boot. Now that I did, I see that it fails to mount its root volume. > > It had been running previously on pvhvm_v10 for about two weeks without problems. I updated my local git, and recompiled the kernel and rebooted. Then this happened. > > > In order: > > Booting... > GDB: no debug ports present > KDB: debugger backends: ddb > KDB: current backend: ddb > Copyright (c) 1992-2013 The FreeBSD Project. > Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 > The Regents of the University of California. All rights reserved. > FreeBSD is a registered trademark of The FreeBSD Foundation. > FreeBSD 10.0-CURRENT #2 r+6ff8d00-dirty: Tue Jun 18 12:55:16 CEST 2013 > root@image01:/usr/obj/root/freebsd/sys/XENHVM amd64 > FreeBSD clang version 3.3 (trunk 178860) 20130405 > WARNING: WITNESS option enabled, expect reduced performance. > XEN: Hypervisor version 4.0 detected. > CPU: Quad-Core AMD Opteron(tm) Processor 2374 HE (2200.07-MHz K8-class CPU) > Origin = "AuthenticAMD" Id = 0x100f42 Family = 0x10 Model = 0x4 Stepping = 2 > Features=0x1781fbff > Features2=0x80802001 > AMD Features=0xe2500800 > AMD Features2=0x1f3 > real memory = 536870912 (512 MB) > avail memory = 472260608 (450 MB) > Event timer "LAPIC" quality 400 > ACPI APIC Table: > FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs > FreeBSD/SMP: 1 package(s) x 2 core(s) > cpu0 (BSP): APIC ID: 0 > cpu1 (AP): APIC ID: 2 > random device not loaded; using insecure entropy > ioapic0: Changing APIC ID to 1 > MADT: Forcing active-low polarity and level trigger for SCI > ioapic0 irqs 0-47 on motherboard > kbd1 at kbdmux0 > xen_et0: on motherboard > Event timer "XENTIMER" frequency 1000000000 Hz quality 950 > Timecounter "XENTIMER" frequency 1000000000 Hz quality 950 > acpi0: on motherboard > acpi0: Power Button (fixed) > acpi0: Sleep Button (fixed) > acpi0: reservation of 0, a0000 (3) failed > cpu0: on acpi0 > cpu1: on acpi0 > attimer0: port 0x40-0x43 irq 0 on acpi0 > Timecounter "i8254" frequency 1193182 Hz quality 0 > Event timer "i8254" frequency 1193182 Hz quality 100 > atrtc0: port 0x70-0x71 irq 8 on acpi0 > Event timer "RTC" frequency 32768 Hz quality 0 > Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 > acpi_timer0: <32-bit timer at 3.579545MHz> port 0x1f48-0x1f4b on acpi0 > pcib0: port 0xcf8-0xcff on acpi0 > pci0: on pcib0 > isab0: at device 1.0 on pci0 > isa0: on isab0 > atapci0: port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xc300-0xc30f at device 1.1 on pci0 > ata0: at channel 0 on atapci0 > ata1: at channel 1 on atapci0 > pci0: at device 1.3 (no driver attached) > vgapci0: mem 0xf0000000-0xf1ffffff,0xf3000000-0xf3000fff at device 2.0 on pci0 > xenpci0: port 0xc000-0xc0ff mem 0xf2000000-0xf2ffffff irq 28 at device 3.0 on pci0 > xenstore0: on xenpci0 > atkbdc0: port 0x60,0x64 irq 1 on acpi0 > atkbd0: irq 1 on atkbdc0 > kbd0 at atkbd0 > atkbd0: [GIANT-LOCKED] > psm0: irq 12 on atkbdc0 > psm0: [GIANT-LOCKED] > psm0: model IntelliMouse Explorer, device ID 4 > fdc0: port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0 > fdc0: does not respond > device_attach: fdc0 attach returned 6 > uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 > uart0: console (9600,n,8,1) > ppc0: port 0x378-0x37f irq 7 on acpi0 > ppc0: Generic chipset (NIBBLE-only) in COMPATIBLE mode > ppbus0: on ppc0 > lpt0: on ppbus0 > lpt0: Interrupt-driven port > ppi0: on ppbus0 > orm0: at iomem 0xc9000-0xc97ff on isa0 > sc0: at flags 0x100 on isa0 > sc0: VGA <16 virtual consoles, flags=0x300> > vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 > fdc0: No FDOUT register! > Timecounters tick every 10.000 msec > xenbusb_front0: on xenstore0 > cd0 at ata1 bus 0 scbus1 target 0 lun 0 > cd0: Removable CD-ROM SCSI-0 device > cd0: 16.700MB/s transfers (WDMA2, ATAPI 12bytes, PIO 65534bytes) > cd0: cd present [360385 x 2048 byte records] > xn0: at device/vif/0 on xenbusb_front0 > xn0: Ethernet address: 00:16:3e:2f:b7:22 > xn1: at device/vif/1 on xenbusb_front0 > xn1: Ethernet address: 00:16:3e:3e:64:c5 > xenbusb_back0: on xenstore0 > xctrl0: on xenstore0 > xn0: backend features: feature-sg feature-gso-tcp4 > xn1: backend features: feature-sg feature-gso-tcp4 > xbd0: 20480MB at device/vbd/768 on xenbusb_front0 > xbd0: attaching as ada0 > xbd0: disk supports cache flush using: barriers > xbd1: 703MB at device/vbd/5632 on xenbusb_front0 > xbd1: attaching as ada2 > xbd1: disk supports cache flush using: barriers > SMP: AP CPU #1 Launched! > WARNING: WITNESS option enabled, expect reduced performance. > Trying to mount root from ufs:/dev/ad0p2 [rw]... > mountroot: waiting for device /dev/ad0p2 ... > Mounting from ufs:/dev/ad0p2 failed with error 19. > Loader variables: > vfs.root.mountfrom=ufs:/dev/ad0p2 > vfs.root.mountfrom.options=rw > > Manual root filesystem specification: > : [options] > Mount using filesystem > and with the specified (optional) option list. > > eg. ufs:/dev/da0s1a > zfs:tank > cd9660:/dev/acd0 ro > (which is equivalent to: mount -t cd9660 -o ro /dev/acd0 /) > > ? List valid disk boot devices > . Yield 1 second (for background tasks) > Abort manual input > > mountroot> > panic: mountroot: unable to (re-)mount root. > cpuid = 1 > KDB: enter: panic > [ thread pid 1 tid 100002 ] > Stopped at kdb_enter+0x3e: movq $0,kdb_why > db> trace > Tracing pid 1 tid 100002 td 0xfffffe0003384920 > kdb_enter() at kdb_enter+0x3e/frame 0xffffff80002347d0 > vpanic() at vpanic+0x146/frame 0xffffff8000234810 > panic() at panic+0x43/frame 0xffffff8000234870 > vfs_mountroot() at vfs_mountroot+0x1dc7/frame 0xffffff8000234b20 > start_init() at start_init+0x62/frame 0xffffff8000234bb0 > fork_exit() at fork_exit+0x84/frame 0xffffff8000234bf0 > fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000234bf0 > --- trap 0, rip = 0, rsp = 0xffffff8000234cb0, rbp = 0 --- > > jeroen@soleus01 ~]$ sudo xm info > host : soleus01.soleus.nu > release : 2.6.32-5-xen-amd64 > version : #1 SMP Mon Oct 3 07:53:54 UTC 2011 > machine : x86_64 > nr_cpus : 8 > nr_nodes : 2 > cores_per_socket : 4 > threads_per_core : 1 > cpu_mhz : 2200 > hw_caps : 178bf3ff:efd3fbff:00000000:00001310:00802001:00000000:000037ff:00000000 > virt_caps : hvm > total_memory : 65534 > free_memory : 6865 > node_to_cpu : node0:0-3 > node1:4-7 > node_to_memory : node0:3134 > node1:3731 > node_to_dma32_mem : node0:3128 > node1:0 > max_node_id : 1 > xen_major : 4 > xen_minor : 0 > xen_extra : .1 > xen_caps : xen-3.0-x86_64 xen-3.0-x86_32p hvm-3.0-x86_32 hvm-3.0-x86_32p hvm-3.0-x86_64 > xen_scheduler : credit > xen_pagesize : 4096 > platform_params : virt_start=0xffff800000000000 > xen_changeset : unavailable > xen_commandline : placeholder dom0_mem=1852M > cc_compiler : gcc version 4.4.5 (Debian 4.4.5-10) > cc_compile_by : waldi > cc_compile_domain : debian.org > cc_compile_date : Wed Jan 12 14:04:06 UTC 2011 > xend_config_format : 4 > > > [jeroen@soleus01 ~]$ uname -a > Linux soleus01.soleus.nu 2.6.32-5-xen-amd64 #1 SMP Mon Oct 3 07:53:54 UTC 2011 x86_64 GNU/Linux > That's because Justin recently pushed a commit that changed the ad translation to ada, you should change your /etc/fstab to ada0p2. It's commit 526f3ad11acb296481215d7c2915b3f30f1844f6. From owner-freebsd-virtualization@FreeBSD.ORG Wed Jun 19 12:33:23 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) by hub.freebsd.org (Postfix) with ESMTP id 227F6354; Wed, 19 Jun 2013 12:33:23 +0000 (UTC) (envelope-from jeroen@dckd.nl) Received: from positron.dckd.nl (positron.dckd.nl [94.142.246.99]) by mx1.freebsd.org (Postfix) with ESMTP id DAF241DF5; Wed, 19 Jun 2013 12:33:22 +0000 (UTC) Received: from nb-vdham.science.uva.nl (nb-vdham.science.uva.nl [146.50.52.179]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) by positron.dckd.nl (Postfix) with ESMTPSA id B7E85F8012; Wed, 19 Jun 2013 14:33:21 +0200 (CEST) Content-Type: text/plain; charset=iso-8859-1 Mime-Version: 1.0 (Mac OS X Mail 6.5 \(1508\)) Subject: Re: FreeBSD PVHVM call for testing From: Jeroen van der Ham In-Reply-To: <51C1A223.6030305@citrix.com> Date: Wed, 19 Jun 2013 14:33:21 +0200 Content-Transfer-Encoding: quoted-printable Message-Id: <6E99C9B2-E28D-4793-81C2-97440AC5AD0E@dckd.nl> References: <519131D8.9010307@citrix.com> <519E54DE.5090304@citrix.com> <51B5E730.6070007@citrix.com> <51B9FF53.2020901@citrix.com> <2C70BC9B-5964-498F-AAE2-E5024160E3E5@dckd.nl> <51C1972B.50703@citrix.com> <51C1A223.6030305@citrix.com> To: =?iso-8859-1?Q?Roger_Pau_Monn=E9?= X-Mailer: Apple Mail (2.1508) Cc: freebsd-xen@freebsd.org, "Justin T. Gibbs" , xen-devel , freebsd-virtualization@freebsd.org, xen-users@lists.xen.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 19 Jun 2013 12:33:23 -0000 On 19 Jun 2013, at 14:20, Roger Pau Monn=E9 = wrote: > That's because Justin recently pushed a commit that changed the ad > translation to ada, you should change your /etc/fstab to ada0p2. It's > commit 526f3ad11acb296481215d7c2915b3f30f1844f6. Ah, you may want to update the wiki page also to warn for that. :) Jeroen. From owner-freebsd-virtualization@FreeBSD.ORG Wed Jun 19 12:44:30 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) by hub.freebsd.org (Postfix) with ESMTP id 6E53B5F9; Wed, 19 Jun 2013 12:44:30 +0000 (UTC) (envelope-from roger.pau@citrix.com) Received: from SMTP.EU.CITRIX.COM (smtp.eu.citrix.com [46.33.159.39]) by mx1.freebsd.org (Postfix) with ESMTP id BD1471E9B; Wed, 19 Jun 2013 12:44:29 +0000 (UTC) X-IronPort-AV: E=Sophos;i="4.87,896,1363132800"; d="scan'208";a="5825245" Received: from lonpex01cl02.citrite.net ([10.30.203.102]) by LONPIPO01.EU.CITRIX.COM with ESMTP/TLS/AES128-SHA; 19 Jun 2013 12:44:28 +0000 Received: from [192.168.1.30] (10.30.203.1) by LONPEX01CL02.citrite.net (10.30.203.102) with Microsoft SMTP Server id 14.2.342.4; Wed, 19 Jun 2013 13:44:27 +0100 Message-ID: <51C1A7AA.2010307@citrix.com> Date: Wed, 19 Jun 2013 14:44:26 +0200 From: =?ISO-8859-1?Q?Roger_Pau_Monn=E9?= User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.7; rv:17.0) Gecko/20130509 Thunderbird/17.0.6 MIME-Version: 1.0 To: Jeroen van der Ham Subject: Re: FreeBSD PVHVM call for testing References: <519131D8.9010307@citrix.com> <519E54DE.5090304@citrix.com> <51B5E730.6070007@citrix.com> <51B9FF53.2020901@citrix.com> <2C70BC9B-5964-498F-AAE2-E5024160E3E5@dckd.nl> <51C1972B.50703@citrix.com> <51C1A223.6030305@citrix.com> <6E99C9B2-E28D-4793-81C2-97440AC5AD0E@dckd.nl> In-Reply-To: <6E99C9B2-E28D-4793-81C2-97440AC5AD0E@dckd.nl> Content-Type: text/plain; charset="ISO-8859-1" Content-Transfer-Encoding: 8bit X-Originating-IP: [10.30.203.1] Cc: freebsd-xen@freebsd.org, "Justin T. Gibbs" , xen-devel , freebsd-virtualization@freebsd.org, xen-users@lists.xen.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 19 Jun 2013 12:44:30 -0000 On 19/06/13 14:33, Jeroen van der Ham wrote: > > On 19 Jun 2013, at 14:20, Roger Pau Monné wrote: >> That's because Justin recently pushed a commit that changed the ad >> translation to ada, you should change your /etc/fstab to ada0p2. It's >> commit 526f3ad11acb296481215d7c2915b3f30f1844f6. > > > Ah, you may want to update the wiki page also to warn for that. :) D'oh, I've completely forgot about the wiki page, it's updated now, thanks for the pointer. From owner-freebsd-virtualization@FreeBSD.ORG Wed Jun 19 13:16:02 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id CBE65516; Wed, 19 Jun 2013 13:16:02 +0000 (UTC) (envelope-from larrymelia@gmail.com) Received: from mail-pb0-x230.google.com (mail-pb0-x230.google.com [IPv6:2607:f8b0:400e:c01::230]) by mx1.freebsd.org (Postfix) with ESMTP id 9D24810DA; Wed, 19 Jun 2013 13:16:02 +0000 (UTC) Received: by mail-pb0-f48.google.com with SMTP id ma3so5024089pbc.7 for ; Wed, 19 Jun 2013 06:16:02 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-type; bh=JWx8hqZ7WM0Tfz+FUYIygdjXlZkJd3KpRJP9AAnST6Y=; b=RgXpbiAD5k7TyGQWyRrqX8RJMupcqRnfz88TYI0bgcEr0znIzQHa3/XTYvve+j6Tu+ ox+HPjOQ2PPxztn9OOOG4mENKG++0s57EK94ujD6W3HhOch03ly5xEmoBO8/CguoWsll KCKnNiujVH4vRyDUXZLkUo3byFjSiLJPs6Ty44D3WWEav5tjjeK6CnMyIbsnPM0YDzXp A1UGP/I0pSXALsTjH7JEfeFcBM5yp4Pm+oq7BhW3wxn7uGIJPZpApvjv7aAfNwzdCNxT x5LoTBaLEHY2kgnsXAtIu/f6+BYva83f+Ore5sFwBzfl+iNB5rZjfcLB2SOHXBZYLIF+ hgPA== X-Received: by 10.66.240.41 with SMTP id vx9mr6672164pac.93.1371647762423; Wed, 19 Jun 2013 06:16:02 -0700 (PDT) MIME-Version: 1.0 Received: by 10.70.85.196 with HTTP; Wed, 19 Jun 2013 06:15:22 -0700 (PDT) In-Reply-To: <201304291345.50635.jhb@freebsd.org> References: <201304291345.50635.jhb@freebsd.org> From: Larry Melia Date: Wed, 19 Jun 2013 06:15:22 -0700 Message-ID: Subject: Re: Proposal for better support of hypervisors and their synthetic drivers at boot-time To: John Baldwin Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.14 Cc: Alexander Motin , KY Srinivasan , "Abhishek Gupta \(LIS\)" , freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 19 Jun 2013 13:16:02 -0000 John, Sorry for not responding earlier to your comments, but we=92re at a point where we=92re trying to get our VM drivers included with the current build. Your solution for dynamic loading sounds wonderful! Is this a simple change? And how can we help? Here=92s an example of the modern, preferred way (Linux has been doing this for 5+ years) to detect the presence of a hypervisor on x86/AMD chips, both 32/64 bit modes (this is pulled from our FreeBSD driver, but the formatting is off because Google's Gmail really wants to make it look "pretty"): *#define HV_X64_MSR_GUEST_OS_ID 0x40000000* *#define HV_X64_CPUID_MIN 0x40000005* *#define HV_X64_CPUID_MAX 0x4000ffff* *static* *int* *hv_check_for_hyper_v*(*void*) { u_int regs[4]; *int* hyper_v_detected *=3D* 0; do_cpuid(1, regs); *if* (regs[2] *&* 0x80000000) { */* if(a hypervisor is detected) */* */* make sure this really is Hyper-V */* */* we look at the CPUID info */* do_cpuid(HV_X64_MSR_GUEST_OS_ID, regs); hyper_v_detected *=3D* regs[0] *>=3D* HV_X64_CPUID_MIN *&&* regs[0] *<=3D* HV_X64_CPUID_MAX *&&* *!*memcmp("Microsoft Hv", *&*regs[1], 12); } *return* (hyper_v_detected); } Of course, a general purpose routine will simply copy the name-tag somewhere and make it available. We are also having some issues with some of the disk utilities. They need to behave differently when operating under a hypervisor. I=92ll try to provide a list of all the things that should be upgraded or enhanced, then we can figure out the best way to get them done. On Mon, Apr 29, 2013 at 10:45 AM, John Baldwin wrote: > I know Alexander replied about the ATA bits already, but I wanted to repl= y > to > two of your other points below: > > On Tuesday, April 23, 2013 10:07:03 am Larry Melia wrote: > > (1) Move the call to init_param1() (in sys/kern/subr_parm.c), which is > used > > for hypervisor detection, to an earlier point in the boot process. > > Presently, it appears to be called after the ATA driver is selected, > which > > is too late in the boot process. (This was discovered after some testin= g > > with the ATA driver.) Therefore, before the bus drivers and native > > controllers are detected and selected, discovery of a host hypervisor > > should be done first. > > > > (3) Upgrade the init_param1() function (in sys/kern/subr_parm.c) to use > the > > more recent approach to hypervisor detection. This approach uses the > > CPU-identify functions to retrieve a unique signature consisting of a > fixed > > string of ASCII characters. This was done on Linux about five years. Fo= r > > backward compatibility, however, the existing logic would be retained, > but > > augmented with this new approach. It would also be conditionally added > only > > for x86/AMD64 builds. > > I definitely agree with these proposals. In addition, our current > hypervisor > detection code is completely x86-specific and does not belong in MI code. > The > only bits that should be MI are the vm_guest variable and the VM_GUEST > constants. I would argue that most of the VM_GUEST constants (for specif= ic > VMs which we do not have currently) should be MD as well. > > Each platform that supports hypervisors would install its own SYSINIT to > set > vm_guest instead of doing it directly from init_param1(). > > Making the VM_GUEST_FOO constants be MD macros means you can use #ifdef t= o > test for them. Thus: > > #ifdef VM_GUEST_HYPERV > /* Include a hyper-V specific driver. */ > #endif > > The current enum approach doesn't allow for that. > > -- > John Baldwin > From owner-freebsd-virtualization@FreeBSD.ORG Wed Jun 19 16:07:42 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id 2FD788B7; Wed, 19 Jun 2013 16:07:42 +0000 (UTC) (envelope-from jeroen@dckd.nl) Received: from positron.dckd.nl (positron.dckd.nl [IPv6:2a02:898:62:f6::63]) by mx1.freebsd.org (Postfix) with ESMTP id E7C371C65; Wed, 19 Jun 2013 16:07:41 +0000 (UTC) Received: from [IPv6:2001:610:6a1::9c87:e105:ef6f:ff9d] (unknown [IPv6:2001:610:6a1:0:9c87:e105:ef6f:ff9d]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) by positron.dckd.nl (Postfix) with ESMTPSA id 64953F841F; Wed, 19 Jun 2013 18:07:39 +0200 (CEST) Content-Type: text/plain; charset=iso-8859-1 Mime-Version: 1.0 (Mac OS X Mail 6.5 \(1508\)) Subject: Re: FreeBSD PVHVM call for testing From: Jeroen van der Ham In-Reply-To: <51C1A7AA.2010307@citrix.com> Date: Wed, 19 Jun 2013 18:07:38 +0200 Content-Transfer-Encoding: quoted-printable Message-Id: References: <519131D8.9010307@citrix.com> <519E54DE.5090304@citrix.com> <51B5E730.6070007@citrix.com> <51B9FF53.2020901@citrix.com> <2C70BC9B-5964-498F-AAE2-E5024160E3E5@dckd.nl> <51C1972B.50703@citrix.com> <51C1A223.6030305@citrix.com> <6E99C9B2-E28D-4793-81C2-97440AC5AD0E@dckd.nl> <51C1A7AA.2010307@citrix.com> To: =?iso-8859-1?Q?Roger_Pau_Monn=E9?= X-Mailer: Apple Mail (2.1508) Cc: freebsd-xen@freebsd.org, "Justin T. Gibbs" , xen-devel , freebsd-virtualization@freebsd.org, xen-users@lists.xen.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 19 Jun 2013 16:07:42 -0000 Hi, On 19 Jun 2013, at 14:44, Roger Pau Monn=E9 = wrote: > On 19/06/13 14:33, Jeroen van der Ham wrote: >>=20 >> On 19 Jun 2013, at 14:20, Roger Pau Monn=E9 = wrote: >>> That's because Justin recently pushed a commit that changed the ad >>> translation to ada, you should change your /etc/fstab to ada0p2. = It's >>> commit 526f3ad11acb296481215d7c2915b3f30f1844f6. >>=20 >>=20 >> Ah, you may want to update the wiki page also to warn for that. :) >=20 > D'oh, I've completely forgot about the wiki page, it's updated now, > thanks for the pointer. Okay, everything works again now. Additionally, I've applied the patches from FreeBSD-SA-13:06.mmap, = rebuilt the kernel and rebooted, and the system now works fine. I did note however that rebuilding the kernel takes an awful lot more = time than on a FreeBSD9 system. As in it took about 2 hours longer. Jeroen. From owner-freebsd-virtualization@FreeBSD.ORG Wed Jun 19 16:15:17 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id E8673C0A; Wed, 19 Jun 2013 16:15:17 +0000 (UTC) (envelope-from gibbs@freebsd.org) Received: from aslan.scsiguy.com (mail.scsiguy.com [70.89.174.89]) by mx1.freebsd.org (Postfix) with ESMTP id A4A121CCF; Wed, 19 Jun 2013 16:15:17 +0000 (UTC) Received: from [192.168.6.155] (207-225-98-3.dia.static.qwest.net [207.225.98.3]) (authenticated bits=0) by aslan.scsiguy.com (8.14.7/8.14.5) with ESMTP id r5JGF9pZ018518 (version=TLSv1/SSLv3 cipher=AES128-SHA bits=128 verify=NO); Wed, 19 Jun 2013 16:15:10 GMT (envelope-from gibbs@freebsd.org) Content-Type: text/plain; charset=iso-8859-1 Mime-Version: 1.0 (Mac OS X Mail 6.5 \(1508\)) Subject: Re: FreeBSD PVHVM call for testing From: "Justin T. Gibbs" In-Reply-To: Date: Wed, 19 Jun 2013 10:15:06 -0600 Content-Transfer-Encoding: quoted-printable Message-Id: References: <519131D8.9010307@citrix.com> <519E54DE.5090304@citrix.com> <51B5E730.6070007@citrix.com> <51B9FF53.2020901@citrix.com> <2C70BC9B-5964-498F-AAE2-E5024160E3E5@dckd.nl> <51C1972B.50703@citrix.com> <51C1A223.6030305@citrix.com> <6E99C9B2-E28D-4793-81C2-97440AC5AD0E@dckd.nl> <51C1A7AA.2010307@citrix.com> To: Jeroen van der Ham X-Mailer: Apple Mail (2.1508) X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.4.3 (aslan.scsiguy.com [70.89.174.89]); Wed, 19 Jun 2013 16:15:10 +0000 (UTC) Cc: freebsd-xen@freebsd.org, xen-users@lists.xen.org, xen-devel , freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 19 Jun 2013 16:15:18 -0000 On Jun 19, 2013, at 10:07 AM, Jeroen van der Ham wrote: > Hi, >=20 > On 19 Jun 2013, at 14:44, Roger Pau Monn=E9 = wrote: >=20 >> On 19/06/13 14:33, Jeroen van der Ham wrote: >>>=20 >>> On 19 Jun 2013, at 14:20, Roger Pau Monn=E9 = wrote: >>>> That's because Justin recently pushed a commit that changed the ad >>>> translation to ada, you should change your /etc/fstab to ada0p2. = It's >>>> commit 526f3ad11acb296481215d7c2915b3f30f1844f6. >>>=20 >>>=20 >>> Ah, you may want to update the wiki page also to warn for that. :) >>=20 >> D'oh, I've completely forgot about the wiki page, it's updated now, >> thanks for the pointer. >=20 > Okay, everything works again now. Should we encourage folks to just configure their VMs to use xbd? I = hope some day that the system will just report "da" devices, so the ada = name may change again. We could also suggest specifying SCSI disks in = the VM config since I don't think "da" will ever change. > Additionally, I've applied the patches from FreeBSD-SA-13:06.mmap, = rebuilt the kernel and rebooted, and the system now works fine. >=20 > I did note however that rebuilding the kernel takes an awful lot more = time than on a FreeBSD9 system. As in it took about 2 hours longer. >=20 > Jeroen. I've never seen a kernel build take 2 hours, much less 2 hours *longer*. = Are you talking about buildworld? It would be interesting to know your = results building stable/9 sources in your 10 environment to see if this = is just due to "build bloat" or a true performance regression. -- Justin= From owner-freebsd-virtualization@FreeBSD.ORG Wed Jun 19 16:50:09 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) by hub.freebsd.org (Postfix) with ESMTP id 6A18CBF9; Wed, 19 Jun 2013 16:50:09 +0000 (UTC) (envelope-from jeroen@dckd.nl) Received: from positron.dckd.nl (positron.dckd.nl [94.142.246.99]) by mx1.freebsd.org (Postfix) with ESMTP id 2D9AF1F76; Wed, 19 Jun 2013 16:50:08 +0000 (UTC) Received: from doc.dckd.nl (doc.dckd.nl [145.99.178.214]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) by positron.dckd.nl (Postfix) with ESMTPSA id 053B0F841F; Wed, 19 Jun 2013 18:50:06 +0200 (CEST) Content-Type: text/plain; charset=windows-1252 Mime-Version: 1.0 (Mac OS X Mail 6.5 \(1508\)) Subject: Re: FreeBSD PVHVM call for testing From: Jeroen van der Ham In-Reply-To: Date: Wed, 19 Jun 2013 18:50:06 +0200 Content-Transfer-Encoding: quoted-printable Message-Id: <546D0358-4F92-4E8C-AED0-94FC5D36086F@dckd.nl> References: <519131D8.9010307@citrix.com> <519E54DE.5090304@citrix.com> <51B5E730.6070007@citrix.com> <51B9FF53.2020901@citrix.com> <2C70BC9B-5964-498F-AAE2-E5024160E3E5@dckd.nl> <51C1972B.50703@citrix.com> <51C1A223.6030305@citrix.com> <6E99C9B2-E28D-4793-81C2-97440AC5AD0E@dckd.nl> <51C1A7AA.2010307@citrix.com> To: Justin T. Gibbs X-Mailer: Apple Mail (2.1508) Cc: freebsd-xen@freebsd.org, xen-users@lists.xen.org, xen-devel , freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 19 Jun 2013 16:50:09 -0000 Hi, On 19 Jun 2013, at 18:15, Justin T. Gibbs wrote: >=20 > I've never seen a kernel build take 2 hours, much less 2 hours = *longer*. Are you talking about buildworld? It would be interesting to = know your results building stable/9 sources in your 10 environment to = see if this is just due to "build bloat" or a true performance = regression. >=20 I copy/pasted the command from the wiki: > # make kernel-toolchain && make buildkernel KERNCONF=3DXENHVM && make = installkernel KERNCONF=3DXENHVM On the stable/9 I only did=20 > make buildkernel KERNCONF=3DXENHVM && make installkernel = KERNCONF=3DXENHVM I guess the kernel-toolchain takes a long time to build=85and from what = I can see it does a clean before rebuilding also. I'm doing the kernel-toolchain step only now and will report how long it = took. Jeroen. From owner-freebsd-virtualization@FreeBSD.ORG Wed Jun 19 16:52:14 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) by hub.freebsd.org (Postfix) with ESMTP id ABF04CAF; Wed, 19 Jun 2013 16:52:14 +0000 (UTC) (envelope-from gibbs@FreeBSD.org) Received: from aslan.scsiguy.com (mail.scsiguy.com [70.89.174.89]) by mx1.freebsd.org (Postfix) with ESMTP id 670731FA4; Wed, 19 Jun 2013 16:52:14 +0000 (UTC) Received: from [192.168.6.155] (207-225-98-3.dia.static.qwest.net [207.225.98.3]) (authenticated bits=0) by aslan.scsiguy.com (8.14.7/8.14.5) with ESMTP id r5JGq9XQ018695 (version=TLSv1/SSLv3 cipher=AES128-SHA bits=128 verify=NO); Wed, 19 Jun 2013 16:52:09 GMT (envelope-from gibbs@FreeBSD.org) Content-Type: text/plain; charset=windows-1252 Mime-Version: 1.0 (Mac OS X Mail 6.5 \(1508\)) Subject: Re: FreeBSD PVHVM call for testing From: "Justin T. Gibbs" In-Reply-To: <546D0358-4F92-4E8C-AED0-94FC5D36086F@dckd.nl> Date: Wed, 19 Jun 2013 10:52:06 -0600 Content-Transfer-Encoding: quoted-printable Message-Id: References: <519131D8.9010307@citrix.com> <519E54DE.5090304@citrix.com> <51B5E730.6070007@citrix.com> <51B9FF53.2020901@citrix.com> <2C70BC9B-5964-498F-AAE2-E5024160E3E5@dckd.nl> <51C1972B.50703@citrix.com> <51C1A223.6030305@citrix.com> <6E99C9B2-E28D-4793-81C2-97440AC5AD0E@dckd.nl> <51C1A7AA.2010307@citrix.com> <546D0358-4F92-4E8C-AED0-94FC5D36086F@dckd.nl> To: Jeroen van der Ham X-Mailer: Apple Mail (2.1508) X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.4.3 (aslan.scsiguy.com [70.89.174.89]); Wed, 19 Jun 2013 16:52:09 +0000 (UTC) Cc: freebsd-xen@freebsd.org, xen-users@lists.xen.org, xen-devel , freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 19 Jun 2013 16:52:14 -0000 On Jun 19, 2013, at 10:50 AM, Jeroen van der Ham wrote: > Hi, >=20 > On 19 Jun 2013, at 18:15, Justin T. Gibbs wrote: >>=20 >> I've never seen a kernel build take 2 hours, much less 2 hours = *longer*. Are you talking about buildworld? It would be interesting to = know your results building stable/9 sources in your 10 environment to = see if this is just due to "build bloat" or a true performance = regression. >>=20 >=20 > I copy/pasted the command from the wiki: >=20 >> # make kernel-toolchain && make buildkernel KERNCONF=3DXENHVM && make = installkernel KERNCONF=3DXENHVM >=20 > On the stable/9 I only did=20 >=20 >> make buildkernel KERNCONF=3DXENHVM && make installkernel = KERNCONF=3DXENHVM >=20 >=20 > I guess the kernel-toolchain takes a long time to build=85and from = what I can see it does a clean before rebuilding also. >=20 > I'm doing the kernel-toolchain step only now and will report how long = it took. >=20 > Jeroen. Oh. Without any parallelism (-j X), the build will take a really long = time. Even with only one core, you'll get a large speedup by performing = a parallel build since many steps of the build are I/O bound. -- Justin= From owner-freebsd-virtualization@FreeBSD.ORG Wed Jun 19 20:03:30 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id 223BF7CD; Wed, 19 Jun 2013 20:03:30 +0000 (UTC) (envelope-from jeroen@dckd.nl) Received: from positron.dckd.nl (positron.dckd.nl [94.142.246.99]) by mx1.freebsd.org (Postfix) with ESMTP id D74311C33; Wed, 19 Jun 2013 20:03:29 +0000 (UTC) Received: from doc.dckd.nl (doc.dckd.nl [145.99.178.214]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) by positron.dckd.nl (Postfix) with ESMTPSA id 2877EF841F; Wed, 19 Jun 2013 22:03:28 +0200 (CEST) Content-Type: text/plain; charset=windows-1252 Mime-Version: 1.0 (Mac OS X Mail 6.5 \(1508\)) Subject: Re: FreeBSD PVHVM call for testing From: Jeroen van der Ham In-Reply-To: Date: Wed, 19 Jun 2013 22:03:27 +0200 Content-Transfer-Encoding: quoted-printable Message-Id: <405F53E2-C9E3-4AA8-8BC1-935E500D3DD9@dckd.nl> References: <519131D8.9010307@citrix.com> <519E54DE.5090304@citrix.com> <51B5E730.6070007@citrix.com> <51B9FF53.2020901@citrix.com> <2C70BC9B-5964-498F-AAE2-E5024160E3E5@dckd.nl> <51C1972B.50703@citrix.com> <51C1A223.6030305@citrix.com> <6E99C9B2-E28D-4793-81C2-97440AC5AD0E@dckd.nl> <51C1A7AA.2010307@citrix.com> <546D0358-4F92-4E8C-AED0-94FC5D36086F@dckd.nl> To: Justin T. Gibbs X-Mailer: Apple Mail (2.1508) Cc: freebsd-xen@freebsd.org, xen-users@lists.xen.org, xen-devel , freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 19 Jun 2013 20:03:30 -0000 Hi, On 19 Jun 2013, at 18:52, Justin T. Gibbs wrote: >> I guess the kernel-toolchain takes a long time to build=85and from = what I can see it does a clean before rebuilding also. >>=20 >> I'm doing the kernel-toolchain step only now and will report how long = it took. This seems to be it, that took roughly 2 hours to build. The actual = kernel is probably pretty fast in building. > Oh. Without any parallelism (-j X), the build will take a really long = time. Even with only one core, you'll get a large speedup by performing = a parallel build since many steps of the build are I/O bound. Neither of the systems actually had parallelism defined, either as flag = or in /etc/make.conf Jeroen. From owner-freebsd-virtualization@FreeBSD.ORG Thu Jun 20 09:20:15 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id 3590843B; Thu, 20 Jun 2013 09:20:15 +0000 (UTC) (envelope-from jeroen@dckd.nl) Received: from positron.dckd.nl (positron.dckd.nl [IPv6:2a02:898:62:f6::63]) by mx1.freebsd.org (Postfix) with ESMTP id EEF9E1717; Thu, 20 Jun 2013 09:20:14 +0000 (UTC) Received: from nb-vdham.science.uva.nl (nb-vdham.science.uva.nl [146.50.52.179]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) by positron.dckd.nl (Postfix) with ESMTPSA id EC496F841F; Thu, 20 Jun 2013 11:20:12 +0200 (CEST) Content-Type: text/plain; charset=iso-8859-1 Mime-Version: 1.0 (Mac OS X Mail 6.5 \(1508\)) Subject: Re: FreeBSD PVHVM call for testing From: Jeroen van der Ham In-Reply-To: <51B9FF53.2020901@citrix.com> Date: Thu, 20 Jun 2013 11:20:12 +0200 Content-Transfer-Encoding: quoted-printable Message-Id: <54560214-F170-426E-BDF9-2295D8B8E982@dckd.nl> References: <519131D8.9010307@citrix.com> <519E54DE.5090304@citrix.com> <51B5E730.6070007@citrix.com> <51B9FF53.2020901@citrix.com> To: =?iso-8859-1?Q?Roger_Pau_Monn=E9?= X-Mailer: Apple Mail (2.1508) Cc: "freebsd-xen@freebsd.org" , "Justin T. Gibbs" , xen-devel , "freebsd-virtualization@freebsd.org" , "xen-users@lists.xen.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Jun 2013 09:20:15 -0000 Hi, I have this running for a day or so now, but I'm noticing that the load = averages seem a bit off: $ uptime 11:17AM up 17:14, 1 user, load averages: 0.31, 0.27, 0.21 This is for a clean install, with just enough installed to compile this = kernel. In top I'm seeing that the machine is idling >98% of the time. = But this does not correlate to the load displayed above. Jeroen. From owner-freebsd-virtualization@FreeBSD.ORG Thu Jun 20 09:33:28 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) by hub.freebsd.org (Postfix) with ESMTP id D5B5C93F; Thu, 20 Jun 2013 09:33:28 +0000 (UTC) (envelope-from roger.pau@citrix.com) Received: from SMTP.EU.CITRIX.COM (smtp.eu.citrix.com [46.33.159.39]) by mx1.freebsd.org (Postfix) with ESMTP id 28C2417F3; Thu, 20 Jun 2013 09:33:26 +0000 (UTC) X-IronPort-AV: E=Sophos;i="4.87,903,1363132800"; d="scan'208";a="5871147" Received: from lonpex01cl02.citrite.net ([10.30.203.102]) by LONPIPO01.EU.CITRIX.COM with ESMTP/TLS/AES128-SHA; 20 Jun 2013 09:33:25 +0000 Received: from [192.168.1.30] (10.30.203.1) by LONPEX01CL02.citrite.net (10.30.203.102) with Microsoft SMTP Server id 14.2.342.4; Thu, 20 Jun 2013 10:33:24 +0100 Message-ID: <51C2CC63.9070505@citrix.com> Date: Thu, 20 Jun 2013 11:33:23 +0200 From: =?ISO-8859-1?Q?Roger_Pau_Monn=E9?= User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.7; rv:17.0) Gecko/20130509 Thunderbird/17.0.6 MIME-Version: 1.0 To: Jeroen van der Ham Subject: Re: FreeBSD PVHVM call for testing References: <519131D8.9010307@citrix.com> <519E54DE.5090304@citrix.com> <51B5E730.6070007@citrix.com> <51B9FF53.2020901@citrix.com> <54560214-F170-426E-BDF9-2295D8B8E982@dckd.nl> In-Reply-To: <54560214-F170-426E-BDF9-2295D8B8E982@dckd.nl> Content-Type: text/plain; charset="ISO-8859-1" Content-Transfer-Encoding: 7bit X-Originating-IP: [10.30.203.1] Cc: "freebsd-xen@freebsd.org" , "Justin T. Gibbs" , xen-devel , "freebsd-virtualization@freebsd.org" , "xen-users@lists.xen.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Jun 2013 09:33:28 -0000 On 20/06/13 11:20, Jeroen van der Ham wrote: > Hi, > > I have this running for a day or so now, but I'm noticing that the load averages seem a bit off: > > $ uptime > 11:17AM up 17:14, 1 user, load averages: 0.31, 0.27, 0.21 > > This is for a clean install, with just enough installed to compile this kernel. In top I'm seeing that the machine is idling >98% of the time. But this does not correlate to the load displayed above. This is probably due to the fact that we are not properly accounting for blocked/runnable/offline time. Did you see the same when running the XENHVM kernel without my patches? Roger. From owner-freebsd-virtualization@FreeBSD.ORG Thu Jun 20 09:38:02 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id A89759EF; Thu, 20 Jun 2013 09:38:02 +0000 (UTC) (envelope-from jeroen@dckd.nl) Received: from positron.dckd.nl (positron.dckd.nl [94.142.246.99]) by mx1.freebsd.org (Postfix) with ESMTP id 6CF32181F; Thu, 20 Jun 2013 09:38:01 +0000 (UTC) Received: from nb-vdham.science.uva.nl (nb-vdham.science.uva.nl [146.50.52.179]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) by positron.dckd.nl (Postfix) with ESMTPSA id 63C3EF841F; Thu, 20 Jun 2013 11:37:59 +0200 (CEST) Content-Type: text/plain; charset=iso-8859-1 Mime-Version: 1.0 (Mac OS X Mail 6.5 \(1508\)) Subject: Re: FreeBSD PVHVM call for testing From: Jeroen van der Ham In-Reply-To: <51C2CC63.9070505@citrix.com> Date: Thu, 20 Jun 2013 11:37:59 +0200 Content-Transfer-Encoding: quoted-printable Message-Id: <1F66A530-BBE6-4D6D-9557-E11BE8B7C4B7@dckd.nl> References: <519131D8.9010307@citrix.com> <519E54DE.5090304@citrix.com> <51B5E730.6070007@citrix.com> <51B9FF53.2020901@citrix.com> <54560214-F170-426E-BDF9-2295D8B8E982@dckd.nl> <51C2CC63.9070505@citrix.com> To: =?iso-8859-1?Q?Roger_Pau_Monn=E9?= X-Mailer: Apple Mail (2.1508) Cc: "freebsd-xen@freebsd.org" , "Justin T. Gibbs" , xen-devel , "freebsd-virtualization@freebsd.org" , "xen-users@lists.xen.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Jun 2013 09:38:02 -0000 Hi, On 20 Jun 2013, at 11:33, Roger Pau Monn=E9 = wrote: >=20 > This is probably due to the fact that we are not properly accounting = for > blocked/runnable/offline time. Did you see the same when running the > XENHVM kernel without my patches? >=20 I have a different system on the same platform running FreeBSD9 with = XENHVM. This server is running (web)mail, smokeping and irssi. That gives: 11:35AM up 20:07, 1 user, load averages: 0.06, 0.06, 0.07 Jeroen.