From owner-freebsd-virtualization@FreeBSD.ORG Sun Oct 19 12:03:57 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id C2CE0BC8; Sun, 19 Oct 2014 12:03:57 +0000 (UTC) Received: from smtp.digiware.nl (smtp.digiware.nl [31.223.170.169]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 8042FE1B; Sun, 19 Oct 2014 12:03:57 +0000 (UTC) Received: from rack1.digiware.nl (unknown [127.0.0.1]) by smtp.digiware.nl (Postfix) with ESMTP id 278CA1534DC; Sun, 19 Oct 2014 14:03:54 +0200 (CEST) X-Virus-Scanned: amavisd-new at digiware.nl Received: from smtp.digiware.nl ([127.0.0.1]) by rack1.digiware.nl (rack1.digiware.nl [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id CVZUzPW6yKbh; Sun, 19 Oct 2014 14:03:45 +0200 (CEST) Received: from [IPv6:2001:4cb8:3:1:ecc9:b9dc:e5a3:6838] (unknown [IPv6:2001:4cb8:3:1:ecc9:b9dc:e5a3:6838]) (using TLSv1 with cipher ECDHE-RSA-AES128-SHA (128/128 bits)) (No client certificate requested) by smtp.digiware.nl (Postfix) with ESMTPSA id F2FED153413; Sun, 19 Oct 2014 14:03:44 +0200 (CEST) Message-ID: <5443A89F.8050801@digiware.nl> Date: Sun, 19 Oct 2014 14:03:43 +0200 From: Willem Jan Withagen User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:24.0) Gecko/20100101 Thunderbird/24.6.0 MIME-Version: 1.0 To: Anish Gupta , freebsd-current@freebsd.org, freebsd-virtualization@freebsd.org Subject: Re: HEADS UP: Merging projects/bhyve_svm to HEAD References: <154A442D-7814-4618-9AFC-6F9FB3F5DFD3@gmail.com> In-Reply-To: <154A442D-7814-4618-9AFC-6F9FB3F5DFD3@gmail.com> Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 8bit Cc: Neel Natu X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 19 Oct 2014 12:03:57 -0000 On 16-10-2014 5:00, Anish Gupta wrote: > Hi all, > > The projects/bhyve_svm branch is ready to be merged to HEAD. > > This branch contains patches to bhyve to enable it to work on AMD > processors with SVM/AMD-V hardware extensions[1]. Pretty much any AMD > processor since 2010 will have the features required by bhyve. > > bhyve on AMD supports (almost) all the features available with Intel > [2]. All guest OSes supported on Intel are supported on AMD. All the > bhyve-related utilities function similarly on both Intel and AMD > platforms [3]. > > The patch against HEAD revision 273066 is available for review and testing: > https://people.freebsd.org/~neel/bhyve/bhyve_svm.diff [Neels web directory] > > [1]: http://en.wikipedia.org/wiki/X86_virtualization > [2]: bhyve doesn't support PCI passthru on AMD at this time > [3]: bhyvectl has grown some processor-specific options Fetched the patch and compiled. Now running: HEAD r273066M and I was able to throw at it all the tests and images that in the past works. And perhaps even better. Great work. --WjW From owner-freebsd-virtualization@FreeBSD.ORG Sun Oct 19 20:04:57 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 6DA2E7BC; Sun, 19 Oct 2014 20:04:57 +0000 (UTC) Received: from mail-pd0-x22a.google.com (mail-pd0-x22a.google.com [IPv6:2607:f8b0:400e:c02::22a]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 375CCFA5; Sun, 19 Oct 2014 20:04:57 +0000 (UTC) Received: by mail-pd0-f170.google.com with SMTP id p10so3698721pdj.1 for ; Sun, 19 Oct 2014 13:04:56 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=content-type:mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=FEzkb6ICRWhRwPcvyescEbytaBvjp0TmWZ6O0G+UULg=; b=lDqCI53VSk7dwOinaa4RWtYZPveLA3PtVEXC6ZE6teSL0yHmbB7c4o1sz1fO/6Gu+e wkdgii+P/Zb7yrP9ARa5biO1PvIa7rKUk8LqFchUNSI9uZUtYsWOTtKZNnrMRt3ZOEAi WjQlSvDwg60gSXicGa2Cwd3w2GR45WBsl1mhRujU/27hBmICnF3BdcaIw45BNoAMEZQa KA2EX8shDBb/BG6dB3aSLCr6zUpOhnSus5SN3f78+DuK7kXQCL+sZg97xfg5YfYS2OLi 3UKGSQbhO2G3HdRdH7sEedzPLMpEpfPKZOOiFvFZq21cYxWl2EeD5EQwhhcMD/+i4jEd wHhQ== X-Received: by 10.66.233.37 with SMTP id tt5mr23130468pac.11.1413749096727; Sun, 19 Oct 2014 13:04:56 -0700 (PDT) Received: from neil.creepingfur.org (tessier.creepingfur.is. [70.36.196.188]) by mx.google.com with ESMTPSA id qf3sm7175321pbc.96.2014.10.19.13.04.55 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Sun, 19 Oct 2014 13:04:56 -0700 (PDT) Content-Type: text/plain; charset=windows-1252 Mime-Version: 1.0 (Mac OS X Mail 8.0 \(1990.1\)) Subject: Re: HEADS UP: Merging projects/bhyve_svm to HEAD From: Benjamin Perrault In-Reply-To: <5443A89F.8050801@digiware.nl> Date: Sun, 19 Oct 2014 13:04:50 -0700 Content-Transfer-Encoding: quoted-printable Message-Id: References: <154A442D-7814-4618-9AFC-6F9FB3F5DFD3@gmail.com> <5443A89F.8050801@digiware.nl> To: freebsd-virtualization@freebsd.org, Anish Gupta X-Mailer: Apple Mail (2.1990.1) Cc: freebsd-current@freebsd.org, Neel Natu X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 19 Oct 2014 20:04:57 -0000 After a few days of extensive testing and abuse, i=92ve run into no new = issues or unknowns what so ever. Everything that worked before still = works now ( and a few bugs from fixed from HEAD ).=20 Thus, I have gone ahead and pushed r273182 w/ Neel=92s patch out to = about 80 of the assorted AMD boxes in the production and dev pods that I = care for. If end users see something, I=92ll let you know, but I have a = feeling they won=92t.=20 Again - Excellent work.=20 cheers, -bp > On Oct 19, 2014, at 5:03 AM, Willem Jan Withagen = wrote: >=20 > On 16-10-2014 5:00, Anish Gupta wrote: >> Hi all, >>=20 >> The projects/bhyve_svm branch is ready to be merged to HEAD. >>=20 >> This branch contains patches to bhyve to enable it to work on AMD >> processors with SVM/AMD-V hardware extensions[1]. Pretty much any AMD >> processor since 2010 will have the features required by bhyve. >>=20 >> bhyve on AMD supports (almost) all the features available with Intel >> [2]. All guest OSes supported on Intel are supported on AMD. All the >> bhyve-related utilities function similarly on both Intel and AMD >> platforms [3]. >>=20 >> The patch against HEAD revision 273066 is available for review and = testing: >> https://people.freebsd.org/~neel/bhyve/bhyve_svm.diff [Neel=92s web = directory] >>=20 >> [1]: http://en.wikipedia.org/wiki/X86_virtualization >> [2]: bhyve doesn't support PCI passthru on AMD at this time >> [3]: bhyvectl has grown some processor-specific options >=20 > Fetched the patch and compiled. > Now running: HEAD r273066M and I was able to throw at it all the tests > and images that in the past works. And perhaps even better. >=20 > Great work. > --WjW >=20 >=20 > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to = "freebsd-virtualization-unsubscribe@freebsd.org" From owner-freebsd-virtualization@FreeBSD.ORG Mon Oct 20 16:21:03 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 88EE3E20 for ; Mon, 20 Oct 2014 16:21:03 +0000 (UTC) Received: from potato.growveg.org (potato.growveg.org [62.49.247.163]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4183965C for ; Mon, 20 Oct 2014 16:21:02 +0000 (UTC) Received: from john by potato.growveg.org with local (Exim 4.84 (FreeBSD)) (envelope-from ) id 1XgFhL-000HM9-DP for freebsd-virtualization@freebsd.org; Mon, 20 Oct 2014 17:20:43 +0100 Date: Mon, 20 Oct 2014 17:20:43 +0100 From: John To: freebsd-virtualization@freebsd.org Subject: moving from virtualbox to bhyve Message-ID: <20141020162043.GA66615@potato.growveg.org> Reply-To: freebsd-virtualization@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.5.23 (2014-03-12) Sender: John X-SA-Exim-Connect-IP: X-SA-Exim-Mail-From: john@potato.growveg.org X-SA-Exim-Scanned: No (on potato.growveg.org); SAEximRunCond expanded to false X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 20 Oct 2014 16:21:03 -0000 Hi, I'm trying to move from virtualbox to bhyve. From the server I've successfully converted an ubuntu guest on vbox to raw. What I'm trying to do is to load that into bhyve, (on another freebsd server) and I'm at the limits of my knowledge here; this isn't my speciality. The most recent information relevant to what I want to do, I found at https://www.monkeybrains.net/support/bhyve but (not his fault!) what I'm trying to accomplish is not what he set out to do. Has anyone done what I'm trying to do, or anyone know how to do it? The furthest I got was with this, the guest.img is the raw ubuntu from vbox: # bhyve -AI -H -P -s 0:0,hostbridge -s 1,lpc -s 2:0,virtio-net,tap1 -s 3:0,virtio-blk, \ ./guest.img -l com1,stdio -c 4 -m 1024M linuxguest [ 0.000000] Initializing cgroup subsys cpuset [ 0.000000] Initializing cgroup subsys cpu [ 0.000000] Initializing cgroup subsys cpuacct [ 0.000000] Linux version 3.11.0-26-generic (buildd@comet) (gcc version 4.8.1 (Ubuntu/Linaro 4.8.1-10ubuntu8) ) #45-Ubuntu SMP Tue Jul 15 04:02:06 UTC 2014 (Ubuntu 3.11.0-26.45-generic 3.11.10.12) [ 0.000000] Command line: console=ttyS0 BOOT_IMAGE=/boot/vmlinuz-3.11.0-26-generic root=UUID=9cd5a28b-8746-41f3-9b0e-8a950b8c5206 ro [ 0.000000] KERNEL supported cpus: [ 0.000000] Intel GenuineIntel [ 0.000000] AMD AuthenticAMD [ 0.000000] Centaur CentaurHauls [...] [ 0.696113] io scheduler deadline registered (default) [ 0.696437] io scheduler cfq registered [ 0.696705] pci_hotplug: PCI Hot Plug PCI Core version: 0.5 [ 0.697052] pciehp: PCI Express Hot Plug Controller Driver version: 0.4 [ 0.697502] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 [ 0.697951] ACPI: Power Button [PWRF] [ 0.698214] GHES: HEST is not enabled! [ 0.698808] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled [ 0.719861] 00:01: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A [ 0.740907] 00:02: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A [ 0.742883] Linux agpgart interface v0.103 [ 0.744250] brd: module loaded [ 0.745010] loop: module loaded Segmentation fault (core dumped) thanks, -- John From owner-freebsd-virtualization@FreeBSD.ORG Mon Oct 20 16:30:54 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 6F25CF15 for ; Mon, 20 Oct 2014 16:30:54 +0000 (UTC) Received: from mx1.scaleengine.net (beauharnois2.bhs1.scaleengine.net [142.4.218.15]) by mx1.freebsd.org (Postfix) with ESMTP id 2F9777F6 for ; Mon, 20 Oct 2014 16:30:53 +0000 (UTC) Received: from [192.168.1.2] (Seawolf.HML3.ScaleEngine.net [209.51.186.28]) (Authenticated sender: allanjude.freebsd@scaleengine.com) by mx1.scaleengine.net (Postfix) with ESMTPSA id A0F9C621DF for ; Mon, 20 Oct 2014 16:30:52 +0000 (UTC) Message-ID: <544538D6.80101@freebsd.org> Date: Mon, 20 Oct 2014 12:31:18 -0400 From: Allan Jude User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:31.0) Gecko/20100101 Thunderbird/31.2.0 MIME-Version: 1.0 To: freebsd-virtualization@freebsd.org Subject: Re: moving from virtualbox to bhyve References: <20141020162043.GA66615@potato.growveg.org> In-Reply-To: <20141020162043.GA66615@potato.growveg.org> Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="oRlt8iu73hmg5cKjoVCHCogjnFGKgHaA2" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 20 Oct 2014 16:30:54 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --oRlt8iu73hmg5cKjoVCHCogjnFGKgHaA2 Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable On 2014-10-20 12:20, John wrote: > Hi, >=20 > I'm trying to move from virtualbox to bhyve. From the server I've succe= ssfully > converted an ubuntu guest on vbox to raw. What I'm trying to do is to l= oad that > into bhyve, (on another freebsd server) and I'm at the limits of my kno= wledge=20 > here; this isn't my speciality. >=20 > The most recent information relevant to what I want to do, I found at=20 > https://www.monkeybrains.net/support/bhyve >=20 > but (not his fault!) what I'm trying to accomplish is not what he set o= ut to do. >=20 > Has anyone done what I'm trying to do, or anyone know how to do it? The= furthest=20 > I got was with this, the guest.img is the raw ubuntu from vbox: >=20 > # bhyve -AI -H -P -s 0:0,hostbridge -s 1,lpc -s 2:0,virtio-net,tap1 -s = 3:0,virtio-blk, \ > ./guest.img -l com1,stdio -c 4 -m 1024M linuxguest >=20 > [ 0.000000] Initializing cgroup subsys cpuset > [ 0.000000] Initializing cgroup subsys cpu > [ 0.000000] Initializing cgroup subsys cpuacct > [ 0.000000] Linux version 3.11.0-26-generic (buildd@comet) (gcc vers= ion 4.8.1 (Ubuntu/Linaro 4.8.1-10ubuntu8) ) #45-Ubuntu SMP Tue Jul 15 04:= 02:06 UTC 2014 (Ubuntu 3.11.0-26.45-generic 3.11.10.12) > [ 0.000000] Command line: console=3DttyS0 BOOT_IMAGE=3D/boot/vmlinuz= -3.11.0-26-generic root=3DUUID=3D9cd5a28b-8746-41f3-9b0e-8a950b8c5206 ro > [ 0.000000] KERNEL supported cpus: > [ 0.000000] Intel GenuineIntel > [ 0.000000] AMD AuthenticAMD > [ 0.000000] Centaur CentaurHauls > =20 > [...] >=20 > [ 0.696113] io scheduler deadline registered (default) > [ 0.696437] io scheduler cfq registered > [ 0.696705] pci_hotplug: PCI Hot Plug PCI Core version: 0.5 > [ 0.697052] pciehp: PCI Express Hot Plug Controller Driver version: = 0.4 > [ 0.697502] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/= input/input0 > [ 0.697951] ACPI: Power Button [PWRF] > [ 0.698214] GHES: HEST is not enabled! > [ 0.698808] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled= > [ 0.719861] 00:01: ttyS0 at I/O 0x3f8 (irq =3D 4) is a 16550A > [ 0.740907] 00:02: ttyS1 at I/O 0x2f8 (irq =3D 3) is a 16550A > [ 0.742883] Linux agpgart interface v0.103 > [ 0.744250] brd: module loaded > [ 0.745010] loop: module loaded > Segmentation fault (core dumped) >=20 > thanks, >=20 What version of FreeBSD are you using? You might want to try the latest 10.1 RC (or HEAD if you are so included) instead, as they have much improved bhyve. --=20 Allan Jude --oRlt8iu73hmg5cKjoVCHCogjnFGKgHaA2 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.22 (MingW32) iQIcBAEBAgAGBQJURTjZAAoJEJrBFpNRJZKf7ekQAKtf6TLXiSt/cMruEOel+ca2 nr9MLQnmIY4vXOXOBHboWx6ndI3fFtQaGXSEsiTibjZ/lH8oZTTEoT5GFRsCUjD7 HaPiReJMRFh7tqwZz3xjQLPrfxJBk62+iqd4ef95j2rWj4vUnox11gDtKcQjUMjd zx3KPbuDTkx0mHXEzHnZi5u4AK8dEM6//tT9PdgUgCHYKdXTKk9pD/Et8suIeFxm V8nyWLCLVbBJZ2BrVUdiGI8yGeh9M1BkOyLsEfMNxWYLAZ20BmwjYqJsrlX4PD4k hgHSD9tIE9NmzJaWUDKGd1mg+zHgl/pdN9yR4eProEq1snkL7LbwhaWnPVrykPbg NdJcsSpqjO5FoXbmdiJ8iEUtK8r/TyqPt1ugOU5/Vb6tnuVAfgoSybp/palVkxvS GuPYGGlZD3gb9uBuwwzKXSJ2DhBvGsCTqTEv8hUNznq8CL6c1b2bzFKlBrnhodz4 TpcncpKYLRRuPY7N8W2erXPDZtjDW0QrWoAXvdmrQo7MezZ0BiP9pdE1R94VdkeV OTxqIZiiRelbnKNudbotsjtU95jDMScPRSWtGMju5RVfRdUCvbbBfCGkLadvz8W4 XkcJxNJR7VenuHysIn7VNk75FCUmyPHDIUw6WJBCh/xq4VO28qrcTKNpiZcD1BM6 +oMbavTferYrQedA3PS0 =lD1F -----END PGP SIGNATURE----- --oRlt8iu73hmg5cKjoVCHCogjnFGKgHaA2-- From owner-freebsd-virtualization@FreeBSD.ORG Mon Oct 20 17:04:14 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 381F8845; Mon, 20 Oct 2014 17:04:14 +0000 (UTC) Received: from potato.growveg.org (potato.growveg.org [62.49.247.163]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id E93C6B19; Mon, 20 Oct 2014 17:04:13 +0000 (UTC) Received: from john by potato.growveg.org with local (Exim 4.84 (FreeBSD)) (envelope-from ) id 1XgGNF-000HPg-Rz; Mon, 20 Oct 2014 18:04:01 +0100 Date: Mon, 20 Oct 2014 18:04:01 +0100 From: John To: Allan Jude Subject: Re: moving from virtualbox to bhyve Message-ID: <20141020170401.GB66615@potato.growveg.org> Reply-To: freebsd-virtualization@freebsd.org References: <20141020162043.GA66615@potato.growveg.org> <544538D6.80101@freebsd.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <544538D6.80101@freebsd.org> User-Agent: Mutt/1.5.23 (2014-03-12) Sender: John X-SA-Exim-Connect-IP: X-SA-Exim-Mail-From: john@potato.growveg.org X-SA-Exim-Scanned: No (on potato.growveg.org); SAEximRunCond expanded to false Cc: freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 20 Oct 2014 17:04:14 -0000 On Mon, Oct 20, 2014 at 12:31:18PM -0400, Allan Jude wrote: > What version of FreeBSD are you using? You might want to try the latest > 10.1 RC (or HEAD if you are so included) instead, as they have much > improved bhyve. freebsd version is: 10.1-PRERELEASE #0 r273275 ports is 371224 I'm running 10-STABLE -- John From owner-freebsd-virtualization@FreeBSD.ORG Tue Oct 21 00:55:14 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id AC694618; Tue, 21 Oct 2014 00:55:14 +0000 (UTC) Received: from mail-qg0-x229.google.com (mail-qg0-x229.google.com [IPv6:2607:f8b0:400d:c04::229]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 5E5BF389; Tue, 21 Oct 2014 00:55:14 +0000 (UTC) Received: by mail-qg0-f41.google.com with SMTP id a108so130465qge.28 for ; Mon, 20 Oct 2014 17:55:13 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=mDqrVt4LmVrgVwVyHbg+7Wy+n9cjuP2124eZGQRVE/E=; b=arIqcWEwsehu/QOEL5TlZwBWNWR5cETDgxb7KE7x5ZLTC4ACRz1DhSyA1IPDb45Dsf rgqXqBLDu4B6l+0BeiUTW4HrsOGI0UHTQy/pcWpkhvkkvXj5rYYHX+cZGWDopSIdT8t0 j4feE481wLTRGg/3LHlK47ML0FbfJ5gpGGfwD9FHjDr/PxWTTVVT9xkS9n8prQCbwZBX 2St2CEUJAueCC1yHXE0fpb/U2EyE6Zb9ostnia1HYVtlqgk69oJnjV9zN3ubbZGETfzK KVUVDFpvALyYH/mFtwQ+AQCgr381cbXbEJQs1SgO/2CWGigWqaa+qklFrY1cCZqeE4Jd fA8g== MIME-Version: 1.0 X-Received: by 10.140.32.227 with SMTP id h90mr37938924qgh.13.1413852913382; Mon, 20 Oct 2014 17:55:13 -0700 (PDT) Received: by 10.140.85.83 with HTTP; Mon, 20 Oct 2014 17:55:13 -0700 (PDT) In-Reply-To: <20141020170401.GB66615@potato.growveg.org> References: <20141020162043.GA66615@potato.growveg.org> <544538D6.80101@freebsd.org> <20141020170401.GB66615@potato.growveg.org> Date: Mon, 20 Oct 2014 17:55:13 -0700 Message-ID: Subject: Re: moving from virtualbox to bhyve From: Neel Natu To: "freebsd-virtualization@freebsd.org" Content-Type: text/plain; charset=UTF-8 Cc: Allan Jude X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 21 Oct 2014 00:55:14 -0000 Hi John, On Mon, Oct 20, 2014 at 10:04 AM, John wrote: > On Mon, Oct 20, 2014 at 12:31:18PM -0400, Allan Jude wrote: > >> What version of FreeBSD are you using? You might want to try the latest >> 10.1 RC (or HEAD if you are so included) instead, as they have much >> improved bhyve. > > freebsd version is: 10.1-PRERELEASE #0 r273275 > ports is 371224 > > I'm running 10-STABLE It seems that you are booting the guest from the disk that was originally used with vbox. Do you have the same issue booting from an ubuntu ISO and doing a fresh install to disk in bhyve? best Neel > -- > John > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@freebsd.org" From owner-freebsd-virtualization@FreeBSD.ORG Tue Oct 21 04:59:25 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 92718165 for ; Tue, 21 Oct 2014 04:59:25 +0000 (UTC) Received: from potato.growveg.org (potato.growveg.org [62.49.247.163]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4D3E6E11 for ; Tue, 21 Oct 2014 04:59:25 +0000 (UTC) Received: from john by potato.growveg.org with local (Exim 4.84 (FreeBSD)) (envelope-from ) id 1XgRXL-000I1q-0G; Tue, 21 Oct 2014 05:59:11 +0100 Date: Tue, 21 Oct 2014 05:59:10 +0100 From: John To: Neel Natu Subject: Re: moving from virtualbox to bhyve Message-ID: <20141021045910.GA68426@potato.growveg.org> Reply-To: freebsd-virtualization@freebsd.org References: <20141020162043.GA66615@potato.growveg.org> <544538D6.80101@freebsd.org> <20141020170401.GB66615@potato.growveg.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.23 (2014-03-12) Sender: John X-SA-Exim-Connect-IP: X-SA-Exim-Mail-From: john@potato.growveg.org X-SA-Exim-Scanned: No (on potato.growveg.org); SAEximRunCond expanded to false Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 21 Oct 2014 04:59:25 -0000 On Mon, Oct 20, 2014 at 05:55:13PM -0700, Neel Natu wrote: > It seems that you are booting the guest from the disk that was > originally used with vbox. Yes, this is what I want to do, because there's data on there. > Do you have the same issue booting from an ubuntu ISO and doing a > fresh install to disk in bhyve? No, that seems to work. cheers, -- John From owner-freebsd-virtualization@FreeBSD.ORG Tue Oct 21 09:46:48 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id C57065A0 for ; Tue, 21 Oct 2014 09:46:48 +0000 (UTC) Received: from mailer.gewt.net (mailer.gewt.net [198.27.113.113]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 9EE78FC2 for ; Tue, 21 Oct 2014 09:46:48 +0000 (UTC) Received: from cpe-65-24-235-132.insight.res.rr.com ([65.24.235.132] helo=[10.10.10.13]) by mailer.gewt.net with esmtpsa (TLSv1:DHE-RSA-AES256-SHA:256) (Exim 4.82 (FreeBSD)) (envelope-from ) id 1XgVT9-0009HT-CI for freebsd-virtualization@freebsd.org; Tue, 21 Oct 2014 05:11:07 -0400 From: Cory Smelosky Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (1.0) Subject: Re: moving from virtualbox to bhyve Message-Id: Date: Tue, 21 Oct 2014 05:11:07 -0400 References: <20141020162043.GA66615@potato.growveg.org> <544538D6.80101@freebsd.org> <20141020170401.GB66615@potato.growveg.org> <20141021045910.GA68426@potato.growveg.org> In-Reply-To: <20141021045910.GA68426@potato.growveg.org> To: "freebsd-virtualization@freebsd.org" X-Mailer: iPhone Mail (12A405) Sender: b4@mailer.gewt.net X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 21 Oct 2014 09:46:48 -0000 Sent from my iPhone > On Oct 21, 2014, at 00:59, John wrote: >=20 >> On Mon, Oct 20, 2014 at 05:55:13PM -0700, Neel Natu wrote: >>=20 >> It seems that you are booting the guest from the disk that was >> originally used with vbox. >=20 > Yes, this is what I want to do, because there's data on there. You can convert the image without data loss. Qemu-img and VBoxManage provide= a means to do as such. >=20 >> Do you have the same issue booting from an ubuntu ISO and doing a >> fresh install to disk in bhyve? >=20 > No, that seems to work. >=20 > cheers, > --=20 > John=20 > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@freeb= sd.org" From owner-freebsd-virtualization@FreeBSD.ORG Tue Oct 21 13:02:31 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 6F313F5F for ; Tue, 21 Oct 2014 13:02:31 +0000 (UTC) Received: from potato.growveg.org (potato.growveg.org [62.49.247.163]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 2811AA21 for ; Tue, 21 Oct 2014 13:02:30 +0000 (UTC) Received: from john by potato.growveg.org with local (Exim 4.84 (FreeBSD)) (envelope-from ) id 1XgZ4r-000LZt-Ff; Tue, 21 Oct 2014 14:02:17 +0100 Date: Tue, 21 Oct 2014 14:02:17 +0100 From: John To: Cory Smelosky Subject: Re: moving from virtualbox to bhyve Message-ID: <20141021130217.GA81912@potato.growveg.org> Reply-To: freebsd-virtualization@freebsd.org References: <20141020162043.GA66615@potato.growveg.org> <544538D6.80101@freebsd.org> <20141020170401.GB66615@potato.growveg.org> <20141021045910.GA68426@potato.growveg.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.23 (2014-03-12) Sender: John X-SA-Exim-Connect-IP: X-SA-Exim-Mail-From: john@potato.growveg.org X-SA-Exim-Scanned: No (on potato.growveg.org); SAEximRunCond expanded to false Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 21 Oct 2014 13:02:31 -0000 Hi, On Tue, Oct 21, 2014 at 05:11:07AM -0400, Cory Smelosky wrote: > You can convert the image without data loss. Qemu-img and > VBoxManage provide a means to do as such. I know, I had already converted it to raw. The question was, how do I launch it, but after some experimentation and reading, I *think* I may have sussed it out. So far, the instance boots and loads its services (it's a web server) but it's hanging halfway through the loading process, and I can't make it abort loading them with ctrl-c for example. cheers, -- John From owner-freebsd-virtualization@FreeBSD.ORG Tue Oct 21 18:26:43 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id BE8A39C9 for ; Tue, 21 Oct 2014 18:26:43 +0000 (UTC) Received: from h2.funkthat.com (gate2.funkthat.com [208.87.223.18]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "funkthat.com", Issuer "funkthat.com" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 85810339 for ; Tue, 21 Oct 2014 18:26:43 +0000 (UTC) Received: from h2.funkthat.com (localhost [127.0.0.1]) by h2.funkthat.com (8.14.3/8.14.3) with ESMTP id s9LIQfWQ066645 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO) for ; Tue, 21 Oct 2014 11:26:41 -0700 (PDT) (envelope-from jmg@h2.funkthat.com) Received: (from jmg@localhost) by h2.funkthat.com (8.14.3/8.14.3/Submit) id s9LIQfTh066644 for freebsd-virtualization@freebsd.org; Tue, 21 Oct 2014 11:26:41 -0700 (PDT) (envelope-from jmg) Date: Tue, 21 Oct 2014 11:26:41 -0700 From: John-Mark Gurney To: freebsd-virtualization@freebsd.org Subject: bhyvectl man page? Message-ID: <20141021182641.GQ82214@funkthat.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.4.2.3i X-Operating-System: FreeBSD 7.2-RELEASE i386 X-PGP-Fingerprint: 54BA 873B 6515 3F10 9E88 9322 9CB1 8F74 6D3F A396 X-Files: The truth is out there X-URL: http://resnet.uoregon.edu/~gurney_j/ X-Resume: http://resnet.uoregon.edu/~gurney_j/resume.html X-TipJar: bitcoin:13Qmb6AeTgQecazTWph4XasEsP7nGRbAPE X-to-the-FBI-CIA-and-NSA: HI! HOW YA DOIN? can i haz chizburger? X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.2.2 (h2.funkthat.com [127.0.0.1]); Tue, 21 Oct 2014 11:26:41 -0700 (PDT) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 21 Oct 2014 18:26:43 -0000 Can someone write a man page for this tool? I'm willing to do the formating if someone writes the text... Thanks. -- John-Mark Gurney Voice: +1 415 225 5579 "All that I will do, has been done, All that I have, has not." From owner-freebsd-virtualization@FreeBSD.ORG Tue Oct 21 18:50:08 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id A08871E5 for ; Tue, 21 Oct 2014 18:50:08 +0000 (UTC) Received: from h2.funkthat.com (gate2.funkthat.com [208.87.223.18]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "funkthat.com", Issuer "funkthat.com" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 6EB097CE for ; Tue, 21 Oct 2014 18:50:08 +0000 (UTC) Received: from h2.funkthat.com (localhost [127.0.0.1]) by h2.funkthat.com (8.14.3/8.14.3) with ESMTP id s9LIo7S2066878 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO) for ; Tue, 21 Oct 2014 11:50:07 -0700 (PDT) (envelope-from jmg@h2.funkthat.com) Received: (from jmg@localhost) by h2.funkthat.com (8.14.3/8.14.3/Submit) id s9LIo7TP066877 for freebsd-virtualization@freebsd.org; Tue, 21 Oct 2014 11:50:07 -0700 (PDT) (envelope-from jmg) Date: Tue, 21 Oct 2014 11:50:07 -0700 From: John-Mark Gurney To: freebsd-virtualization@freebsd.org Subject: testing bhyve on AMD box... Message-ID: <20141021185007.GR82214@funkthat.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.4.2.3i X-Operating-System: FreeBSD 7.2-RELEASE i386 X-PGP-Fingerprint: 54BA 873B 6515 3F10 9E88 9322 9CB1 8F74 6D3F A396 X-Files: The truth is out there X-URL: http://resnet.uoregon.edu/~gurney_j/ X-Resume: http://resnet.uoregon.edu/~gurney_j/resume.html X-TipJar: bitcoin:13Qmb6AeTgQecazTWph4XasEsP7nGRbAPE X-to-the-FBI-CIA-and-NSA: HI! HOW YA DOIN? can i haz chizburger? X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.2.2 (h2.funkthat.com [127.0.0.1]); Tue, 21 Oct 2014 11:50:07 -0700 (PDT) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 21 Oct 2014 18:50:08 -0000 So, I did, and it failed... First, if_tap doesn't get automatically loaded.. but that was easy to spot due to the error message... loader runs fine, but then after hitting enter, I get the following: /tmp/bhyve.4dv5wFK 91: [0008] FACS Address : 00000000000F27C0 Error 6154 - Integer too large for target ^ (00000000000F27C0) /tmp/bhyve.4dv5wFK 92: [0008] DSDT Address : 00000000000F2800 Error 6154 - Integer too large for target ^ (00000000000F2800) /tmp/bhyve.4dv5wFK 98: [0008] Address : 0000000000000400 Error 6154 - ^ Integer too large for target (0000000000000400) /tmp/bhyve.4dv5wFK 112: [0008] Address : 0000000000000404 Error 6154 - ^ Integer too large for target (0000000000000404) /tmp/bhyve.4dv5wFK 133: [0008] Address : 0000000000000408 Error 6154 - ^ Integer too large for target (0000000000000408) Assertion failed: (error == 0), function main, file /usr/src/usr.sbin/bhyve/bhyverun.c, line 864. Abort trap (core dumped) I had to reformat it since the terminal wasn't emitting CR's... This is from: FreeBSD carbon.funkthat.com 11.0-CURRENT FreeBSD 11.0-CURRENT #9: Tue Oct 21 10:55:05 PDT 2014 jmg@carbon.funkthat.com:/usr/home/jmg/freebsd.p4/opencrypto/sys/amd64/compile/GENERIC amd64 Though this is from my p4 project branch, it is fully synced w/ r273388... CPU: AMD A10-5700 APU with Radeon(tm) HD Graphics (3393.89-MHz K8-class CPU) Origin="AuthenticAMD" Id=0x610f01 Family=0x15 Model=0x10 Stepping=1 Features=0x178bfbff Features2=0x3e98320b AMD Features=0x2e500800 AMD Features2=0x1ebbfff Structured Extended Features=0x8 TSC: P-state invariant, performance statistics real memory = 8589934592 (8192 MB) avail memory = 7665848320 (7310 MB) I'm willing to test any patches you throw my way... -- John-Mark Gurney Voice: +1 415 225 5579 "All that I will do, has been done, All that I have, has not." From owner-freebsd-virtualization@FreeBSD.ORG Tue Oct 21 19:01:54 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 1C7D15D3 for ; Tue, 21 Oct 2014 19:01:54 +0000 (UTC) Received: from mail-qc0-x232.google.com (mail-qc0-x232.google.com [IPv6:2607:f8b0:400d:c01::232]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id D35EA980 for ; Tue, 21 Oct 2014 19:01:53 +0000 (UTC) Received: by mail-qc0-f178.google.com with SMTP id b13so133292qcw.9 for ; Tue, 21 Oct 2014 12:01:53 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=13+3KRgvP9i+hUDS3ADzKw9cdepgQuJ3407g4B+ZOjM=; b=rIAa2BhRl4b29WqnI4fMhOHytwFWUC/8Y4JS/7wto0mJNs4zxyhyAQScXWlA+C/XGl gLJ2JNgXoMqIBqP3x4Lwx9ij+l4fbsig5mvSAR3HjfJa6P7Ne6BOm8bta1klAS0HRSqu PUpzfpnrRloEd8bUgSMm2EKDm9bAmNw8TVlfty5vbYCSeOwawyh0qlVLAaYioxHoUX11 IuUmMNorM5hDFtTi0cBs1To84nFTmG78nnGFuPmW3Yx8LOhk6O64QME/MzrVdRC0UNOA cmSlWv+iw9459E9S4Uj/uIwCs91PuoiuPUMoGjIbNVh2iPh7OAcz7tPx2TxXCCqsOezl DYnQ== MIME-Version: 1.0 X-Received: by 10.224.24.131 with SMTP id v3mr34949220qab.81.1413918112850; Tue, 21 Oct 2014 12:01:52 -0700 (PDT) Received: by 10.140.85.83 with HTTP; Tue, 21 Oct 2014 12:01:52 -0700 (PDT) In-Reply-To: <20141021185007.GR82214@funkthat.com> References: <20141021185007.GR82214@funkthat.com> Date: Tue, 21 Oct 2014 12:01:52 -0700 Message-ID: Subject: Re: testing bhyve on AMD box... From: Neel Natu To: John-Mark Gurney Content-Type: text/plain; charset=UTF-8 Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 21 Oct 2014 19:01:54 -0000 Hi, On Tue, Oct 21, 2014 at 11:50 AM, John-Mark Gurney wrote: > So, I did, and it failed... > > First, if_tap doesn't get automatically loaded.. but that was easy to > spot due to the error message... loader runs fine, but then after > hitting enter, I get the following: > /tmp/bhyve.4dv5wFK 91: [0008] FACS Address : 00000000000F27C0 > Error 6154 - Integer too large for target ^ (00000000000F27C0) > > /tmp/bhyve.4dv5wFK 92: [0008] DSDT Address : 00000000000F2800 > Error 6154 - Integer too large for target ^ (00000000000F2800) > > /tmp/bhyve.4dv5wFK 98: [0008] Address : 0000000000000400 > Error 6154 - ^ Integer too large for target (0000000000000400) > > /tmp/bhyve.4dv5wFK 112: [0008] Address : 0000000000000404 > Error 6154 - ^ Integer too large for target (0000000000000404) > > /tmp/bhyve.4dv5wFK 133: [0008] Address : 0000000000000408 > Error 6154 - ^ Integer too large for target (0000000000000408) > > Assertion failed: (error == 0), function main, file /usr/src/usr.sbin/bhyve/bhyverun.c, line 864. > Abort trap (core dumped) > > I had to reformat it since the terminal wasn't emitting CR's... > > This is from: > FreeBSD carbon.funkthat.com 11.0-CURRENT FreeBSD 11.0-CURRENT #9: Tue Oct 21 10:55:05 PDT 2014 jmg@carbon.funkthat.com:/usr/home/jmg/freebsd.p4/opencrypto/sys/amd64/compile/GENERIC amd64 > > Though this is from my p4 project branch, it is fully synced w/ r273388... > > CPU: AMD A10-5700 APU with Radeon(tm) HD Graphics (3393.89-MHz K8-class CPU) > Origin="AuthenticAMD" Id=0x610f01 Family=0x15 Model=0x10 Stepping=1 > Features=0x178bfbff > Features2=0x3e98320b > AMD Features=0x2e500800 > AMD Features2=0x1ebbfff > Structured Extended Features=0x8 > TSC: P-state invariant, performance statistics > real memory = 8589934592 (8192 MB) > avail memory = 7665848320 (7310 MB) > > I'm willing to test any patches you throw my way... > What is the output of "iasl -v" on your system? This is what's on my AMD machine: [neel@a ~/head]$ iasl -v Intel ACPI Component Architecture ASL Optimizing Compiler version 20140926-64 Copyright (c) 2000 - 2014 Intel Corporation best Neel > -- > John-Mark Gurney Voice: +1 415 225 5579 > > "All that I will do, has been done, All that I have, has not." > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@freebsd.org" From owner-freebsd-virtualization@FreeBSD.ORG Tue Oct 21 20:55:28 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 03E0FFFC for ; Tue, 21 Oct 2014 20:55:28 +0000 (UTC) Received: from mail-qc0-x229.google.com (mail-qc0-x229.google.com [IPv6:2607:f8b0:400d:c01::229]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id BA31B806 for ; Tue, 21 Oct 2014 20:55:27 +0000 (UTC) Received: by mail-qc0-f169.google.com with SMTP id o8so1654308qcw.28 for ; Tue, 21 Oct 2014 13:55:26 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=BevfodHt+CbASoyin8THTNCS8FjqORVZl3+mEPDkHC0=; b=ZDeMr53NYPJ+M0FcQOQBioBlpL46WZ0lnJcVOHULYskJXN+e0n/UWVhVGDdmTY4sRz byNZVX81UCyqamS67NQ7/vJoKlILgx4WG5d9IMlUhQwgP8CdjhvwfyXXCQN9d+3dItow JbfJrVpKI3xPcvmog1hVNF/oVT7DqJbkRA6xul6mNvnzZcIBzr/RQrVEIeylPEsEBPoG geI6oQ0Z5IJBwGNd1vPFuto9oBZqpb7CybDhJ+PBIFY1zxrQ4EvlhC3h4tGP9y0tVICD xQZqiGdrxt6jJ+9tHkjh9bBJSEYS/rXt6/ijszk+egzjRpImrjtVtzjUWMv+6+BACZwV fr8g== MIME-Version: 1.0 X-Received: by 10.229.65.2 with SMTP id g2mr49543825qci.1.1413924926158; Tue, 21 Oct 2014 13:55:26 -0700 (PDT) Received: by 10.140.85.83 with HTTP; Tue, 21 Oct 2014 13:55:26 -0700 (PDT) In-Reply-To: <20141021045910.GA68426@potato.growveg.org> References: <20141020162043.GA66615@potato.growveg.org> <544538D6.80101@freebsd.org> <20141020170401.GB66615@potato.growveg.org> <20141021045910.GA68426@potato.growveg.org> Date: Tue, 21 Oct 2014 13:55:26 -0700 Message-ID: Subject: Re: moving from virtualbox to bhyve From: Neel Natu To: "freebsd-virtualization@freebsd.org" Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 21 Oct 2014 20:55:28 -0000 Hi John, On Mon, Oct 20, 2014 at 9:59 PM, John wrote: > On Mon, Oct 20, 2014 at 05:55:13PM -0700, Neel Natu wrote: > >> It seems that you are booting the guest from the disk that was >> originally used with vbox. > > Yes, this is what I want to do, because there's data on there. > If you are comfortable sharing your disk image then I can try to reproduce locally and hopefully get a better grip on what's happening. best Neel >> Do you have the same issue booting from an ubuntu ISO and doing a >> fresh install to disk in bhyve? > > No, that seems to work. > > cheers, > -- > John From owner-freebsd-virtualization@FreeBSD.ORG Tue Oct 21 21:19:40 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 1901F338 for ; Tue, 21 Oct 2014 21:19:40 +0000 (UTC) Received: from h2.funkthat.com (gate2.funkthat.com [208.87.223.18]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "funkthat.com", Issuer "funkthat.com" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id EBD5BD55 for ; Tue, 21 Oct 2014 21:19:39 +0000 (UTC) Received: from h2.funkthat.com (localhost [127.0.0.1]) by h2.funkthat.com (8.14.3/8.14.3) with ESMTP id s9LLJcBj068749 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Tue, 21 Oct 2014 14:19:38 -0700 (PDT) (envelope-from jmg@h2.funkthat.com) Received: (from jmg@localhost) by h2.funkthat.com (8.14.3/8.14.3/Submit) id s9LLJcFc068748; Tue, 21 Oct 2014 14:19:38 -0700 (PDT) (envelope-from jmg) Date: Tue, 21 Oct 2014 14:19:38 -0700 From: John-Mark Gurney To: Neel Natu Subject: Re: testing bhyve on AMD box... Message-ID: <20141021211938.GU82214@funkthat.com> References: <20141021185007.GR82214@funkthat.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.4.2.3i X-Operating-System: FreeBSD 7.2-RELEASE i386 X-PGP-Fingerprint: 54BA 873B 6515 3F10 9E88 9322 9CB1 8F74 6D3F A396 X-Files: The truth is out there X-URL: http://resnet.uoregon.edu/~gurney_j/ X-Resume: http://resnet.uoregon.edu/~gurney_j/resume.html X-TipJar: bitcoin:13Qmb6AeTgQecazTWph4XasEsP7nGRbAPE X-to-the-FBI-CIA-and-NSA: HI! HOW YA DOIN? can i haz chizburger? X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.2.2 (h2.funkthat.com [127.0.0.1]); Tue, 21 Oct 2014 14:19:38 -0700 (PDT) Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 21 Oct 2014 21:19:40 -0000 Neel Natu wrote this message on Tue, Oct 21, 2014 at 12:01 -0700: > On Tue, Oct 21, 2014 at 11:50 AM, John-Mark Gurney wrote: > > So, I did, and it failed... > > > > First, if_tap doesn't get automatically loaded.. but that was easy to > > spot due to the error message... loader runs fine, but then after > > hitting enter, I get the following: > > /tmp/bhyve.4dv5wFK 91: [0008] FACS Address : 00000000000F27C0 > > Error 6154 - Integer too large for target ^ (00000000000F27C0) > > > > /tmp/bhyve.4dv5wFK 92: [0008] DSDT Address : 00000000000F2800 > > Error 6154 - Integer too large for target ^ (00000000000F2800) > > > > /tmp/bhyve.4dv5wFK 98: [0008] Address : 0000000000000400 > > Error 6154 - ^ Integer too large for target (0000000000000400) > > > > /tmp/bhyve.4dv5wFK 112: [0008] Address : 0000000000000404 > > Error 6154 - ^ Integer too large for target (0000000000000404) > > > > /tmp/bhyve.4dv5wFK 133: [0008] Address : 0000000000000408 > > Error 6154 - ^ Integer too large for target (0000000000000408) > > > > Assertion failed: (error == 0), function main, file /usr/src/usr.sbin/bhyve/bhyverun.c, line 864. > > Abort trap (core dumped) > > > > I had to reformat it since the terminal wasn't emitting CR's... > > > > This is from: > > FreeBSD carbon.funkthat.com 11.0-CURRENT FreeBSD 11.0-CURRENT #9: Tue Oct 21 10:55:05 PDT 2014 jmg@carbon.funkthat.com:/usr/home/jmg/freebsd.p4/opencrypto/sys/amd64/compile/GENERIC amd64 > > > > Though this is from my p4 project branch, it is fully synced w/ r273388... > > > > CPU: AMD A10-5700 APU with Radeon(tm) HD Graphics (3393.89-MHz K8-class CPU) > > Origin="AuthenticAMD" Id=0x610f01 Family=0x15 Model=0x10 Stepping=1 > > Features=0x178bfbff > > Features2=0x3e98320b > > AMD Features=0x2e500800 > > AMD Features2=0x1ebbfff > > Structured Extended Features=0x8 > > TSC: P-state invariant, performance statistics > > real memory = 8589934592 (8192 MB) > > avail memory = 7665848320 (7310 MB) > > > > I'm willing to test any patches you throw my way... > > > > What is the output of "iasl -v" on your system? > > This is what's on my AMD machine: > > [neel@a ~/head]$ iasl -v > > Intel ACPI Component Architecture > ASL Optimizing Compiler version 20140926-64 > Copyright (c) 2000 - 2014 Intel Corporation $ iasl -v Intel ACPI Component Architecture ASL Optimizing Compiler version 20130823-64 Copyright (c) 2000 - 2013 Intel Corporation Sorry, I was so excited to try it out that I didn't do a buildworld... I'll do one now, since I'm still getting a failure after updating to a current iasl: Assertion failed: (CPU_ISSET(vcpu, &active_cpus)), function vm_loop, file /usr/src/usr.sbin/bhyve/bhyverun.c, line 597. Abort trap (core dumped) I'll report back success or failure after buildworld/installworld/reboot is complete... -- John-Mark Gurney Voice: +1 415 225 5579 "All that I will do, has been done, All that I have, has not." From owner-freebsd-virtualization@FreeBSD.ORG Tue Oct 21 23:59:51 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 95049C50 for ; Tue, 21 Oct 2014 23:59:51 +0000 (UTC) Received: from potato.growveg.org (potato.growveg.org [62.49.247.163]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4CD0716C for ; Tue, 21 Oct 2014 23:59:51 +0000 (UTC) Received: from john by potato.growveg.org with local (Exim 4.84 (FreeBSD)) (envelope-from ) id 1XgjKt-000MSi-Ql for freebsd-virtualization@freebsd.org; Wed, 22 Oct 2014 00:59:31 +0100 Date: Wed, 22 Oct 2014 00:59:31 +0100 From: John To: freebsd-virtualization@freebsd.org Subject: Re: moving from virtualbox to bhyve - SOLVED Message-ID: <20141021235931.GA85315@potato.growveg.org> Reply-To: freebsd-virtualization@freebsd.org References: <20141020162043.GA66615@potato.growveg.org> <544538D6.80101@freebsd.org> <20141020170401.GB66615@potato.growveg.org> <20141021045910.GA68426@potato.growveg.org> <20141021130217.GA81912@potato.growveg.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20141021130217.GA81912@potato.growveg.org> User-Agent: Mutt/1.5.23 (2014-03-12) Sender: John X-SA-Exim-Connect-IP: X-SA-Exim-Mail-From: john@potato.growveg.org X-SA-Exim-Scanned: No (on potato.growveg.org); SAEximRunCond expanded to false X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 21 Oct 2014 23:59:51 -0000 On Tue, Oct 21, 2014 at 02:02:17PM +0100, John wrote: > Hi, > > On Tue, Oct 21, 2014 at 05:11:07AM -0400, Cory Smelosky wrote: > > > You can convert the image without data loss. Qemu-img and > > VBoxManage provide a means to do as such. > > I know, I had already converted it to raw. The question was, > how do I launch it, but after some experimentation and reading, > I *think* I may have sussed it out. So far, the instance boots > and loads its services (it's a web server) but it's hanging halfway > through the loading process, and I can't make it abort loading them > with ctrl-c for example. I was so busy waiting for the login screen from the console that I'd failed to notice it *HAD* actually booted. I found this out by trying to ssh to it for the hell of it. dmesg showed things were normal. My console, though, looks like this: http://tinyurl.com/q4a3t4e The ubuntu is 13.10 with security patches. cheers -- John From owner-freebsd-virtualization@FreeBSD.ORG Wed Oct 22 00:20:27 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id ACF691AD for ; Wed, 22 Oct 2014 00:20:27 +0000 (UTC) Received: from potato.growveg.org (potato.growveg.org [62.49.247.163]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 654B2604 for ; Wed, 22 Oct 2014 00:20:27 +0000 (UTC) Received: from john by potato.growveg.org with local (Exim 4.84 (FreeBSD)) (envelope-from ) id 1Xgjew-000MTg-1m; Wed, 22 Oct 2014 01:20:14 +0100 Date: Wed, 22 Oct 2014 01:20:14 +0100 From: John To: Neel Natu Subject: Re: moving from virtualbox to bhyve - SOLVED Message-ID: <20141022002014.GB85315@potato.growveg.org> Reply-To: freebsd-virtualization@freebsd.org References: <20141020162043.GA66615@potato.growveg.org> <544538D6.80101@freebsd.org> <20141020170401.GB66615@potato.growveg.org> <20141021045910.GA68426@potato.growveg.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.23 (2014-03-12) Sender: John X-SA-Exim-Connect-IP: X-SA-Exim-Mail-From: john@potato.growveg.org X-SA-Exim-Scanned: No (on potato.growveg.org); SAEximRunCond expanded to false Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 Oct 2014 00:20:27 -0000 On Tue, Oct 21, 2014 at 01:55:26PM -0700, Neel Natu wrote: > If you are comfortable sharing your disk image then I can try to > reproduce locally and hopefully get a better grip on what's happening. That's very nice of you to offer, but I have to decline as I don't own the data. I think I might have sorted it in any case. I was thrown by the login prompt not appearing in the console. Really pleased with the performance of ubuntu on bhyve. It doesn't impact much on the host either. -- John From owner-freebsd-virtualization@FreeBSD.ORG Wed Oct 22 00:21:03 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 15A7E1F0 for ; Wed, 22 Oct 2014 00:21:03 +0000 (UTC) Received: from mailer.gewt.net (mailer.gewt.net [198.27.113.113]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id E0DB8608 for ; Wed, 22 Oct 2014 00:21:02 +0000 (UTC) Received: from cpe-65-24-235-132.insight.res.rr.com ([65.24.235.132] helo=meaghan.gimme-sympathy.org) by mailer.gewt.net with esmtpsa (TLSv1.2:DHE-RSA-AES256-GCM-SHA384:256) (Exim 4.82 (FreeBSD)) (envelope-from ) id 1Xgjf8-000Axe-DK for freebsd-virtualization@freebsd.org; Tue, 21 Oct 2014 20:20:26 -0400 Date: Tue, 21 Oct 2014 20:20:25 -0400 (EDT) From: Cory Smelosky X-X-Sender: csmelosky@meaghan.gimme-sympathy.org To: freebsd-virtualization@freebsd.org Subject: Re: moving from virtualbox to bhyve - SOLVED In-Reply-To: <20141021235931.GA85315@potato.growveg.org> Message-ID: References: <20141020162043.GA66615@potato.growveg.org> <544538D6.80101@freebsd.org> <20141020170401.GB66615@potato.growveg.org> <20141021045910.GA68426@potato.growveg.org> <20141021130217.GA81912@potato.growveg.org> <20141021235931.GA85315@potato.growveg.org> User-Agent: Alpine 2.11 (DFB 23 2013-08-11) MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Sender: b4@mailer.gewt.net X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 Oct 2014 00:21:03 -0000 On Wed, 22 Oct 2014, John wrote: >> with ctrl-c for example. > > I was so busy waiting for the login screen from the console that I'd failed > to notice it *HAD* actually booted. I found this out by trying > to ssh to it for the hell of it. dmesg showed things were normal. > My console, though, looks like this: http://tinyurl.com/q4a3t4e > The ubuntu is 13.10 with security patches. > I am unsure as to what the console device should be for bhyve, but that's likely what your problem is. Getty or systemd or whatever it is now is probably not launching a console on the correct device? > cheers > -- Cory Smelosky http://gewt.net Personal stuff http://gimme-sympathy.org Projects From owner-freebsd-virtualization@FreeBSD.ORG Wed Oct 22 00:41:53 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 28B635B5 for ; Wed, 22 Oct 2014 00:41:53 +0000 (UTC) Received: from mail-wg0-x22f.google.com (mail-wg0-x22f.google.com [IPv6:2a00:1450:400c:c00::22f]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id B97967A9 for ; Wed, 22 Oct 2014 00:41:52 +0000 (UTC) Received: by mail-wg0-f47.google.com with SMTP id x13so2524164wgg.30 for ; Tue, 21 Oct 2014 17:41:50 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=3TrslJE2re/IqVUEkiWlHJTrvZVGod4OF7TEFokm8QY=; b=LBOH83NMwY9FfcR17jBpaQrMkIKfJXUCuLF3If+wfM6wUWBfrK1LGRHyinr+qvxu08 8Zl+1ZE4yUT6SzGd3cxdJto9RQXXKiZzDSwLJ0ix2rinEfDnbJkN/3DcftlAVdS7rE5R ISaaTVDoWcqCgqqx/PDiGp9l2qWNTSbYWJe+6QBrhVXq7zw6pEk/58X88lTuBrHKQpO6 7A2GHXrFoc/uy/HOgb9zxDogrgQTYhjkxd350EL1/qFpwQohOF8+bUNkNB3t6wDJFIuR SIHlUeY1YIxw2o5azFPiRu/QfQlqfzatOeTvw3k8wMNnSQ/N0AifNT5lGJUOfpivVbb4 4PTQ== MIME-Version: 1.0 X-Received: by 10.181.27.135 with SMTP id jg7mr1702817wid.56.1413938510911; Tue, 21 Oct 2014 17:41:50 -0700 (PDT) Received: by 10.195.10.138 with HTTP; Tue, 21 Oct 2014 17:41:50 -0700 (PDT) Date: Tue, 21 Oct 2014 17:41:50 -0700 Message-ID: Subject: Adding support for launching linux VMs in libvirtd/bhvye From: Jonathan Wong To: freebsd-virtualization@freebsd.org Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 Oct 2014 00:41:53 -0000 Hi- I'm looking at libvirt in the ports tree and I noticed that bhyvectl has been added into libvirt. I'd like to add grub-bhyve to be able to load linux VMs as I currently can do manually or with the VMRC scripts. Any pointers on which files to look at and modify would be great. Thanks, Jonathan From owner-freebsd-virtualization@FreeBSD.ORG Wed Oct 22 00:57:03 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 1E8AF67B for ; Wed, 22 Oct 2014 00:57:03 +0000 (UTC) Received: from mail-la0-x236.google.com (mail-la0-x236.google.com [IPv6:2a00:1450:4010:c03::236]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 9927C907 for ; Wed, 22 Oct 2014 00:57:02 +0000 (UTC) Received: by mail-la0-f54.google.com with SMTP id gm9so2027143lab.41 for ; Tue, 21 Oct 2014 17:57:00 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type; bh=IfNiiLnBvv1YrAkW747vVyIUuJBaJ7gB/XKyXj8HLss=; b=SFO4CWcUCW9bpmQAapHqXK2ct+s+TmF9Ftd3rqLGtn1/ADJS4j7XNEiy3FYcZxi3Uw 0kDiC6JYkWIhFZfkx8kaeuAPdu10pvJAdouex1J6aO6pGBIXAjKDpG6z+f0ddnx3Km3p 8w/g4bszGwcokDm+BMH+6x8ivDWDueFCO9wCXK6WllLybY35aqbKF44KEAXgw5Wkx59w r0Q/2oeMhY7JfESM1VCE8VS3PP6h/JBYRP+QyOrMCcmYFnHJDJn2GqT+yQDEAnQuxKii 9S4oaD2v71+c3yRVjlBBhdgCSTGYbE6Jax0yXNjpkfEQGQBgu4IsUqXcT9JqjZQ+uAei 6nfA== MIME-Version: 1.0 X-Received: by 10.112.73.37 with SMTP id i5mr2667610lbv.83.1413939420319; Tue, 21 Oct 2014 17:57:00 -0700 (PDT) Sender: crodr001@gmail.com Received: by 10.112.131.66 with HTTP; Tue, 21 Oct 2014 17:57:00 -0700 (PDT) In-Reply-To: References: Date: Tue, 21 Oct 2014 17:57:00 -0700 X-Google-Sender-Auth: xIgSV-OHM8k0GwmwUT5AIDF9sKo Message-ID: Subject: Re: Adding support for launching linux VMs in libvirtd/bhvye From: Craig Rodrigues To: Jonathan Wong Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 Oct 2014 00:57:03 -0000 On Tue, Oct 21, 2014 at 5:41 PM, Jonathan Wong wrote: > Hi- > > I'm looking at libvirt in the ports tree and I noticed that bhyvectl has > been added into libvirt. I'd like to add grub-bhyve to be able to load > linux VMs as I currently can do manually or with the VMRC scripts. > > Any pointers on which files to look at and modify would be great. > > Take a look at this discussion: https://lists.freebsd.org/pipermail/freebsd-virtualization/2014-October/002857.html We covered some of the topics you mentioned in that thread. If you want to hack on the libvirt code, you need to get it from a git repository on libvirt.org, see: http://libvirt.org/downloads.html Roman Bogorodskiy has been very good about pushing bhyve enhancements directly to the libvirt maintainers via git. We need more people working on libvirt for bhyve, so any help you can provide would be great. -- Craig From owner-freebsd-virtualization@FreeBSD.ORG Wed Oct 22 01:07:11 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id D7B4E9FB for ; Wed, 22 Oct 2014 01:07:11 +0000 (UTC) Received: from mail-ig0-x236.google.com (mail-ig0-x236.google.com [IPv6:2607:f8b0:4001:c05::236]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 9FA85A00 for ; Wed, 22 Oct 2014 01:07:11 +0000 (UTC) Received: by mail-ig0-f182.google.com with SMTP id hn18so1991igb.15 for ; Tue, 21 Oct 2014 18:07:11 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=content-type:mime-version:content-transfer-encoding:message-id:date :subject:from:in-reply-to:references:to; bh=AH5E3eFlj+GsITudZ3XTNllS3dDt8PczIeJF83N3Iuc=; b=Q1cKU9P5ZG5xlkXalgvKSNR4xf0TCHrP4YoEpNlJQFwWLwmJzcFHAuOAVYvsLNGHRZ QBWnucsmqX5+v/dzRvdRWcHoSYuW5p/HiCnuPbrUQ+zGrI34T/nsAWyw2MBpGlzNqp3D Zt1Sj5XcYkLhhJmtlYO1D7crMVNoe0gMFOW+ykQuELojClmvXgBKoA/AZJ+ioUpKj1E7 JobCkeRfXDdcE0kZmRaKk+Tipr0BzPz9r66U/gR9fRCszAS7K/1usc9DjllnDLEY79Od 2Jx3eyEpTe6d90p190NbcV9MoeqwBsQr7xnm9l0rhSkwoweXNsj2BCvRlT8kZ4NPa7V3 p7AQ== X-Received: by 10.50.79.193 with SMTP id l1mr1939432igx.10.1413940030987; Tue, 21 Oct 2014 18:07:10 -0700 (PDT) Received: from [127.0.0.1] ([66.11.161.139]) by mx.google.com with ESMTPSA id v133sm6897779ioe.18.2014.10.21.18.07.09 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Tue, 21 Oct 2014 18:07:09 -0700 (PDT) Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable X-Mailer: BlackBerry Email (10.2.1.2141) Message-ID: <20141022010709.36446387.85535.1969@gmail.com> Date: Tue, 21 Oct 2014 21:07:09 -0400 Subject: Re: moving from virtualbox to bhyve - SOLVED From: Manas In-Reply-To: References: <20141020162043.GA66615@potato.growveg.org> <544538D6.80101@freebsd.org> <20141020170401.GB66615@potato.growveg.org> <20141021045910.GA68426@potato.growveg.org> <20141021130217.GA81912@potato.growveg.org> <20141021235931.GA85315@potato.growveg.org> To: freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 Oct 2014 01:07:11 -0000 I have experienced something similar on a Gentoo guest. It boots fine but I= don't get a login prompt at the end of the boot process. I am interested i= n learning a solution to this. I have a 14.04.1 Ubuntu guest=E2=80=8E and a= Debian guest (latest version) that work fine and present me with a login p= rompt. Manas On BlackBerry =C2=A0 Original Message =C2=A0 From: Cory Smelosky Sent: Tuesday, October 21, 2014 8:21 PM To: freebsd-virtualization@freebsd.org Subject: Re: moving from virtualbox to bhyve - SOLVED On Wed, 22 Oct 2014, John wrote: >> with ctrl-c for example. > > I was so busy waiting for the login screen from the console that I'd fail= ed > to notice it *HAD* actually booted. I found this out by trying > to ssh to it for the hell of it. dmesg showed things were normal. > My console, though, looks like this: http://tinyurl.com/q4a3t4e > The ubuntu is 13.10 with security patches. > I am unsure as to what the console device should be for bhyve, but that's=20 likely what your problem is. Getty or systemd or whatever it is now is=20 probably not launching a console on the correct device? > cheers > --=20 Cory Smelosky http://gewt.net Personal stuff http://gimme-sympathy.org Projects _______________________________________________ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@freebs= d.org" From owner-freebsd-virtualization@FreeBSD.ORG Wed Oct 22 01:08:41 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 6D052A45 for ; Wed, 22 Oct 2014 01:08:41 +0000 (UTC) Received: from mx1.scaleengine.net (beauharnois2.bhs1.scaleengine.net [142.4.218.15]) by mx1.freebsd.org (Postfix) with ESMTP id 29F65A07 for ; Wed, 22 Oct 2014 01:08:40 +0000 (UTC) Received: from [192.168.1.2] (Seawolf.HML3.ScaleEngine.net [209.51.186.28]) (Authenticated sender: allanjude.freebsd@scaleengine.com) by mx1.scaleengine.net (Postfix) with ESMTPSA id E533162C14 for ; Wed, 22 Oct 2014 01:08:39 +0000 (UTC) Message-ID: <5447039A.2020303@freebsd.org> Date: Tue, 21 Oct 2014 21:08:42 -0400 From: Allan Jude User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:31.0) Gecko/20100101 Thunderbird/31.2.0 MIME-Version: 1.0 To: freebsd-virtualization@freebsd.org Subject: Re: moving from virtualbox to bhyve - SOLVED References: <20141020162043.GA66615@potato.growveg.org> <544538D6.80101@freebsd.org> <20141020170401.GB66615@potato.growveg.org> <20141021045910.GA68426@potato.growveg.org> <20141021130217.GA81912@potato.growveg.org> <20141021235931.GA85315@potato.growveg.org> <20141022010709.36446387.85535.1969@gmail.com> In-Reply-To: <20141022010709.36446387.85535.1969@gmail.com> Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="H5TjSgAA4Qs6bQE38GR9vEwH1f2v9jal4" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 Oct 2014 01:08:41 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --H5TjSgAA4Qs6bQE38GR9vEwH1f2v9jal4 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable On 2014-10-21 21:07, Manas wrote: > I have experienced something similar on a Gentoo guest. It boots fine b= ut I don't get a login prompt at the end of the boot process. I am intere= sted in learning a solution to this. I have a 14.04.1 Ubuntu guest=E2=80=8E= and a Debian guest (latest version) that work fine and present me with a= login prompt. >=20 > Manas > On BlackBerry > Original Message =20 > From: Cory Smelosky > Sent: Tuesday, October 21, 2014 8:21 PM > To: freebsd-virtualization@freebsd.org > Subject: Re: moving from virtualbox to bhyve - SOLVED >=20 > On Wed, 22 Oct 2014, John wrote: >=20 >>> with ctrl-c for example. >> >> I was so busy waiting for the login screen from the console that I'd f= ailed >> to notice it *HAD* actually booted. I found this out by trying >> to ssh to it for the hell of it. dmesg showed things were normal. >> My console, though, looks like this: http://tinyurl.com/q4a3t4e >> The ubuntu is 13.10 with security patches. >> >=20 > I am unsure as to what the console device should be for bhyve, but that= 's=20 > likely what your problem is. Getty or systemd or whatever it is now is = > probably not launching a console on the correct device? >=20 >> cheers >> >=20 Just like when the same thing happens on FreeBSD, the issue is that the console output is not being directed to the serial port. You must configure the OS as if it was running on a machine with no video card, only a serial port. --=20 Allan Jude --H5TjSgAA4Qs6bQE38GR9vEwH1f2v9jal4 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.22 (MingW32) iQIcBAEBAgAGBQJURwOdAAoJEJrBFpNRJZKfUHcQAKFCzIJVaQb1oPmb1MAAXiQN 6QhlFZX/qTNtsGn/Pu3+q18PDUbtELqECK+dr/iMh7mRVbCKCuwL2k7jr+IND6u1 u17IVemgg3t7/EhquF/Vytr79CHRVw1G4HRjkV0AEG+cput8mqm87AANqzy8N/WZ 2O8aoCFqgcrvcdk4KScN67vA2Rrh+FpEXJHJSDdLHu9fAgz33In+vvLq+HPLnlkO TPNAyO4ufBMJZ9Ytozf/FijAn9o/GNlKa24kfSNhj9Oan7+X4s+dwntATPa8nCym t58LtmbViQop4Gnj6vMpaEGKCWewQz+UKm8udmRRS+uwi1DVh48msAZVPP5neh7U Rfg/ZLQHYNtC4Cl2RIhhtGYrD8PiWDevaOiUIltB/l17GWO39XG4n0WCPTAsfbdF 1LzDG9Fdbo4CULIv0ok2DnJ5xpUZ+taf+1i2SEl8mvaVlUK3KSAKL5sh6cw4xeul JCiZbkS/Pu0qYP8tVZydW6t96FBca7ZCMU2qRbFLIaYV6UKPkT1ON3oWfgnmMVpj xySDNCm68d5IYVw6/V2yJzWr+O6mcizdOxlUIv81ufWNUkQDJ34BMyjSSOnQ3c7Q 9EtWzCUHFOmRA0xwx++TdbEq44DZAfC0F3JE1aiO+8XAAw4+cjC0VP9NZ4ZKU8jh JIsIwvA7khkpz8QEAnrM =dsx0 -----END PGP SIGNATURE----- --H5TjSgAA4Qs6bQE38GR9vEwH1f2v9jal4-- From owner-freebsd-virtualization@FreeBSD.ORG Wed Oct 22 01:11:52 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 4A0D0BDA for ; Wed, 22 Oct 2014 01:11:52 +0000 (UTC) Received: from alto.onthenet.com.au (alto.OntheNet.com.au [203.13.68.12]) by mx1.freebsd.org (Postfix) with ESMTP id 0751AAA1 for ; Wed, 22 Oct 2014 01:11:51 +0000 (UTC) Received: from dommail.onthenet.com.au (dommail.OntheNet.com.au [203.13.70.57]) by alto.onthenet.com.au (Postfix) with ESMTP id 8731C12599; Wed, 22 Oct 2014 11:11:49 +1000 (EST) Received: from Peters-MacBook-Pro.local (c-67-161-27-37.hsd1.ca.comcast.net [67.161.27.37]) by dommail.onthenet.com.au (MOS 4.4.4-GA) with ESMTP id BZD80612 (AUTH peterg@ptree32.com.au); Wed, 22 Oct 2014 11:11:48 +1000 Message-ID: <54470452.6080504@freebsd.org> Date: Tue, 21 Oct 2014 18:11:46 -0700 From: Peter Grehan User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:24.0) Gecko/20100101 Thunderbird/24.6.0 MIME-Version: 1.0 To: Manas Subject: Re: moving from virtualbox to bhyve - SOLVED References: <20141020162043.GA66615@potato.growveg.org> <544538D6.80101@freebsd.org> <20141020170401.GB66615@potato.growveg.org> <20141021045910.GA68426@potato.growveg.org> <20141021130217.GA81912@potato.growveg.org> <20141021235931.GA85315@potato.growveg.org> <20141022010709.36446387.85535.1969@gmail.com> In-Reply-To: <20141022010709.36446387.85535.1969@gmail.com> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit Cc: freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 Oct 2014 01:11:52 -0000 Hi Manas, > I have experienced something similar on a Gentoo guest. It boots fine > but I don't get a login prompt at the end of the boot process. I am > interested in learning a solution to this. I have a 14.04.1 Ubuntu > guest‎ and a Debian guest (latest version) that work fine and present > me with a login prompt. This is most likely a graphically-oriented distro that doesn't have an install process that can run on a serial console. I've seen that same with Fedora ISOs. Server distros are your best bet for bhyve, at least until VGA emulation is done. later, Peter. From owner-freebsd-virtualization@FreeBSD.ORG Wed Oct 22 01:16:02 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 98E09CC4 for ; Wed, 22 Oct 2014 01:16:02 +0000 (UTC) Received: from alto.onthenet.com.au (alto.OntheNet.com.au [203.13.68.12]) by mx1.freebsd.org (Postfix) with ESMTP id 57A30ABC for ; Wed, 22 Oct 2014 01:16:02 +0000 (UTC) Received: from dommail.onthenet.com.au (dommail.OntheNet.com.au [203.13.70.57]) by alto.onthenet.com.au (Postfix) with ESMTP id BC2AF123CF for ; Wed, 22 Oct 2014 11:16:01 +1000 (EST) Received: from Peters-MacBook-Pro.local (c-67-161-27-37.hsd1.ca.comcast.net [67.161.27.37]) by dommail.onthenet.com.au (MOS 4.4.4-GA) with ESMTP id BZD80907 (AUTH peterg@ptree32.com.au); Wed, 22 Oct 2014 11:16:00 +1000 Message-ID: <5447054E.9000709@freebsd.org> Date: Tue, 21 Oct 2014 18:15:58 -0700 From: Peter Grehan User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:24.0) Gecko/20100101 Thunderbird/24.6.0 MIME-Version: 1.0 To: freebsd-virtualization@freebsd.org Subject: Re: moving from virtualbox to bhyve - SOLVED References: <20141020162043.GA66615@potato.growveg.org> <544538D6.80101@freebsd.org> <20141020170401.GB66615@potato.growveg.org> <20141021045910.GA68426@potato.growveg.org> <20141021130217.GA81912@potato.growveg.org> <20141021235931.GA85315@potato.growveg.org> In-Reply-To: <20141021235931.GA85315@potato.growveg.org> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 Oct 2014 01:16:02 -0000 Hi John, > I was so busy waiting for the login screen from the console that I'd failed > to notice it *HAD* actually booted. I found this out by trying > to ssh to it for the hell of it. dmesg showed things were normal. > My console, though, looks like this: http://tinyurl.com/q4a3t4e > The ubuntu is 13.10 with security patches. I think what happened is that the grub config file was setting up Ubuntu for a graphical console on the original VBox VM. grub-bhyve will auto-insert a "console=ttyS0" at the start of the kernel command-line, but any loater "console=" option will override this. You may have to edit your grub.conf and remove any "console=" options. There may be some additional steps that are required to enable a getty on the serial port - that tends to be distro-specific and I'm not sure what is required (if anything) for Ubuntu. later, Peter. From owner-freebsd-virtualization@FreeBSD.ORG Wed Oct 22 07:53:30 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 63EBAFB2; Wed, 22 Oct 2014 07:53:30 +0000 (UTC) Received: from potato.growveg.org (potato.growveg.org [62.49.247.163]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 1C342606; Wed, 22 Oct 2014 07:53:29 +0000 (UTC) Received: from john by potato.growveg.org with local (Exim 4.84 (FreeBSD)) (envelope-from ) id 1XgqjL-000Pyi-Fb; Wed, 22 Oct 2014 08:53:15 +0100 Date: Wed, 22 Oct 2014 08:53:15 +0100 From: John To: Peter Grehan Subject: Re: moving from virtualbox to bhyve - SOLVED Message-ID: <20141022075315.GC85315@potato.growveg.org> Reply-To: freebsd-virtualization@freebsd.org References: <20141020162043.GA66615@potato.growveg.org> <544538D6.80101@freebsd.org> <20141020170401.GB66615@potato.growveg.org> <20141021045910.GA68426@potato.growveg.org> <20141021130217.GA81912@potato.growveg.org> <20141021235931.GA85315@potato.growveg.org> <5447054E.9000709@freebsd.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <5447054E.9000709@freebsd.org> User-Agent: Mutt/1.5.23 (2014-03-12) Sender: John X-SA-Exim-Connect-IP: X-SA-Exim-Mail-From: john@potato.growveg.org X-SA-Exim-Scanned: No (on potato.growveg.org); SAEximRunCond expanded to false Cc: freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 Oct 2014 07:53:30 -0000 Hi, On Tue, Oct 21, 2014 at 06:15:58PM -0700, Peter Grehan wrote: > Hi John, > > I think what happened is that the grub config file was setting up > Ubuntu for a graphical console on the original VBox VM. I think you might be right. I'll check to see if there's a way to tell. I can't remember if there was. It was very ad-hoc when I installed it. I know when it was installed to vbox I was exporting a term over ssh. vbox has this ILO emulation and that was used at first. Then I used the command line utilities on the host for managing and restarting the VM, and ssh to access the vm itself. ISTR in the emulation that it emulated a text console though. It's the server version of ubuntu rather than the desktop version. I remember having difficulties with character repitition over the emulated console. Having said all that, it would be weird if a server install defaulted to graphics mode on bootup! I guess stranger things have happened... -- John From owner-freebsd-virtualization@FreeBSD.ORG Wed Oct 22 14:09:49 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 1E00CCDA for ; Wed, 22 Oct 2014 14:09:49 +0000 (UTC) Received: from potato.growveg.org (potato.growveg.org [62.49.247.163]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id CFF40D63 for ; Wed, 22 Oct 2014 14:09:48 +0000 (UTC) Received: from john by potato.growveg.org with local (Exim 4.84 (FreeBSD)) (envelope-from ) id 1XgwbW-0000HH-Hf for freebsd-virtualization@freebsd.org; Wed, 22 Oct 2014 15:09:34 +0100 Date: Wed, 22 Oct 2014 15:09:34 +0100 From: John To: freebsd-virtualization@freebsd.org Subject: bhyve tapN additions Message-ID: <20141022140934.GA367@potato.growveg.org> Reply-To: freebsd-lists@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.5.23 (2014-03-12) Sender: John X-SA-Exim-Connect-IP: X-SA-Exim-Mail-From: john@potato.growveg.org X-SA-Exim-Scanned: No (on potato.growveg.org); SAEximRunCond expanded to false X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 Oct 2014 14:09:49 -0000 Hi all, I couldn't see the following answered clearly in the literature, so I'll ask it here. When a freeBSD host is running a [anything] guest, a tap interface needs to be created. Let's say I've done all this: # ifconfig tap0 create # sysctl net.link.tap.up_on_open=1 net.link.tap.up_on_open: 0 -> 1 # ifconfig bridge0 create # ifconfig bridge0 addm igb0 addm tap0 # ifconfig bridge0 up I want to add another tap, I don't want to restart the host. If I do # ifconfig bridge0 addm tap1 then configure another vm to use tap1, can I expect it to work? Or, If I want 2 vns with 2 taps, do I need to do this: # ifconfig bridge0 create # ifconfig bridge0 addm igb0 addm tap0 addm tap1 # ifconfig bridge0 up The reason I ask, is because I'm expecting a freebsd vm to work on tap1, and it's not. thanks, -- John From owner-freebsd-virtualization@FreeBSD.ORG Wed Oct 22 14:12:36 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 57483E38 for ; Wed, 22 Oct 2014 14:12:36 +0000 (UTC) Received: from mail-ig0-x234.google.com (mail-ig0-x234.google.com [IPv6:2607:f8b0:4001:c05::234]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 251CCE13 for ; Wed, 22 Oct 2014 14:12:36 +0000 (UTC) Received: by mail-ig0-f180.google.com with SMTP id uq10so951954igb.13 for ; Wed, 22 Oct 2014 07:12:35 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=content-type:mime-version:content-transfer-encoding:message-id:date :subject:from:in-reply-to:references:to; bh=Hp4SoINzBHR8AODCj0mpseZojxn5GDUo4NnNxwvuVcA=; b=ppH/aGNCQLkE67Y4C2Nuv7HK8WNw9vCL/V4xOtkLnxlCX96H3g9Ni41HjgSmFp/bJO xCROKldX9jHxjw2aa7zSvKjF66peahI3zmvsZ7Omr0CG2Iv4I59mMqyRS8Qlj3LnGyAa nN14b7Ztnx9ut2Aus7W4iPMs4LKSWlRjx+t4pCEOsHddhi3UV2xqBkPtMCgLeyv6mpYW /bTW+nv4ZPTi5/5rf/l3Y7QF/lMfe8sJdTbDeSpBSaVHdGH7qKVhfZ+0od7oO/Q1aKVx BRtElVautAZ1oQhySYLuFK50L4492f/tpVuMrzAhFTsiiM1eost6DtrBDmftD8Qx5YSk EivQ== X-Received: by 10.50.79.167 with SMTP id k7mr5725876igx.14.1413987155505; Wed, 22 Oct 2014 07:12:35 -0700 (PDT) Received: from [127.0.0.1] ([66.11.161.139]) by mx.google.com with ESMTPSA id h5sm792934igo.5.2014.10.22.07.12.32 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Wed, 22 Oct 2014 07:12:33 -0700 (PDT) Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable X-Mailer: BlackBerry Email (10.2.1.2141) Message-ID: <20141022141232.36446387.74087.1991@gmail.com> Date: Wed, 22 Oct 2014 10:12:32 -0400 Subject: Re: bhyve tapN additions From: Manas In-Reply-To: <20141022140934.GA367@potato.growveg.org> References: <20141022140934.GA367@potato.growveg.org> To: freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 Oct 2014 14:12:36 -0000 =E2=80=8EI think you have to do ifconfig tap1 create Before the addm Manas On BlackBerry =C2=A0 Original Message =C2=A0 From: John Sent: Wednesday, October 22, 2014 10:09 AM To: freebsd-virtualization@freebsd.org Reply To: freebsd-lists@freebsd.org Subject: bhyve tapN additions Hi all, I couldn't see the following answered clearly in the literature, so I'll=20 ask it here.=20 When a freeBSD host is running a [anything] guest, a tap interface needs to= be created. Let's say I've done all this: # ifconfig tap0 create # sysctl net.link.tap.up_on_open=3D1 net.link.tap.up_on_open: 0 -> 1 # ifconfig bridge0 create # ifconfig bridge0 addm igb0 addm tap0 # ifconfig bridge0 up I want to add another tap, I don't want to restart the host. If I do # ifconfig bridge0 addm tap1 then configure another vm to use tap1, can I expect it to work? Or, If I wa= nt 2 vns with 2 taps, do I need to do this: # ifconfig bridge0 create # ifconfig bridge0 addm igb0 addm tap0 addm tap1 # ifconfig bridge0 up The reason I ask, is because I'm expecting a freebsd vm to work on tap1, an= d it's=20 not. thanks, --=20 John=20 _______________________________________________ freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@freebs= d.org" From owner-freebsd-virtualization@FreeBSD.ORG Wed Oct 22 14:16:45 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 8230AFC0 for ; Wed, 22 Oct 2014 14:16:45 +0000 (UTC) Received: from potato.growveg.org (potato.growveg.org [62.49.247.163]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 3EB3DE4B for ; Wed, 22 Oct 2014 14:16:44 +0000 (UTC) Received: from john by potato.growveg.org with local (Exim 4.84 (FreeBSD)) (envelope-from ) id 1XgwiF-0000I2-14; Wed, 22 Oct 2014 15:16:31 +0100 Date: Wed, 22 Oct 2014 15:16:31 +0100 From: John To: Manas Subject: Re: bhyve tapN additions Message-ID: <20141022141631.GB367@potato.growveg.org> Reply-To: freebsd-virtualization@freebsd.org References: <20141022140934.GA367@potato.growveg.org> <20141022141232.36446387.74087.1991@gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <20141022141232.36446387.74087.1991@gmail.com> User-Agent: Mutt/1.5.23 (2014-03-12) Sender: John X-SA-Exim-Connect-IP: X-SA-Exim-Mail-From: john@potato.growveg.org X-SA-Exim-Scanned: No (on potato.growveg.org); SAEximRunCond expanded to false Cc: freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 Oct 2014 14:16:45 -0000 On Wed, Oct 22, 2014 at 10:12:32AM -0400, Manas wrote: > ‎I think you have to do > > ifconfig tap1 create > > Before the addm arrrrrgh! I need a drink... Thanks for that, very quick. Sorry for the noise! -- John From owner-freebsd-virtualization@FreeBSD.ORG Wed Oct 22 15:06:18 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 2A856CF9 for ; Wed, 22 Oct 2014 15:06:18 +0000 (UTC) Received: from mx1.scaleengine.net (beauharnois2.bhs1.scaleengine.net [142.4.218.15]) by mx1.freebsd.org (Postfix) with ESMTP id 03C24687 for ; Wed, 22 Oct 2014 15:06:17 +0000 (UTC) Received: from [192.168.1.2] (Seawolf.HML3.ScaleEngine.net [209.51.186.28]) (Authenticated sender: allanjude.freebsd@scaleengine.com) by mx1.scaleengine.net (Postfix) with ESMTPSA id 970AC6347E for ; Wed, 22 Oct 2014 15:06:16 +0000 (UTC) Message-ID: <5447C7EB.4060105@freebsd.org> Date: Wed, 22 Oct 2014 11:06:19 -0400 From: Allan Jude User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:31.0) Gecko/20100101 Thunderbird/31.2.0 MIME-Version: 1.0 To: freebsd-virtualization@freebsd.org Subject: Re: bhyve tapN additions References: <20141022140934.GA367@potato.growveg.org> <20141022141232.36446387.74087.1991@gmail.com> <20141022141631.GB367@potato.growveg.org> In-Reply-To: <20141022141631.GB367@potato.growveg.org> Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="x4w6SJwuxAc7ej4EiKhfwIsVHMtoV2soX" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 Oct 2014 15:06:18 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --x4w6SJwuxAc7ej4EiKhfwIsVHMtoV2soX Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable On 2014-10-22 10:16, John wrote: > On Wed, Oct 22, 2014 at 10:12:32AM -0400, Manas wrote: >> =E2=80=8EI think you have to do >> >> ifconfig tap1 create >> >> Before the addm > =20 > arrrrrgh! I need a drink... >=20 > Thanks for that, very quick. Sorry for the noise! >=20 The tap device can also be created automatically by bhyve, make sure you specify a different tap device for each instance of bhyve. --=20 Allan Jude --x4w6SJwuxAc7ej4EiKhfwIsVHMtoV2soX Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.22 (MingW32) iQIcBAEBAgAGBQJUR8fxAAoJEJrBFpNRJZKfupsP/0IPiLk3wNwzsnoqhFOLDdfN 56qkpBfE2ZflOGOMHfJhP7CWm4vDpBDbmkQVftFZJj5q55h71jK9msSEAWfMmpCr 9l1UXyxX3+EveK6CjZj+ieJgDd+ahReQRJCkrFnaicS8Sv2P9T/Ie9jNHuG4AHOL QVgHvBxNFppaDW1rR/C0p+bMrjpL64SlRRCVpugwM6l8HU6j7WQVkbs7EimI214X 99337pSSO6phFLKWWrjRfno5K409OIzc9Su4vzs+yXsTcF3gflraD1BaLFFbGMrz zJoICTSVUHUP+5BJMn97xp3pw2s7DNBEnhxd/cK8jPOFSHsx0S6k4l839RA/ijJO cLCMiudPDkEAniREDfuy/50+svKUao5MaJ2ehH2o/pW3afGJlT7+6Tr3G3N7/0XG zdKKVLoImHpoE/GcteFT25k2JjDRQ8GLp9AAymd9lKpLPqch2WqtAdiXKiDobogy Mk9i2mld97slrkMZ1iad9A1t93j+RoYf5pssyLefHB64+nVxwAFbqbjC1uM2eK2V Rt7tdIWKXaETS15urk3nB0+cAoDORKXSDdcWxQZIdtv7K5NviIPFfXA0Ov6nywT9 TX+3/bCiS3x2VVU0ZQHFcjF06/1c0hRkxXWW6gYnocg13QJkUi68gFvjftWl+11y yjiq+oPIL3vNkSkhDxNk =yRrc -----END PGP SIGNATURE----- --x4w6SJwuxAc7ej4EiKhfwIsVHMtoV2soX-- From owner-freebsd-virtualization@FreeBSD.ORG Wed Oct 22 20:11:47 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 35EF8BFD for ; Wed, 22 Oct 2014 20:11:47 +0000 (UTC) Received: from smtp.digiware.nl (smtp.digiware.nl [31.223.170.169]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id E4D38C93 for ; Wed, 22 Oct 2014 20:11:46 +0000 (UTC) Received: from rack1.digiware.nl (unknown [127.0.0.1]) by smtp.digiware.nl (Postfix) with ESMTP id 870E21534DF; Wed, 22 Oct 2014 22:11:38 +0200 (CEST) X-Virus-Scanned: amavisd-new at digiware.nl Received: from smtp.digiware.nl ([127.0.0.1]) by rack1.digiware.nl (rack1.digiware.nl [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id zV91vS4AH9Kh; Wed, 22 Oct 2014 22:11:11 +0200 (CEST) Received: from [192.168.10.9] (vaio [192.168.10.9]) (using TLSv1 with cipher ECDHE-RSA-AES128-SHA (128/128 bits)) (No client certificate requested) by smtp.digiware.nl (Postfix) with ESMTPSA id 6EBB5153408; Wed, 22 Oct 2014 22:02:17 +0200 (CEST) Message-ID: <54480D4B.6090108@digiware.nl> Date: Wed, 22 Oct 2014 22:02:19 +0200 From: Willem Jan Withagen User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:24.0) Gecko/20100101 Thunderbird/24.6.0 MIME-Version: 1.0 To: freebsd-virtualization@freebsd.org, Neel Natu Subject: Re: moving from virtualbox to bhyve - SOLVED References: <20141020162043.GA66615@potato.growveg.org> <544538D6.80101@freebsd.org> <20141020170401.GB66615@potato.growveg.org> <20141021045910.GA68426@potato.growveg.org> <20141022002014.GB85315@potato.growveg.org> In-Reply-To: <20141022002014.GB85315@potato.growveg.org> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 Oct 2014 20:11:47 -0000 On 22-10-2014 2:20, John wrote: > On Tue, Oct 21, 2014 at 01:55:26PM -0700, Neel Natu wrote: > >> If you are comfortable sharing your disk image then I can try to >> reproduce locally and hopefully get a better grip on what's happening. > > That's very nice of you to offer, but I have to decline as I don't own > the data. I think I might have sorted it in any case. I was thrown by > the login prompt not appearing in the console. > > Really pleased with the performance of ubuntu on bhyve. It doesn't impact > much on the host either. > Why not boot the system, and look in the grub config. And fix the code there by removing most of the graphics code. Or for testing, edit the grub boot line from within grub itself while bhyveload.... Then you will know if this is the problem, but from old experience trying to get all the linuxcees running in AMD, I think I ran into this as well. --WjW From owner-freebsd-virtualization@FreeBSD.ORG Wed Oct 22 20:22:33 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id C9513DEE for ; Wed, 22 Oct 2014 20:22:33 +0000 (UTC) Received: from mail-vc0-x230.google.com (mail-vc0-x230.google.com [IPv6:2607:f8b0:400c:c03::230]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 8C778D90 for ; Wed, 22 Oct 2014 20:22:33 +0000 (UTC) Received: by mail-vc0-f176.google.com with SMTP id hq11so2494386vcb.7 for ; Wed, 22 Oct 2014 13:22:32 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=1VDQgYgHKUh81BoNrPkjfQXWEU9JeGq8IziSflG6NLM=; b=YJWquJDpzl2Upqn4+iMFgUQGiqqdeOTy8FAz84wjCqH4vuLNmrp6CUVXOdeJdF0TJh RJh1U4J+KteEdx/lIhIUMbJfmh40+cxdoiCx28RckOqbcoWWOl6MlSaf2KJgjHuQDUh1 d0t463WGxRNDJB66qhp8BpbAhpay40H2YetYP9wyCF7EZJVDIQn+vMOmFfRQKm5uD03N TTIfQoHIBrHEE3pL45pgc7Qg/SfPw/+YN3CV6+apbDr0Sxm7VNb056Wg1DpW38wag2XO aJ+KizI6CKuxuNPY96asNtZBqfgXEOT8FKOWIjYxhpKjuDnLwi/GG8tv9pwW00qUgTUa fXlg== MIME-Version: 1.0 X-Received: by 10.220.174.193 with SMTP id u1mr343299vcz.28.1414009352677; Wed, 22 Oct 2014 13:22:32 -0700 (PDT) Received: by 10.220.150.68 with HTTP; Wed, 22 Oct 2014 13:22:32 -0700 (PDT) Date: Wed, 22 Oct 2014 16:22:32 -0400 Message-ID: Subject: Native Linux guest in Bhyve (no grub2-bhyve) status? From: Conrad Rad To: freebsd-virtualization@freebsd.org Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 Oct 2014 20:22:33 -0000 Hi all, I've tried asking IRC, but it's pretty quiet. Does anyone know what the status of UEFI/BIOS for bhyve is? http://www.slideshare.net/syuu1228/implements-bios-emulation-support-for-b-hy-ve-a-bsd-hypervisor looks neat; is it integrated? http://blather.michaelwlucas.com/archives/2060 seems to suggest someone was working on something back in May? I've tried booting a Linux VM and of course it just hangs in bhyveload. Does anyone know what is needed? What has been implemented? If work is being done in this area, where it is? And what else is needed? Thanks, Conrad From owner-freebsd-virtualization@FreeBSD.ORG Wed Oct 22 20:43:39 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id D1DFF186 for ; Wed, 22 Oct 2014 20:43:39 +0000 (UTC) Received: from mx1.scaleengine.net (beauharnois2.bhs1.scaleengine.net [142.4.218.15]) by mx1.freebsd.org (Postfix) with ESMTP id AAAA4F74 for ; Wed, 22 Oct 2014 20:43:39 +0000 (UTC) Received: from [192.168.1.2] (Seawolf.HML3.ScaleEngine.net [209.51.186.28]) (Authenticated sender: allanjude.freebsd@scaleengine.com) by mx1.scaleengine.net (Postfix) with ESMTPSA id 50E6F630A3 for ; Wed, 22 Oct 2014 20:43:38 +0000 (UTC) Message-ID: <54481701.3050907@freebsd.org> Date: Wed, 22 Oct 2014 16:43:45 -0400 From: Allan Jude User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:31.0) Gecko/20100101 Thunderbird/31.2.0 MIME-Version: 1.0 To: freebsd-virtualization@freebsd.org Subject: Re: Native Linux guest in Bhyve (no grub2-bhyve) status? References: In-Reply-To: Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="wSkkqmJXfJtRS9Kk286WjLswD5ScVUAE4" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 Oct 2014 20:43:39 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --wSkkqmJXfJtRS9Kk286WjLswD5ScVUAE4 Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable On 2014-10-22 16:22, Conrad Rad wrote: > Hi all, >=20 > I've tried asking IRC, but it's pretty quiet. Does anyone know what > the status of UEFI/BIOS for bhyve is? >=20 > http://www.slideshare.net/syuu1228/implements-bios-emulation-support-fo= r-b-hy-ve-a-bsd-hypervisor > looks neat; is it integrated? >=20 > http://blather.michaelwlucas.com/archives/2060 seems to suggest > someone was working on something back in May? >=20 > I've tried booting a Linux VM and of course it just hangs in > bhyveload. Does anyone know what is needed? What has been implemented? > If work is being done in this area, where it is? And what else is > needed? >=20 > Thanks, > Conrad > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@fr= eebsd.org" >=20 That definitely won't work, bhyveload is very specific to freebsd. A generic boot system would use some other command, or none at all. --=20 Allan Jude --wSkkqmJXfJtRS9Kk286WjLswD5ScVUAE4 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.22 (MingW32) iQIcBAEBAgAGBQJUSBcEAAoJEJrBFpNRJZKfjKMQAJYCObVHp46lU7CRMpoPhhzr GM3fVmR6U1pM5KW0BLW5e+VSrdPfQp98LG/T8c0cRy3kMtCtdTi9iO2LcdhiuboX GZZItKkyewcILbFJbptO1AldGH0KZiGcWLttTRUUrn2FZao5MjzyZ1aCBH6Lf2uY /qW9iMX31jEkq+vcCL3G9rCBMiAw71z1LVc5yeA8y6vyDeszR0bYagmURSBJf/8Q 27WbjpHXzQDe3QpUSHO/fr20EZ2INBOwmJenI1RxMQW2JeZaVO+U2KMwREdOpur4 5sRc0EoEraeOkutAHr3sR61fiqkpTHIX5mRlIK0y+VuRGpSqKJvPdjZYd7WYQGKg 5KaNgtsAaq0eptR0sMJyUy8n2VfFyqEJNc1zMEHYcDnC8e8tSZD84nQfjOC0twqW DVoF5lXgS8HfY6cHY7nmAf7Q19S53Mtbqz+vx8xk5ECiFyprkcgSUPsH38YH98h7 GkCU3JI88Pgf4X21T5MKTVJmhDuOow4ShUkP//KTUNFZFlNTlJJBdAHpsqsA56tA uq//fjZ1/qMEq9Gq5nlc1A2IqI3v1fPsSCfH7ApHc07LZql4SNtoKaLv8UiJL42l fqv3IXiBseiWw71yZESFgu3cyUg9BRDGbOvkon84qEbiRseyqJoqNl1kD4e5jOV9 IZEcgklZt+5hCTrVaakC =lf8v -----END PGP SIGNATURE----- --wSkkqmJXfJtRS9Kk286WjLswD5ScVUAE4-- From owner-freebsd-virtualization@FreeBSD.ORG Wed Oct 22 20:57:30 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id B38C5601; Wed, 22 Oct 2014 20:57:30 +0000 (UTC) Received: from mail-vc0-x233.google.com (mail-vc0-x233.google.com [IPv6:2607:f8b0:400c:c03::233]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 603DE133; Wed, 22 Oct 2014 20:57:30 +0000 (UTC) Received: by mail-vc0-f179.google.com with SMTP id im17so2514356vcb.24 for ; Wed, 22 Oct 2014 13:57:29 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:content-transfer-encoding; bh=F9TuZt93h3/4ScNerG4trlBprtXfVLE8OPHGFdKM7jE=; b=tKb6Ine0QeHA/Xe25Pj/dHJ2BR8OrEv+WQfaBlEqWXDWYRlNjYyzCOKZ5ozsW5tHKe L1PYJbRGgK/4DUnumrTaEQu7+fAYqP7Bkx5XUIiiuaYPMVedhutsj2ciXXlWx7vAu7/m xxoEp2LAyJ+J9CWHNdOq2RR8nlzTeTTqT4VJzH0YIcsqj7vVmTSsz5mwEHqs16Z5C93R X79TjULCHYgKe0XNMjyZPJDoIjWmhF/jVxD4e11QMSPwKSGK9qreKKuK5uyBuPugwjAb 3OmJiCLKKTioTFw0zKIbFR9gg308ZjsTIBTrQXcpsaazKK980XAe+Nw71kkCPEH2auGS /Jmw== MIME-Version: 1.0 X-Received: by 10.52.165.68 with SMTP id yw4mr348021vdb.42.1414011449469; Wed, 22 Oct 2014 13:57:29 -0700 (PDT) Received: by 10.220.150.68 with HTTP; Wed, 22 Oct 2014 13:57:29 -0700 (PDT) In-Reply-To: <54481701.3050907@freebsd.org> References: <54481701.3050907@freebsd.org> Date: Wed, 22 Oct 2014 16:57:29 -0400 Message-ID: Subject: Re: Native Linux guest in Bhyve (no grub2-bhyve) status? From: Conrad Rad To: Allan Jude Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Cc: freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 Oct 2014 20:57:30 -0000 On Wed, Oct 22, 2014 at 4:43 PM, Allan Jude wrote: > On 2014-10-22 16:22, Conrad Rad wrote: >> I've tried booting a Linux VM and of course it just hangs in >> bhyveload. Does anyone know what is needed? What has been implemented? >> If work is being done in this area, where it is? And what else is >> needed? > > That definitely won't work, bhyveload is very specific to freebsd. A > generic boot system would use some other command, or none at all. Hi Allan, I elided a bit of detail =E2=80=94 actually I'm using libvirt, which then u= ses bhyveload. So we need to create some other generic loader, and fix libvirt to invoke that instead? What does bhyve need the loader to do? Thanks, Conrad From owner-freebsd-virtualization@FreeBSD.ORG Wed Oct 22 21:54:44 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 60F61A3B; Wed, 22 Oct 2014 21:54:44 +0000 (UTC) Received: from alto.onthenet.com.au (alto.OntheNet.com.au [203.13.68.12]) by mx1.freebsd.org (Postfix) with ESMTP id 23116A09; Wed, 22 Oct 2014 21:54:43 +0000 (UTC) Received: from dommail.onthenet.com.au (dommail.OntheNet.com.au [203.13.70.57]) by alto.onthenet.com.au (Postfix) with ESMTP id 10FD11268C; Thu, 23 Oct 2014 07:54:36 +1000 (EST) Received: from Peter-Grehans-MacBook-Pro-2.local ([64.245.0.210]) by dommail.onthenet.com.au (MOS 4.4.4-GA) with ESMTP id BZE35732 (AUTH peterg@ptree32.com.au); Thu, 23 Oct 2014 07:54:35 +1000 Message-ID: <54482799.8080003@freebsd.org> Date: Wed, 22 Oct 2014 14:54:33 -0700 From: Peter Grehan User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:24.0) Gecko/20100101 Thunderbird/24.6.0 MIME-Version: 1.0 To: Allan Jude Subject: Re: bhyve tapN additions References: <20141022140934.GA367@potato.growveg.org> <20141022141232.36446387.74087.1991@gmail.com> <20141022141631.GB367@potato.growveg.org> <5447C7EB.4060105@freebsd.org> In-Reply-To: <5447C7EB.4060105@freebsd.org> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 Oct 2014 21:54:44 -0000 Hi Allan, > The tap device can also be created automatically by bhyve, make sure you > specify a different tap device for each instance of bhyve. That may require some devd scripting to get it to be added to a bridge group. We're looking at having the bridge interface have a cloneable tap-style interface so this step can be avoided i.e. point bhyve at a /dev/bridgeN device, and it will automatically become a part of that bridge. later, Peter. From owner-freebsd-virtualization@FreeBSD.ORG Wed Oct 22 21:58:53 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 3ED2BD1C; Wed, 22 Oct 2014 21:58:53 +0000 (UTC) Received: from mail-lb0-x22a.google.com (mail-lb0-x22a.google.com [IPv6:2a00:1450:4010:c04::22a]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 8DEE2A4E; Wed, 22 Oct 2014 21:58:52 +0000 (UTC) Received: by mail-lb0-f170.google.com with SMTP id u10so3669877lbd.29 for ; Wed, 22 Oct 2014 14:58:50 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type; bh=wofIOfpwqmCCvxWxAlZSuE8bP2+XoovQCNZcBHQIaag=; b=GgLPXRZD3tXZKhlSEBRQggYpkK1LEI3HO50HSOxMgCnJ3gpu2mmIqfGAGsSnYTq1rn 86TP3o5kOlvAKcswVgG0+heGVCgxzhPEfKUXt3l2pMIDP4507EXyNuy3kcuW2eCM9nOi pdH88TnB7hWujW2btGQO6qvtL5saL+dORjIVt8KPH2+Jy3ESDkJP6CV8x5tUIx/SRqFL 2mT4NMxXqVlERkOw3O4+9x2CRWZgN4Kt1d8Ev2OkTC9pcTZ7gSfFCcfCeOmZEBCP6sVG Nrx1tMaJc0Y+0blz2qL/P7Mv2FDS57o2A8j8W5fVsYyaWHdgPS8p7+WABTmqrJhoJnOq GYVg== MIME-Version: 1.0 X-Received: by 10.112.133.138 with SMTP id pc10mr864093lbb.48.1414015130496; Wed, 22 Oct 2014 14:58:50 -0700 (PDT) Sender: crodr001@gmail.com Received: by 10.112.84.197 with HTTP; Wed, 22 Oct 2014 14:58:50 -0700 (PDT) In-Reply-To: References: <54481701.3050907@freebsd.org> Date: Wed, 22 Oct 2014 14:58:50 -0700 X-Google-Sender-Auth: YWt02PVazbTVviZdHTWFz3cdFmY Message-ID: Subject: Re: Native Linux guest in Bhyve (no grub2-bhyve) status? From: Craig Rodrigues To: Conrad Rad Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 Cc: "freebsd-virtualization@freebsd.org" , Allan Jude X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 Oct 2014 21:58:53 -0000 On Wed, Oct 22, 2014 at 1:57 PM, Conrad Rad wrote: > > I elided a bit of detail -- actually I'm using libvirt, which then uses > > I raised the issue you brought up with respect to libvirt, and some other deficiencies in the current libvirt + byve implementation. See this discussion: https://lists.freebsd.org/pipermail/freebsd-virtualization/2014-October/002857.html -- Craig From owner-freebsd-virtualization@FreeBSD.ORG Wed Oct 22 22:06:07 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id F21C6EBB; Wed, 22 Oct 2014 22:06:06 +0000 (UTC) Received: from mail-vc0-x233.google.com (mail-vc0-x233.google.com [IPv6:2607:f8b0:400c:c03::233]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 9E8FFB0F; Wed, 22 Oct 2014 22:06:06 +0000 (UTC) Received: by mail-vc0-f179.google.com with SMTP id im17so2660857vcb.10 for ; Wed, 22 Oct 2014 15:06:05 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=45WvFXOzIl9TZ5rTT3oSpEWjNMsjYO9zIgxyBEOMliE=; b=o9ljE4OgAl8a2w04j3idO5gAy3V16eZtWysRwIqgJQ4NEuApYgiAP7J/ufUI5KUk2n CuHviZdl8CatGv1TdT/ADAZqGiOBQATaSfWyZdePjoA2uLc4S9xm7c2BaeCAIj3sJIhr PtZx1FWitymUg2fezYhPUdZftfiQB4G2CmIQSgpXpMd859i3FYPWrbU9iRln2IdJeYt6 XiEbFt3z3iHIypXrpd5Cs510XgRzuCejrRNFF6qmt4sxOS9ToVjHo+vN68EeddEzoyL/ 1KPTBGyqlO7//dVqBsz7WHedmS7mcC5myMt5SfZQ3IhuvhtbiJ+bO5NWEzdWM0qmORSA AkYQ== MIME-Version: 1.0 X-Received: by 10.52.78.162 with SMTP id c2mr488959vdx.3.1414015565720; Wed, 22 Oct 2014 15:06:05 -0700 (PDT) Received: by 10.220.150.68 with HTTP; Wed, 22 Oct 2014 15:06:05 -0700 (PDT) In-Reply-To: References: <54481701.3050907@freebsd.org> Date: Wed, 22 Oct 2014 18:06:05 -0400 Message-ID: Subject: Re: Native Linux guest in Bhyve (no grub2-bhyve) status? From: Conrad Rad To: Craig Rodrigues Content-Type: text/plain; charset=UTF-8 Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 Oct 2014 22:06:07 -0000 On Wed, Oct 22, 2014 at 5:58 PM, Craig Rodrigues wrote: > I raised the issue you brought up with respect to libvirt, and some other > deficiencies in the current libvirt + byve > implementation. See this discussion: > https://lists.freebsd.org/pipermail/freebsd-virtualization/2014-October/002857.html Hi Craig, Thanks, I've read that thread. Ideally libvirt/bhyve can just use a generic loader rather than special casing bhyveloader and grub2-bhyve. How are you envisioning one indicating to libvirt which loader to use / what the guest OS is? Thanks, Conrad From owner-freebsd-virtualization@FreeBSD.ORG Wed Oct 22 22:32:04 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 4EE853CC for ; Wed, 22 Oct 2014 22:32:04 +0000 (UTC) Received: from alto.onthenet.com.au (alto.OntheNet.com.au [203.13.68.12]) by mx1.freebsd.org (Postfix) with ESMTP id 10AC2D74 for ; Wed, 22 Oct 2014 22:32:03 +0000 (UTC) Received: from dommail.onthenet.com.au (dommail.OntheNet.com.au [203.13.70.57]) by alto.onthenet.com.au (Postfix) with ESMTP id 268C41287C; Thu, 23 Oct 2014 08:32:02 +1000 (EST) Received: from Peter-Grehans-MacBook-Pro-2.local ([64.245.0.210]) by dommail.onthenet.com.au (MOS 4.4.4-GA) with ESMTP id BZE37966 (AUTH peterg@ptree32.com.au); Thu, 23 Oct 2014 08:32:01 +1000 Message-ID: <5448305F.8010307@freebsd.org> Date: Wed, 22 Oct 2014 15:31:59 -0700 From: Peter Grehan User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:24.0) Gecko/20100101 Thunderbird/24.6.0 MIME-Version: 1.0 To: Conrad Rad Subject: Re: Native Linux guest in Bhyve (no grub2-bhyve) status? References: In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 Oct 2014 22:32:04 -0000 Hi Conrad, > I've tried asking IRC, but it's pretty quiet. Does anyone know what > the status of UEFI/BIOS for bhyve is? It's being worked on, though it's not yet at a state that it could be committed. later, Peter. From owner-freebsd-virtualization@FreeBSD.ORG Wed Oct 22 22:40:11 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 55BE6715 for ; Wed, 22 Oct 2014 22:40:11 +0000 (UTC) Received: from mail-lb0-x235.google.com (mail-lb0-x235.google.com [IPv6:2a00:1450:4010:c04::235]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id CCC70DBF for ; Wed, 22 Oct 2014 22:40:10 +0000 (UTC) Received: by mail-lb0-f181.google.com with SMTP id l4so3739632lbv.12 for ; Wed, 22 Oct 2014 15:40:08 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type; bh=1nuB6gUUb2H986EVz4KgyMWprWviTAs2aOi7C/HhYL0=; b=bvjm75ZeUEvfqv2MdDgtTJN7R0A/U+tjlyjZ2wsoW/7WpWFUYDLXcS9Ahva9InMHrt L9EBtobu4kEvd0fuH2LPkKRdbm/w8xxXGDkBsdNFkVL4Ghr2o31DQmMn09/fQb4v7tAI HLUbFZlElf0AM7Z83Ow9V2ev8tStuNn4r3K68JKMVsSSgFWodjabdTgVSGLcTwoHTMl2 y/XukfyxyLuAOTZmo4A2a6mcFuPfUOTVWHdhFllO5wgmogak9g+lLY2W21EGIGr3UHvV xH9LnozYS6y2/6NDxalCoKM+12nr7IE1a5YEudEyvdRx3RWVgNdO4mPckW3k7qXGbP4c t/tQ== MIME-Version: 1.0 X-Received: by 10.112.150.68 with SMTP id ug4mr976745lbb.82.1414017608496; Wed, 22 Oct 2014 15:40:08 -0700 (PDT) Sender: crodr001@gmail.com Received: by 10.112.84.197 with HTTP; Wed, 22 Oct 2014 15:40:08 -0700 (PDT) In-Reply-To: References: <54481701.3050907@freebsd.org> Date: Wed, 22 Oct 2014 15:40:08 -0700 X-Google-Sender-Auth: FlvoNW7bPcRyIKV-kjUC8QrHXuI Message-ID: Subject: Re: Native Linux guest in Bhyve (no grub2-bhyve) status? From: Craig Rodrigues To: Conrad Rad Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 Oct 2014 22:40:11 -0000 On Wed, Oct 22, 2014 at 3:06 PM, Conrad Rad wrote: > On Wed, Oct 22, 2014 at 5:58 PM, Craig Rodrigues > wrote: > > I raised the issue you brought up with respect to libvirt, and some other > > deficiencies in the current libvirt + byve > > implementation. See this discussion: > > > https://lists.freebsd.org/pipermail/freebsd-virtualization/2014-October/002857.html > > Hi Craig, > > Thanks, I've read that thread. Ideally libvirt/bhyve can just use a > generic loader rather than special casing bhyveloader and grub2-bhyve. > How are you envisioning one indicating to libvirt which loader to use > / what the guest OS is? > > It's mentioned in this followup: https://lists.freebsd.org/pipermail/freebsd-virtualization/2014-October/002859.html -- Craig From owner-freebsd-virtualization@FreeBSD.ORG Wed Oct 22 22:47:01 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 3609579B; Wed, 22 Oct 2014 22:47:01 +0000 (UTC) Received: from mail-vc0-x235.google.com (mail-vc0-x235.google.com [IPv6:2607:f8b0:400c:c03::235]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id D8910E72; Wed, 22 Oct 2014 22:47:00 +0000 (UTC) Received: by mail-vc0-f181.google.com with SMTP id le20so2622416vcb.26 for ; Wed, 22 Oct 2014 15:46:59 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=yTjveZIaXE6LV/KiBlU4EWnDbXoQtM6UmI7xSv91j+8=; b=NrXxOrudYRy3DXU7mU0zGqWf7zpxCEcNQwpV5UHbjWNb/Sac1leU1DZ1LFospjh4xL lo+kDFF6vz0w8XAETAmSx2wpaQ2jRZ7+V1vH1w3xDmv6mPk2AXmqcB4lT2ze1jwffX+I tob998h5EUgoPlVYg6n8aGytpQN6QMS/wcgA7iqtCCQHkYgPLlEptnYnJ1XdV5XpQrPB 5EhFvYQ8mvJGpnUl7s0MepP62EqDBynldRJW7WLbngVGhJlUK75XlsWx+7SXj5hOp64A 4W/GVo6WwKh1nAsd7ieNx64Y9xWxVMzn2G2MlbQlSXzD7klTCkM1rdrUKfF/QL5Uo0vG faDA== MIME-Version: 1.0 X-Received: by 10.220.197.9 with SMTP id ei9mr694868vcb.45.1414018019867; Wed, 22 Oct 2014 15:46:59 -0700 (PDT) Received: by 10.220.150.68 with HTTP; Wed, 22 Oct 2014 15:46:59 -0700 (PDT) In-Reply-To: <5448305F.8010307@freebsd.org> References: <5448305F.8010307@freebsd.org> Date: Wed, 22 Oct 2014 18:46:59 -0400 Message-ID: Subject: Re: Native Linux guest in Bhyve (no grub2-bhyve) status? From: Conrad Rad To: Peter Grehan Content-Type: text/plain; charset=UTF-8 Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 Oct 2014 22:47:01 -0000 On Wed, Oct 22, 2014 at 6:31 PM, Peter Grehan wrote: > Hi Conrad, > >> I've tried asking IRC, but it's pretty quiet. Does anyone know what >> the status of UEFI/BIOS for bhyve is? > > > It's being worked on, though it's not yet at a state that it could be > committed. Hi Peter, Is the work being done in public? Thanks, Conrad From owner-freebsd-virtualization@FreeBSD.ORG Wed Oct 22 22:48:39 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 5A1AC7F6; Wed, 22 Oct 2014 22:48:39 +0000 (UTC) Received: from mail-vc0-x235.google.com (mail-vc0-x235.google.com [IPv6:2607:f8b0:400c:c03::235]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 04DDDE82; Wed, 22 Oct 2014 22:48:38 +0000 (UTC) Received: by mail-vc0-f181.google.com with SMTP id le20so2648777vcb.40 for ; Wed, 22 Oct 2014 15:48:38 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=wBNqcd+s24qzHqPd8vbxYLwlXLh7yEjnIxTPNIZK988=; b=CHY5WIlmcW1hVUQR9Z51PTU31xEZxN9K4oLWr9v+zzLCwITBMed0BDg9FS0IlP4Kg9 aQft7wUxvDuyeE3lkYv/f9ANZLSHXfPOBc88rybwXHSkQiSMcW8r9Czm7zce6nutoHE3 2jdARWgrqS1dzwIo9jsYoUzduUkxd8bL/j1G6+svmrtWsbCCk5bTLSVfmuNORQXxYJxy inqJTlDSwNLH0eGJBhe3x+p5d8Fbed3tvnJQqTmwU74JENyHEw5qve2/2zc0w5FqJVN+ e3QL5Jq+3eyxvXq54H0FN4MDwxvz9IafYdjEoc0Uwm8iJixtdGTHdxkWoe16xMFxOsV/ 4apQ== MIME-Version: 1.0 X-Received: by 10.221.63.8 with SMTP id xc8mr708687vcb.37.1414018118198; Wed, 22 Oct 2014 15:48:38 -0700 (PDT) Received: by 10.220.150.68 with HTTP; Wed, 22 Oct 2014 15:48:38 -0700 (PDT) In-Reply-To: References: <54481701.3050907@freebsd.org> Date: Wed, 22 Oct 2014 18:48:38 -0400 Message-ID: Subject: Re: Native Linux guest in Bhyve (no grub2-bhyve) status? From: Conrad Rad To: Craig Rodrigues Content-Type: text/plain; charset=UTF-8 Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 Oct 2014 22:48:39 -0000 On Wed, Oct 22, 2014 at 6:40 PM, Craig Rodrigues wrote: > > On Wed, Oct 22, 2014 at 3:06 PM, Conrad Rad wrote: >> >> How are you envisioning one indicating to libvirt which loader to use >> / what the guest OS is? >> > > It's mentioned in this followup: > > https://lists.freebsd.org/pipermail/freebsd-virtualization/2014-October/002859.html Thanks. After it is fixed, we should probably get that documented on http://libvirt.org/drvbhyve.html . Conrad From owner-freebsd-virtualization@FreeBSD.ORG Wed Oct 22 23:00:40 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 4153FA85 for ; Wed, 22 Oct 2014 23:00:40 +0000 (UTC) Received: from alto.onthenet.com.au (alto.OntheNet.com.au [203.13.68.12]) by mx1.freebsd.org (Postfix) with ESMTP id 01FECF7B for ; Wed, 22 Oct 2014 23:00:39 +0000 (UTC) Received: from dommail.onthenet.com.au (dommail.OntheNet.com.au [203.13.70.57]) by alto.onthenet.com.au (Postfix) with ESMTP id 595D912851; Thu, 23 Oct 2014 09:00:37 +1000 (EST) Received: from Peter-Grehans-MacBook-Pro-2.local ([64.245.0.210]) by dommail.onthenet.com.au (MOS 4.4.4-GA) with ESMTP id BZE39985 (AUTH peterg@ptree32.com.au); Thu, 23 Oct 2014 09:00:36 +1000 Message-ID: <54483712.8050007@freebsd.org> Date: Wed, 22 Oct 2014 16:00:34 -0700 From: Peter Grehan User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:24.0) Gecko/20100101 Thunderbird/24.6.0 MIME-Version: 1.0 To: Conrad Rad Subject: Re: Native Linux guest in Bhyve (no grub2-bhyve) status? References: <5448305F.8010307@freebsd.org> In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 Oct 2014 23:00:40 -0000 Hi Conrad, > Is the work being done in public? We're working on getting it released. later, Peter. From owner-freebsd-virtualization@FreeBSD.ORG Thu Oct 23 01:24:31 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 029C79F7 for ; Thu, 23 Oct 2014 01:24:31 +0000 (UTC) Received: from elvis.mu.org (elvis.mu.org [192.203.228.196]) by mx1.freebsd.org (Postfix) with ESMTP id E2234F97 for ; Thu, 23 Oct 2014 01:24:30 +0000 (UTC) Received: from u10-2-32-011.office.norse-data.com (unknown [50.204.88.51]) by elvis.mu.org (Postfix) with ESMTPSA id 7B820341F83D for ; Wed, 22 Oct 2014 18:24:29 -0700 (PDT) Message-ID: <544858CD.6020907@freebsd.org> Date: Wed, 22 Oct 2014 18:24:29 -0700 From: Alfred Perlstein Organization: FreeBSD User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.9; rv:31.0) Gecko/20100101 Thunderbird/31.2.0 MIME-Version: 1.0 To: freebsd-virtualization@freebsd.org Subject: Re: bhyve tapN additions References: <20141022140934.GA367@potato.growveg.org> <20141022141232.36446387.74087.1991@gmail.com> <20141022141631.GB367@potato.growveg.org> <5447C7EB.4060105@freebsd.org> <54482799.8080003@freebsd.org> In-Reply-To: <54482799.8080003@freebsd.org> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Oct 2014 01:24:31 -0000 On 10/22/14 2:54 PM, Peter Grehan wrote: > Hi Allan, > >> The tap device can also be created automatically by bhyve, make sure you >> specify a different tap device for each instance of bhyve. > > That may require some devd scripting to get it to be added to a > bridge group. > > We're looking at having the bridge interface have a cloneable > tap-style interface so this step can be avoided i.e. point bhyve at a > /dev/bridgeN device, and it will automatically become a part of that > bridge. Peter, that would be super helpful. Thank you! -Alfred From owner-freebsd-virtualization@FreeBSD.ORG Thu Oct 23 19:58:31 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id B8E435A1 for ; Thu, 23 Oct 2014 19:58:31 +0000 (UTC) Received: from mail-yh0-x22b.google.com (mail-yh0-x22b.google.com [IPv6:2607:f8b0:4002:c01::22b]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 7D2BA909 for ; Thu, 23 Oct 2014 19:58:31 +0000 (UTC) Received: by mail-yh0-f43.google.com with SMTP id z6so315258yhz.2 for ; Thu, 23 Oct 2014 12:58:30 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=from:to:cc:subject:date:message-id; bh=/S55FvopWiTnDemDu2oNImaE8Kx2FDFx0t9Nh9Rm8jY=; b=Tm2F1Z3ygZY7n32bc9HL5LAfslq1uAPXblt5RtkrwOmhqov+3X86MB5sjO/N4ZRW19 0XUduGnJMW9qra6WakQ655DFCAnZz+sYjnDq7yMhoF/76KCGh/IfsC57qy5ALbrhc36s ABzCg85yB/ljFI3/45x4yS/r3tBn2uIkEP/Q52Mi8ZPIiRTTOxqE1wgXqfmrDv6Mw1p4 AmA9ynAxyb9lFT3tHFsMau0SFRsQTFAD2fqDTyVXa0gTH0GjYiPprwlMQDxzDVDK9qP4 PZOnGsirlLiKHPGV+kAhmC6wworGGLSTbxOvatkbWXjcIlwjlQFnqdT8SSaF9BbCdy4q rdqw== X-Received: by 10.170.61.87 with SMTP id d84mr390888ykd.112.1414094310674; Thu, 23 Oct 2014 12:58:30 -0700 (PDT) Received: from m.west.isilon.com (c-98-209-117-232.hsd1.mi.comcast.net. [98.209.117.232]) by mx.google.com with ESMTPSA id x9sm2642586igl.10.2014.10.23.12.58.29 for (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 23 Oct 2014 12:58:29 -0700 (PDT) From: Conrad Meyer To: libvir-list@redhat.com Subject: [PATCH 0/2] Add non-FreeBSD guest support to Bhyve driver. Date: Thu, 23 Oct 2014 15:58:02 -0400 Message-Id: <1414094284-29055-1-git-send-email-cse.cem@gmail.com> X-Mailer: git-send-email 1.9.3 Cc: freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Oct 2014 19:58:31 -0000 First-time libvirt contributor here. Apologies if I've made beginner mistakes, etc. If something needs fixing, please let me know and I'll try and take care of it expediently. First, the bhyve driver expected and assumed an OS type of 'hvm'. I think this was incorrect. Bhyve does not provide a BIOS API and instead uses a host bootloader to paravirtualize guests. This patch changes the OS type Bhyve expects to 'xen' and updates tests to match. Second, drvbhyve hardcodes bhyveload(8) as the host bootloader for guests. bhyveload(8) loader only supports FreeBSD guests. This patch adds and handling to bhyve_command, so libvirt can boot non-FreeBSD guests in Bhyve. See patch logs for further details. Thanks, Conrad Conrad Meyer (2): bhyve: Support /domain/bootloader configuration for non-FreeBSD guests. Generated PO files for 'bhyve: Support /domain/bootloader' docs/drvbhyve.html.in | 30 +++++- docs/formatdomain.html.in | 4 +- po/af.po | 4 + po/am.po | 4 + po/ar.po | 4 + po/as.po | 4 + po/be.po | 4 + po/bg.po | 4 + po/bn.po | 4 + po/bn_IN.po | 4 + po/bo.po | 4 + po/bs.po | 4 + po/ca.po | 4 + po/cs.po | 4 + po/cy.po | 4 + po/da.po | 4 + po/de.po | 4 + po/el.po | 4 + po/en_GB.po | 4 + po/es.po | 4 + po/et.po | 4 + po/eu_ES.po | 4 + po/fa.po | 4 + po/fi.po | 4 + po/fr.po | 4 + po/gl.po | 4 + po/gu.po | 4 + po/he.po | 4 + po/hi.po | 4 + po/hr.po | 4 + po/hu.po | 4 + po/hy.po | 4 + po/id.po | 4 + po/is.po | 4 + po/it.po | 4 + po/ja.po | 4 + po/ka.po | 4 + po/kn.po | 4 + po/ko.po | 4 + po/ku.po | 4 + po/libvirt.pot | 4 + po/lo.po | 4 + po/lt.po | 4 + po/lv.po | 4 + po/mk.po | 4 + po/ml.po | 4 + po/mr.po | 4 + po/ms.po | 4 + po/my.po | 4 + po/nb.po | 4 + po/nl.po | 4 + po/nn.po | 4 + po/nso.po | 4 + po/or.po | 4 + po/pa.po | 4 + po/pl.po | 4 + po/pt.po | 4 + po/pt_BR.po | 4 + po/ro.po | 4 + po/ru.po | 4 + po/si.po | 4 + po/sk.po | 4 + po/sl.po | 4 + po/sq.po | 4 + po/sr.po | 4 + po/sr@latin.po | 4 + po/sv.po | 4 + po/ta.po | 4 + po/te.po | 4 + po/th.po | 4 + po/tr.po | 4 + po/uk.po | 4 + po/ur.po | 4 + po/vi.po | 4 + po/vi_VN.po | 4 + po/zh_CN.po | 4 + po/zh_TW.po | 4 + po/zu.po | 4 + src/bhyve/bhyve_capabilities.c | 2 +- src/bhyve/bhyve_command.c | 107 +++++++++++++++++++-- tests/bhyvexml2argvdata/bhyvexml2argv-acpiapic.xml | 2 +- tests/bhyvexml2argvdata/bhyvexml2argv-base.xml | 2 +- tests/bhyvexml2argvdata/bhyvexml2argv-console.xml | 2 +- .../bhyvexml2argvdata/bhyvexml2argv-disk-cdrom.xml | 2 +- .../bhyvexml2argv-disk-virtio.xml | 2 +- tests/bhyvexml2argvdata/bhyvexml2argv-macaddr.xml | 2 +- tests/bhyvexml2argvdata/bhyvexml2argv-metadata.xml | 2 +- tests/bhyvexml2argvdata/bhyvexml2argv-serial.xml | 2 +- .../bhyvexml2xmlout-metadata.xml | 2 +- 89 files changed, 439 insertions(+), 26 deletions(-) -- 1.9.3 From owner-freebsd-virtualization@FreeBSD.ORG Thu Oct 23 19:58:38 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 417195E5 for ; Thu, 23 Oct 2014 19:58:38 +0000 (UTC) Received: from mail-yh0-x22f.google.com (mail-yh0-x22f.google.com [IPv6:2607:f8b0:4002:c01::22f]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 0248390B for ; Thu, 23 Oct 2014 19:58:37 +0000 (UTC) Received: by mail-yh0-f47.google.com with SMTP id c41so230386yho.34 for ; Thu, 23 Oct 2014 12:58:37 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=from:to:cc:subject:date:message-id:in-reply-to:references; bh=W+Eoi72pkb5AePXuOAjLFNBX6kMmiiEryCb4l+h9S4o=; b=xWrIsTBjCg59W7oR+LpkHsdJWfk+csWzjEN0UADmpyXATUzo/4jM/MU7wq0akaIhOl Mwcere58LxE5vixTc87a4GZ94Fp9cyyg+OfuAFtx8vz4FN7X5ZfIabcW+wrI82pT2JDw 5dXVl7X0Cd6C2ObBgPmLINh21EnhfQdw0SpSbLYDkrOuV9eL2zkU4nPBLry9jPoPrUPE es/WQzIgloJUVmmA7xJXzyzu+eHkOEHrRLwpwidCF8sZ3LePQEBqgot+3UT0SAMaZkoL idtExYtIhYNY92FlWDiAtLMxMSE69GiJxWa4ssDYVdAK9zdNKauIOHUVqYUiuaaxStl4 331w== X-Received: by 10.170.150.197 with SMTP id r188mr927554ykc.1.1414094317201; Thu, 23 Oct 2014 12:58:37 -0700 (PDT) Received: from m.west.isilon.com (c-98-209-117-232.hsd1.mi.comcast.net. [98.209.117.232]) by mx.google.com with ESMTPSA id x9sm2642586igl.10.2014.10.23.12.58.35 for (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 23 Oct 2014 12:58:36 -0700 (PDT) From: Conrad Meyer To: libvir-list@redhat.com Subject: [PATCH 1/2] bhyve: Support /domain/bootloader configuration for non-FreeBSD guests. Date: Thu, 23 Oct 2014 15:58:03 -0400 Message-Id: <1414094284-29055-2-git-send-email-cse.cem@gmail.com> X-Mailer: git-send-email 1.9.3 In-Reply-To: <1414094284-29055-1-git-send-email-cse.cem@gmail.com> References: <1414094284-29055-1-git-send-email-cse.cem@gmail.com> Cc: Conrad Meyer , freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Oct 2014 19:58:38 -0000 Also, flip Bhyve /domain/os/type support from HVM to Xen. Bhyve only supports paravirtualized guests, and 'xen' is closest to that. We still default to bhyveloader(1) if no explicit bootloader configuration is supplied in the domain. If the /domain/bootloader looks like grub-bhyve and the user doesn't supply /domain/bootloader_args, we make an intelligent guess and try chainloading the first partition on the disk. Caveats: - We can't install from CD without explicit bootloader_args. - We leave a device.map file lying around in /tmp. I don't see a good way not to do so without reworking the API somewhat. Sponsored by: EMC / Isilon storage division Signed-off-by: Conrad Meyer --- docs/drvbhyve.html.in | 30 +++++- docs/formatdomain.html.in | 4 +- po/libvirt.pot | 4 + src/bhyve/bhyve_capabilities.c | 2 +- src/bhyve/bhyve_command.c | 107 +++++++++++++++++++-- tests/bhyvexml2argvdata/bhyvexml2argv-acpiapic.xml | 2 +- tests/bhyvexml2argvdata/bhyvexml2argv-base.xml | 2 +- tests/bhyvexml2argvdata/bhyvexml2argv-console.xml | 2 +- .../bhyvexml2argvdata/bhyvexml2argv-disk-cdrom.xml | 2 +- .../bhyvexml2argv-disk-virtio.xml | 2 +- tests/bhyvexml2argvdata/bhyvexml2argv-macaddr.xml | 2 +- tests/bhyvexml2argvdata/bhyvexml2argv-metadata.xml | 2 +- tests/bhyvexml2argvdata/bhyvexml2argv-serial.xml | 2 +- .../bhyvexml2xmlout-metadata.xml | 2 +- 14 files changed, 139 insertions(+), 26 deletions(-) diff --git a/docs/drvbhyve.html.in b/docs/drvbhyve.html.in index 39afdf5..c6c79d7 100644 --- a/docs/drvbhyve.html.in +++ b/docs/drvbhyve.html.in @@ -37,8 +37,7 @@ bhyve+ssh://root@example.com/system (remote access, SSH tunnelled)

Example config

The bhyve driver in libvirt is in its early stage and under active development. So it supports -only limited number of features bhyve provides. All the supported features could be found -in this sample domain XML. +only limited number of features bhyve provides.

@@ -50,13 +49,13 @@ up to 31 PCI devices. 

 <domain type='bhyve'>
-  <name>bhyve</name>
-  <uuid>df3be7e7-a104-11e3-aeb0-50e5492bd3dc</uuid>
+    <name>bhyve</name>
+    <uuid>df3be7e7-a104-11e3-aeb0-50e5492bd3dc</uuid>
     <memory>219136</memory>
     <currentMemory>219136</currentMemory>
     <vcpu>1</vcpu>
     <os>
-       <type>hvm</type>
+       <type>xen</type>
     </os>
     <features>
       <apic/>
@@ -157,5 +156,26 @@ An example of domain XML device entry for that will look like:

 
Please refer to the Storage documentation for more details on storage
 management.

 
+
Using grub2-bhyve or Alternative Bootloaders

+
+
It's possible to boot non-FreeBSD guests by specifying an explicit
+bootloader, e.g. grub-bhyve(1). Arguments to the bootloader may be
+specified as well. If no arguments are given and bootloader is
+grub-bhyve, libvirt will try and boot from the first partition of
+the disk image.

+
+
+  ...
+    <bootloader>/usr/local/sbin/grub-bhyve</bootloader>
+    <bootloader_args>...</bootloader_args>
+  ...
+

+
+
(Of course, to install from a CD a user will have to supply explicit
+arguments to grub-bhyve.)

+
+
Caveat: bootloader_args does not support any quoting.
+Filenames, etc, must not have spaces or they will be tokenized incorrectly.

+
   
 
diff --git a/docs/formatdomain.html.in b/docs/formatdomain.html.in
index 0099ce7..b7b6c46 100644
--- a/docs/formatdomain.html.in
+++ b/docs/formatdomain.html.in
@@ -217,7 +217,9 @@
       a BIOS, and instead the host is responsible to kicking off the
       operating system boot. This may use a pseudo-bootloader in the
       host to provide an interface to choose a kernel for the guest.
-      An example is pygrub with Xen.
+      An example is pygrub with Xen. The Bhyve hypervisor
+      also uses a host bootloader, either bhyveload or
+      grub-bhyve.
     

 
 
diff --git a/po/libvirt.pot b/po/libvirt.pot
index 0b44ad7..d8c9a4d 100644
--- a/po/libvirt.pot
+++ b/po/libvirt.pot
@@ -851,6 +851,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/src/bhyve/bhyve_capabilities.c b/src/bhyve/bhyve_capabilities.c
index 132ce91..b37a24f 100644
--- a/src/bhyve/bhyve_capabilities.c
+++ b/src/bhyve/bhyve_capabilities.c
@@ -85,7 +85,7 @@ virBhyveCapsBuild(void)
                                    false, false)) == NULL)
         return NULL;
 
-    if ((guest = virCapabilitiesAddGuest(caps, "hvm",
+    if ((guest = virCapabilitiesAddGuest(caps, "xen",
                                          VIR_ARCH_X86_64,
                                          "bhyve",
                                          NULL, 0, NULL)) == NULL)
diff --git a/src/bhyve/bhyve_command.c b/src/bhyve/bhyve_command.c
index bea4a59..99956ae 100644
--- a/src/bhyve/bhyve_command.c
+++ b/src/bhyve/bhyve_command.c
@@ -300,6 +300,7 @@ virBhyveProcessBuildLoadCmd(virConnectPtr conn,
 {
     virCommandPtr cmd;
     virDomainDiskDefPtr disk;
+    bool bhyveload, grub_bhyve;
 
     if (def->ndisks < 1) {
         virReportError(VIR_ERR_CONFIG_UNSUPPORTED, "%s",
@@ -326,19 +327,105 @@ virBhyveProcessBuildLoadCmd(virConnectPtr conn,
         return NULL;
     }
 
-    cmd = virCommandNew(BHYVELOAD);
+    if (def->os.bootloader == NULL) {
+        bhyveload = true;
+        grub_bhyve = false;
+        cmd = virCommandNew(BHYVELOAD);
+    } else {
+        bhyveload = false;
+        if (strstr(def->os.bootloader, "grub-bhyve") == 0)
+            grub_bhyve = true;
+        cmd = virCommandNew(def->os.bootloader);
+    }
 
-    /* Memory */
-    virCommandAddArg(cmd, "-m");
-    virCommandAddArgFormat(cmd, "%llu",
-                           VIR_DIV_UP(def->mem.max_balloon, 1024));
+    if (bhyveload && def->os.bootloaderArgs == NULL) {
+        VIR_DEBUG("%s: bhyveload with default arguments", __func__);
+
+        /* Memory (MB) */
+        virCommandAddArg(cmd, "-m");
+        virCommandAddArgFormat(cmd, "%llu",
+                               VIR_DIV_UP(def->mem.max_balloon, 1024));
+
+        /* Image path */
+        virCommandAddArg(cmd, "-d");
+        virCommandAddArg(cmd, virDomainDiskGetSource(disk));
+
+        /* VM name */
+        virCommandAddArg(cmd, def->name);
+    } else if (grub_bhyve && def->os.bootloaderArgs == NULL) {
+        char tmpmapfile[128] = "/tmp/grub-bhyve-device.map_XXXXXX";
+        FILE *f;
+        int fd;
+
+        VIR_DEBUG("%s: grub-bhyve with default arguments", __func__);
+
+        /*
+         * XXX Default grub-bhyve has some BIG caveats, but MAY work for some
+         * typical configurations. In particular:
+         *
+         *   - Can't create a new VM this way (no CD, no boot from CD)
+         *   - Assumes a GRUB install on hd0,msdos1
+         */
 
-    /* Image path */
-    virCommandAddArg(cmd, "-d");
-    virCommandAddArg(cmd, virDomainDiskGetSource(disk));
+        /* XXX cleanup this file. */
+        fd = mkstemp(tmpmapfile);
+        if (fd < 0) {
+                virReportError(VIR_ERR_OPEN_FAILED, tmpmapfile);
+                goto error;
+        }
+
+        f = VIR_FDOPEN(fd, "wb+");
+        if (f == NULL) {
+                VIR_FORCE_CLOSE(fd);
+                virReportError(VIR_ERR_OPEN_FAILED, tmpmapfile);
+                goto error;
+        }
+
+        /* Grub device.map */
+        fprintf(f, "(hd0) %s\n", virDomainDiskGetSource(disk));
+        /* XXX CDs would look like: "(cd0) /path/to/CD" */
+
+        if (VIR_FCLOSE(f) < 0) {
+                virReportSystemError(errno, "%s", _("failed to close file"));
+                goto error;
+        }
 
-    /* VM name */
-    virCommandAddArg(cmd, def->name);
+
+        virCommandAddArg(cmd, "--device-map");
+        virCommandAddArg(cmd, tmpmapfile);
+
+        /* Memory in MB */
+        virCommandAddArg(cmd, "--memory");
+        virCommandAddArgFormat(cmd, "%llu",
+                               VIR_DIV_UP(def->mem.max_balloon, 1024));
+
+        /* To boot from CD, "cd0" here. */
+        virCommandAddArg(cmd, "--root");
+        virCommandAddArg(cmd, "hd0,msdos1");
+
+        /* VM name */
+        virCommandAddArg(cmd, def->name);
+    } else if (def->os.bootloaderArgs == NULL) {
+        virReportError(VIR_ERR_CONFIG_UNSUPPORTED,
+                       _("Custom loader requires explicit %s configuration"),
+                       "bootloader_args");
+        goto error;
+    } else {
+        char **blargs, **arg;
+
+        VIR_DEBUG("%s: custom loader '%s' with arguments", __func__,
+                  def->os.bootloader);
+
+        /* XXX: Handle quoted? */
+        blargs = virStringSplit(def->os.bootloaderArgs, " ", 0);
+        for (arg = blargs; *arg; arg++)
+                virCommandAddArg(cmd, *arg);
+        virStringFreeList(blargs);
+    }
 
     return cmd;
+
+error:
+    virCommandFree(cmd);
+    return NULL;
 }
diff --git a/tests/bhyvexml2argvdata/bhyvexml2argv-acpiapic.xml b/tests/bhyvexml2argvdata/bhyvexml2argv-acpiapic.xml
index 2be970e..bda6ab5 100644
--- a/tests/bhyvexml2argvdata/bhyvexml2argv-acpiapic.xml
+++ b/tests/bhyvexml2argvdata/bhyvexml2argv-acpiapic.xml
@@ -4,7 +4,7 @@
   219136
   1
   
-    hvm
+    xen
   
   
     
diff --git a/tests/bhyvexml2argvdata/bhyvexml2argv-base.xml b/tests/bhyvexml2argvdata/bhyvexml2argv-base.xml
index 3d23375..9ae8194 100644
--- a/tests/bhyvexml2argvdata/bhyvexml2argv-base.xml
+++ b/tests/bhyvexml2argvdata/bhyvexml2argv-base.xml
@@ -4,7 +4,7 @@
   219136
   1
   
-    hvm
+    xen
   
   
     
diff --git a/tests/bhyvexml2argvdata/bhyvexml2argv-console.xml b/tests/bhyvexml2argvdata/bhyvexml2argv-console.xml
index 35206b5..f2492b3 100644
--- a/tests/bhyvexml2argvdata/bhyvexml2argv-console.xml
+++ b/tests/bhyvexml2argvdata/bhyvexml2argv-console.xml
@@ -4,7 +4,7 @@
   219136
   1
   
-    hvm
+    xen
   
   
     
diff --git a/tests/bhyvexml2argvdata/bhyvexml2argv-disk-cdrom.xml b/tests/bhyvexml2argvdata/bhyvexml2argv-disk-cdrom.xml
index d70219c..b30c76f 100644
--- a/tests/bhyvexml2argvdata/bhyvexml2argv-disk-cdrom.xml
+++ b/tests/bhyvexml2argvdata/bhyvexml2argv-disk-cdrom.xml
@@ -4,7 +4,7 @@
   219136
   1
   
-    hvm
+    xen
   
   
     
diff --git a/tests/bhyvexml2argvdata/bhyvexml2argv-disk-virtio.xml b/tests/bhyvexml2argvdata/bhyvexml2argv-disk-virtio.xml
index 773d55e..83dbd3c 100644
--- a/tests/bhyvexml2argvdata/bhyvexml2argv-disk-virtio.xml
+++ b/tests/bhyvexml2argvdata/bhyvexml2argv-disk-virtio.xml
@@ -4,7 +4,7 @@
   219136
   1
   
-    hvm
+    xen
   
   
     
diff --git a/tests/bhyvexml2argvdata/bhyvexml2argv-macaddr.xml b/tests/bhyvexml2argvdata/bhyvexml2argv-macaddr.xml
index b262eb7..b2714c6 100644
--- a/tests/bhyvexml2argvdata/bhyvexml2argv-macaddr.xml
+++ b/tests/bhyvexml2argvdata/bhyvexml2argv-macaddr.xml
@@ -4,7 +4,7 @@
   219136
   1
   
-    hvm
+    xen
   
   
     
diff --git a/tests/bhyvexml2argvdata/bhyvexml2argv-metadata.xml b/tests/bhyvexml2argvdata/bhyvexml2argv-metadata.xml
index 6436301..09a793b 100644
--- a/tests/bhyvexml2argvdata/bhyvexml2argv-metadata.xml
+++ b/tests/bhyvexml2argvdata/bhyvexml2argv-metadata.xml
@@ -4,7 +4,7 @@
   219136
   1
   
-    hvm
+    xen
   
   
     
diff --git a/tests/bhyvexml2argvdata/bhyvexml2argv-serial.xml b/tests/bhyvexml2argvdata/bhyvexml2argv-serial.xml
index cd4f25b..fff6aa8 100644
--- a/tests/bhyvexml2argvdata/bhyvexml2argv-serial.xml
+++ b/tests/bhyvexml2argvdata/bhyvexml2argv-serial.xml
@@ -4,7 +4,7 @@
   219136
   1
   
-    hvm
+    xen
   
   
     
diff --git a/tests/bhyvexml2xmloutdata/bhyvexml2xmlout-metadata.xml b/tests/bhyvexml2xmloutdata/bhyvexml2xmlout-metadata.xml
index 77e18d4..08ff7d2 100644
--- a/tests/bhyvexml2xmloutdata/bhyvexml2xmlout-metadata.xml
+++ b/tests/bhyvexml2xmloutdata/bhyvexml2xmlout-metadata.xml
@@ -9,7 +9,7 @@
   219136
   1
   
-    hvm
+    xen
     
   
   
-- 
1.9.3


From owner-freebsd-virtualization@FreeBSD.ORG  Thu Oct 23 19:58:40 2014
Return-Path: 
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 3355E5E8
 for ; Thu, 23 Oct 2014 19:58:40 +0000 (UTC)
Received: from mail-yh0-x232.google.com (mail-yh0-x232.google.com
 [IPv6:2607:f8b0:4002:c01::232])
 (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
 (Client CN "smtp.gmail.com",
 Issuer "Google Internet Authority G2" (verified OK))
 by mx1.freebsd.org (Postfix) with ESMTPS id E664890C
 for ; Thu, 23 Oct 2014 19:58:39 +0000 (UTC)
Received: by mail-yh0-f50.google.com with SMTP id a41so223670yho.37
 for ; Thu, 23 Oct 2014 12:58:39 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
 h=from:to:cc:subject:date:message-id:in-reply-to:references
 :mime-version:content-type:content-transfer-encoding;
 bh=6n5ZJXUHzwY7dwNVzzHzYTcq9PwM6QzFk46g7hPHNKE=;
 b=enjpooQ28PSfDTPmGJXPYQuAoWmR+kPezXmQ60/y5ar+luKChTEEc8dRN4IyfkZQt4
 Z+Jf2ZjLUq/e6OH+eZc2+N2S9EyyHcvmYF774hT+mE4jivMqhOWx8mDNY0+6Bav5XpY2
 +M5Iv9+Pnvfj9RecjDYHrfIJldwnVayUkBqEjhr9WX5ovph+oz17WDYNKa6yIe5eGvWG
 iXJBuk1MA1T0IMWTzQiasrYceB/heMGNAUzZ143JQ9tWyhJlKU1pr9bnjnkxMf6/knwa
 wLT2b5Xw0YyVORCFZgZsLfalltlHrEgosSk4oeIOXBKYOWm4EJlOLEmX3Hyz/cxxCbpM
 TiQg==
X-Received: by 10.170.84.66 with SMTP id b63mr908033yka.69.1414094319133;
 Thu, 23 Oct 2014 12:58:39 -0700 (PDT)
Received: from m.west.isilon.com (c-98-209-117-232.hsd1.mi.comcast.net.
 [98.209.117.232])
 by mx.google.com with ESMTPSA id x9sm2642586igl.10.2014.10.23.12.58.38
 for 
 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128);
 Thu, 23 Oct 2014 12:58:38 -0700 (PDT)
From: Conrad Meyer 
To: libvir-list@redhat.com
Subject: [PATCH 2/2] Generated PO files for 'bhyve: Support /domain/bootloader'
Date: Thu, 23 Oct 2014 15:58:04 -0400
Message-Id: <1414094284-29055-3-git-send-email-cse.cem@gmail.com>
X-Mailer: git-send-email 1.9.3
In-Reply-To: <1414094284-29055-1-git-send-email-cse.cem@gmail.com>
References: <1414094284-29055-1-git-send-email-cse.cem@gmail.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 8bit
Cc: Conrad Meyer , freebsd-virtualization@freebsd.org
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Thu, 23 Oct 2014 19:58:40 -0000

Sponsored by:   EMC / Isilon storage division

Signed-off-by: Conrad Meyer 
---
 po/af.po       | 4 ++++
 po/am.po       | 4 ++++
 po/ar.po       | 4 ++++
 po/as.po       | 4 ++++
 po/be.po       | 4 ++++
 po/bg.po       | 4 ++++
 po/bn.po       | 4 ++++
 po/bn_IN.po    | 4 ++++
 po/bo.po       | 4 ++++
 po/bs.po       | 4 ++++
 po/ca.po       | 4 ++++
 po/cs.po       | 4 ++++
 po/cy.po       | 4 ++++
 po/da.po       | 4 ++++
 po/de.po       | 4 ++++
 po/el.po       | 4 ++++
 po/en_GB.po    | 4 ++++
 po/es.po       | 4 ++++
 po/et.po       | 4 ++++
 po/eu_ES.po    | 4 ++++
 po/fa.po       | 4 ++++
 po/fi.po       | 4 ++++
 po/fr.po       | 4 ++++
 po/gl.po       | 4 ++++
 po/gu.po       | 4 ++++
 po/he.po       | 4 ++++
 po/hi.po       | 4 ++++
 po/hr.po       | 4 ++++
 po/hu.po       | 4 ++++
 po/hy.po       | 4 ++++
 po/id.po       | 4 ++++
 po/is.po       | 4 ++++
 po/it.po       | 4 ++++
 po/ja.po       | 4 ++++
 po/ka.po       | 4 ++++
 po/kn.po       | 4 ++++
 po/ko.po       | 4 ++++
 po/ku.po       | 4 ++++
 po/lo.po       | 4 ++++
 po/lt.po       | 4 ++++
 po/lv.po       | 4 ++++
 po/mk.po       | 4 ++++
 po/ml.po       | 4 ++++
 po/mr.po       | 4 ++++
 po/ms.po       | 4 ++++
 po/my.po       | 4 ++++
 po/nb.po       | 4 ++++
 po/nl.po       | 4 ++++
 po/nn.po       | 4 ++++
 po/nso.po      | 4 ++++
 po/or.po       | 4 ++++
 po/pa.po       | 4 ++++
 po/pl.po       | 4 ++++
 po/pt.po       | 4 ++++
 po/pt_BR.po    | 4 ++++
 po/ro.po       | 4 ++++
 po/ru.po       | 4 ++++
 po/si.po       | 4 ++++
 po/sk.po       | 4 ++++
 po/sl.po       | 4 ++++
 po/sq.po       | 4 ++++
 po/sr.po       | 4 ++++
 po/sr@latin.po | 4 ++++
 po/sv.po       | 4 ++++
 po/ta.po       | 4 ++++
 po/te.po       | 4 ++++
 po/th.po       | 4 ++++
 po/tr.po       | 4 ++++
 po/uk.po       | 4 ++++
 po/ur.po       | 4 ++++
 po/vi.po       | 4 ++++
 po/vi_VN.po    | 4 ++++
 po/zh_CN.po    | 4 ++++
 po/zh_TW.po    | 4 ++++
 po/zu.po       | 4 ++++
 75 files changed, 300 insertions(+)

diff --git a/po/af.po b/po/af.po
index 0e1374d..6e54827 100644
--- a/po/af.po
+++ b/po/af.po
@@ -853,6 +853,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/am.po b/po/am.po
index 8230ec8..c664b6b 100644
--- a/po/am.po
+++ b/po/am.po
@@ -853,6 +853,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/ar.po b/po/ar.po
index fed8f1f..3745c56 100644
--- a/po/ar.po
+++ b/po/ar.po
@@ -854,6 +854,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/as.po b/po/as.po
index b2bba9a..1e8ecad 100644
--- a/po/as.po
+++ b/po/as.po
@@ -915,6 +915,10 @@ msgstr "উৎস পথৰ অবিহনে cdrom ডিভাইচ সম
 msgid "domain should have at least one disk defined"
 msgstr "ডমেইনৰ অন্তত এটা ডিস্ক বিৱৰিত থাকিব লাগিব"
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr "PCI বাচ 0 স্লট 1 ইমপ্লিচিট LPC PCI-ISA ব্ৰিজৰ বাবে সংৰক্ষিত"
diff --git a/po/be.po b/po/be.po
index 1f4b856..3b5ff79 100644
--- a/po/be.po
+++ b/po/be.po
@@ -854,6 +854,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/bg.po b/po/bg.po
index 05d9e5d..0d75cb5 100644
--- a/po/bg.po
+++ b/po/bg.po
@@ -855,6 +855,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/bn.po b/po/bn.po
index ab15fc4..3c8cf38 100644
--- a/po/bn.po
+++ b/po/bn.po
@@ -853,6 +853,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/bn_IN.po b/po/bn_IN.po
index 88dd968..ac3af06 100644
--- a/po/bn_IN.po
+++ b/po/bn_IN.po
@@ -876,6 +876,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/bo.po b/po/bo.po
index cfbee90..55c561b 100644
--- a/po/bo.po
+++ b/po/bo.po
@@ -851,6 +851,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/bs.po b/po/bs.po
index 80c8ac2..90381b3 100644
--- a/po/bs.po
+++ b/po/bs.po
@@ -855,6 +855,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/ca.po b/po/ca.po
index 2ccbfdc..f14e08a 100644
--- a/po/ca.po
+++ b/po/ca.po
@@ -858,6 +858,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/cs.po b/po/cs.po
index 35a9ba6..dd44065 100644
--- a/po/cs.po
+++ b/po/cs.po
@@ -862,6 +862,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/cy.po b/po/cy.po
index 51e11b8..466965b 100644
--- a/po/cy.po
+++ b/po/cy.po
@@ -854,6 +854,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/da.po b/po/da.po
index 04d39ad..a820ecb 100644
--- a/po/da.po
+++ b/po/da.po
@@ -856,6 +856,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/de.po b/po/de.po
index 64cf6fe..f15b826 100644
--- a/po/de.po
+++ b/po/de.po
@@ -911,6 +911,10 @@ msgstr "Benannte Einheiten-Aliasnamen werden nicht unterstützt"
 msgid "domain should have at least one disk defined"
 msgstr "Domain XML muss zumindest ein  Element enthalten."
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/el.po b/po/el.po
index c62c443..fdd00d4 100644
--- a/po/el.po
+++ b/po/el.po
@@ -869,6 +869,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/en_GB.po b/po/en_GB.po
index 833044a..55beffd 100644
--- a/po/en_GB.po
+++ b/po/en_GB.po
@@ -916,6 +916,10 @@ msgstr "Named device aliases are not supported"
 msgid "domain should have at least one disk defined"
 msgstr "Domain XML must contain at least one  element."
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/es.po b/po/es.po
index 8a54e10..7946ae0 100644
--- a/po/es.po
+++ b/po/es.po
@@ -900,6 +900,10 @@ msgstr "Los dispositivos llamados alias no tienen soporte"
 msgid "domain should have at least one disk defined"
 msgstr "XML de dominio debe contener al menos un elemento ."
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/et.po b/po/et.po
index bd5d59f..b74b89d 100644
--- a/po/et.po
+++ b/po/et.po
@@ -853,6 +853,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/eu_ES.po b/po/eu_ES.po
index 3939c44..3e0f2f8 100644
--- a/po/eu_ES.po
+++ b/po/eu_ES.po
@@ -853,6 +853,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/fa.po b/po/fa.po
index dba48be..00782ce 100644
--- a/po/fa.po
+++ b/po/fa.po
@@ -853,6 +853,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/fi.po b/po/fi.po
index 2e487f7..c2eb1cd 100644
--- a/po/fi.po
+++ b/po/fi.po
@@ -854,6 +854,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/fr.po b/po/fr.po
index 4e46d32..05ed448 100644
--- a/po/fr.po
+++ b/po/fr.po
@@ -899,6 +899,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/gl.po b/po/gl.po
index 7e089a0..ee0c2a8 100644
--- a/po/gl.po
+++ b/po/gl.po
@@ -853,6 +853,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/gu.po b/po/gu.po
index fea7041..d050c35 100644
--- a/po/gu.po
+++ b/po/gu.po
@@ -913,6 +913,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/he.po b/po/he.po
index e236131..786699d 100644
--- a/po/he.po
+++ b/po/he.po
@@ -853,6 +853,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/hi.po b/po/hi.po
index d918984..b3dc6d8 100644
--- a/po/hi.po
+++ b/po/hi.po
@@ -890,6 +890,10 @@ msgstr "नामित युक्ति एलियास समर्थि
 msgid "domain should have at least one disk defined"
 msgstr "डोमेन XML कम से कम एक  तत्व शामिल करना अनिवार्य है."
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/hr.po b/po/hr.po
index 3dda86b..d532f83 100644
--- a/po/hr.po
+++ b/po/hr.po
@@ -855,6 +855,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/hu.po b/po/hu.po
index f0cd18f..5dc6b83 100644
--- a/po/hu.po
+++ b/po/hu.po
@@ -855,6 +855,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/hy.po b/po/hy.po
index 182b4ef..4d1fc59 100644
--- a/po/hy.po
+++ b/po/hy.po
@@ -853,6 +853,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/id.po b/po/id.po
index 97578be..c758356 100644
--- a/po/id.po
+++ b/po/id.po
@@ -856,6 +856,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/is.po b/po/is.po
index 321b801..5b16607 100644
--- a/po/is.po
+++ b/po/is.po
@@ -853,6 +853,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/it.po b/po/it.po
index 5e52e2f..77c1368 100644
--- a/po/it.po
+++ b/po/it.po
@@ -867,6 +867,10 @@ msgstr "non è supportato il collegamento a caldo dell'unità"
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/ja.po b/po/ja.po
index 52c8b86..801398a 100644
--- a/po/ja.po
+++ b/po/ja.po
@@ -919,6 +919,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/ka.po b/po/ka.po
index 51fb83d..dab5f16 100644
--- a/po/ka.po
+++ b/po/ka.po
@@ -853,6 +853,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/kn.po b/po/kn.po
index 74589ab..e74ba4f 100644
--- a/po/kn.po
+++ b/po/kn.po
@@ -900,6 +900,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/ko.po b/po/ko.po
index 06c5f63..7f216ff 100644
--- a/po/ko.po
+++ b/po/ko.po
@@ -882,6 +882,10 @@ msgstr "원본 경로가 없는 CD-ROM 장치를 지원하지 않습니다"
 msgid "domain should have at least one disk defined"
 msgstr "도메인은 최소 하나의 디스크를 정의해야 합니다"
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr "PCI 버스 0 슬롯 1은 암시적 LPC PCI-ISA 브릿지에 예약되어 있습니다"
diff --git a/po/ku.po b/po/ku.po
index 0ca4331..7a30d94 100644
--- a/po/ku.po
+++ b/po/ku.po
@@ -853,6 +853,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/lo.po b/po/lo.po
index ee3285c..1237bfe 100644
--- a/po/lo.po
+++ b/po/lo.po
@@ -853,6 +853,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/lt.po b/po/lt.po
index 3547478..e9410d9 100644
--- a/po/lt.po
+++ b/po/lt.po
@@ -854,6 +854,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/lv.po b/po/lv.po
index da15417..db3fc85 100644
--- a/po/lv.po
+++ b/po/lv.po
@@ -854,6 +854,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/mk.po b/po/mk.po
index bca6175..cba9c7d 100644
--- a/po/mk.po
+++ b/po/mk.po
@@ -856,6 +856,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/ml.po b/po/ml.po
index a316f8f..6dd9a56 100644
--- a/po/ml.po
+++ b/po/ml.po
@@ -905,6 +905,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/mr.po b/po/mr.po
index 4feb3ca..1f40e27 100644
--- a/po/mr.po
+++ b/po/mr.po
@@ -912,6 +912,10 @@ msgstr "स्रोत मार्गविना cdrom साधन समर
 msgid "domain should have at least one disk defined"
 msgstr "डोमेनकडे किमान एक डिस्क ठरविलेले पाहिजे"
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr "PCI बस 0 स्लॉट 1 आरक्षित आहे, सूचीत PC PCI-ISA ब्रिजकरिता"
diff --git a/po/ms.po b/po/ms.po
index f3dd1e7..9618322 100644
--- a/po/ms.po
+++ b/po/ms.po
@@ -853,6 +853,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/my.po b/po/my.po
index 92a4af8..0e225fb 100644
--- a/po/my.po
+++ b/po/my.po
@@ -853,6 +853,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/nb.po b/po/nb.po
index ff77e7c..9bf88ef 100644
--- a/po/nb.po
+++ b/po/nb.po
@@ -855,6 +855,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/nl.po b/po/nl.po
index f906e10..a8f76fc 100644
--- a/po/nl.po
+++ b/po/nl.po
@@ -867,6 +867,10 @@ msgstr "Benoemde apparaat aliassen worden niet ondersteund"
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/nn.po b/po/nn.po
index 1fdb298..e8de23c 100644
--- a/po/nn.po
+++ b/po/nn.po
@@ -853,6 +853,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/nso.po b/po/nso.po
index ca73df5..3569368 100644
--- a/po/nso.po
+++ b/po/nso.po
@@ -853,6 +853,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/or.po b/po/or.po
index 4f99a8b..995544e 100644
--- a/po/or.po
+++ b/po/or.po
@@ -876,6 +876,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/pa.po b/po/pa.po
index 9f8c9d9..e9fd8db 100644
--- a/po/pa.po
+++ b/po/pa.po
@@ -895,6 +895,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/pl.po b/po/pl.po
index fb7e20c..1718bfd 100644
--- a/po/pl.po
+++ b/po/pl.po
@@ -867,6 +867,10 @@ msgstr "Aliasy nazwanych urządzeń są nieobsługiwane"
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/pt.po b/po/pt.po
index a5a1f50..671f2c2 100644
--- a/po/pt.po
+++ b/po/pt.po
@@ -854,6 +854,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/pt_BR.po b/po/pt_BR.po
index f261bbd..d70c20e 100644
--- a/po/pt_BR.po
+++ b/po/pt_BR.po
@@ -902,6 +902,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/ro.po b/po/ro.po
index b7efaf0..9321cee 100644
--- a/po/ro.po
+++ b/po/ro.po
@@ -854,6 +854,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/ru.po b/po/ru.po
index 3b6b6a6..2272f7f 100644
--- a/po/ru.po
+++ b/po/ru.po
@@ -918,6 +918,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/si.po b/po/si.po
index 18f0dea..2fe3215 100644
--- a/po/si.po
+++ b/po/si.po
@@ -853,6 +853,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/sk.po b/po/sk.po
index 8d55137..d9f26c9 100644
--- a/po/sk.po
+++ b/po/sk.po
@@ -853,6 +853,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/sl.po b/po/sl.po
index 9425c9d..bf5d86f 100644
--- a/po/sl.po
+++ b/po/sl.po
@@ -854,6 +854,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/sq.po b/po/sq.po
index 3a597d0..bac1d70 100644
--- a/po/sq.po
+++ b/po/sq.po
@@ -853,6 +853,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/sr.po b/po/sr.po
index f54d52f..a2b1ff5 100644
--- a/po/sr.po
+++ b/po/sr.po
@@ -871,6 +871,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/sr@latin.po b/po/sr@latin.po
index c9ae98f..586230f 100644
--- a/po/sr@latin.po
+++ b/po/sr@latin.po
@@ -871,6 +871,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/sv.po b/po/sv.po
index 0a1e320..f2e5bb6 100644
--- a/po/sv.po
+++ b/po/sv.po
@@ -860,6 +860,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/ta.po b/po/ta.po
index 61170be..4dfb2df 100644
--- a/po/ta.po
+++ b/po/ta.po
@@ -919,6 +919,10 @@ msgstr "மூலப் பாதையில்லாத cdrom சாதனம
 msgid "domain should have at least one disk defined"
 msgstr "டொமைனுக்கு குறைந்தது ஒரு வட்டேனும் வரையறுக்கப்பட்டிருக்க வேண்டும்"
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr "PCI பஸ் 0 ஸ்லாட் 1 மறைமுக LPC PCI-ISA பிரிட்ஜுக்காக ஒதுக்கப்பட்டது"
diff --git a/po/te.po b/po/te.po
index 2ad29f3..8d3f27b 100644
--- a/po/te.po
+++ b/po/te.po
@@ -880,6 +880,10 @@ msgstr "పేరుగల పరికర మారుపేర్లు తో
 msgid "domain should have at least one disk defined"
 msgstr "డొమైన్ XML తప్పక వొక  మూలకం కలిగివుండాలి."
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/th.po b/po/th.po
index 8d6c983..ffb4c19 100644
--- a/po/th.po
+++ b/po/th.po
@@ -853,6 +853,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/tr.po b/po/tr.po
index 5502581..76b1fad 100644
--- a/po/tr.po
+++ b/po/tr.po
@@ -853,6 +853,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/uk.po b/po/uk.po
index ba17e24..36e5338 100644
--- a/po/uk.po
+++ b/po/uk.po
@@ -923,6 +923,10 @@ msgstr "підтримки пристроїв cdrom без шляху до дж
 msgid "domain should have at least one disk defined"
 msgstr "для домену слід визначити принаймні один диск"
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr "Слот 1 каналу PCI 0 зарезервовано для неявного містка LPC PCI-ISA"
diff --git a/po/ur.po b/po/ur.po
index e15d614..74a926f 100644
--- a/po/ur.po
+++ b/po/ur.po
@@ -853,6 +853,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/vi.po b/po/vi.po
index 4974c2c..8f93aaa 100644
--- a/po/vi.po
+++ b/po/vi.po
@@ -867,6 +867,10 @@ msgstr "lưu trữ bí mật không được hỗ trợ"
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/vi_VN.po b/po/vi_VN.po
index 1e9af39..2e335bc 100644
--- a/po/vi_VN.po
+++ b/po/vi_VN.po
@@ -867,6 +867,10 @@ msgstr "lưu trữ bí mật không được hỗ trợ"
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/zh_CN.po b/po/zh_CN.po
index afc2e3b..a2464e3 100644
--- a/po/zh_CN.po
+++ b/po/zh_CN.po
@@ -886,6 +886,10 @@ msgstr "不支持命名的设备别名"
 msgid "domain should have at least one disk defined"
 msgstr "域 XML 必须包含至少一个  元素"
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/zh_TW.po b/po/zh_TW.po
index 812901c..b034bb8 100644
--- a/po/zh_TW.po
+++ b/po/zh_TW.po
@@ -859,6 +859,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/zu.po b/po/zu.po
index 8a04324..83f3147 100644
--- a/po/zu.po
+++ b/po/zu.po
@@ -853,6 +853,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
-- 
1.9.3


From owner-freebsd-virtualization@FreeBSD.ORG  Thu Oct 23 22:30:14 2014
Return-Path: 
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id AADBD400;
 Thu, 23 Oct 2014 22:30:14 +0000 (UTC)
Received: from mail-la0-x22e.google.com (mail-la0-x22e.google.com
 [IPv6:2a00:1450:4010:c03::22e])
 (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
 (Client CN "smtp.gmail.com",
 Issuer "Google Internet Authority G2" (verified OK))
 by mx1.freebsd.org (Postfix) with ESMTPS id BA0EAB50;
 Thu, 23 Oct 2014 22:30:13 +0000 (UTC)
Received: by mail-la0-f46.google.com with SMTP id gi9so1704324lab.33
 for ; Thu, 23 Oct 2014 15:30:11 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
 h=mime-version:sender:in-reply-to:references:date:message-id:subject
 :from:to:cc:content-type;
 bh=/5fqvNvE/qdXl+isJp4pGo9u4qWhv3pR10hD+WYUvRE=;
 b=bNc8/R4fGAYwoTexq4fMoSUj1U/wgQ5WY3kuf4WXaC8t3F5jwPuv+Vx3i7liDMqJr+
 DUksZTXY8/Arf3lmuqQEvAwl8FlkQiRMN0RSPfCoeiCptoQndikPuvr39NDHtrs9A5xe
 jtGnqBa+kJZwAVf8WgKDiNtfttlu6XG+Ob7GQVvxybL9NFwZ1gjT2IXjZ2vu/p6srDM4
 6PjiyhblmqUwqbyv2156oJLC+C+n8wE2XL4VPE9psR+ZzdsKK/Q8Ghy/6nAHl2lflbuh
 Jzjd24oPpLFfagvlQDv5ElIFRXDaoCa0K9+kCfKKfdARlrdE7YJ7csC2XJvoxWumwebq
 H4Rg==
MIME-Version: 1.0
X-Received: by 10.152.42.172 with SMTP id p12mr438220lal.11.1414103411024;
 Thu, 23 Oct 2014 15:30:11 -0700 (PDT)
Sender: crodr001@gmail.com
Received: by 10.112.84.197 with HTTP; Thu, 23 Oct 2014 15:30:10 -0700 (PDT)
In-Reply-To: 
References: 
 
Date: Thu, 23 Oct 2014 15:30:10 -0700
X-Google-Sender-Auth: Vjq-Kaj1UQORJRV-k9cUp2U4-Mw
Message-ID: 
Subject: Re: Automatically running /usr/tests on stable/10 branch under Jenkins
From: Craig Rodrigues 
To: Garrett Cooper 
Content-Type: text/plain; charset=ISO-8859-1
X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1
Cc: "freebsd-testing@freebsd.org" ,
 FreeBSD stable ,
 "freebsd-virtualization@freebsd.org" 
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Thu, 23 Oct 2014 22:30:14 -0000

Garrett Cooper wrote:

>
> Hi Craig!
>         As much as everyone would like to take i386 out to pasture,
> there's a large degree of value in running i386 tests on 11-CURRENT and
> 10-STABLE (I've caught some interesting build bugs and test bugs by running
> on my i386/CURRENT VM). Are there any plans to have i386 executors running
> tests anytime soon (does bhyve support i386?)?
>


We (jenkins-admin@freebsd.org) have been busy the 5 months since BSDCan
2014 as
you can see by our status report, which lists what we have done, and what
our future plans are:

https://www.freebsd.org/news/status/report-2014-07-2014-09.html#Jenkins-Continuous-Integration-for-FreeBSD

Integrating Jenkins with Kyua on amd64 was a major milestone which was
achieved, and
was even mentioned on the Jenkins web site:

http://jenkins-ci.org/content/freebsd-project-use-jenkins-os-testing

Now, where to take this further (such as i386) is an interesting question.

Personally, I would like to see:
   -> integration of automated kyua testing with the FreeBSD release
engineering process
   -> more involvement from FreeBSD developers, and even companies such as
EMC/Isilon,
       who can:
           -> write tests
           -> suggest and implement new tests (network, storage, VM, etc.)
           -> help with devops maintenance of the existing
jenkins.freebsd.org cluster
           -> improve bhyve support in libvirt
           -> set up their own Jenkins build environments outside of
FreeBSD, and help test things in their own private environments

I've had requests for;
   -> running tests in bhyve VM's with very small memory footprints
(Adrian Chadd)
   -> running tests in MIPS environment (Adrian Chadd)
   -> running Java JDK tests (Kip Macy)
   -> i386 builds (Garrett Cooper)

There are a lot of different directions to take this, but without more
people (and companies) pitching in and helping out,
progress is limited by bodies working on the stuff.

I will be at the MeetBSD Vendor summit (not the conference) Nov. 3-4, so
hopefully
anyone interested in pushing this stuff forward can talk to me there.

--
Craig

From owner-freebsd-virtualization@FreeBSD.ORG  Thu Oct 23 22:56:53 2014
Return-Path: 
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id EDE72E6C
 for ; Thu, 23 Oct 2014 22:56:53 +0000 (UTC)
Received: from alto.onthenet.com.au (alto.OntheNet.com.au [203.13.68.12])
 by mx1.freebsd.org (Postfix) with ESMTP id AEDFEE1D
 for ; Thu, 23 Oct 2014 22:56:53 +0000 (UTC)
Received: from dommail.onthenet.com.au (dommail.OntheNet.com.au [203.13.70.57])
 by alto.onthenet.com.au (Postfix) with ESMTP id 3871E12790;
 Fri, 24 Oct 2014 08:55:36 +1000 (EST)
Received: from Peter-Grehans-MacBook-Pro-2.local ([64.245.0.210])
 by dommail.onthenet.com.au (MOS 4.4.4-GA)
 with ESMTP id BZF00611 (AUTH peterg@ptree32.com.au);
 Fri, 24 Oct 2014 08:55:34 +1000
Message-ID: <54498764.6080404@freebsd.org>
Date: Thu, 23 Oct 2014 15:55:32 -0700
From: Peter Grehan 
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6;
 rv:24.0) Gecko/20100101 Thunderbird/24.6.0
MIME-Version: 1.0
To: Conrad Meyer 
Subject: Re: [PATCH 1/2] bhyve: Support /domain/bootloader configuration for
 non-FreeBSD guests.
References: <1414094284-29055-1-git-send-email-cse.cem@gmail.com>
 <1414094284-29055-2-git-send-email-cse.cem@gmail.com>
In-Reply-To: <1414094284-29055-2-git-send-email-cse.cem@gmail.com>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
Cc: Conrad Meyer , freebsd-virtualization@freebsd.org
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Thu, 23 Oct 2014 22:56:54 -0000

Hi Conrad,

> Also, flip Bhyve /domain/os/type support from HVM to Xen. Bhyve only
> supports paravirtualized guests, and 'xen' is closest to that.

  That's not true: bhyve has enough h/w emulation required to run 
unmodified guests - there are register-level emulations of the local 
APIC, I/O APIC, PIT, PIC, RTC, HPET, APCI timer, PCI/PCIe support, and AHCI.

  While virtio devices may be categorised as PV, in reality they're seen 
by a guest o/s as PCI devices and can be considered HVM.

  The bhyveload/grub-bhyve user-space loaders are an artifact of how 
bhyve was initially developed - they will be made redundant when the 
UEFI work is done, at which point bhyve will have a BIOS.

later,

Peter.


From owner-freebsd-virtualization@FreeBSD.ORG  Thu Oct 23 23:16:19 2014
Return-Path: 
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id BD1254AC;
 Thu, 23 Oct 2014 23:16:19 +0000 (UTC)
Received: from mail-qa0-x22f.google.com (mail-qa0-x22f.google.com
 [IPv6:2607:f8b0:400d:c00::22f])
 (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
 (Client CN "smtp.gmail.com",
 Issuer "Google Internet Authority G2" (verified OK))
 by mx1.freebsd.org (Postfix) with ESMTPS id 6D16CFDD;
 Thu, 23 Oct 2014 23:16:19 +0000 (UTC)
Received: by mail-qa0-f47.google.com with SMTP id dc16so226326qab.6
 for ; Thu, 23 Oct 2014 16:16:18 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
 h=mime-version:in-reply-to:references:date:message-id:subject:from:to
 :cc:content-type:content-transfer-encoding;
 bh=ihr/wlPTcDcDR75a6BTtSL34TkdYWFmRPGgluavaf7o=;
 b=dEApNhrzcL+GaALY6EcHskWnV3Bu2UyTglGLL6OKs4K8Q6Iu0Kl3RwwqeGM5HXR/7o
 IKAIS4mRKXK0ImKgS2/r4lovQzJLhW22VqkldivXUjkIs8yeqoO3lRyogZ0ih50TD2xS
 GcUgTHBshxuwBLAskrguGa2nnjsuycb+y5XQaD5FpfMIKakkE8UEPYPkM8SCSUkHaSD1
 c/bOnJixq43ntMut/73dMCsBJ9y9VnFtEU8uYYr7KlvgW7xoNiBJJJwVtEVBNforWCEK
 KhpH0wongjEZT3+FdhGvzktKU941SNM63s/g69O2dLI9SWD86l7bJ2mjdqqJTE9BP410
 NaHg==
MIME-Version: 1.0
X-Received: by 10.170.60.197 with SMTP id c188mr584737ykc.61.1414106178427;
 Thu, 23 Oct 2014 16:16:18 -0700 (PDT)
Received: by 10.220.150.68 with HTTP; Thu, 23 Oct 2014 16:16:18 -0700 (PDT)
In-Reply-To: <54498764.6080404@freebsd.org>
References: <1414094284-29055-1-git-send-email-cse.cem@gmail.com>
 <1414094284-29055-2-git-send-email-cse.cem@gmail.com>
 <54498764.6080404@freebsd.org>
Date: Thu, 23 Oct 2014 19:16:18 -0400
Message-ID: 
Subject: Re: [PATCH 1/2] bhyve: Support /domain/bootloader configuration for
 non-FreeBSD guests.
From: Conrad Rad 
To: Peter Grehan 
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
Cc: Conrad Meyer ,
 "freebsd-virtualization@freebsd.org" 
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Thu, 23 Oct 2014 23:16:19 -0000

On Thu, Oct 23, 2014 at 6:55 PM, Peter Grehan  wrote:
>> Also, flip Bhyve /domain/os/type support from HVM to Xen. Bhyve only
>> supports paravirtualized guests, and 'xen' is closest to that.
>
>  That's not true: bhyve has enough h/w emulation required to run unmodifi=
ed
> guests - there are register-level emulations of the local APIC, I/O APIC,
> PIT, PIC, RTC, HPET, APCI timer, PCI/PCIe support, and AHCI.
>
>  While virtio devices may be categorised as PV, in reality they're seen b=
y a
> guest o/s as PCI devices and can be considered HVM.
>
>  The bhyveload/grub-bhyve user-space loaders are an artifact of how bhyve
> was initially developed - they will be made redundant when the UEFI work =
is
> done, at which point bhyve will have a BIOS.


Hi Peter,

I'm happy to drop the hvm -> xen changes. I'll need to change the
domain parsing code to allow hvm domains to set  options =E2=80=
=94
currently it only allows xen domains to do so.

Unless I'm mistaken, the userspace loaders are still needed to boot
VMs for now. Will the Bhyve UEFI work be complete before MeetBSD? And
is it going into the FreeBSD 10 release branch, or only in 11?

Until that code actually materializes, I think it's important to fix
libvirt now. This change doesn't break a future Bhyve-that-supports
EUFI, and it can even be yanked out later if totally redundant. Until
UEFI support materializes, Linux guests are broken in libvirt-bhyve.

I'll rework and submit a v2.

Thanks,
Conrad

From owner-freebsd-virtualization@FreeBSD.ORG  Thu Oct 23 23:21:22 2014
Return-Path: 
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 0E751956;
 Thu, 23 Oct 2014 23:21:22 +0000 (UTC)
Received: from mail-yh0-x231.google.com (mail-yh0-x231.google.com
 [IPv6:2607:f8b0:4002:c01::231])
 (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
 (Client CN "smtp.gmail.com",
 Issuer "Google Internet Authority G2" (verified OK))
 by mx1.freebsd.org (Postfix) with ESMTPS id B667A122;
 Thu, 23 Oct 2014 23:21:21 +0000 (UTC)
Received: by mail-yh0-f49.google.com with SMTP id a41so1138040yho.36
 for ; Thu, 23 Oct 2014 16:21:21 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
 h=mime-version:in-reply-to:references:date:message-id:subject:from:to
 :cc:content-type:content-transfer-encoding;
 bh=Q3byFZKza3EnoJSvo8w/+UGHFIFAj/oSBskpekL13a8=;
 b=KHXxo/jZrSCZ12A3we8d0IxOHskKZlUPPEDAJ+CFFCG/3YwKu0+Ww9P+9E6TO8meTW
 ea+xmxOb9RE0bmfuulcJZOdXXXbSps8g11mJSi7+Dojpcmkf6ZQMUP+pQTpclsHL6G0q
 okCowJnwl+WsouWpgCbiohAAMkst74xfHMPUhwlnlTTJ0lCufnBJemTdw1NYCsVsf0sO
 +sH/LmdjNfZHxO51SlGRaQeMLY/Bv7mw/ZazBaltsu6W4xCsY4m6/0gRNJZvnaECcVsU
 hhrLHgvDauijuCVmGrRoDMK2EB/0M/BotsWc1LxJ05RVw91p42z6v5h/yNsRArIhlB9X
 tCAw==
MIME-Version: 1.0
X-Received: by 10.170.60.197 with SMTP id c188mr609075ykc.61.1414106480937;
 Thu, 23 Oct 2014 16:21:20 -0700 (PDT)
Received: by 10.220.150.68 with HTTP; Thu, 23 Oct 2014 16:21:20 -0700 (PDT)
In-Reply-To: 
References: <1414094284-29055-1-git-send-email-cse.cem@gmail.com>
 <1414094284-29055-2-git-send-email-cse.cem@gmail.com>
 <54498764.6080404@freebsd.org>
 
Date: Thu, 23 Oct 2014 19:21:20 -0400
Message-ID: 
Subject: Re: [PATCH 1/2] bhyve: Support /domain/bootloader configuration for
 non-FreeBSD guests.
From: Conrad Rad 
To: Peter Grehan 
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
Cc: Conrad Meyer ,
 "freebsd-virtualization@freebsd.org" 
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Thu, 23 Oct 2014 23:21:22 -0000

On Thu, Oct 23, 2014 at 7:16 PM, Conrad Rad  wrote:
> I'll need to change the
> domain parsing code to allow hvm domains to set  options =E2=
=80=94
> currently it only allows xen domains to do so.

My bad, I read that wrong. It defaults to "xen" if no OS type is
otherwise specified and you specify a .

Best,
Conrad

From owner-freebsd-virtualization@FreeBSD.ORG  Thu Oct 23 23:28:58 2014
Return-Path: 
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 2CC03B69
 for ; Thu, 23 Oct 2014 23:28:58 +0000 (UTC)
Received: from mail-yh0-x231.google.com (mail-yh0-x231.google.com
 [IPv6:2607:f8b0:4002:c01::231])
 (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
 (Client CN "smtp.gmail.com",
 Issuer "Google Internet Authority G2" (verified OK))
 by mx1.freebsd.org (Postfix) with ESMTPS id E5547166
 for ; Thu, 23 Oct 2014 23:28:57 +0000 (UTC)
Received: by mail-yh0-f49.google.com with SMTP id a41so1195072yho.22
 for ; Thu, 23 Oct 2014 16:28:57 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
 h=from:to:cc:subject:date:message-id;
 bh=e0OQskGoVXFgWjTKSoFax34AQDYEJUOD9pQwvctFiFQ=;
 b=qnFhqWSb45lWonfoFAiCbOuFJYSNeYrw4NORCYDTgNyS2ameZd1w8jf4kvYQnuddlP
 HbISkZWcRmCdW4W0Sy0FJ8o2nk4gW+rgBdKUqjy7K2kFcxc/GE5pZWf/jSg4eFWqrHAb
 1pNakYuwF1Udmniq8MTuavrBOjdE1AF6VywOd3/dIn3d6m7glTxDvX3w/GaTHqBPMmMT
 73BwmClpo1PC862a2yWpkLMNAGa2b/S4FM7Uxvnu2DMY4nLrSeK5z3fNSPzv8GVLhWkW
 o9h8IpzJm0zXUK0exBcuru+WK4MA/RUt1RlhiUBGCPjALLduAzriYMMWQYP73+YE0jdn
 V3rA==
X-Received: by 10.170.90.212 with SMTP id h203mr689452yka.106.1414106937145;
 Thu, 23 Oct 2014 16:28:57 -0700 (PDT)
Received: from m.west.isilon.com (c-98-209-117-232.hsd1.mi.comcast.net.
 [98.209.117.232])
 by mx.google.com with ESMTPSA id xb4sm79861igc.11.2014.10.23.16.28.56
 for 
 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128);
 Thu, 23 Oct 2014 16:28:56 -0700 (PDT)
From: Conrad Meyer 
To: libvir-list@redhat.com
Subject: [PATCHv2 0/2] Add non-FreeBSD guest support to Bhyve driver.
Date: Thu, 23 Oct 2014 19:28:41 -0400
Message-Id: <1414106923-32313-1-git-send-email-cse.cem@gmail.com>
X-Mailer: git-send-email 1.9.3
Cc: freebsd-virtualization@freebsd.org
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Thu, 23 Oct 2014 23:28:58 -0000

Drvbhyve hardcodes bhyveload(8) as the host bootloader for guests.
bhyveload(8) loader only supports FreeBSD guests.

This patch adds  and  handling to
bhyve_command, so libvirt can boot non-FreeBSD guests in Bhyve.

See patch logs for further details.

Thanks,
Conrad

Changelog:
v2:
  - Dropped hvm -> xen change per Peter's feedback.

Conrad Meyer (2):
  bhyve: Support /domain/bootloader configuration for non-FreeBSD
    guests.
  Generated PO files for 'bhyve: Support /domain/bootloader'

 docs/drvbhyve.html.in     |  28 ++++++++++--
 docs/formatdomain.html.in |   4 +-
 po/af.po                  |   4 ++
 po/am.po                  |   4 ++
 po/ar.po                  |   4 ++
 po/as.po                  |   4 ++
 po/be.po                  |   4 ++
 po/bg.po                  |   4 ++
 po/bn.po                  |   4 ++
 po/bn_IN.po               |   4 ++
 po/bo.po                  |   4 ++
 po/bs.po                  |   4 ++
 po/ca.po                  |   4 ++
 po/cs.po                  |   4 ++
 po/cy.po                  |   4 ++
 po/da.po                  |   4 ++
 po/de.po                  |   4 ++
 po/el.po                  |   4 ++
 po/en_GB.po               |   4 ++
 po/es.po                  |   4 ++
 po/et.po                  |   4 ++
 po/eu_ES.po               |   4 ++
 po/fa.po                  |   4 ++
 po/fi.po                  |   4 ++
 po/fr.po                  |   4 ++
 po/gl.po                  |   4 ++
 po/gu.po                  |   4 ++
 po/he.po                  |   4 ++
 po/hi.po                  |   4 ++
 po/hr.po                  |   4 ++
 po/hu.po                  |   4 ++
 po/hy.po                  |   4 ++
 po/id.po                  |   4 ++
 po/is.po                  |   4 ++
 po/it.po                  |   4 ++
 po/ja.po                  |   4 ++
 po/ka.po                  |   4 ++
 po/kn.po                  |   4 ++
 po/ko.po                  |   4 ++
 po/ku.po                  |   4 ++
 po/libvirt.pot            |   4 ++
 po/lo.po                  |   4 ++
 po/lt.po                  |   4 ++
 po/lv.po                  |   4 ++
 po/mk.po                  |   4 ++
 po/ml.po                  |   4 ++
 po/mr.po                  |   4 ++
 po/ms.po                  |   4 ++
 po/my.po                  |   4 ++
 po/nb.po                  |   4 ++
 po/nl.po                  |   4 ++
 po/nn.po                  |   4 ++
 po/nso.po                 |   4 ++
 po/or.po                  |   4 ++
 po/pa.po                  |   4 ++
 po/pl.po                  |   4 ++
 po/pt.po                  |   4 ++
 po/pt_BR.po               |   4 ++
 po/ro.po                  |   4 ++
 po/ru.po                  |   4 ++
 po/si.po                  |   4 ++
 po/sk.po                  |   4 ++
 po/sl.po                  |   4 ++
 po/sq.po                  |   4 ++
 po/sr.po                  |   4 ++
 po/sr@latin.po            |   4 ++
 po/sv.po                  |   4 ++
 po/ta.po                  |   4 ++
 po/te.po                  |   4 ++
 po/th.po                  |   4 ++
 po/tr.po                  |   4 ++
 po/uk.po                  |   4 ++
 po/ur.po                  |   4 ++
 po/vi.po                  |   4 ++
 po/vi_VN.po               |   4 ++
 po/zh_CN.po               |   4 ++
 po/zh_TW.po               |   4 ++
 po/zu.po                  |   4 ++
 src/bhyve/bhyve_command.c | 107 +++++++++++++++++++++++++++++++++++++++++-----
 79 files changed, 428 insertions(+), 15 deletions(-)

-- 
1.9.3


From owner-freebsd-virtualization@FreeBSD.ORG  Thu Oct 23 23:29:09 2014
Return-Path: 
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 440E6BAC
 for ; Thu, 23 Oct 2014 23:29:09 +0000 (UTC)
Received: from mail-yh0-x232.google.com (mail-yh0-x232.google.com
 [IPv6:2607:f8b0:4002:c01::232])
 (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
 (Client CN "smtp.gmail.com",
 Issuer "Google Internet Authority G2" (verified OK))
 by mx1.freebsd.org (Postfix) with ESMTPS id 03074169
 for ; Thu, 23 Oct 2014 23:29:08 +0000 (UTC)
Received: by mail-yh0-f50.google.com with SMTP id a41so1180965yho.23
 for ; Thu, 23 Oct 2014 16:29:08 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
 h=from:to:cc:subject:date:message-id:in-reply-to:references
 :mime-version:content-type:content-transfer-encoding;
 bh=6n5ZJXUHzwY7dwNVzzHzYTcq9PwM6QzFk46g7hPHNKE=;
 b=CB3aPbuszpzV/HLXqLtfIekkhP+xm1w4sDkBe9Lhzl+EhyW9Vo++II+HTgzEREhHUb
 fB7jUXyxrVNMtH7f3bj+sb8f5HW3tbnPqqjCKCszsJbg4u9w9rNfB3OXdci/eJDcmF46
 bNHIWAezXUkIAqLfefB6LAGA0y/mUDXf/gGH5I5v5SAB+vQkIm5NmISGm1wq2RrIiM2a
 Jh27+c6k8YIKAO8j9g42P5hDzJIOi/cKHXFJ7z30oITlv3zMvnsPbaXg9qI+7b5d2EIC
 HD2Ev2hpwDB0+kiuDuK/YAKbhKBNgdwsLP30xrjEVi3RTp8a77RvaiBUhiP9kB6Cm4W2
 05VA==
X-Received: by 10.170.62.84 with SMTP id e81mr566180yke.115.1414106947989;
 Thu, 23 Oct 2014 16:29:07 -0700 (PDT)
Received: from m.west.isilon.com (c-98-209-117-232.hsd1.mi.comcast.net.
 [98.209.117.232])
 by mx.google.com with ESMTPSA id xb4sm79861igc.11.2014.10.23.16.29.07
 for 
 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128);
 Thu, 23 Oct 2014 16:29:07 -0700 (PDT)
From: Conrad Meyer 
To: libvir-list@redhat.com
Subject: [PATCHv2 2/2] Generated PO files for 'bhyve: Support
 /domain/bootloader'
Date: Thu, 23 Oct 2014 19:28:43 -0400
Message-Id: <1414106923-32313-3-git-send-email-cse.cem@gmail.com>
X-Mailer: git-send-email 1.9.3
In-Reply-To: <1414106923-32313-1-git-send-email-cse.cem@gmail.com>
References: <1414106923-32313-1-git-send-email-cse.cem@gmail.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 8bit
Cc: Conrad Meyer , freebsd-virtualization@freebsd.org
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Thu, 23 Oct 2014 23:29:09 -0000

Sponsored by:   EMC / Isilon storage division

Signed-off-by: Conrad Meyer 
---
 po/af.po       | 4 ++++
 po/am.po       | 4 ++++
 po/ar.po       | 4 ++++
 po/as.po       | 4 ++++
 po/be.po       | 4 ++++
 po/bg.po       | 4 ++++
 po/bn.po       | 4 ++++
 po/bn_IN.po    | 4 ++++
 po/bo.po       | 4 ++++
 po/bs.po       | 4 ++++
 po/ca.po       | 4 ++++
 po/cs.po       | 4 ++++
 po/cy.po       | 4 ++++
 po/da.po       | 4 ++++
 po/de.po       | 4 ++++
 po/el.po       | 4 ++++
 po/en_GB.po    | 4 ++++
 po/es.po       | 4 ++++
 po/et.po       | 4 ++++
 po/eu_ES.po    | 4 ++++
 po/fa.po       | 4 ++++
 po/fi.po       | 4 ++++
 po/fr.po       | 4 ++++
 po/gl.po       | 4 ++++
 po/gu.po       | 4 ++++
 po/he.po       | 4 ++++
 po/hi.po       | 4 ++++
 po/hr.po       | 4 ++++
 po/hu.po       | 4 ++++
 po/hy.po       | 4 ++++
 po/id.po       | 4 ++++
 po/is.po       | 4 ++++
 po/it.po       | 4 ++++
 po/ja.po       | 4 ++++
 po/ka.po       | 4 ++++
 po/kn.po       | 4 ++++
 po/ko.po       | 4 ++++
 po/ku.po       | 4 ++++
 po/lo.po       | 4 ++++
 po/lt.po       | 4 ++++
 po/lv.po       | 4 ++++
 po/mk.po       | 4 ++++
 po/ml.po       | 4 ++++
 po/mr.po       | 4 ++++
 po/ms.po       | 4 ++++
 po/my.po       | 4 ++++
 po/nb.po       | 4 ++++
 po/nl.po       | 4 ++++
 po/nn.po       | 4 ++++
 po/nso.po      | 4 ++++
 po/or.po       | 4 ++++
 po/pa.po       | 4 ++++
 po/pl.po       | 4 ++++
 po/pt.po       | 4 ++++
 po/pt_BR.po    | 4 ++++
 po/ro.po       | 4 ++++
 po/ru.po       | 4 ++++
 po/si.po       | 4 ++++
 po/sk.po       | 4 ++++
 po/sl.po       | 4 ++++
 po/sq.po       | 4 ++++
 po/sr.po       | 4 ++++
 po/sr@latin.po | 4 ++++
 po/sv.po       | 4 ++++
 po/ta.po       | 4 ++++
 po/te.po       | 4 ++++
 po/th.po       | 4 ++++
 po/tr.po       | 4 ++++
 po/uk.po       | 4 ++++
 po/ur.po       | 4 ++++
 po/vi.po       | 4 ++++
 po/vi_VN.po    | 4 ++++
 po/zh_CN.po    | 4 ++++
 po/zh_TW.po    | 4 ++++
 po/zu.po       | 4 ++++
 75 files changed, 300 insertions(+)

diff --git a/po/af.po b/po/af.po
index 0e1374d..6e54827 100644
--- a/po/af.po
+++ b/po/af.po
@@ -853,6 +853,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/am.po b/po/am.po
index 8230ec8..c664b6b 100644
--- a/po/am.po
+++ b/po/am.po
@@ -853,6 +853,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/ar.po b/po/ar.po
index fed8f1f..3745c56 100644
--- a/po/ar.po
+++ b/po/ar.po
@@ -854,6 +854,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/as.po b/po/as.po
index b2bba9a..1e8ecad 100644
--- a/po/as.po
+++ b/po/as.po
@@ -915,6 +915,10 @@ msgstr "উৎস পথৰ অবিহনে cdrom ডিভাইচ সম
 msgid "domain should have at least one disk defined"
 msgstr "ডমেইনৰ অন্তত এটা ডিস্ক বিৱৰিত থাকিব লাগিব"
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr "PCI বাচ 0 স্লট 1 ইমপ্লিচিট LPC PCI-ISA ব্ৰিজৰ বাবে সংৰক্ষিত"
diff --git a/po/be.po b/po/be.po
index 1f4b856..3b5ff79 100644
--- a/po/be.po
+++ b/po/be.po
@@ -854,6 +854,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/bg.po b/po/bg.po
index 05d9e5d..0d75cb5 100644
--- a/po/bg.po
+++ b/po/bg.po
@@ -855,6 +855,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/bn.po b/po/bn.po
index ab15fc4..3c8cf38 100644
--- a/po/bn.po
+++ b/po/bn.po
@@ -853,6 +853,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/bn_IN.po b/po/bn_IN.po
index 88dd968..ac3af06 100644
--- a/po/bn_IN.po
+++ b/po/bn_IN.po
@@ -876,6 +876,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/bo.po b/po/bo.po
index cfbee90..55c561b 100644
--- a/po/bo.po
+++ b/po/bo.po
@@ -851,6 +851,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/bs.po b/po/bs.po
index 80c8ac2..90381b3 100644
--- a/po/bs.po
+++ b/po/bs.po
@@ -855,6 +855,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/ca.po b/po/ca.po
index 2ccbfdc..f14e08a 100644
--- a/po/ca.po
+++ b/po/ca.po
@@ -858,6 +858,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/cs.po b/po/cs.po
index 35a9ba6..dd44065 100644
--- a/po/cs.po
+++ b/po/cs.po
@@ -862,6 +862,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/cy.po b/po/cy.po
index 51e11b8..466965b 100644
--- a/po/cy.po
+++ b/po/cy.po
@@ -854,6 +854,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/da.po b/po/da.po
index 04d39ad..a820ecb 100644
--- a/po/da.po
+++ b/po/da.po
@@ -856,6 +856,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/de.po b/po/de.po
index 64cf6fe..f15b826 100644
--- a/po/de.po
+++ b/po/de.po
@@ -911,6 +911,10 @@ msgstr "Benannte Einheiten-Aliasnamen werden nicht unterstützt"
 msgid "domain should have at least one disk defined"
 msgstr "Domain XML muss zumindest ein  Element enthalten."
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/el.po b/po/el.po
index c62c443..fdd00d4 100644
--- a/po/el.po
+++ b/po/el.po
@@ -869,6 +869,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/en_GB.po b/po/en_GB.po
index 833044a..55beffd 100644
--- a/po/en_GB.po
+++ b/po/en_GB.po
@@ -916,6 +916,10 @@ msgstr "Named device aliases are not supported"
 msgid "domain should have at least one disk defined"
 msgstr "Domain XML must contain at least one  element."
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/es.po b/po/es.po
index 8a54e10..7946ae0 100644
--- a/po/es.po
+++ b/po/es.po
@@ -900,6 +900,10 @@ msgstr "Los dispositivos llamados alias no tienen soporte"
 msgid "domain should have at least one disk defined"
 msgstr "XML de dominio debe contener al menos un elemento ."
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/et.po b/po/et.po
index bd5d59f..b74b89d 100644
--- a/po/et.po
+++ b/po/et.po
@@ -853,6 +853,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/eu_ES.po b/po/eu_ES.po
index 3939c44..3e0f2f8 100644
--- a/po/eu_ES.po
+++ b/po/eu_ES.po
@@ -853,6 +853,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/fa.po b/po/fa.po
index dba48be..00782ce 100644
--- a/po/fa.po
+++ b/po/fa.po
@@ -853,6 +853,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/fi.po b/po/fi.po
index 2e487f7..c2eb1cd 100644
--- a/po/fi.po
+++ b/po/fi.po
@@ -854,6 +854,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/fr.po b/po/fr.po
index 4e46d32..05ed448 100644
--- a/po/fr.po
+++ b/po/fr.po
@@ -899,6 +899,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/gl.po b/po/gl.po
index 7e089a0..ee0c2a8 100644
--- a/po/gl.po
+++ b/po/gl.po
@@ -853,6 +853,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/gu.po b/po/gu.po
index fea7041..d050c35 100644
--- a/po/gu.po
+++ b/po/gu.po
@@ -913,6 +913,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/he.po b/po/he.po
index e236131..786699d 100644
--- a/po/he.po
+++ b/po/he.po
@@ -853,6 +853,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/hi.po b/po/hi.po
index d918984..b3dc6d8 100644
--- a/po/hi.po
+++ b/po/hi.po
@@ -890,6 +890,10 @@ msgstr "नामित युक्ति एलियास समर्थि
 msgid "domain should have at least one disk defined"
 msgstr "डोमेन XML कम से कम एक  तत्व शामिल करना अनिवार्य है."
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/hr.po b/po/hr.po
index 3dda86b..d532f83 100644
--- a/po/hr.po
+++ b/po/hr.po
@@ -855,6 +855,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/hu.po b/po/hu.po
index f0cd18f..5dc6b83 100644
--- a/po/hu.po
+++ b/po/hu.po
@@ -855,6 +855,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/hy.po b/po/hy.po
index 182b4ef..4d1fc59 100644
--- a/po/hy.po
+++ b/po/hy.po
@@ -853,6 +853,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/id.po b/po/id.po
index 97578be..c758356 100644
--- a/po/id.po
+++ b/po/id.po
@@ -856,6 +856,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/is.po b/po/is.po
index 321b801..5b16607 100644
--- a/po/is.po
+++ b/po/is.po
@@ -853,6 +853,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/it.po b/po/it.po
index 5e52e2f..77c1368 100644
--- a/po/it.po
+++ b/po/it.po
@@ -867,6 +867,10 @@ msgstr "non è supportato il collegamento a caldo dell'unità"
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/ja.po b/po/ja.po
index 52c8b86..801398a 100644
--- a/po/ja.po
+++ b/po/ja.po
@@ -919,6 +919,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/ka.po b/po/ka.po
index 51fb83d..dab5f16 100644
--- a/po/ka.po
+++ b/po/ka.po
@@ -853,6 +853,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/kn.po b/po/kn.po
index 74589ab..e74ba4f 100644
--- a/po/kn.po
+++ b/po/kn.po
@@ -900,6 +900,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/ko.po b/po/ko.po
index 06c5f63..7f216ff 100644
--- a/po/ko.po
+++ b/po/ko.po
@@ -882,6 +882,10 @@ msgstr "원본 경로가 없는 CD-ROM 장치를 지원하지 않습니다"
 msgid "domain should have at least one disk defined"
 msgstr "도메인은 최소 하나의 디스크를 정의해야 합니다"
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr "PCI 버스 0 슬롯 1은 암시적 LPC PCI-ISA 브릿지에 예약되어 있습니다"
diff --git a/po/ku.po b/po/ku.po
index 0ca4331..7a30d94 100644
--- a/po/ku.po
+++ b/po/ku.po
@@ -853,6 +853,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/lo.po b/po/lo.po
index ee3285c..1237bfe 100644
--- a/po/lo.po
+++ b/po/lo.po
@@ -853,6 +853,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/lt.po b/po/lt.po
index 3547478..e9410d9 100644
--- a/po/lt.po
+++ b/po/lt.po
@@ -854,6 +854,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/lv.po b/po/lv.po
index da15417..db3fc85 100644
--- a/po/lv.po
+++ b/po/lv.po
@@ -854,6 +854,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/mk.po b/po/mk.po
index bca6175..cba9c7d 100644
--- a/po/mk.po
+++ b/po/mk.po
@@ -856,6 +856,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/ml.po b/po/ml.po
index a316f8f..6dd9a56 100644
--- a/po/ml.po
+++ b/po/ml.po
@@ -905,6 +905,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/mr.po b/po/mr.po
index 4feb3ca..1f40e27 100644
--- a/po/mr.po
+++ b/po/mr.po
@@ -912,6 +912,10 @@ msgstr "स्रोत मार्गविना cdrom साधन समर
 msgid "domain should have at least one disk defined"
 msgstr "डोमेनकडे किमान एक डिस्क ठरविलेले पाहिजे"
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr "PCI बस 0 स्लॉट 1 आरक्षित आहे, सूचीत PC PCI-ISA ब्रिजकरिता"
diff --git a/po/ms.po b/po/ms.po
index f3dd1e7..9618322 100644
--- a/po/ms.po
+++ b/po/ms.po
@@ -853,6 +853,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/my.po b/po/my.po
index 92a4af8..0e225fb 100644
--- a/po/my.po
+++ b/po/my.po
@@ -853,6 +853,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/nb.po b/po/nb.po
index ff77e7c..9bf88ef 100644
--- a/po/nb.po
+++ b/po/nb.po
@@ -855,6 +855,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/nl.po b/po/nl.po
index f906e10..a8f76fc 100644
--- a/po/nl.po
+++ b/po/nl.po
@@ -867,6 +867,10 @@ msgstr "Benoemde apparaat aliassen worden niet ondersteund"
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/nn.po b/po/nn.po
index 1fdb298..e8de23c 100644
--- a/po/nn.po
+++ b/po/nn.po
@@ -853,6 +853,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/nso.po b/po/nso.po
index ca73df5..3569368 100644
--- a/po/nso.po
+++ b/po/nso.po
@@ -853,6 +853,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/or.po b/po/or.po
index 4f99a8b..995544e 100644
--- a/po/or.po
+++ b/po/or.po
@@ -876,6 +876,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/pa.po b/po/pa.po
index 9f8c9d9..e9fd8db 100644
--- a/po/pa.po
+++ b/po/pa.po
@@ -895,6 +895,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/pl.po b/po/pl.po
index fb7e20c..1718bfd 100644
--- a/po/pl.po
+++ b/po/pl.po
@@ -867,6 +867,10 @@ msgstr "Aliasy nazwanych urządzeń są nieobsługiwane"
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/pt.po b/po/pt.po
index a5a1f50..671f2c2 100644
--- a/po/pt.po
+++ b/po/pt.po
@@ -854,6 +854,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/pt_BR.po b/po/pt_BR.po
index f261bbd..d70c20e 100644
--- a/po/pt_BR.po
+++ b/po/pt_BR.po
@@ -902,6 +902,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/ro.po b/po/ro.po
index b7efaf0..9321cee 100644
--- a/po/ro.po
+++ b/po/ro.po
@@ -854,6 +854,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/ru.po b/po/ru.po
index 3b6b6a6..2272f7f 100644
--- a/po/ru.po
+++ b/po/ru.po
@@ -918,6 +918,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/si.po b/po/si.po
index 18f0dea..2fe3215 100644
--- a/po/si.po
+++ b/po/si.po
@@ -853,6 +853,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/sk.po b/po/sk.po
index 8d55137..d9f26c9 100644
--- a/po/sk.po
+++ b/po/sk.po
@@ -853,6 +853,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/sl.po b/po/sl.po
index 9425c9d..bf5d86f 100644
--- a/po/sl.po
+++ b/po/sl.po
@@ -854,6 +854,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/sq.po b/po/sq.po
index 3a597d0..bac1d70 100644
--- a/po/sq.po
+++ b/po/sq.po
@@ -853,6 +853,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/sr.po b/po/sr.po
index f54d52f..a2b1ff5 100644
--- a/po/sr.po
+++ b/po/sr.po
@@ -871,6 +871,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/sr@latin.po b/po/sr@latin.po
index c9ae98f..586230f 100644
--- a/po/sr@latin.po
+++ b/po/sr@latin.po
@@ -871,6 +871,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/sv.po b/po/sv.po
index 0a1e320..f2e5bb6 100644
--- a/po/sv.po
+++ b/po/sv.po
@@ -860,6 +860,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/ta.po b/po/ta.po
index 61170be..4dfb2df 100644
--- a/po/ta.po
+++ b/po/ta.po
@@ -919,6 +919,10 @@ msgstr "மூலப் பாதையில்லாத cdrom சாதனம
 msgid "domain should have at least one disk defined"
 msgstr "டொமைனுக்கு குறைந்தது ஒரு வட்டேனும் வரையறுக்கப்பட்டிருக்க வேண்டும்"
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr "PCI பஸ் 0 ஸ்லாட் 1 மறைமுக LPC PCI-ISA பிரிட்ஜுக்காக ஒதுக்கப்பட்டது"
diff --git a/po/te.po b/po/te.po
index 2ad29f3..8d3f27b 100644
--- a/po/te.po
+++ b/po/te.po
@@ -880,6 +880,10 @@ msgstr "పేరుగల పరికర మారుపేర్లు తో
 msgid "domain should have at least one disk defined"
 msgstr "డొమైన్ XML తప్పక వొక  మూలకం కలిగివుండాలి."
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/th.po b/po/th.po
index 8d6c983..ffb4c19 100644
--- a/po/th.po
+++ b/po/th.po
@@ -853,6 +853,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/tr.po b/po/tr.po
index 5502581..76b1fad 100644
--- a/po/tr.po
+++ b/po/tr.po
@@ -853,6 +853,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/uk.po b/po/uk.po
index ba17e24..36e5338 100644
--- a/po/uk.po
+++ b/po/uk.po
@@ -923,6 +923,10 @@ msgstr "підтримки пристроїв cdrom без шляху до дж
 msgid "domain should have at least one disk defined"
 msgstr "для домену слід визначити принаймні один диск"
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr "Слот 1 каналу PCI 0 зарезервовано для неявного містка LPC PCI-ISA"
diff --git a/po/ur.po b/po/ur.po
index e15d614..74a926f 100644
--- a/po/ur.po
+++ b/po/ur.po
@@ -853,6 +853,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/vi.po b/po/vi.po
index 4974c2c..8f93aaa 100644
--- a/po/vi.po
+++ b/po/vi.po
@@ -867,6 +867,10 @@ msgstr "lưu trữ bí mật không được hỗ trợ"
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/vi_VN.po b/po/vi_VN.po
index 1e9af39..2e335bc 100644
--- a/po/vi_VN.po
+++ b/po/vi_VN.po
@@ -867,6 +867,10 @@ msgstr "lưu trữ bí mật không được hỗ trợ"
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/zh_CN.po b/po/zh_CN.po
index afc2e3b..a2464e3 100644
--- a/po/zh_CN.po
+++ b/po/zh_CN.po
@@ -886,6 +886,10 @@ msgstr "不支持命名的设备别名"
 msgid "domain should have at least one disk defined"
 msgstr "域 XML 必须包含至少一个  元素"
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/zh_TW.po b/po/zh_TW.po
index 812901c..b034bb8 100644
--- a/po/zh_TW.po
+++ b/po/zh_TW.po
@@ -859,6 +859,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/po/zu.po b/po/zu.po
index 8a04324..83f3147 100644
--- a/po/zu.po
+++ b/po/zu.po
@@ -853,6 +853,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
-- 
1.9.3


From owner-freebsd-virtualization@FreeBSD.ORG  Thu Oct 23 23:29:06 2014
Return-Path: 
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id A87B5BAB
 for ; Thu, 23 Oct 2014 23:29:06 +0000 (UTC)
Received: from mail-yh0-x234.google.com (mail-yh0-x234.google.com
 [IPv6:2607:f8b0:4002:c01::234])
 (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
 (Client CN "smtp.gmail.com",
 Issuer "Google Internet Authority G2" (verified OK))
 by mx1.freebsd.org (Postfix) with ESMTPS id 695A5168
 for ; Thu, 23 Oct 2014 23:29:06 +0000 (UTC)
Received: by mail-yh0-f52.google.com with SMTP id f10so1170887yha.25
 for ; Thu, 23 Oct 2014 16:29:05 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
 h=from:to:cc:subject:date:message-id:in-reply-to:references;
 bh=deuPPt1kETFU8MvhKHfVO2JXCggAV1n1iIbSwK7gxQg=;
 b=aq+nzqHxPuFxsUrs/kPQMVjApS6VUlIauKcwRRbnSw2X62L1I4/QRJk5oG2RY0z1Ry
 fvmJ0xrM+OUt2iIs5DwIXtVKirkZBRz8gjbDKRCYAhy1y9qwik0KSmzuQVZvJWiBgQkv
 liiFdHw7dNXCa1W8kMJhXKLeeMrr2CXetBxE//+TNo0p15h4VqsdlrZZhFuGXaNkcuKf
 CXGZAFxXzh8M5omJBcG3flG1Jd9bF2rS+hiolTKdZlOymXa5YcX+fn0/YAUSrto/UgCE
 hFykZMlHL7z8xO7yQqdQ2lWqnkaXzRQd713ViN3vxSob4zyjetcT9oVgAdyRBDnmnHTe
 suxQ==
X-Received: by 10.170.121.140 with SMTP id n134mr660455ykb.89.1414106945643;
 Thu, 23 Oct 2014 16:29:05 -0700 (PDT)
Received: from m.west.isilon.com (c-98-209-117-232.hsd1.mi.comcast.net.
 [98.209.117.232])
 by mx.google.com with ESMTPSA id xb4sm79861igc.11.2014.10.23.16.29.04
 for 
 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128);
 Thu, 23 Oct 2014 16:29:05 -0700 (PDT)
From: Conrad Meyer 
To: libvir-list@redhat.com
Subject: [PATCHv2 1/2] bhyve: Support /domain/bootloader configuration for
 non-FreeBSD guests.
Date: Thu, 23 Oct 2014 19:28:42 -0400
Message-Id: <1414106923-32313-2-git-send-email-cse.cem@gmail.com>
X-Mailer: git-send-email 1.9.3
In-Reply-To: <1414106923-32313-1-git-send-email-cse.cem@gmail.com>
References: <1414106923-32313-1-git-send-email-cse.cem@gmail.com>
Cc: Conrad Meyer , freebsd-virtualization@freebsd.org
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Thu, 23 Oct 2014 23:29:06 -0000

We still default to bhyveloader(1) if no explicit bootloader
configuration is supplied in the domain.

If the /domain/bootloader looks like grub-bhyve and the user doesn't
supply /domain/bootloader_args, we make an intelligent guess and try
chainloading the first partition on the disk.

Caveats:
- We can't install from CD without explicit bootloader_args.
- We leave a device.map file lying around in /tmp. I don't see a good
  way not to do so without reworking the API somewhat.

Sponsored by:   EMC / Isilon storage division

Signed-off-by: Conrad Meyer 
---
 docs/drvbhyve.html.in     |  28 ++++++++++--
 docs/formatdomain.html.in |   4 +-
 po/libvirt.pot            |   4 ++
 src/bhyve/bhyve_command.c | 107 +++++++++++++++++++++++++++++++++++++++++-----
 4 files changed, 128 insertions(+), 15 deletions(-)

diff --git a/docs/drvbhyve.html.in b/docs/drvbhyve.html.in
index 39afdf5..6e85800 100644
--- a/docs/drvbhyve.html.in
+++ b/docs/drvbhyve.html.in
@@ -37,8 +37,7 @@ bhyve+ssh://root@example.com/system (remote access, SSH tunnelled)
 
Example config

 

 The bhyve driver in libvirt is in its early stage and under active development. So it supports
-only limited number of features bhyve provides. All the supported features could be found
-in this sample domain XML.
+only limited number of features bhyve provides.
 

 
 

@@ -50,8 +49,8 @@ up to 31 PCI devices.
 
 
 <domain type='bhyve'>
-  <name>bhyve</name>
-  <uuid>df3be7e7-a104-11e3-aeb0-50e5492bd3dc</uuid>
+    <name>bhyve</name>
+    <uuid>df3be7e7-a104-11e3-aeb0-50e5492bd3dc</uuid>
     <memory>219136</memory>
     <currentMemory>219136</currentMemory>
     <vcpu>1</vcpu>
@@ -157,5 +156,26 @@ An example of domain XML device entry for that will look like:

 
Please refer to the Storage documentation for more details on storage
 management.

 
+
Using grub2-bhyve or Alternative Bootloaders

+
+
It's possible to boot non-FreeBSD guests by specifying an explicit
+bootloader, e.g. grub-bhyve(1). Arguments to the bootloader may be
+specified as well. If no arguments are given and bootloader is
+grub-bhyve, libvirt will try and boot from the first partition of
+the disk image.

+
+
+  ...
+    <bootloader>/usr/local/sbin/grub-bhyve</bootloader>
+    <bootloader_args>...</bootloader_args>
+  ...
+

+
+
(Of course, to install from a CD a user will have to supply explicit
+arguments to grub-bhyve.)

+
+
Caveat: bootloader_args does not support any quoting.
+Filenames, etc, must not have spaces or they will be tokenized incorrectly.

+
   
 
diff --git a/docs/formatdomain.html.in b/docs/formatdomain.html.in
index 0099ce7..b7b6c46 100644
--- a/docs/formatdomain.html.in
+++ b/docs/formatdomain.html.in
@@ -217,7 +217,9 @@
       a BIOS, and instead the host is responsible to kicking off the
       operating system boot. This may use a pseudo-bootloader in the
       host to provide an interface to choose a kernel for the guest.
-      An example is pygrub with Xen.
+      An example is pygrub with Xen. The Bhyve hypervisor
+      also uses a host bootloader, either bhyveload or
+      grub-bhyve.
     

 
 
diff --git a/po/libvirt.pot b/po/libvirt.pot
index 0b44ad7..d8c9a4d 100644
--- a/po/libvirt.pot
+++ b/po/libvirt.pot
@@ -851,6 +851,10 @@ msgstr ""
 msgid "domain should have at least one disk defined"
 msgstr ""
 
+#: src/bhyve/bhyve_command.c:407
+msgid "Custom loader requires explicit %s configuration"
+msgstr ""
+
 #: src/bhyve/bhyve_device.c:50
 msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
 msgstr ""
diff --git a/src/bhyve/bhyve_command.c b/src/bhyve/bhyve_command.c
index bea4a59..99956ae 100644
--- a/src/bhyve/bhyve_command.c
+++ b/src/bhyve/bhyve_command.c
@@ -300,6 +300,7 @@ virBhyveProcessBuildLoadCmd(virConnectPtr conn,
 {
     virCommandPtr cmd;
     virDomainDiskDefPtr disk;
+    bool bhyveload, grub_bhyve;
 
     if (def->ndisks < 1) {
         virReportError(VIR_ERR_CONFIG_UNSUPPORTED, "%s",
@@ -326,19 +327,105 @@ virBhyveProcessBuildLoadCmd(virConnectPtr conn,
         return NULL;
     }
 
-    cmd = virCommandNew(BHYVELOAD);
+    if (def->os.bootloader == NULL) {
+        bhyveload = true;
+        grub_bhyve = false;
+        cmd = virCommandNew(BHYVELOAD);
+    } else {
+        bhyveload = false;
+        if (strstr(def->os.bootloader, "grub-bhyve") == 0)
+            grub_bhyve = true;
+        cmd = virCommandNew(def->os.bootloader);
+    }
 
-    /* Memory */
-    virCommandAddArg(cmd, "-m");
-    virCommandAddArgFormat(cmd, "%llu",
-                           VIR_DIV_UP(def->mem.max_balloon, 1024));
+    if (bhyveload && def->os.bootloaderArgs == NULL) {
+        VIR_DEBUG("%s: bhyveload with default arguments", __func__);
+
+        /* Memory (MB) */
+        virCommandAddArg(cmd, "-m");
+        virCommandAddArgFormat(cmd, "%llu",
+                               VIR_DIV_UP(def->mem.max_balloon, 1024));
+
+        /* Image path */
+        virCommandAddArg(cmd, "-d");
+        virCommandAddArg(cmd, virDomainDiskGetSource(disk));
+
+        /* VM name */
+        virCommandAddArg(cmd, def->name);
+    } else if (grub_bhyve && def->os.bootloaderArgs == NULL) {
+        char tmpmapfile[128] = "/tmp/grub-bhyve-device.map_XXXXXX";
+        FILE *f;
+        int fd;
+
+        VIR_DEBUG("%s: grub-bhyve with default arguments", __func__);
+
+        /*
+         * XXX Default grub-bhyve has some BIG caveats, but MAY work for some
+         * typical configurations. In particular:
+         *
+         *   - Can't create a new VM this way (no CD, no boot from CD)
+         *   - Assumes a GRUB install on hd0,msdos1
+         */
 
-    /* Image path */
-    virCommandAddArg(cmd, "-d");
-    virCommandAddArg(cmd, virDomainDiskGetSource(disk));
+        /* XXX cleanup this file. */
+        fd = mkstemp(tmpmapfile);
+        if (fd < 0) {
+                virReportError(VIR_ERR_OPEN_FAILED, tmpmapfile);
+                goto error;
+        }
+
+        f = VIR_FDOPEN(fd, "wb+");
+        if (f == NULL) {
+                VIR_FORCE_CLOSE(fd);
+                virReportError(VIR_ERR_OPEN_FAILED, tmpmapfile);
+                goto error;
+        }
+
+        /* Grub device.map */
+        fprintf(f, "(hd0) %s\n", virDomainDiskGetSource(disk));
+        /* XXX CDs would look like: "(cd0) /path/to/CD" */
+
+        if (VIR_FCLOSE(f) < 0) {
+                virReportSystemError(errno, "%s", _("failed to close file"));
+                goto error;
+        }
 
-    /* VM name */
-    virCommandAddArg(cmd, def->name);
+
+        virCommandAddArg(cmd, "--device-map");
+        virCommandAddArg(cmd, tmpmapfile);
+
+        /* Memory in MB */
+        virCommandAddArg(cmd, "--memory");
+        virCommandAddArgFormat(cmd, "%llu",
+                               VIR_DIV_UP(def->mem.max_balloon, 1024));
+
+        /* To boot from CD, "cd0" here. */
+        virCommandAddArg(cmd, "--root");
+        virCommandAddArg(cmd, "hd0,msdos1");
+
+        /* VM name */
+        virCommandAddArg(cmd, def->name);
+    } else if (def->os.bootloaderArgs == NULL) {
+        virReportError(VIR_ERR_CONFIG_UNSUPPORTED,
+                       _("Custom loader requires explicit %s configuration"),
+                       "bootloader_args");
+        goto error;
+    } else {
+        char **blargs, **arg;
+
+        VIR_DEBUG("%s: custom loader '%s' with arguments", __func__,
+                  def->os.bootloader);
+
+        /* XXX: Handle quoted? */
+        blargs = virStringSplit(def->os.bootloaderArgs, " ", 0);
+        for (arg = blargs; *arg; arg++)
+                virCommandAddArg(cmd, *arg);
+        virStringFreeList(blargs);
+    }
 
     return cmd;
+
+error:
+    virCommandFree(cmd);
+    return NULL;
 }
-- 
1.9.3


From owner-freebsd-virtualization@FreeBSD.ORG  Thu Oct 23 23:31:13 2014
Return-Path: 
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 17934D9B
 for ; Thu, 23 Oct 2014 23:31:13 +0000 (UTC)
Received: from alto.onthenet.com.au (alto.OntheNet.com.au [203.13.68.12])
 by mx1.freebsd.org (Postfix) with ESMTP id CB0AA212
 for ; Thu, 23 Oct 2014 23:31:12 +0000 (UTC)
Received: from dommail.onthenet.com.au (dommail.OntheNet.com.au [203.13.70.57])
 by alto.onthenet.com.au (Postfix) with ESMTP id D855A12713;
 Fri, 24 Oct 2014 09:31:10 +1000 (EST)
Received: from Peter-Grehans-MacBook-Pro-2.local ([64.245.0.210])
 by dommail.onthenet.com.au (MOS 4.4.4-GA)
 with ESMTP id BZF03345 (AUTH peterg@ptree32.com.au);
 Fri, 24 Oct 2014 09:31:09 +1000
Message-ID: <54498FBB.5060904@freebsd.org>
Date: Thu, 23 Oct 2014 16:31:07 -0700
From: Peter Grehan 
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6;
 rv:24.0) Gecko/20100101 Thunderbird/24.6.0
MIME-Version: 1.0
To: Conrad Rad 
Subject: Re: [PATCH 1/2] bhyve: Support /domain/bootloader configuration for
 non-FreeBSD guests.
References: <1414094284-29055-1-git-send-email-cse.cem@gmail.com>	<1414094284-29055-2-git-send-email-cse.cem@gmail.com>	<54498764.6080404@freebsd.org>
 
In-Reply-To: 
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit
Cc: Conrad Meyer ,
 "freebsd-virtualization@freebsd.org" 
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Thu, 23 Oct 2014 23:31:13 -0000

Hi Conrad,

> Unless I'm mistaken, the userspace loaders are still needed to boot
> VMs for now.

  That's correct.

> Will the Bhyve UEFI work be complete before MeetBSD?

  Most likely not.

> And is it going into the FreeBSD 10 release branch, or only in 11?

  It will be MFCable.

> Until that code actually materializes, I think it's important to fix
> libvirt now. This change doesn't break a future Bhyve-that-supports
> EUFI, and it can even be yanked out later if totally redundant.

  Good - I just wanted to make sure this change (or characterization of 
bhyve as PV) wasn't something that would hurt long-term.

later,

Peter.


From owner-freebsd-virtualization@FreeBSD.ORG  Thu Oct 23 23:42:25 2014
Return-Path: 
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id F222EEEE
 for ; Thu, 23 Oct 2014 23:42:25 +0000 (UTC)
Received: from mailer.gewt.net (mailer.gewt.net [198.27.113.113])
 (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
 (Client did not present a certificate)
 by mx1.freebsd.org (Postfix) with ESMTPS id C9D63321
 for ; Thu, 23 Oct 2014 23:42:25 +0000 (UTC)
Received: from cpe-65-24-235-132.insight.res.rr.com ([65.24.235.132]
 helo=meaghan.gimme-sympathy.org)
 by mailer.gewt.net with esmtpsa (TLSv1.2:DHE-RSA-AES256-GCM-SHA384:256)
 (Exim 4.82 (FreeBSD)) (envelope-from )
 id 1XhS07-000FbM-6e
 for freebsd-virtualization@freebsd.org; Thu, 23 Oct 2014 19:41:03 -0400
Date: Thu, 23 Oct 2014 19:41:01 -0400 (EDT)
From: Cory Smelosky 
X-X-Sender: csmelosky@meaghan.gimme-sympathy.org
cc: "freebsd-virtualization@freebsd.org" 
Subject: Re: [PATCH 1/2] bhyve: Support /domain/bootloader configuration for
 non-FreeBSD guests.
In-Reply-To: <54498FBB.5060904@freebsd.org>
Message-ID: 
References: <1414094284-29055-1-git-send-email-cse.cem@gmail.com>
 <1414094284-29055-2-git-send-email-cse.cem@gmail.com>
 <54498764.6080404@freebsd.org>
 
 <54498FBB.5060904@freebsd.org>
User-Agent: Alpine 2.11 (DFB 23 2013-08-11)
MIME-Version: 1.0
Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed
Sender: b4@mailer.gewt.net
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Thu, 23 Oct 2014 23:42:26 -0000

On Thu, 23 Oct 2014, Peter Grehan wrote:

>> Will the Bhyve UEFI work be complete before MeetBSD?
>
> Most likely not.
>

Will there be a legacy BIOS compat layer to go along with that?  I have 
some legacy stuff I'd love to move to bhyve that'll never work under UEFI.

-- 
Cory Smelosky
http://gewt.net Personal stuff
http://gimme-sympathy.org Projects

From owner-freebsd-virtualization@FreeBSD.ORG  Thu Oct 23 23:47:30 2014
Return-Path: 
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 878D8F76
 for ; Thu, 23 Oct 2014 23:47:30 +0000 (UTC)
Received: from alto.onthenet.com.au (alto.OntheNet.com.au [203.13.68.12])
 by mx1.freebsd.org (Postfix) with ESMTP id 463D0343
 for ; Thu, 23 Oct 2014 23:47:29 +0000 (UTC)
Received: from dommail.onthenet.com.au (dommail.OntheNet.com.au [203.13.70.57])
 by alto.onthenet.com.au (Postfix) with ESMTP id B127B126F3;
 Fri, 24 Oct 2014 09:47:28 +1000 (EST)
Received: from Peter-Grehans-MacBook-Pro-2.local ([64.245.0.210])
 by dommail.onthenet.com.au (MOS 4.4.4-GA)
 with ESMTP id BZF04633 (AUTH peterg@ptree32.com.au);
 Fri, 24 Oct 2014 09:47:27 +1000
Message-ID: <5449938E.3060403@freebsd.org>
Date: Thu, 23 Oct 2014 16:47:26 -0700
From: Peter Grehan 
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6;
 rv:24.0) Gecko/20100101 Thunderbird/24.6.0
MIME-Version: 1.0
To: Cory Smelosky 
Subject: Re: [PATCH 1/2] bhyve: Support /domain/bootloader configuration for
 non-FreeBSD guests.
References: <1414094284-29055-1-git-send-email-cse.cem@gmail.com>
 <1414094284-29055-2-git-send-email-cse.cem@gmail.com>
 <54498764.6080404@freebsd.org>
 
 <54498FBB.5060904@freebsd.org>
 
In-Reply-To: 
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
Cc: "freebsd-virtualization@freebsd.org" 
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Thu, 23 Oct 2014 23:47:30 -0000

Hi Cory,

> Will there be a legacy BIOS compat layer to go along with that?  I have
> some legacy stuff I'd love to move to bhyve that'll never work under UEFI.

  Yes - the UEFI image will include a CSM module.

later,

Peter.


From owner-freebsd-virtualization@FreeBSD.ORG  Thu Oct 23 23:48:56 2014
Return-Path: 
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 3CBF1133
 for ; Thu, 23 Oct 2014 23:48:56 +0000 (UTC)
Received: from mailer.gewt.net (mailer.gewt.net [198.27.113.113])
 (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
 (Client did not present a certificate)
 by mx1.freebsd.org (Postfix) with ESMTPS id 13746354
 for ; Thu, 23 Oct 2014 23:48:55 +0000 (UTC)
Received: from cpe-65-24-235-132.insight.res.rr.com ([65.24.235.132]
 helo=meaghan.gimme-sympathy.org)
 by mailer.gewt.net with esmtpsa (TLSv1.2:DHE-RSA-AES256-GCM-SHA384:256)
 (Exim 4.82 (FreeBSD)) (envelope-from )
 id 1XhS7j-000Fcn-0V
 for freebsd-virtualization@freebsd.org; Thu, 23 Oct 2014 19:48:55 -0400
Date: Thu, 23 Oct 2014 19:48:53 -0400 (EDT)
From: Cory Smelosky 
X-X-Sender: csmelosky@meaghan.gimme-sympathy.org
cc: "freebsd-virtualization@freebsd.org" 
Subject: Re: [PATCH 1/2] bhyve: Support /domain/bootloader configuration for
 non-FreeBSD guests.
In-Reply-To: <5449938E.3060403@freebsd.org>
Message-ID: 
References: <1414094284-29055-1-git-send-email-cse.cem@gmail.com>
 <1414094284-29055-2-git-send-email-cse.cem@gmail.com>
 <54498764.6080404@freebsd.org>
 
 <54498FBB.5060904@freebsd.org>
 
 <5449938E.3060403@freebsd.org>
User-Agent: Alpine 2.11 (DFB 23 2013-08-11)
MIME-Version: 1.0
Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed
Sender: b4@mailer.gewt.net
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Thu, 23 Oct 2014 23:48:56 -0000

On Thu, 23 Oct 2014, Peter Grehan wrote:

> Hi Cory,
>
>> Will there be a legacy BIOS compat layer to go along with that?  I have
>> some legacy stuff I'd love to move to bhyve that'll never work under UEFI.
>
> Yes - the UEFI image will include a CSM module.
>

I will eagerly await this feature and will be happy to test it once it's 
implemented!

> later,
>
> Peter.
>
>

-- 
Cory Smelosky
http://gewt.net Personal stuff
http://gimme-sympathy.org Projects

From owner-freebsd-virtualization@FreeBSD.ORG  Fri Oct 24 03:31:28 2014
Return-Path: 
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 7423A981;
 Fri, 24 Oct 2014 03:31:28 +0000 (UTC)
Received: from mx1.scaleengine.net (beauharnois2.bhs1.scaleengine.net
 [142.4.218.15]) by mx1.freebsd.org (Postfix) with ESMTP id 32A77C42;
 Fri, 24 Oct 2014 03:31:27 +0000 (UTC)
Received: from [192.168.1.2] (Seawolf.HML3.ScaleEngine.net [209.51.186.28])
 (Authenticated sender: allanjude.freebsd@scaleengine.com)
 by mx1.scaleengine.net (Postfix) with ESMTPSA id 0731E63E88;
 Fri, 24 Oct 2014 03:31:25 +0000 (UTC)
Message-ID: <5449C81B.8080008@freebsd.org>
Date: Thu, 23 Oct 2014 23:31:39 -0400
From: Allan Jude 
User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64;
 rv:31.0) Gecko/20100101 Thunderbird/31.2.0
MIME-Version: 1.0
To: freebsd-virtualization@freebsd.org, freebsd-testing@freebsd.org, 
 freebsd-stable@freebsd.org
Subject: Re: Automatically running /usr/tests on stable/10 branch under Jenkins
References: 
 
 
In-Reply-To: 
Content-Type: multipart/signed; micalg=pgp-sha1;
 protocol="application/pgp-signature";
 boundary="EO7bdR25mcpewkJ1lSwKXBRl5VclR2krx"
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Fri, 24 Oct 2014 03:31:28 -0000

This is an OpenPGP/MIME signed message (RFC 4880 and 3156)
--EO7bdR25mcpewkJ1lSwKXBRl5VclR2krx
Content-Type: text/plain; charset=windows-1252
Content-Transfer-Encoding: quoted-printable

On 2014-10-23 18:30, Craig Rodrigues wrote:
> Garrett Cooper wrote:
>=20
>>
>> Hi Craig!
>>         As much as everyone would like to take i386 out to pasture,
>> there's a large degree of value in running i386 tests on 11-CURRENT an=
d
>> 10-STABLE (I've caught some interesting build bugs and test bugs by ru=
nning
>> on my i386/CURRENT VM). Are there any plans to have i386 executors run=
ning
>> tests anytime soon (does bhyve support i386?)?
>>
>=20
>=20
> We (jenkins-admin@freebsd.org) have been busy the 5 months since BSDCan=

> 2014 as
> you can see by our status report, which lists what we have done, and wh=
at
> our future plans are:
>=20
> https://www.freebsd.org/news/status/report-2014-07-2014-09.html#Jenkins=
-Continuous-Integration-for-FreeBSD
>=20
> Integrating Jenkins with Kyua on amd64 was a major milestone which was
> achieved, and
> was even mentioned on the Jenkins web site:
>=20
> http://jenkins-ci.org/content/freebsd-project-use-jenkins-os-testing
>=20
> Now, where to take this further (such as i386) is an interesting questi=
on.
>=20
> Personally, I would like to see:
>    -> integration of automated kyua testing with the FreeBSD release
> engineering process
>    -> more involvement from FreeBSD developers, and even companies such=
 as
> EMC/Isilon,
>        who can:
>            -> write tests
>            -> suggest and implement new tests (network, storage, VM, et=
c.)
>            -> help with devops maintenance of the existing
> jenkins.freebsd.org cluster
>            -> improve bhyve support in libvirt
>            -> set up their own Jenkins build environments outside of
> FreeBSD, and help test things in their own private environments
>=20
> I've had requests for;
>    -> running tests in bhyve VM's with very small memory footprints
> (Adrian Chadd)
>    -> running tests in MIPS environment (Adrian Chadd)
>    -> running Java JDK tests (Kip Macy)
>    -> i386 builds (Garrett Cooper)
>=20
> There are a lot of different directions to take this, but without more
> people (and companies) pitching in and helping out,
> progress is limited by bodies working on the stuff.
>=20
> I will be at the MeetBSD Vendor summit (not the conference) Nov. 3-4, s=
o
> hopefully
> anyone interested in pushing this stuff forward can talk to me there.
>=20
> --
> Craig
> _______________________________________________
> freebsd-virtualization@freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization
> To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@fr=
eebsd.org"
>=20

At the Cambridge Dev Summit, Xinuous specifically mentioned helping with
testing and writing tests. Might be good people to reach out to

--=20
Allan Jude


--EO7bdR25mcpewkJ1lSwKXBRl5VclR2krx
Content-Type: application/pgp-signature; name="signature.asc"
Content-Description: OpenPGP digital signature
Content-Disposition: attachment; filename="signature.asc"

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.22 (MingW32)

iQIcBAEBAgAGBQJUScgeAAoJEJrBFpNRJZKfOSoP/RjL9wJCyl04M0OHCmXb5n0f
sUbbElAF+Us4URbVNPVG5mVZooKT5Dl5WFm5uEjXHkzXXRbK24IPere4Tn46H3uw
BB4AW9gmOcOxSOEYtghATIzLhBI+UkEZxLJrhKyQIMZFVg9P7hm2TC9wjUc6S/d3
Z6x+bd/ukh0ojRfAXaZ3oLVV2N/uAIgIOGAkDk34WApF8EjFwEO33dt035qO7/n4
OmgP3J2JvprEM2HKvYfgnDUpvYHz/DgJAoRaW0vTD2OK6yDuCF8ROIiBOI7gvl9M
NKFUP4Wa8zIUF4u+WtqJ7x1yyDnvRhe/8Z63aSdcbITQ19nSX8YvQ0wCbpXScOgf
5lCkolSBolSNDsNeILVu3f4JV5/N8QwCV/9B1XuzGN98+cZiLLoqvXwkkz3HscZR
QXwYlqVTP0VlJ9Z4yZMKjVEKwzYpzTwNR30shpIMhhLyzJVeAOAutaEhkTVuPEci
2H5jcCssQlCGBs24gSsl8yh5sN/pz2RmSa2t8OOFMtYCKpmYtZxs5XEObeNqI+qo
Vseu8+zqAMFh59sRBdynp9BYzIY0vlHhJgklSDT8PBGECBvR7X0w8S9Pg4efjGaq
YHs+4yoDMMQklap3dLJoqzeHsbrDfKy+30YTbx8UfB+ffrA8er1uLMJnlOzfqGR0
IMSS1NRGiP++uUgKIbFO
=U9+b
-----END PGP SIGNATURE-----

--EO7bdR25mcpewkJ1lSwKXBRl5VclR2krx--

From owner-freebsd-virtualization@FreeBSD.ORG  Fri Oct 24 04:20:11 2014
Return-Path: 
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 4EF5457F;
 Fri, 24 Oct 2014 04:20:11 +0000 (UTC)
Received: from mail-lb0-x229.google.com (mail-lb0-x229.google.com
 [IPv6:2a00:1450:4010:c04::229])
 (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
 (Client CN "smtp.gmail.com",
 Issuer "Google Internet Authority G2" (verified OK))
 by mx1.freebsd.org (Postfix) with ESMTPS id 457A9FD6;
 Fri, 24 Oct 2014 04:20:10 +0000 (UTC)
Received: by mail-lb0-f169.google.com with SMTP id 10so1931539lbg.28
 for ; Thu, 23 Oct 2014 21:20:08 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
 h=mime-version:sender:in-reply-to:references:date:message-id:subject
 :from:to:cc:content-type;
 bh=a4h/yTVcb77Uzncemt6arDYRCSWVMJfN6seay5CYQZY=;
 b=VbmeUbQHCEuXpBDenR4ge+Lw69ZZKtTspwJV0Z28I/sVoI4mqAejvxNA/f9MtErN3R
 aOVX//GGg/bTzArUSC9bTtgdl76jnW6WIlkArpmCW0f60/GnwOVGdLssIEcRUFqjgkaU
 2uw/Wcr8LBp9RXsVL7/proGlHIAUPcqUt02WfCfHkrB1+aEja2Ly1f9OxOtX9evhWIEU
 drYgSWVGChpwGzQP/MCYlBCTsDX/2hsAM3CH6veQc6OQSoO6fv6Y5ybAZc0gTmURVB/1
 nWMijJM9fWG1nVqK7fg/EGx3qDMP1BoVnZpN136+KIZBXRWHG56zeyAJv1GvFv0H7Z6Z
 mSGA==
MIME-Version: 1.0
X-Received: by 10.152.27.38 with SMTP id q6mr90580lag.92.1414124408058; Thu,
 23 Oct 2014 21:20:08 -0700 (PDT)
Sender: crodr001@gmail.com
Received: by 10.112.84.197 with HTTP; Thu, 23 Oct 2014 21:20:07 -0700 (PDT)
In-Reply-To: <5449C81B.8080008@freebsd.org>
References: 
 
 
 <5449C81B.8080008@freebsd.org>
Date: Thu, 23 Oct 2014 21:20:07 -0700
X-Google-Sender-Auth: nnY3939Gop-kkXhmr88BME7waH4
Message-ID: 
Subject: Re: Automatically running /usr/tests on stable/10 branch under Jenkins
From: Craig Rodrigues 
To: Allan Jude 
Content-Type: text/plain; charset=ISO-8859-1
X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1
Cc: "freebsd-testing@freebsd.org" ,
 FreeBSD stable ,
 "freebsd-virtualization@freebsd.org" 
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Fri, 24 Oct 2014 04:20:11 -0000

On Thu, Oct 23, 2014 at 8:31 PM, Allan Jude  wrote:

>
> At the Cambridge Dev Summit, Xinuous specifically mentioned helping with
> testing and writing tests. Might be good people to reach out to
>

Are you referring to Eric Le Blan from Xinuous who was interviewed on
BSDNow ( http://www.bsdnow.tv/episodes/2014_08_20-engineering_nginx ,
starting at 0:16:38 )?

--
Craig

From owner-freebsd-virtualization@FreeBSD.ORG  Fri Oct 24 04:59:09 2014
Return-Path: 
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 6C84195D
 for ; Fri, 24 Oct 2014 04:59:09 +0000 (UTC)
Received: from mail-lb0-x22e.google.com (mail-lb0-x22e.google.com
 [IPv6:2a00:1450:4010:c04::22e])
 (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
 (Client CN "smtp.gmail.com",
 Issuer "Google Internet Authority G2" (verified OK))
 by mx1.freebsd.org (Postfix) with ESMTPS id D560A3B6
 for ; Fri, 24 Oct 2014 04:59:08 +0000 (UTC)
Received: by mail-lb0-f174.google.com with SMTP id p9so1919072lbv.5
 for ; Thu, 23 Oct 2014 21:59:06 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
 h=date:from:to:cc:subject:message-id:references:mime-version
 :content-type:content-disposition:content-transfer-encoding
 :in-reply-to:user-agent;
 bh=A/XwH9BvhfwSyp/HuLMj3ALaW2Rsl/Xd93vC3M6bLFE=;
 b=OnCSWTQpXTR/bdAFPv6zezA1N3Sh7wtyzhGDnQYIImBl99QzLQGt3P9QFzzPutGSRD
 6wYDjyLrvTv++iPnKPEkRJIievsYA0BUx9tl00dVKRLIBhKh6V5/EZkOXfLocqSEpXap
 tMy1G9t1svpJV1l7+DhR7Es+5ABwbigvMVtvXi9Sf7UVNEc1BWXh5t03iJKSmDCBoWkw
 On7ChsfgX1EJaHwmkbEcEGR55caM3Ub7tYxUFyRShIEREuFfwTeYFWk762y5X8hpjsrF
 5cnTpPGfc1IxNZ4CEce0TKSy3csZvciWw/J7PI/xF7nrq5SKUJ1t84lJoPnTOEFJvsXB
 gQ5Q==
X-Received: by 10.152.30.33 with SMTP id p1mr1801286lah.78.1414126746664;
 Thu, 23 Oct 2014 21:59:06 -0700 (PDT)
Received: from dev.san.ru (dev.san.ru. [88.147.129.60])
 by mx.google.com with ESMTPSA id lk5sm1451595lac.45.2014.10.23.21.59.05
 for 
 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128);
 Thu, 23 Oct 2014 21:59:06 -0700 (PDT)
Date: Fri, 24 Oct 2014 08:58:45 +0400
From: Roman Bogorodskiy 
To: Conrad Meyer 
Subject: Re: [PATCHv2 1/2] bhyve: Support /domain/bootloader configuration
 for non-FreeBSD guests.
Message-ID: <20141024045844.GA12422@dev.san.ru>
References: <1414106923-32313-1-git-send-email-cse.cem@gmail.com>
 <1414106923-32313-2-git-send-email-cse.cem@gmail.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable
In-Reply-To: <1414106923-32313-2-git-send-email-cse.cem@gmail.com>
User-Agent: Mutt/1.5.23 (2014-03-12)
Cc: libvir-list@redhat.com, Conrad Meyer ,
 freebsd-virtualization@freebsd.org
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Fri, 24 Oct 2014 04:59:09 -0000

  Conrad Meyer wrote:

> We still default to bhyveloader(1) if no explicit bootloader
> configuration is supplied in the domain.
>=20
> If the /domain/bootloader looks like grub-bhyve and the user doesn't
> supply /domain/bootloader_args, we make an intelligent guess and try
> chainloading the first partition on the disk.
>=20
> Caveats:
> - We can't install from CD without explicit bootloader_args.
> - We leave a device.map file lying around in /tmp. I don't see a good
>   way not to do so without reworking the API somewhat.
>
> Sponsored by:   EMC / Isilon storage division

Hi Conrad.

Thanks for the patch. As for the /tmp, probably storing it somewhere in
BHYVE_STATE_DIR would be more clean.

However, I'm concerned about libvirt dealing with the grub-bhyve
specifics as it involves some assumptions about its behaviour ahd has
limitations, like the one you pointed with installing from CD.

My idea was to add the following behaviour:

 * bootloader specified and bootloader_args specified -- use that as is
 * bootloader not specified, bootloader_args specified -- call
     bhyveload $bootloader_args $default_bhyveloader_args
 * bootloader and bootloader_args not set -- use defaults (current
     behaviour)
 * bootloader specified, bootloader_args missing -- fail here

Actually, I've implemented that already, but didn't send because it
needs some more testing.

The reason of my concern about adding a special handling of grub-bhyve
case that, as I've mentioned, we have to make assumptions and there are
also caveats you mentioned. Probably it'd worth to wait for bhyve to
provide single-step VM boot, i.e. UEFI support, that should appear soon
anyway.

There are some comments inline.

> Signed-off-by: Conrad Meyer 
> ---
>  docs/drvbhyve.html.in     |  28 ++++++++++--
>  docs/formatdomain.html.in |   4 +-
>  po/libvirt.pot            |   4 ++
>  src/bhyve/bhyve_command.c | 107 ++++++++++++++++++++++++++++++++++++++++=
+-----
>  4 files changed, 128 insertions(+), 15 deletions(-)
>=20
> diff --git a/docs/drvbhyve.html.in b/docs/drvbhyve.html.in
> index 39afdf5..6e85800 100644
> --- a/docs/drvbhyve.html.in
> +++ b/docs/drvbhyve.html.in
> @@ -37,8 +37,7 @@ bhyve+ssh://root@example.com/system (remote access, SSH=
 tunnelled)
>  
Example config

>  

>  The bhyve driver in libvirt is in its early stage and under active devel=
opment. So it supports
> -only limited number of features bhyve provides. All the supported featur=
es could be found
> -in this sample domain XML.
> +only limited number of features bhyve provides.
>  

> =20
>  

> @@ -50,8 +49,8 @@ up to 31 PCI devices.
> =20
>  
>  <domain type=3D'bhyve'>
> -  <name>bhyve</name>
> -  <uuid>df3be7e7-a104-11e3-aeb0-50e5492bd3dc</uuid>
> +    <name>bhyve</name>
> +    <uuid>df3be7e7-a104-11e3-aeb0-50e5492bd3dc</uuid>
>      <memory>219136</memory>
>      <currentMemory>219136</currentMemory>
>      <vcpu>1</vcpu>
> @@ -157,5 +156,26 @@ An example of domain XML device entry for that will =
look like:

>  
Please refer to the Storage documentation for more details on storage
>  management.

> =20
> +
Using grub2-bhyve or Alternative Bootloaders

> +
> +
It's possible to boot non-FreeBSD guests by specifying an explicit
> +bootloader, e.g. grub-bhyve(1). Arguments to the bootloader=
 may be
> +specified as well. If no arguments are given and bootloader is
> +grub-bhyve, libvirt will try and boot from the first partit=
ion of
> +the disk image.

> +
> +
> +  ...
> +    <bootloader>/usr/local/sbin/grub-bhyve</bootloader>
> +    <bootloader_args>...</bootloader_args>
> +  ...
> +

> +
> +
(Of course, to install from a CD a user will have to supply explicit
> +arguments to grub-bhyve.)

> +
> +
Caveat: bootloader_args does not support any quoting.
> +Filenames, etc, must not have spaces or they will be tokenized incorrect=
ly.

> +
>    
>  
> diff --git a/docs/formatdomain.html.in b/docs/formatdomain.html.in
> index 0099ce7..b7b6c46 100644
> --- a/docs/formatdomain.html.in
> +++ b/docs/formatdomain.html.in
> @@ -217,7 +217,9 @@
>        a BIOS, and instead the host is responsible to kicking off the
>        operating system boot. This may use a pseudo-bootloader in the
>        host to provide an interface to choose a kernel for the guest.
> -      An example is pygrub with Xen.
> +      An example is pygrub with Xen. The Bhyve hypervisor
> +      also uses a host bootloader, either bhyveload or
> +      grub-bhyve.
>      

> =20
>  
> diff --git a/po/libvirt.pot b/po/libvirt.pot
> index 0b44ad7..d8c9a4d 100644
> --- a/po/libvirt.pot
> +++ b/po/libvirt.pot
> @@ -851,6 +851,10 @@ msgstr ""
>  msgid "domain should have at least one disk defined"
>  msgstr ""
> =20
> +#: src/bhyve/bhyve_command.c:407
> +msgid "Custom loader requires explicit %s configuration"
> +msgstr ""
> +
>  #: src/bhyve/bhyve_device.c:50
>  msgid "PCI bus 0 slot 1 is reserved for the implicit LPC PCI-ISA bridge"
>  msgstr ""
> diff --git a/src/bhyve/bhyve_command.c b/src/bhyve/bhyve_command.c
> index bea4a59..99956ae 100644
> --- a/src/bhyve/bhyve_command.c
> +++ b/src/bhyve/bhyve_command.c
> @@ -300,6 +300,7 @@ virBhyveProcessBuildLoadCmd(virConnectPtr conn,
>  {
>      virCommandPtr cmd;
>      virDomainDiskDefPtr disk;
> +    bool bhyveload, grub_bhyve;
> =20
>      if (def->ndisks < 1) {
>          virReportError(VIR_ERR_CONFIG_UNSUPPORTED, "%s",
> @@ -326,19 +327,105 @@ virBhyveProcessBuildLoadCmd(virConnectPtr conn,
>          return NULL;
>      }
> =20
> -    cmd =3D virCommandNew(BHYVELOAD);
> +    if (def->os.bootloader =3D=3D NULL) {
> +        bhyveload =3D true;
> +        grub_bhyve =3D false;
> +        cmd =3D virCommandNew(BHYVELOAD);
> +    } else {
> +        bhyveload =3D false;
> +        if (strstr(def->os.bootloader, "grub-bhyve") =3D=3D 0)
> +            grub_bhyve =3D true;
> +        cmd =3D virCommandNew(def->os.bootloader);
> +    }
> =20
> -    /* Memory */
> -    virCommandAddArg(cmd, "-m");
> -    virCommandAddArgFormat(cmd, "%llu",
> -                           VIR_DIV_UP(def->mem.max_balloon, 1024));
> +    if (bhyveload && def->os.bootloaderArgs =3D=3D NULL) {
> +        VIR_DEBUG("%s: bhyveload with default arguments", __func__);
> +
> +        /* Memory (MB) */
> +        virCommandAddArg(cmd, "-m");
> +        virCommandAddArgFormat(cmd, "%llu",
> +                               VIR_DIV_UP(def->mem.max_balloon, 1024));
> +
> +        /* Image path */
> +        virCommandAddArg(cmd, "-d");
> +        virCommandAddArg(cmd, virDomainDiskGetSource(disk));
> +
> +        /* VM name */
> +        virCommandAddArg(cmd, def->name);
> +    } else if (grub_bhyve && def->os.bootloaderArgs =3D=3D NULL) {
> +        char tmpmapfile[128] =3D "/tmp/grub-bhyve-device.map_XXXXXX";
> +        FILE *f;
> +        int fd;
> +
> +        VIR_DEBUG("%s: grub-bhyve with default arguments", __func__);
> +
> +        /*
> +         * XXX Default grub-bhyve has some BIG caveats, but MAY work for=
 some
> +         * typical configurations. In particular:
> +         *
> +         *   - Can't create a new VM this way (no CD, no boot from CD)
> +         *   - Assumes a GRUB install on hd0,msdos1
> +         */
> =20
> -    /* Image path */
> -    virCommandAddArg(cmd, "-d");
> -    virCommandAddArg(cmd, virDomainDiskGetSource(disk));
> +        /* XXX cleanup this file. */
> +        fd =3D mkstemp(tmpmapfile);

This yields an error in 'syntax-check'. Running 'make syntax-check'
allows to avoid some of the general code and formatting issues.

> +        if (fd < 0) {
> +                virReportError(VIR_ERR_OPEN_FAILED, tmpmapfile);
> +                goto error;
> +        }
> +
> +        f =3D VIR_FDOPEN(fd, "wb+");
> +        if (f =3D=3D NULL) {
> +                VIR_FORCE_CLOSE(fd);
> +                virReportError(VIR_ERR_OPEN_FAILED, tmpmapfile);
> +                goto error;
> +        }
> +
> +        /* Grub device.map */
> +        fprintf(f, "(hd0) %s\n", virDomainDiskGetSource(disk));
> +        /* XXX CDs would look like: "(cd0) /path/to/CD" */
> +
> +        if (VIR_FCLOSE(f) < 0) {
> +                virReportSystemError(errno, "%s", _("failed to close fil=
e"));
> +                goto error;
> +        }
> =20
> -    /* VM name */
> -    virCommandAddArg(cmd, def->name);
> +
> +        virCommandAddArg(cmd, "--device-map");
> +        virCommandAddArg(cmd, tmpmapfile);
> +
> +        /* Memory in MB */
> +        virCommandAddArg(cmd, "--memory");
> +        virCommandAddArgFormat(cmd, "%llu",
> +                               VIR_DIV_UP(def->mem.max_balloon, 1024));
> +
> +        /* To boot from CD, "cd0" here. */
> +        virCommandAddArg(cmd, "--root");
> +        virCommandAddArg(cmd, "hd0,msdos1");
> +
> +        /* VM name */
> +        virCommandAddArg(cmd, def->name);
> +    } else if (def->os.bootloaderArgs =3D=3D NULL) {
> +        virReportError(VIR_ERR_CONFIG_UNSUPPORTED,
> +                       _("Custom loader requires explicit %s configurati=
on"),
> +                       "bootloader_args");
> +        goto error;
> +    } else {
> +        char **blargs, **arg;
> +
> +        VIR_DEBUG("%s: custom loader '%s' with arguments", __func__,
> +                  def->os.bootloader);
> +
> +        /* XXX: Handle quoted? */
> +        blargs =3D virStringSplit(def->os.bootloaderArgs, " ", 0);
> +        for (arg =3D blargs; *arg; arg++)
> +                virCommandAddArg(cmd, *arg);
> +        virStringFreeList(blargs);
> +    }
> =20
>      return cmd;
> +
> +error:
> +    virCommandFree(cmd);
> +    return NULL;
>  }
> --=20
> 1.9.3
>=20
> _______________________________________________
> freebsd-virtualization@freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization
> To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@free=
bsd.org"

Thanks,

Roman Bogorodskiy

From owner-freebsd-virtualization@FreeBSD.ORG  Fri Oct 24 05:36:43 2014
Return-Path: 
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 564D6DCC;
 Fri, 24 Oct 2014 05:36:43 +0000 (UTC)
Received: from mail-wi0-x22a.google.com (mail-wi0-x22a.google.com
 [IPv6:2a00:1450:400c:c05::22a])
 (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
 (Client CN "smtp.gmail.com",
 Issuer "Google Internet Authority G2" (verified OK))
 by mx1.freebsd.org (Postfix) with ESMTPS id 70D01932;
 Fri, 24 Oct 2014 05:36:42 +0000 (UTC)
Received: by mail-wi0-f170.google.com with SMTP id n3so332698wiv.1
 for ; Thu, 23 Oct 2014 22:36:40 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
 h=date:from:to:cc:subject:message-id:references:mime-version
 :content-type:content-disposition:in-reply-to:user-agent;
 bh=7+pxbGFZibruIx59JPm4doCZlK817jtqLwwip/wT9QM=;
 b=tcMuKDzTsWFWq8GbT08dE3SKrXwylP37kShX6LyB9CrHeMXbQ/6y6oA3cW2gv81SSu
 Kr131k/7p5qxekmI9fofwbDdpJtKEiva/fvVAUppqLVf3CDfWYigNvXgph0VTw+ur3mB
 b3souRl9t78ke8NVcIa/UpCtrBfm7IcALsvP6dlcQPID9pIgKlrd63vulsSTtF+oyAIC
 O0ZsYsnO/O9RAeP0t0yNhAdXSm87O7XLZw4rvIJnmeeHPQ2jRdCBVXZqSGzJFYD1dSjY
 gwGxvDF3o0LuFJytvalSVxRJtk5bCoaKZvNwsr07GsyhIAtN70Y3qE3zH5DJQGF3K103
 dX8g==
X-Received: by 10.180.205.162 with SMTP id lh2mr1688937wic.14.1414129000784;
 Thu, 23 Oct 2014 22:36:40 -0700 (PDT)
Received: from dft-labs.eu (n1x0n-1-pt.tunnel.tserv5.lon1.ipv6.he.net.
 [2001:470:1f08:1f7::2])
 by mx.google.com with ESMTPSA id hg14sm735728wib.24.2014.10.23.22.36.39
 for 
 (version=TLSv1.2 cipher=RC4-SHA bits=128/128);
 Thu, 23 Oct 2014 22:36:39 -0700 (PDT)
Date: Fri, 24 Oct 2014 07:36:36 +0200
From: Mateusz Guzik 
To: Craig Rodrigues 
Subject: Re: Automatically running /usr/tests on stable/10 branch under Jenkins
Message-ID: <20141024053636.GH11222@dft-labs.eu>
References: 
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Disposition: inline
In-Reply-To: 
User-Agent: Mutt/1.5.21 (2010-09-15)
Cc: "freebsd-testing@freebsd.org" ,
 FreeBSD stable ,
 "freebsd-virtualization@freebsd.org" 
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Fri, 24 Oct 2014 05:36:43 -0000

On Sun, Oct 12, 2014 at 11:14:45PM -0700, Craig Rodrigues wrote:
> Hi,
> 
> I have created this Jenkins job, which you can see a graphical
> representation of:
> 
> https://jenkins.freebsd.org/jenkins/view/FreeBSD_src_stable/job/FreeBSD_stable_10/848/BuildGraph/
> 

It is noted below stuff is being done this for current as well and in
that light:

> (1)  does a buildworld/buildkernel on amd64 when someone checks new
>       code into the stable/10 branch

Is not this excessive? I would suggest every N commits or M hours if
there were not enough commits to reach given threshold. Of course no
work in there were no commits whatsoever, but then do the work after the
first which gets in.

> (2)  Creates a bootable UFS image with makefs

any chance zfs will be used as well?

> (3)  Boots the image under bhyve
> (4)  Runs these commands inside the bhyve VM:
> 
>       cd /usr/tests
>       kyua test
>       kyua report-junit --output=test-output.xml

would be nice to run some kind of stress testing. buildworld with a high
-j is an example of a general purpose test. This could be done with
different frequency than regular tests.

> 
> (5)  Shuts down the bhyve VM

Do you have crashdumps configured in case stuff goes wrong?

> (6)  imports test-output.xml into Jenkins.
> 
> You can see a full test report here:
> 
> https://jenkins.freebsd.org/jenkins/job/FreeBSD_stable_10-tests/4/testReport/
> 
> We already do the same thing for CURRENT.
> 
> Hopefully by running the tests regularly, we can help improve the quality
> of FreeBSD.
> 
> 
> --
> Craig
> _______________________________________________
> freebsd-virtualization@freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization
> To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@freebsd.org"

-- 
Mateusz Guzik 

From owner-freebsd-virtualization@FreeBSD.ORG  Fri Oct 24 06:06:32 2014
Return-Path: 
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 476A76B7;
 Fri, 24 Oct 2014 06:06:32 +0000 (UTC)
Received: from mail-yh0-x235.google.com (mail-yh0-x235.google.com
 [IPv6:2607:f8b0:4002:c01::235])
 (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
 (Client CN "smtp.gmail.com",
 Issuer "Google Internet Authority G2" (verified OK))
 by mx1.freebsd.org (Postfix) with ESMTPS id D239DBF6;
 Fri, 24 Oct 2014 06:06:31 +0000 (UTC)
Received: by mail-yh0-f53.google.com with SMTP id z6so2969534yhz.12
 for ; Thu, 23 Oct 2014 23:06:31 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
 h=mime-version:sender:in-reply-to:references:date:message-id:subject
 :from:to:cc:content-type;
 bh=/fyOPRnYYCIbhxYMFn8WZMuaLqU4ZjEzzlTJRglH0go=;
 b=wGMvK3AYzPLenHX6lV4ZTx8TgweK0+XZ/vLRSfQWCUiZlEEMB1CaHYYQV00F5md5iQ
 2I9buxIeXEqZYBmYmfIEH4fOJDWXX7aCSk2sbezLEt59Pb1DNR5ImFtiJQgCKS/CZtkY
 iIr6R0xUOES3DUchUH1HdQLZ3+YkfzuJsSlQC8xxRrDhioyfXHEvw0ykELrTW6lJutoj
 Ez2cGkUUhqn2Hvn+Cc36SVmMzNVG9AFiM7Tyb1mhHHhGatbjdclZvyTUrF57kubHKs3h
 dMRoRw9KDjR33XV4hrNWqSU8j8yf8pKgq6wat1PPg4F19X5FKpQiwKw+QJhOtS0a0web
 ic0A==
MIME-Version: 1.0
X-Received: by 10.170.74.85 with SMTP id q82mr3009680ykq.119.1414130790985;
 Thu, 23 Oct 2014 23:06:30 -0700 (PDT)
Sender: kmacybsd@gmail.com
Received: by 10.170.82.197 with HTTP; Thu, 23 Oct 2014 23:06:30 -0700 (PDT)
In-Reply-To: <20141024053636.GH11222@dft-labs.eu>
References: 
 <20141024053636.GH11222@dft-labs.eu>
Date: Thu, 23 Oct 2014 23:06:30 -0700
X-Google-Sender-Auth: oQccbWzenSL947pHPPmkGKERUgE
Message-ID: 
Subject: Re: Automatically running /usr/tests on stable/10 branch under Jenkins
From: "K. Macy" 
To: Mateusz Guzik 
Content-Type: text/plain; charset=UTF-8
Cc: "freebsd-testing@freebsd.org" ,
 FreeBSD stable ,
 "freebsd-virtualization@freebsd.org" 
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Fri, 24 Oct 2014 06:06:32 -0000

>> (2)  Creates a bootable UFS image with makefs
>
> any chance zfs will be used as well?
>

Seconded. There are residual locking issues issues in ZFS.
Particularly in the less exercised areas.



>> (5)  Shuts down the bhyve VM
>
> Do you have crashdumps configured in case stuff goes wrong?

Along those same lines, do you have any sort of watchdog in case it deadlocks?

-K

From owner-freebsd-virtualization@FreeBSD.ORG  Fri Oct 24 08:05:45 2014
Return-Path: 
Delivered-To: virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 848ECF3C
 for ; Fri, 24 Oct 2014 08:05:45 +0000 (UTC)
Received: from smtp.digiware.nl (smtp.digiware.nl [31.223.170.169])
 (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
 (Client did not present a certificate)
 by mx1.freebsd.org (Postfix) with ESMTPS id 46AA691B
 for ; Fri, 24 Oct 2014 08:05:44 +0000 (UTC)
Received: from rack1.digiware.nl (unknown [127.0.0.1])
 by smtp.digiware.nl (Postfix) with ESMTP id 00722153416
 for ; Fri, 24 Oct 2014 10:05:35 +0200 (CEST)
X-Virus-Scanned: amavisd-new at digiware.nl
Received: from smtp.digiware.nl ([127.0.0.1])
 by rack1.digiware.nl (rack1.digiware.nl [127.0.0.1]) (amavisd-new, port 10024)
 with ESMTP id 2shTwSQcb_yT; Fri, 24 Oct 2014 10:05:16 +0200 (CEST)
Received: from [IPv6:2001:4cb8:3:1:38e4:5c44:f298:d877] (unknown
 [IPv6:2001:4cb8:3:1:38e4:5c44:f298:d877])
 by smtp.digiware.nl (Postfix) with ESMTP id 4FABF153448
 for ; Fri, 24 Oct 2014 10:05:16 +0200 (CEST)
Message-ID: <544A083B.50007@digiware.nl>
Date: Fri, 24 Oct 2014 10:05:15 +0200
From: Willem Jan Withagen 
Organization: Digiware Management b.v.
User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64;
 rv:24.0) Gecko/20100101 Thunderbird/24.6.0
MIME-Version: 1.0
To: virtualization@freebsd.org
Subject: Bhyve building kernel....Just an observation
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Fri, 24 Oct 2014 08:05:45 -0000

Hi,

Just out of curiosity I did the following:

Updated 10-STABLE src in both Dom0 and in the Bhyve FreeBSD VM
Rebooted my bhyve AMD testing machine so it was in a fresh state.
Nothing special loaded orhter than ZFS.

And build a 10-STABLE kernel on the raw box, that took about 6 minutes.
no {make,src}.conf, so the full GENERIC KERNEL
That took about 6:45 minutes.

Again rebooted to clean the box up.
And then booted a 10-STABLE bhyve VM with all memory and processors 
assigned to the VM. So all the power could be available to the VM.

The build again 10-STABLE in the VM.
That took about 9:30 minutes.

Now it looks like the VM has a 50% overhead.
My expectations were quite a bit better for the performance difference 
between the two?

Would people with more experience in doing VM stuff expect such a large
difference?
Or is this a to be expected result?

Thanx,
--WjW

System info:
Dom0:
	11.0-CURRENT FreeBSD 11.0-CURRENT #1 r273066M
	(110.0 Head with Neel's patch)
	CPU: AMD Phenom(tm) II X6 1075T Processor (3013.83-MHz K8-class
	16 Gb Ram
	ZFS mirror
		2* 500Gb WD WD5000AA
		cache 2* Samsung SSD 840 PRO Series DXM05B0Q

Dom Bhyve
	FreeBSD 10.0-RELEASE-p9
	ahci-hd 16GB



From owner-freebsd-virtualization@FreeBSD.ORG  Fri Oct 24 08:12:23 2014
Return-Path: 
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 5D6B31D0;
 Fri, 24 Oct 2014 08:12:23 +0000 (UTC)
Received: from zhost.uxsglobal.com (zhost.xinuos.com [144.202.236.63])
 by mx1.freebsd.org (Postfix) with ESMTP id 2CE259F3;
 Fri, 24 Oct 2014 08:12:22 +0000 (UTC)
Received: from localhost (localhost [127.0.0.1])
 by zhost.uxsglobal.com (Postfix) with ESMTP id B32338C035B;
 Fri, 24 Oct 2014 04:12:16 -0400 (EDT)
Received: from zhost.uxsglobal.com ([127.0.0.1])
 by localhost (zhost.uxsglobalhost.com [127.0.0.1]) (amavisd-new, port 10024)
 with ESMTP id f_JEp-p0yZZa; Fri, 24 Oct 2014 04:12:16 -0400 (EDT)
Received: from zhost.uxsglobal.com (localhost [127.0.0.1])
 by zhost.uxsglobal.com (Postfix) with ESMTP id 8405C8C035A;
 Fri, 24 Oct 2014 04:12:16 -0400 (EDT)
Received: from 64ZN53J (unknown [212.40.155.50])
 by zhost.uxsglobal.com (Postfix) with ESMTPSA id EA7978C035C;
 Fri, 24 Oct 2014 04:12:06 -0400 (EDT)
Reply-To: 
From: "Eric le Blan" 
To: 
References: <5449C81B.8080008@freebsd.org> <5449DB7C.9080107@xinuos.com>
In-Reply-To: <5449DB7C.9080107@xinuos.com>
Subject: RE: Re: Automatically running /usr/tests on stable/10 branch under
 Jenkins
Date: Fri, 24 Oct 2014 11:11:59 +0300
Organization: Xinuos, Inc.
Message-ID: <06ec01cfef62$3776a6b0$a663f410$@Xinuos.com>
MIME-Version: 1.0
X-Mailer: Microsoft Outlook 15.0
Thread-Index: AQHziTEWsZrWVIPIV8vYqc5DIi1UpgGVS+E/m+sFWRA=
Content-Language: en-gb
Content-Type: text/plain;
	charset="us-ascii"
Content-Transfer-Encoding: 7bit
X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1
Cc: 'John Wolfe' , freebsd-virtualization@freebsd.org,
 freebsd-testing@freebsd.org, 'Susan Stanziano' ,
 'Cheryl Blain' ,
 'Andy Nagle' 
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Fri, 24 Oct 2014 08:12:23 -0000

Allan,

 

Always happy to discuss testing. I believe that Susan Stanziono of Xinuos
system test team already spoke to some of you. Please do not hesitate to
reach her for any specific needs. Also, Cheryl Blain - Xinuos VP of
operations - will be at the MeetBSD vendor summit on Nov 3-4 and can reach
to Craig.

 

Keep well.

 

Eric
Interim CTO

* email:   eric@xinuos.com

 
 

 

 

-------- Original Message -------- 


Subject: 

Re: Automatically running /usr/tests on stable/10 branch under Jenkins


Date: 

Thu, 23 Oct 2014 23:31:39 -0400


From: 

Allan Jude   


To: 

freebsd-virtualization@freebsd.org
 , freebsd-testing@freebsd.org
 , freebsd-stable@freebsd.org
 

 

On 2014-10-23 18:30, Craig Rodrigues wrote:
> Garrett Cooper wrote:
> 
>> 
>> Hi Craig!
>>         As much as everyone would like to take i386 out to pasture,
>> there's a large degree of value in running i386 tests on 11-CURRENT and
>> 10-STABLE (I've caught some interesting build bugs and test bugs by
running
>> on my i386/CURRENT VM). Are there any plans to have i386 executors
running
>> tests anytime soon (does bhyve support i386?)?
>> 
> 
> 
> We (jenkins-admin@freebsd.org  ) have
been busy the 5 months since BSDCan
> 2014 as
> you can see by our status report, which lists what we have done, and what
> our future plans are:
> 
>
https://www.freebsd.org/news/status/report-2014-07-2014-09.html#Jenkins-Cont
inuous-Integration-for-FreeBSD
> 
> Integrating Jenkins with Kyua on amd64 was a major milestone which was
> achieved, and
> was even mentioned on the Jenkins web site:
> 
> http://jenkins-ci.org/content/freebsd-project-use-jenkins-os-testing
> 
> Now, where to take this further (such as i386) is an interesting question.
> 
> Personally, I would like to see:
>    -> integration of automated kyua testing with the FreeBSD release
> engineering process
>    -> more involvement from FreeBSD developers, and even companies such as
> EMC/Isilon,
>        who can:
>            -> write tests
>            -> suggest and implement new tests (network, storage, VM, etc.)
>            -> help with devops maintenance of the existing
> jenkins.freebsd.org cluster
>            -> improve bhyve support in libvirt
>            -> set up their own Jenkins build environments outside of
> FreeBSD, and help test things in their own private environments
> 
> I've had requests for;
>    -> running tests in bhyve VM's with very small memory footprints
> (Adrian Chadd)
>    -> running tests in MIPS environment (Adrian Chadd)
>    -> running Java JDK tests (Kip Macy)
>    -> i386 builds (Garrett Cooper)
> 
> There are a lot of different directions to take this, but without more
> people (and companies) pitching in and helping out,
> progress is limited by bodies working on the stuff.
> 
> I will be at the MeetBSD Vendor summit (not the conference) Nov. 3-4, so
> hopefully
> anyone interested in pushing this stuff forward can talk to me there.
> 
> --
> Craig
> _______________________________________________
> freebsd-virtualization@freebsd.org
  mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization
> To unsubscribe, send any mail to

"freebsd-virtualization-unsubscribe@freebsd.org"
> 
 
At the Cambridge Dev Summit, Xinuous specifically mentioned helping with
testing and writing tests. Might be good people to reach out to
 
-- 
Allan Jude
 
 

 

 


From owner-freebsd-virtualization@FreeBSD.ORG  Fri Oct 24 11:09:08 2014
Return-Path: 
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 47B24833;
 Fri, 24 Oct 2014 11:09:08 +0000 (UTC)
Received: from mail-lb0-x22d.google.com (mail-lb0-x22d.google.com
 [IPv6:2a00:1450:4010:c04::22d])
 (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
 (Client CN "smtp.gmail.com",
 Issuer "Google Internet Authority G2" (verified OK))
 by mx1.freebsd.org (Postfix) with ESMTPS id 65E2BC1;
 Fri, 24 Oct 2014 11:09:07 +0000 (UTC)
Received: by mail-lb0-f173.google.com with SMTP id 10so2365305lbg.4
 for ; Fri, 24 Oct 2014 04:09:05 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
 h=mime-version:sender:in-reply-to:references:date:message-id:subject
 :from:to:cc:content-type;
 bh=KmYMihj1PwsSWtnggR8jNhB1+EOPLGi1L5jstxB713g=;
 b=HdUrhdPcCjK9G8i+/E4wIfI0OX1jepW1ZX94SO37pNWV5SepfWl72RaiUkTML37XrQ
 5+3+1MEMz3QUf5oxUsXGbVBts43FNl0B7M2DCEZjRNNN5TYissE6c6ILpY/Dxsim/q6b
 PaxnZob2DuLy2/aKM/XKsAQSifYswglbXyZ5MImKwNdAVokqpGGWzOTimYtMQPakPfog
 cmfEFV26BTtl4x+JT+WKNJ0NfcfEtIGG/8y47ustUyMNZa3FEOvEepxV+DANwKVkSx6I
 u2Jb/WkdddZ5KvRDOkX/DzpD4/jD7S9t04X77kal0LOZAEUZcu8JJEWjp2y+qT8d6GOp
 yZ6Q==
MIME-Version: 1.0
X-Received: by 10.152.5.169 with SMTP id t9mr2258113lat.90.1414148945077; Fri,
 24 Oct 2014 04:09:05 -0700 (PDT)
Sender: crodr001@gmail.com
Received: by 10.112.84.197 with HTTP; Fri, 24 Oct 2014 04:09:04 -0700 (PDT)
In-Reply-To: <06ec01cfef62$3776a6b0$a663f410$@Xinuos.com>
References: <5449C81B.8080008@freebsd.org> <5449DB7C.9080107@xinuos.com>
 <06ec01cfef62$3776a6b0$a663f410$@Xinuos.com>
Date: Fri, 24 Oct 2014 04:09:04 -0700
X-Google-Sender-Auth: TjofZ6_tWhX3p8SFupBERwHvn9c
Message-ID: 
Subject: Re: Re: Automatically running /usr/tests on stable/10 branch under
 Jenkins
From: Craig Rodrigues 
To: Eric@xinuos.com
Content-Type: text/plain; charset=ISO-8859-1
X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1
Cc: John Wolfe ,
 "freebsd-virtualization@freebsd.org" ,
 "freebsd-testing@freebsd.org" ,
 Susan Stanziano ,
 Allan Jude , Cheryl Blain ,
 Andy Nagle 
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Fri, 24 Oct 2014 11:09:08 -0000

On Fri, Oct 24, 2014 at 1:11 AM, Eric le Blan  wrote:

> Allan,
>
>
>
> Always happy to discuss testing. I believe that Susan Stanziono of Xinuos
> system test team already spoke to some of you. Please do not hesitate to
> reach her for any specific needs. Also, Cheryl Blain - Xinuos VP of
> operations - will be at the MeetBSD vendor summit on Nov 3-4 and can reach
> to Craig.



It would be helpful if someone (or some people) from Xinuous could do the
following:

(1)  Subscribe to freebsd-testing@freebsd.org at
https://lists.freebsd.org/mailman/listinfo/freebsd-testing to start
monitoring the discussions on that list.

(2)   Review this announcement:
http://jenkins-ci.org/content/freebsd-project-use-jenkins-os-testing

(3)  Review these slides:
http://www.slideshare.net/CraigRodrigues1/kyua-jenkins

(4)  Talk to me at MeetBSD Vendor Summit

I have not been given a long timeslot to give a presentation, so reviewing
those links before MeetBSD would
be helpful.  Long term, any testing of FreeBSD will only succeed if there
is
an ecosystem of people working together and sharing common scripts and
information for testing FreeBSD.

Any help that Xinuous (or any other company) can provide would be welcome.

--
Craig

From owner-freebsd-virtualization@FreeBSD.ORG  Fri Oct 24 13:12:00 2014
Return-Path: 
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 1874F7B3
 for ; Fri, 24 Oct 2014 13:12:00 +0000 (UTC)
Received: from mail-vc0-x22e.google.com (mail-vc0-x22e.google.com
 [IPv6:2607:f8b0:400c:c03::22e])
 (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
 (Client CN "smtp.gmail.com",
 Issuer "Google Internet Authority G2" (verified OK))
 by mx1.freebsd.org (Postfix) with ESMTPS id CA1BA10D
 for ; Fri, 24 Oct 2014 13:11:59 +0000 (UTC)
Received: by mail-vc0-f174.google.com with SMTP id hq12so215972vcb.19
 for ; Fri, 24 Oct 2014 06:11:58 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
 h=mime-version:in-reply-to:references:date:message-id:subject:from:to
 :cc:content-type;
 bh=YqOSV4ft9Jo7gyd8tbCCJ0G82f4ZmP6nWlLe+wb3htQ=;
 b=XdjXz6JdRh+C+aBZZZRD+2O0ma/0MF8AmTSIIPDXBDE10OVJVnBPx9HIhySFE686XA
 qKvsps6AHfLsEMADzUMYMF8kukV+R/gfjdc5NV82H2DOZKLL7oXKz8Luq5mq+quVe5wl
 tXy+nTDuJds6JdzDfkqQiqtW3ftM5kx/7Q6ANGRcnyl2RynWPLZuTjMhN1nhRTxJhOAd
 TWlbDRs7zsGWH3EjW5c8aSoN+vNXx0emiFRsIAzzZxLDjzPNylQtysC2aduD3guGCdA4
 4/Qeja5mKAqQEa+t08pA7UDgwA4v5XdlcDNoUS3E3WEQVzgX5fcqFQCAxAiOv7Od3Nxa
 UjGg==
MIME-Version: 1.0
X-Received: by 10.52.252.172 with SMTP id zt12mr2443144vdc.7.1414156318868;
 Fri, 24 Oct 2014 06:11:58 -0700 (PDT)
Received: by 10.220.150.68 with HTTP; Fri, 24 Oct 2014 06:11:58 -0700 (PDT)
In-Reply-To: <20141024045844.GA12422@dev.san.ru>
References: <1414106923-32313-1-git-send-email-cse.cem@gmail.com>
 <1414106923-32313-2-git-send-email-cse.cem@gmail.com>
 <20141024045844.GA12422@dev.san.ru>
Date: Fri, 24 Oct 2014 09:11:58 -0400
Message-ID: 
Subject: Re: [PATCHv2 1/2] bhyve: Support /domain/bootloader configuration for
 non-FreeBSD guests.
From: Conrad Rad 
To: Roman Bogorodskiy 
Content-Type: text/plain; charset=UTF-8
Cc: libvir-list@redhat.com,
 "freebsd-virtualization@freebsd.org" 
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Fri, 24 Oct 2014 13:12:00 -0000

On Fri, Oct 24, 2014 at 12:58 AM, Roman Bogorodskiy
 wrote:
>   Conrad Meyer wrote:
> Hi Conrad.
>
> Thanks for the patch. As for the /tmp, probably storing it somewhere in
> BHYVE_STATE_DIR would be more clean.

Sure.

> However, I'm concerned about libvirt dealing with the grub-bhyve
> specifics as it involves some assumptions about its behaviour ahd has
> limitations, like the one you pointed with installing from CD.

Sure. However, the user can always override the assumptions. And I
think the CD case is actually quite easy to fix, if that's a blocking
issue.

> My idea was to add the following behaviour:
>
>  * bootloader specified and bootloader_args specified -- use that as is
>  * bootloader not specified, bootloader_args specified -- call
>      bhyveload $bootloader_args $default_bhyveloader_args
>  * bootloader and bootloader_args not set -- use defaults (current
>      behaviour)
>  * bootloader specified, bootloader_args missing -- fail here

Ok. I think the grub-bhyve stuff is just a special case of the 4th
bullet here; but otherwise my patch matches up with this behavior.

> Actually, I've implemented that already, but didn't send because it
> needs some more testing.

Ok. I am happy to guinea-pig bhyve improvements for libvirt, if you need it.

> The reason of my concern about adding a special handling of grub-bhyve
> case that, as I've mentioned, we have to make assumptions and there are
> also caveats you mentioned. Probably it'd worth to wait for bhyve to
> provide single-step VM boot, i.e. UEFI support, that should appear soon
> anyway.

Any idea how soon? Months? A year? 5 years? I'm not comfortable
postponing improvements indefinitely for vaporware. In the wonderful
bhyve-UEFI future, we can ignore/warn about .

> There are some comments inline.

Thanks!

>> -    /* Image path */
>> -    virCommandAddArg(cmd, "-d");
>> -    virCommandAddArg(cmd, virDomainDiskGetSource(disk));
>> +        /* XXX cleanup this file. */
>> +        fd = mkstemp(tmpmapfile);
>
> This yields an error in 'syntax-check'. Running 'make syntax-check'
> allows to avoid some of the general code and formatting issues.

I did run syntax-check, but did not see any error around there.
syntax-check has lots of console output; does it log somewhere else
too?

Thanks,
Conrad

From owner-freebsd-virtualization@FreeBSD.ORG  Fri Oct 24 15:03:04 2014
Return-Path: 
Delivered-To: virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 8DD63C74
 for ; Fri, 24 Oct 2014 15:03:04 +0000 (UTC)
Received: from mx1.scaleengine.net (beauharnois2.bhs1.scaleengine.net
 [142.4.218.15]) by mx1.freebsd.org (Postfix) with ESMTP id 67D3DF2D
 for ; Fri, 24 Oct 2014 15:03:03 +0000 (UTC)
Received: from [192.168.1.2] (Seawolf.HML3.ScaleEngine.net [209.51.186.28])
 (Authenticated sender: allanjude.freebsd@scaleengine.com)
 by mx1.scaleengine.net (Postfix) with ESMTPSA id 6B28D64B01;
 Fri, 24 Oct 2014 15:03:03 +0000 (UTC)
Message-ID: <544A6A3A.2020108@freebsd.org>
Date: Fri, 24 Oct 2014 11:03:22 -0400
From: Allan Jude 
User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64;
 rv:31.0) Gecko/20100101 Thunderbird/31.2.0
MIME-Version: 1.0
To: Willem Jan Withagen , virtualization@freebsd.org
Subject: Re: Bhyve building kernel....Just an observation
References: <544A083B.50007@digiware.nl>
In-Reply-To: <544A083B.50007@digiware.nl>
Content-Type: multipart/signed; micalg=pgp-sha1;
 protocol="application/pgp-signature";
 boundary="vReighlB0wreteRi6OV2p05FKIuqsJBPl"
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Fri, 24 Oct 2014 15:03:04 -0000

This is an OpenPGP/MIME signed message (RFC 4880 and 3156)
--vReighlB0wreteRi6OV2p05FKIuqsJBPl
Content-Type: text/plain; charset=windows-1252
Content-Transfer-Encoding: quoted-printable

On 2014-10-24 04:05, Willem Jan Withagen wrote:
> Hi,
>=20
> Just out of curiosity I did the following:
>=20
> Updated 10-STABLE src in both Dom0 and in the Bhyve FreeBSD VM
> Rebooted my bhyve AMD testing machine so it was in a fresh state.
> Nothing special loaded orhter than ZFS.
>=20
> And build a 10-STABLE kernel on the raw box, that took about 6 minutes.=

> no {make,src}.conf, so the full GENERIC KERNEL
> That took about 6:45 minutes.
>=20
> Again rebooted to clean the box up.
> And then booted a 10-STABLE bhyve VM with all memory and processors
> assigned to the VM. So all the power could be available to the VM.
>=20
> The build again 10-STABLE in the VM.
> That took about 9:30 minutes.
>=20
> Now it looks like the VM has a 50% overhead.
> My expectations were quite a bit better for the performance difference
> between the two?
>=20
> Would people with more experience in doing VM stuff expect such a large=

> difference?
> Or is this a to be expected result?
>=20
> Thanx,
> --WjW
>=20
> System info:
> Dom0:
>     11.0-CURRENT FreeBSD 11.0-CURRENT #1 r273066M
>     (110.0 Head with Neel's patch)
>     CPU: AMD Phenom(tm) II X6 1075T Processor (3013.83-MHz K8-class
>     16 Gb Ram
>     ZFS mirror
>         2* 500Gb WD WD5000AA
>         cache 2* Samsung SSD 840 PRO Series DXM05B0Q
>=20
> Dom Bhyve
>     FreeBSD 10.0-RELEASE-p9
>     ahci-hd 16GB
>=20
>=20
> _______________________________________________
> freebsd-virtualization@freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization
> To unsubscribe, send any mail to
> "freebsd-virtualization-unsubscribe@freebsd.org"

The big difference here is probably disk performance. If you do
something that is pure CPU, you'll usually get about the same
performance as the host, but virtualized disk is not always nearly as goo=
d.

--=20
Allan Jude


--vReighlB0wreteRi6OV2p05FKIuqsJBPl
Content-Type: application/pgp-signature; name="signature.asc"
Content-Description: OpenPGP digital signature
Content-Disposition: attachment; filename="signature.asc"

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.22 (MingW32)

iQIcBAEBAgAGBQJUSmo6AAoJEJrBFpNRJZKf1GoQAJF9euei+uqsx7sR6ufaTwrL
oGUG1PWEEF7QC7N2QKAlcGEq3MwlQVo8H8KTvzsKYJfNdYF5YPVnYWHzIcy+CRn3
PVzzNELQOUl3zxNTEj3sGJP3eKCxpNSTBea7VTA8NAaYMovmWVqc7nJCf7Oyzvg9
535l3Fz0dvEEvTlSJr/6FLm3OAyb09TwSEhvXG2oD/LTZcuC5KW0FIto5SDt4Ja9
gYWRyC/qtKLPO1Y9m1iTSEbL6rwPCyW1ZABQGwi44ReIVVEjd37E9VKRH4LTzNhG
KnzQu6o3SE3j1LoHItLjovJMw3UoMVF/KFs0c2U6o/thIgQ8HMDFf3zL9AhnWvau
f3CYYkUKex6V/BvH2p61aPKuP3XGt8P5u5tllH80/VM6BorBu3LZF5Nw4m5U9ILO
hfOnvPEnGJ0MhSkPaHV5XtJQ7ks+RNZqOQ6hMQUZ8vCpCpyi2Kg5ykI/HyhIBgLh
urr1Sl3WU2bWZiFBfHFblQ65tHeA3IcFIH4zdHod2rMF0LmrKj/3nes5gPeAAsaT
To1iw54sW2VeKrnjIebmkwP9CHN4nzgLlhLnQx7NTw5HygeTzKY8Y9PBJ1PmEUbn
LVY96dMwD0dpD4Qs/jNWPWJwYqkgBZfRnm8JH5/QyLAoxtswyU4EjLEKDDJUWe2h
+0zsxLRfNUJgeS/OjGRE
=dNYI
-----END PGP SIGNATURE-----

--vReighlB0wreteRi6OV2p05FKIuqsJBPl--

From owner-freebsd-virtualization@FreeBSD.ORG  Fri Oct 24 15:14:55 2014
Return-Path: 
Delivered-To: virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 2B64CC3;
 Fri, 24 Oct 2014 15:14:55 +0000 (UTC)
Received: from smtp.digiware.nl (smtp.digiware.nl [31.223.170.169])
 (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
 (Client did not present a certificate)
 by mx1.freebsd.org (Postfix) with ESMTPS id DF8A2119;
 Fri, 24 Oct 2014 15:14:54 +0000 (UTC)
Received: from rack1.digiware.nl (unknown [127.0.0.1])
 by smtp.digiware.nl (Postfix) with ESMTP id 098BD1534C7;
 Fri, 24 Oct 2014 17:14:52 +0200 (CEST)
X-Virus-Scanned: amavisd-new at digiware.nl
Received: from smtp.digiware.nl ([127.0.0.1])
 by rack1.digiware.nl (rack1.digiware.nl [127.0.0.1]) (amavisd-new, port 10024)
 with ESMTP id 17gn6oRBqDEi; Fri, 24 Oct 2014 17:14:40 +0200 (CEST)
Received: from [192.168.101.102] (vpn.ecoracks.nl [31.223.170.173])
 (using TLSv1 with cipher ECDHE-RSA-AES128-SHA (128/128 bits))
 (No client certificate requested)
 by smtp.digiware.nl (Postfix) with ESMTPSA id BA7AB153448;
 Fri, 24 Oct 2014 17:14:40 +0200 (CEST)
Message-ID: <544A6CE2.5020500@digiware.nl>
Date: Fri, 24 Oct 2014 17:14:42 +0200
From: Willem Jan Withagen 
User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64;
 rv:24.0) Gecko/20100101 Thunderbird/24.6.0
MIME-Version: 1.0
To: Allan Jude , virtualization@freebsd.org
Subject: Re: Bhyve building kernel....Just an observation
References: <544A083B.50007@digiware.nl> <544A6A3A.2020108@freebsd.org>
In-Reply-To: <544A6A3A.2020108@freebsd.org>
Content-Type: text/plain; charset=windows-1252
Content-Transfer-Encoding: 7bit
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Fri, 24 Oct 2014 15:14:55 -0000

On 24-10-2014 17:03, Allan Jude wrote:
> On 2014-10-24 04:05, Willem Jan Withagen wrote:
>> Hi,
>>
>> Just out of curiosity I did the following:
>>
>> Updated 10-STABLE src in both Dom0 and in the Bhyve FreeBSD VM
>> Rebooted my bhyve AMD testing machine so it was in a fresh state.
>> Nothing special loaded orhter than ZFS.
>>
>> And build a 10-STABLE kernel on the raw box, that took about 6 minutes.
>> no {make,src}.conf, so the full GENERIC KERNEL
>> That took about 6:45 minutes.
>>
>> Again rebooted to clean the box up.
>> And then booted a 10-STABLE bhyve VM with all memory and processors
>> assigned to the VM. So all the power could be available to the VM.
>>
>> The build again 10-STABLE in the VM.
>> That took about 9:30 minutes.
>>
>> Now it looks like the VM has a 50% overhead.
>> My expectations were quite a bit better for the performance difference
>> between the two?
>>
>> Would people with more experience in doing VM stuff expect such a large
>> difference?
>> Or is this a to be expected result?
>>
>> Thanx,
>> --WjW
>>
>> System info:
>> Dom0:
>>     11.0-CURRENT FreeBSD 11.0-CURRENT #1 r273066M
>>     (110.0 Head with Neel's patch)
>>     CPU: AMD Phenom(tm) II X6 1075T Processor (3013.83-MHz K8-class
>>     16 Gb Ram
>>     ZFS mirror
>>         2* 500Gb WD WD5000AA
>>         cache 2* Samsung SSD 840 PRO Series DXM05B0Q
>>
>> Dom Bhyve
>>     FreeBSD 10.0-RELEASE-p9
>>     ahci-hd 16GB

> The big difference here is probably disk performance. If you do
> something that is pure CPU, you'll usually get about the same
> performance as the host, but virtualized disk is not always nearly as good.

Would it make any difference to use virtio instead of ahci-hd?

In any case, to test your assumption:
	build a 10G memdisk in Dom0 and DomU
	load it with sources and /usr/obj
and see if that helps getting things closer?

Nice thing to do during eveninghours in the weekend.

--WjW


From owner-freebsd-virtualization@FreeBSD.ORG  Fri Oct 24 15:18:13 2014
Return-Path: 
Delivered-To: virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 64C95284
 for ; Fri, 24 Oct 2014 15:18:13 +0000 (UTC)
Received: from mx1.scaleengine.net (beauharnois2.bhs1.scaleengine.net
 [142.4.218.15]) by mx1.freebsd.org (Postfix) with ESMTP id 2516514E
 for ; Fri, 24 Oct 2014 15:18:12 +0000 (UTC)
Received: from [192.168.1.2] (Seawolf.HML3.ScaleEngine.net [209.51.186.28])
 (Authenticated sender: allanjude.freebsd@scaleengine.com)
 by mx1.scaleengine.net (Postfix) with ESMTPSA id 21F4664BFB;
 Fri, 24 Oct 2014 15:18:12 +0000 (UTC)
Message-ID: <544A6DC4.1090206@freebsd.org>
Date: Fri, 24 Oct 2014 11:18:28 -0400
From: Allan Jude 
User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64;
 rv:31.0) Gecko/20100101 Thunderbird/31.2.0
MIME-Version: 1.0
To: Willem Jan Withagen , virtualization@freebsd.org
Subject: Re: Bhyve building kernel....Just an observation
References: <544A083B.50007@digiware.nl> <544A6A3A.2020108@freebsd.org>
 <544A6CE2.5020500@digiware.nl>
In-Reply-To: <544A6CE2.5020500@digiware.nl>
Content-Type: multipart/signed; micalg=pgp-sha1;
 protocol="application/pgp-signature";
 boundary="ao0CuqX6CEv3EfQoBDu4OktkMgFhWTMOd"
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Fri, 24 Oct 2014 15:18:13 -0000

This is an OpenPGP/MIME signed message (RFC 4880 and 3156)
--ao0CuqX6CEv3EfQoBDu4OktkMgFhWTMOd
Content-Type: text/plain; charset=windows-1252
Content-Transfer-Encoding: quoted-printable

On 2014-10-24 11:14, Willem Jan Withagen wrote:
> On 24-10-2014 17:03, Allan Jude wrote:
>> On 2014-10-24 04:05, Willem Jan Withagen wrote:
>>> Hi,
>>>
>>> Just out of curiosity I did the following:
>>>
>>> Updated 10-STABLE src in both Dom0 and in the Bhyve FreeBSD VM
>>> Rebooted my bhyve AMD testing machine so it was in a fresh state.
>>> Nothing special loaded orhter than ZFS.
>>>
>>> And build a 10-STABLE kernel on the raw box, that took about 6 minute=
s.
>>> no {make,src}.conf, so the full GENERIC KERNEL
>>> That took about 6:45 minutes.
>>>
>>> Again rebooted to clean the box up.
>>> And then booted a 10-STABLE bhyve VM with all memory and processors
>>> assigned to the VM. So all the power could be available to the VM.
>>>
>>> The build again 10-STABLE in the VM.
>>> That took about 9:30 minutes.
>>>
>>> Now it looks like the VM has a 50% overhead.
>>> My expectations were quite a bit better for the performance differenc=
e
>>> between the two?
>>>
>>> Would people with more experience in doing VM stuff expect such a lar=
ge
>>> difference?
>>> Or is this a to be expected result?
>>>
>>> Thanx,
>>> --WjW
>>>
>>> System info:
>>> Dom0:
>>>     11.0-CURRENT FreeBSD 11.0-CURRENT #1 r273066M
>>>     (110.0 Head with Neel's patch)
>>>     CPU: AMD Phenom(tm) II X6 1075T Processor (3013.83-MHz K8-class
>>>     16 Gb Ram
>>>     ZFS mirror
>>>         2* 500Gb WD WD5000AA
>>>         cache 2* Samsung SSD 840 PRO Series DXM05B0Q
>>>
>>> Dom Bhyve
>>>     FreeBSD 10.0-RELEASE-p9
>>>     ahci-hd 16GB
>=20
>> The big difference here is probably disk performance. If you do
>> something that is pure CPU, you'll usually get about the same
>> performance as the host, but virtualized disk is not always nearly as =
good.
>=20
> Would it make any difference to use virtio instead of ahci-hd?
>=20
> In any case, to test your assumption:
> 	build a 10G memdisk in Dom0 and DomU
> 	load it with sources and /usr/obj
> and see if that helps getting things closer?
>=20
> Nice thing to do during eveninghours in the weekend.
>=20
> --WjW
>=20
> _______________________________________________
> freebsd-virtualization@freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization
> To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@fr=
eebsd.org"
>=20

Doing that would give you a much more accurate benchmark.

--=20
Allan Jude


--ao0CuqX6CEv3EfQoBDu4OktkMgFhWTMOd
Content-Type: application/pgp-signature; name="signature.asc"
Content-Description: OpenPGP digital signature
Content-Disposition: attachment; filename="signature.asc"

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.22 (MingW32)

iQIcBAEBAgAGBQJUSm3HAAoJEJrBFpNRJZKf+a8QAJl/rjI7MH6zxTM5uAaAsh2X
NQGmprxbViaMx/kLti1cKZk2x9Pv37OCYQiiYEnGYSjxLbkgyAvVQhEKfsFCe6/7
LKJIsdO/6LS0f4ZTxSKx3pwb9v5UuH8zIolvvP9XLXqpXMwJdfdMAyNOVen10rt7
4YdGVfCI7gARq+Zw3wUDyliRXSrlV1grXO7kJOubCSbyuoW2r9GlUxA5aZEjHSeN
DhQlbghcF4cMXzf6mU0TJscemn67BHrVrzF/CmcQHY61smHAjeoPeoThNFIfT7ft
xyGPRG6KBMttBKVlQOOFg3A9/JorbtmP/4KIBp8E6qDS45Zga/euKKmGKkoQFGPr
nPPEWrtmQaxOeRjZbPp+vV/N/+DAgqlc55k5UMzKxVJvqXP+HX9ySyEVoxKFSvIs
acImGEDALKatjaUm7b5gfzBUtzSgjBWb7W9Ty3DaWwdzRqmLbO5P+YBFd2NuCagA
nDR6R1ppB19gAd0O6bPfMTObtAWR5cUIY4aYG0ycDu2qtliR2/GHp43U1BBLOwDN
QmeiIo/oOrVWbEzed0unqekquW5jt9IaqyUmgFKne613LslPauZuAPXnZspsgLV7
XNpmyCYJ9/c/G2MH8FOZIHTa3MVXMJkEuL3RJpespLGnqhaDbrayHPlkUlUtQ+OZ
ne9Cx5iuSaH2XpCxNRhD
=5BXr
-----END PGP SIGNATURE-----

--ao0CuqX6CEv3EfQoBDu4OktkMgFhWTMOd--

From owner-freebsd-virtualization@FreeBSD.ORG  Fri Oct 24 17:23:32 2014
Return-Path: 
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id F1B1D536
 for ; Fri, 24 Oct 2014 17:23:32 +0000 (UTC)
Received: from vps1.elischer.org (vps1.elischer.org [204.109.63.16])
 (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
 (Client CN "vps1.elischer.org",
 Issuer "CA Cert Signing Authority" (not verified))
 by mx1.freebsd.org (Postfix) with ESMTPS id C5CD01E0
 for ; Fri, 24 Oct 2014 17:23:32 +0000 (UTC)
Received: from jre-mbp.elischer.org
 (ppp121-45-234-114.lns20.per1.internode.on.net [121.45.234.114])
 (authenticated bits=0)
 by vps1.elischer.org (8.14.9/8.14.9) with ESMTP id s9OHNS9h076201
 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES128-SHA bits=128 verify=NO);
 Fri, 24 Oct 2014 10:23:31 -0700 (PDT)
 (envelope-from julian@freebsd.org)
Message-ID: <544A8B0B.4000202@freebsd.org>
Date: Sat, 25 Oct 2014 01:23:23 +0800
From: Julian Elischer 
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.9;
 rv:24.0) Gecko/20100101 Thunderbird/24.6.0
MIME-Version: 1.0
To: freebsd-lists@freebsd.org, freebsd-virtualization@freebsd.org
Subject: Re: bhyve tapN additions
References: <20141022140934.GA367@potato.growveg.org>
In-Reply-To: <20141022140934.GA367@potato.growveg.org>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Fri, 24 Oct 2014 17:23:33 -0000

On 10/22/14, 10:09 PM, John wrote:
> Hi all,
>
> I couldn't see the following answered clearly in the literature, so I'll
> ask it here.
>
> When a freeBSD host is running a [anything] guest, a tap interface needs to be
> created. Let's say I've done all this:
>
> # ifconfig tap0 create
> # sysctl net.link.tap.up_on_open=1
> net.link.tap.up_on_open: 0 -> 1
> # ifconfig bridge0 create
> # ifconfig bridge0 addm igb0 addm tap0
> # ifconfig bridge0 up
>
> I want to add another tap, I don't want to restart the host. If I do
>
> # ifconfig bridge0 addm tap1
>
> then configure another vm to use tap1, can I expect it to work? Or, If I want 2
> vns with 2 taps, do I need to do this:
>
> # ifconfig bridge0 create
> # ifconfig bridge0 addm igb0 addm tap0 addm tap1
> # ifconfig bridge0 up
>
> The reason I ask, is because I'm expecting a freebsd vm to work on tap1, and it's
> not.
>
> thanks,

I do this on 10-stable.. it works for me..


From owner-freebsd-virtualization@FreeBSD.ORG  Fri Oct 24 20:37:34 2014
Return-Path: 
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 2B15973F;
 Fri, 24 Oct 2014 20:37:34 +0000 (UTC)
Received: from zhost.uxsglobal.com (zhost.xinuos.com [144.202.236.63])
 by mx1.freebsd.org (Postfix) with ESMTP id E8E3BAC5;
 Fri, 24 Oct 2014 20:37:33 +0000 (UTC)
Received: from localhost (localhost [127.0.0.1])
 by zhost.uxsglobal.com (Postfix) with ESMTP id 8B5D68C025F;
 Fri, 24 Oct 2014 16:37:32 -0400 (EDT)
Received: from zhost.uxsglobal.com ([127.0.0.1])
 by localhost (zhost.uxsglobalhost.com [127.0.0.1]) (amavisd-new, port 10024)
 with ESMTP id jLEg7D3c1wW4; Fri, 24 Oct 2014 16:37:32 -0400 (EDT)
Received: from zhost.uxsglobal.com (localhost [127.0.0.1])
 by zhost.uxsglobal.com (Postfix) with ESMTP id 63F048C0354;
 Fri, 24 Oct 2014 16:37:32 -0400 (EDT)
Received: from zhost.uxsglobalhost.com (localhost [127.0.0.1])
 by zhost.uxsglobal.com (Postfix) with ESMTP id 529058C025F;
 Fri, 24 Oct 2014 16:37:32 -0400 (EDT)
Date: Fri, 24 Oct 2014 16:37:32 -0400 (EDT)
From: Susan Stanziano 
To: Craig Rodrigues 
Message-ID: <886660362.1106176.1414183052149.JavaMail.zimbra@xinuos.com>
In-Reply-To: 
References: <5449C81B.8080008@freebsd.org> <5449DB7C.9080107@xinuos.com>
 <06ec01cfef62$3776a6b0$a663f410$@Xinuos.com>
 
Subject: Re: Automatically running /usr/tests on stable/10 branch under Jenkins
MIME-Version: 1.0
X-Originating-IP: [96.234.37.238]
X-Mailer: Zimbra 8.0.6_GA_5922 (ZimbraWebClient - GC38 (Win)/8.0.6_GA_5922)
Thread-Topic: Automatically running /usr/tests on stable/10 branch under
 Jenkins
Thread-Index: xzpKhEOfuv17hwVZmKLHXN9t72ikSQ==
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1
Cc: John Wolfe , freebsd-virtualization@freebsd.org,
 freebsd-testing@freebsd.org, Eric@xinuos.com,
 Allan Jude , Cheryl Blain ,
 Andy Nagle 
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Fri, 24 Oct 2014 20:37:34 -0000

Hello Craig, 

I have been reading through your slides and your website announcement, as requested, and have a few questions. (I have also subscribed to the mailing list as suggested). 

(1) The slides indicate that with a FreeBSD10 and lower OS, I should be able to build tests already included with FreeBSD. I have created a VM on FreeBSD10.0 but do not have the /etc/make.conf file necessary to build and install the tests. This may be that I am missing some set-up steps required but not covered in the slide presentation. 

(2) Does the test build require the use of the "Build Flow Plugin" or can the tests be run independent of the "continuous build" model? 

(3) Can the tests only be run under Bhyve as described in the announcement? 

I would be happy to exchange emails with you or skype as I investigate this work further. 

Regards, 

Susan 

----- Original Message -----

From: "Craig Rodrigues"  
To: Eric@xinuos.com 
Cc: "Allan Jude" , "John Wolfe" , freebsd-virtualization@freebsd.org, freebsd-testing@freebsd.org, "Susan Stanziano" , "Cheryl Blain" , "Andy Nagle"  
Sent: Friday, October 24, 2014 7:09:04 AM 
Subject: Re: Re: Automatically running /usr/tests on stable/10 branch under Jenkins 



On Fri, Oct 24, 2014 at 1:11 AM, Eric le Blan < Eric@xinuos.com > wrote: 


Allan, 



Always happy to discuss testing. I believe that Susan Stanziono of Xinuos 
system test team already spoke to some of you. Please do not hesitate to 
reach her for any specific needs. Also, Cheryl Blain - Xinuos VP of 
operations - will be at the MeetBSD vendor summit on Nov 3-4 and can reach 
to Craig. 




It would be helpful if someone (or some people) from Xinuous could do the following: 

(1) Subscribe to freebsd-testing@freebsd.org at https://lists.freebsd.org/mailman/listinfo/freebsd-testing to start monitoring the discussions on that list. 

(2) Review this announcement: http://jenkins-ci.org/content/freebsd-project-use-jenkins-os-testing 

(3) Review these slides: http://www.slideshare.net/CraigRodrigues1/kyua-jenkins 

(4) Talk to me at MeetBSD Vendor Summit 

I have not been given a long timeslot to give a presentation, so reviewing those links before MeetBSD would 
be helpful. Long term, any testing of FreeBSD will only succeed if there is 
an ecosystem of people working together and sharing common scripts and information for testing FreeBSD. 

Any help that Xinuous (or any other company) can provide would be welcome. 

-- 
Craig 


From owner-freebsd-virtualization@FreeBSD.ORG  Fri Oct 24 22:28:36 2014
Return-Path: 
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 65C68EDA
 for ; Fri, 24 Oct 2014 22:28:36 +0000 (UTC)
Received: from mail-la0-x22a.google.com (mail-la0-x22a.google.com
 [IPv6:2a00:1450:4010:c03::22a])
 (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
 (Client CN "smtp.gmail.com",
 Issuer "Google Internet Authority G2" (verified OK))
 by mx1.freebsd.org (Postfix) with ESMTPS id DDCF5830
 for ; Fri, 24 Oct 2014 22:28:35 +0000 (UTC)
Received: by mail-la0-f42.google.com with SMTP id gf13so4059042lab.1
 for ; Fri, 24 Oct 2014 15:28:33 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
 h=mime-version:sender:in-reply-to:references:date:message-id:subject
 :from:to:cc:content-type;
 bh=ls9hOdWw5J43Xh5eJvtCgUhgJ6fsz2qFLx8YYg+9wPg=;
 b=gAmSKFfU/2+rqwOU8QZrjEtarXVkyBghP9i/FCAGR4OOLltmeVbqsZ7EdJngc1RhA8
 guCqqWOPdlwh1olIfzB4nBT7GnTY7rpMVpIlaLAGwELnYMoWCwL58GEADxI/61CGTEPu
 CiVo/GQu72rmr94LS65lB8JxZgstcskwSqatFCSeTKcQheeDotAsizN7mjcopPr5yD09
 sMbSdQszRtc6QVUCeXhzB3/jOa0z38MzMSx3fw7gf+scO3fP+5Ffw1Tz1hFK+xKXCSy+
 ignRbY4MFMbLEFzQ78yQAGFcNNoISs7hOJZD+aia1sbgrxzM4shglubJWicf5XamzzUS
 eGJQ==
MIME-Version: 1.0
X-Received: by 10.112.221.226 with SMTP id qh2mr7325891lbc.5.1414189713650;
 Fri, 24 Oct 2014 15:28:33 -0700 (PDT)
Sender: crodr001@gmail.com
Received: by 10.112.84.197 with HTTP; Fri, 24 Oct 2014 15:28:33 -0700 (PDT)
In-Reply-To: 
References: <1414106923-32313-1-git-send-email-cse.cem@gmail.com>
 <1414106923-32313-2-git-send-email-cse.cem@gmail.com>
 <20141024045844.GA12422@dev.san.ru>
 
Date: Fri, 24 Oct 2014 15:28:33 -0700
X-Google-Sender-Auth: A1GPm4VJCtbwFmC9IuS6_LO5V_A
Message-ID: 
Subject: Re: [PATCHv2 1/2] bhyve: Support /domain/bootloader configuration for
 non-FreeBSD guests.
From: Craig Rodrigues 
To: Conrad Rad 
Content-Type: text/plain; charset=ISO-8859-1
X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1
Cc: libvir-list@redhat.com, Roman Bogorodskiy ,
 "freebsd-virtualization@freebsd.org" 
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Fri, 24 Oct 2014 22:28:36 -0000

On Fri, Oct 24, 2014 at 6:11 AM, Conrad Rad  wrote:

>
> Any idea how soon? Months? A year? 5 years? I'm not comfortable
> postponing improvements indefinitely for vaporware. In the wonderful
> bhyve-UEFI future, we can ignore/warn about .
>
>
Hi,

I have to agree with Conrad here.  I hope that any perceived future
direction of bhyve is not
going to be used as an excuse to block some of the libvirt patches that
Conrad is
submitting.  The stuff that Conrad is working on overlaps some of the
shortcomings in libvirt/bhyve that
I mentioned here:
https://lists.freebsd.org/pipermail/freebsd-virtualization/2014-October/002857.html

Fixing these issues in libvirt will make libvirt + bhyve more usable
today.  When the bhyve-UEFI stuff comes out in future,
that will be even better, but there are a few people (me and others) who
are trying to put together FreeBSD + bhyve systems today
that are viable alternatives to Linux + KVM for managing many VM's.   bhyve
is rapidly improving, but
the lack of libvirt support means that a huge ecosystem of software built
for libvirt + KVM cannot be used for bhyve.
I hope we can start improving libvirt today to eliminate this problem.

--
Craig

From owner-freebsd-virtualization@FreeBSD.ORG  Fri Oct 24 23:08:28 2014
Return-Path: 
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id C59177F9
 for ; Fri, 24 Oct 2014 23:08:28 +0000 (UTC)
Received: from mail.nomadlogic.org (mail.nomadlogic.org
 [IPv6:2607:f2f8:a098::4])
 (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits))
 (Client did not present a certificate)
 by mx1.freebsd.org (Postfix) with ESMTPS id AD388BBE
 for ; Fri, 24 Oct 2014 23:08:28 +0000 (UTC)
Received: from mail.nomadlogic.org (localhost [127.0.0.1])
 (using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits))
 (No client certificate requested)
 by mail.nomadlogic.org (Postfix) with ESMTPS id 0FA11125EE1
 for ; Fri, 24 Oct 2014 16:08:28 -0700 (PDT)
Received: from pop.rubicorp.com (unknown [72.34.113.100])
 (using TLSv1 with cipher DHE-RSA-AES128-SHA (128/128 bits))
 (No client certificate requested)
 by mail.nomadlogic.org (Postfix) with ESMTPSA id 0741C125EBA
 for ; Fri, 24 Oct 2014 16:08:28 -0700 (PDT)
Message-ID: <544ADBEB.2030907@nomadlogic.org>
Date: Fri, 24 Oct 2014 16:08:27 -0700
From: Pete Wright 
User-Agent: Mozilla/5.0 (X11; FreeBSD amd64;
 rv:31.0) Gecko/20100101 Thunderbird/31.2.0
MIME-Version: 1.0
To: freebsd-virtualization@freebsd.org
Subject: NATed or Private Network Setups
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Fri, 24 Oct 2014 23:08:28 -0000

Hi All,
Has anyone deployed bhyve using NAT'd or private network setups?  I've
been able to deploy bridged interfaces, but I was wondering if anyone
has done other network topologies.  Is there anything preventing this
from happening code wise?  I reckon it could be achieved by creating a
pseudo interface?

Thanks in advance!
-pete
-- 
Pete Wright
pete@nomadlogic.org
twitter => @nomadlogicLA


From owner-freebsd-virtualization@FreeBSD.ORG  Fri Oct 24 23:21:55 2014
Return-Path: 
Delivered-To: virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id E7958A1A
 for ; Fri, 24 Oct 2014 23:21:55 +0000 (UTC)
Received: from alto.onthenet.com.au (alto.OntheNet.com.au [203.13.68.12])
 by mx1.freebsd.org (Postfix) with ESMTP id AB75DD25
 for ; Fri, 24 Oct 2014 23:21:55 +0000 (UTC)
Received: from dommail.onthenet.com.au (dommail.OntheNet.com.au [203.13.70.57])
 by alto.onthenet.com.au (Postfix) with ESMTP id C518412670;
 Sat, 25 Oct 2014 09:21:47 +1000 (EST)
Received: from Peter-Grehans-MacBook-Pro-2.local ([64.245.0.210])
 by dommail.onthenet.com.au (MOS 4.4.4-GA)
 with ESMTP id BZF52641 (AUTH peterg@ptree32.com.au);
 Sat, 25 Oct 2014 09:21:46 +1000
Message-ID: <544ADF08.4020706@freebsd.org>
Date: Fri, 24 Oct 2014 16:21:44 -0700
From: Peter Grehan 
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6;
 rv:24.0) Gecko/20100101 Thunderbird/24.6.0
MIME-Version: 1.0
To: Willem Jan Withagen 
Subject: Re: Bhyve building kernel....Just an observation
References: <544A083B.50007@digiware.nl>
In-Reply-To: <544A083B.50007@digiware.nl>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
Cc: virtualization@freebsd.org
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Fri, 24 Oct 2014 23:21:56 -0000

Hi Willem,
> And then booted a 10-STABLE bhyve VM with all memory and processors
> assigned to the VM. So all the power could be available to the VM.

  You'll most likely want to keep some memory and processor resources 
available for the host system. ZFS will need memory for ARC and CPU for 
operations - if these aren't available, it will compete with bhyve's use 
of CPUs, and there will be times when these are conflicting.

later,

Peter.


From owner-freebsd-virtualization@FreeBSD.ORG  Sat Oct 25 00:01:38 2014
Return-Path: 
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id CAC5948E
 for ; Sat, 25 Oct 2014 00:01:38 +0000 (UTC)
Received: from webmail2.jnielsen.net (webmail2.jnielsen.net [50.114.224.20])
 (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
 (Client CN "webmail2.jnielsen.net",
 Issuer "freebsdsolutions.net" (not verified))
 by mx1.freebsd.org (Postfix) with ESMTPS id A83FC103
 for ; Sat, 25 Oct 2014 00:01:38 +0000 (UTC)
Received: from [192.168.2.123] (c-50-160-123-105.hsd1.ut.comcast.net
 [50.160.123.105]) (authenticated bits=0)
 by webmail2.jnielsen.net (8.14.9/8.14.9) with ESMTP id s9P01PoK059387
 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO);
 Fri, 24 Oct 2014 18:01:30 -0600 (MDT)
 (envelope-from lists@jnielsen.net)
X-Authentication-Warning: webmail2.jnielsen.net: Host
 c-50-160-123-105.hsd1.ut.comcast.net [50.160.123.105] claimed to be
 [192.168.2.123]
Content-Type: text/plain;
	charset=us-ascii
Mime-Version: 1.0 (1.0)
Subject: Re: NATed or Private Network Setups
From: John Nielsen 
X-Mailer: iPhone Mail (12B411)
In-Reply-To: <544ADBEB.2030907@nomadlogic.org>
Date: Fri, 24 Oct 2014 18:01:24 -0600
Content-Transfer-Encoding: quoted-printable
Message-Id: 
References: <544ADBEB.2030907@nomadlogic.org>
To: Pete Wright 
Cc: "freebsd-virtualization@freebsd.org" 
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Sat, 25 Oct 2014 00:01:38 -0000

> On Oct 24, 2014, at 5:08 PM, Pete Wright  wrote:
>=20
> Hi All,
> Has anyone deployed bhyve using NAT'd or private network setups?  I've
> been able to deploy bridged interfaces, but I was wondering if anyone
> has done other network topologies.  Is there anything preventing this
> from happening code wise?  I reckon it could be achieved by creating a
> pseudo interface?

Rather than supporting something like epair(4) directly, I believe the plan i=
s to allow connecting a bhyve VM to a user-space virtual switch on the host.=
 Neither is currently available to my knowledge.

For a NAT setup today you should be able to add your VM's tap(4) interface a=
s the only member of a bridge on the host and assign an IP address to the br=
idge interface. Services like DHCP for this virtual subnet would need to als=
o be configured on the host in addition to whatever NAT you want to use.

For an internal-only network between two or more VMs on the host you could a=
lso just use a bridge containing only the VM tap adapters. If you don't want=
 the host to participate in the network then don't put an IP on the bridge.=

From owner-freebsd-virtualization@FreeBSD.ORG  Sat Oct 25 01:29:24 2014
Return-Path: 
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 724E648D
 for ; Sat, 25 Oct 2014 01:29:24 +0000 (UTC)
Received: from mx1.scaleengine.net (beauharnois2.bhs1.scaleengine.net
 [142.4.218.15]) by mx1.freebsd.org (Postfix) with ESMTP id 2BDA8A1C
 for ; Sat, 25 Oct 2014 01:29:23 +0000 (UTC)
Received: from [192.168.1.2] (Seawolf.HML3.ScaleEngine.net [209.51.186.28])
 (Authenticated sender: allanjude.freebsd@scaleengine.com)
 by mx1.scaleengine.net (Postfix) with ESMTPSA id 042AA6456E
 for ; Sat, 25 Oct 2014 01:29:21 +0000 (UTC)
Message-ID: <544AFD04.3060509@freebsd.org>
Date: Fri, 24 Oct 2014 21:29:40 -0400
From: Allan Jude 
User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64;
 rv:31.0) Gecko/20100101 Thunderbird/31.2.0
MIME-Version: 1.0
To: freebsd-virtualization@freebsd.org
Subject: Re: NATed or Private Network Setups
References: <544ADBEB.2030907@nomadlogic.org>
 
In-Reply-To: 
Content-Type: multipart/signed; micalg=pgp-sha1;
 protocol="application/pgp-signature";
 boundary="QLRtCdVkLDHj6I7eA1o73w8LFRsAlVTN1"
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Sat, 25 Oct 2014 01:29:24 -0000

This is an OpenPGP/MIME signed message (RFC 4880 and 3156)
--QLRtCdVkLDHj6I7eA1o73w8LFRsAlVTN1
Content-Type: text/plain; charset=windows-1252
Content-Transfer-Encoding: quoted-printable

On 2014-10-24 20:01, John Nielsen wrote:
>> On Oct 24, 2014, at 5:08 PM, Pete Wright  wrote:
>>
>> Hi All,
>> Has anyone deployed bhyve using NAT'd or private network setups?  I've=

>> been able to deploy bridged interfaces, but I was wondering if anyone
>> has done other network topologies.  Is there anything preventing this
>> from happening code wise?  I reckon it could be achieved by creating a=

>> pseudo interface?
>=20
> Rather than supporting something like epair(4) directly, I believe the =
plan is to allow connecting a bhyve VM to a user-space virtual switch on =
the host. Neither is currently available to my knowledge.
>=20
> For a NAT setup today you should be able to add your VM's tap(4) interf=
ace as the only member of a bridge on the host and assign an IP address t=
o the bridge interface. Services like DHCP for this virtual subnet would =
need to also be configured on the host in addition to whatever NAT you wa=
nt to use.
>=20
> For an internal-only network between two or more VMs on the host you co=
uld also just use a bridge containing only the VM tap adapters. If you do=
n't want the host to participate in the network then don't put an IP on t=
he bridge.
> _______________________________________________
> freebsd-virtualization@freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization
> To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@fr=
eebsd.org"
>=20

This sets up stupid-simple NAT to allow a bhyve instance to talk to the
internet.  This is especially useful when your connection is wireless so
you can't just bridge it. Assumes IPFW is already loaded note that it
loads with a default deny all.

in /etc/rc.conf:

firewall_enable=3D"YES"
firewall_type=3D"OPEN"
firewall_quiet=3D"NO"
firewall_logging=3D"YES"
gateway_enable=3D"YES"


Run:

#this needs to be the same tap the bhyve uses, 1 per bhyve
ifconfig tap0 create
ifconfig tap0 10.0.9.1/30

#Load the IPFW nat module if it isn't already
kldload ipfw_nat

#create an IPFW NAT instance on your internet interface
ipfw nat 9999 config if wlan0

#pass outbound traffic from the internal network through NAT
ipfw add 9001 nat 9999 ip from 10.0.9.0/24 to any out via wlan0
ipfw add 9002 nat 9999 ip from any to any in via wlan0


Then just configure the bhyve to have an IP in the 10.0.9.0/24 network


--=20
Allan Jude


--QLRtCdVkLDHj6I7eA1o73w8LFRsAlVTN1
Content-Type: application/pgp-signature; name="signature.asc"
Content-Description: OpenPGP digital signature
Content-Disposition: attachment; filename="signature.asc"

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.22 (MingW32)

iQIcBAEBAgAGBQJUSv0HAAoJEJrBFpNRJZKfLlcQAIt2H1r4DErkxixKuY1eQtf9
WZuJ1m17AORf1USM5dCtFqDxwCbN5jMEKB8vW4Alu4dGQIQ/iZ8VvddDAvu3eS+F
R8WT6zslfA/sai5Jl47+agKhFmQnxi0qYNTdif/Q3fSohY6ITGkoTsikhuf8CpL7
JaMEHFjhrr70zBKo9RiwoRGrHGzVKDUFRwDPKUbpYwIsz1t16kLr7YXHOYWf5VMK
7n9JfmN3d95EntV24+/JJY5IjuuSKluygY+GfetfCOv7hya3/Ayx9adGUVsTTgth
LT5SDbB7sliDG8y12rrjCOJBoYM71svJz4qtw+D58D48K0aHI+ixVeXZAsSnXDKE
Evf0lGiBNHqP+ZNL8umrS4Z7QGF70lRjC9zliC5Sz1YT7uBJsPPoduDk1aJnLt8n
wWTghV4RMgqn9DZgZX19F26n+nO3XJcDIu5dg3xL/JHwUP5CxncoG7LLbRzVd9c2
/8tyJGrB382iCdSibJuRphyOQgOb5CTg4XfuGE7P289XHlCP1wSRKWHTz6viOwAZ
Uq24C7OkccIkC+46+dFL2j006ztJf4yHfaNdy2SxFgGR7sLnKdBzikyArv5fnXR3
9RVOKp+GTgPB7iIi0Y019vKTuT/MWQDf6YPbWLvcrYVWigoPTGDWuRzwcH/Sn4tR
dCoQ+LVW6uIB58B/C4jL
=ROMo
-----END PGP SIGNATURE-----

--QLRtCdVkLDHj6I7eA1o73w8LFRsAlVTN1--

From owner-freebsd-virtualization@FreeBSD.ORG  Sat Oct 25 03:01:57 2014
Return-Path: 
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 273CBC43
 for ; Sat, 25 Oct 2014 03:01:57 +0000 (UTC)
Received: from vps1.elischer.org (vps1.elischer.org [204.109.63.16])
 (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
 (Client CN "vps1.elischer.org",
 Issuer "CA Cert Signing Authority" (not verified))
 by mx1.freebsd.org (Postfix) with ESMTPS id EF3E2342
 for ; Sat, 25 Oct 2014 03:01:56 +0000 (UTC)
Received: from jre-mbp.elischer.org
 (ppp121-45-234-114.lns20.per1.internode.on.net [121.45.234.114])
 (authenticated bits=0)
 by vps1.elischer.org (8.14.9/8.14.9) with ESMTP id s9P31pB9077613
 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES128-SHA bits=128 verify=NO);
 Fri, 24 Oct 2014 20:01:53 -0700 (PDT)
 (envelope-from julian@freebsd.org)
Message-ID: <544B1298.60000@freebsd.org>
Date: Sat, 25 Oct 2014 11:01:44 +0800
From: Julian Elischer 
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.9;
 rv:24.0) Gecko/20100101 Thunderbird/24.6.0
MIME-Version: 1.0
To: John Nielsen , Pete Wright 
Subject: Re: NATed or Private Network Setups
References: <544ADBEB.2030907@nomadlogic.org>
 
In-Reply-To: 
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
Cc: "freebsd-virtualization@freebsd.org" 
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Sat, 25 Oct 2014 03:01:57 -0000

On 10/25/14, 8:01 AM, John Nielsen wrote:
>> On Oct 24, 2014, at 5:08 PM, Pete Wright  wrote:
>>
>> Hi All,
>> Has anyone deployed bhyve using NAT'd or private network setups?  I've
>> been able to deploy bridged interfaces, but I was wondering if anyone
>> has done other network topologies.  Is there anything preventing this
>> from happening code wise?  I reckon it could be achieved by creating a
>> pseudo interface?
> Rather than supporting something like epair(4) directly, I believe the plan is to allow connecting a bhyve VM to a user-space virtual switch on the host. Neither is currently available to my knowledge.
>
> For a NAT setup today you should be able to add your VM's tap(4) interface as the only member of a bridge on the host and assign an IP address to the bridge interface. Services like DHCP for this virtual subnet would need to also be configured on the host in addition to whatever NAT you want to use.
>
> For an internal-only network between two or more VMs on the host you could also just use a bridge containing only the VM tap adapters. If you don't want the host to participate in the network then don't put an IP on the bridge.
I disciovered you can also use netgraph to hook to the tap interfaces,
which means that you can use the whole netgraph library of functions..
I did find out that it occasionally loses packets or something so I
need to investigate more but it did work.

> _______________________________________________
> freebsd-virtualization@freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization
> To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@freebsd.org"
>


From owner-freebsd-virtualization@FreeBSD.ORG  Sat Oct 25 03:14:43 2014
Return-Path: 
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 26375DC4;
 Sat, 25 Oct 2014 03:14:43 +0000 (UTC)
Received: from mail-la0-x22d.google.com (mail-la0-x22d.google.com
 [IPv6:2a00:1450:4010:c03::22d])
 (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
 (Client CN "smtp.gmail.com",
 Issuer "Google Internet Authority G2" (verified OK))
 by mx1.freebsd.org (Postfix) with ESMTPS id 37A19610;
 Sat, 25 Oct 2014 03:14:42 +0000 (UTC)
Received: by mail-la0-f45.google.com with SMTP id gm9so2107293lab.18
 for ; Fri, 24 Oct 2014 20:14:40 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
 h=mime-version:sender:in-reply-to:references:date:message-id:subject
 :from:to:cc:content-type;
 bh=sd7/KXri8xql4nwYIyXIAniP0SDTHcbziALz3VlKMb4=;
 b=MJEbW3gbe7U7RME+6KJpoN6iuQBwQVVy0RxTkcUDDIrTjHin/KntxK0t7NY0jIWZmI
 JkCAUw4TCSNfEnWPPitmhnuJl6DOj0p2EV8YU94HeL2EchaP7g+Dokk0edVwh6lO/j6D
 B0uE4P1wBZKTMKj/Aaw2seV01NOWa410STin+SAyvuZjIHWdnWB1D+G/HQCzboAgHAS2
 i5J+AY18n/GzSeUq05vrDmwFJGsJLrmENTGgvNTSt/aEI/AB57lF2TRFdDkeyQmwH6/B
 C+OtacAggynUxb2jPwObYwciU4+HyVtVA+jim9BWmfjjhujgX66eVzvpZu2OyMw2etvM
 x9tg==
MIME-Version: 1.0
X-Received: by 10.152.4.132 with SMTP id k4mr8316755lak.1.1414206880089; Fri,
 24 Oct 2014 20:14:40 -0700 (PDT)
Sender: crodr001@gmail.com
Received: by 10.112.84.197 with HTTP; Fri, 24 Oct 2014 20:14:39 -0700 (PDT)
In-Reply-To: <886660362.1106176.1414183052149.JavaMail.zimbra@xinuos.com>
References: <5449C81B.8080008@freebsd.org> <5449DB7C.9080107@xinuos.com>
 <06ec01cfef62$3776a6b0$a663f410$@Xinuos.com>
 
 <886660362.1106176.1414183052149.JavaMail.zimbra@xinuos.com>
Date: Fri, 24 Oct 2014 20:14:39 -0700
X-Google-Sender-Auth: 2x616JZDbzg5ICNmUSa5zEsjztc
Message-ID: 
Subject: Re: Automatically running /usr/tests on stable/10 branch under Jenkins
From: Craig Rodrigues 
To: Susan Stanziano 
Content-Type: text/plain; charset=ISO-8859-1
X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1
Cc: John Wolfe ,
 "freebsd-virtualization@freebsd.org" ,
 "freebsd-testing@freebsd.org" , Eric@xinuos.com,
 Allan Jude , Cheryl Blain ,
 Andy Nagle 
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Sat, 25 Oct 2014 03:14:43 -0000

On Fri, Oct 24, 2014 at 1:37 PM, Susan Stanziano  wrote:

> Hello Craig,
>
> I have been reading through your slides and your website announcement, as
> requested, and have a few questions.  (I have also subscribed to the
> mailing list as suggested).
>
> (1)  The slides indicate that with a FreeBSD10 and lower OS, I should be
> able to build tests already included with FreeBSD.  I have created a VM on
> FreeBSD10.0 but do not have the /etc/make.conf file necessary to build and
> install the tests.  This may be that I am missing some set-up steps
> required but not covered in the slide presentation.
>

/etc/make.conf is not there by default, but you can create it and add a
line:

WITH_TESTS="yes"

After you do that, you should rebuild everything and install everything as
per the steps listed here:
https://svnweb.freebsd.org/base/head/Makefile?revision=271168&view=markup#l70


and the tests should be visible under /usr/tests .


>
> (2) Does the test build require the use of the "Build Flow Plugin" or can
> the tests be run independent of the "continuous build" model?
>

No, "continuous build" and 'Build Flow Plugin" are not required to run the
tests.
You should focus on building the tests and running them manually before
using "continuous integration".


> (3) Can the tests only be run under Bhyve as described in the announcement?
>
>
No, you do not need Bhyve to run the tests.


Feel free to ask any additional questions on freebsd-testing@freebsd.org,
so that we
can clarify the steps.

--
Craig

From owner-freebsd-virtualization@FreeBSD.ORG  Sat Oct 25 03:43:34 2014
Return-Path: 
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 7096834E
 for ; Sat, 25 Oct 2014 03:43:34 +0000 (UTC)
Received: from mx1.scaleengine.net (beauharnois2.bhs1.scaleengine.net
 [142.4.218.15]) by mx1.freebsd.org (Postfix) with ESMTP id 46D2890C
 for ; Sat, 25 Oct 2014 03:43:33 +0000 (UTC)
Received: from [192.168.1.2] (Seawolf.HML3.ScaleEngine.net [209.51.186.28])
 (Authenticated sender: allanjude.freebsd@scaleengine.com)
 by mx1.scaleengine.net (Postfix) with ESMTPSA id 9491D64643
 for ; Sat, 25 Oct 2014 03:43:32 +0000 (UTC)
Message-ID: <544B1C76.8020102@freebsd.org>
Date: Fri, 24 Oct 2014 23:43:50 -0400
From: Allan Jude 
User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64;
 rv:31.0) Gecko/20100101 Thunderbird/31.2.0
MIME-Version: 1.0
To: freebsd-virtualization@freebsd.org
Subject: Re: Automatically running /usr/tests on stable/10 branch under Jenkins
References: 
 
 
 <5449C81B.8080008@freebsd.org>
 
In-Reply-To: 
Content-Type: multipart/signed; micalg=pgp-sha1;
 protocol="application/pgp-signature";
 boundary="d9PgjN0SeGMgA7jopxTNtxvSbDU3vDBQw"
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Sat, 25 Oct 2014 03:43:34 -0000

This is an OpenPGP/MIME signed message (RFC 4880 and 3156)
--d9PgjN0SeGMgA7jopxTNtxvSbDU3vDBQw
Content-Type: text/plain; charset=windows-1252
Content-Transfer-Encoding: quoted-printable

On 2014-10-24 00:20, Craig Rodrigues wrote:
> On Thu, Oct 23, 2014 at 8:31 PM, Allan Jude  wro=
te:
>=20
>>
>> At the Cambridge Dev Summit, Xinuous specifically mentioned helping wi=
th
>> testing and writing tests. Might be good people to reach out to
>>
>=20
> Are you referring to Eric Le Blan from Xinuous who was interviewed on
> BSDNow ( http://www.bsdnow.tv/episodes/2014_08_20-engineering_nginx ,
> starting at 0:16:38 )?
>=20
> --
> Craig
> _______________________________________________
> freebsd-virtualization@freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization
> To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@fr=
eebsd.org"
>=20

Yes, Eric and the other guy from Xinuous, specifically cited Testing as
something they will have to do, much more extensively than we normally
do, and would be glad to help out and get the tests upstreamed etc.

They plan to support our stable branches for more than 10 years, in very
sensitive environments that require stability.

--=20
Allan Jude


--d9PgjN0SeGMgA7jopxTNtxvSbDU3vDBQw
Content-Type: application/pgp-signature; name="signature.asc"
Content-Description: OpenPGP digital signature
Content-Disposition: attachment; filename="signature.asc"

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.22 (MingW32)

iQIcBAEBAgAGBQJUSxx6AAoJEJrBFpNRJZKfuawP/2sIOVkb4vgN+atnK8pvzked
P7B5pyylMJRNlCfnWWZk01ltig1WpJm81Isf9HMmKMIMOm2QMCGjKIOMDWSIXSus
ZIsWUit/26SjgnwpOPmNlI7ocHYHMq0V8KLUm275S6hRTN93wRhOf1UnlnE6uZNj
Le6U9Iv9a1gA6m74mVOi+vzmXF7wPLLrv4reJMrQsIcih11LtlRmqvEu6HjZh2g7
u3R7MUkwp8eBn34mab/rqnt88isG51/PwlbVeZAYqfA9UdG9y4kT9tqf/VsMgFox
b/ygd7sferkf4PUCpkMkY3+Hd9LIoTVcenFXpv6HdaHkF5GetRZ0bim8Tjt5EEtJ
yQCvO/0a2zFedl74sG/yXa0+6lVbAGcTumsmmUd5YcZV5mA+zf9ix2Okv1HlbjY6
TS+EhWXNdAeROqTDKeLb/H6oR1PfRepsDWD+Rmb9nk0iAmYQODCTTxKkFXise823
4kB/5IsQl61eRxWcE9P8H+vRpJ6jQsl02Y3W1v7OLLJxO3an5BpHUrI6yEVY/wuU
RFErLOh1NArPOzwi5rdJc6VqDBG3DxERIF7MMyICEH7bCq4Zey3zzbiX+Lr+cKvs
Nqj1CNrSeFhlC8vqTXz22edgkhJs21rEX5uDVG2ALE8Hqlf2tmWNXq2xZ0P6S+6H
0HZna1DFTHvrMBARLJ8P
=EhfT
-----END PGP SIGNATURE-----

--d9PgjN0SeGMgA7jopxTNtxvSbDU3vDBQw--

From owner-freebsd-virtualization@FreeBSD.ORG  Sat Oct 25 04:09:51 2014
Return-Path: 
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id A74F06A7;
 Sat, 25 Oct 2014 04:09:51 +0000 (UTC)
Received: from mail-la0-x230.google.com (mail-la0-x230.google.com
 [IPv6:2a00:1450:4010:c03::230])
 (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
 (Client CN "smtp.gmail.com",
 Issuer "Google Internet Authority G2" (verified OK))
 by mx1.freebsd.org (Postfix) with ESMTPS id CAED0AAC;
 Sat, 25 Oct 2014 04:09:50 +0000 (UTC)
Received: by mail-la0-f48.google.com with SMTP id gi9so3625537lab.35
 for ; Fri, 24 Oct 2014 21:09:48 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
 h=mime-version:sender:in-reply-to:references:date:message-id:subject
 :from:to:cc:content-type;
 bh=qr/rXrJooVx762BNCGeZLQJlZqU3HKlQPWZ7sfLtm3c=;
 b=WzXiAEUVBlMrMqT/7YZNZen8mlrPCHCXS9274zlbszRKQdM3fXfRlmOEMp9ul61pge
 ApDZann6s3YTVVx78AyM4v0v5ezokZ/p8ajDDsaovQOXTwz1x9SPKm4yHK6x8298GsRF
 Y5XtdV86om+h+185/fVDgyjD9WAkM7r8Tjw2LHGWtFg0k4Yco641NOvsCDHSMg4L/1S/
 Cj1ELosJxuXHoDysWwAblW1252aCVRbXxwO1Ub/DCjNnhTH8w92241nY7FzxjniplePY
 /xti57eDYguRh5icA9QANm50eIn/f5pHhI2amsZJZfLi3GDMb6S2K0KPFp3I3BiDFjGv
 6B3A==
MIME-Version: 1.0
X-Received: by 10.152.198.166 with SMTP id jd6mr7354418lac.81.1414210188680;
 Fri, 24 Oct 2014 21:09:48 -0700 (PDT)
Sender: crodr001@gmail.com
Received: by 10.112.84.197 with HTTP; Fri, 24 Oct 2014 21:09:48 -0700 (PDT)
In-Reply-To: <20141024053636.GH11222@dft-labs.eu>
References: 
 <20141024053636.GH11222@dft-labs.eu>
Date: Fri, 24 Oct 2014 21:09:48 -0700
X-Google-Sender-Auth: yE4uALWkHkllRY-YNfQm8cqtUco
Message-ID: 
Subject: Re: Automatically running /usr/tests on stable/10 branch under Jenkins
From: Craig Rodrigues 
To: Mateusz Guzik 
Content-Type: text/plain; charset=ISO-8859-1
X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1
Cc: "freebsd-testing@freebsd.org" ,
 FreeBSD stable ,
 "freebsd-virtualization@freebsd.org" 
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Sat, 25 Oct 2014 04:09:51 -0000

On Thu, Oct 23, 2014 at 10:36 PM, Mateusz Guzik  wrote:

> > (1)  does a buildworld/buildkernel on amd64 when someone checks new
> >       code into the stable/10 branch
>
> Is not this excessive?


It has not been a problem.  For example, when a build occurs on the HEAD in
svn,
if further commits come in on HEAD, we have Jenkins configured so that it
will not trigger another build on HEAD until the build in progress is done.
It has been working fine.

If no commits


> > (2)  Creates a bootable UFS image with makefs
>
> any chance zfs will be used as well?
>

Sure, we can look at that as well, but as I said earlier,
there need to be more bodies working on setting up builds and
configurations for this
to happen.


>
> would be nice to run some kind of stress testing. buildworld with a high
> -j is an example of a general purpose test. This could be done with
> different frequency than regular tests.
>
>
Are you volunteering to write the scripts that incorporate any stress
testing
that you think should be done?  We would welcome any contributions.


> Do you have crashdumps configured in case stuff goes wrong?
>
>

No.

You can look at our scripts used to build and boot the various VM's:

https://wiki.freebsd.org/Jenkins#Repositories

It's all on github, so if you think you have new scripts to add, or fixes
to existing scripts,
you can feel free to do a github pull request to contribute.

--
Craig

From owner-freebsd-virtualization@FreeBSD.ORG  Sat Oct 25 04:20:22 2014
Return-Path: 
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 91E15B78;
 Sat, 25 Oct 2014 04:20:22 +0000 (UTC)
Received: from mail-lb0-x236.google.com (mail-lb0-x236.google.com
 [IPv6:2a00:1450:4010:c04::236])
 (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
 (Client CN "smtp.gmail.com",
 Issuer "Google Internet Authority G2" (verified OK))
 by mx1.freebsd.org (Postfix) with ESMTPS id 88044C7A;
 Sat, 25 Oct 2014 04:20:21 +0000 (UTC)
Received: by mail-lb0-f182.google.com with SMTP id f15so2308328lbj.13
 for ; Fri, 24 Oct 2014 21:20:19 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
 h=mime-version:sender:in-reply-to:references:date:message-id:subject
 :from:to:cc:content-type;
 bh=eMt+sDIlpJGnS5JxkXDSZT1TZb/JCTw7KbaGM6giSrs=;
 b=UeQM8xvCXsqRKV6SmVW5SbTXzz2XCs6ubWveIwV6nz0icQD2gVI4rkXsjecJKFD67i
 zpnGcQsakvW2BoUc1jfDM+TALGNRpCHbG8Kb3Hx3TtOzIa6vRqYYwn2yWZmq+iaePXZd
 AyxK7IhTVb3TNeqI0fPouQv8cTmzCD+oSBQK4IflUyosMwV5wBmIKacJhOvuX+MVT+qp
 kA6NI9sxAUcxZMruv/6hLcH5UeC/fU9XnAf7Nn0IDUarZt+X2VwgMKE3xRrAg/hDq6cO
 giT1zrdxlqJFEL1+/QSsBaBTzR9RUM+haRfxDBAQQzcEOMt8ZpFgwhBXpvJyqCunzER0
 gQsA==
MIME-Version: 1.0
X-Received: by 10.152.22.135 with SMTP id d7mr8544867laf.46.1414210819435;
 Fri, 24 Oct 2014 21:20:19 -0700 (PDT)
Sender: crodr001@gmail.com
Received: by 10.112.84.197 with HTTP; Fri, 24 Oct 2014 21:20:19 -0700 (PDT)
In-Reply-To: 
References: 
 <20141024053636.GH11222@dft-labs.eu>
 
Date: Fri, 24 Oct 2014 21:20:19 -0700
X-Google-Sender-Auth: T2JiUvJPzpUzUjMpVLkU7vfsiW0
Message-ID: 
Subject: Re: Automatically running /usr/tests on stable/10 branch under Jenkins
From: Craig Rodrigues 
To: "K. Macy" 
Content-Type: text/plain; charset=ISO-8859-1
X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1
Cc: "freebsd-testing@freebsd.org" ,
 FreeBSD stable ,
 "freebsd-virtualization@freebsd.org" 
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Sat, 25 Oct 2014 04:20:22 -0000

On Thu, Oct 23, 2014 at 11:06 PM, K. Macy  wrote:

> >> (2)  Creates a bootable UFS image with makefs
> >
> > any chance zfs will be used as well?
> >
>
> Seconded. There are residual locking issues issues in ZFS.
> Particularly in the less exercised areas.
>

I think what would be an interesting exercise is to set up a Jenkins job to
build
and boot a bhyve VM with ZFS, and then run
the ZFS Test Suite, ported by Alan Somers to FreeBSD:

https://lists.freebsd.org/pipermail/freebsd-testing/2014-August/000503.html


Are there any volunteers who would like to help set that up and get it
running
under Jenkins?




>
> Along those same lines, do you have any sort of watchdog in case it
> deadlocks?
>

No.

You can look at our scripts used to build and boot the various VM's:

https://wiki.freebsd.org/Jenkins#Repositories

It's all on github, so if you think you have new scripts to add, or fixes
to existing scripts,
you can feel free to do a github pull request to contribute.

--
Craig

From owner-freebsd-virtualization@FreeBSD.ORG  Sat Oct 25 04:45:24 2014
Return-Path: 
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 988EF1FD;
 Sat, 25 Oct 2014 04:45:24 +0000 (UTC)
Received: from mail-pd0-x22d.google.com (mail-pd0-x22d.google.com
 [IPv6:2607:f8b0:400e:c02::22d])
 (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
 (Client CN "smtp.gmail.com",
 Issuer "Google Internet Authority G2" (verified OK))
 by mx1.freebsd.org (Postfix) with ESMTPS id 4F233ED4;
 Sat, 25 Oct 2014 04:45:24 +0000 (UTC)
Received: by mail-pd0-f173.google.com with SMTP id v10so2550832pde.18
 for ; Fri, 24 Oct 2014 21:45:23 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
 h=content-type:mime-version:subject:from:in-reply-to:date:cc
 :message-id:references:to;
 bh=sakTeGSANXio1+THlQlVOipJbwfFO0ckzcxpaeBzyjs=;
 b=j37WmbuziOXpvv4R8d4Rc9dgyMs3m0ee61g6tF64kqx+EhRAvzw4F35j9ZSZ+jWgsg
 UjEovt54uSSu+F5mDnmZZVNtBCnmrvWl9K0n2NTyS34W0T0NTR3FyZlFVf70NXSEXr+z
 OFs6NTLGCkdoUiNN0O5vLobRrmKmo2O2X2Y3vwkpRwAJ0vLSbPiifxCZihG+ClYXeWHC
 JUKT/C4DXNaXElnXVrQKrGO0NmNL1tLNeJkHixEqKrPRynz0uCUzSvtz3ACOLV3jutnx
 NOD35Ax+V5IWzoJ7Dp+pxO8zZmfSh4J0OysunnpNHeN6ttf8V8Y5DC/Fg0Hf+oxZYcaA
 HTpg==
X-Received: by 10.70.11.2 with SMTP id m2mr8980923pdb.31.1414212323759;
 Fri, 24 Oct 2014 21:45:23 -0700 (PDT)
Received: from ?IPv6:2601:8:ab80:7d6:4d3d:33a4:5ddc:37e2?
 ([2601:8:ab80:7d6:4d3d:33a4:5ddc:37e2])
 by mx.google.com with ESMTPSA id uj7sm5210916pac.4.2014.10.24.21.45.22
 for 
 (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128);
 Fri, 24 Oct 2014 21:45:23 -0700 (PDT)
Content-Type: multipart/signed;
 boundary="Apple-Mail=_2A11CEE8-A629-491F-891F-17FC136ECA72";
 protocol="application/pgp-signature"; micalg=pgp-sha512
Mime-Version: 1.0 (Mac OS X Mail 7.3 \(1878.6\))
Subject: Re: Automatically running /usr/tests on stable/10 branch under Jenkins
From: Garrett Cooper 
In-Reply-To: 
Date: Fri, 24 Oct 2014 21:45:21 -0700
Message-Id: <81030948-E60F-4AAD-AAF1-16349607917D@gmail.com>
References: 
 <20141024053636.GH11222@dft-labs.eu>
 
 
To: Craig Rodrigues 
X-Mailer: Apple Mail (2.1878.6)
Cc: "freebsd-testing@freebsd.org" ,
 FreeBSD stable ,
 "freebsd-virtualization@freebsd.org" 
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Sat, 25 Oct 2014 04:45:24 -0000


--Apple-Mail=_2A11CEE8-A629-491F-891F-17FC136ECA72
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain;
	charset=windows-1252

On Oct 24, 2014, at 21:20, Craig Rodrigues  wrote:

> On Thu, Oct 23, 2014 at 11:06 PM, K. Macy  wrote:
>=20
>>>> (2)  Creates a bootable UFS image with makefs
>>>=20
>>> any chance zfs will be used as well?
>>>=20
>>=20
>> Seconded. There are residual locking issues issues in ZFS.
>> Particularly in the less exercised areas.
>>=20
>=20
> I think what would be an interesting exercise is to set up a Jenkins =
job to
> build
> and boot a bhyve VM with ZFS, and then run
> the ZFS Test Suite, ported by Alan Somers to FreeBSD:
>=20
> =
https://lists.freebsd.org/pipermail/freebsd-testing/2014-August/000503.htm=
l
>=20
>=20
> Are there any volunteers who would like to help set that up and get it
> running
> under Jenkins?

I think getting tools/regression/zfs working first would be a better =
idea (which means that ZFS developers will need to go debug/fix the =
issue noted in https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D191574 =
). I=92ll go ahead and commit my fixes to head from my github fork so it =
runs.

Alan also suggested against integrating the test suite as-is, because as =
he said, "Remember, don't run these tests on a production system.  They =
WILL cause panics and deadlocks, and they may cause data loss too.=94

Cheers,
-Garrett

--Apple-Mail=_2A11CEE8-A629-491F-891F-17FC136ECA72
Content-Transfer-Encoding: 7bit
Content-Disposition: attachment;
	filename=signature.asc
Content-Type: application/pgp-signature;
	name=signature.asc
Content-Description: Message signed with OpenPGP using GPGMail

-----BEGIN PGP SIGNATURE-----
Comment: GPGTools - https://gpgtools.org

iQEcBAEBCgAGBQJUSyrhAAoJEMZr5QU6S73eQq0H/i1iKoeG+vYhyEgN5rLuis5b
T7p5Vv5CLpCt0hiWcaAnKw6pRXLHS+NZpp2iaMg6El7C4E9XOAMYPrD6Lf5FSSyO
6jlBZ7NpNuTG7oo8SDe8uC3aHvEf8pw+XMNroAkLliRKrjGGkY7wsoD8IdlMTebT
6jAvMcszrEo6o8q2zi1kNZfT0y64US49htX7mVqxRVsDgvNSJMMsBlTzDigo4aGj
rqlkL6WYaWus8XJr0rLXgLzFFNkb/6RsEDA258bA7lR+upordi375fhYCOJ0R6Rh
C8l+EQOb18dcsh3d3WQRNF7Blt0O0lht+TL0AcnH4MZtslJLBsl/9fDzW1fLZKM=
=psgR
-----END PGP SIGNATURE-----

--Apple-Mail=_2A11CEE8-A629-491F-891F-17FC136ECA72--

From owner-freebsd-virtualization@FreeBSD.ORG  Sat Oct 25 05:11:15 2014
Return-Path: 
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id E3B15608;
 Sat, 25 Oct 2014 05:11:14 +0000 (UTC)
Received: from mail-pd0-x22e.google.com (mail-pd0-x22e.google.com
 [IPv6:2607:f8b0:400e:c02::22e])
 (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
 (Client CN "smtp.gmail.com",
 Issuer "Google Internet Authority G2" (verified OK))
 by mx1.freebsd.org (Postfix) with ESMTPS id 9A2C711F;
 Sat, 25 Oct 2014 05:11:14 +0000 (UTC)
Received: by mail-pd0-f174.google.com with SMTP id p10so2570141pdj.33
 for ; Fri, 24 Oct 2014 22:11:14 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
 h=content-type:mime-version:subject:from:in-reply-to:date:cc
 :message-id:references:to;
 bh=HQGvuTqDSbBI1h/rjkmmVCseB8iLUxwQ9KzKGEcIAJI=;
 b=Oayd24Qyh407XMyqb0JfzKScBq7WHCOp/zLZ7rWhSVXedqIWXpW6KqKPGVty/jpPU3
 /iGsrICiHGEwI5AM8QawUIZPOfuhUR32bNY3XGNq/GqYFKjb17tLjZ6pxnn0/7BeR90v
 EN5sp+6fP/KzAvLR00Yxk6JGzFUbzsOEukf9UFrZTUsfD6YyVk5LdM45MWsL/AUb2wgL
 2Aod0mSCEjHphPMPY/p70KBhCRBrvyQg/L1LJErYzklkEjACkRWKjJyh2T5bpBJIPeB3
 jVny7B/WsN01LgLrd2zKHTcxDdhGWeY7T350BCvoit2KtQwJuFxygeYRV1XKYTlN0wEb
 HioQ==
X-Received: by 10.68.246.229 with SMTP id xz5mr25945pbc.131.1414213874088;
 Fri, 24 Oct 2014 22:11:14 -0700 (PDT)
Received: from ?IPv6:2601:8:ab80:7d6:4d3d:33a4:5ddc:37e2?
 ([2601:8:ab80:7d6:4d3d:33a4:5ddc:37e2])
 by mx.google.com with ESMTPSA id g2sm5218951pdk.46.2014.10.24.22.11.13
 for 
 (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128);
 Fri, 24 Oct 2014 22:11:13 -0700 (PDT)
Content-Type: multipart/signed;
 boundary="Apple-Mail=_51EBB7D1-6870-4412-A765-22F9D16DF84A";
 protocol="application/pgp-signature"; micalg=pgp-sha512
Mime-Version: 1.0 (Mac OS X Mail 7.3 \(1878.6\))
Subject: Re: Automatically running /usr/tests on stable/10 branch under Jenkins
From: Garrett Cooper 
In-Reply-To: <81030948-E60F-4AAD-AAF1-16349607917D@gmail.com>
Date: Fri, 24 Oct 2014 22:11:11 -0700
Message-Id: <2D7ED585-8A72-462F-9F3E-1C67C620AC72@gmail.com>
References: 
 <20141024053636.GH11222@dft-labs.eu>
 
 
 <81030948-E60F-4AAD-AAF1-16349607917D@gmail.com>
To: Craig Rodrigues 
X-Mailer: Apple Mail (2.1878.6)
Cc: "freebsd-testing@freebsd.org" ,
 FreeBSD stable ,
 "freebsd-virtualization@freebsd.org" 
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Sat, 25 Oct 2014 05:11:15 -0000


--Apple-Mail=_51EBB7D1-6870-4412-A765-22F9D16DF84A
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain;
	charset=windows-1252

On Oct 24, 2014, at 21:45, Garrett Cooper  wrote:

> On Oct 24, 2014, at 21:20, Craig Rodrigues  =
wrote:
>=20
>> On Thu, Oct 23, 2014 at 11:06 PM, K. Macy  wrote:
>>=20
>>>>> (2)  Creates a bootable UFS image with makefs
>>>>=20
>>>> any chance zfs will be used as well?
>>>>=20
>>>=20
>>> Seconded. There are residual locking issues issues in ZFS.
>>> Particularly in the less exercised areas.
>>>=20
>>=20
>> I think what would be an interesting exercise is to set up a Jenkins =
job to
>> build
>> and boot a bhyve VM with ZFS, and then run
>> the ZFS Test Suite, ported by Alan Somers to FreeBSD:
>>=20
>> =
https://lists.freebsd.org/pipermail/freebsd-testing/2014-August/000503.htm=
l
>>=20
>>=20
>> Are there any volunteers who would like to help set that up and get =
it
>> running
>> under Jenkins?
>=20
> I think getting tools/regression/zfs working first would be a better =
idea (which means that ZFS developers will need to go debug/fix the =
issue noted inhttps://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D191574 =
). I=92ll go ahead and commit my fixes to head from my github fork so it =
runs.

	Might have helped if I had referenced the appropriate bug: =
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D191573 (I=92m =
basically fixing =
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D191574 right now).
Cheers!

--Apple-Mail=_51EBB7D1-6870-4412-A765-22F9D16DF84A
Content-Transfer-Encoding: 7bit
Content-Disposition: attachment;
	filename=signature.asc
Content-Type: application/pgp-signature;
	name=signature.asc
Content-Description: Message signed with OpenPGP using GPGMail

-----BEGIN PGP SIGNATURE-----
Comment: GPGTools - https://gpgtools.org

iQEcBAEBCgAGBQJUSzDvAAoJEMZr5QU6S73eARAH/1P3uHc6LPrjW0rvbl4aTn4D
e54PyOxQ/XEoy5MhauP8Wj3rg7HJn6/jcqtPldVQ2w8l0qzIbhiQOzL/Y93zknW8
yzKUAhkvd+5h2KmwxFK/u+fLAvK2UPurYTiJ1RC+UTiaA+8E+RlUH6iUjwl93JFo
qp2SVDTxW7xbMq6Tmni8YKl4ZTcVlyPynRoKiVf7JJoy67oQPhOCWeTf8piaXI+x
SYhgfetOvPl7ny8EnP3tHHqkg96ewpEqSs4ne0YQ4BejaBJwyQh/+H1rw2Nt6Af0
LTPv35Thnfr0tj2RBkcMaVsvNvkecKcws5SxPCatkNMRoRgFmbwJLhAMsTHi+10=
=0kRo
-----END PGP SIGNATURE-----

--Apple-Mail=_51EBB7D1-6870-4412-A765-22F9D16DF84A--

From owner-freebsd-virtualization@FreeBSD.ORG  Sat Oct 25 06:44:10 2014
Return-Path: 
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id C95F77D2;
 Sat, 25 Oct 2014 06:44:10 +0000 (UTC)
Received: from elvis.mu.org (elvis.mu.org [IPv6:2001:470:1f05:b76::196])
 by mx1.freebsd.org (Postfix) with ESMTP id B01CCB08;
 Sat, 25 Oct 2014 06:44:10 +0000 (UTC)
Received: from u10-2-32-011.office.norse-data.com (unknown [50.204.88.51])
 by elvis.mu.org (Postfix) with ESMTPSA id 9D56F341F86A;
 Fri, 24 Oct 2014 23:44:10 -0700 (PDT)
Message-ID: <544B46BA.4000008@freebsd.org>
Date: Fri, 24 Oct 2014 23:44:10 -0700
From: Alfred Perlstein 
Organization: FreeBSD
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.9;
 rv:31.0) Gecko/20100101 Thunderbird/31.2.0
MIME-Version: 1.0
To: Garrett Cooper , 
 Craig Rodrigues 
Subject: Re: Automatically running /usr/tests on stable/10 branch under Jenkins
References: 
 <20141024053636.GH11222@dft-labs.eu>
 
 
 <81030948-E60F-4AAD-AAF1-16349607917D@gmail.com>
In-Reply-To: <81030948-E60F-4AAD-AAF1-16349607917D@gmail.com>
Content-Type: text/plain; charset=windows-1252; format=flowed
Content-Transfer-Encoding: 8bit
Cc: "freebsd-testing@freebsd.org" ,
 FreeBSD stable ,
 "freebsd-virtualization@freebsd.org" 
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Sat, 25 Oct 2014 06:44:10 -0000


On 10/24/14 9:45 PM, Garrett Cooper wrote:
> On Oct 24, 2014, at 21:20, Craig Rodrigues  wrote:
>
>> On Thu, Oct 23, 2014 at 11:06 PM, K. Macy  wrote:
>>
>>>>> (2)  Creates a bootable UFS image with makefs
>>>> any chance zfs will be used as well?
>>>>
>>> Seconded. There are residual locking issues issues in ZFS.
>>> Particularly in the less exercised areas.
>>>
>> I think what would be an interesting exercise is to set up a Jenkins job to
>> build
>> and boot a bhyve VM with ZFS, and then run
>> the ZFS Test Suite, ported by Alan Somers to FreeBSD:
>>
>> https://lists.freebsd.org/pipermail/freebsd-testing/2014-August/000503.html
>>
>>
>> Are there any volunteers who would like to help set that up and get it
>> running
>> under Jenkins?
> I think getting tools/regression/zfs working first would be a better idea (which means that ZFS developers will need to go debug/fix the issue noted in https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=191574 ). Ill go ahead and commit my fixes to head from my github fork so it runs.
>
> Alan also suggested against integrating the test suite as-is, because as he said, "Remember, don't run these tests on a production system.  They WILL cause panics and deadlocks, and they may cause data loss too.
>
> Cheers,
> -Garrett

Wait, we want to sweep those bugs under the rug?  What exactly is wrong 
with making a test harness that can very easily reproduce a known 
problem?  The chances are that anyone will dive into it once the bug is 
easily reproducible.

-Alfred


From owner-freebsd-virtualization@FreeBSD.ORG  Sat Oct 25 06:48:04 2014
Return-Path: 
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id D6465A25;
 Sat, 25 Oct 2014 06:48:04 +0000 (UTC)
Received: from mail-pd0-x22b.google.com (mail-pd0-x22b.google.com
 [IPv6:2607:f8b0:400e:c02::22b])
 (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
 (Client CN "smtp.gmail.com",
 Issuer "Google Internet Authority G2" (verified OK))
 by mx1.freebsd.org (Postfix) with ESMTPS id 8B496B2F;
 Sat, 25 Oct 2014 06:48:04 +0000 (UTC)
Received: by mail-pd0-f171.google.com with SMTP id r10so2660083pdi.30
 for ; Fri, 24 Oct 2014 23:48:04 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
 h=content-type:mime-version:subject:from:in-reply-to:date:cc
 :message-id:references:to;
 bh=0W9DkqfiAld4WGNwRxVReCOvtZ/9P41LPKGt4Nci47w=;
 b=epVQvQOiEMDjjCGFLuY7SL5ke0xemxc8uTqDhVvyNveauSg6B9i8NJi8DnCp3U7vlU
 zbzCv0QK1I/jKkB70joNDOpMDkBSnR9JVznMLxbYUsqJvOXhWYVDMpN2TzgKFd5GLsK5
 dhvnvmP0yXtj0Oi1ees9sCOvSyBtJNWDdXEVgO7dLKmWf8MzDFl4yqYM9PXu4KZ9AMXS
 3kG+E40gcOtaHKcNgVCYUkh6+q5IifYCAkj0f6joAo6Lpr7WLo5wbHnn9lD4r/BS55Hf
 w7UdNjs4a+6tf8gJSeq6EcV20eBBdxKg8rKfrlN/xDsexhnnRZa/otfm/CPLDh4INnzZ
 FOCw==
X-Received: by 10.68.213.101 with SMTP id nr5mr9344918pbc.81.1414219684005;
 Fri, 24 Oct 2014 23:48:04 -0700 (PDT)
Received: from ?IPv6:2601:8:ab80:7d6:4d3d:33a4:5ddc:37e2?
 ([2601:8:ab80:7d6:4d3d:33a4:5ddc:37e2])
 by mx.google.com with ESMTPSA id nq2sm5418288pdb.74.2014.10.24.23.48.03
 for 
 (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128);
 Fri, 24 Oct 2014 23:48:03 -0700 (PDT)
Content-Type: multipart/signed;
 boundary="Apple-Mail=_FDB23D5C-BB5E-410D-95B3-35CE9ACBE165";
 protocol="application/pgp-signature"; micalg=pgp-sha512
Mime-Version: 1.0 (Mac OS X Mail 7.3 \(1878.6\))
Subject: Re: Automatically running /usr/tests on stable/10 branch under Jenkins
From: Garrett Cooper 
In-Reply-To: <544B46BA.4000008@freebsd.org>
Date: Fri, 24 Oct 2014 23:48:01 -0700
Message-Id: 
References: 
 <20141024053636.GH11222@dft-labs.eu>
 
 
 <81030948-E60F-4AAD-AAF1-16349607917D@gmail.com>
 <544B46BA.4000008@freebsd.org>
To: Alfred Perlstein 
X-Mailer: Apple Mail (2.1878.6)
Cc: "freebsd-testing@freebsd.org" ,
 FreeBSD stable ,
 "freebsd-virtualization@freebsd.org" 
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Sat, 25 Oct 2014 06:48:05 -0000


--Apple-Mail=_FDB23D5C-BB5E-410D-95B3-35CE9ACBE165
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain;
	charset=windows-1252

On Oct 24, 2014, at 23:44, Alfred Perlstein  wrote:

> On 10/24/14 9:45 PM, Garrett Cooper wrote:
>> On Oct 24, 2014, at 21:20, Craig Rodrigues  =
wrote:
>>=20
>>> On Thu, Oct 23, 2014 at 11:06 PM, K. Macy  wrote:
>>>=20
>>>>>> (2)  Creates a bootable UFS image with makefs
>>>>> any chance zfs will be used as well?
>>>>>=20
>>>> Seconded. There are residual locking issues issues in ZFS.
>>>> Particularly in the less exercised areas.
>>>>=20
>>> I think what would be an interesting exercise is to set up a Jenkins =
job to
>>> build
>>> and boot a bhyve VM with ZFS, and then run
>>> the ZFS Test Suite, ported by Alan Somers to FreeBSD:
>>>=20
>>> =
https://lists.freebsd.org/pipermail/freebsd-testing/2014-August/000503.htm=
l
>>>=20
>>>=20
>>> Are there any volunteers who would like to help set that up and get =
it
>>> running
>>> under Jenkins?
>> I think getting tools/regression/zfs working first would be a better =
idea (which means that ZFS developers will need to go debug/fix the =
issue noted in https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D191574 =
). I=92ll go ahead and commit my fixes to head from my github fork so it =
runs.
>>=20
>> Alan also suggested against integrating the test suite as-is, because =
as he said, "Remember, don't run these tests on a production system.  =
They WILL cause panics and deadlocks, and they may cause data loss too.=94=

>>=20
>> Cheers,
>> -Garrett
>=20
> Wait, we want to sweep those bugs under the rug?  What exactly is =
wrong with making a test harness that can very easily reproduce a known =
problem?  The chances are that anyone will dive into it once the bug is =
easily reproducible.

	Sweeping bugs under the rug is not what I plan on doing; I=92m =
marking these as expected failures, as opposed to having them =
continually panic a machine. Once a ZFS dev takes a look at the issue =
and resolves them, then the ZFS dev can remove the =93bail=94 calls I=92m =
adding to the testcases.
Cheers,
-Garrett

PS FWIW the panics are recent. As I stated in the first bug, it didn=92t =
occur on 10.0-RELEASE.

--Apple-Mail=_FDB23D5C-BB5E-410D-95B3-35CE9ACBE165
Content-Transfer-Encoding: 7bit
Content-Disposition: attachment;
	filename=signature.asc
Content-Type: application/pgp-signature;
	name=signature.asc
Content-Description: Message signed with OpenPGP using GPGMail

-----BEGIN PGP SIGNATURE-----
Comment: GPGTools - https://gpgtools.org

iQEcBAEBCgAGBQJUS0eiAAoJEMZr5QU6S73ejxcIALZRkCzcpT6cfWtwDIgts2rz
5zUOJHgmExFkkijOtd7m9HEFnQQcEDQ8JJ0P/s6Fvol2/gKfRCtjd51+ip2Dj8ya
g67V81qOxTFomCWo9VxWMWaBtPsowP8wwG/ZL0QkKCYQlLQITNNVu8/FsKODpIbm
IKja9Bk97du9oI7+1T6L0FvkRvvk7m7MJxkzI373HKTb6+hmmt7YK9jRQ7fh5efG
Qy7Ce4UUAffr6V/PHqhVvxZLiZkSa69hnY9MaAKXkVRPvIgUFTFhdYTCKqw7L8Ua
vJx+zflZEzCnA2a9NC0Llcf0roNsnPV/E11F5vBzhhIY1ICx2dx2Gj99298zHPE=
=pm2N
-----END PGP SIGNATURE-----

--Apple-Mail=_FDB23D5C-BB5E-410D-95B3-35CE9ACBE165--

From owner-freebsd-virtualization@FreeBSD.ORG  Sat Oct 25 16:49:50 2014
Return-Path: 
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 30F1BC36;
 Sat, 25 Oct 2014 16:49:50 +0000 (UTC)
Received: from mail-la0-x229.google.com (mail-la0-x229.google.com
 [IPv6:2a00:1450:4010:c03::229])
 (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
 (Client CN "smtp.gmail.com",
 Issuer "Google Internet Authority G2" (verified OK))
 by mx1.freebsd.org (Postfix) with ESMTPS id 1F886CA9;
 Sat, 25 Oct 2014 16:49:48 +0000 (UTC)
Received: by mail-la0-f41.google.com with SMTP id pn19so4268604lab.0
 for ; Sat, 25 Oct 2014 09:49:46 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
 h=mime-version:sender:in-reply-to:references:date:message-id:subject
 :from:to:cc:content-type;
 bh=cgm9lfEHWfB6qAKCJlmjuQQ3hPSKCH27q8M4kK3lgUg=;
 b=t/zm/tpixCC8iLm0cepTwA62bBcKH00ujOBaTZjgFYl0Bo3gLBEwSzKg/CrjCEIWGS
 GiogtLPx0yMwoo2c6DZct0U0cUATsYJRJfO57owSpHlO3UMj8kJP3GZl9qXgyxRfCamL
 UjorKSEMtacmJRLL2upi0sTRhku8LSGxeMws02Ke0b7ZHxjat8ujAHmPaPX6lSypOII0
 R1cK0S1ssTesQBpX78IwggzDqUkfjAknXFHUTfjM8wXoUnQXXAQUNiLAgulq/n9hN7dA
 3sVj+i/FHxqB9SPwJhRlQC2IQcG4ZNYW6RtBZjNIGzx3Rx7RO+kvUSPNCnNPe3yRNatW
 OsLg==
MIME-Version: 1.0
X-Received: by 10.112.57.227 with SMTP id l3mr11901372lbq.68.1414255786825;
 Sat, 25 Oct 2014 09:49:46 -0700 (PDT)
Sender: crodr001@gmail.com
Received: by 10.112.84.197 with HTTP; Sat, 25 Oct 2014 09:49:46 -0700 (PDT)
In-Reply-To: <544B46BA.4000008@freebsd.org>
References: 
 <20141024053636.GH11222@dft-labs.eu>
 
 
 <81030948-E60F-4AAD-AAF1-16349607917D@gmail.com>
 <544B46BA.4000008@freebsd.org>
Date: Sat, 25 Oct 2014 09:49:46 -0700
X-Google-Sender-Auth: GIlVT8zHlo5sp3t_C8L_ce6W7_A
Message-ID: 
Subject: Re: Automatically running /usr/tests on stable/10 branch under Jenkins
From: Craig Rodrigues 
To: Alfred Perlstein 
Content-Type: text/plain; charset=ISO-8859-1
X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1
Cc: "freebsd-testing@freebsd.org" ,
 FreeBSD stable ,
 "freebsd-virtualization@freebsd.org" ,
 Garrett Cooper 
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Sat, 25 Oct 2014 16:49:50 -0000

On Fri, Oct 24, 2014 at 11:44 PM, Alfred Perlstein 
wrote:

>
> On 10/24/14 9:45 PM, Garrett Cooper wrote:
>
>> I think getting tools/regression/zfs working first would be a better idea
>> (which means that ZFS developers will need to go debug/fix the issue noted
>> in https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=191574 ). I'll go
>> ahead and commit my fixes to head from my github fork so it runs.
>>
>
If tools/regression/zfs has Kyuafiles that makes it easier to
run under the kyua tool, that would greatly facilitate running
under Jenkins automation, and would be useful.
I notice some of the fixes you are applying to the regression/zfs
tests is to make certain tests not run on FreeBSD because they
cause known kernel panics such as this:

https://lists.freebsd.org/pipermail/svn-src-all/2014-October/093671.html

I'm not entirely convinced that this is a good way to "fix" a test.
If a test causes a panic, then that's what it does, it it should not be
swept under the rug, as Alfred has pointed out.
Printing out a warning with a pointer to the PR just before running this
type of test is OK, though.



>
>> Alan also suggested against integrating the test suite as-is, because as
>> he said, "Remember, don't run these tests on a production system.  They
>> WILL cause panics and deadlocks, and they may cause data loss too."
>>
>> Cheers,
>> -Garrett
>>
>
> Wait, we want to sweep those bugs under the rug?  What exactly is wrong
> with making a test harness that can very easily reproduce a known problem?
> The chances are that anyone will dive into it once the bug is easily
> reproducible.
>

I agree with Alfred on this.  Even though Alan's test suite
may kernel panic or cause problems, there is still value in running it
and making the results visible on jenkins.freebsd.org.
Running these tests inside a VM which is generated during the build
will allow these types of test to run, but still keep the test machine
usable,
even if the VM gets corrupted while running the tests.

If we have test suites for ZFS, but no one runs them, then no one will
bother to investigate and fix the bugs.

Running the test suites under automation that is visible on
jenkins.freebsd.org is going to force developers to see problems
much sooner than they do now.  Just having the tests in the tree
and hoping that people run them and care to look into the problems is
not enough.

--
Craig

From owner-freebsd-virtualization@FreeBSD.ORG  Sat Oct 25 17:45:56 2014
Return-Path: 
Delivered-To: virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 5975B843;
 Sat, 25 Oct 2014 17:45:56 +0000 (UTC)
Received: from smtp.digiware.nl (unknown [IPv6:2001:4cb8:90:ffff::3])
 (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
 (Client did not present a certificate)
 by mx1.freebsd.org (Postfix) with ESMTPS id 18267232;
 Sat, 25 Oct 2014 17:45:56 +0000 (UTC)
Received: from rack1.digiware.nl (unknown [127.0.0.1])
 by smtp.digiware.nl (Postfix) with ESMTP id 957BC153448;
 Sat, 25 Oct 2014 19:45:52 +0200 (CEST)
X-Virus-Scanned: amavisd-new at digiware.nl
Received: from smtp.digiware.nl ([127.0.0.1])
 by rack1.digiware.nl (rack1.digiware.nl [127.0.0.1]) (amavisd-new, port 10024)
 with ESMTP id 3TWFPszzpxVh; Sat, 25 Oct 2014 19:45:43 +0200 (CEST)
Received: from [192.168.10.9] (vaio [192.168.10.9])
 (using TLSv1 with cipher ECDHE-RSA-AES128-SHA (128/128 bits))
 (No client certificate requested)
 by smtp.digiware.nl (Postfix) with ESMTPSA id A9A92153416;
 Sat, 25 Oct 2014 19:45:43 +0200 (CEST)
Message-ID: <544BE1CA.6010300@digiware.nl>
Date: Sat, 25 Oct 2014 19:45:46 +0200
From: Willem Jan Withagen 
User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64;
 rv:24.0) Gecko/20100101 Thunderbird/24.6.0
MIME-Version: 1.0
To: Peter Grehan 
Subject: Re: Bhyve building kernel....Just an observation
References: <544A083B.50007@digiware.nl> <544ADF08.4020706@freebsd.org>
In-Reply-To: <544ADF08.4020706@freebsd.org>
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
Cc: virtualization@freebsd.org
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Sat, 25 Oct 2014 17:45:56 -0000

On 25-10-2014 1:21, Peter Grehan wrote:
> Hi Willem,
>> And then booted a 10-STABLE bhyve VM with all memory and processors
>> assigned to the VM. So all the power could be available to the VM.
> 
>  You'll most likely want to keep some memory and processor resources
> available for the host system. ZFS will need memory for ARC and CPU for
> operations - if these aren't available, it will compete with bhyve's use
> of CPUs, and there will be times when these are conflicting.

Hi Peter,

Thanx for the hint.

The assumption that the performance difference is, is Disk-IO is at
least not very obvious from the simple test.

Both tests were running from a 6Gb tmpfs
Dom0 had 16Gb Ram, and I limited DomU to 12G Ram.

Tested it once in Dom0, and it takes ~ 5Gb of tmp store.
It holds src and obj, and I see no disk traffic while building.

Building kernel with just the default tmpfs (all avail mem + swap)
takes 	6:30 (zfs with ssd's)
versus 	5:30 (tmpfs)

Running in DomU is get about the same difference:
with ahci-hd/zfs backing 	9:30
with tmpfs 			8:30

So I would think the difference is not really in the IO-performance.

But as usual:
	All other opinions more than appreciated.

--WjW




From owner-freebsd-virtualization@FreeBSD.ORG  Sat Oct 25 20:20:07 2014
Return-Path: 
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 7E16FD6B;
 Sat, 25 Oct 2014 20:20:07 +0000 (UTC)
Received: from mail-yh0-x236.google.com (mail-yh0-x236.google.com
 [IPv6:2607:f8b0:4002:c01::236])
 (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
 (Client CN "smtp.gmail.com",
 Issuer "Google Internet Authority G2" (verified OK))
 by mx1.freebsd.org (Postfix) with ESMTPS id 104C3366;
 Sat, 25 Oct 2014 20:20:07 +0000 (UTC)
Received: by mail-yh0-f54.google.com with SMTP id 29so3165889yhl.13
 for ; Sat, 25 Oct 2014 13:20:05 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
 h=mime-version:sender:in-reply-to:references:date:message-id:subject
 :from:to:cc:content-type:content-transfer-encoding;
 bh=tynCnMKKC0eHZKShqxl5XFhNw74YLNxljWlRLqIOxA4=;
 b=Pub3QTq2WHLOKa8SdiQLMVF4SbTO2qnYUbR4XG+2yQllUwJPdQbUCWpRbuFy8nd9s8
 r8pwHdCwy4EzGeMTtXHkwS7L9TqxbdbXcRNskwWWpPzDxCgil7raUIrZvitMCPnBJphI
 Y1aY/Zi3+hdvH1rNCXGNYqff8v+MHVALWchY3YxImcLw/VjXavNp1PD56P1vXrpdIR/Z
 fNNMe+v+M9AwqgBmfgQ9X1246rzuf5eDr+tEAGC/wTNiDB3kXn+PYKvfnmE6ht4LgoqI
 R6UiXjiXhNkLA2IPvRR1Lih9V4YEYtUgdDH/EuOz9rXOeEbbIGkRh4Xq4xXKIVvCB19C
 ksfw==
MIME-Version: 1.0
X-Received: by 10.170.113.214 with SMTP id f205mr15326025ykb.10.1414268405509; 
 Sat, 25 Oct 2014 13:20:05 -0700 (PDT)
Sender: kmacybsd@gmail.com
Received: by 10.170.82.197 with HTTP; Sat, 25 Oct 2014 13:20:05 -0700 (PDT)
In-Reply-To: 
References: 
 <20141024053636.GH11222@dft-labs.eu>
 
 
 <81030948-E60F-4AAD-AAF1-16349607917D@gmail.com>
 <544B46BA.4000008@freebsd.org>
 
Date: Sat, 25 Oct 2014 13:20:05 -0700
X-Google-Sender-Auth: Tz1pjYcN82aDbop02VCfh_GmGLU
Message-ID: 
Subject: Re: Automatically running /usr/tests on stable/10 branch under Jenkins
From: "K. Macy" 
To: Garrett Cooper 
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
Cc: "freebsd-testing@freebsd.org" ,
 FreeBSD stable ,
 "freebsd-virtualization@freebsd.org" 
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Sat, 25 Oct 2014 20:20:07 -0000

>>> Alan also suggested against integrating the test suite as-is, because a=
s he said, "Remember, don't run these tests on a production system.  They W=
ILL cause panics and deadlocks, and they may cause data loss too.=E2=80=9D
>>>
>>> Cheers,
>>> -Garrett
>>
>> Wait, we want to sweep those bugs under the rug?  What exactly is wrong =
with making a test harness that can very easily reproduce a known problem? =
 The chances are that anyone will dive into it once the bug is easily repro=
ducible.
>
>         Sweeping bugs under the rug is not what I plan on doing; I=E2=80=
=99m marking these as expected failures, as opposed to having them continua=
lly panic a machine. Once a ZFS dev takes a look at the issue and resolves =
them, then the ZFS dev can remove the =E2=80=9Cbail=E2=80=9D calls I=E2=80=
=99m adding to the testcases.
> Cheers,
> -Garrett

Yes, disabling tests that fail leads to an ineffectual test suite. A
test suite that never has any failures is not very useful. However,
there are two factors to take in to account in this context:
a) frequent failures can lead users to stop running a test suite
leading to further regressions
b) long-term repeated failures can desensitize users leading them to
ignore *new* failures facilitating further regressions

Thus it's really a question of what context you're talking about
running the test suite in. For purposes of Jenkins we want full
visibility in to what is passing and what is failing and how long this
has been going on for.

Cheers.

-K

From owner-freebsd-virtualization@FreeBSD.ORG  Sat Oct 25 20:46:08 2014
Return-Path: 
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 256C38D1;
 Sat, 25 Oct 2014 20:46:08 +0000 (UTC)
Received: from mail-wg0-x22c.google.com (mail-wg0-x22c.google.com
 [IPv6:2a00:1450:400c:c00::22c])
 (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
 (Client CN "smtp.gmail.com",
 Issuer "Google Internet Authority G2" (verified OK))
 by mx1.freebsd.org (Postfix) with ESMTPS id 1AE708A5;
 Sat, 25 Oct 2014 20:46:06 +0000 (UTC)
Received: by mail-wg0-f44.google.com with SMTP id y10so3165082wgg.15
 for ; Sat, 25 Oct 2014 13:46:05 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
 h=mime-version:reply-to:sender:in-reply-to:references:date:message-id
 :subject:from:to:cc:content-type:content-transfer-encoding;
 bh=t//pXgEd3Q3UH0iDU41IKFjnnABq5Sm5aPP3WwoOZYY=;
 b=SVH1blnEsqAYqr3PugLeWMACKsu9FoSXunMO38A0GhtfKZv0/sOTh3ATCkCS9jCQlD
 DAtFkj8tZBZefRlYGdMmO8HEeASGKxmgLOICXsaUtSVHbLYTBFdei7R3gKKoeKDHu6nt
 Ml6Jk9Nu7ZACfRC+Pe9L7Rbgb6wIDxIAk0fn91G//Plugu5QCeTEQldd3dXidRp6wOzd
 4FQuRRsjKOgvCGhHeLqBnOJ6HQTRSOwbWRaxPWQ2YjRSVIYZ+EJ7FUlLQk5xooiMVr0V
 8a0eM26oTPzJVM/gFgFcJPOJvV/GizrxUBE5Q6qiPdBpFQ/ErX4JxJQJREl+y+8+Tygp
 2gOw==
MIME-Version: 1.0
X-Received: by 10.194.91.176 with SMTP id cf16mr13105133wjb.60.1414269965374; 
 Sat, 25 Oct 2014 13:46:05 -0700 (PDT)
Reply-To: matt@ixsystems.com
Sender: mattjeet@gmail.com
Received: by 10.194.14.40 with HTTP; Sat, 25 Oct 2014 13:46:05 -0700 (PDT)
In-Reply-To: 
References: 
 <20141024053636.GH11222@dft-labs.eu>
 
 
 <81030948-E60F-4AAD-AAF1-16349607917D@gmail.com>
 <544B46BA.4000008@freebsd.org>
 
 
Date: Sat, 25 Oct 2014 13:46:05 -0700
X-Google-Sender-Auth: d4LEDwRd3jOMoF28Wxp0hRpOoQk
Message-ID: 
Subject: Re: Automatically running /usr/tests on stable/10 branch under Jenkins
From: Matt Olander 
To: "K. Macy" 
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
Cc: "freebsd-testing@freebsd.org" ,
 FreeBSD stable ,
 "freebsd-virtualization@freebsd.org" ,
 Garrett Cooper 
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Sat, 25 Oct 2014 20:46:08 -0000

On Sat, Oct 25, 2014 at 1:20 PM, K. Macy  wrote:
>>>> Alan also suggested against integrating the test suite as-is, because =
as he said, "Remember, don't run these tests on a production system.  They =
WILL cause panics and deadlocks, and they may cause data loss too.=E2=80=9D
>>>>
>>>> Cheers,
>>>> -Garrett
>>>
>>> Wait, we want to sweep those bugs under the rug?  What exactly is wrong=
 with making a test harness that can very easily reproduce a known problem?=
  The chances are that anyone will dive into it once the bug is easily repr=
oducible.
>>
>>         Sweeping bugs under the rug is not what I plan on doing; I=E2=80=
=99m marking these as expected failures, as opposed to having them continua=
lly panic a machine. Once a ZFS dev takes a look at the issue and resolves =
them, then the ZFS dev can remove the =E2=80=9Cbail=E2=80=9D calls I=E2=80=
=99m adding to the testcases.
>> Cheers,
>> -Garrett
>
> Yes, disabling tests that fail leads to an ineffectual test suite. A
> test suite that never has any failures is not very useful. However,
> there are two factors to take in to account in this context:
> a) frequent failures can lead users to stop running a test suite
> leading to further regressions
> b) long-term repeated failures can desensitize users leading them to
> ignore *new* failures facilitating further regressions
>
> Thus it's really a question of what context you're talking about
> running the test suite in. For purposes of Jenkins we want full
> visibility in to what is passing and what is failing and how long this
> has been going on for.

Agreed. We're talking about doing an OpenZFS bug-tracker and maybe we
could have tests post there automatically, once the bug is opened. I
am going to put this on the board at MeetBSD Ca. next week, so we can
have a discussion about it in real-time with some of the people
present.

Cheers,
-matt

From owner-freebsd-virtualization@FreeBSD.ORG  Sat Oct 25 21:46:48 2014
Return-Path: 
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 62229484;
 Sat, 25 Oct 2014 21:46:48 +0000 (UTC)
Received: from mail-pa0-x22b.google.com (mail-pa0-x22b.google.com
 [IPv6:2607:f8b0:400e:c03::22b])
 (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
 (Client CN "smtp.gmail.com",
 Issuer "Google Internet Authority G2" (verified OK))
 by mx1.freebsd.org (Postfix) with ESMTPS id 1629EDD4;
 Sat, 25 Oct 2014 21:46:48 +0000 (UTC)
Received: by mail-pa0-f43.google.com with SMTP id eu11so3107879pac.30
 for ; Sat, 25 Oct 2014 14:46:47 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
 h=content-type:mime-version:subject:from:in-reply-to:date:cc
 :message-id:references:to;
 bh=ROBklQZYzRnOWEg4u6+mXXSEkyoA39Nb6IiVCDo1Xxw=;
 b=TxhmpWmG3d4QN+IylTmBpQ4iKoZbx8OXhNghtQONHkI+RGzBN2aOzpdlTaPeIua/zr
 rCd1a80riRlgYFrpHlJ5FuvMCZbPrL6oWUmajDRwVFMUWEILl01baRhHrwaFj6KljQmQ
 iq5i6PImVvu/vaOv7JJo5bgxDUqKGipAU9HAC/poO7y0DL5yt4Bbs1wvk7gkvLm1Hm0J
 S/4c5derxn850sFBlqrbnTE42zGlBGDkmbDmZEP43OBvkVdoHFNHBAb219BzbA7TaMP4
 ofxFP139tjrcShC8epy6Vrn43rKU1K8lw66K+m9wp9uxbK7ePFV2Wfxd/4UmqlvwTYvW
 sZtw==
X-Received: by 10.70.19.101 with SMTP id d5mr13514906pde.79.1414273607611;
 Sat, 25 Oct 2014 14:46:47 -0700 (PDT)
Received: from [192.168.20.5] (c-98-247-240-204.hsd1.wa.comcast.net.
 [98.247.240.204])
 by mx.google.com with ESMTPSA id jq5sm6960728pbc.32.2014.10.25.14.46.46
 for 
 (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128);
 Sat, 25 Oct 2014 14:46:46 -0700 (PDT)
Content-Type: multipart/signed;
 boundary="Apple-Mail=_B288C26C-0C84-4CCF-A5EC-92AEB18549DC";
 protocol="application/pgp-signature"; micalg=pgp-sha512
Mime-Version: 1.0 (Mac OS X Mail 7.3 \(1878.6\))
Subject: Re: Automatically running /usr/tests on stable/10 branch under Jenkins
From: Garrett Cooper 
In-Reply-To: 
Date: Sat, 25 Oct 2014 14:46:46 -0700
Message-Id: <74FE3F75-43D2-4CFC-8B0F-56EF886F4748@gmail.com>
References: 
 <20141024053636.GH11222@dft-labs.eu>
 
 
 <81030948-E60F-4AAD-AAF1-16349607917D@gmail.com>
 <544B46BA.4000008@freebsd.org>
 
 
To: "K. Macy" 
X-Mailer: Apple Mail (2.1878.6)
Cc: "freebsd-testing@freebsd.org" ,
 FreeBSD stable ,
 "freebsd-virtualization@freebsd.org" 
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Sat, 25 Oct 2014 21:46:48 -0000


--Apple-Mail=_B288C26C-0C84-4CCF-A5EC-92AEB18549DC
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain;
	charset=windows-1252

On Oct 25, 2014, at 13:20, K. Macy  wrote:

>>>> Alan also suggested against integrating the test suite as-is, =
because as he said, "Remember, don't run these tests on a production =
system.  They WILL cause panics and deadlocks, and they may cause data =
loss too.=94
>>>>=20
>>>> Cheers,
>>>> -Garrett
>>>=20
>>> Wait, we want to sweep those bugs under the rug?  What exactly is =
wrong with making a test harness that can very easily reproduce a known =
problem?  The chances are that anyone will dive into it once the bug is =
easily reproducible.
>>=20
>>        Sweeping bugs under the rug is not what I plan on doing; I=92m =
marking these as expected failures, as opposed to having them =
continually panic a machine. Once a ZFS dev takes a look at the issue =
and resolves them, then the ZFS dev can remove the =93bail=94 calls I=92m =
adding to the testcases.
>=20
> Yes, disabling tests that fail leads to an ineffectual test suite. A
> test suite that never has any failures is not very useful. However,
> there are two factors to take in to account in this context:
> a) frequent failures can lead users to stop running a test suite
> leading to further regressions
> b) long-term repeated failures can desensitize users leading them to
> ignore *new* failures facilitating further regressions
>=20
> Thus it's really a question of what context you're talking about
> running the test suite in. For purposes of Jenkins we want full
> visibility in to what is passing and what is failing and how long this
> has been going on for.

(seeing as how my other post isn=92t in the -testing archives yet..)
	Panicking a node (what the tests are doing before last night) =
and exiting with a non-zero exit code (what I=92m making them do with =
the bail outs in tools/regression/zfs) are both considered test =
failures. The difference being that I can safely run all of the tests on =
a production or a test machine without having to panic/reboot the box =
and I get greater coverage in one fell swoop. If a developer wants they =
can always delete the lines that bail out of the tests to get the =
desired panic.
Cheers,
-Garrett

--Apple-Mail=_B288C26C-0C84-4CCF-A5EC-92AEB18549DC
Content-Transfer-Encoding: 7bit
Content-Disposition: attachment;
	filename=signature.asc
Content-Type: application/pgp-signature;
	name=signature.asc
Content-Description: Message signed with OpenPGP using GPGMail

-----BEGIN PGP SIGNATURE-----
Comment: GPGTools - https://gpgtools.org

iQEcBAEBCgAGBQJUTBpGAAoJEMZr5QU6S73eroQH/0EUjiiTQEnkaDgG29GxsSP4
pmerYl9PXlSJiN1t0ApDz7HxxWh0qTsV8+5OIdrWOU4gvmK3DEaq+HOMqVboVtS5
WLFy+/bljFhnEbF5b3UqPUyNFNaCKV7Rdr96oLnA9NVJRvEo6aNHF0+rZKyTDeMd
Qb7YDscluRqyqFCugb3rcatFWVHLycQKZdiUSx5Mdc7PnXiJ4nK9nK9nq6gU3lAA
u9F3wKFZLHuzI9Ko2MEUp9jqwoK8kL2wx3Q5YBvyCUUI7OmoIf2GNhhxOZwa4Tga
lfrTGH4gOcRLzjGmOGCOqXLAG3j1JpPetzJywdYjfZIVu+iEp+FmX4vH6WjF8nw=
=a/Nc
-----END PGP SIGNATURE-----

--Apple-Mail=_B288C26C-0C84-4CCF-A5EC-92AEB18549DC--

From owner-freebsd-virtualization@FreeBSD.ORG  Sat Oct 25 21:55:30 2014
Return-Path: 
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 49A4D678;
 Sat, 25 Oct 2014 21:55:30 +0000 (UTC)
Received: from mail-yh0-x231.google.com (mail-yh0-x231.google.com
 [IPv6:2607:f8b0:4002:c01::231])
 (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
 (Client CN "smtp.gmail.com",
 Issuer "Google Internet Authority G2" (verified OK))
 by mx1.freebsd.org (Postfix) with ESMTPS id CC162EB6;
 Sat, 25 Oct 2014 21:55:29 +0000 (UTC)
Received: by mail-yh0-f49.google.com with SMTP id a41so2850484yho.22
 for ; Sat, 25 Oct 2014 14:55:29 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
 h=mime-version:sender:in-reply-to:references:date:message-id:subject
 :from:to:cc:content-type:content-transfer-encoding;
 bh=kKt6BmrW6I+rLbcDwNkEKwLjVTlpuwf/2Jn9S9xWo14=;
 b=gvhr0GrDcrOeHTC5nx8pgldKNvSbME/5jkI0kLJkw+pgl/cRnB0k84cK9wV+q56YbJ
 VG+woGlm/AS5K7No/+0DJPXINLGMUjgDc/4gJ6LaELUcskKepR5yvzetI1yGFu0F4+uO
 3jezqTfumx1vwcoS0N/zhpI4fGNsHoBkXXMXigKHe1ZIb2TPyABVzf2nOlpUmMn5Zckn
 Kj/JRjkXKj182CHGbei9aYR3665sQdve/f4MPMbf5/E2REb+efnTPrGA3+D73rIUZImO
 RIjCnr39Dex8uCuCmWLyxTR3p30aBEmWJ18u4dlGZQXtp9rIrwShqqj2n3RMEP5uf50j
 gvfQ==
MIME-Version: 1.0
X-Received: by 10.236.209.101 with SMTP id r65mr3468882yho.140.1414274129002; 
 Sat, 25 Oct 2014 14:55:29 -0700 (PDT)
Sender: kmacybsd@gmail.com
Received: by 10.170.82.197 with HTTP; Sat, 25 Oct 2014 14:55:28 -0700 (PDT)
In-Reply-To: <74FE3F75-43D2-4CFC-8B0F-56EF886F4748@gmail.com>
References: 
 <20141024053636.GH11222@dft-labs.eu>
 
 
 <81030948-E60F-4AAD-AAF1-16349607917D@gmail.com>
 <544B46BA.4000008@freebsd.org>
 
 
 <74FE3F75-43D2-4CFC-8B0F-56EF886F4748@gmail.com>
Date: Sat, 25 Oct 2014 14:55:28 -0700
X-Google-Sender-Auth: t0VcMeHAoagDRAA2pnmRsZr5KUA
Message-ID: 
Subject: Re: Automatically running /usr/tests on stable/10 branch under Jenkins
From: "K. Macy" 
To: Garrett Cooper 
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
Cc: "freebsd-testing@freebsd.org" ,
 FreeBSD stable ,
 "freebsd-virtualization@freebsd.org" 
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Sat, 25 Oct 2014 21:55:30 -0000

On Sat, Oct 25, 2014 at 2:46 PM, Garrett Cooper  wro=
te:
> On Oct 25, 2014, at 13:20, K. Macy  wrote:
>
>>>>> Alan also suggested against integrating the test suite as-is, because=
 as he said, "Remember, don't run these tests on a production system.  They=
 WILL cause panics and deadlocks, and they may cause data loss too.=E2=80=
=9D
>>>>>
>>>>> Cheers,
>>>>> -Garrett
>>>>
>>>> Wait, we want to sweep those bugs under the rug?  What exactly is wron=
g with making a test harness that can very easily reproduce a known problem=
?  The chances are that anyone will dive into it once the bug is easily rep=
roducible.
>>>
>>>        Sweeping bugs under the rug is not what I plan on doing; I=E2=80=
=99m marking these as expected failures, as opposed to having them continua=
lly panic a machine. Once a ZFS dev takes a look at the issue and resolves =
them, then the ZFS dev can remove the =E2=80=9Cbail=E2=80=9D calls I=E2=80=
=99m adding to the testcases.
>>
>> Yes, disabling tests that fail leads to an ineffectual test suite. A
>> test suite that never has any failures is not very useful. However,
>> there are two factors to take in to account in this context:
>> a) frequent failures can lead users to stop running a test suite
>> leading to further regressions
>> b) long-term repeated failures can desensitize users leading them to
>> ignore *new* failures facilitating further regressions
>>
>> Thus it's really a question of what context you're talking about
>> running the test suite in. For purposes of Jenkins we want full
>> visibility in to what is passing and what is failing and how long this
>> has been going on for.
>
> (seeing as how my other post isn=E2=80=99t in the -testing archives yet..=
)
>         Panicking a node (what the tests are doing before last night) and=
 exiting with a non-zero exit code (what I=E2=80=99m making them do with th=
e bail outs in tools/regression/zfs) are both considered test failures. The=
 difference being that I can safely run all of the tests on a production or=
 a test machine without having to panic/reboot the box and I get greater co=
verage in one fell swoop. If a developer wants they can always delete the l=
ines that bail out of the tests to get the desired panic.

I don't think there is a RIGHT answer. I just ask that it be noisy
about the choice that's being made. In other words, it should be very
explicit that it's running a "safe" subset of the tests because
FreeBSD's ZFS can't actually pass all of them, and that there be a
flag to enable those of us who want to see the failure to see it
without modifying any scripts or config files. A test framework that
requires me to muck with settings to run failing tests isn't living up
to its full potential.


-K

From owner-freebsd-virtualization@FreeBSD.ORG  Sat Oct 25 22:49:08 2014
Return-Path: 
Delivered-To: virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 5461042B
 for ; Sat, 25 Oct 2014 22:49:08 +0000 (UTC)
Received: from smtp.digiware.nl (smtp.digiware.nl [31.223.170.169])
 (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
 (Client did not present a certificate)
 by mx1.freebsd.org (Postfix) with ESMTPS id 15DE160B
 for ; Sat, 25 Oct 2014 22:49:07 +0000 (UTC)
Received: from rack1.digiware.nl (unknown [127.0.0.1])
 by smtp.digiware.nl (Postfix) with ESMTP id 83EE61534C9
 for ; Sun, 26 Oct 2014 00:48:59 +0200 (CEST)
X-Virus-Scanned: amavisd-new at digiware.nl
Received: from smtp.digiware.nl ([127.0.0.1])
 by rack1.digiware.nl (rack1.digiware.nl [127.0.0.1]) (amavisd-new, port 10024)
 with ESMTP id 7g5bOgplObnL; Sun, 26 Oct 2014 00:48:38 +0200 (CEST)
Received: from [192.168.10.9] (vaio [192.168.10.9])
 (using TLSv1 with cipher ECDHE-RSA-AES128-SHA (128/128 bits))
 (No client certificate requested)
 by smtp.digiware.nl (Postfix) with ESMTPSA id 340E51534C7
 for ; Sun, 26 Oct 2014 00:48:38 +0200 (CEST)
Message-ID: <544C28C8.2060108@digiware.nl>
Date: Sun, 26 Oct 2014 00:48:40 +0200
From: Willem Jan Withagen 
User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64;
 rv:24.0) Gecko/20100101 Thunderbird/24.6.0
MIME-Version: 1.0
To: "freebsd-virtualization@freebsd.org" 
Subject: Looking for a Libvirt example xml file
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Sat, 25 Oct 2014 22:49:08 -0000

Hoi

I tried the version on the libvirt.org/bhyve page.
But that returns:

freetest# virsh -c "bhyve:///system"  domxml-to-native \\
	--format bhyve-argv --xml /root/libvirt-example.xml
error: unsupported configuration: unsupported disk device

So I was wondering if somebody would like to share his working example?

Thanx,
--WjW


From owner-freebsd-virtualization@FreeBSD.ORG  Sat Oct 25 22:50:13 2014
Return-Path: 
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 3F3D74B8;
 Sat, 25 Oct 2014 22:50:13 +0000 (UTC)
Received: from mail-vc0-x235.google.com (mail-vc0-x235.google.com
 [IPv6:2607:f8b0:400c:c03::235])
 (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
 (Client CN "smtp.gmail.com",
 Issuer "Google Internet Authority G2" (verified OK))
 by mx1.freebsd.org (Postfix) with ESMTPS id CB02E617;
 Sat, 25 Oct 2014 22:50:12 +0000 (UTC)
Received: by mail-vc0-f181.google.com with SMTP id hy10so45396vcb.26
 for ; Sat, 25 Oct 2014 15:50:11 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
 h=mime-version:in-reply-to:references:date:message-id:subject:from:to
 :cc:content-type;
 bh=yYFHj0B0mHNxLhy4VeEEVyUdCF2Bz6JodqhTuUtJNHw=;
 b=Bqi5S3qXf3horIRuRS1o12iBpv862zLeD6XKreQOcZklftdnipYoSviv7Oz0x04Gmp
 iVpwqPdunNDKYgFKEgsuPwIoVcHyRJLQcVrTrSoz+ZeN91CGdIFrxRleAkM4e7A0OFRv
 iOhcE1M5YBZX12J0W1+kqxXGZLQ/UC1VtLPlKS0wyaNk5tUm+3BZ4LG21KRF8MrP179L
 BTHGpk5+hvJkY4bfLEydLANpRR7oPJsxsV9PoXwIkTwhDNe4C5Hk0Zx8mVwS7RMzK1kp
 HlEHG1MRgC2EA7O7zO1i9zwHGjItkF3DqTYLwOq9e78zGPcwqkNuvQRk2siqOCvFC2IK
 g3WQ==
MIME-Version: 1.0
X-Received: by 10.221.4.73 with SMTP id ob9mr9292812vcb.13.1414277411719; Sat,
 25 Oct 2014 15:50:11 -0700 (PDT)
Received: by 10.220.238.14 with HTTP; Sat, 25 Oct 2014 15:50:11 -0700 (PDT)
In-Reply-To: 
References: <154A442D-7814-4618-9AFC-6F9FB3F5DFD3@gmail.com>
 <5443A89F.8050801@digiware.nl>
 
Date: Sat, 25 Oct 2014 18:50:11 -0400
Message-ID: 
Subject: Re: HEADS UP: Merging projects/bhyve_svm to HEAD
From: Zaphod Beeblebrox 
To: Benjamin Perrault 
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1
Cc: freebsd-current , Neel Natu ,
 "freebsd-virtualization@freebsd.org" 
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Sat, 25 Oct 2014 22:50:13 -0000

I tried to integrate this patch into 10.1_RC3 and I failed.  Is there a
timeframe to MFC this to 10.1 or 10-STABLE?

On Sun, Oct 19, 2014 at 4:04 PM, Benjamin Perrault 
wrote:

> After a few days of extensive testing and abuse, i=E2=80=99ve run into no=
 new
> issues or unknowns what so ever. Everything that worked before still work=
s
> now ( and a few bugs from fixed from HEAD ).
>
> Thus, I have gone ahead and pushed r273182 w/ Neel=E2=80=99s patch out to=
 about 80
> of the assorted AMD boxes in the production and dev pods that I care for.
> If end users see something, I=E2=80=99ll let you know, but I have a feeli=
ng they
> won=E2=80=99t.
>
> Again - Excellent work.
>
> cheers,
> -bp
>
> > On Oct 19, 2014, at 5:03 AM, Willem Jan Withagen 
> wrote:
> >
> > On 16-10-2014 5:00, Anish Gupta wrote:
> >> Hi all,
> >>
> >> The projects/bhyve_svm branch is ready to be merged to HEAD.
> >>
> >> This branch contains patches to bhyve to enable it to work on AMD
> >> processors with SVM/AMD-V hardware extensions[1]. Pretty much any AMD
> >> processor since 2010 will have the features required by bhyve.
> >>
> >> bhyve on AMD supports (almost) all the features available with Intel
> >> [2]. All guest OSes supported on Intel are supported on AMD. All the
> >> bhyve-related utilities function similarly on both Intel and AMD
> >> platforms [3].
> >>
> >> The patch against HEAD revision 273066 is available for review and
> testing:
> >> https://people.freebsd.org/~neel/bhyve/bhyve_svm.diff [Neel=E2=80=99s =
web
> directory]
> >>
> >> [1]: http://en.wikipedia.org/wiki/X86_virtualization
> >> [2]: bhyve doesn't support PCI passthru on AMD at this time
> >> [3]: bhyvectl has grown some processor-specific options
> >
> > Fetched the patch and compiled.
> > Now running: HEAD r273066M and I was able to throw at it all the tests
> > and images that in the past works. And perhaps even better.
> >
> > Great work.
> > --WjW
> >
> >
> > _______________________________________________
> > freebsd-virtualization@freebsd.org mailing list
> > http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization
> > To unsubscribe, send any mail to "
> freebsd-virtualization-unsubscribe@freebsd.org"
>
> _______________________________________________
> freebsd-current@freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-current
> To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org=
"
>

From owner-freebsd-virtualization@FreeBSD.ORG  Sat Oct 25 23:37:19 2014
Return-Path: 
Delivered-To: virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 4B06FC9B
 for ; Sat, 25 Oct 2014 23:37:19 +0000 (UTC)
Received: from mail-vc0-x22d.google.com (mail-vc0-x22d.google.com
 [IPv6:2607:f8b0:400c:c03::22d])
 (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
 (Client CN "smtp.gmail.com",
 Issuer "Google Internet Authority G2" (verified OK))
 by mx1.freebsd.org (Postfix) with ESMTPS id 0B01FA86
 for ; Sat, 25 Oct 2014 23:37:18 +0000 (UTC)
Received: by mail-vc0-f173.google.com with SMTP id ij19so1362975vcb.4
 for ; Sat, 25 Oct 2014 16:37:18 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
 h=mime-version:in-reply-to:references:date:message-id:subject:from:to
 :cc:content-type;
 bh=94KL2vmZCkLP6KS6cBrSFJyzQrEimyZzkN0geuXcl/E=;
 b=jMxZNm9lXQBwTpGKAW2qPVsKHSZklFsouTs5WXFqqv16nVQrGu1rB3/DzJqQ5dJjYv
 l/ZO1miUV/7bETbC959njP/ZL/AZXQhIUNTICkWfTk/fRQnOJup4LF49VrXwcMM63r8I
 72jk0F+P2Js34tbeR5eVFqUn9iAsFNQE6QLjs9OiYv/9+gnulAZFLMwx0IBgyQBQgpTK
 kGNKQH2Fo/wUQj9zgxwDepgsOgdDMJThjh4DdMzvjV2EVRaXZ8Dfbyh7UIbItWX3VBaD
 G4E1S8r5aicX4p716CEnJRnA07Ur5wNxLwOyHI37Ccw3/AFoglCHYXFgbOCT7oo6Razy
 rp6Q==
MIME-Version: 1.0
X-Received: by 10.52.248.76 with SMTP id yk12mr7932591vdc.1.1414280238139;
 Sat, 25 Oct 2014 16:37:18 -0700 (PDT)
Received: by 10.220.150.68 with HTTP; Sat, 25 Oct 2014 16:37:18 -0700 (PDT)
In-Reply-To: <544C28C8.2060108@digiware.nl>
References: <544C28C8.2060108@digiware.nl>
Date: Sat, 25 Oct 2014 19:37:18 -0400
Message-ID: 
Subject: Re: Looking for a Libvirt example xml file
From: Conrad Meyer 
To: Willem Jan Withagen 
Content-Type: text/plain; charset=UTF-8
Cc: "freebsd-virtualization@freebsd.org" 
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 
List-Unsubscribe: , 
 
List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: , 
 
X-List-Received-Date: Sat, 25 Oct 2014 23:37:19 -0000

On Sat, Oct 25, 2014 at 6:48 PM, Willem Jan Withagen  wrote:
> Hoi
>
> I tried the version on the libvirt.org/bhyve page.
> But that returns:
>
> freetest# virsh -c "bhyve:///system"  domxml-to-native \\
>         --format bhyve-argv --xml /root/libvirt-example.xml
> error: unsupported configuration: unsupported disk device
>
> So I was wondering if somebody would like to share his working example?


Hi Willem,

What do your  sections look like? I am using basically the same
configuration from libvirt's bhyve page as well and have no such issue
(however, I am on recent git which is ~1.2.10, versus the 1.2.6 in
ports). Example:

    
      
      
      
    

For what it's worth, If you do not specify a bus, libvirt will choose
'ide' and libvirt-bhyve only supports SATA.

Best,
Conrad