From owner-freebsd-virtualization@FreeBSD.ORG Mon Oct 6 11:10:43 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 8886D462; Mon, 6 Oct 2014 11:10:43 +0000 (UTC) Received: from mail.0x20.net (mail.0x20.net [IPv6:2001:aa8:fffb:1::3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 454F09EC; Mon, 6 Oct 2014 11:10:43 +0000 (UTC) Received: from e-new.0x20.net (mail.0x20.net [IPv6:2001:aa8:fffb:1::3]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.0x20.net (Postfix) with ESMTPS id 0353E6A6002; Mon, 6 Oct 2014 13:10:41 +0200 (CEST) Received: from e-new.0x20.net (localhost [127.0.0.1]) by e-new.0x20.net (8.14.7/8.14.7) with ESMTP id s96BAeNx083680; Mon, 6 Oct 2014 13:10:40 +0200 (CEST) (envelope-from lars@e-new.0x20.net) Received: (from lars@localhost) by e-new.0x20.net (8.14.7/8.14.7/Submit) id s96BAeX5082317; Mon, 6 Oct 2014 13:10:40 +0200 (CEST) (envelope-from lars) Date: Mon, 6 Oct 2014 13:10:40 +0200 From: Lars Engels To: Peter Grehan Subject: Re: [regression] bhyve stopped working Message-ID: <20141006111040.GK20243@e-new.0x20.net> References: <20141003103318.GC20243@e-new.0x20.net> <542EDCAD.2080007@freebsd.org> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="CZI63rpYmK/igF6U" Content-Disposition: inline In-Reply-To: <542EDCAD.2080007@freebsd.org> X-Editor: VIM - Vi IMproved 7.4 X-Operation-System: FreeBSD 8.4-RELEASE-p16 User-Agent: Mutt/1.5.23 (2014-03-12) Cc: freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 06 Oct 2014 11:10:43 -0000 --CZI63rpYmK/igF6U Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Fri, Oct 03, 2014 at 10:28:13AM -0700, Peter Grehan wrote: > HI Lars, >=20 > > I just upgraded to r272468 and bhyve stopped working. When I start a VM > > (Ubuntu or FreeBSD) byhve dumps core: >=20 > Should be fixed in r272481. >=20 Yes, I can confirm that. Thank you! Lars --CZI63rpYmK/igF6U Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iQF8BAEBCgBmBQJUMniwXxSAAAAAAC4AKGlzc3Vlci1mcHJAbm90YXRpb25zLm9w ZW5wZ3AuZmlmdGhob3JzZW1hbi5uZXQ4RjQwMDE3RTRERjUzMTI1N0FGRTUxNDlF NTRDQjM3RDNBMDg5RDZEAAoJEOVMs306CJ1tzOIIAMjI+jrtUV6/tt06hz45o7ty HzpbM0nBtHgBeGNCqC+Ze4lELpNJIxnQZok1fGTj/fPbiUh+Sa7H55QsnjuR1xVw iNRRB/5idoYEfYsSQ6C6a6FxPvRY4WlrRC9+xbjiIhr5St7mnxS1onzCKSRtuPxI WDFrYeuO1uZvJFLFy0ML/wyNJJMQH5Ter9MXOXGqksNX/ZG4t/LuloOD6n/tAOM7 qHikPJcusQv60O3VdcHAnQiswlVv48jY4pUuxZX2DHd8FLrjbr5Uk0a2Ong0/pNk 6sfKN3DwV1T7fsBB022+XUbvYZmJmf0pPu8+QMJQkUG42AUG9cmNcZSpqMzZ/ag= =i2y5 -----END PGP SIGNATURE----- --CZI63rpYmK/igF6U-- From owner-freebsd-virtualization@FreeBSD.ORG Tue Oct 7 14:43:28 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 73EA890F; Tue, 7 Oct 2014 14:43:28 +0000 (UTC) Received: from bsd.zplay.eu (bsd.zplay.eu [62.210.240.224]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "bsd.zplay.eu", Issuer "StartCom Class 1 Primary Intermediate Server CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id BDEE8ACE; Tue, 7 Oct 2014 14:43:27 +0000 (UTC) Received: from localhost (80@localhost [local]); by localhost (OpenSMTPD) with ESMTPA id 669c0160; Tue, 7 Oct 2014 16:36:44 +0200 (CEST) To: freebsd-virtualization@freebsd.org, owner-freebsd-virtualization@freebsd.org Subject: Re: VBox extension pack installation failed X-PHP-Originating-Script: 0:rcube.php MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit Date: Tue, 07 Oct 2014 16:36:44 +0200 From: =?UTF-8?Q?Sol=C3=A8ne_Rapenne?= In-Reply-To: <006f3ec814e6d7d1fc93a09dd4c765e3@zahemszky.hu> References: <006f3ec814e6d7d1fc93a09dd4c765e3@zahemszky.hu> Message-ID: <55687e986fd3b9151c45ceee871c1350@mail.zplay.eu> X-Sender: solene@bsd.zplay.eu User-Agent: Roundcube Webmail/1.0.3 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 07 Oct 2014 14:43:28 -0000 On 2014-10-01 21:07, gabor@zahemszky.hu wrote: > Hi! > > Without the extension pack, I couldn't create USB2.0 interface in my > VM-s. > So I tried to install it. First I found out, that there is an > "installed" > version of it named VNC. After downloading it, I tried to install from > File / Preferences / Extensions / Add package. But it failed with an > error message about /dev/ctty. As I first tried as a normal user, next > I tried it as root. (xhost +local: ; VirtualBox). Now the installation > started, but failed with "Failed to locate the main module > (VBoxPuelMain)" > And after it I have a non-functional "Oracle VM VirtualBox Extension > Pack". > The difference between the original installed version and the failed > version, > is that the original has version the same version number with an _OSE > postfix > in it. > > Here is the full error message: > > === > Failed to install the Extension Pack > /home/zgabor/Oracle_VM_VirtualBox_Extension_Pack-4.3.16-95972.vbox-extpack. > > Failed to locate the main module ('VBoxPuelMain'). > > Result Code: NS_ERROR_FAILURE (0x80004005) > Component: ExtPackManager > Interface: IExtPackManager {3295e6ce-b051-47b2-9514-2c588bfe7554} > > === > > So how can I enable USB 2.0 as it needs the extension pack? > > Thanks, > > Gábor < Gabor at Zahemszky dot HU > > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to > "freebsd-virtualization-unsubscribe@freebsd.org" Hello, As far as I know, extensions pack are not compatible with FreeBSD VBox hosts :( Regards From owner-freebsd-virtualization@FreeBSD.ORG Tue Oct 7 21:15:24 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id B19D354A; Tue, 7 Oct 2014 21:15:24 +0000 (UTC) Received: from mail-lb0-x22c.google.com (mail-lb0-x22c.google.com [IPv6:2a00:1450:4010:c04::22c]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id D70F2FDF; Tue, 7 Oct 2014 21:15:23 +0000 (UTC) Received: by mail-lb0-f172.google.com with SMTP id b6so6919393lbj.17 for ; Tue, 07 Oct 2014 14:15:21 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:date:message-id:subject:from:to:cc:content-type; bh=yLPYxIUc8T0yTfS1DN15d2K2NCccXnWad4iSeUD7ZOU=; b=b22DDiYqeFOt49CYxoPpwCR41q6/xkvkXC+cAlspEH8T3mLShbKQUkhDHbERSnQlJk JYyjbKdh32xwiNPVgmVX+YrNKMX7JAekaiaiPCMT8CvSumipsSobcF5qV1OGAJS9/Wh8 qC9vjMEWBWMTZcqfCgH4+Q48hjUhigkhVb9fs5eypLq1fQSLjy1CqiEL8ojpgSB5fDvk Datw6QnE8zxwdYYn1/D6G5aTE7TZ5/dkSidB7ktWi36zaBlefppB0gfS0DoBYu86lVRm 8wYhOh4gSwd4A0RnJHbg6tXynAP5OHFnRaojRHAkJ1IFJ8VUIjVHMxlBK2Nrx53byBzz pfyw== MIME-Version: 1.0 X-Received: by 10.152.7.145 with SMTP id j17mr6780316laa.67.1412716521802; Tue, 07 Oct 2014 14:15:21 -0700 (PDT) Sender: crodr001@gmail.com Received: by 10.112.131.66 with HTTP; Tue, 7 Oct 2014 14:15:21 -0700 (PDT) Date: Tue, 7 Oct 2014 14:15:21 -0700 X-Google-Sender-Auth: wlQT8VkQiEFHOQFkjir3dXPn1p0 Message-ID: Subject: Automatically running /usr/tests under Jenkins From: Craig Rodrigues To: freebsd-current Current Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 Cc: "freebsd-testing@freebsd.org" , "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 07 Oct 2014 21:15:24 -0000 Hi, I have created this Jenkins job: https://jenkins.freebsd.org/jenkins/job/FreeBSD_HEAD/1577/BuildGraph/ (1) does a buildworld/buildkernel on amd64 when someone checks new code into CURRENT (2) Creates a bootable UFS image with makefs (3) Boots the image under bhyve (4) Runs these commands inside the bhyve VM: cd /usr/tests kyua test kyua report-junit --output=test-output.xml (5) Shuts down the bhyve VM (6) imports test-output.xml into Jenkins. Hopefully we will be able to run this job very frequently, so the tests will be run every time new commits hit the tree. -- Craig From owner-freebsd-virtualization@FreeBSD.ORG Wed Oct 8 02:07:47 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 1FCA2D65; Wed, 8 Oct 2014 02:07:47 +0000 (UTC) Received: from mail-la0-x22a.google.com (mail-la0-x22a.google.com [IPv6:2a00:1450:4010:c03::22a]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 752BB1AA; Wed, 8 Oct 2014 02:07:46 +0000 (UTC) Received: by mail-la0-f42.google.com with SMTP id mk6so7574282lab.15 for ; Tue, 07 Oct 2014 19:07:44 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:date:message-id:subject:from:to:cc:content-type; bh=Lko5rSmSYDez2RMGr7sNSWRyhbV6ddsS+EgzI9vmJiQ=; b=N2VDQznvFnT6tKJPKnVTe7U10wsb4ddqhUYAZGlf8woUfyYeJjTSjpwB93t/IpSrxI j1DfMm1YtkomerU1lMH7QaGRAQE/9qHu5YB6hdXUaWZar0yYtPoVncLq9lYcAAMbSSTW M+5gTYl6nGvgTXPcolyoGa2YUi758o46Mm9BLpnBICIjGdG+4qasgHOhyYwrdG9qV8Gg vwwqXKKjnFXyywfTS7Rp2ZNsq6/biUzM36VidvUOYBDWD7noIJlSgLmxJnLsOHOPiyu4 ATrruT+wM2yv9ANyVncLb9jNa5bZCBpfLCxv9ov7XCOCIc/evU/SkB9Qt1BpKVUIZfVK uxzA== MIME-Version: 1.0 X-Received: by 10.112.54.130 with SMTP id j2mr7444142lbp.41.1412734064395; Tue, 07 Oct 2014 19:07:44 -0700 (PDT) Sender: crodr001@gmail.com Received: by 10.112.131.66 with HTTP; Tue, 7 Oct 2014 19:07:44 -0700 (PDT) Date: Tue, 7 Oct 2014 19:07:44 -0700 X-Google-Sender-Auth: yftMPJfJBvlUgm1XeSuxBz0ROSc Message-ID: Subject: libvirt improvements for bhyve From: Craig Rodrigues To: Roman Bogorodskiy Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 08 Oct 2014 02:07:47 -0000 Roman, I am using bhyve a lot these days, but I find that I need to write scripts on top of bhyveload / bhyve in order to work with VM's. I would rather use libvirt, because there are many 3rd party programs to work with VM's that are written for libvirt (especially for KVM). How hard would it be to implement the following: (1) The last time I tried libvirt 1.2.7, it did not seem to properly keep track if a VM was powered on or shutdown. If I started a VM with libvirt, then did "shutdown -r now", I couldn't seem to restart the VM, unless I destroyed the VM in libvirt, and restarted. This is very inconvenient. If you see the latest version of vmrun.sh ( https://svnweb.freebsd.org/base/head/share/examples/bhyve/vmrun.sh?view=markup ) you will see that I added some comments to tell when the VM has been reset, powered off, etc. by looking at the exit status of bhyve. Can we add this logic to libvirt, so that it can properly tell if a VM is up or not? (2) "bhyveload -e" allows specifying environment variables to loader. Can we have a way to specify loader environment variables, in the libvirt XML config? (3) "grub-bhyve" is needed to boot VM's for Linux. Can we specify an option to choose between "bhyveload" and "grub-bhyve"? (4) bhyve has many options for specifying which PCI slots to use, and also PCI passthru ( https://wiki.freebsd.org/bhyve/pci_passthru ) Can this be specified in libvirt? For me, without (1), libvirt is mostly unusable for bhyve. (2) - (4) would be nice to have. However, if we could fix libvirt with these things, then a lot of things I do now in scripts, I could do in libvirt. I would much rather use libvirt, because then I could take advantage of a lot of libvirt software targeted towards KVM. Thanks. -- Craig From owner-freebsd-virtualization@FreeBSD.ORG Sat Oct 11 17:58:17 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 036FE6F5; Sat, 11 Oct 2014 17:58:17 +0000 (UTC) Received: from mail-la0-x236.google.com (mail-la0-x236.google.com [IPv6:2a00:1450:4010:c03::236]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 2AC8E338; Sat, 11 Oct 2014 17:58:15 +0000 (UTC) Received: by mail-la0-f54.google.com with SMTP id gm9so4906221lab.27 for ; Sat, 11 Oct 2014 10:58:14 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:date:message-id:subject:from:to:content-type; bh=k4aPXNhC9puvxX745aPjHytM9M3nuMibMpdbM6ns3Vo=; b=LKTAA4rcQL2O+pM+bR9ZtrwKQDzikqkT7dJuDyLqgkebiSm5xFl4MugHUwLQ9+lhqM PneTb06I32/F7No1of28HDkUAtg8s/CxVbtD7xVBI31PGeDZpZGsNdj8xABIYBez2cjK yK/SyJvLhii/nl4hswz4/TkvzKw28hGiE3hjq/PXR9So+dwdMhYdSlcpTqJUSBPlbU/S OLG6uJRUEAAVivMomxkvmYPDKYH3xXCcgljyDpHeH2Tb7DrLzJYCUpnOeRjk+FBydVUy UzxC5I6uV6tsZU5ImuygB8vjarOcKzW35bjBBDkVbQlsD/w1CuwtovjP75Cd/5gdAEdR n18w== MIME-Version: 1.0 X-Received: by 10.152.3.167 with SMTP id d7mr12815188lad.17.1413050293953; Sat, 11 Oct 2014 10:58:13 -0700 (PDT) Sender: crodr001@gmail.com Received: by 10.112.131.66 with HTTP; Sat, 11 Oct 2014 10:58:13 -0700 (PDT) Date: Sat, 11 Oct 2014 10:58:13 -0700 X-Google-Sender-Auth: maglq4jH-2LPOPBwiqzx-dileUY Message-ID: Subject: Enabling VIMAGE by default for FreeBSD 11? From: Craig Rodrigues To: freebsd-net@freebsd.org, "freebsd-virtualization@freebsd.org" , freebsd-arch Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 11 Oct 2014 17:58:17 -0000 Hi, What action items are left to enable VIMAGE by default for FreeBSD 11? Not everyone uses bhyve, so VIMAGE is quite useful when using jails. -- Craig From owner-freebsd-virtualization@FreeBSD.ORG Sat Oct 11 18:08:32 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 5C99BC1E; Sat, 11 Oct 2014 18:08:32 +0000 (UTC) Received: from mail-la0-x231.google.com (mail-la0-x231.google.com [IPv6:2a00:1450:4010:c03::231]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id AA90D627; Sat, 11 Oct 2014 18:08:31 +0000 (UTC) Received: by mail-la0-f49.google.com with SMTP id q1so4917586lam.36 for ; Sat, 11 Oct 2014 11:08:29 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=sender:date:from:to:cc:subject:message-id:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; bh=HeCXr8vahdSoGgMNXXEDCUe7Wqeg5vqThb0hWk0zIuY=; b=EKd/oo9F5WJvRrs9g/1n4vnQv/DoiQMGNCOGQrsCV6vf8fE3l8ZIiEhxMmS/b7KAVX MtxLzRdkcaup0ZNIsnMGbabQuxWJ5XpzhIqQo4G2Ar0NyLkVR8T1qbQUO28fwTzm23y8 1UpRA+SqMB6ldMuj8pQzsuMhnI5gB1luPDf3Z+opeGB4HUxqb28ogRfIUBcHO2y0v/Zw r/0OEWIsZEhpiNnXsHzw/s5WOvaqAj6D9Rh3s98DeKchUwqigPFsxojTz6LI3MflI+PI 1fyPTCAgSlbFQ9KB5xu22cO5irNmQIT58yI0kh6O+FKG0bU7G/D/du1AZEmP2JfnXfHb 3DAw== X-Received: by 10.152.18.130 with SMTP id w2mr13240443lad.64.1413050909424; Sat, 11 Oct 2014 11:08:29 -0700 (PDT) Received: from kloomba ([95.104.130.152]) by mx.google.com with ESMTPSA id l1sm1476448lag.42.2014.10.11.11.08.28 for (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Sat, 11 Oct 2014 11:08:28 -0700 (PDT) Sender: Roman Bogorodskiy Date: Sat, 11 Oct 2014 22:05:29 +0400 From: Roman Bogorodskiy To: Craig Rodrigues Subject: Re: libvirt improvements for bhyve Message-ID: <20141011180528.GA26301@kloomba> References: MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="envbJBWh7q8WU6mo" Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.23 (2014-03-12) Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 11 Oct 2014 18:08:32 -0000 --envbJBWh7q8WU6mo Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Craig Rodrigues wrote: > Roman, >=20 > I am using bhyve a lot these days, but > I find that I need to write scripts on top of > bhyveload / bhyve in order to work with VM's. >=20 > I would rather use libvirt, because there are many 3rd party > programs to work with VM's that are written for libvirt (especially for > KVM). >=20 > How hard would it be to implement the following: >=20 > (1) The last time I tried libvirt 1.2.7, it did not seem to properly keep > track > if a VM was powered on or shutdown. If I started a VM with libvir= t, > then did "shutdown -r now", I couldn't seem to restart the VM, unle= ss > I destroyed the VM in libvirt, and restarted. > This is very inconvenient. >=20 > If you see the latest version of vmrun.sh ( > https://svnweb.freebsd.org/base/head/share/examples/bhyve/vmrun.sh?view= =3Dmarkup > ) > you will see that I added some comments to tell when the VM has > been reset, powered off, etc. by looking at the exit status of bhyv= e. >=20 > Can we add this logic to libvirt, so that it can properly tell if > a VM is up or not? Frankly speaking, it's a hard topic for me and currently I don't have a complete idea how to design that. The thing I'm worried about is that as far as I understand that exit codes are sort of temporary solution and will be dropped in the future. Also, it seems the behaviour is changing already, e.g. IIRC on -CURRENT the bhyve proccess doesn't exit on reboots (unlike in 10-R). My goal is to support 10-R and I'm not sure how to probe if exit codes are available or not (and how to probe if e.g. if new exit code will be added in some future version). On the other hand, I think I need to check cases when bhyve process vanishes away and probably set VM status to something like 'shutdown / error' or something like that. Also, I think I need to support 'bhyvectl --force-reset' if that's available. I guess that should be safe for all versions of bhyve and I'll add it to my todo list. > (2) "bhyveload -e" allows specifying environment variables to loader. > Can we have a way to specify loader environment variables, > in the libvirt XML config? >=20 > (3) "grub-bhyve" is needed to boot VM's for Linux. > Can we specify an option to choose between "bhyveload" and > "grub-bhyve"? For 2-3 I think bootloader should be honored from the XML file: http://libvirt.org/formatdomain.html#elementsOSBootloader I'll add it to my todo list as well. > (4) bhyve has many options for specifying which PCI slots to use, > and also PCI passthru ( https://wiki.freebsd.org/bhyve/pci_passthru= ) > Can this be specified in libvirt? Currently you can specify PCI slot and function by using 'address' tag in the device element (e.g. disk or interface), for example:
PCI passthrough is not supported as I've never looked at that, will need to take a look. >=20 > For me, without (1), libvirt is mostly unusable for bhyve. (2) - (4) wou= ld > be > nice to have. However, if we could fix libvirt with these things, > then a lot of things I do now in scripts, I could do in libvirt. > I would much rather use libvirt, because then I could take advantage of > a lot of libvirt software targeted towards KVM. >=20 > Thanks. > -- > Craig Roman Bogorodskiy --envbJBWh7q8WU6mo Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.13 (FreeBSD) iQEcBAEBAgAGBQJUOXFoAAoJEMltX/4IwiJqRPwIAI1/NW7Hu6g8gd0vpGa6ojTo n6HDslR0fj2WsqsxGmVghTL71trn1MFpyfrn9YoVpYN5Umjj8TXmaBO0BOcUEE4C C++Dh7pe1xSZ+JAc47WC/1UfSCYta8Isuz9fpBlYGsyBVFtni7U0l1EyU5kOUUgT 6TMO7G4kOr1slMbRWtwHE0qn+yq6Ov+OMq5fHF5MNVV4sj9A+gzxIjZRkYncQky1 TBhdzsI4MQgnUXuuPV/CKT+ofVMPzwgAN6GXfUzRjMft+blDHuyyWIkejDhnSwpi 5M5dToNWeNypOKkps3FrEkjGNSzqiu76iVezy/NYVqEPd4C2+JzGnzHIE/P9KAc= =PgDv -----END PGP SIGNATURE----- --envbJBWh7q8WU6mo-- From owner-freebsd-virtualization@FreeBSD.ORG Sat Oct 11 18:25:33 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 0553CF3B for ; Sat, 11 Oct 2014 18:25:33 +0000 (UTC) Received: from mail-lb0-x235.google.com (mail-lb0-x235.google.com [IPv6:2a00:1450:4010:c04::235]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 7E6BD82D for ; Sat, 11 Oct 2014 18:25:32 +0000 (UTC) Received: by mail-lb0-f181.google.com with SMTP id l4so4718343lbv.12 for ; Sat, 11 Oct 2014 11:25:30 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=sender:date:from:to:cc:subject:message-id:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; bh=Mt+VccuU03nh2yN2V+hUMwg5XZ6CoDrzCx1e/3TGHBM=; b=tupOI5Th+P12RzrfDkZa45wrWcDYOyzIzzno5/qQ0xQY86YiOXCrQxS2iK3nmVPiRv jF4JIqqTOSryptOP/Byk2WO9AKMRx/YgOSqfkf83/SCHUn+UDmGM0ZOvIt4b443+MLcU ruw/LoL1OCbVPk+Ikb6F4W0SbzXvYHTUCzoBMryveSshHNkS3b0vHAxKqs3wbU0ZSIZ5 M1SIlTvKy5SvCmHiCI3uf+04Uc6ESw61HoQnXY/YsbSLKgqqw+uj7/1gib/V7o3Zkz7U DZ8ml8w8yMZyPbN7xgL6PKE1O4ch5mZVGJ3ckPAn6w+al2oDKp8wocbek6ow+bzTmlUH S80w== X-Received: by 10.152.88.43 with SMTP id bd11mr13157787lab.62.1413051930426; Sat, 11 Oct 2014 11:25:30 -0700 (PDT) Received: from kloomba ([95.104.130.152]) by mx.google.com with ESMTPSA id am8sm2918027lac.46.2014.10.11.11.25.29 for (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Sat, 11 Oct 2014 11:25:30 -0700 (PDT) Sender: Roman Bogorodskiy Date: Sat, 11 Oct 2014 22:22:32 +0400 From: Roman Bogorodskiy To: Denis Menshikov Subject: Re: Perl, libvirt and bhyve Message-ID: <20141011182232.GB26301@kloomba> References: <1412183498.692614263@f25.i.mail.ru> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="UHN/qo2QbUvPLonB" Content-Disposition: inline In-Reply-To: <1412183498.692614263@f25.i.mail.ru> User-Agent: Mutt/1.5.23 (2014-03-12) Cc: freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 11 Oct 2014 18:25:33 -0000 --UHN/qo2QbUvPLonB Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Denis Menshikov wrote: > Good day! > As far as I know, libvirt does not provide API for Perl. Can I use this Perl module for managing bhyve virtual machines https://metacpan.org/pod/Sys::Virt? I think Yes, but I want to clarify. > Thank you! Hi, You are right, that's the official binding for libvirt as mentioned on http://libvirt.org/bindings.html. Most probably it works fine with bhyve as well. Roman Bogorodskiy --UHN/qo2QbUvPLonB Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.13 (FreeBSD) iQEcBAEBAgAGBQJUOXVnAAoJEMltX/4IwiJqRacH/1JtXQdO8EAPjaXAH+4Cy9ry KvXIvYcByz9XemW8S/tRwNcTEvTZfjpLtBgbkf5hBcNG0C/T1OAl+u1DlSZoc3pO Q6fmaf3q/kCxRvkwS5AaGdaO0F65rHQ0scIDvadfHvIHmo/Ne7XGXyQs6JR3ux3y TrA/KuTo77Pa64A1Ie4XETxCjJ9bOuo4mfTEBYC+07mwghu2cRdLkhBUgoAJDvsR qgnxqPiQcfs0ZnzVLFh6via9r513VurvMLOga8S3xgltcY9bXLbt/uF2lvCDOJpr 94ITcK22P6k0IUJfR4KJaq8F0RKzM3RNlFeTA+0+mdk7gi99/H4kB5DfeVw4Vks= =8m8G -----END PGP SIGNATURE----- --UHN/qo2QbUvPLonB-- From owner-freebsd-virtualization@FreeBSD.ORG Sat Oct 11 20:03:05 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 78808852; Sat, 11 Oct 2014 20:03:05 +0000 (UTC) Received: from mail-la0-x22a.google.com (mail-la0-x22a.google.com [IPv6:2a00:1450:4010:c03::22a]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 6F522174; Sat, 11 Oct 2014 20:03:04 +0000 (UTC) Received: by mail-la0-f42.google.com with SMTP id mk6so4998869lab.1 for ; Sat, 11 Oct 2014 13:03:02 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type; bh=azA3JnMLaJlVrC5QN3acIq1Y6b/0M/2KzQqbGNb7LDk=; b=XGHk0b0G/UZLevK0pA8l0vak9OH/NyLQmyvaWM4H0Q31Of/bhl7klT7bPBnA9qrNGy knTBRfs87I6v8W6SaHWqY0pYugj+vCaejUpjhBJ/uzXIOxqiEHHeOOkccQlsZlESaMYj k2xMEefW9oZdOrXmnrV3LwiT4Q40iv3Rw6JKkcCsIXEjubo4AOfqfFNC52/T29Iws93i ZS8FyQH3tg3lgVzrCBITI6K3MBr2qe2oea490k4xuLhSPSCiNHnp80OKeNlxj8EcbYnR 2zVTXglNp6wJMz1RYK3DTjkAJ/Z9a7gd3ln3/hHDQtwnlUmHg2kVamb5n8T7Q7mLjMXy FLGw== MIME-Version: 1.0 X-Received: by 10.152.26.200 with SMTP id n8mr13238717lag.57.1413057782246; Sat, 11 Oct 2014 13:03:02 -0700 (PDT) Sender: crodr001@gmail.com Received: by 10.112.131.66 with HTTP; Sat, 11 Oct 2014 13:03:02 -0700 (PDT) In-Reply-To: <20141011180528.GA26301@kloomba> References: <20141011180528.GA26301@kloomba> Date: Sat, 11 Oct 2014 13:03:02 -0700 X-Google-Sender-Auth: zh-hWy6W6c5USc9Ow9lRYE4IXFQ Message-ID: Subject: Re: libvirt improvements for bhyve From: Craig Rodrigues To: Roman Bogorodskiy , Neel Natu , Peter Grehan Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 11 Oct 2014 20:03:05 -0000 On Sat, Oct 11, 2014 at 11:05 AM, Roman Bogorodskiy wrote: > > Frankly speaking, it's a hard topic for me and currently I don't have a > complete idea how to design that. The thing I'm worried about is that as > far as I understand that exit codes are sort of temporary solution and > will be dropped in the future. Also, it seems the behaviour is changing > already, e.g. IIRC on -CURRENT the bhyve proccess doesn't exit on > reboots (unlike in 10-R). My goal is to support 10-R and I'm not sure > how to probe if exit codes are available or not (and how to probe if > e.g. if new exit code will be added in some future version). > Any reason why you are stuck on 10-R? Unlike other parts of FreeBSD, bhyve is not mature, and is evolving over time. Serious users of bhyve are following CURRENT or 10-STABLE. 10-STABLE has the same error status codes as CURRENT, and 10.1-R is coming out in a few weeks. libvirt for bhyve is even less mature than bhyve itself, so tracking bhyve beyond the release should be OK, but it's up to you. In its current form, my experience has been that bhyve and libvirt are unusable for serious work, based on the issues which I've described before for starting/stopping VM's. bhyve + custom scripting is the only way to go. I tried to use libvirt + bhyve for jenkins.freebsd.org, but found it unusable, even though Jenkins has libvirt support for starting VM's on demand. I backed away from libvirt, and ended up writing my own scripts. I am trying to convince some people to go with libvirt + bhyve for a simulation/testing system, but am having a hard time because of all the rough edges, and Linux + KVM + libvirt looks a lot more mature and easier to use. It's too bad, because I think if you can incorporate a few minor enhancements to libvirt for bhyve, it can definitely be a replacement for Linux + KVM + libvirt Neel, Peter, can you comment on the status exit codes from bhyve? Are those temporary, or will you keep them? There is no other way for external scripts to detect reset/poweroff. It looks like the confusion over this issue is blocking Roman from moving forward with libvirt. Thanks. -- Craig From owner-freebsd-virtualization@FreeBSD.ORG Sat Oct 11 20:20:34 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 9AEDC9A; Sat, 11 Oct 2014 20:20:34 +0000 (UTC) Received: from mail.ipfw.ru (mail.ipfw.ru [IPv6:2a01:4f8:120:6141::2]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 5CF6A2BA; Sat, 11 Oct 2014 20:20:34 +0000 (UTC) Received: from secured.by.ipfw.ru ([95.143.220.47] helo=[10.0.0.120]) by mail.ipfw.ru with esmtpsa (TLSv1:AES128-SHA:128) (Exim 4.82 (FreeBSD)) (envelope-from ) id 1Xcz9s-000CZl-CW; Sat, 11 Oct 2014 20:04:40 +0400 Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 7.3 \(1878.6\)) Subject: Re: Enabling VIMAGE by default for FreeBSD 11? From: "Alexander V. Chernikov" In-Reply-To: Date: Sun, 12 Oct 2014 00:20:30 +0400 Content-Transfer-Encoding: quoted-printable Message-Id: References: To: Craig Rodrigues X-Mailer: Apple Mail (2.1878.6) Cc: freebsd-net@freebsd.org, "freebsd-virtualization@freebsd.org" , freebsd-arch X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 11 Oct 2014 20:20:34 -0000 On 11 Oct 2014, at 21:58, Craig Rodrigues wrote: > Hi, >=20 > What action items are left to enable VIMAGE by default for FreeBSD 11? Are there any tests results showing performance implications on = different network-related workloads? >=20 > Not everyone uses bhyve, so VIMAGE is quite useful when using jails. >=20 > -- > Craig > _______________________________________________ > freebsd-net@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" >=20