From owner-freebsd-virtualization@freebsd.org Sun Nov 1 21:00:40 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DB48EA23F5C for ; Sun, 1 Nov 2015 21:00:40 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id B58C91F2B for ; Sun, 1 Nov 2015 21:00:40 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id tA1L0eLF076310 for ; Sun, 1 Nov 2015 21:00:40 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <201511012100.tA1L0eLF076310@kenobi.freebsd.org> From: bugzilla-noreply@FreeBSD.org To: freebsd-virtualization@FreeBSD.org Subject: Problem reports for freebsd-virtualization@FreeBSD.org that need special attention X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 Date: Sun, 01 Nov 2015 21:00:40 +0000 Content-Type: text/plain; charset="UTF-8" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 01 Nov 2015 21:00:40 -0000 To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- In Progress | 202321 | [bhyve,patch] More verbose error reporting in bhy New | 202322 | [bhyve,patch] add option to have bhyve write its 2 problems total for which you should take action. From owner-freebsd-virtualization@freebsd.org Sun Nov 1 21:22:11 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 60CB6A244F0 for ; Sun, 1 Nov 2015 21:22:11 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: from phabric-backend.isc.freebsd.org (phabric-backend.isc.freebsd.org [IPv6:2001:4f8:3:ffe0:406a:0:50:2]) by mx1.freebsd.org (Postfix) with ESMTP id 461E81CFB for ; Sun, 1 Nov 2015 21:22:11 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: by phabric-backend.isc.freebsd.org (Postfix, from userid 1346) id 43FD83320E63; Sun, 1 Nov 2015 21:22:11 +0000 (UTC) Date: Sun, 1 Nov 2015 21:22:11 +0000 To: freebsd-virtualization@freebsd.org From: "mmoll (Michael Moll)" Reply-to: D1944+333+b09c6235d993877b@reviews.freebsd.org Subject: [Differential] [Commented On] D1944: PF and VIMAGE fixes Message-ID: <8fbc4690eb7ec435c9c7bf54002556e4@localhost.localdomain> X-Priority: 3 X-Phabricator-Sent-This-Message: Yes X-Mail-Transport-Agent: MetaMTA X-Auto-Response-Suppress: All X-Phabricator-Mail-Tags: , Thread-Topic: D1944: PF and VIMAGE fixes X-Herald-Rules: none X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: Precedence: bulk In-Reply-To: References: Thread-Index: NDc2NzM0MzY4OTdiYThiNTU1MjY2ZDZmMTJiIFY2goM= MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Content-Type: text/plain; charset="utf-8" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 01 Nov 2015 21:22:11 -0000 mmoll added a subscriber: mmoll. mmoll added a comment. what's the status here? REVISION DETAIL https://reviews.freebsd.org/D1944 EMAIL PREFERENCES https://reviews.freebsd.org/settings/panel/emailpreferences/ To: nvass-gmx.com, bz, trociny, kristof, gnn, zec, rodrigc, glebius, eri Cc: mmoll, javier_ovi_yahoo.com, farrokhi, julian, robak, freebsd-virtualization-list, freebsd-pf-list, freebsd-net-list From owner-freebsd-virtualization@freebsd.org Mon Nov 2 08:41:18 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D823DA23AB7 for ; Mon, 2 Nov 2015 08:41:18 +0000 (UTC) (envelope-from doublef.mobile@gmail.com) Received: from mail-wi0-x236.google.com (mail-wi0-x236.google.com [IPv6:2a00:1450:400c:c05::236]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 7257719C3 for ; Mon, 2 Nov 2015 08:41:18 +0000 (UTC) (envelope-from doublef.mobile@gmail.com) Received: by wicfx6 with SMTP id fx6so44745529wic.1 for ; Mon, 02 Nov 2015 00:41:17 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-type; bh=U6QQ3oe1qukpNObs1BYS8MYQubhfxxSCrcfeCKC+2lo=; b=rdKrwfxTceC2Lo3nUYeyhHEff/YbG9u+sZJlOg8YZS7/NXzBoaq96NxV4/OxyqyCOd xyBI4+7+AbV3bsPn+tjv3zYLZMizHS7JOKrrUU3KfOAm29TzkiFEX+5imGsNO3d/5VPW nWdrkgk/etbZ6a5pEJwu8xyY9i8vRQIwlwwew8twpxS0VN+/5+KpPZHQN6Iq+YlB3tfd bMWgFzEL6+1lC9Sy22RrlsvHIcP5ovYFGrNAZBNaA9Ys8V3BN3J+Iayu3gDgABEoTIGX zuVcByU6BkIg8C/IR+FNdb4C+kGZp3+TZZnPJ8w96LEQ53//0jvNPQIgxlyuRCc1AJRF RZvQ== X-Received: by 10.194.20.135 with SMTP id n7mr21291699wje.95.1446453677003; Mon, 02 Nov 2015 00:41:17 -0800 (PST) MIME-Version: 1.0 Received: by 10.28.178.3 with HTTP; Mon, 2 Nov 2015 00:40:57 -0800 (PST) In-Reply-To: References: <20151027145033.GA24588@dft-labs.eu> From: Sergey Zakharchenko Date: Mon, 2 Nov 2015 11:40:57 +0300 Message-ID: Subject: Re: Docker: jail: name cannot be numeric fix To: Mateusz Guzik Cc: freebsd-virtualization@freebsd.org Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 02 Nov 2015 08:41:18 -0000 2015-10-27 19:12 GMT+03:00 Sergey Zakharchenko : > Mateusz, > >> What's the significance of said names? > > None that I know of; I'm new to Docker so I might be wrong though. > >> The issue here is that said id may contain to letters, effectivley >> looking like a number > > ..the probability of that being (10/16)^12, which isn't too high but still > significant... A funny thing: Docker source (function GenerateRandomID in pkg/stringid/stringid.go) actually checks for a fully numeric ID and avoids it, because it causes other problems: // if we try to parse the truncated for as an int and we don't have // an error then the value is all numberic and causes issues when // used as a hostname. ref #3869 So the probability I mentioned is if fact zero and, ironically, fixing this small kernel bug could actually 'unbreak' Docker. Adjusting GenerateRandomID in the FreeBSD Docker port is another option, possibly faster to get into production. Best regards, -- DoubleF From owner-freebsd-virtualization@freebsd.org Mon Nov 2 17:14:03 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E1D36A24E2F for ; Mon, 2 Nov 2015 17:14:03 +0000 (UTC) (envelope-from bogorodskiy@gmail.com) Received: from mail-lb0-x236.google.com (mail-lb0-x236.google.com [IPv6:2a00:1450:4010:c04::236]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 66F741B63 for ; Mon, 2 Nov 2015 17:14:03 +0000 (UTC) (envelope-from bogorodskiy@gmail.com) Received: by lbbec13 with SMTP id ec13so93632515lbb.0 for ; Mon, 02 Nov 2015 09:14:01 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=sender:date:from:to:subject:message-id:mime-version:content-type :content-disposition:user-agent; bh=AXIBD9uvDO3ss7FuEUq4c5qGVllhOdz0XHj2D5rxd4M=; b=BYvlX8do7NLm3UMJX+Wuvzd71xOVY3obJ07LjLgyj6PxLf1UcyfzZcfpguSMGiAbO/ uGYu/gr0dVbcpTZsfvMKZYeEWV3jxBle2dpoI97e14VwMwySFWQ+ZtKTKFe/1Ne8pokE eQCImpZ9q5dktWVdhWZl+0QjYf/DK4V+RXxtMJyz5+zQQG6iTCBFWta+yHjKTeZvsyoG Dv3W5dYXvl+GH6JgJjyDDtmNzYw7mZihB3WCgY+1Z5BHjlwEwJPJe4/3udIqEleSAT5B Zp0zGFkEIt2EVrrC8TfWjOQIZQle/Yi6fWxDqDUOBEMGkBUWBOfbRJsnmDq46cCfbDs6 mT3w== X-Received: by 10.112.167.3 with SMTP id zk3mr10671697lbb.103.1446484441574; Mon, 02 Nov 2015 09:14:01 -0800 (PST) Received: from kloomba.lvv.mirantis.net ([217.65.211.58]) by smtp.gmail.com with ESMTPSA id dz9sm4067980lbc.40.2015.11.02.09.14.00 for (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Mon, 02 Nov 2015 09:14:01 -0800 (PST) Sender: Roman Bogorodskiy Date: Mon, 2 Nov 2015 20:13:58 +0300 From: Roman Bogorodskiy To: freebsd-virtualization@freebsd.org Subject: bhyve -l bootrom problem Message-ID: <20151102171356.GB18899@kloomba.lvv.mirantis.net> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="mojUlQ0s9EVzWg2t" Content-Disposition: inline User-Agent: Mutt/1.5.24 (2015-08-30) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 02 Nov 2015 17:14:04 -0000 --mojUlQ0s9EVzWg2t Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Hi, I'm facing a strange problem with -l bootrom. I try to boot a VM this way: sudo /usr/sbin/bhyve -l bootrom,/home/novel/uefi/BHYVE_UEFI_20151002.fd -c 2 -m 214 -A -I -u -H -P -s 0:0,hostbridge -s 2:0,virtio-net,tap0,mac=52:54:00:56:9a:77 -s 3:0,ahci-hd,/home/novel/FreeBSD-11.0-CURRENT-amd64.raw -s 1,lpc -l com1,/dev/nmdm0A testvm BHYVE_UEFI_20151002.fd is downloaded from [1]. FreeBSD-11.0-CURRENT-amd64.raw is downloaded from [2]. VMs fail to boot with 'Boot Failed. EFI Hard Drive' and brings into UEFI shell. Changing ahci-hd to virtio-blk changes error message to: 'Boot Failed. EFI Misc Device'. Dropping 'hostbridge' and 'virtio-net' doesn't seem to change anything. Also, before trying FreeBSD-11.0-CURRENT-amd64.raw I tried my old images I used with bhyveload and they fail in the same way, though they're still booting using bhyveload. I'm running -CURRENT updated last weekend on Intel i5-2310. What could be wrong with this? 1: http://people.freebsd.org/~grehan/bhyve_uefi/BHYVE_UEFI_20151002.fd 2: http://ftp.freebsd.org/pub/FreeBSD/snapshots/VM-IMAGES/11.0-CURRENT/amd64/Latest/FreeBSD-11.0-CURRENT-amd64.raw.xz Roman Bogorodskiy --mojUlQ0s9EVzWg2t Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEcBAEBAgAGBQJWN5nUAAoJEMltX/4IwiJqYXwIALsZTrafuV/IFiqAqeUrQqWP DbrhgjMYow+Qsb4tpddIWp+wGAkFJbt4Hr5HGNXil4ioxAC8Z9SDqf7h2zBMyk5y SYAukf4fHdpAXcrp1WzvO7zyAT8j8IAL4xn510k52EIoNND2kPkPknjsXXxkZehK pqeyNQyHjWWeEWm7pBIlxmsyeYz2SHIaNuMlarPUADoPcRqchxs2xkPdrEi+UJBu kuZWVMIHmHaHQq6/sdUGLBDDUTDQ8JkzntBf2+28WJnf/BeLaRcXLf+DNQZqpWQZ fv+icd7gcVjqZg5FWWt5ucZxlz/M45R3gSQJBYHvXvYGkIinFDwJYSWGEHc5PyQ= =aoIS -----END PGP SIGNATURE----- --mojUlQ0s9EVzWg2t-- From owner-freebsd-virtualization@freebsd.org Mon Nov 2 17:27:45 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9F296A24105 for ; Mon, 2 Nov 2015 17:27:45 +0000 (UTC) (envelope-from trentnthompson@gmail.com) Received: from mail-lb0-x243.google.com (mail-lb0-x243.google.com [IPv6:2a00:1450:4010:c04::243]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 3BD75110E; Mon, 2 Nov 2015 17:27:45 +0000 (UTC) (envelope-from trentnthompson@gmail.com) Received: by lbvc6 with SMTP id c6so8790567lbv.2; Mon, 02 Nov 2015 09:27:43 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=pPd46h0mPLptBjQOUFpQRzSUQ8QidPUIOeGiG9KA1sE=; b=XG0hFmPwXykMvEDmQChfFtO1dalW8wMoIgI0PW4JdPrVNE5CTs6W3ZAH66QuJw+PWn NN2ekCEVHpDxHOoM3WSE4W9hoIhprf937YKXMnbDTpAuNMW7sxbBMbwKI8A6VUvo29K/ rD1cy8DwSHvwAK3Mtl6yRmU5TxoRFDBsJAh3k1WOWtOPAofnJaMyUbydp2WcI/L9SDHy +4wSpu3aUHo295Owqb+GCUrtNa8M3wZXN52reB/YjQsRUhUrEhUdNriYfrqwJH/ga1WH rGGHu74Wpvw3fNycQjHiTAeFuajtefZXySTMjFjvPJsEJghktI+/4veAk2AkaQPV2Oim o82g== MIME-Version: 1.0 X-Received: by 10.112.87.69 with SMTP id v5mr10705489lbz.70.1446485263230; Mon, 02 Nov 2015 09:27:43 -0800 (PST) Received: by 10.25.213.2 with HTTP; Mon, 2 Nov 2015 09:27:43 -0800 (PST) In-Reply-To: <20151102171356.GB18899@kloomba.lvv.mirantis.net> References: <20151102171356.GB18899@kloomba.lvv.mirantis.net> Date: Mon, 2 Nov 2015 10:27:43 -0700 Message-ID: Subject: Re: bhyve -l bootrom problem From: Trent Thompson To: Roman Bogorodskiy Cc: freebsd-virtualization@freebsd.org Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 02 Nov 2015 17:27:45 -0000 According to the bhyve/Windows wiki: https://wiki.freebsd.org/bhyve/Windows The lpc slot needs to be in slot 31, and the block devices bust be in 3, 4, 5, and 6. I have had luck* booting into the Debian install environment using this method, as long as you pass "console=ttyS0" to grub at boot time. I believe you must do the same as well on FreeBSD, with adding the ability to use a console in /boot/loader.conf *I have installed Debian VMs utilizing UEFI, however I have not had success after destroying the VM. They fail to boot and drop you to that fancy EFI shell. On Mon, Nov 2, 2015 at 10:13 AM, Roman Bogorodskiy wrote: > Hi, > > I'm facing a strange problem with -l bootrom. > > I try to boot a VM this way: > > sudo /usr/sbin/bhyve -l bootrom,/home/novel/uefi/BHYVE_UEFI_20151002.fd > -c 2 -m 214 -A -I -u -H -P -s 0:0,hostbridge -s > 2:0,virtio-net,tap0,mac=52:54:00:56:9a:77 -s > 3:0,ahci-hd,/home/novel/FreeBSD-11.0-CURRENT-amd64.raw -s 1,lpc -l > com1,/dev/nmdm0A testvm > > BHYVE_UEFI_20151002.fd is downloaded from [1]. > FreeBSD-11.0-CURRENT-amd64.raw is downloaded from [2]. > > VMs fail to boot with 'Boot Failed. EFI Hard Drive' and brings into UEFI > shell. > > Changing ahci-hd to virtio-blk changes error message to: > > 'Boot Failed. EFI Misc Device'. > > Dropping 'hostbridge' and 'virtio-net' doesn't seem to change anything. > > Also, before trying FreeBSD-11.0-CURRENT-amd64.raw I tried my old images > I used with bhyveload and they fail in the same way, though they're > still booting using bhyveload. > > I'm running -CURRENT updated last weekend on Intel i5-2310. > > What could be wrong with this? > > 1: http://people.freebsd.org/~grehan/bhyve_uefi/BHYVE_UEFI_20151002.fd > 2: > > http://ftp.freebsd.org/pub/FreeBSD/snapshots/VM-IMAGES/11.0-CURRENT/amd64/Latest/FreeBSD-11.0-CURRENT-amd64.raw.xz > > Roman Bogorodskiy > From owner-freebsd-virtualization@freebsd.org Mon Nov 2 17:47:55 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 38307A2455A for ; Mon, 2 Nov 2015 17:47:55 +0000 (UTC) (envelope-from bogorodskiy@gmail.com) Received: from mail-lf0-x243.google.com (mail-lf0-x243.google.com [IPv6:2a00:1450:4010:c07::243]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id A76461CD8 for ; Mon, 2 Nov 2015 17:47:54 +0000 (UTC) (envelope-from bogorodskiy@gmail.com) Received: by lfgh9 with SMTP id h9so1968765lfg.0 for ; Mon, 02 Nov 2015 09:47:52 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=sender:date:from:to:cc:subject:message-id:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; bh=SxmRerEK6PxSPKZkXwBwOnvV5cLmUyYHpiriwNJPm88=; b=ANwDsAhblI3oApeATQyNSYK7FBF2vHmAoFLmiwrMXbjKy/aflHTBXUjzlS3MGYHwE6 eXv8iJpBwuTB0HW82vfb8b0UQmdzrTlb5lkGFE3Gt0f8Pu19yT/Zk+xoSXl12M4qDH+h KX+KUOVauRTmbVMv1f+bpURDkrPYkAIsZ8hoSuy4/w9770d/kHwiWAcTuRWYySkjabfA vLqdxNGIA7ijYjwluR84pAjvBqWXJOgAISeka8hauKoMcNQMBD6rqpgwR3lMAsS5CY0r UPTiM1B5DnDe/bUHuSFn0/WyzeZoZXelqHYkUPbFJhyqILn+UjgwU0+wLLCCTsXUQN0Z gAyA== X-Received: by 10.25.152.131 with SMTP id a125mr7334003lfe.13.1446486472783; Mon, 02 Nov 2015 09:47:52 -0800 (PST) Received: from kloomba.lvv.mirantis.net ([217.65.211.58]) by smtp.gmail.com with ESMTPSA id m124sm1584499lfd.40.2015.11.02.09.47.51 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Mon, 02 Nov 2015 09:47:52 -0800 (PST) Sender: Roman Bogorodskiy Date: Mon, 2 Nov 2015 20:47:49 +0300 From: Roman Bogorodskiy To: Trent Thompson Cc: freebsd-virtualization@freebsd.org Subject: Re: bhyve -l bootrom problem Message-ID: <20151102174748.GC18899@kloomba.lvv.mirantis.net> References: <20151102171356.GB18899@kloomba.lvv.mirantis.net> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="eHhjakXzOLJAF9wJ" Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.24 (2015-08-30) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 02 Nov 2015 17:47:55 -0000 --eHhjakXzOLJAF9wJ Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Trent Thompson wrote: > According to the bhyve/Windows wiki: https://wiki.freebsd.org/bhyve/Windo= ws > The lpc slot needs to be in slot 31, and the block devices bust be in 3, = 4, > 5, and 6. > I have had luck* booting into the Debian install environment using this > method, as long as you pass "console=3DttyS0" to grub at boot time. I bel= ieve > you must do the same as well on FreeBSD, with adding the ability to use a > console in /boot/loader.conf >=20 > *I have installed Debian VMs utilizing UEFI, however I have not had succe= ss > after destroying the VM. > They fail to boot and drop you to that fancy EFI shell. Hm... changing pci slot numbers doesn't seem to change anything: sudo /usr/sbin/bhyve -l bootrom,/home/novel/uefi/BHYVE_UEFI_20151002.fd -c 2 -m 512 -A -I -u -H -P -s 0:0,hostbridge -s 3:0,ahci-hd,/home/novel/bhyve_freebsd.img.bak -s 31,lpc -l com1,/dev/nmdm0A testvm=20 and I get: Boot Failed. EFI Hard Drive However, when I do: sudo bhyveload -m 512 -d /home/novel/bhyve_freebsd.img.bak testvm and then: sudo /usr/sbin/bhyve -c 2 -m 512 -A -I -u -H -P -s 0:0,hostbridge -s 3:0,ahci-hd,/home/novel/bhyve_freebsd.img.bak -s 31,lpc -l com1,/dev/nmdm0A testvm I can see a console: (It fails to mount root though because my image is configured to virtio, but I guess it's not relevant to this situation). >=20 > On Mon, Nov 2, 2015 at 10:13 AM, Roman Bogorodskiy > wrote: >=20 > > Hi, > > > > I'm facing a strange problem with -l bootrom. > > > > I try to boot a VM this way: > > > > sudo /usr/sbin/bhyve -l bootrom,/home/novel/uefi/BHYVE_UEFI_20151002.fd > > -c 2 -m 214 -A -I -u -H -P -s 0:0,hostbridge -s > > 2:0,virtio-net,tap0,mac=3D52:54:00:56:9a:77 -s > > 3:0,ahci-hd,/home/novel/FreeBSD-11.0-CURRENT-amd64.raw -s 1,lpc -l > > com1,/dev/nmdm0A testvm > > > > BHYVE_UEFI_20151002.fd is downloaded from [1]. > > FreeBSD-11.0-CURRENT-amd64.raw is downloaded from [2]. > > > > VMs fail to boot with 'Boot Failed. EFI Hard Drive' and brings into UEFI > > shell. > > > > Changing ahci-hd to virtio-blk changes error message to: > > > > 'Boot Failed. EFI Misc Device'. > > > > Dropping 'hostbridge' and 'virtio-net' doesn't seem to change anything. > > > > Also, before trying FreeBSD-11.0-CURRENT-amd64.raw I tried my old images > > I used with bhyveload and they fail in the same way, though they're > > still booting using bhyveload. > > > > I'm running -CURRENT updated last weekend on Intel i5-2310. > > > > What could be wrong with this? > > > > 1: http://people.freebsd.org/~grehan/bhyve_uefi/BHYVE_UEFI_20151002.fd > > 2: > > > > http://ftp.freebsd.org/pub/FreeBSD/snapshots/VM-IMAGES/11.0-CURRENT/amd= 64/Latest/FreeBSD-11.0-CURRENT-amd64.raw.xz > > > > Roman Bogorodskiy > > Roman Bogorodskiy --eHhjakXzOLJAF9wJ Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEcBAEBAgAGBQJWN6HEAAoJEMltX/4IwiJqlIwH/3uR3WVmXmUDuU6pbIk8dDMG vVS7UVcYTwdSyw3NzD6s22iBCUNOdTu/SyFsr5mpzR3gQ72/kSIuFReG7KVDW50K DUCKZ4DCRbV1DblHb9KbBQe2SN1x8QJTMOzNmgxzYvpFUOJgNcWm7wZMR1Lb+e27 f9PApkTH56sw459HepP5C713d/HdQerrByhyUG1QokRmSuidNFwMLjlcKKkXjbkF TqT28osStJmJbGm+T3EOqVCBqOM/NSTz8IO4fIh6fI+71JUQFOJze68Ch/+QH5FN eovUJ5pK9WpapHP0kn+ay11jCqdKK1xxp30AQ/vM8rbQ1xhN57Ka7Yu7j4L0cwg= =b2Lh -----END PGP SIGNATURE----- --eHhjakXzOLJAF9wJ-- From owner-freebsd-virtualization@freebsd.org Mon Nov 2 21:07:41 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 900EAA24A0C for ; Mon, 2 Nov 2015 21:07:41 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: from phabric-backend.isc.freebsd.org (phabric-backend.isc.freebsd.org [IPv6:2001:4f8:3:ffe0:406a:0:50:2]) by mx1.freebsd.org (Postfix) with ESMTP id 77BDF1015 for ; Mon, 2 Nov 2015 21:07:41 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: by phabric-backend.isc.freebsd.org (Postfix, from userid 1346) id 753D9147B7C; Mon, 2 Nov 2015 21:07:41 +0000 (UTC) Date: Mon, 2 Nov 2015 21:07:41 +0000 To: freebsd-virtualization@freebsd.org From: "rodrigc (Craig Rodrigues)" Reply-to: D1944+333+b09c6235d993877b@reviews.freebsd.org Subject: [Differential] [Commented On] D1944: PF and VIMAGE fixes Message-ID: <1e66dd27f4d3c369323a9a5e841c1f79@localhost.localdomain> X-Priority: 3 X-Phabricator-Sent-This-Message: Yes X-Mail-Transport-Agent: MetaMTA X-Auto-Response-Suppress: All X-Phabricator-Mail-Tags: Thread-Topic: D1944: PF and VIMAGE fixes X-Herald-Rules: none X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: Precedence: bulk In-Reply-To: References: Thread-Index: NDc2NzM0MzY4OTdiYThiNTU1MjY2ZDZmMTJiIFY30J0= MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Content-Type: text/plain; charset="utf-8" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 02 Nov 2015 21:07:41 -0000 rodrigc added a comment. @mmoll : It would be nice if @glebius could review this patch. He previously committed some patches I committed to FreeBSD which attempted to fix this problem, so he has an interest in this area. REVISION DETAIL https://reviews.freebsd.org/D1944 EMAIL PREFERENCES https://reviews.freebsd.org/settings/panel/emailpreferences/ To: nvass-gmx.com, bz, trociny, kristof, gnn, zec, rodrigc, glebius, eri Cc: mmoll, javier_ovi_yahoo.com, farrokhi, julian, robak, freebsd-virtualization-list, freebsd-pf-list, freebsd-net-list From owner-freebsd-virtualization@freebsd.org Tue Nov 3 20:01:53 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 09B5DA25B71 for ; Tue, 3 Nov 2015 20:01:53 +0000 (UTC) (envelope-from lab@gta.com) Received: from mailgate.gta.com (gb-ha.orl.gta.com [209.208.105.194]) by mx1.freebsd.org (Postfix) with ESMTP id 234E61F24 for ; Tue, 3 Nov 2015 20:01:51 +0000 (UTC) (envelope-from lab@gta.com) Received: (qmail 92230 invoked by uid 1000); 3 Nov 2015 20:01:41 -0000 Date: Tue, 3 Nov 2015 15:01:41 -0500 From: Larry Baird To: freebsd-virtualization@freebsd.org Subject: Re: Issues gatewaying through Hyper-V Message-ID: <20151103200141.GB90948@gta.com> References: <20151030034535.GA19514@gta.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20151030034535.GA19514@gta.com> User-Agent: Mutt/1.5.24 (2015-08-30) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 03 Nov 2015 20:01:53 -0000 On Thu, Oct 29, 2015 at 11:45:35PM -0400, Larry Baird wrote: > I have two identical setups on Hyper-V 2012R2 and Hype-V windows 10. > > I have two FreeBSD 10.2-RELEASE-p6 Hyper-V hosts in both cases. > The first FreeBSD host (client) has one NIC configured to use a Private > network. The second (gateway) has two nics. One private and one external. > The gateway box has the gateway_enable option set to YES in its rc.conf. > The boxes otherwize of very vanilla. > > I get failures forwarding thru gateway on both versions of Hyper-V. But > they fail in different ways. > > On both configurations, I can ping thru the gateway from the client to reach > the internet. > > For the 2012r2 configuration I can do DNS looks. The command > "host www.google.com 8.8.8.8" works on the client. > > For the Windows 10 configuration the "host" command fails. > > For the 2012r2, "curl http://www.goggle.com" times out on client. > > Under Windows 10, I can successfuly do curl requests by IP address. > > Using tcpdump on the client for the failure cases, I see bad checksums > in the responses retunred to the failing commands. I tried turning off > rxcsum, txcsum, tso4 and tso6 on all interfaces. This did not effect the > results. > > Using tcpdup on the gateway on either interface shows valid checksums. > They are getting corrupted after they leave FreeBSD on their way to the > client. I assume this means this is an internal HyperV issue. I wonder if > there anything the FreeBSD hn(4) driver can do? The patch below fixes the issue for me. --- hv_netvsc_drv_freebsd.c.orig 2015-11-03 15:12:27.242856000 -0500 +++ hv_netvsc_drv_freebsd.c 2015-11-03 15:13:20.641513000 -0500 @@ -570,7 +570,8 @@ packet->vlan_tci & 0xfff; } - if (0 == m_head->m_pkthdr.csum_flags) { + /* Ignore flags for checksum already calculated or valid */ + if (0 == (m_head->m_pkthdr.csum_flags & 0xffffff)) { goto pre_send; } -- ------------------------------------------------------------------------ Larry Baird Global Technology Associates, Inc. 1992-2012 | http://www.gta.com Celebrating Twenty Years of Software Innovation | Orlando, FL Email: lab@gta.com | TEL 407-380-0220 From owner-freebsd-virtualization@freebsd.org Tue Nov 3 22:19:48 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 29538A24E58 for ; Tue, 3 Nov 2015 22:19:48 +0000 (UTC) (envelope-from shawn@debnath.net) Received: from na01-bn1-obe.outbound.protection.outlook.com (mail-bn1on0099.outbound.protection.outlook.com [157.56.110.99]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "MSIT Machine Auth CA 2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id D8CCF1A22 for ; Tue, 3 Nov 2015 22:19:47 +0000 (UTC) (envelope-from shawn@debnath.net) Authentication-Results: spf=none (sender IP is ) smtp.mailfrom=shawn@debnath.net; Received: from debnath.net (205.175.118.12) by BLUPR05MB353.namprd05.prod.outlook.com (10.141.25.11) with Microsoft SMTP Server (TLS) id 15.1.312.18; Tue, 3 Nov 2015 22:19:38 +0000 Date: Tue, 3 Nov 2015 14:19:31 -0800 From: Shawn Debnath To: Subject: C bhyve administration tool Message-ID: <20151103221930.GA50869@debnath.net> MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Disposition: inline User-Agent: Mutt/1.5.24 (2015-08-30) X-Originating-IP: [205.175.118.12] X-ClientProxiedBy: CO1PR06CA023.namprd06.prod.outlook.com (10.242.160.13) To BLUPR05MB353.namprd05.prod.outlook.com (10.141.25.11) X-Microsoft-Exchange-Diagnostics: 1; BLUPR05MB353; 2:RFpp3pGljgMraHQnxcVaeXAzcYxut1QXjGB95Pu77IhCj8LvkqYTAxgzJaNXZoxit7bigkX8EyUKPWTSiFLK76cr9qRDwOLjbXvEMjnYKoPSYAuGVM/PTOk99FT16rrZP4PxwRejiSQlNzRw1KIx29NuNTCf4lzkQM8dw42eM20=; 3:CIOCIuOTcFcbz5Q3lNpxGEVWh1thU4hOvqRVEgMqTnxD1+kNoIB0FSO3G2qmFDxfXuETkVqya0stISqn5sQ6yZOMYj5rDVCYX3CRMns0EjWVc0llvmJsC6qYXuCdgL5uSZUoYdbIn0eIgJ9zWGSaCA==; 25:8UtepRhS2EnVa0OwAPnswUrplHd4dsXKSO3zdgmYcKWjB6+MC+SDu6lAZBVXh0z7/QCSAlC/7PY/msLdSVg+sJRE8Cfv0md4FLVM+AHM/Axwu87ful6JIelmGblWKMpfiLQq/n+ghlk7dGDl10t10W2DqIDklJf64pA3ffXC+kft1eTUfXssT2w+w4YlBP9sjZjWD+9h3eC7F+HsXInnF/HzJeZHO9KFgIkKITN6W+apbk8xYABCdOZEd8Dddv2u; 4:o2fST+hTw4DumcANnOlvwuBPoK8dvJkYN36KWzxB3NqjHiOmdK+vBLnJdpfJBD+MTB9we4t5KJqbKnsukd5ZXPAm1npljHY+lsqHcozMyIjfUoD49z6dTr995BZMJptAtE2IltP25wM89dGO5JjJFGas45jLa2toUvEYuQlvSFfAU4hySk32Bl1XwOGjzByNoIkr0R0dzXtYY8bzl0ACJwAPvit0oFtvrfRQGfBdfi0KHXe5+T9HE7lQJdGre4KywQNVZ4J0Av6OJw5fLFjn9LvmizpRiUUDwxNbE4uxSpl7MtLjdsEMBOTGC47gETzQz5SbgDdY2ccGcCRBh1EE5dtw3Y/DTKKRv2Yd4DBkztWXenSdEX8k7AzegLyz7pmk X-Microsoft-Antispam: UriScan:;BCL:0;PCL:0;RULEID:;SRVR:BLUPR05MB353; X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:; X-Exchange-Antispam-Report-CFA-Test: BCL:0; PCL:0; RULEID:(601004)(2401047)(8121501046)(5005006)(520078)(10201501046)(3002001); SRVR:BLUPR05MB353; BCL:0; PCL:0; RULEID:; SRVR:BLUPR05MB353; X-Forefront-PRVS: 0749DC2CE6 X-Forefront-Antispam-Report: SFV:NSPM; SFS:(10009020)(979002)(6009001)(199003)(189002)(23676002)(106356001)(81156007)(122386002)(86362001)(40100003)(66066001)(87976001)(4001350100001)(189998001)(33656002)(5004730100002)(69596002)(54356999)(77096005)(107886002)(83506001)(5001960100002)(5008740100001)(92566002)(97736004)(42186005)(101416001)(21086003)(110136002)(47776003)(105586002)(229853001)(2351001)(450100001)(5007970100001)(50466002)(36756003)(50986999)(969003)(989001)(999001)(1009001)(1019001); DIR:OUT; SFP:1101; SCL:1; SRVR:BLUPR05MB353; H:debnath.net; FPR:; SPF:None; PTR:InfoNoRecords; A:1; MX:1; LANG:en; Received-SPF: None (protection.outlook.com: debnath.net does not designate permitted sender hosts) X-Microsoft-Exchange-Diagnostics: =?utf-8?B?MTtCTFVQUjA1TUIzNTM7MjM6ajRlbTJtUlJEd255WWZnWnZ3NW9OandOeWRM?= =?utf-8?B?TFQ5a25ZaUpoTzJlNytCUGR5Zlg0RUhHdURmVHFxdmZHT2tjT3EwWWdzUnBz?= =?utf-8?B?SVdDUXM2bzh3OG5EcVpERjdybStEeVJtZk9uODRVaWlUTnMzRUdGZjhCMUx3?= =?utf-8?B?TXBFZy9xejRuNVgyMGhMSWlsMXY3S1dOaFhrUVR3eGRmWm9TbmdkemRBanNE?= =?utf-8?B?REVxUUpHVFpDR1F6YjJUaHBlNFUzTXBBMGt2VTI0RjZEQmh5bVpwQm92WHFs?= =?utf-8?B?VWpVeU9KeE9NOWM1ZXRrR1hmK1JUM29DYnloeFhIYmdJbnBXcER4b3gvUE9B?= =?utf-8?B?QTQ3ME5rZE5hRnlhRFMwaW9DM3FvSjYwbjMxL3VDU0J6RXZXWFVYV2hJa2Jw?= =?utf-8?B?cHh0aFhMbFRVMDJONmlrbDNubjRTMDBGMGo1cXJEdjNXSEIra3BqY1BIcGJZ?= =?utf-8?B?d3h5U1E0OHJDb092Ri9JNjFEcVZrdHg1RU9vSWFpbWx2QjZMNHhDbVh1ZDBT?= =?utf-8?B?TWREeXhHc3htS3hEbUF4Y0Z3bWxJR0NJYTIxMWVQUTJnMFhYYkp6NXhyazEy?= =?utf-8?B?cGJURXBoQWFLYlZDcUlCMG9CT1VENWJkQkJlb3NXQVJUZ1dvQmUxT1J5Ym1T?= =?utf-8?B?TE51cit0ajM2T3cvUWpPbmVVNVdzbHR4SnE0N0JBYklMZmR4YWgvV3EzeTh6?= =?utf-8?B?QlpjbTBmbTFrUnJTSWI0TmoybnJ6Q1hMUGYrQmJYczRIRFdGTUF5Ym5CLytR?= =?utf-8?B?T3owMGR4cnphOTNJQ1I3RVMyV2w3Q21YQTFEb0hhNFFUbC9DMkZFMVFsS2xZ?= =?utf-8?B?N202VnlUOGQ5SGtIU0VCN0JyanRJelN2WGdRcEJhbzJKdHZ1eWlzU1hvSWY0?= =?utf-8?B?eHpvcGJkdy9KNzVvem90U0RQUkE3aU1HbjVKMjNGNS9NWTJFTzBBd2R2ZXI5?= =?utf-8?B?YkJsM1FGTUZvVmNaVStKTUFraTJWUk05UGNOaWVZK01ZVjhDUzlTUlBITUZI?= =?utf-8?B?dG9ydTk0OHpkVHhEeTBSQzNjUDgwZGEyb3dTMkkwdTNoV1hHL1RaeDYxNXFL?= =?utf-8?B?cmpnRXNmY2xrVW9lSDhvS2UyMkJTSnVINy91Mis1cHN5TkdmVHJmZVI1cnpD?= =?utf-8?B?WVhCVFJZVlk0a2VFVDkyVDJHbXZRTkRYWU1IV0R5SERXNHR5OS9QYmM3Wjdz?= =?utf-8?B?SFFRYnZnRWhobkxtVDdwNllUTmJHd1I5Y2IyNXlwRm5LUmp1cDVmeFN4b3VM?= =?utf-8?B?anA1eWZpWXJYalRINzVPRjlGSGVjYVhYS3VTNWtLK1RFT0ZkZmdHVVViYkNr?= =?utf-8?B?b0xod3BybUp2enhvK2F6WGRLUFBmeWRmY204Tm9MMXhVMU1GaC83NlRjQkY1?= =?utf-8?B?NVdYNHBaMWtneitqa0p3cFB1YVp1dmVWa3h2MjlmcXhKZmJ4Zy9QVi9qSy9T?= =?utf-8?B?em4yTVp3ci9oNGxZR2QveVNrZk5zaDZ4M25jRkxRdkJFTktkc1J6YXpOMkc4?= =?utf-8?B?VWxBPT0=?= X-Microsoft-Exchange-Diagnostics: 1; BLUPR05MB353; 5:1NWko8cTkFb3kkZTLRwYgePC3l/DcBpK8qJpfefFo0Vi9I1j7g/etCE3aEZF5LnziwOGoNOlL5E2As+Avl7ReQBv2My2qgI6ahNin9MuzG/MGWGN8xIC7Bhj2f9YZHyIEU1QoxTedqlRFn99BXfx5Q==; 24:9BmKeHFANEw+1EJphH6H6xFdBcEORp5iMbAZNtTa+PtP1ixONWZlisK1IXXR8bYbHM+XQKGNyf5HvUqi1OQhVWHRlviItim9FibqxH9s8LQ=; 20:Sst7JGmancQzsXdb9bAStFeiSj2Yl1g25r5hEqTTY1jFzKRNG6x97wyLTFBjCLBNUKFmefLAGOgQTdoprPLi2g== SpamDiagnosticOutput: 1:23 SpamDiagnosticMetadata: NSPM X-OriginatorOrg: debnath.net X-MS-Exchange-CrossTenant-OriginalArrivalTime: 03 Nov 2015 22:19:38.5206 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-Transport-CrossTenantHeadersStamped: BLUPR05MB353 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 03 Nov 2015 22:19:48 -0000 Hello! Couple months ago I started writing a bhyve management tool in C for our startup, in preparation for migration to FreeBSD for our servers. The goal was to be able to create, drop, and auto-start/stop/restart VMs, individually or all at once, and provide a plugin infrastructure to expose some metrics / errors for reporting and aggregation. More importantly it would detect errors/failures, report them and attempt to restart the VM per assigned policy. The effort stalled due to some high priority work that crept in. However, I am planning on restarting soon and wanted to check if there was a need for something like this. I ran across Michael Dexter's vmrc, and although its shell based, it does provide quite a bit of features that we were looking for. There's also iohyve. And I heard Peter and Neel are working on something as well. If there is interest, this would be open sourced from the start. Or if there is an existing effort that addresses these problems, I would love to contribute to that project. Thoughts, comments, concerns, please share. Thanks! -- Shawn From owner-freebsd-virtualization@freebsd.org Tue Nov 3 23:03:39 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id CE613A25862 for ; Tue, 3 Nov 2015 23:03:39 +0000 (UTC) (envelope-from amvandemore@gmail.com) Received: from mail-wm0-x22b.google.com (mail-wm0-x22b.google.com [IPv6:2a00:1450:400c:c09::22b]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 692A811BD for ; Tue, 3 Nov 2015 23:03:39 +0000 (UTC) (envelope-from amvandemore@gmail.com) Received: by wmec75 with SMTP id c75so99248892wme.1 for ; Tue, 03 Nov 2015 15:03:37 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=FlelFoKJLmCqgUaAfc8gVt5jMZeLTT/9rrxfp4Us4IQ=; b=H7WoTvxqutL+7CNBudChZCV4Le4MZYqytX/Ox9+eHwiUSSfxfz9Wy3UnkIi/UJ4zMf xfztaiQ4xvcPLiBwmNwVuGgchIRojMFQEvQ0FzIVmITDgR7cKqvIfg9PNcmvCFJse9JC x9xMWyja67rh6PVorNI3Ta96V1a7ZxTuB34vE1FUFONT4nhpUr0csuZn36fWRKEdXFIG xvatC8+nqL490AlzQ9bfE+k/l/mB3rkKz4tkUSKT8kU3VYH6Rq/MLQgmCRfE9J58nOPN nUJ9Rb1ctTxUD6Uh00HqVwi71KlXnJQXrXVht4Y6oh6sh9jkyy6s100uPYbPlxoJLY1i mwcw== MIME-Version: 1.0 X-Received: by 10.28.23.208 with SMTP id 199mr20821626wmx.11.1446591817475; Tue, 03 Nov 2015 15:03:37 -0800 (PST) Received: by 10.194.16.231 with HTTP; Tue, 3 Nov 2015 15:03:37 -0800 (PST) In-Reply-To: <20151103221930.GA50869@debnath.net> References: <20151103221930.GA50869@debnath.net> Date: Tue, 3 Nov 2015 17:03:37 -0600 Message-ID: Subject: Re: C bhyve administration tool From: Adam Vande More To: Shawn Debnath Cc: FreeBSD virtualization Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 03 Nov 2015 23:03:40 -0000 On Tue, Nov 3, 2015 at 4:19 PM, Shawn Debnath wrote: > Hello! > > Couple months ago I started writing a bhyve management tool in C for our > startup, in preparation for migration to FreeBSD for our servers. The > goal was to be able to create, drop, and auto-start/stop/restart VMs, > individually or all at once, and provide a plugin infrastructure to > expose some metrics / errors for reporting and aggregation. More > importantly it would detect errors/failures, report them and attempt to > restart the VM per assigned policy. > > The effort stalled due to some high priority work that crept in. > However, I am planning on restarting soon and wanted to check if there > was a need for something like this. I ran across Michael Dexter's vmrc, > and although its shell based, it does provide quite a bit of features > that we were looking for. There's also iohyve. And I heard Peter and > Neel are working on something as well. If there is interest, this would > be open sourced from the start. Or if there is an existing effort > that addresses these problems, I would love to contribute to that project. > > Thoughts, comments, concerns, please share. > vm-bhyve is most mature to this point IME, just don't use the ports version. -- Adam From owner-freebsd-virtualization@freebsd.org Wed Nov 4 10:19:06 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 76FE4A26170 for ; Wed, 4 Nov 2015 10:19:06 +0000 (UTC) (envelope-from matt.churchyard@userve.net) Received: from smtp-outbound.userve.net (smtp-outbound.userve.net [217.196.1.22]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.userve.net", Issuer "Go Daddy Secure Certificate Authority - G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id DFD681783 for ; Wed, 4 Nov 2015 10:19:05 +0000 (UTC) (envelope-from matt.churchyard@userve.net) Received: from owa.usd-group.com (owa.usd-group.com [217.196.1.2]) by smtp-outbound.userve.net (8.15.1/8.15.1) with ESMTPS id tA49lq8h038965 (version=TLSv1 cipher=ECDHE-RSA-AES256-SHA bits=256 verify=FAIL); Wed, 4 Nov 2015 09:47:53 GMT (envelope-from matt.churchyard@userve.net) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=userve.net; s=201508; t=1446630477; bh=MzvnkW6AgvVPj+N76Hk1Kvhr3iiDaAMmtEGMOP9KgJA=; h=From:To:CC:Subject:Date:References:In-Reply-To; b=vB3g7n0tUF9fP7HOXenYbtkYJ0mDxlUqxiBSfY2gSLk3OxWqfaj2QWCj1+P9vjJ6H heQZXlLSV8dGhcPETKcv/+H2RlopTRAts1W/4IwoWSB9kiv0ZSF99LtiJmH/R14xpx OC8a4Fs7BhN3tSjiY7BBG02K+IvrH86EPxs4vcVI= Received: from SERVER.ad.usd-group.com (192.168.0.1) by SERVER.ad.usd-group.com (192.168.0.1) with Microsoft SMTP Server (TLS) id 15.0.847.32; Wed, 4 Nov 2015 09:47:47 +0000 Received: from SERVER.ad.usd-group.com ([fe80::b19d:892a:6fc7:1c9]) by SERVER.ad.usd-group.com ([fe80::b19d:892a:6fc7:1c9%12]) with mapi id 15.00.0847.030; Wed, 4 Nov 2015 09:47:47 +0000 From: Matt Churchyard To: Adam Vande More , Shawn Debnath CC: FreeBSD virtualization Subject: RE: C bhyve administration tool Thread-Topic: C bhyve administration tool Thread-Index: AQHRFoXM74mFoJK6AkqxRGclvqWnoJ6K6rKAgACvmZA= Date: Wed, 4 Nov 2015 09:47:46 +0000 Message-ID: References: <20151103221930.GA50869@debnath.net> In-Reply-To: Accept-Language: en-GB, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [192.168.0.10] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Nov 2015 10:19:06 -0000 > Hello! > > Couple months ago I started writing a bhyve management tool in C for=20 > our startup, in preparation for migration to FreeBSD for our servers.=20 > The goal was to be able to create, drop, and auto-start/stop/restart=20 > VMs, individually or all at once, and provide a plugin infrastructure=20 > to expose some metrics / errors for reporting and aggregation. More=20 > importantly it would detect errors/failures, report them and attempt=20 > to restart the VM per assigned policy. > > The effort stalled due to some high priority work that crept in. > However, I am planning on restarting soon and wanted to check if there=20 > was a need for something like this. I ran across Michael Dexter's=20 > vmrc, and although its shell based, it does provide quite a bit of=20 > features that we were looking for. There's also iohyve. And I heard=20 > Peter and Neel are working on something as well. If there is interest,=20 > this would be open sourced from the start. Or if there is an existing=20 > effort that addresses these problems, I would love to contribute to that = project. > > Thoughts, comments, concerns, please share. > >vm-bhyve is most mature to this point IME, just don't use the ports versio= n. > Adam Thanks Adam :) I could do with updating the port. Unfortunately this is my first porting e= xperience so not exactly sure of the 'correct' channel to go through to get= things updated. It took 2 months for my original port request to be addres= sed and I'm not sure re-opening that bug is the right way to do it. If anyone uses the port, the error that gets printed when running 'vm init'= can be completely ignored. It's just trying to load any existing virtual s= witches from the switch configuration file, and complaining that the switch= configuration file doesn't exist. Apart from that and a few newer features= /tweaks, I don't think there's anything particularly show-stopping about th= e current port/package if people prefer installing it that way to downloadi= ng from GitHub. Of course it would still be interesting to see a "real" bhyve management to= ol (possibly even an official one) written in C. Matt From owner-freebsd-virtualization@freebsd.org Wed Nov 4 15:00:30 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 35946A264E0; Wed, 4 Nov 2015 15:00:30 +0000 (UTC) (envelope-from ler@lerctr.org) Received: from thebighonker.lerctr.org (thebighonker.lerctr.org [IPv6:2001:470:1f0f:3ad:223:7dff:fe9e:6e8a]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "thebighonker.lerctr.org", Issuer "COMODO RSA Domain Validation Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id ADEDA1D67; Wed, 4 Nov 2015 15:00:29 +0000 (UTC) (envelope-from ler@lerctr.org) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lerctr.org; s=lerami; h=Message-ID:References:In-Reply-To:Subject:Cc:To:From:Date: Content-Transfer-Encoding:Content-Type:MIME-Version; bh=8IrIy5eJ/26/ji44H1CkrtF3evzK0lskHi/zgBsi/M4=; b=UMIDviOTyRQENtV9xwDbDYhEG4 WyT9JjwZ5lu+xdXHXFaQbsiXepwcvCFt71eN8X3W81VPkqAelZO4aenM4lesJkDQ/I/BWVI2k2aJW 9Rg2BID0X69yzPz7xlp8l9IGhW5aw4BMZv5A3si/C8/TKa049KxUMauFroU28MVGCLEA=; Received: from thebighonker.lerctr.org ([2001:470:1f0f:3ad:223:7dff:fe9e:6e8a]:55105 helo=webmail.lerctr.org) by thebighonker.lerctr.org with esmtpsa (TLSv1:ECDHE-RSA-AES128-SHA:128) (Exim 4.86 (FreeBSD)) (envelope-from ) id 1ZtzY0-000A7F-1g; Wed, 04 Nov 2015 09:00:24 -0600 Received: from proxy.lucent.com ([135.245.48.12]) by webmail.lerctr.org with HTTP (HTTP/1.1 POST); Wed, 04 Nov 2015 09:00:23 -0600 MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII; format=flowed Content-Transfer-Encoding: 7bit Date: Wed, 04 Nov 2015 09:00:23 -0600 From: Larry Rosenman To: Matt Churchyard Cc: Adam Vande More , Shawn Debnath , FreeBSD virtualization , owner-freebsd-virtualization@freebsd.org Subject: RE: C bhyve administration tool In-Reply-To: References: <20151103221930.GA50869@debnath.net> Message-ID: X-Sender: ler@lerctr.org User-Agent: Roundcube Webmail/1.1.3 X-Spam-Score: -1.0 (-) X-LERCTR-Spam-Score: -1.0 (-) X-Spam-Report: SpamScore (-1.0/5.0) ALL_TRUSTED=-1,SHORTCIRCUIT=-0.0001 X-LERCTR-Spam-Report: SpamScore (-1.0/5.0) ALL_TRUSTED=-1, SHORTCIRCUIT=-0.0001 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Nov 2015 15:00:30 -0000 On 2015-11-04 03:47, Matt Churchyard via freebsd-virtualization wrote: >> Hello! >> >> Couple months ago I started writing a bhyve management tool in C for >> our startup, in preparation for migration to FreeBSD for our servers. >> The goal was to be able to create, drop, and auto-start/stop/restart >> VMs, individually or all at once, and provide a plugin infrastructure >> to expose some metrics / errors for reporting and aggregation. More >> importantly it would detect errors/failures, report them and attempt >> to restart the VM per assigned policy. >> >> The effort stalled due to some high priority work that crept in. >> However, I am planning on restarting soon and wanted to check if there >> was a need for something like this. I ran across Michael Dexter's >> vmrc, and although its shell based, it does provide quite a bit of >> features that we were looking for. There's also iohyve. And I heard >> Peter and Neel are working on something as well. If there is interest, >> this would be open sourced from the start. Or if there is an existing >> effort that addresses these problems, I would love to contribute to >> that project. >> >> Thoughts, comments, concerns, please share. >> > >> vm-bhyve is most mature to this point IME, just don't use the ports >> version. > >> Adam > > Thanks Adam :) > > I could do with updating the port. Unfortunately this is my first > porting experience so not exactly sure of the 'correct' channel to go > through to get things updated. It took 2 months for my original port > request to be addressed and I'm not sure re-opening that bug is the > right way to do it. > > If anyone uses the port, the error that gets printed when running 'vm > init' can be completely ignored. It's just trying to load any existing > virtual switches from the switch configuration file, and complaining > that the switch configuration file doesn't exist. Apart from that and > a few newer features/tweaks, I don't think there's anything > particularly show-stopping about the current port/package if people > prefer installing it that way to downloading from GitHub. > > Of course it would still be interesting to see a "real" bhyve > management tool (possibly even an official one) written in C. > to update an existing port, create a PR with the patch to update it, and then wait. If a committer doesn't grab it within a reasonable time, post to freebsd-ports to get their attention. Do run poudriere testport and provide the output. -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 E-Mail: ler@lerctr.org US Mail: 7011 W Parmer Ln, Apt 1115, Austin, TX 78729-6961 From owner-freebsd-virtualization@freebsd.org Wed Nov 4 15:23:43 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id ED53AA268F4; Wed, 4 Nov 2015 15:23:43 +0000 (UTC) (envelope-from matt.churchyard@userve.net) Received: from smtp-outbound.userve.net (smtp-outbound.userve.net [217.196.1.22]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.userve.net", Issuer "Go Daddy Secure Certificate Authority - G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 971B41927; Wed, 4 Nov 2015 15:23:42 +0000 (UTC) (envelope-from matt.churchyard@userve.net) Received: from owa.usd-group.com (owa.usd-group.com [217.196.1.2]) by smtp-outbound.userve.net (8.15.1/8.15.1) with ESMTPS id tA4FNPRe049723 (version=TLSv1 cipher=ECDHE-RSA-AES256-SHA bits=256 verify=FAIL); Wed, 4 Nov 2015 15:23:28 GMT (envelope-from matt.churchyard@userve.net) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=userve.net; s=201508; t=1446650611; bh=MGWWaxmBMCizwSoJYLq2PhDr5MC9xZ3szf7q6KKKU2w=; h=From:To:CC:Subject:Date:References:In-Reply-To; b=dKJYWx7YgVocMaQvQzOQMOH4I/rYqRFdXM1ZC/aSeNWfeVIFIpM0bHzz589VWJfhq dpkiMzMqDSgXty48gnO9wChxmt162m++ht+Bh9ogvBJWTtup7cxGVnqzyrU6MFDEko khiZprWIQkYb7NAVtVZjmyriDJhpgRnv39LkEUy4= Received: from SERVER.ad.usd-group.com (192.168.0.1) by SERVER.ad.usd-group.com (192.168.0.1) with Microsoft SMTP Server (TLS) id 15.0.847.32; Wed, 4 Nov 2015 15:23:19 +0000 Received: from SERVER.ad.usd-group.com ([fe80::b19d:892a:6fc7:1c9]) by SERVER.ad.usd-group.com ([fe80::b19d:892a:6fc7:1c9%12]) with mapi id 15.00.0847.030; Wed, 4 Nov 2015 15:23:19 +0000 From: Matt Churchyard To: Larry Rosenman , Lars Engels CC: "owner-freebsd-virtualization@freebsd.org" , FreeBSD virtualization Subject: RE: C bhyve administration tool Thread-Topic: C bhyve administration tool Thread-Index: AQHRFoXM74mFoJK6AkqxRGclvqWnoJ6K6rKAgACvmZCAAFu4gIAAA3kw Date: Wed, 4 Nov 2015 15:23:18 +0000 Message-ID: References: <20151103221930.GA50869@debnath.net> In-Reply-To: Accept-Language: en-GB, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [192.168.0.10] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Nov 2015 15:23:44 -0000 >> Hello! >>=20 >> Couple months ago I started writing a bhyve management tool in C for=20 >> our startup, in preparation for migration to FreeBSD for our servers. >> The goal was to be able to create, drop, and auto-start/stop/restart=20 >> VMs, individually or all at once, and provide a plugin infrastructure=20 >> to expose some metrics / errors for reporting and aggregation. More=20 >> importantly it would detect errors/failures, report them and attempt=20 >> to restart the VM per assigned policy. >>=20 >> The effort stalled due to some high priority work that crept in. >> However, I am planning on restarting soon and wanted to check if=20 >> there was a need for something like this. I ran across Michael=20 >> Dexter's vmrc, and although its shell based, it does provide quite a=20 >> bit of features that we were looking for. There's also iohyve. And I=20 >> heard Peter and Neel are working on something as well. If there is=20 >> interest, this would be open sourced from the start. Or if there is=20 >> an existing effort that addresses these problems, I would love to=20 >> contribute to that project. >>=20 >> Thoughts, comments, concerns, please share. >>=20 >=20 >> vm-bhyve is most mature to this point IME, just don't use the ports=20 >> version. >=20 >> Adam >=20 > Thanks Adam :) >=20 > I could do with updating the port. Unfortunately this is my first=20 > porting experience so not exactly sure of the 'correct' channel to go=20 > through to get things updated. It took 2 months for my original port=20 > request to be addressed and I'm not sure re-opening that bug is the=20 > right way to do it. >=20 > If anyone uses the port, the error that gets printed when running 'vm=20 > init' can be completely ignored. It's just trying to load any existing=20 > virtual switches from the switch configuration file, and complaining=20 > that the switch configuration file doesn't exist. Apart from that and=20 > a few newer features/tweaks, I don't think there's anything=20 > particularly show-stopping about the current port/package if people=20 > prefer installing it that way to downloading from GitHub. >=20 > Of course it would still be interesting to see a "real" bhyve=20 > management tool (possibly even an official one) written in C. >=20 >to update an existing port, create a PR with the patch to update it, and t= hen wait. If a committer doesn't grab it within a reasonable time, post to= freebsd-ports to get their >attention. >Do run poudriere testport and provide the output. >--=20 >Larry Rosenman http://www.lerctr.org/~ler ------- >Hi Matt, >if you need someone to help you updating the port and get it committed, dr= op me a line and I'll help. >Lars Hi Lars, Larry Thanks both for your help. Once I'm sure I won't be making any changes 5 minutes after submitting it, = and don't have any other silly bugs scaring new users I will submit a PR. Matt From owner-freebsd-virtualization@freebsd.org Wed Nov 4 15:36:17 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5A8B1A26B86 for ; Wed, 4 Nov 2015 15:36:17 +0000 (UTC) (envelope-from trentnthompson@gmail.com) Received: from mail-lf0-x231.google.com (mail-lf0-x231.google.com [IPv6:2a00:1450:4010:c07::231]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id C1A171094 for ; Wed, 4 Nov 2015 15:36:16 +0000 (UTC) (envelope-from trentnthompson@gmail.com) Received: by lfbf136 with SMTP id f136so40701194lfb.0 for ; Wed, 04 Nov 2015 07:36:15 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=C5OP3qYyGvMRY4YXDFE1Do0ucgMNmpmZ3wRdq86ldZc=; b=hghMZVj12WZqJnLVxn4t17JlUSWJ0md9N+xBMf4gowx9lHlhJ3RQt3rsCBRwjpPP4r sw5YnqZ1rqZLId0gyIycq9YpfJg+PbZqREFx97i4d4228USdAqLmI18cosLENxJQKO0G XlUEtnoSdOk3vJEqRxXJ/eX78tlebITxzZG19ybJ9XCz2AVr6Jvi8xoipRP/rgpNwzP9 dO/X4ep7ZNeXCLEB5JvVqrQsUJuRJC+ZREpxeznl82ILKYYTh7Qqf58bTjZWVl4aF300 aLg9LFwMJWWZSfAesCLN3INTZ73+b9ry9sLuYiU3GXw5ayTzDwPfnCrxs4jpuE34fdev if+g== MIME-Version: 1.0 X-Received: by 10.25.162.5 with SMTP id l5mr446695lfe.70.1446651374902; Wed, 04 Nov 2015 07:36:14 -0800 (PST) Received: by 10.25.198.9 with HTTP; Wed, 4 Nov 2015 07:36:14 -0800 (PST) In-Reply-To: References: <20151103221930.GA50869@debnath.net> Date: Wed, 4 Nov 2015 08:36:14 -0700 Message-ID: Subject: Re: C bhyve administration tool From: Trent Thompson To: Shawn Debnath Cc: FreeBSD virtualization Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Nov 2015 15:36:17 -0000 Going back to the original message in the thread, yes, I think the more the merrier. I created iohyve to solve a problem I had. I wanted to store my bhyve VM's in ZFS. Matt C. created vm-bhyve to solve the problem of storing VM's in a manager that didn't use ZFS. Matt and I have traded ideas back and forth even though we maintain different managers. I think that is the most important thing we need to focus on, working together to get bhyve at the same level as KVM and other hypervisors. Throw it up on Github so we can prod and poke at it. I don't know much about C, but I am always willing to learn. -Trent (@pr1ntf) On Wed, Nov 4, 2015 at 2:47 AM, Matt Churchyard via freebsd-virtualization < freebsd-virtualization@freebsd.org> wrote: > > Hello! > > > > Couple months ago I started writing a bhyve management tool in C for > > our startup, in preparation for migration to FreeBSD for our servers. > > The goal was to be able to create, drop, and auto-start/stop/restart > > VMs, individually or all at once, and provide a plugin infrastructure > > to expose some metrics / errors for reporting and aggregation. More > > importantly it would detect errors/failures, report them and attempt > > to restart the VM per assigned policy. > > > > The effort stalled due to some high priority work that crept in. > > However, I am planning on restarting soon and wanted to check if there > > was a need for something like this. I ran across Michael Dexter's > > vmrc, and although its shell based, it does provide quite a bit of > > features that we were looking for. There's also iohyve. And I heard > > Peter and Neel are working on something as well. If there is interest, > > this would be open sourced from the start. Or if there is an existing > > effort that addresses these problems, I would love to contribute to that > project. > > > > Thoughts, comments, concerns, please share. > > > > >vm-bhyve is most mature to this point IME, just don't use the ports > version. > > > Adam > > Thanks Adam :) > > I could do with updating the port. Unfortunately this is my first porting > experience so not exactly sure of the 'correct' channel to go through to > get things updated. It took 2 months for my original port request to be > addressed and I'm not sure re-opening that bug is the right way to do it. > > If anyone uses the port, the error that gets printed when running 'vm > init' can be completely ignored. It's just trying to load any existing > virtual switches from the switch configuration file, and complaining that > the switch configuration file doesn't exist. Apart from that and a few > newer features/tweaks, I don't think there's anything particularly > show-stopping about the current port/package if people prefer installing it > that way to downloading from GitHub. > > Of course it would still be interesting to see a "real" bhyve management > tool (possibly even an official one) written in C. > > Matt > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to " > freebsd-virtualization-unsubscribe@freebsd.org" > From owner-freebsd-virtualization@freebsd.org Wed Nov 4 20:56:55 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B68CBA26778 for ; Wed, 4 Nov 2015 20:56:55 +0000 (UTC) (envelope-from andrnils@gmail.com) Received: from mail-wm0-x231.google.com (mail-wm0-x231.google.com [IPv6:2a00:1450:400c:c09::231]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 447A819AC for ; Wed, 4 Nov 2015 20:56:55 +0000 (UTC) (envelope-from andrnils@gmail.com) Received: by wmeg8 with SMTP id g8so120924363wme.0 for ; Wed, 04 Nov 2015 12:56:53 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=ZarenSH1jSJk/JOQRXhJwI8eM7gA3Tw5iORyjIdXf6c=; b=fsAx7XsMm/FhBt7WRTvtnNPvw4w0coS+3jJxNeiBv+AFRTEGcazZhOwG41vOOJ612g oJscJwpTErj2lKjFkQe+bR0qjIRoq7lvC/P8nj8CtSOZ3Pb/iZiqN5jw712LsDztFqQ1 1WCChZiitLa5prKUokwpn2kiSKR4IUVzrYSMeEfTr95H8SdVJDtS/SsOxixRGyQeKz5X o3ZlppVaDowRNggs1QIZl7a1RmjO8RRTybu7DNYt3qN0GqjDZhC7LVZ8SzbFwqUGj/ou DCLIipGLWiky1UKu5uhv0EqzHHmLAsuDQ2KOrZZW68awzhbWGjidDgp0Ssrr+AgNRImW E4Mw== MIME-Version: 1.0 X-Received: by 10.28.218.7 with SMTP id r7mr5432601wmg.17.1446670613759; Wed, 04 Nov 2015 12:56:53 -0800 (PST) Received: by 10.28.2.194 with HTTP; Wed, 4 Nov 2015 12:56:53 -0800 (PST) In-Reply-To: References: <20151103221930.GA50869@debnath.net> Date: Wed, 4 Nov 2015 21:56:53 +0100 Message-ID: Subject: Re: C bhyve administration tool From: Andreas Nilsson To: Trent Thompson Cc: Shawn Debnath , FreeBSD virtualization Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Nov 2015 20:56:55 -0000 Well, in all honesty, getting vm managers to kvm equivalents ( ie virt-manager ) should not be a goal. virt-manager and friends are terrible. Please envision something better! Where it is hosted and what language it is written in doesn't really matter. Just my 2 cents. Best regards Andreas On Wed, Nov 4, 2015 at 4:36 PM, Trent Thompson wrote: > Going back to the original message in the thread, yes, I think the more the > merrier. > I created iohyve to solve a problem I had. I wanted to store my bhyve VM's > in ZFS. > Matt C. created vm-bhyve to solve the problem of storing VM's in a manager > that didn't use ZFS. > Matt and I have traded ideas back and forth even though we maintain > different managers. > I think that is the most important thing we need to focus on, working > together to get bhyve at the same level as KVM and other hypervisors. > > Throw it up on Github so we can prod and poke at it. I don't know much > about C, but I am always willing to learn. > > -Trent (@pr1ntf) > > On Wed, Nov 4, 2015 at 2:47 AM, Matt Churchyard via freebsd-virtualization > < > freebsd-virtualization@freebsd.org> wrote: > > > > Hello! > > > > > > Couple months ago I started writing a bhyve management tool in C for > > > our startup, in preparation for migration to FreeBSD for our servers. > > > The goal was to be able to create, drop, and auto-start/stop/restart > > > VMs, individually or all at once, and provide a plugin infrastructure > > > to expose some metrics / errors for reporting and aggregation. More > > > importantly it would detect errors/failures, report them and attempt > > > to restart the VM per assigned policy. > > > > > > The effort stalled due to some high priority work that crept in. > > > However, I am planning on restarting soon and wanted to check if there > > > was a need for something like this. I ran across Michael Dexter's > > > vmrc, and although its shell based, it does provide quite a bit of > > > features that we were looking for. There's also iohyve. And I heard > > > Peter and Neel are working on something as well. If there is interest, > > > this would be open sourced from the start. Or if there is an existing > > > effort that addresses these problems, I would love to contribute to > that > > project. > > > > > > Thoughts, comments, concerns, please share. > > > > > > > >vm-bhyve is most mature to this point IME, just don't use the ports > > version. > > > > > Adam > > > > Thanks Adam :) > > > > I could do with updating the port. Unfortunately this is my first porting > > experience so not exactly sure of the 'correct' channel to go through to > > get things updated. It took 2 months for my original port request to be > > addressed and I'm not sure re-opening that bug is the right way to do it. > > > > If anyone uses the port, the error that gets printed when running 'vm > > init' can be completely ignored. It's just trying to load any existing > > virtual switches from the switch configuration file, and complaining that > > the switch configuration file doesn't exist. Apart from that and a few > > newer features/tweaks, I don't think there's anything particularly > > show-stopping about the current port/package if people prefer installing > it > > that way to downloading from GitHub. > > > > Of course it would still be interesting to see a "real" bhyve management > > tool (possibly even an official one) written in C. > > > > Matt > > _______________________________________________ > > freebsd-virtualization@freebsd.org mailing list > > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > > To unsubscribe, send any mail to " > > freebsd-virtualization-unsubscribe@freebsd.org" > > > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to " > freebsd-virtualization-unsubscribe@freebsd.org" > From owner-freebsd-virtualization@freebsd.org Wed Nov 4 22:19:29 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5D17DA265D4 for ; Wed, 4 Nov 2015 22:19:29 +0000 (UTC) (envelope-from vixie@tisf.net) Received: from family.redbarn.org (family.redbarn.org [IPv6:2001:559:8000:cd::5]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4AC671C50 for ; Wed, 4 Nov 2015 22:19:29 +0000 (UTC) (envelope-from vixie@tisf.net) Received: from linux-85bq.suse (c-67-180-164-69.hsd1.ca.comcast.net [67.180.164.69]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by family.redbarn.org (Postfix) with ESMTPSA id 5D75113B25; Wed, 4 Nov 2015 22:19:28 +0000 (UTC) From: Paul Vixie To: freebsd-virtualization@freebsd.org Subject: Re: C bhyve administration tool Date: Wed, 04 Nov 2015 14:19:27 -0800 Message-ID: <1557160.7OrEWMRSrv@linux-85bq.suse> Organization: TISF User-Agent: KMail/4.14.10 (Linux/4.1.12-1-default; KDE/4.14.10; x86_64; ; ) In-Reply-To: References: <20151103221930.GA50869@debnath.net> MIME-Version: 1.0 Content-Transfer-Encoding: 7Bit Content-Type: text/plain; charset="us-ascii" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Nov 2015 22:19:29 -0000 On Wednesday, November 04, 2015 09:56:53 PM Andreas Nilsson wrote: > Well, > > in all honesty, getting vm managers to kvm equivalents ( ie virt-manager ) > should not be a goal. virt-manager and friends are terrible. Please > envision something better! > > Where it is hosted and what language it is written in doesn't really matter. > > Just my 2 cents. i'll add a nickel to those thoughts. libvirt isn't a library, virsh isn't a shell, and it all sucks so bad it blows. bhyve deserves something new. -- P. Vixie From owner-freebsd-virtualization@freebsd.org Thu Nov 5 08:28:21 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6504DA25928 for ; Thu, 5 Nov 2015 08:28:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 504C9187B for ; Thu, 5 Nov 2015 08:28:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id tA58SLmU063430 for ; Thu, 5 Nov 2015 08:28:21 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-virtualization@FreeBSD.org Subject: [Bug 203884] bhyve exits with assert when vcpu already in use Date: Thu, 05 Nov 2015 08:28:21 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 10.2-STABLE X-Bugzilla-Keywords: patch X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: commit-hook@freebsd.org X-Bugzilla-Status: In Progress X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-virtualization@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Nov 2015 08:28:21 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=203884 --- Comment #7 from commit-hook@freebsd.org --- A commit references this bug: Author: ngie Date: Thu Nov 5 08:27:45 UTC 2015 New revision: 290386 URL: https://svnweb.freebsd.org/changeset/base/290386 Log: MFC r289746: Exit with a user-friendly message instead of tripping an assert if vm_activate_cpu(..) fails when called from fbsdrun_addcpu(..) PR: 203884 Reviewed by: grehan Submitted by: William Orr Changes: _U stable/10/ stable/10/usr.sbin/bhyve/bhyverun.c -- You are receiving this mail because: You are the assignee for the bug. From owner-freebsd-virtualization@freebsd.org Thu Nov 5 17:37:24 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C954BA276B5 for ; Thu, 5 Nov 2015 17:37:24 +0000 (UTC) (envelope-from bogorodskiy@gmail.com) Received: from mail-lb0-x231.google.com (mail-lb0-x231.google.com [IPv6:2a00:1450:4010:c04::231]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DD631E6C; Thu, 5 Nov 2015 17:37:24 +0000 (UTC) (envelope-from bogorodskiy@gmail.com) Received: by lbbkw15 with SMTP id kw15so34853498lbb.0; Thu, 05 Nov 2015 09:37:22 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=sender:date:from:to:cc:subject:message-id:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; bh=ZhrtWQt5QLZ6u5etvtRJHKvsU5gV1/YT7Qevv42tyHE=; b=tpAGNkr4tpRdEWwoQrLFaJ7w/Erz2JBL0b+6NYE1AcUrzVXxQ6edUfco3daxYvKVX4 I0vjaHwUYIaVe2gNJzQw2DuuA82MP0heS36dXYTMbxJBASjFKu2tezPaJRz906qjatXt 7ZHHdjRATrEkRJrqh1Js42hrjhHmQms6fERNQm7Xy9n2wuAoYJ+Ud5KrBNK1zrkFazPm E7nxvtIJsQBa61mRXDHP5olM4AzhnqzLFB1Ofo1NPlBtYRKRE4jNIKqRXvC79jJKgsuP lANtBXg5SKdPT6rcPbed+kI2D7B6ZG0/KNyRvvD/ZytZegqlHftmADe24fOtIUuo1EjX 9YGg== X-Received: by 10.112.35.196 with SMTP id k4mr4493291lbj.3.1446745042279; Thu, 05 Nov 2015 09:37:22 -0800 (PST) Received: from kloomba.lvv.mirantis.net ([213.147.219.128]) by smtp.gmail.com with ESMTPSA id b199sm677983lfe.28.2015.11.05.09.37.21 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 05 Nov 2015 09:37:21 -0800 (PST) Sender: Roman Bogorodskiy Date: Thu, 5 Nov 2015 20:37:18 +0300 From: Roman Bogorodskiy To: Peter Grehan Cc: "freebsd-virtualization@freebsd.org" Subject: Re: Illumos support in bhyve Message-ID: <20151105173717.GB2025@kloomba.lvv.mirantis.net> References: <56118B2B.2040101@freebsd.org> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="s/l3CgOIzMHHjg/5" Content-Disposition: inline In-Reply-To: <56118B2B.2040101@freebsd.org> User-Agent: Mutt/1.5.24 (2015-08-30) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Nov 2015 17:37:25 -0000 --s/l3CgOIzMHHjg/5 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Peter Grehan wrote: > To follow up on the previous post, with the UEFI support introduced in=20 > r288524, bhyve can now boot Illumos since there is a working BIOS. >=20 > This has been tested with SmartOS and also OpenIndiana and OmniOS,=20 > though I've not been able to work out how to enable serial console=20 > support for the latter two post-install. >=20 > The best bet is the most recent SmartOS: > =20 > https://us-east.manta.joyent.com/Joyent_Dev/public/SmartOS/smartos-latest= =2Eiso >=20 > Grab the UEFI build with CSM/BIOS enabled: > http://people.freebsd.org/~grehan/bhyve_uefi/BHYVE_UEFI_CSM_20151002= =2Efd >=20 > An example command line is: >=20 > bhyve \ > -c 2 \ > -s 3,ahci-cd,/path/to/smartos-20151001T070028Z.iso \ > -s 4,ahci-hd,/path/to/smartos.img \ > -s 5,virtio-net,tap0 \ > -s 31,lpc \ > -l com1,/dev/nmdm0A \ > -l com2,/dev/nmdm1A \ > -l bootrom,/path/to/BHYVE_UEFI_CSM_20151002.fd \ > -m 2G -H smartos >=20 > UEFI/CSM debug output is on com1, grub1 is on com2, install is on com1.= =20 > On a reboot after install, login sessions are enabled for both com1 and= =20 > com2. >=20 > Many thanks to Andriy Gapon for helping out with debug, and Ben Perrault= =20 > for giving it a good shakeout. Hi Peter, I tried this instruction and I was able to get into smartos installation. I choose all the default options there, it reported successful installation. Then I dropped 'ahci-cd' part, but I cannot get smartos boot. I can see on nmdm0B the following: Legacy INT19 Boot... And that's all. And there's nothing on nmdm1B. My command is: bhyve -c 2 -s 4,ahci-hd,/home/novel/smartos.img -s 5,virtio-net,tap0 -s 31,lpc -l com1,/dev/nmdm0A -l com2,/dev/nmdm1A -l bootrom,/home/novel/uefi/BHYVE_UEFI_CSM_20151002.fd -m 2G -H smartos ^T reports: load: 1.17 cmd: bhyve 4821 [running] 2461.38r 347.75u 2109.83s 100% 7580k And, by the way, is it possible to run FreeBSD using UEFI? I encountered problems with that as well: https://lists.freebsd.org/pipermail/freebsd-virtualization/2015-November/00= 3904.html Any hints how to debug this are appreciated. Thanks, Roman Bogorodskiy --s/l3CgOIzMHHjg/5 Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEcBAEBAgAGBQJWO5PNAAoJEMltX/4IwiJqdv4IAJEp1BmuUev/GwZuFBtsknpo dtucNols2Di+H7LfSqhqNUnxedEDIuiMbn+fFsK+aZlUM6oILsNpD+6nnJerriM4 1BUOLs39cv07vkXykCp/SxNc8N0ExcysXJBXf8olyQ5iOoTaNZvYBh3PzBuzpTDA K9pOwCCGjbuXyvQ19Yd+aopW9KGthntE485BdTeBjOQ5TCjuCNMAIYNJ1VAcqS1P wspcHVIwiEWI7066xe+iEbWsGlnZ4ut9fgZ7g4Ageasjo8YoZ/l51BzqCMbj193J iKtpTB20b2okBNKyST69CzhpueaEtnNWGm5M9m2qVA7EXwi5YBMpGctv3gHceOg= =FstA -----END PGP SIGNATURE----- --s/l3CgOIzMHHjg/5-- From owner-freebsd-virtualization@freebsd.org Thu Nov 5 18:15:07 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B96DEA27D90 for ; Thu, 5 Nov 2015 18:15:07 +0000 (UTC) (envelope-from shawn@debnath.net) Received: from na01-bn1-obe.outbound.protection.outlook.com (mail-bn1on0088.outbound.protection.outlook.com [157.56.110.88]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "MSIT Machine Auth CA 2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 5FA2A141A for ; Thu, 5 Nov 2015 18:15:06 +0000 (UTC) (envelope-from shawn@debnath.net) Authentication-Results: spf=none (sender IP is ) smtp.mailfrom=shawn@debnath.net; Received: from debnath.net (2601:602:8500:73b:9cf6:8489:4d1e:ec9a) by DM2PR05MB366.namprd05.prod.outlook.com (10.141.98.25) with Microsoft SMTP Server (TLS) id 15.1.306.13; Thu, 5 Nov 2015 18:14:57 +0000 Date: Thu, 5 Nov 2015 10:14:52 -0800 From: Shawn Debnath To: Paul Vixie CC: Subject: Re: C bhyve administration tool Message-ID: <20151105181450.GA71547@debnath.net> References: <20151103221930.GA50869@debnath.net> <1557160.7OrEWMRSrv@linux-85bq.suse> MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Disposition: inline In-Reply-To: <1557160.7OrEWMRSrv@linux-85bq.suse> User-Agent: Mutt/1.5.24 (2015-08-30) X-Originating-IP: [2601:602:8500:73b:9cf6:8489:4d1e:ec9a] X-ClientProxiedBy: CO2PR03CA0047.namprd03.prod.outlook.com (10.141.194.174) To DM2PR05MB366.namprd05.prod.outlook.com (10.141.98.25) X-Microsoft-Exchange-Diagnostics: 1; DM2PR05MB366; 2:OllhmSPlRSQ8C+wWGippqHA3bEt+Rl+tUeF/gCDdSOWyPTfJkY7j8oqO4P9cuoBodkdYtKKjbDQMIVF+7XWTLJb5GH/ibV5+w3kpNeMxG4egRUULFPZbSH0bXDkWFiA/Cd9o3A6hed3jeVWftt4vhY7V3hmTXx1scYDFcRSQ0vs=; 3:1UoLx2150CTfPWsEQbC9XaoNcW7HF1plYn+rKeTD+kTMd/nZcKL9qJpe1tpx7KSJQHzSQpmur6s8ysdp5wGE9VvGwWzDXGoHYi4Ted1LSbMCiKcCdDjwhAuYMvg+o3woIl1Eonc8waepAlmZgCggPXsqMuOHYWHWUsZTov3t4sT/GijNkIKm9tI+IRWNMNCJ; 25:47yeDtwniCCEyETdMSbTWpTNATKgk9QYJaZ9VfPliT1a8u5qiNKVfITWXqPPt9iVanXKohxioCZI9XOf9ywuatKtatbnRLpAaMeAZOxnPb43T99bh6Mfhl9Ae1PfXTM9r6dDO6/EM9Wfiz8Pd9V48dTQN0cCLdRs4YM60erScTC4vuUkTSaEGxnYXcFV9Gz4ZhtTv4X3CQl550ukLxeihbh8EUy4IdpVcbIGQTTJHiiBSsg32+lVIxKHPfr9qBiHwGc3CY8dKiDa1kavc++rzA== X-Microsoft-Antispam: UriScan:; BCL:0; PCL:0; RULEID:(42134001)(42139001); SRVR:DM2PR05MB366; X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:; X-Exchange-Antispam-Report-CFA-Test: BCL:0; PCL:0; RULEID:(601004)(2401047)(520078)(5005006)(8121501046)(10201501046)(3002001); SRVR:DM2PR05MB366; BCL:0; PCL:0; RULEID:; SRVR:DM2PR05MB366; X-Microsoft-Exchange-Diagnostics: 1; DM2PR05MB366; 4:P2eIqhEPuZx0ewQHe9R3ChbWSJKFARYkxpP8RH3mXSgzf5PiAgj21tYYYx3jHoMMdZGunJkWCtp/u1j3tkFGt6Hea0ZlLtaJcW2ClcofqGSDdSRVxdY150l1qYih7+SywEngbB5sHvQWg6bSBC2NEVWaDoiREHkqFPD+79+abAjyBGxAiBPJTVHsx+1Yk6znnMx1i6UDS4I5xtt9gq5ymlaPgmleIQLo15Vtt7LG2ov3SUK5jjJGQp2lzb8x4WWmYbh/fxwXsijnQcg3kg45jUbJoumz2E7WW7jqVPf/tVu1VVNePuWUHTYywLL89OqR78b10u39ulwvFBTc/owBBF9frCUPl6xqYn6Xxqbm/lknj3fZfwxBB8PW2BiO8kXq X-Forefront-PRVS: 0751474A44 X-Forefront-Antispam-Report: SFV:NSPM; SFS:(10009020)(6009001)(199003)(377454003)(189002)(164054003)(24454002)(479174004)(5007970100001)(50986999)(5008740100001)(92566002)(105586002)(87976001)(47776003)(21086003)(4001350100001)(101416001)(97736004)(81156007)(5004730100002)(106356001)(76176999)(36756003)(122386002)(54356999)(50466002)(77096005)(19580395003)(33656002)(110136002)(69596002)(93886004)(2950100001)(83506001)(189998001)(19580405001)(42186005)(23676002)(40100003)(86362001)(15975445007)(5001960100002)(3826002); DIR:OUT; SFP:1101; SCL:1; SRVR:DM2PR05MB366; H:debnath.net; FPR:; SPF:None; PTR:InfoNoRecords; A:1; MX:1; LANG:en; Received-SPF: None (protection.outlook.com: debnath.net does not designate permitted sender hosts) X-Microsoft-Exchange-Diagnostics: =?utf-8?B?MTtETTJQUjA1TUIzNjY7MjM6WXl6d1ZCSXBPNCs4dExXNXA3Z1lzc2thOVRp?= =?utf-8?B?UURKbVNQTGswTnlEM3l2RzBMTFk1QnU4VVkrY2hqSE9zWkR5UUJtQmxwclZW?= =?utf-8?B?cXo2VmdUU2dNZE5WVGR3MWM2bzc5UVpiTUxBRlZ1cDlKYVFoK2pTYzhUcHR4?= =?utf-8?B?TjJ3ZnRtUEd5c3lsdmt5cnp3c09GS2JrNFNuUkY5K09YVklBMThqaHlDanRS?= =?utf-8?B?U3VtMXBqdk1JL2hKSmhjUzlaM0FnUWZlN2trbVNoTWFSL2pKVDBmelFsZ2hK?= =?utf-8?B?bVFteVJIVDVkbFBFQ0hMY0t1Nk9BQWpWeDRydmRLK0c1ODJ0elY4SE00VjYy?= =?utf-8?B?Y2JXdG5FVjBUSlFQbzUzVWdxMHJ1bmlqWjJZcXg2dkVnNmxWVnpVVGs3UGYr?= =?utf-8?B?YXhwRU9BRDRyc25zaGczNXBMMHVzVWtCZDhILzZvc2VFY1BhSHdJZ2VGc3Nq?= =?utf-8?B?a2pVVGU3U01wRmdCeGNWZFozZEVFc1E2WFJwRTlCV2Jjc2dBRVJZUm5wTW5q?= =?utf-8?B?NWo3aTBVODdhdXlWMTYwM1psRHRVeGt1dlY1cldiVk82aEFrdXZMODZIOXNj?= =?utf-8?B?SjV3N0hTcndwMjF1dUN3N1hrdjJnc0VvcUFOemFiUUlvT1NIVVhqRWlMbVBX?= =?utf-8?B?UVgrd2U3aTE2Mjk1cXNXeW9heldBUDdreng5OWZieG9seW1ZVUZnS2IrYjh6?= =?utf-8?B?czhsNitPYmlHdGFTeElzWGhVZk1SekxHcGJpU0g4RHdmSnpWYUFzV0FGTjM0?= =?utf-8?B?S3c0eFFVUkNmdlBRaHFNbXJCRWsvdjQrbUx6YUhwUkVlRXdrR29vS1VvVkRX?= =?utf-8?B?WGVoM1BrVGd5eW5xckNDdGMrL2hhc3FiRmtKTzExVitYd1hsYnhyUHJEOFpi?= =?utf-8?B?Mnl0Y04zeEJiZkZRdjdyYnI1c0FLTlNReDIzYXFVWXdmbldhRDZLZS9vVDBk?= =?utf-8?B?WERkZXhKTEpDVG8rZ08vckh6ckh1WkE0aVhkLy9JakIzUElXVDBxY1BSc3Zi?= =?utf-8?B?RzJBdjByL0dEUVZFNHN5b01jN3F5ZzRrZGltS2ozOGFVakxjZE1aOU5uMk5s?= =?utf-8?B?SS9OT1d6VHIxT1IvazBNWlBkYmVoZHg3MC9qZlZQdjVmTDBIbExuNEpHaTlx?= =?utf-8?B?RlBaV0pQTVI2dDhJUGlxeVg1N1I1ZjBESStBZGdUQ1VKWDJUWFMzRlpoYm5l?= =?utf-8?B?T1NvZnlCclhtYXB2NmhWNHZSMUw1Yi9PNUVrUmlVT2YySm5qSWJib1h2VWRE?= =?utf-8?B?eXV6NitwYVZ1K2RYakZYaWh3MzlCUnUzNjhqaXFrb2hhbzFZT09kRDJualhh?= =?utf-8?B?Y1Y0amxJWitxVjBaZHpTeWZZbWMvRUx4N2ZXeC9TT29xbjV5L2kyVnRlYWVj?= =?utf-8?B?Yjg2Qk14alcvcW9FbURsa040ZjJrK1dnRDk0cU1XamtMaEdqeTB4anJUUmd3?= =?utf-8?B?Z0JJSjZlbFRDZ1BlZkpqWExJZm9ibkxCMkNqL2tuK1krbENjMHE2RjhMRldD?= =?utf-8?B?TEZobzNrSGVsSURhd1E1SmN5cndpdE9ORzczZnFPZTBlQXlXdkxjZ1ZNUjRh?= =?utf-8?B?bTZMM1RScG5DcnVUZWNKRytPNjF1QT09?= X-Microsoft-Exchange-Diagnostics: 1; DM2PR05MB366; 5:tELGUDlg+7tPSd7uWHLyZlB+V+52x+hZQO7KRO3tLagL+fppB6EkJBLPkR3nm55rC2GLLQI0cICvm2jJpLkSzDOLEQNd3F9AU8S1XnM/lKAx5AJ4yAmXgGwy7NXrs8HxF0gHxPHpxLbri4XbXaS6mw==; 24:c1/HKJ7QScjWvTd5W1nD9HAnLvWC/wAOYK9puhqeIHTQnJdT6vHEl2rfKYqfXm9oIQZBbfEy37v/7HPWWNfifF4KbAzFsX7lWsg4jM9i2J0=; 20:G2UQH+rs5GuanvmhBa3qlaOEwiccFSJCYI7VKG523sZ5PEy+oNvF4Q1yWlb0wxmMNf7ESCPUxLyKrdjniJqL8Q== SpamDiagnosticOutput: 1:23 SpamDiagnosticMetadata: NSPM X-OriginatorOrg: debnath.net X-MS-Exchange-CrossTenant-OriginalArrivalTime: 05 Nov 2015 18:14:57.5652 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM2PR05MB366 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Nov 2015 18:15:07 -0000 Great feedback and thank you. Looks like it might not hurt to continue the work, at least for now. My reasoning for a C based tool was to be able to use libvmmapi to get deeper integration with the bhyve framework. Let's see how things go. I will work on getting the basics functioning and get a build out. Folks can try it out, and if there's interest, we can talk about what would a good local bhyve administration tool should look like. Seems like there are at least a few people with ideas they would like to see implemented. The basics can be easily re-factored so this effort won't be wasted. The initial features will mimic iohyve and vmrc with more or less the same cmdline usage: 1. Build a VM based on configuration (simple to start, UCL is the goal) 2. Start/stop/restart VM (Attempt graceful shutdown, option for forced) 3. StartAll/StopAll/RestartAll VMs 4. List basic status of VMs 5. Destroy a VM Won't be dealing with ZFS management yet. Thanks, Shawn Paul Vixie on 11/04/2015 14:19 wrote: > On Wednesday, November 04, 2015 09:56:53 PM Andreas Nilsson wrote: > > Well, > > > > in all honesty, getting vm managers to kvm equivalents ( ie virt-manager ) > > should not be a goal. virt-manager and friends are terrible. Please > > envision something better! > > > > Where it is hosted and what language it is written in doesn't really matter. > > > > Just my 2 cents. > > i'll add a nickel to those thoughts. libvirt isn't a library, virsh isn't a > shell, and it all sucks so bad it blows. bhyve deserves something new. > > -- > P. Vixie > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@freebsd.org" -- Shawn From owner-freebsd-virtualization@freebsd.org Thu Nov 5 22:59:38 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 053E8A27152 for ; Thu, 5 Nov 2015 22:59:38 +0000 (UTC) (envelope-from crodr001@gmail.com) Received: from mail-yk0-x231.google.com (mail-yk0-x231.google.com [IPv6:2607:f8b0:4002:c07::231]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id B7DF518FA for ; Thu, 5 Nov 2015 22:59:37 +0000 (UTC) (envelope-from crodr001@gmail.com) Received: by ykdv3 with SMTP id v3so69977599ykd.0 for ; Thu, 05 Nov 2015 14:59:37 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type; bh=qYVlpZ6yQbQO5MlLftoDzZRyeSuL6jFkM0R3+V9WxhY=; b=n49WYfcsb7HNZBGgh7JprcIYxOgMCduWTuEKQKccWAWBd7JHsvjmEaD2Cia/DGlRyi n/SYx/LjCon2KsCPumC10h5kjxiO2LSU1vEaevWXarM+um5UmK/AF7/dV6OA11HeTpO9 AuYw/wjO5dPDYUvv8TgjGYAUjxf5ZyJ5OK7PRZ7U2UJY3G+IRS8G7kOUlgTCiREcs7rr pTFOQo4+zzaYKbglhuuZWxOOZ3IvEfqjGUrGD3HVamtiMhM37aikUpC7rzxH/IrbChsf cU7g8uvD3a3bewrxxSAFdMLldUnpKFW40gGn9ozEPg1JYSEX5ZgLl1J7SAgmnvNyQzQa sQ+Q== MIME-Version: 1.0 X-Received: by 10.129.115.139 with SMTP id o133mr8545942ywc.172.1446764376919; Thu, 05 Nov 2015 14:59:36 -0800 (PST) Sender: crodr001@gmail.com Received: by 10.37.95.9 with HTTP; Thu, 5 Nov 2015 14:59:36 -0800 (PST) In-Reply-To: <20151105181450.GA71547@debnath.net> References: <20151103221930.GA50869@debnath.net> <1557160.7OrEWMRSrv@linux-85bq.suse> <20151105181450.GA71547@debnath.net> Date: Thu, 5 Nov 2015 14:59:36 -0800 X-Google-Sender-Auth: 3NKhkiX1gtnOHmcM7dQZSuCvhiQ Message-ID: Subject: Re: C bhyve administration tool From: Craig Rodrigues To: Shawn Debnath Cc: "freebsd-virtualization@freebsd.org" Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Nov 2015 22:59:38 -0000 Shawn, Go forth and conquer and happy hacking! It is quite clear that vmrun.sh, /usr/sbin/bhyve, /usr/sbin/bhyveload are very simplistic and fall apart under more advanced usage. It looks like there are many parallel efforts where people are writing their own scripts and utilities on top of bhyve. At my previous job, I wrote a bunch of stuff in Python, and used a JSON config file to specify the properties of a VM. By using a JSON config file, I was able to specify more advanced topologies of many VM's running together, including the network configuration, and PCI-Passthru. The unfortunate thing when people write these scripts is sometimes this stuff is internal, and people cannot collaborate. Hopefully by having your stuff on GitHub, people can work together and improve things. I would encourage you to use UCL as early as possible. Adding lots of command-line options to vmrun.sh is doable, but gets a bit clunky. I would also encourage you to look at the bhyveucl work done by Allan Jude: https://github.com/allanjude/bhyveucl I think it would be nice if we had a common config file format for bhyve VM's based off of UCL. That way even if people decide to use their own scripts or utilities, at least they can reuse the config files, instead of cobbling together their own stuff which is overlapping in functionality, but is incompatible. -- Craig On Thu, Nov 5, 2015 at 10:14 AM, Shawn Debnath wrote: > > 1. Build a VM based on configuration (simple to start, UCL is the goal) > 2. Start/stop/restart VM (Attempt graceful shutdown, option for forced) > 3. StartAll/StopAll/RestartAll VMs > 4. List basic status of VMs > 5. Destroy a VM > > From owner-freebsd-virtualization@freebsd.org Fri Nov 6 00:32:08 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 364FCA25954 for ; Fri, 6 Nov 2015 00:32:08 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from alto.onthenet.com.au (alto.OntheNet.com.au [203.13.68.12]) by mx1.freebsd.org (Postfix) with ESMTP id E44FE12A0 for ; Fri, 6 Nov 2015 00:32:07 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from iredmail.onthenet.com.au (iredmail.onthenet.com.au [203.13.68.150]) by alto.onthenet.com.au (Postfix) with ESMTPS id D893B20FEBC6 for ; Fri, 6 Nov 2015 10:31:59 +1000 (AEST) Received: from localhost (iredmail.onthenet.com.au [127.0.0.1]) by iredmail.onthenet.com.au (Postfix) with ESMTP id CF23E282027 for ; Fri, 6 Nov 2015 10:31:59 +1000 (AEST) X-Amavis-Modified: Mail body modified (using disclaimer) - iredmail.onthenet.com.au Received: from iredmail.onthenet.com.au ([127.0.0.1]) by localhost (iredmail.onthenet.com.au [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id VklLiTfVPirn for ; Fri, 6 Nov 2015 10:31:59 +1000 (AEST) Received: from busmail.onthenet.com.au (iredmail.onthenet.com.au [127.0.0.1]) by iredmail.onthenet.com.au (Postfix) with ESMTPSA id A13BB280F8B; Fri, 6 Nov 2015 10:31:59 +1000 (AEST) MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII; format=flowed Content-Transfer-Encoding: 7bit Date: Thu, 05 Nov 2015 16:31:59 -0800 From: grehan@freebsd.org To: Roman Bogorodskiy Cc: freebsd-virtualization@freebsd.org, Roman Bogorodskiy Subject: Re: Illumos support in bhyve In-Reply-To: <20151105173717.GB2025@kloomba.lvv.mirantis.net> References: <56118B2B.2040101@freebsd.org> <20151105173717.GB2025@kloomba.lvv.mirantis.net> Message-ID: X-Sender: grehan@freebsd.org User-Agent: OntheNet Business Mail X-CMAE-Score: 0 X-CMAE-Analysis: v=2.1 cv=B9IZqLZM c=1 sm=1 tr=0 a=A6CF0fG5TOl4vs6YHvqXgw==:117 a=3FMX7HLxAAAA:8 a=6I5d2MoRAAAA:8 a=wkc5CHvUAAAA:8 a=kj9zAlcOel0A:10 a=qtqOOiqGOCEA:10 a=q78Xq7Gim28WaegqQrkA:9 a=CjuIK1q_8ugA:10 a=Sb2ziR56aZkA:10 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 06 Nov 2015 00:32:08 -0000 Hi Roman, > I tried this instruction and I was able to get into smartos > installation. I choose all the default options there, it reported > successful installation. Then I dropped 'ahci-cd' part, but I cannot > get > smartos boot. For smartos, the CD should always be left there since that's the boot media. The first boot just detects that the hard drive is empty which triggers the install. > And, by the way, is it possible to run FreeBSD using UEFI? > > I encountered problems with that as well: > > https://lists.freebsd.org/pipermail/freebsd-virtualization/2015-November/003904.html > > Any hints how to debug this are appreciated. The VM images don't include the UEFI loader. You'll have to boot from the ISO for that, and force serial console output at the loader prompt. later, Peter. From owner-freebsd-virtualization@freebsd.org Fri Nov 6 02:53:49 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C5149A27212 for ; Fri, 6 Nov 2015 02:53:49 +0000 (UTC) (envelope-from shawn@debnath.net) Received: from na01-by2-obe.outbound.protection.outlook.com (mail-by2on0058.outbound.protection.outlook.com [207.46.100.58]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "MSIT Machine Auth CA 2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 572191927; Fri, 6 Nov 2015 02:53:48 +0000 (UTC) (envelope-from shawn@debnath.net) Authentication-Results: spf=none (sender IP is ) smtp.mailfrom=shawn@debnath.net; Received: from debnath.net (2601:602:8500:73b:9cf6:8489:4d1e:ec9a) by CO1PR05MB361.namprd05.prod.outlook.com (10.141.51.148) with Microsoft SMTP Server (TLS) id 15.1.312.18; Fri, 6 Nov 2015 02:38:44 +0000 Date: Thu, 5 Nov 2015 18:38:36 -0800 From: Shawn Debnath To: Craig Rodrigues CC: "freebsd-virtualization@freebsd.org" Subject: Re: C bhyve administration tool Message-ID: <20151106023835.GA72293@debnath.net> References: <20151103221930.GA50869@debnath.net> <1557160.7OrEWMRSrv@linux-85bq.suse> <20151105181450.GA71547@debnath.net> MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.24 (2015-08-30) X-Originating-IP: [2601:602:8500:73b:9cf6:8489:4d1e:ec9a] X-ClientProxiedBy: CO2PR03CA0029.namprd03.prod.outlook.com (10.141.194.156) To CO1PR05MB361.namprd05.prod.outlook.com (10.141.51.148) X-Microsoft-Exchange-Diagnostics: 1; CO1PR05MB361; 2:PdJAmABgdWo/Bfa3zrgy/E22YX7+cp97d0aaXjCPlHEEIp/nBY9fCCePdbl3DtKox5qd71q8j2EJKbEN/B+78thGYW5J10olWKvG6SiCWsXcKNaAHA6ut79F5QyZRZcnzygyQCRO/mRYqN+Mt6BQO4zSwYqXRFa6jQlX/XR7J9Y=; 3:ifUg2QM0oze4/X7uYPa36LN7KNarBApLktYzB1SeYC1h6QDgHEXLEdpP9AZZlNX62LVXH1kTEK4R3Q/wTnavkGqNg8h+kfRUnUUbmf7qV4+LhGNuo4g6MhccSNofHlntgB0/c6nXwyE039pjANOSPQ==; 25:YBKAgxVaAbj3vZF4suNZjYmJ7x4VhYB6ljNTJei2Tl4uxo2YAta7ifB7Kx9SrF1qcUHVH69ctKvX6lPqM5e16a9QKyxeJo9h7Yhvwh++wTF09+AkkiQNeoWbp5v3SzQhHWQD6oDsktZjDHuq4MKJmUfkQtqyrwzqNfe0euhFWEi5JxKMMDXmXFa7XVUyX4mYBNR3LTO0aY9pDE5+XSdfxWkB5yOrYV4IKgujm2uzqmLOy3WTbIhgrdxjlsjQSGnISm8Cnrzdavdts2buehK0nA== X-Microsoft-Antispam: UriScan:;BCL:0;PCL:0;RULEID:;SRVR:CO1PR05MB361; X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:; X-Exchange-Antispam-Report-CFA-Test: BCL:0; PCL:0; RULEID:(601004)(2401047)(8121501046)(5005006)(520078)(10201501046)(3002001); SRVR:CO1PR05MB361; BCL:0; PCL:0; RULEID:; SRVR:CO1PR05MB361; X-Microsoft-Exchange-Diagnostics: 1; CO1PR05MB361; 4:k3rH74TrimFLcZcsKJvI2YIbJR7EIlpsNTunyJZgmkXqY5qke4RE0lsVTXgmMGtLSlC9QLOBpHDNEJtlbYXu/cu8n+Z87XDAw4Z5+Q5s1YDzLb+k7VQeL2RiaF5QZiymcyHCEkYmpCMkHUwNZBq6gVYSZQblt8I/ws5EV/z5sWjJzQJGPHCvjiHehf7OrPFMKhXWS8pxUDIqA7Q8m7OEejxAyRXDe/iN1xhG/4se78ktN9wOmgouC6yCxW/sxW5Gw6el4hng5MJSYMEiSdtSCoW6NQxgT+iYylDx1Xngj2DYKKKQuyGTopwNLE9BRtWEPjfTTx4Q+VnfAWjjfyaFCcJR0jVp/teR6qEGloopMv75DSJyjXLZukSvVF4HWMZv X-Forefront-PRVS: 07521929C1 X-Forefront-Antispam-Report: SFV:NSPM; SFS:(10009020)(6009001)(24454002)(189002)(199003)(479174004)(52044002)(122386002)(42186005)(110136002)(101416001)(40100003)(50986999)(450100001)(5001960100002)(93886004)(5001920100001)(86362001)(33656002)(97736004)(76176999)(19580395003)(105586002)(4001350100001)(189998001)(69596002)(81156007)(106356001)(54356999)(47776003)(87976001)(77096005)(5008740100001)(36756003)(5004730100002)(92566002)(83506001)(15975445007)(50466002)(2950100001)(5007970100001)(21086003)(23676002)(3826002); DIR:OUT; SFP:1101; SCL:1; SRVR:CO1PR05MB361; H:debnath.net; FPR:; SPF:None; PTR:InfoNoRecords; MX:1; A:1; LANG:en; Received-SPF: None (protection.outlook.com: debnath.net does not designate permitted sender hosts) X-Microsoft-Exchange-Diagnostics: =?utf-8?B?MTtDTzFQUjA1TUIzNjE7MjM6M0RwWm14dER2QnY2ZFV1TVcxUEVaSmhwQ2JX?= =?utf-8?B?Q3I5bWZwd3V0V3dXbnV0TVVSZGxNL1A3K0MzeFBwZmZKSTR5SktkT0JnWm1t?= =?utf-8?B?OHdDQWRJNk5FMjYyK0hZQXpqREFZREtQMFhOUjVzRWZQN2oxZWJzVWVJOTFU?= =?utf-8?B?ZDdUY3RMN1ZZcjI1dG9nUlFxVzhzR1BaSUdRc1Y2bWd6RFkxZFgyc0RXMWxa?= =?utf-8?B?cisxbXRXbW14ZjhHWHM5OE11NUprYUVoZjh2cVZnM1lzaXpLTVFHaFdEbWJK?= =?utf-8?B?NGV4TW1IWmhySVdUSzdPL1U1eDVQb2FvYjVnemkrVzZLVlJEd1dEUmYrSVY0?= =?utf-8?B?UTlFVEtHbnRIL3FhbS84ajF6UENXTWNvaW1Nd1pjR1lGSC9tdjZjTVZOMnZm?= =?utf-8?B?TENSZXB5TkkyNFQwZmtLOThONDlITGtRRHM1ay9QdWVBTTBCV2d0UGFycC9R?= =?utf-8?B?bmt1cVNJMUd4UFVJQnU1MXBMMWZKdmo3aFI0YnliYXFLaUVwSGZqckNwTzU5?= =?utf-8?B?L29nVnZlcnBFenM1VjBwT0tGZ2VGd3FvMlVJZmZzYm9BWHZlS21QamlVOEZu?= =?utf-8?B?U1NERlpUbnZHVFZlMXhEekxRSmJwTVEreFdKSmZ5SFd5Nkk5YWFnRmtGeG55?= =?utf-8?B?aEFUaTk0dkNEN0I0WENNUUJpVCtsbTROSDhhdVpRTFJLZjY4Z0l2ZWpFQXZL?= =?utf-8?B?TjQ3SklPdlE2UmpNaERnN1BESkJSZ2M3cThxenFHODZGTklQSTZlUVZkM3h4?= =?utf-8?B?YXdvcHRkQ3pFaXZGMkhnQ3pJbllXT0x2Zjh3RWRsY2xiUUZtajh3R2RTZVZF?= =?utf-8?B?U3QrWWpvalhxeGJkZmViMGlDRG9jVE1qS0NUV2N2OGxlYm82TXFFcTUxRVkw?= =?utf-8?B?UVU0M2xHYzVyZm5oaUtyb093dUtHOHpzejhXWTBYSFlvdjcyMkZKZlM5T0x5?= =?utf-8?B?NmhPbHNWSHR5RUFwbXRBZlR2cTI2dGg0QVVkRWJKZFZGMWRGU0FpWG5lQWZH?= =?utf-8?B?eGV0U1JDbDNTVlpvK3dIaFZIRjhIMUFKeE0xS3dPbjJqYmtxWmhGa3FiQ3ov?= =?utf-8?B?V1NIRTRXMWJ1WERTdmpNOWJtbzZQSHVKSTdpS1lRVFBrMXE3ZHRIczBrd3lm?= =?utf-8?B?R2trK0JQU1A4Qk1QUU5YSEh1cUkrcXRBUmVqU0Q4MWpVeVZqdlk5RVpTdWRt?= =?utf-8?B?b2E3RTRrNW9DQ1JxaDlmRXIwQzdnOU13eCtzQ1lURENBVlFPbmNrOXdNZ0pY?= =?utf-8?B?VHphVUJDSUVKaTNMZXl2RnJaQTA4SDY0cnhOTnR4N3JaTEVPU3ZpRW1Hcm9L?= =?utf-8?B?Mmk4VUlOQVFUcnZTK0x6S0t4cTNpVkNEMkNiVWYrSmkwKzdhOGNqck9EUHVQ?= =?utf-8?B?SC9QUmF5NCtzeGFmSWYwWHRZVGg0aWFEeTNnU29nMHJGM3VtZU0wRWN6VnYv?= =?utf-8?B?UkFNbFpYUnVBbnVxOHVjaHlVZm82USt6dzBwanIyTzk5NGU3bU1oeWlicmpr?= =?utf-8?B?NC8yLzZmeDFpb1ZSZ0lpdFc2OU9HV1NyNXkwVWVJQ0VBaEJKeDZoTnZWa2VD?= =?utf-8?B?WFM4WXAwRy8vZ2h0dCs0UHBYbERwUT09?= X-Microsoft-Exchange-Diagnostics: 1; CO1PR05MB361; 5:HsrSdxW9SAKZ9TFPuBA6MKSHuJT5aTl12m/6JqNeZn+cUrOn00odT28CFP9c5kS4clNMtZ8vDbm/inwGBu2FkrbpyCvE8EbhrNYclMWl/MIsNbo8MGQIy7OkVZ8IXIdHqPmT4El90KlYoeS0WTZzsQ==; 24:dwSvM7TRDCRgIcZiKoTnkzjHWujKM3gkvmVDXVl6O/ML043oDGsqcj3Du1JV0qb1PccFREjqRO9oIUvhgcXDmEWpK8SjQTma4KMiGzASqnw=; 20:iesTPsUV2UblUHEDESZcT3DxqVIj7D2ZuFC21aQmNVrQpw+EUhbRXN81u2+Fy3hCcIBRV02hS0yGWD9LRNCnaw== SpamDiagnosticOutput: 1:23 SpamDiagnosticMetadata: NSPM X-OriginatorOrg: debnath.net X-MS-Exchange-CrossTenant-OriginalArrivalTime: 06 Nov 2015 02:38:44.9279 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-Transport-CrossTenantHeadersStamped: CO1PR05MB361 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 06 Nov 2015 02:53:50 -0000 Yep, I chatted with Allan about this when I first got started. UCL is definitely the way to go, and I will make that a priority. Though the current UCL configuration for bhyve is in a state of flux. According to him, the form is supposed to change quite a bit once bhyve gets support for some new features (brain fart on which features Peter and Neel mentioned to Allan). Though, conforming to his form is of course the right way to proceed. Allan, feel free to chip in and correct me if I am mistaken :) Agree with you 100% on config file re-use wherever possible. Specially comes in handy when people want to help and can re-use those files instead of having to re-define them. Craig Rodrigues on 11/05/2015 14:59 wrote: > I would encourage you to use UCL as early as possible. Adding lots of > command-line options > to vmrun.sh is doable, but gets a bit clunky. > > I would also encourage you to look at the bhyveucl work done by Allan Jude: > https://github.com/allanjude/bhyveucl > > I think it would be nice if we had a common config file format for bhyve > VM's > based off of UCL. > > That way even if people decide to use their own scripts or utilities, > at least they can reuse the config files, instead of cobbling together > their own stuff > which is overlapping in functionality, but is incompatible. -- Shawn From owner-freebsd-virtualization@freebsd.org Fri Nov 6 11:46:53 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 69E32A2799D for ; Fri, 6 Nov 2015 11:46:53 +0000 (UTC) (envelope-from abrancatelli@schema31.it) Received: from stricnina.roma.schema31.it (2-228-74-189.ip190.fastwebnet.it [2.228.74.189]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "stricnina.roma.schema31.it", Issuer "stricnina.roma.schema31.it" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 7934C1F97 for ; Fri, 6 Nov 2015 11:46:50 +0000 (UTC) (envelope-from abrancatelli@schema31.it) Received: from smtp.schema31.it (localhost [127.0.0.1]) by stricnina.roma.schema31.it (8.14.9/8.14.9) with ESMTP id tA6BaXGi015205; Fri, 6 Nov 2015 12:36:41 +0100 (CET) (envelope-from abrancatelli@schema31.it) MIME-Version: 1.0 Date: Fri, 06 Nov 2015 12:36:33 +0100 From: Andrea Brancatelli To: Shawn Debnath Cc: Paul Vixie , freebsd-virtualization@freebsd.org Subject: Re: C bhyve administration tool Organization: Schema31 s.r.l. In-Reply-To: <20151105181450.GA71547@debnath.net> References: <20151103221930.GA50869@debnath.net> <1557160.7OrEWMRSrv@linux-85bq.suse> <20151105181450.GA71547@debnath.net> Message-ID: <8c5965445d33870b3b1938aba513acbe@schema31.it> X-Sender: abrancatelli@schema31.it User-Agent: Roundcube Webmail/1.1.2 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 06 Nov 2015 11:46:53 -0000 Il 2015-11-05 19:14 Shawn Debnath ha scritto: > Won't be dealing with ZFS management yet. If I can give you my two cents, if you plan on doing any kind of management tool, please always keep in mind that ZFS is not required by bhyve. We initially started with VMs on ZFS just to find out how terribly slow it was and we now switched anything to a standard UFS partition with a tremendous performance improvement in the VMs. So please don't take for granted that bhyve == zfs. Thanks :-) From owner-freebsd-virtualization@freebsd.org Fri Nov 6 15:02:22 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2F235A28F5D for ; Fri, 6 Nov 2015 15:02:22 +0000 (UTC) (envelope-from paul@redbarn.org) Received: from family.redbarn.org (family.redbarn.org [IPv6:2001:559:8000:cd::5]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 116141454 for ; Fri, 6 Nov 2015 15:02:22 +0000 (UTC) (envelope-from paul@redbarn.org) Received: from [IPv6:2001:559:8000:c9:9970:a349:343c:71be] (unknown [IPv6:2001:559:8000:c9:9970:a349:343c:71be]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by family.redbarn.org (Postfix) with ESMTPSA id 74885181F6; Fri, 6 Nov 2015 15:02:20 +0000 (UTC) In-Reply-To: <8c5965445d33870b3b1938aba513acbe@schema31.it> References: <20151103221930.GA50869@debnath.net> <1557160.7OrEWMRSrv@linux-85bq.suse> <20151105181450.GA71547@debnath.net> <8c5965445d33870b3b1938aba513acbe@schema31.it> MIME-Version: 1.0 Subject: Re: C bhyve administration tool From: P Vixie Date: Fri, 06 Nov 2015 15:02:18 +0000 To: Andrea Brancatelli , Shawn Debnath CC: freebsd-virtualization@freebsd.org,Paul Vixie Message-ID: <46A3E98C-9413-40FC-8480-BCBB4BF7C34C@redbarn.org> Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 06 Nov 2015 15:02:22 -0000 Fwiw, I use zvol to create bhyve guest system disks, with ufs inside. -- Sent from my Android device with K-9 Mail. Please excuse my brevity. From owner-freebsd-virtualization@freebsd.org Fri Nov 6 15:33:41 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0AF9BA27573 for ; Fri, 6 Nov 2015 15:33:41 +0000 (UTC) (envelope-from bogorodskiy@gmail.com) Received: from mail-lb0-x233.google.com (mail-lb0-x233.google.com [IPv6:2a00:1450:4010:c04::233]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 8217713E1; Fri, 6 Nov 2015 15:33:40 +0000 (UTC) (envelope-from bogorodskiy@gmail.com) Received: by lbbes7 with SMTP id es7so60150464lbb.2; Fri, 06 Nov 2015 07:33:38 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=sender:date:from:to:cc:subject:message-id:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; bh=hAjocLYskWPxB+2cvaGHXej5rs+v1TRne8C7dde+ico=; b=qxtpViQrnH6mAw0+0gSVyyngSXhdLSk02QTfwIw4/QGLr0aRthYAfgLw86SiOUMfu6 A/OzwdThoRyG5/pSUswV+uC0LOwhDqCJrgw+DU69DSbv3RzTY4tl8q/abeih8bz6WXIv NqXFTSQHE0vG/6Qq/E96bYXSdnkyKqhXjRABhEr1RtWP19JExLx4cblfkV8KYgOz6uOI UZHLh8YK3hwC5qLvDby8ANf5Wf6d/8RrN4aYb4K3JwCL4yudK0tR8dzHe2V4VcCHSJ8t df3bBA6sJ3YeAoY0aKL5xJZlgN8AHMdPcTvQX75NOwXP04HbuBRNXtji/eeRARdvd9iz M3jQ== X-Received: by 10.112.159.2 with SMTP id wy2mr7394335lbb.102.1446824018663; Fri, 06 Nov 2015 07:33:38 -0800 (PST) Received: from kloomba.lvv.mirantis.net ([95.104.138.32]) by smtp.gmail.com with ESMTPSA id l79sm118452lfl.2.2015.11.06.07.33.37 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Fri, 06 Nov 2015 07:33:37 -0800 (PST) Sender: Roman Bogorodskiy Date: Fri, 6 Nov 2015 18:33:33 +0300 From: Roman Bogorodskiy To: grehan@freebsd.org Cc: freebsd-virtualization@freebsd.org, Roman Bogorodskiy Subject: Re: Illumos support in bhyve Message-ID: <20151106153332.GB1881@kloomba.lvv.mirantis.net> References: <56118B2B.2040101@freebsd.org> <20151105173717.GB2025@kloomba.lvv.mirantis.net> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="rJwd6BRFiFCcLxzm" Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.24 (2015-08-30) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 06 Nov 2015 15:33:41 -0000 --rJwd6BRFiFCcLxzm Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable grehan@freebsd.org wrote: > Hi Roman, >=20 > > I tried this instruction and I was able to get into smartos > > installation. I choose all the default options there, it reported > > successful installation. Then I dropped 'ahci-cd' part, but I cannot=20 > > get > > smartos boot. >=20 > For smartos, the CD should always be left there since that's the boot= =20 > media. The first boot just detects that the hard drive is empty which=20 > triggers the install. Ah, I see. It works now, thanks! > > And, by the way, is it possible to run FreeBSD using UEFI? > >=20 > > I encountered problems with that as well: > >=20 > > https://lists.freebsd.org/pipermail/freebsd-virtualization/2015-Novembe= r/003904.html > >=20 > > Any hints how to debug this are appreciated. >=20 > The VM images don't include the UEFI loader. You'll have to boot from= =20 > the ISO for that, and force serial console output at the loader prompt. Is it possible to prepare an image that would not require booting from the ISO? Roman Bogorodskiy --rJwd6BRFiFCcLxzm Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEcBAEBAgAGBQJWPMhMAAoJEMltX/4IwiJqKY4H/3GVivVQzEsWrVS3g2sNDvfs wdHfpJUE9qhf5dBuIjnv2azaGJ4YGruhiL0L9zI2GP48zNWRJVwQNtiaoYbrMyEG +iyjgM8aXCCHbKC7D5/YP1ABUs/LlMlP2mvZc4itKb8r323bvkPsnFeqW7ZrgfrF roAdz3rUJKXB7wnUv3yaWTM1pM2XNoRoIXiKpihNzTqk/lrPAHi/9A2X9AMgzrhg lKTCPGYJm1m97mqHrtWv4YvFm+Fjjsnw8ycDG5Zqwuv1OYyoLDKS+y/0u41HEnt9 AbzA1JGXG/CGmynZyy4fY9kR4gQIyZR4J84G8ahrKGtVOGlJnNL/gUPcDdjKbJM= =xOUE -----END PGP SIGNATURE----- --rJwd6BRFiFCcLxzm-- From owner-freebsd-virtualization@freebsd.org Fri Nov 6 20:12:14 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 835FDA2839A for ; Fri, 6 Nov 2015 20:12:14 +0000 (UTC) (envelope-from shawn@debnath.net) Received: from na01-bl2-obe.outbound.protection.outlook.com (mail-bl2on0068.outbound.protection.outlook.com [65.55.169.68]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "MSIT Machine Auth CA 2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 1153F1F2F for ; Fri, 6 Nov 2015 20:12:13 +0000 (UTC) (envelope-from shawn@debnath.net) Authentication-Results: spf=none (sender IP is ) smtp.mailfrom=shawn@debnath.net; Received: from debnath.net (2601:602:8500:73b:9cf6:8489:4d1e:ec9a) by BLUPR05MB353.namprd05.prod.outlook.com (10.141.25.11) with Microsoft SMTP Server (TLS) id 15.1.312.18; Fri, 6 Nov 2015 19:38:07 +0000 Date: Fri, 6 Nov 2015 11:37:59 -0800 From: Shawn Debnath To: Andrea Brancatelli CC: Paul Vixie , Subject: Re: C bhyve administration tool Message-ID: <20151106193758.GA74312@debnath.net> References: <20151103221930.GA50869@debnath.net> <1557160.7OrEWMRSrv@linux-85bq.suse> <20151105181450.GA71547@debnath.net> <8c5965445d33870b3b1938aba513acbe@schema31.it> MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Disposition: inline In-Reply-To: <8c5965445d33870b3b1938aba513acbe@schema31.it> User-Agent: Mutt/1.5.24 (2015-08-30) X-Originating-IP: [2601:602:8500:73b:9cf6:8489:4d1e:ec9a] X-ClientProxiedBy: CO1PR06CA028.namprd06.prod.outlook.com (10.242.160.18) To BLUPR05MB353.namprd05.prod.outlook.com (10.141.25.11) X-Microsoft-Exchange-Diagnostics: 1; BLUPR05MB353; 2:O1yNQA/oukKRXu+Rku2B5EHWY/fxV7Ui4By6acWTdom5DfQqCuzY+sCcW784O4keeUv7rvfU0YA0wOcU/T5d+EJllYgEQgvnVhnIkwD3/Cqj+Rv/g7eW4Qji3zgW0fy8IWnB/7YmpZ8IQ+cWMpIao2Z+SlxJAfzje8GbhaU97M0=; 3:U9F0xRRW+C48GPbNVzcsbed0vt3IS8H05UBd3eEACGK17OrD2QL5V1zwdQJwfns5p/vXK4hqDaDLwxIxUF58ppyA+9NdpQKeMty3ncSkgg8GsBRg3YF5UaEWLEJ+uHcMWVnv81tuw16KmqgRt3ScsQ==; 25:GY94hNOratnNF9zo/ZrrW7kmdu29CYmFYkx5RwMatTmEBQLi4VzTRHoclhqSjzdeuNLkNlWHOVgXJrWam1gdhVzcDogWX3Tg4ZMUdVT4NHf2EyxxX/PdEAS4ECL635KfhOK/2Nbfc5pxm5iYo7j1yE/TvUYDkAamtCF01ibyS2l0ZXx6ElzmTn9bGc/sR35MIPqBfaVo2O1oHInXof95rMNKWtWEETBFUzkJhtlfweuGeXxMNftxwV0veOJP4LXfKMFoAR3UlQkTjbd7jNT2gA== X-Microsoft-Antispam: UriScan:;BCL:0;PCL:0;RULEID:;SRVR:BLUPR05MB353; X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:; X-Exchange-Antispam-Report-CFA-Test: BCL:0; PCL:0; RULEID:(601004)(2401047)(520078)(8121501046)(5005006)(10201501046)(3002001); SRVR:BLUPR05MB353; BCL:0; PCL:0; RULEID:; SRVR:BLUPR05MB353; X-Microsoft-Exchange-Diagnostics: 1; BLUPR05MB353; 4:uDJD8vH8Yn20ymEX66JuImrISJ8NnCDK7vRAuDiWCIpeGv5l3MXlBHZiVqNxnayJSyieznQHmk5dEjlEAtNFV/BZSUfK9RmxyMhwwuRA6tYwR8THZUco/jSzCN8hhEf9EYaXcFyq3ATUnSxAOwDnlRPKkuvgwY2iFhB9DfAYRTa7DmL5u0Sq8593BepKBhMMd7w9vYXzZB070D3+qb3wm0i83gBge/ErIs9nQYiWRJ88nQJkvYebR9VmIffQbmdQpxeSNxX1neb1iSPOR9y2QhJ/UHqf+KMYKq8eRwZD4sFwCh9ibc0si+4Sg3vtQwW0hxx+thNcWBMrwVteIy0iKUyM3Co500SPWH+8woqO7mFyE4cfWuOwd3VPBu0GdhF0 X-Forefront-PRVS: 07521929C1 X-Forefront-Antispam-Report: SFV:NSPM; SFS:(10009020)(6009001)(24454002)(377424004)(189002)(199003)(479174004)(101416001)(2950100001)(105586002)(47776003)(5008740100001)(21086003)(40100003)(92566002)(42186005)(5001960100002)(50466002)(97736004)(77096005)(86362001)(50986999)(36756003)(83506001)(5007970100001)(23676002)(4001350100001)(81156007)(122386002)(106356001)(87976001)(93886004)(189998001)(110136002)(76176999)(69596002)(5004730100002)(54356999)(33656002)(3826002); DIR:OUT; SFP:1101; SCL:1; SRVR:BLUPR05MB353; H:debnath.net; FPR:; SPF:None; PTR:InfoNoRecords; MX:1; A:1; LANG:en; Received-SPF: None (protection.outlook.com: debnath.net does not designate permitted sender hosts) X-Microsoft-Exchange-Diagnostics: =?utf-8?B?MTtCTFVQUjA1TUIzNTM7MjM6SGpySjJRZFBXZU0rQjQ5QTBiSEVXNlVlY3k0?= =?utf-8?B?ck8vK2poSTZCb0xEWkVaTHdVdWpCRmFvMHpKcUxJa2sxazJvTllycGNNcWtG?= =?utf-8?B?RlM2RjZEaTNLUWFZakVKaGFWVmRlV29yRmZRaUMvQWdJUWlLaDBSemVFK3hy?= =?utf-8?B?OHl5bGVJTWlUYWg1SE91cnJWWVNCMmhGd3c3NEhMWGJMUDlHN0JySVliUGZk?= =?utf-8?B?bkVVOW4yNGhudjZYY1FQTFZHL0FrYWloYkU0OURGd201NnZGRU1YVGwvak1l?= =?utf-8?B?UWxodURwS0E0VUk3OVMxMVplZHExZ2FuMXhoMFhtcmFJU0xYTElkM1NuRldZ?= =?utf-8?B?Ly9pbVE0NmMrNjZZcG5TL20vVXhoZThLZllnbVl5VWhsUkdNV3d2ditkMEVO?= =?utf-8?B?cWVNOS8rRkorQ1gwMU4vWWhadzd3YStDMmJvV1V5aThWSFFuczdnTEFJY29q?= =?utf-8?B?UTd4dm9OV08wMUcxcm96aktMNzZieHhoUXJpeEYyenRvWURPQVhFTkFzWXBW?= =?utf-8?B?QkFHbUV4ak5JMjNiK0VlRnlRcHlFcVVTSndWK1VDRlNXQ2lvRzhTTlNhcWZH?= =?utf-8?B?dkowdlFrNzdKbFU5ZU9jV2JScnFBcXl1MFRaVmhqbU05UUN0d1gveERkem5Y?= =?utf-8?B?cC9VQVBVTmxOT1cxenV6cFVzYXhoNjNVQU82bEtXdFB6M0xVWFBIbWtzb2lM?= =?utf-8?B?MjNDOEJsQmZHQ0xybHdQcm1TSEE2dkVOZEdXdkxwREtmMGxjWU9ybDlwaXBx?= =?utf-8?B?azB6VmR1bXk1ZnkxdUJUSXdkK0J0bVRxUjdKbUR0bWttNzhvT0VxMG5DQUdZ?= =?utf-8?B?LzE0TVFZZTIrMTJhOFp5YjIyV1BVVmVubk5idEZDZjkzekV6NW1vbXlhUlJl?= =?utf-8?B?ZTVJUHkxS3ZzTmdMM3ZHeWNLVW5lanU0QzM5Uk9iNnJaRCtmNnVrNDFyYnMr?= =?utf-8?B?L2VuZnlJcHVNaWZVeXA0M0lvWEtjMU5Qb1hrRU9GV0Zzc1k5OEk5THM1Q1E3?= =?utf-8?B?T3dpZ2V3YmhncWNSM0tjQ0pUT0R6V2lvTzhVVGpyU0JKK21DSHF2b0lTSkxl?= =?utf-8?B?Q1V2Y2dURHRjMHNiZ2I3enc1L05CMXF6UHdVMDMxNUUwMy9pVENQUnJmZzRN?= =?utf-8?B?bnhSdUdlMlAxRGxOV2c1R1RkZU53R0J1VDFGa0duK2Z5ZjVFM05nZkZwdmth?= =?utf-8?B?YW5ZQnVlUHV1bDd6SjZqTU5kaFlBblBSNXlEZ3ZqRHRhdmFLbXVUUXNaZURE?= =?utf-8?B?KzRzcExXcmRWbG82RjhoUi9XN3JJZkZsTCtJQjM2T3NvWjFtbGNUaUVvd0pL?= =?utf-8?B?bHAvaDJqcXNaNEw4U0VQZ0VzWmdkejRBRDZDc2FvN2MxUFhRdVVtS3VZZUU1?= =?utf-8?B?VXlIOHZERDlTL3FudHc2RXhyVWJTaWpyK1BxSms2Mi9iMUNibTJybTNUWGsw?= =?utf-8?Q?1p1w4=3D?= X-Microsoft-Exchange-Diagnostics: 1; BLUPR05MB353; 5:lCEeSRo/JiWb3kEkenFXPahUgheZzvV9wCrSQU3QqysfY9pu5SffpZlEBXuDP/Z07NN1U7SqbMi7+pJfUTt+ZCf5gI2mvAP5GwOKngEkWRqLBBoPH/0zHL9Xt+N8JsA5usysyAp6pnHh99g2NHxWjg==; 24:1UFxHeDwdddoSPQAX8BYI4W4EieBJDKVBZZg8H5n8nGD8plBOMd5WDjpBCJRLwrN7KGjsjKS4sxusJYGL+Xiu5ewqHlMtkZNg4bLJDp3l7I=; 20:RkKg0K+vsX7U+DFowVpxluPQ1kjGF4dARlN+AGsF3RrXcaOa0wrkaFZvd6inH7lP5fyH+EQ3L6TBOD7nJS6hJg== SpamDiagnosticOutput: 1:23 SpamDiagnosticMetadata: NSPM X-OriginatorOrg: debnath.net X-MS-Exchange-CrossTenant-OriginalArrivalTime: 06 Nov 2015 19:38:07.2158 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-Transport-CrossTenantHeadersStamped: BLUPR05MB353 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 06 Nov 2015 20:12:14 -0000 True. My goal is that if this works out for everyone, that someday it might get pulled into the distribution. ZFS has it advantages, but you are correct. Not everyone in the world wants to use ZFS (for whatever the reason might be). Will make sure the core features stays file system independent, as it should. Down the road, I can imagine some advanced features that might require ZFS, but we can talk about that when the time comes. Andrea Brancatelli on 11/06/2015 12:36 wrote: > > > Il 2015-11-05 19:14 Shawn Debnath ha scritto: > > > Won't be dealing with ZFS management yet. > > If I can give you my two cents, if you plan on doing any kind of > management tool, please always keep in mind that ZFS is not required by > bhyve. We initially started with VMs on ZFS just to find out how > terribly slow it was and we now switched anything to a standard UFS > partition with a tremendous performance improvement in the VMs. > > So please don't take for granted that bhyve == zfs. > > Thanks :-) -- Shawn From owner-freebsd-virtualization@freebsd.org Sat Nov 7 21:38:06 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0DF09A29705 for ; Sat, 7 Nov 2015 21:38:06 +0000 (UTC) (envelope-from nicolas.gilles@gmail.com) Received: from mail-vk0-x22c.google.com (mail-vk0-x22c.google.com [IPv6:2607:f8b0:400c:c05::22c]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id B6D501A91 for ; Sat, 7 Nov 2015 21:38:05 +0000 (UTC) (envelope-from nicolas.gilles@gmail.com) Received: by vkfw189 with SMTP id w189so35924654vkf.2 for ; Sat, 07 Nov 2015 13:38:04 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=0cGAh0gNH/3U44Bsah878Pnw5TsBj1F6yLZ+gpIUf8M=; b=bLk6bTl2pymA1+ijAZ1UvEzgOx2bQ0xG29ZPT0NBp4QMAhm4BoDlLF8jvCPHzQOc8u ojflgUxQsSsAaIS0JOJDTWYc7BflWD3IrtS9nj2/rpKDdaxXV2zhstG105ShaH7l0wmn +kO/I9AguBfqno7mIFS7m+MUQl+TJ32cBB75iCvcDnuKytaNLrNUsWB0WRyqZfjSsRVD UxfeyqqVKxFtqfcO3n1+AK1lSUw4Y+MQTKrqwZ+C1v+BmNABA6E3yMaKfwExP3oSFYmN tpSUQPZShk7CR4rSnxT93LNwFD7zkAVa8HjIPaM/6wQLvx+3ikSghN5P7+wWnSyfz1uY /Mtw== MIME-Version: 1.0 X-Received: by 10.31.134.193 with SMTP id i184mr21680213vkd.64.1446932284568; Sat, 07 Nov 2015 13:38:04 -0800 (PST) Received: by 10.31.106.199 with HTTP; Sat, 7 Nov 2015 13:38:04 -0800 (PST) In-Reply-To: <20151106153332.GB1881@kloomba.lvv.mirantis.net> References: <56118B2B.2040101@freebsd.org> <20151105173717.GB2025@kloomba.lvv.mirantis.net> <20151106153332.GB1881@kloomba.lvv.mirantis.net> Date: Sat, 7 Nov 2015 22:38:04 +0100 Message-ID: Subject: Re: Illumos support in bhyve From: Nicolas Gilles To: freebsd-virtualization@freebsd.org Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 07 Nov 2015 21:38:06 -0000 SmartOS is built to work that way, booting from an "static" ISO or USB or PXE, and just using the hard-drives in the system as store for the zones + vms, the os "drives" is loaded into memory. In a VM, it's not going to change you much to boot form a virtual DVD drive vs virtual HD install, what troubles you booting from the ISO? On Fri, Nov 6, 2015 at 4:33 PM, Roman Bogorodskiy wrote: > grehan@freebsd.org wrote: > >> Hi Roman, >> >> > I tried this instruction and I was able to get into smartos >> > installation. I choose all the default options there, it reported >> > successful installation. Then I dropped 'ahci-cd' part, but I cannot >> > get >> > smartos boot. >> >> For smartos, the CD should always be left there since that's the boot >> media. The first boot just detects that the hard drive is empty which >> triggers the install. > > Ah, I see. It works now, thanks! > >> > And, by the way, is it possible to run FreeBSD using UEFI? >> > >> > I encountered problems with that as well: >> > >> > https://lists.freebsd.org/pipermail/freebsd-virtualization/2015-November/003904.html >> > >> > Any hints how to debug this are appreciated. >> >> The VM images don't include the UEFI loader. You'll have to boot from >> the ISO for that, and force serial console output at the loader prompt. > > Is it possible to prepare an image that would not require booting from > the ISO? > > Roman Bogorodskiy