From owner-freebsd-virtualization@FreeBSD.ORG Tue Aug 6 23:06:26 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id EACD0E5D for ; Tue, 6 Aug 2013 23:06:26 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from alto.onthenet.com.au (alto.OntheNet.com.au [203.13.68.12]) by mx1.freebsd.org (Postfix) with ESMTP id AABEE29F1 for ; Tue, 6 Aug 2013 23:06:26 +0000 (UTC) Received: from dommail.onthenet.com.au (dommail.OntheNet.com.au [203.13.70.57]) by alto.onthenet.com.au (Postfix) with ESMTPS id 8012D11DDE for ; Wed, 7 Aug 2013 09:06:18 +1000 (EST) Received: from Peter-Grehans-MacBook-Pro-2.local ([64.245.0.210]) by dommail.onthenet.com.au (MOS 4.2.4-GA) with ESMTP id BNV61534 (AUTH peterg@ptree32.com.au); Wed, 7 Aug 2013 09:06:17 +1000 Message-ID: <52018166.7050004@freebsd.org> Date: Tue, 06 Aug 2013 16:06:14 -0700 From: Peter Grehan User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:17.0) Gecko/20130620 Thunderbird/17.0.7 MIME-Version: 1.0 To: freebsd-virtualization@freebsd.org Subject: Re: bhyve and virtualbox on the same host using EPT References: <1f2844d8e1f5f5f931811be351f19bd9@debank.tv> In-Reply-To: <1f2844d8e1f5f5f931811be351f19bd9@debank.tv> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 06 Aug 2013 23:06:27 -0000 Hi Rob, > Bhyve generates the following error after the bootloader screen: > > ----------------------------------------------------- > Booting... > 4 vCPUs requested but only 1 available > ----------------------------------------------------- What this means is that the model of CPU that you have doesn't support the "unrestricted guest" feature, which allows a guest to run in 16-bit mode. bhyve boots FreeBSD directly into 64-bit mode on the main CPU, but secondary CPUs are started through a boostrap from 16-bit mode to 64-bit mode. There was a hack early on in bhyve to avoid this by starting the secondaries directly in 64-bit mode, but it was bhyve- and FreeBSD-specific and difficult to maintain. Given that there was only a small timeframe of CPUs that supported EPT but not unrestricted guest (early Nehalems), we decided to the 64-bit AP spinup. You can still run single vCPU guests though. > The Virtualbox logs below show EPT in use: On the issue of running VBox and bhyve at the same time: that's not recommended and will probably result in a crash. To do this requires cooperation from hypervisors in that they will completely flush state any time they could be context-switched away to avoid the other hypervisor's state from colliding. This results in poor performance which is why it usually isn't done by default. I think we know how to fix this in bhyve, but aren't there yet. later, Peter.