From owner-freebsd-virtualization@FreeBSD.ORG Tue Aug 6 22:33:49 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 686A87AC for ; Tue, 6 Aug 2013 22:33:49 +0000 (UTC) (envelope-from akgupt3@gmail.com) Received: from mail-wi0-x22f.google.com (mail-wi0-x22f.google.com [IPv6:2a00:1450:400c:c05::22f]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id DCE2E28AB for ; Tue, 6 Aug 2013 22:33:48 +0000 (UTC) Received: by mail-wi0-f175.google.com with SMTP id hq12so3287292wib.14 for ; Tue, 06 Aug 2013 15:33:47 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=5xUNyIswXn9+DNyHEKRL6RepJ0NwAIA77SwxgEXEAII=; b=wuxF6+0htEemH7+8WNfbHbFbuXygZdQthqlX4giU83tV/1wocT4YXuQVc3F7i5zo6d JTd9WW8xNxYmFUh7wWqcEiNO28WvTyNefrI0oyslpcb3TUp6Y03cjOHaAPNvPii86vtq 6pMWh1qXN+n1GIIksH+cDLV9lp9p/E3a8eGAnWPdP8D2EiiXQNeCcQHDSNYjE94+hcry 52yYWPo8K8RDWYWY3gS4XUEZgu5a+GrNVfNY5RTOgICwquhn6UauTxYFLduoCv15zH6e msGSJPJZav5CYPmkz1sDO7QyZXWsQZIK0xXoPEBc1u7LBXaRIRtRSsa7UxwbAjPh9DMu Nx2w== MIME-Version: 1.0 X-Received: by 10.194.120.225 with SMTP id lf1mr207353wjb.74.1375828427057; Tue, 06 Aug 2013 15:33:47 -0700 (PDT) Received: by 10.194.56.99 with HTTP; Tue, 6 Aug 2013 15:33:46 -0700 (PDT) In-Reply-To: <1f2844d8e1f5f5f931811be351f19bd9@debank.tv> References: <1f2844d8e1f5f5f931811be351f19bd9@debank.tv> Date: Tue, 6 Aug 2013 15:33:46 -0700 Message-ID: Subject: Re: bhyve and virtualbox on the same host using EPT From: Anish To: mailinglists@debank.tv Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.14 Cc: freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 06 Aug 2013 22:33:49 -0000 Each processor has its own EPT root pointer in VMCS. How many processors are there in system and how many are given to Virtualbox. error = vmcs_set_defaults(&vmx->vmcs[i], (u_long)vmx_longjmp, (u_long)&vmx->ctx[i], vtophys(vmx->pml4ept), pinbased_ctls, procbased_ctls, procbased_ctls2, exit_ctls, entry_ctls, vtophys(vmx->msr_bitmap), vpid); On Tue, Aug 6, 2013 at 3:02 PM, wrote: > All, > > > I'm trying to run a bhyve VM on a host that's already running Virtualbox, > the problem I encounter is bhyve doesn't detect EPT capabilities but the > Virtualbox logs indicate EPT is in use and functional. > My question is; is it possible for two pieces of virtualization software > to use EPT on the same host? > > See below for the various logs, happy to provide more info if needed. > > > Bhyve generates the following error after the bootloader screen: > > ------------------------------**----------------------- > Booting... > 4 vCPUs requested but only 1 available > ------------------------------**----------------------- > > A quick look in the source code indicates that this error means bhyve > can't use EPT and falls back to using 1 CPU, now the machine in question > does have EPT capabilites (it lists POPCNT in dmesg): > > ------------------------------**----------------------- > uname -a > FreeBSD becks.debank.tv 10.0-CURRENT FreeBSD 10.0-CURRENT #0 r253788M: > Tue Jul 30 12:02:57 NZST 2013 root@becks.debank.tv:/usr/obj/**usr/src/sys/GENERIC > amd64 > ------------------------------**----------------------- > ------------------------------**----------------------- > from dmesg > CPU: Intel(R) Core(TM) i7 CPU 920 @ 2.67GHz (2664.82-MHz K8-class > CPU) > Origin = "GenuineIntel" Id = 0x106a5 Family = 0x6 Model = 0x1a > Stepping = 5 > Features=0xbfebfbff APIC,SEP,MTRR,PGE,MCA,CMOV,**PAT,PSE36,CLFLUSH,DTS,ACPI,** > MMX,FXSR,SSE,SSE2,SS,HTT,TM,**PBE> > Features2=0x98e3bd SSSE3,CX16,xTPR,PDCM,SSE4.1,**SSE4.2,POPCNT> > AMD Features=0x28100800 > AMD Features2=0x1 > TSC: P-state invariant, performance statistics > real memory = 25769803776 (24576 MB) > avail memory = 24060841984 (22946 MB) > ------------------------------**----------------------- > ------------------------------**----------------------- > root@becks:~/bhyve # kldstat > Id Refs Address Size Name > 1 27 0xffffffff80200000 150e0d0 kernel > 2 1 0xffffffff8170f000 224a98 zfs.ko > 3 2 0xffffffff81934000 5c30 opensolaris.ko > 4 1 0xffffffff8193a000 2d40 coretemp.ko > 5 3 0xffffffff8193d000 51a68 vboxdrv.ko > 6 2 0xffffffff81a12000 28c0 vboxnetflt.ko > 7 2 0xffffffff81a15000 881d netgraph.ko > 8 1 0xffffffff81a1e000 15ff ng_ether.ko > 9 1 0xffffffff81a20000 3ec0 vboxnetadp.ko > 10 1 0xffffffff81aba000 1037 cpuctl.ko > 11 1 0xffffffff81abc000 1686ac vmm.ko > ------------------------------**----------------------- > > The Virtualbox logs below show EPT in use: > ------------------------------**----------------------- > 00:00:00.419806 HWACCM: MSR_IA32_VMX_PROCBASED_CTLS2 = 7f00000000 > 00:00:00.419807 HWACCM: VMX_VMCS_CTRL_PROC_EXEC2_VIRT_**APIC > 00:00:00.419807 HWACCM: VMX_VMCS_CTRL_PROC_EXEC2_EPT > 00:00:00.419808 HWACCM: VMX_VMCS_CTRL_PROC_EXEC2_** > DESCRIPTOR_INSTR_EXIT > 00:00:00.419808 HWACCM: VMX_VMCS_CTRL_PROC_EXEC2_**RDTSCP > 00:00:00.419809 HWACCM: VMX_VMCS_CTRL_PROC_EXEC2_**X2APIC > 00:00:00.419809 HWACCM: VMX_VMCS_CTRL_PROC_EXEC2_VPID > 00:00:00.419810 HWACCM: VMX_VMCS_CTRL_PROC_EXEC2_**WBINVD_EXIT > ---- snip ------ > 00:00:00.419916 HWACCM: 32-bit and 64-bit guests supported. > 00:00:00.419917 HWACCM: VMX enabled! > 00:00:00.419918 HWACCM: Enabled nested paging > 00:00:00.419919 HWACCM: EPT root page = 00000000b6167000 > 00:00:00.419922 HWACCM: Large page support enabled! > ------------------------------**----------------------- > > Thanks, > Rob Evers > > ______________________________**_________________ > freebsd-virtualization@**freebsd.org mailing list > http://lists.freebsd.org/**mailman/listinfo/freebsd-**virtualization > To unsubscribe, send any mail to "freebsd-virtualization-** > unsubscribe@freebsd.org " >