From owner-freebsd-virtualization@FreeBSD.ORG Sun Aug 4 16:20:52 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 21BE42EB for ; Sun, 4 Aug 2013 16:20:52 +0000 (UTC) (envelope-from sfourman@gmail.com) Received: from mail-ve0-x230.google.com (mail-ve0-x230.google.com [IPv6:2607:f8b0:400c:c01::230]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id D77DC2E60 for ; Sun, 4 Aug 2013 16:20:51 +0000 (UTC) Received: by mail-ve0-f176.google.com with SMTP id b10so2263482vea.21 for ; Sun, 04 Aug 2013 09:20:51 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=y/xySalS2YsQ9/GXCP3Znda5856P/gm/7X0RuuSQBWQ=; b=BuMBo9Td/ObYWNwid+L3mWvYjOkeOiE5SzOywvmcZiKrpHt2NA5/3Oho9P7A3tGDVx nkFAkUqcv2BZka1fv8pWNPgPv8IAbxFECme6BEmhsbIrMyejhyvhHv8den7e3xmbPisS PR+v+UFFB89vIb2aeTlZl9M8NiZQPPp1ll1y29MT2hOuLNvec0fQUcLUi/NE3zmuYb7E Qp2XNdf7Izk8dKCeBDTY8/ZrzIHjb3OFSJAfH5Y6V8FzicbxS/fzbC0XN0ZUz886/bbN E58CYemZP2NIdvO9wNW5L1aqydsIVt3IGKFm3Yu3tDgCC7u4UvrQ8gXL/Y4dqJ9ESHwD 8RIA== MIME-Version: 1.0 X-Received: by 10.52.165.239 with SMTP id zb15mr3900094vdb.44.1375633250921; Sun, 04 Aug 2013 09:20:50 -0700 (PDT) Received: by 10.220.96.78 with HTTP; Sun, 4 Aug 2013 09:20:50 -0700 (PDT) Date: Sun, 4 Aug 2013 12:20:50 -0400 Message-ID: Subject: PCI passthrough support for VGA devices in VirtualBox on FreeBSD From: "Sam Fourman Jr." To: FreeBSD virtualization mailing list Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.14 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 04 Aug 2013 16:20:52 -0000 Hello List, would anyone be able to tell me if PCI passthrough is available in Virtualbox if FreeBSD is the host? it has been available since version 4.1 http://www.virtualbox.org/manual/ch09.html#idp14053504 I know that this requires a VirtualBox extension pack, and i am not certian if FreeBSD needs one? My use case is, I want to pass through a AMD raedon PCI-E graphics card to a Linux guest. I built a FreeBSD kernel based on experimental work being done here: https://wiki.freebsd.org/AMD_GPU here are excerpts from a dmesg: info: [drm] Initialized drm 1.1.0 20060810 drmn0: on vgapci0 info: [drm] MSI enabled 1 message(s) info: [drm] RADEON_IS_PCIE info: [drm] initializing kernel modesetting (TAHITI 0x1002:0x679A 0x1462:0x2773). info: [drm] register mmio base: 0xFE700000 info: [drm] register mmio size: 262144 info: [drm] radeon_atrm_get_bios: ===> Try ATRM... info: [drm] radeon_atrm_get_bios: pci_find_class() found: 0:7:0:0, vendor=1002, device=679a info: [drm] radeon_atrm_get_bios: Get ACPI device handle info: [drm] radeon_acpi_vfct_bios: ===> Try VFCT... info: [drm] radeon_acpi_vfct_bios: Get "VFCT" ACPI table info: [drm] radeon_acpi_vfct_bios: Failed to get "VFCT" table: AE_NOT_FOUND info: [drm] igp_read_bios_from_vram: ===> Try IGP's VRAM... info: [drm] igp_read_bios_from_vram: VRAM base address: 0xc0000000 info: [drm] igp_read_bios_from_vram: Map address: 0xfffffe00c0000000 (262144 bytes) info: [drm] igp_read_bios_from_vram: Incorrect BIOS signature: 0x6207 info: [drm] radeon_read_bios: ===> Try PCI Expansion ROM... vga_pci_map_bios: Mapping BIOS shadow info: [drm] radeon_read_bios: Map address: 0xfffffe00000c0000 (131072 bytes) vga_pci_unmap_bios: Unmapping BIOS shadow info: [drm] ATOM BIOS: 113 drmn0: info: VRAM: 3072M 0x0000000000000000 - 0x00000000BFFFFFFF (3072M used) drmn0: info: GTT: 512M 0x00000000C0000000 - 0x00000000DFFFFFFF info: [drm] Detected VRAM RAM=3072M, BAR=256M info: [drm] RAM width 384bits DDR [TTM] Zone kernel: Available graphics memory: 16714132 kiB [TTM] Zone dma32: Available graphics memory: 2097152 kiB my hope is to use VirtualBox until Behyve supports booting linux guests Thank you for your help -- Sam Fourman Jr. From owner-freebsd-virtualization@FreeBSD.ORG Sun Aug 4 20:07:59 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 3F84BE4D for ; Sun, 4 Aug 2013 20:07:59 +0000 (UTC) (envelope-from syuu@dokukino.com) Received: from mail-pd0-x22d.google.com (mail-pd0-x22d.google.com [IPv6:2607:f8b0:400e:c02::22d]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 164E627FF for ; Sun, 4 Aug 2013 20:07:59 +0000 (UTC) Received: by mail-pd0-f173.google.com with SMTP id p11so2447049pdj.18 for ; Sun, 04 Aug 2013 13:07:58 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=dokukino.com; s=google; h=mime-version:from:date:message-id:subject:to:content-type; bh=+GB2xSeLQbhTvSHG2XhEFRy2YAHk1hMiXOWWh0xce18=; b=IRQiwm8za6BhV3kCdTdVWu/NkO72j3aZSHyNTqUukFc9y5ScRmV03HvVA6SSdO7UTH HaKsQ6eFahibU50xKpE6DGaB+5x2GlpLQU5mU3iAfR/OPutcyr/h3wGt0Eaywi32HnnA t/rr2LM0cW9ble53hUZnnJPEMUF0tswVFYuqk= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:from:date:message-id:subject:to:content-type :x-gm-message-state; bh=+GB2xSeLQbhTvSHG2XhEFRy2YAHk1hMiXOWWh0xce18=; b=hDansQjvjYQxdrMMBOwXKQP/oDnqYNM+pWp6bie8uBWpLTt1klODvHqCiAtZvpTZM4 DxZW1lSTmWIL52rIHOTyC+VV82dYetZR37Zxezyzqk75WiUUnkHlbGEsbImGYyKEz6SC 5rEAvi8yIVs/CiUdAoDFIAq38EYPwhDjqUmOgJ0p3c5Mr1Lu7MW9xacGaIowOkpS67G2 4zQCFG8Ps183dzRFHRiwCNhoQdEQL7gTyxGCuppoQKRVabhmSHhCeSWemBt9okH6Dzzf UU5rPvmDpvuXV+YPiVRlZW+hGhjECqRgBsVogTQJvyGixUG74Ua42zAj2P5wzoCvo7d4 TUhQ== X-Received: by 10.66.149.73 with SMTP id ty9mr1763440pab.36.1375646878576; Sun, 04 Aug 2013 13:07:58 -0700 (PDT) MIME-Version: 1.0 Received: by 10.68.245.226 with HTTP; Sun, 4 Aug 2013 13:07:18 -0700 (PDT) From: Takuya ASADA Date: Mon, 5 Aug 2013 05:07:18 +0900 Message-ID: Subject: Standalone binary loader for BHyVe To: Peter Grehan , "freebsd-virtualization@freebsd.org" X-Gm-Message-State: ALoCoQk8qT9dSXzqadQl2rDNSrcdKVyT+rICbkig8Hciy4XdRBIWslpGio9yqVwFG+8L/oDlrh1S Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.14 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 04 Aug 2013 20:07:59 -0000 Hi, I implemented standalone binary loader for BHyVe. This allows to load custom program on guest memory area, and run it from specified entry point address. I wrote this for test code of BHyVe suspend/resume project(Yoneji Iori's work), but it might be useful for some other purposes. This is a patch: http://people.freebsd.org/~syuu/bhyve_standalone_guest.diff Most of the code is borrowed from userboot, but userboot looks like only for FreeBSD kernel, so I copied those code to bhyveload instead of modifying userboot APIs. Here's a example of usage: echo "main:" > test.S echo "inb \$0x50, %al" >> test.S as -o test.o test.S objcopy -I elf64-x86-64-freebsd -O binary test.o test.bin sudo bhyveload -m 256 -S test.bin:0x7c00 test sudo bhyve -m 256 -e test # bhyve says "Unhandled inb 0x0050", because there's no inb 0x50 handler. Another example of usage: svn co svn://svn.freebsd.org/base/user/syuu/bhyve_standalone_guest_test1 cd bhyve_standalone_guest_test1 make make run # because test1 is COM1 test program, bhyve continues to show asterisk on the console. From owner-freebsd-virtualization@FreeBSD.ORG Mon Aug 5 11:06:54 2013 Return-Path: Delivered-To: freebsd-virtualization@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id C86C4F91 for ; Mon, 5 Aug 2013 11:06:54 +0000 (UTC) (envelope-from owner-bugmaster@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:1900:2254:206c::16:87]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id B40E525B4 for ; Mon, 5 Aug 2013 11:06:54 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.7/8.14.7) with ESMTP id r75B6sFR036265 for ; Mon, 5 Aug 2013 11:06:54 GMT (envelope-from owner-bugmaster@FreeBSD.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.7/8.14.7/Submit) id r75B6sjs036263 for freebsd-virtualization@FreeBSD.org; Mon, 5 Aug 2013 11:06:54 GMT (envelope-from owner-bugmaster@FreeBSD.org) Date: Mon, 5 Aug 2013 11:06:54 GMT Message-Id: <201308051106.r75B6sjs036263@freefall.freebsd.org> X-Authentication-Warning: freefall.freebsd.org: gnats set sender to owner-bugmaster@FreeBSD.org using -f From: FreeBSD bugmaster To: freebsd-virtualization@FreeBSD.org Subject: Current problem reports assigned to freebsd-virtualization@FreeBSD.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 05 Aug 2013 11:06:54 -0000 Note: to view an individual PR, use: http://www.freebsd.org/cgi/query-pr.cgi?pr=(number). The following is a listing of current problems submitted by FreeBSD users. These represent problem reports covering all versions including experimental development code and obsolete releases. S Tracker Resp. Description -------------------------------------------------------------------------------- o kern/165252 virtualization[vimage] [pf] [panic] kernel panics with VIMAGE and PF o kern/161094 virtualization[vimage] [pf] [panic] kernel panic with pf + VIMAGE wh o kern/160541 virtualization[vimage][pf][patch] panic: userret: Returning on td 0x o kern/160496 virtualization[vimage] [pf] [patch] kernel panic with pf + VIMAGE o kern/148155 virtualization[vimage] [pf] Kernel panic with PF + VIMAGE kernel opt a kern/147950 virtualization[vimage] [carp] VIMAGE + CARP = kernel crash s kern/143808 virtualization[pf] pf does not work inside jail 7 problems total. From owner-freebsd-virtualization@FreeBSD.ORG Tue Aug 6 01:11:43 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id D6DF3319 for ; Tue, 6 Aug 2013 01:11:43 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from alto.onthenet.com.au (alto.OntheNet.com.au [203.13.68.12]) by mx1.freebsd.org (Postfix) with ESMTP id 9931820FC for ; Tue, 6 Aug 2013 01:11:43 +0000 (UTC) Received: from dommail.onthenet.com.au (dommail.OntheNet.com.au [203.13.70.57]) by alto.onthenet.com.au (Postfix) with ESMTPS id 6BC5912344; Tue, 6 Aug 2013 11:11:41 +1000 (EST) Received: from Peter-Grehans-MacBook-Pro-2.local ([64.245.0.210]) by dommail.onthenet.com.au (MOS 4.2.4-GA) with ESMTP id BNV09900 (AUTH peterg@ptree32.com.au); Tue, 6 Aug 2013 11:11:40 +1000 Message-ID: <52004D4A.2050807@freebsd.org> Date: Mon, 05 Aug 2013 18:11:38 -0700 From: Peter Grehan User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:17.0) Gecko/20130620 Thunderbird/17.0.7 MIME-Version: 1.0 To: Takuya ASADA Subject: Re: Standalone binary loader for BHyVe References: In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 06 Aug 2013 01:11:43 -0000 Hi Takuya, > I implemented standalone binary loader for BHyVe. > This allows to load custom program on guest memory area, and run it from > specified entry point address. > I wrote this for test code of BHyVe suspend/resume project(Yoneji Iori's > work), but it might be useful for some other purposes. Nice work. This could be useful to build a test suite on top of e.g. to exercise the instruction emulation. later, Peter. From owner-freebsd-virtualization@FreeBSD.ORG Tue Aug 6 22:03:01 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id F27BC566 for ; Tue, 6 Aug 2013 22:03:00 +0000 (UTC) (envelope-from mailinglists@debank.tv) Received: from smtpout300.onlinespamfilter.nl (smtpout300.onlinespamfilter.nl [IPv6:2001:4cb8:1:1620:217:21:240:161]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 8330A27B6 for ; Tue, 6 Aug 2013 22:03:00 +0000 (UTC) Received: from smtp.onlinespamfilter.nl (localhost [127.0.0.1]) by smtp.onlinespamfilter.nl (Postfix) with ESMTP id AC772207C5 for ; Wed, 7 Aug 2013 00:05:00 +0200 (CEST) Received: from smtp.debank.tv (145-158-ftth.on.nl [88.159.158.145]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by smtp.onlinespamfilter.nl (Postfix) with ESMTPS for ; Wed, 7 Aug 2013 00:05:00 +0200 (CEST) Received: from smtp.debank.tv (smtp.debank.tv [172.16.143.25]) by smtp.debank.tv (Postfix) with ESMTP id 0A35F98D15C for ; Wed, 7 Aug 2013 00:02:55 +0200 (CEST) Received: from debank.tv (roundcube.debank.tv [172.16.143.41]) by smtp.debank.tv (Postfix) with ESMTP id C35AA98D149 for ; Wed, 7 Aug 2013 00:02:54 +0200 (CEST) MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Date: Wed, 07 Aug 2013 10:02:54 +1200 From: mailinglists@debank.tv To: freebsd-virtualization@freebsd.org Subject: bhyve and virtualbox on the same host using EPT Message-ID: <1f2844d8e1f5f5f931811be351f19bd9@debank.tv> X-Sender: mailinglists@debank.tv User-Agent: Roundcube Webmail/0.8.6 X-Virus-Scanned: ClamAV using ClamSMTP @ debank.tv X-OSF-Virus: CLEAN X-OSF-SUM: 14b01933f77b7b21d07e9ad62ee46eb1 X-OSF-Info: Checked for spam and viruses X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 06 Aug 2013 22:03:01 -0000 All, I'm trying to run a bhyve VM on a host that's already running Virtualbox, the problem I encounter is bhyve doesn't detect EPT capabilities but the Virtualbox logs indicate EPT is in use and functional. My question is; is it possible for two pieces of virtualization software to use EPT on the same host? See below for the various logs, happy to provide more info if needed. Bhyve generates the following error after the bootloader screen: ----------------------------------------------------- Booting... 4 vCPUs requested but only 1 available ----------------------------------------------------- A quick look in the source code indicates that this error means bhyve can't use EPT and falls back to using 1 CPU, now the machine in question does have EPT capabilites (it lists POPCNT in dmesg): ----------------------------------------------------- uname -a FreeBSD becks.debank.tv 10.0-CURRENT FreeBSD 10.0-CURRENT #0 r253788M: Tue Jul 30 12:02:57 NZST 2013 root@becks.debank.tv:/usr/obj/usr/src/sys/GENERIC amd64 ----------------------------------------------------- ----------------------------------------------------- from dmesg CPU: Intel(R) Core(TM) i7 CPU 920 @ 2.67GHz (2664.82-MHz K8-class CPU) Origin = "GenuineIntel" Id = 0x106a5 Family = 0x6 Model = 0x1a Stepping = 5 Features=0xbfebfbff Features2=0x98e3bd AMD Features=0x28100800 AMD Features2=0x1 TSC: P-state invariant, performance statistics real memory = 25769803776 (24576 MB) avail memory = 24060841984 (22946 MB) ----------------------------------------------------- ----------------------------------------------------- root@becks:~/bhyve # kldstat Id Refs Address Size Name 1 27 0xffffffff80200000 150e0d0 kernel 2 1 0xffffffff8170f000 224a98 zfs.ko 3 2 0xffffffff81934000 5c30 opensolaris.ko 4 1 0xffffffff8193a000 2d40 coretemp.ko 5 3 0xffffffff8193d000 51a68 vboxdrv.ko 6 2 0xffffffff81a12000 28c0 vboxnetflt.ko 7 2 0xffffffff81a15000 881d netgraph.ko 8 1 0xffffffff81a1e000 15ff ng_ether.ko 9 1 0xffffffff81a20000 3ec0 vboxnetadp.ko 10 1 0xffffffff81aba000 1037 cpuctl.ko 11 1 0xffffffff81abc000 1686ac vmm.ko ----------------------------------------------------- The Virtualbox logs below show EPT in use: ----------------------------------------------------- 00:00:00.419806 HWACCM: MSR_IA32_VMX_PROCBASED_CTLS2 = 7f00000000 00:00:00.419807 HWACCM: VMX_VMCS_CTRL_PROC_EXEC2_VIRT_APIC 00:00:00.419807 HWACCM: VMX_VMCS_CTRL_PROC_EXEC2_EPT 00:00:00.419808 HWACCM: VMX_VMCS_CTRL_PROC_EXEC2_DESCRIPTOR_INSTR_EXIT 00:00:00.419808 HWACCM: VMX_VMCS_CTRL_PROC_EXEC2_RDTSCP 00:00:00.419809 HWACCM: VMX_VMCS_CTRL_PROC_EXEC2_X2APIC 00:00:00.419809 HWACCM: VMX_VMCS_CTRL_PROC_EXEC2_VPID 00:00:00.419810 HWACCM: VMX_VMCS_CTRL_PROC_EXEC2_WBINVD_EXIT ---- snip ------ 00:00:00.419916 HWACCM: 32-bit and 64-bit guests supported. 00:00:00.419917 HWACCM: VMX enabled! 00:00:00.419918 HWACCM: Enabled nested paging 00:00:00.419919 HWACCM: EPT root page = 00000000b6167000 00:00:00.419922 HWACCM: Large page support enabled! ----------------------------------------------------- Thanks, Rob Evers From owner-freebsd-virtualization@FreeBSD.ORG Tue Aug 6 22:33:49 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 686A87AC for ; Tue, 6 Aug 2013 22:33:49 +0000 (UTC) (envelope-from akgupt3@gmail.com) Received: from mail-wi0-x22f.google.com (mail-wi0-x22f.google.com [IPv6:2a00:1450:400c:c05::22f]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id DCE2E28AB for ; Tue, 6 Aug 2013 22:33:48 +0000 (UTC) Received: by mail-wi0-f175.google.com with SMTP id hq12so3287292wib.14 for ; Tue, 06 Aug 2013 15:33:47 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=5xUNyIswXn9+DNyHEKRL6RepJ0NwAIA77SwxgEXEAII=; b=wuxF6+0htEemH7+8WNfbHbFbuXygZdQthqlX4giU83tV/1wocT4YXuQVc3F7i5zo6d JTd9WW8xNxYmFUh7wWqcEiNO28WvTyNefrI0oyslpcb3TUp6Y03cjOHaAPNvPii86vtq 6pMWh1qXN+n1GIIksH+cDLV9lp9p/E3a8eGAnWPdP8D2EiiXQNeCcQHDSNYjE94+hcry 52yYWPo8K8RDWYWY3gS4XUEZgu5a+GrNVfNY5RTOgICwquhn6UauTxYFLduoCv15zH6e msGSJPJZav5CYPmkz1sDO7QyZXWsQZIK0xXoPEBc1u7LBXaRIRtRSsa7UxwbAjPh9DMu Nx2w== MIME-Version: 1.0 X-Received: by 10.194.120.225 with SMTP id lf1mr207353wjb.74.1375828427057; Tue, 06 Aug 2013 15:33:47 -0700 (PDT) Received: by 10.194.56.99 with HTTP; Tue, 6 Aug 2013 15:33:46 -0700 (PDT) In-Reply-To: <1f2844d8e1f5f5f931811be351f19bd9@debank.tv> References: <1f2844d8e1f5f5f931811be351f19bd9@debank.tv> Date: Tue, 6 Aug 2013 15:33:46 -0700 Message-ID: Subject: Re: bhyve and virtualbox on the same host using EPT From: Anish To: mailinglists@debank.tv Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.14 Cc: freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 06 Aug 2013 22:33:49 -0000 Each processor has its own EPT root pointer in VMCS. How many processors are there in system and how many are given to Virtualbox. error = vmcs_set_defaults(&vmx->vmcs[i], (u_long)vmx_longjmp, (u_long)&vmx->ctx[i], vtophys(vmx->pml4ept), pinbased_ctls, procbased_ctls, procbased_ctls2, exit_ctls, entry_ctls, vtophys(vmx->msr_bitmap), vpid); On Tue, Aug 6, 2013 at 3:02 PM, wrote: > All, > > > I'm trying to run a bhyve VM on a host that's already running Virtualbox, > the problem I encounter is bhyve doesn't detect EPT capabilities but the > Virtualbox logs indicate EPT is in use and functional. > My question is; is it possible for two pieces of virtualization software > to use EPT on the same host? > > See below for the various logs, happy to provide more info if needed. > > > Bhyve generates the following error after the bootloader screen: > > ------------------------------**----------------------- > Booting... > 4 vCPUs requested but only 1 available > ------------------------------**----------------------- > > A quick look in the source code indicates that this error means bhyve > can't use EPT and falls back to using 1 CPU, now the machine in question > does have EPT capabilites (it lists POPCNT in dmesg): > > ------------------------------**----------------------- > uname -a > FreeBSD becks.debank.tv 10.0-CURRENT FreeBSD 10.0-CURRENT #0 r253788M: > Tue Jul 30 12:02:57 NZST 2013 root@becks.debank.tv:/usr/obj/**usr/src/sys/GENERIC > amd64 > ------------------------------**----------------------- > ------------------------------**----------------------- > from dmesg > CPU: Intel(R) Core(TM) i7 CPU 920 @ 2.67GHz (2664.82-MHz K8-class > CPU) > Origin = "GenuineIntel" Id = 0x106a5 Family = 0x6 Model = 0x1a > Stepping = 5 > Features=0xbfebfbff APIC,SEP,MTRR,PGE,MCA,CMOV,**PAT,PSE36,CLFLUSH,DTS,ACPI,** > MMX,FXSR,SSE,SSE2,SS,HTT,TM,**PBE> > Features2=0x98e3bd SSSE3,CX16,xTPR,PDCM,SSE4.1,**SSE4.2,POPCNT> > AMD Features=0x28100800 > AMD Features2=0x1 > TSC: P-state invariant, performance statistics > real memory = 25769803776 (24576 MB) > avail memory = 24060841984 (22946 MB) > ------------------------------**----------------------- > ------------------------------**----------------------- > root@becks:~/bhyve # kldstat > Id Refs Address Size Name > 1 27 0xffffffff80200000 150e0d0 kernel > 2 1 0xffffffff8170f000 224a98 zfs.ko > 3 2 0xffffffff81934000 5c30 opensolaris.ko > 4 1 0xffffffff8193a000 2d40 coretemp.ko > 5 3 0xffffffff8193d000 51a68 vboxdrv.ko > 6 2 0xffffffff81a12000 28c0 vboxnetflt.ko > 7 2 0xffffffff81a15000 881d netgraph.ko > 8 1 0xffffffff81a1e000 15ff ng_ether.ko > 9 1 0xffffffff81a20000 3ec0 vboxnetadp.ko > 10 1 0xffffffff81aba000 1037 cpuctl.ko > 11 1 0xffffffff81abc000 1686ac vmm.ko > ------------------------------**----------------------- > > The Virtualbox logs below show EPT in use: > ------------------------------**----------------------- > 00:00:00.419806 HWACCM: MSR_IA32_VMX_PROCBASED_CTLS2 = 7f00000000 > 00:00:00.419807 HWACCM: VMX_VMCS_CTRL_PROC_EXEC2_VIRT_**APIC > 00:00:00.419807 HWACCM: VMX_VMCS_CTRL_PROC_EXEC2_EPT > 00:00:00.419808 HWACCM: VMX_VMCS_CTRL_PROC_EXEC2_** > DESCRIPTOR_INSTR_EXIT > 00:00:00.419808 HWACCM: VMX_VMCS_CTRL_PROC_EXEC2_**RDTSCP > 00:00:00.419809 HWACCM: VMX_VMCS_CTRL_PROC_EXEC2_**X2APIC > 00:00:00.419809 HWACCM: VMX_VMCS_CTRL_PROC_EXEC2_VPID > 00:00:00.419810 HWACCM: VMX_VMCS_CTRL_PROC_EXEC2_**WBINVD_EXIT > ---- snip ------ > 00:00:00.419916 HWACCM: 32-bit and 64-bit guests supported. > 00:00:00.419917 HWACCM: VMX enabled! > 00:00:00.419918 HWACCM: Enabled nested paging > 00:00:00.419919 HWACCM: EPT root page = 00000000b6167000 > 00:00:00.419922 HWACCM: Large page support enabled! > ------------------------------**----------------------- > > Thanks, > Rob Evers > > ______________________________**_________________ > freebsd-virtualization@**freebsd.org mailing list > http://lists.freebsd.org/**mailman/listinfo/freebsd-**virtualization > To unsubscribe, send any mail to "freebsd-virtualization-** > unsubscribe@freebsd.org " > From owner-freebsd-virtualization@FreeBSD.ORG Tue Aug 6 23:06:26 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id EACD0E5D for ; Tue, 6 Aug 2013 23:06:26 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from alto.onthenet.com.au (alto.OntheNet.com.au [203.13.68.12]) by mx1.freebsd.org (Postfix) with ESMTP id AABEE29F1 for ; Tue, 6 Aug 2013 23:06:26 +0000 (UTC) Received: from dommail.onthenet.com.au (dommail.OntheNet.com.au [203.13.70.57]) by alto.onthenet.com.au (Postfix) with ESMTPS id 8012D11DDE for ; Wed, 7 Aug 2013 09:06:18 +1000 (EST) Received: from Peter-Grehans-MacBook-Pro-2.local ([64.245.0.210]) by dommail.onthenet.com.au (MOS 4.2.4-GA) with ESMTP id BNV61534 (AUTH peterg@ptree32.com.au); Wed, 7 Aug 2013 09:06:17 +1000 Message-ID: <52018166.7050004@freebsd.org> Date: Tue, 06 Aug 2013 16:06:14 -0700 From: Peter Grehan User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:17.0) Gecko/20130620 Thunderbird/17.0.7 MIME-Version: 1.0 To: freebsd-virtualization@freebsd.org Subject: Re: bhyve and virtualbox on the same host using EPT References: <1f2844d8e1f5f5f931811be351f19bd9@debank.tv> In-Reply-To: <1f2844d8e1f5f5f931811be351f19bd9@debank.tv> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 06 Aug 2013 23:06:27 -0000 Hi Rob, > Bhyve generates the following error after the bootloader screen: > > ----------------------------------------------------- > Booting... > 4 vCPUs requested but only 1 available > ----------------------------------------------------- What this means is that the model of CPU that you have doesn't support the "unrestricted guest" feature, which allows a guest to run in 16-bit mode. bhyve boots FreeBSD directly into 64-bit mode on the main CPU, but secondary CPUs are started through a boostrap from 16-bit mode to 64-bit mode. There was a hack early on in bhyve to avoid this by starting the secondaries directly in 64-bit mode, but it was bhyve- and FreeBSD-specific and difficult to maintain. Given that there was only a small timeframe of CPUs that supported EPT but not unrestricted guest (early Nehalems), we decided to the 64-bit AP spinup. You can still run single vCPU guests though. > The Virtualbox logs below show EPT in use: On the issue of running VBox and bhyve at the same time: that's not recommended and will probably result in a crash. To do this requires cooperation from hypervisors in that they will completely flush state any time they could be context-switched away to avoid the other hypervisor's state from colliding. This results in poor performance which is why it usually isn't done by default. I think we know how to fix this in bhyve, but aren't there yet. later, Peter. From owner-freebsd-virtualization@FreeBSD.ORG Tue Aug 6 23:10:41 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id B22BCF13 for ; Tue, 6 Aug 2013 23:10:41 +0000 (UTC) (envelope-from mailinglists@debank.tv) Received: from smtpout100.onlinespamfilter.nl (smtpout100.onlinespamfilter.nl [IPv6:2001:4cb8:1:1620:217:21:240:168]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 385BD2A1E for ; Tue, 6 Aug 2013 23:10:41 +0000 (UTC) Received: from smtp.onlinespamfilter.nl (localhost [127.0.0.1]) by smtp.onlinespamfilter.nl (Postfix) with ESMTP id 4D51B207C5 for ; Wed, 7 Aug 2013 01:12:41 +0200 (CEST) Received: from smtp.debank.tv (145-158-ftth.on.nl [88.159.158.145]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by smtp.onlinespamfilter.nl (Postfix) with ESMTPS for ; Wed, 7 Aug 2013 01:12:41 +0200 (CEST) Received: from smtp.debank.tv (smtp.debank.tv [172.16.143.25]) by smtp.debank.tv (Postfix) with ESMTP id 789883239D8 for ; Wed, 7 Aug 2013 01:10:35 +0200 (CEST) Received: from debank.tv (roundcube.debank.tv [172.16.143.41]) by smtp.debank.tv (Postfix) with ESMTP id 3E8563239D3 for ; Wed, 7 Aug 2013 01:10:35 +0200 (CEST) MIME-Version: 1.0 Date: Wed, 07 Aug 2013 11:10:35 +1200 From: mailinglists@debank.tv To: freebsd-virtualization@freebsd.org Subject: Re: bhyve and virtualbox on the same host using EPT In-Reply-To: References: <1f2844d8e1f5f5f931811be351f19bd9@debank.tv> Message-ID: <52a20877a1dd07ab56e0a015a781f80f@debank.tv> X-Sender: mailinglists@debank.tv User-Agent: Roundcube Webmail/0.8.6 X-Virus-Scanned: ClamAV using ClamSMTP @ debank.tv X-OSF-Virus: CLEAN X-OSF-SUM: 009af07ee558f29af3b5b5261cc3c05c X-OSF-Info: Checked for spam and viruses Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.14 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 06 Aug 2013 23:10:41 -0000 > On Tue, Aug 6, 2013 at 3:02 PM, wrote: > >> All, >> >> I'm trying to run a bhyve VM on a host that's already running Virtualbox, the problem I encounter is bhyve doesn't detect EPT capabilities but the Virtualbox logs indicate EPT is in use and functional. >> My question is; is it possible for two pieces of virtualization software to use EPT on the same host? >> >> See below for the various logs, happy to provide more info if needed. >> >> Bhyve generates the following error after the bootloader screen: >> >> ----------------------------------------------------- >> Booting... >> 4 vCPUs requested but only 1 available >> ----------------------------------------------------- >> >> A quick look in the source code indicates that this error means bhyve can't use EPT and falls back to using 1 CPU, now the machine in question does have EPT capabilites (it lists POPCNT in dmesg): >> >> ----------------------------------------------------- >> uname -a >> FreeBSD becks.debank.tv [1] 10.0-CURRENT FreeBSD 10.0-CURRENT #0 r253788M: Tue Jul 30 12:02:57 NZST 2013 root@becks.debank.tv:/usr/obj/usr/src/sys/GENERIC amd64 >> ----------------------------------------------------- >> ----------------------------------------------------- >> from dmesg >> CPU: Intel(R) Core(TM) i7 CPU 920 @ 2.67GHz (2664.82-MHz K8-class CPU) >> Origin = "GenuineIntel" Id = 0x106a5 Family = 0x6 Model = 0x1a Stepping = 5 >> Features=0xbfebfbff >> Features2=0x98e3bd >> AMD Features=0x28100800 >> AMD Features2=0x1 >> TSC: P-state invariant, performance statistics >> real memory = 25769803776 (24576 MB) >> avail memory = 24060841984 (22946 MB) >> ----------------------------------------------------- >> ----------------------------------------------------- >> root@becks:~/bhyve # kldstat >> Id Refs Address Size Name >> 1 27 0xffffffff80200000 150e0d0 kernel >> 2 1 0xffffffff8170f000 224a98 zfs.ko >> 3 2 0xffffffff81934000 5c30 opensolaris.ko >> 4 1 0xffffffff8193a000 2d40 coretemp.ko >> 5 3 0xffffffff8193d000 51a68 vboxdrv.ko >> 6 2 0xffffffff81a12000 28c0 vboxnetflt.ko >> 7 2 0xffffffff81a15000 881d netgraph.ko >> 8 1 0xffffffff81a1e000 15ff ng_ether.ko >> 9 1 0xffffffff81a20000 3ec0 vboxnetadp.ko >> 10 1 0xffffffff81aba000 1037 cpuctl.ko >> 11 1 0xffffffff81abc000 1686ac vmm.ko >> ----------------------------------------------------- >> >> The Virtualbox logs below show EPT in use: >> ----------------------------------------------------- >> 00:00:00.419806 HWACCM: MSR_IA32_VMX_PROCBASED_CTLS2 = 7f00000000 >> 00:00:00.419807 HWACCM: VMX_VMCS_CTRL_PROC_EXEC2_VIRT_APIC >> 00:00:00.419807 HWACCM: VMX_VMCS_CTRL_PROC_EXEC2_EPT >> 00:00:00.419808 HWACCM: VMX_VMCS_CTRL_PROC_EXEC2_DESCRIPTOR_INSTR_EXIT >> 00:00:00.419808 HWACCM: VMX_VMCS_CTRL_PROC_EXEC2_RDTSCP >> 00:00:00.419809 HWACCM: VMX_VMCS_CTRL_PROC_EXEC2_X2APIC >> 00:00:00.419809 HWACCM: VMX_VMCS_CTRL_PROC_EXEC2_VPID >> 00:00:00.419810 HWACCM: VMX_VMCS_CTRL_PROC_EXEC2_WBINVD_EXIT >> ---- snip ------ >> 00:00:00.419916 HWACCM: 32-bit and 64-bit guests supported. >> 00:00:00.419917 HWACCM: VMX enabled! >> 00:00:00.419918 HWACCM: Enabled nested paging >> 00:00:00.419919 HWACCM: EPT root page = 00000000b6167000 >> 00:00:00.419922 HWACCM: Large page support enabled! >> ----------------------------------------------------- >> >> Thanks, >> Rob Evers >> >> _______________________________________________ >> freebsd-virtualization@freebsd.org mailing list >> http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization [2] >> To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@freebsd.org" On 2013-08-07 10:33, Anish wrote: Each processor has its own EPT root pointer in VMCS. How many processors are there in system and how many are given to Virtualbox. error = vmcs_set_defaults(&vmx->vmcs[i], (u_long)vmx_longjmp, (u_long)&vmx->ctx[i], vtophys(vmx->pml4ept), pinbased_ctls, procbased_ctls, procbased_ctls2, exit_ctls, entry_ctls, vtophys(vmx->msr_bitmap), vpid); Anish, The machine has one physical CPU with 4 cores using HT giving 8 threads. I can't quickly find an option to Virtualbox to limit the amount of cpu's used but did try to disable Virtualbox (no rc.d scripts ran and disabled loading the kernel module) after a reboot of the machine, the problem persists. ----------------------------------------------------- root@becks:~/bhyve # kldstat Id Refs Address Size Name 1 17 0xffffffff80200000 150e0d0 kernel 2 1 0xffffffff8170f000 224a98 zfs.ko 3 2 0xffffffff81934000 5c30 opensolaris.ko 4 1 0xffffffff8193a000 2d40 coretemp.ko 5 1 0xffffffff81a12000 1037 cpuctl.ko 6 1 0xffffffff81a14000 1686ac vmm.ko ----------------------------------------------------- ----------------------------------------------------- root@becks:~/bhyve # sh /usr/share/examples/bhyve/vmrun.sh -c 4 -m 2048 fbsd_10 Launching virtual machine "fbsd_10" ... Consoles: userboot FreeBSD/amd64 User boot, Revision 1.1 (root@becks.debank.tv, Tue Jul 30 11:28:33 NZST 2013) Loading /boot/defaults/loader.conf /boot/kernel/kernel text=0xd2f190 data=0x15de70+0x2baac0 syms=[0x8+0x14d648+0x8+0x1a9f58] -------------- snip ------------------ Booting... 4 vCPUs requested but only 1 available ----------------------------------------------------- Could there be a problem in the CPU capability discovery code in bhyve or is my machine not enabling EPT and Virtualbox wrongly reporting the EPT capabilities? Rob Evers Links: ------ [1] http://becks.debank.tv [2] http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization From owner-freebsd-virtualization@FreeBSD.ORG Tue Aug 6 23:17:11 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id D4EE6FB4 for ; Tue, 6 Aug 2013 23:17:11 +0000 (UTC) (envelope-from mailinglists@debank.tv) Received: from smtpout300.onlinespamfilter.nl (smtpout300.onlinespamfilter.nl [IPv6:2001:4cb8:1:1620:217:21:240:161]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 936AC2A4F for ; Tue, 6 Aug 2013 23:17:11 +0000 (UTC) Received: from smtp.onlinespamfilter.nl (localhost [127.0.0.1]) by smtp.onlinespamfilter.nl (Postfix) with ESMTP id 76BB620AA8 for ; Wed, 7 Aug 2013 01:19:13 +0200 (CEST) Received: from smtp.debank.tv (145-158-ftth.on.nl [88.159.158.145]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by smtp.onlinespamfilter.nl (Postfix) with ESMTPS for ; Wed, 7 Aug 2013 01:19:13 +0200 (CEST) Received: from smtp.debank.tv (smtp.debank.tv [172.16.143.25]) by smtp.debank.tv (Postfix) with ESMTP id AD952323F55 for ; Wed, 7 Aug 2013 01:17:07 +0200 (CEST) Received: from debank.tv (roundcube.debank.tv [172.16.143.41]) by smtp.debank.tv (Postfix) with ESMTP id 72A6D323F18 for ; Wed, 7 Aug 2013 01:17:07 +0200 (CEST) MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Date: Wed, 07 Aug 2013 11:17:07 +1200 From: mailinglists@debank.tv To: freebsd-virtualization@freebsd.org Subject: Re: bhyve and virtualbox on the same host using EPT In-Reply-To: <52018166.7050004@freebsd.org> References: <1f2844d8e1f5f5f931811be351f19bd9@debank.tv> <52018166.7050004@freebsd.org> Message-ID: X-Sender: mailinglists@debank.tv User-Agent: Roundcube Webmail/0.8.6 X-Virus-Scanned: ClamAV using ClamSMTP @ debank.tv X-OSF-Virus: CLEAN X-OSF-SUM: 4301b54191f685fe22873c6f2956af02 X-OSF-Info: Checked for spam and viruses X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 06 Aug 2013 23:17:11 -0000 On 2013-08-07 11:06, Peter Grehan wrote: > Hi Rob, > >> Bhyve generates the following error after the bootloader screen: >> >> ----------------------------------------------------- >> Booting... >> 4 vCPUs requested but only 1 available >> ----------------------------------------------------- > > What this means is that the model of CPU that you have doesn't > support the "unrestricted guest" feature, which allows a guest to run > in 16-bit mode. > > bhyve boots FreeBSD directly into 64-bit mode on the main CPU, but > secondary CPUs are started through a boostrap from 16-bit mode to > 64-bit mode. There was a hack early on in bhyve to avoid this by > starting the secondaries directly in 64-bit mode, but it was bhyve- > and FreeBSD-specific and difficult to maintain. Given that there was > only a small timeframe of CPUs that supported EPT but not unrestricted > guest (early Nehalems), we decided to the 64-bit AP spinup. > > You can still run single vCPU guests though. > >> The Virtualbox logs below show EPT in use: > > On the issue of running VBox and bhyve at the same time: that's not > recommended and will probably result in a crash. To do this requires > cooperation from hypervisors in that they will completely flush state > any time they could be context-switched away to avoid the other > hypervisor's state from colliding. This results in poor performance > which is why it usually isn't done by default. > > I think we know how to fix this in bhyve, but aren't there yet. > > later, > > Peter. > > Peter, Thanks for your answer, this clears things up, I was under the impression that EPT support automatically included the "unrestricted guest" feature. Unfortunately I'll have to stick with Virtualbox as I need multiple CPU support for my vm's. Thanks for the great software though, I'll be back running bHyve once I get my hands on a more capable machine! Thanks, Rob Evers From owner-freebsd-virtualization@FreeBSD.ORG Fri Aug 9 03:28:50 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id D147058A for ; Fri, 9 Aug 2013 03:28:50 +0000 (UTC) (envelope-from aryeh.friedman@gmail.com) Received: from mail-pd0-x234.google.com (mail-pd0-x234.google.com [IPv6:2607:f8b0:400e:c02::234]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id B0C7728DF for ; Fri, 9 Aug 2013 03:28:50 +0000 (UTC) Received: by mail-pd0-f180.google.com with SMTP id y10so51138pdj.11 for ; Thu, 08 Aug 2013 20:28:50 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=E1epueH9+tRnve51/Z5wH45EOj7b6zpZ/MriaLMHtDc=; b=ut6Y1L53w8sLhIBHKnDUo8o9L2teVedlGL1KxgXFhPM06Qzzl5q3NgvzCjRU8gR+7E 3c6DBVA+eD6usYHVy7c2fSpziOgimPpkO9yefzEv5MzY/P2LMs6Tv30p+oFGTFN6lmhR 5iP24XmqnknOo3WG5GqMnpxkPfK2oe6NTtSR+5TCZC/JMBEys7FlMw6cBTTmigQdTHEA d8STxZSvPNJ7bVBvPFKzytskM3+oS9etXc31AMz6F0Glw3x/w+n3dUPBVgXT20sykYiA uqWkcAjafqhELFUa2jL8mqmhw4Q8vfPPss8t3KxrZHTrm7Fu9hlfkfVNBmlBkRLJ1+HK IXbw== MIME-Version: 1.0 X-Received: by 10.68.180.1 with SMTP id dk1mr9291482pbc.174.1376018930351; Thu, 08 Aug 2013 20:28:50 -0700 (PDT) Received: by 10.68.51.169 with HTTP; Thu, 8 Aug 2013 20:28:50 -0700 (PDT) Date: Thu, 8 Aug 2013 23:28:50 -0400 Message-ID: Subject: 9.2. + bhyve From: Aryeh Friedman To: freebsd-virtualization@freebsd.org Content-Type: text/plain; charset=ISO-8859-1 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 09 Aug 2013 03:28:50 -0000 What is the status of bhyve in 9.2? I will have some other tech questions on bhyve this weekend