From owner-freebsd-virtualization@freebsd.org Wed Oct 21 04:29:44 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 25F0AA1A875 for ; Wed, 21 Oct 2015 04:29:44 +0000 (UTC) (envelope-from corys@ixsystems.com) Received: from barracuda.ixsystems.com (mail.ixsystems.com [69.198.165.135]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.ixsystems.com", Issuer "Go Daddy Secure Certificate Authority - G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id F19B7CC5 for ; Wed, 21 Oct 2015 04:29:43 +0000 (UTC) (envelope-from corys@ixsystems.com) X-ASG-Debug-ID: 1445401782-08ca040e84830e0001-XWyayz Received: from mail.iXsystems.com ([10.2.55.1]) by barracuda.ixsystems.com with ESMTP id BVggEfD92u6ZpBzY (version=TLSv1 cipher=DHE-RSA-CAMELLIA256-SHA bits=256 verify=NO) for ; Tue, 20 Oct 2015 21:29:42 -0700 (PDT) X-Barracuda-Envelope-From: corys@ixsystems.com X-Barracuda-RBL-Trusted-Forwarder: 10.2.55.1 X-ASG-Whitelist: Client Received: from roundcube.ixsystems.com (unknown [10.2.55.10]) by mail.iXsystems.com (Postfix) with ESMTPA id 61AE584AE9 for ; Tue, 20 Oct 2015 21:29:42 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=ixsystems.com; s=newknight0; t=1445401782; bh=FARsa3KQY/s3p/bb90kfQa04hnjNi+wikPINOVFhD0o=; h=Date:From:To:Subject:In-Reply-To:References; b=Jqa6A1DZOg050f0whwKK+ELJcGocwqExWeKcUt7+FoVHQ2csqaeC9Up9HZp9Mn/Kw EHAYtX8Lh2dIaHPnwp8n9dDOupVpyWIJm0SJDiq3foW3KAoCB4Z5qXlHdOcw5Z/qf+ IyiP625ugIgyNpnrK++55jGnhgZhVcHnhT58OvWw= X-Barracuda-RBL-Trusted-Forwarder: 10.2.55.10 MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII; format=flowed Content-Transfer-Encoding: 7bit Date: Tue, 20 Oct 2015 21:40:42 -0700 From: Cory Smelosky To: freebsd-virtualization@freebsd.org Subject: Issues with bhyve under KVM In-Reply-To: <061b9d92bf351baa9263279e86513861@ixsystems.com> X-ASG-Orig-Subj: Issues with bhyve under KVM References: <061b9d92bf351baa9263279e86513861@ixsystems.com> Message-ID: <78cd6c472dfa583c81442d766e620bf7@ixsystems.com> X-Sender: corys@ixsystems.com User-Agent: Roundcube Webmail/1.1.3 X-Barracuda-Connect: UNKNOWN[10.2.55.1] X-Barracuda-Start-Time: 1445401782 X-Barracuda-Encrypted: DHE-RSA-CAMELLIA256-SHA X-Barracuda-URL: https://10.2.0.41:443/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at ixsystems.com X-Barracuda-BRTS-Status: 1 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Oct 2015 04:29:44 -0000 Hey all, I am utterly confused by this one: I am unable to load vmm.ko nested in KVM. (10.2 on a 2x E5-2620v2 board, linux kernel 4.x for host, kvm/qemu 2.4, proxmox 4.0. Nested bool is set true in module config). `dmesg` prints a message saying that VT-x is "disabled by BIOS" (I passed -L and -bios pointed at OVMF just in case it was a strange SEABIOS compile option) to no change. -cpu is set to host, I have also tried passing -cpu qemu64,+vmx manually to no change. (`kldload vmm` does agree - it says features are missing) Linux appears to have no problems with bringing kvm up nested (I tested kvm -enable-kvm as well to no complaints). What am I missing? model name : Intel(R) Xeon(R) CPU E5-2620 v2 @ 2.10GHz stepping : 4 microcode : 0x1 cpu MHz : 2099.998 cache size : 15360 KB physical id : 0 siblings : 1 core id : 0 cpu cores : 1 apicid : 0 initial apicid : 0 fpu : yes fpu_exception : yes cpuid level : 13 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon rep_good nopl eagerfpu pni pclmulqdq vmx ssse3 cx16 pcid sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm arat xsaveopt tpr_shadow vnmi flexpriority ept fsgsbase tsc_adjust smep erms (note: this is the VM) Verbose boot info: Oct 14 06:13:10 kernel: CPU: Intel(R) Xeon(R) CPU E5-2620 v2 @ 2.10GHz (2100.02-MHz K8-class CPU) Oct 14 06:13:10 kernel: Origin="GenuineIntel" Id=0x306e4 Family=0x6 Model=0x3e Stepping=4 Oct 14 06:13:10 kernel: Features=0xf83fbff Oct 14 06:13:10 kernel: Features2=0xffba2223 Oct 14 06:13:10 kernel: AMD Features=0x2c100800 Oct 14 06:13:10 kernel: AMD Features2=0x1 Oct 14 06:13:10 kernel: Structured Extended Features=0x202 Oct 14 06:13:10 kernel: XSAVE Features=0x1 Oct 14 06:13:10 kernel: VT-x: (disabled in BIOS) Basic Features=0x981000 Oct 14 06:13:10 kernel: Pin-Based Controls=0xff Oct 14 06:13:10 kernel: Primary Processor Controls=0xf7f9fffe Oct 14 06:13:10 kernel: Secondary Processor Controls=0x3db Oct 14 06:13:10 kernel: Exit Controls=0x981000 Oct 14 06:13:10 kernel: Entry Controls=0x981000 Oct 14 06:13:10 kernel: EPT Features=0x4114040 Oct 14 06:13:10 kernel: VPID Features=0x0 Oct 14 06:13:10 kernel: Data TLB: 1 GByte pages, 4-way set associative, 4 entries Oct 14 06:13:10 kernel: Data TLB: 4 KB pages, 4-way set associative, 64 entries Oct 14 06:13:10 kernel: Instruction TLB: 2M/4M pages, fully associative, 8 entries Oct 14 06:13:10 kernel: Instruction TLB: 4KByte pages, 4-way set associative, 64 entries Oct 14 06:13:10 kernel: 64-Byte prefetching Oct 14 06:13:10 kernel: Shared 2nd-Level TLB: 4 KByte pages, 4-way associative, 512 entries Oct 14 06:13:10 kernel: L2 cache: 256 kbytes, 8-way associative, 64 bytes/line Oct 14 06:13:10 kernel: Hypervisor: Origin = "KVMKVMKVM" Oct 14 06:13:10 kernel: real memory = 4294967296 (4096 MB) Oct 14 06:13:10 kernel: Physical memory chunk(s): Oct 14 06:13:19 kernel: domain=0, bus=0, slot=31, func=3 Oct 14 06:13:19 kernel: class=0c-05-00, hdrtype=0x00, mfdev=1 Oct 14 06:13:19 kernel: cmdreg=0x0103, statreg=0x0000, cachelnsz=0 (dwords) Oct 14 06:13:19 kernel: lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) Oct 14 06:13:19 kernel: intpin=a, irq=16 Oct 14 06:13:19 kernel: pci0:0:31:3: reprobing on driver added Oct 14 06:13:19 kernel: pci1: driver added Oct 14 06:13:19 kernel: pci2: driver added Oct 14 06:13:19 kernel: pci3: driver added Oct 14 06:13:19 kernel: pci4: driver added Oct 14 06:13:19 kernel: pci5: driver added Oct 14 06:13:19 kernel: pci6: driver added Oct 14 06:13:19 kernel: pci7: driver added Oct 14 06:13:19 kernel: pci8: driver added Oct 14 06:13:19 kernel: vmx_init: processor does not support desired basic capabilities Oct 14 06:13:19 kernel: module_register_init: MOD_LOAD (vmm, 0xffffffff81a16fd0, 0) error 2 Thanks! -- -- Cory Smelosky iXsystems