Skip site navigation (1)Skip section navigation (2)
Date:      Tue, 20 Oct 2015 21:40:42 -0700
From:      Cory Smelosky <corys@ixsystems.com>
To:        freebsd-virtualization@freebsd.org
Subject:   Issues with bhyve under KVM
Message-ID:  <78cd6c472dfa583c81442d766e620bf7@ixsystems.com>
In-Reply-To: <061b9d92bf351baa9263279e86513861@ixsystems.com>
References:  <061b9d92bf351baa9263279e86513861@ixsystems.com>

next in thread | previous in thread | raw e-mail | index | archive | help
Hey all,

I am utterly confused by this one: I am unable to load vmm.ko nested in 
KVM. (10.2 on a 2x E5-2620v2 board, linux kernel 4.x for host, kvm/qemu 
2.4, proxmox 4.0. Nested bool is set true in module config).

`dmesg` prints a message saying that VT-x is "disabled by BIOS" (I 
passed -L and -bios pointed at OVMF just in case it was a strange 
SEABIOS compile option) to no change.  -cpu is set to host, I have also 
tried passing -cpu qemu64,+vmx manually to no change.

(`kldload vmm` does agree - it says features are missing)

Linux appears to have no problems with bringing kvm up nested (I tested 
kvm -enable-kvm as well to no complaints).  What am I missing?

model name      : Intel(R) Xeon(R) CPU E5-2620 v2 @ 2.10GHz
stepping        : 4
microcode       : 0x1
cpu MHz         : 2099.998
cache size      : 15360 KB
physical id     : 0
siblings        : 1
core id         : 0
cpu cores       : 1
apicid          : 0
initial apicid  : 0
fpu             : yes
fpu_exception   : yes
cpuid level     : 13
wp              : yes
flags           : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge 
mca cmov pat pse36 clflush mmx fxsr sse sse2 ss syscall nx pdpe1gb 
rdtscp lm constant_tsc arch_perfmon rep_good nopl eagerfpu pni pclmulqdq 
vmx ssse3 cx16 pcid sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes 
xsave avx f16c rdrand hypervisor lahf_lm arat xsaveopt tpr_shadow vnmi 
flexpriority ept fsgsbase tsc_adjust smep erms

(note: this is the VM)

Verbose boot info:

Oct 14 06:13:10  kernel: CPU: Intel(R) Xeon(R) CPU E5-2620 v2 @ 2.10GHz 
(2100.02-MHz K8-class CPU)
Oct 14 06:13:10  kernel: Origin="GenuineIntel"  Id=0x306e4  Family=0x6  
Model=0x3e  Stepping=4
Oct 14 06:13:10  kernel: 
Features=0xf83fbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,MMX,FXSR,SSE,SSE2,SS>
Oct 14 06:13:10  kernel: 
Features2=0xffba2223<SSE3,PCLMULQDQ,VMX,SSSE3,CX16,PCID,SSE4.1,SSE4.2,x2APIC,POPCNT,TSCDLT,AESNI,XSAVE,OSXSAVE,AVX,F16C,RDRAND,HV>
Oct 14 06:13:10  kernel: AMD 
Features=0x2c100800<SYSCALL,NX,Page1GB,RDTSCP,LM>
Oct 14 06:13:10  kernel: AMD Features2=0x1<LAHF>
Oct 14 06:13:10  kernel: Structured Extended Features=0x202<TSCADJ,ERMS>
Oct 14 06:13:10  kernel: XSAVE Features=0x1<XSAVEOPT>
Oct 14 06:13:10  kernel: VT-x: (disabled in BIOS) Basic 
Features=0x981000<TRUE>
Oct 14 06:13:10  kernel: Pin-Based 
Controls=0xff<ExtINT,NMI,VNMI,PreTmr,PostIntr>
Oct 14 06:13:10  kernel: Primary Processor 
Controls=0xf7f9fffe<INTWIN,TSCOff,HLT,INVLPG,MWAIT,RDPMC,RDTSC,CR3-LD,CR3-ST,CR8-LD,CR8-ST,TPR,NMIWIN,MOV-DR,IO,IOmap,MSRmap,MONITOR,PAUSE>
Oct 14 06:13:10  kernel: Secondary Processor 
Controls=0x3db<APIC,EPT,RDTSCP,x2APIC,WBINVD,UG,APIC-reg,VID>
Oct 14 06:13:10  kernel: Exit Controls=0x981000<PERF,PAT-LD,EFER-SV>
Oct 14 06:13:10  kernel: Entry Controls=0x981000
Oct 14 06:13:10  kernel: EPT Features=0x4114040<PW4,WB,2M,INVEPT,all>
Oct 14 06:13:10  kernel: VPID Features=0x0
Oct 14 06:13:10  kernel: Data TLB: 1 GByte pages, 4-way set associative, 
4 entries
Oct 14 06:13:10  kernel: Data TLB: 4 KB pages, 4-way set associative, 64 
entries
Oct 14 06:13:10  kernel: Instruction TLB: 2M/4M pages, fully 
associative, 8 entries
Oct 14 06:13:10  kernel: Instruction TLB: 4KByte pages, 4-way set 
associative, 64 entries
Oct 14 06:13:10  kernel: 64-Byte prefetching
Oct 14 06:13:10  kernel: Shared 2nd-Level TLB: 4 KByte pages, 4-way 
associative, 512 entries
Oct 14 06:13:10  kernel: L2 cache: 256 kbytes, 8-way associative, 64 
bytes/line
Oct 14 06:13:10  kernel: Hypervisor: Origin = "KVMKVMKVM"
Oct 14 06:13:10  kernel: real memory  = 4294967296 (4096 MB)
Oct 14 06:13:10  kernel: Physical memory chunk(s):
Oct 14 06:13:19  kernel: domain=0, bus=0, slot=31, func=3
Oct 14 06:13:19  kernel: class=0c-05-00, hdrtype=0x00, mfdev=1
Oct 14 06:13:19  kernel: cmdreg=0x0103, statreg=0x0000, cachelnsz=0 
(dwords)
Oct 14 06:13:19  kernel: lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), 
maxlat=0x00 (0 ns)
Oct 14 06:13:19  kernel: intpin=a, irq=16
Oct 14 06:13:19  kernel: pci0:0:31:3: reprobing on driver added
Oct 14 06:13:19  kernel: pci1: driver added
Oct 14 06:13:19  kernel: pci2: driver added
Oct 14 06:13:19  kernel: pci3: driver added
Oct 14 06:13:19  kernel: pci4: driver added
Oct 14 06:13:19  kernel: pci5: driver added
Oct 14 06:13:19  kernel: pci6: driver added
Oct 14 06:13:19  kernel: pci7: driver added
Oct 14 06:13:19  kernel: pci8: driver added
Oct 14 06:13:19  kernel: vmx_init: processor does not support desired 
basic capabilities
Oct 14 06:13:19  kernel: module_register_init: MOD_LOAD (vmm, 
0xffffffff81a16fd0, 0) error 2

Thanks!

-- 
--
Cory Smelosky
iXsystems



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?78cd6c472dfa583c81442d766e620bf7>