From owner-freebsd-virtualization@freebsd.org Wed Oct 16 01:02:00 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id AD3B7158436 for ; Wed, 16 Oct 2019 01:02:00 +0000 (UTC) (envelope-from kiri@truefc.org) Received: from kx.truefc.org (flets-sg1026.kamome.or.jp [202.216.24.26]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp", Issuer "smtp" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 46tDXQ48ckz43L6 for ; Wed, 16 Oct 2019 01:01:57 +0000 (UTC) (envelope-from kiri@truefc.org) Received: from kx.truefc.org (kx.truefc.org [202.216.24.26]) by kx.truefc.org (8.15.2/8.15.2) with ESMTP id x9G11nWb052203; Wed, 16 Oct 2019 10:01:49 +0900 (JST) (envelope-from kiri@kx.truefc.org) Message-Id: <201910160101.x9G11nWb052203@kx.truefc.org> Date: Wed, 16 Oct 2019 10:01:49 +0900 From: KIRIYAMA Kazuhiko To: KIRIYAMA Kazuhiko Cc: Simon Gusev , freebsd-virtualization@freebsd.org Subject: Re: VM freezed at booting of FreeBSD-13.0-CURRENT-amd64-20191011-r353427-memstick.img In-Reply-To: <201910152217.x9FMH4JI051008@kx.truefc.org> References: <201910150751.x9F7p803016663@kx.truefc.org> <03057504.20191015110705@fly777.net> <201910151035.x9FAZNlU043565@kx.truefc.org> <201910152217.x9FMH4JI051008@kx.truefc.org> User-Agent: Wanderlust/2.15.9 (Almost Unreal) SEMI/1.14.6 (Maruoka) FLIM/1.14.9 (=?ISO-8859-4?Q?Goj=F2?=) APEL/10.8 MULE XEmacs/21.4 (patch 24) (Standard C) (amd64--freebsd) MIME-Version: 1.0 (generated by SEMI 1.14.6 - "Maruoka") Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 46tDXQ48ckz43L6 X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of kiri@truefc.org has no SPF policy when checking 202.216.24.26) smtp.mailfrom=kiri@truefc.org X-Spamd-Result: default: False [-0.49 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.67)[-0.667,0]; RCPT_COUNT_THREE(0.00)[3]; TO_DN_SOME(0.00)[]; FROM_HAS_DN(0.00)[]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[truefc.org]; AUTH_NA(1.00)[]; NEURAL_HAM_LONG(-0.92)[-0.921,0]; TO_MATCH_ENVRCPT_SOME(0.00)[]; R_SPF_NA(0.00)[]; RCVD_COUNT_ONE(0.00)[1]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:4704, ipnet:202.216.0.0/19, country:JP]; IP_SCORE(-0.00)[country: JP(-0.00)]; ONCE_RECEIVED(0.10)[] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 16 Oct 2019 01:02:00 -0000 On Wed, 16 Oct 2019 07:17:04 +0900, KIRIYAMA Kazuhiko wrote: >=20 > On Tue, 15 Oct 2019 19:35:23 +0900, > KIRIYAMA Kazuhiko wrote: > >=20 > > On Tue, 15 Oct 2019 17:07:05 +0900, > > Simon wrote: > > >=20 > > >=20 > > >=20 > > > Hi ) > > > May be the same problem. > > > I said about this here > > > https://forums.freebsd.org/threads/freebsd-12-0-release-amd64-freeze-= boot-from-bhyve-uefi-bhyve_uefi-fd-uefi-gop-screen-goes-blank.69616/ > > > Solution. > > > Try this > > > Select > > > 3 -=A0[Esc]ape to loader prompt=A0 > > > set boot_serial=3D"NO" > > > boot > >=20 > > `vm install' doesn't wait boot loader. So above > > manupulation could not work. I've specified it to the > > bhyveload `-e' option like with `-e boot_serial=3DNO': > >=20 > > root@vm:~ # cat /vm/tbedfc/vm-bhyve.log > > Oct 15 19:27:55: initialising > > Oct 15 19:27:55: [loader: bhyveload] > > Oct 15 19:27:55: [cpu: 2] > > Oct 15 19:27:55: [memory: 8GB] > > Oct 15 19:27:55: [hostbridge: standard] > > Oct 15 19:27:55: [com ports: com1] > > Oct 15 19:27:55: [uuid: 737d1159-ef36-11e9-847a-0cc47ab3cfd4] > > Oct 15 19:27:55: [utctime: yes] > > Oct 15 19:27:55: [debug mode: no] > > Oct 15 19:27:55: [primary disk: disk0.img] > > Oct 15 19:27:55: [primary disk dev: file] > > Oct 15 19:27:55: generated static mac 58:9c:fc:02:46:e2 (based on 'tbed= fc:0:1571135275:0') > > Oct 15 19:27:55: initialising network device tap0 > > Oct 15 19:27:55: adding tap0 -> vm-local (local addm) > > Oct 15 19:27:55: bring up tap0 -> vm-local (local addm) > > Oct 15 19:27:55: booting > > Oct 15 19:27:55: bhyveload -m 8GB -e autoboot_delay=3D3 -e boot_serial= =3DNO -d /vm/.iso/FreeBSD-13.0-CURRENT-amd64-20191011-r353427-memstick.img = tbedfc > > Oct 15 19:27:59: [bhyve options: -c 2 -m 8GB -AHP -U 737d1159-ef36-11e= 9-847a-0cc47ab3cfd4 -u] > > Oct 15 19:27:59: [bhyve devices: -s 0,hostbridge -s 31,lpc -s 4:0,virt= io-blk,/vm/tbedfc/disk0.img -s 5:0,virtio-net,tap0,mac=3D58:9c:fc:02:46:e2] > > Oct 15 19:27:59: [bhyve console: -l com1,stdio] > > Oct 15 19:27:59: [bhyve iso device: -s 3:0,ahci-hd,/vm/.iso/FreeBSD-13= .0-CURRENT-amd64-20191011-r353427-memstick.img] > > Oct 15 19:27:59: starting bhyve (run 1) > > Oct 15 19:29:54: bhyve exited with status 1 > > Oct 15 19:29:54: destroying network device tap0 > > Oct 15 19:29:55: stopped > > root@vm:~ #=20 > >=20 > > but also freezed ;-( >=20 > I've listed all boot variables at loader prompt: >=20 >=20 > Type '?' for a list of commands, 'help' for more detailed help. > OK show > LINES=3D24 > ansi_caption[1]=3D^[1mB^[moot Multi User ^[1m[Enter]^[m > ansi_caption[2]=3DBoot ^[1mS^[mingle User > ansi_caption[3]=3D^[1mEsc^[mape to loader prompt > ansi_caption[5]=3DKernel: default/kernel (1 of 2) > ansi_caption[5][0]=3DKernel: default/kernel (1 of 2) > ansi_caption[5][1]=3DKernel: kernel.old (2 of 2) > ansi_caption[6]=3DConfigure Boot ^[1mO^[mptions... > autoboot_delay=3DNO > beansi_bootfs=3D^[1mbootfs: ^[m > beansi_current=3D^[1mActive: ^[m > beansi_page=3D^[1mP^[mage:=20 > beansi_pageof=3D of=20 > bemenu_bootfs=3Dbootfs:=20 > bemenu_current=3DActive:=20 > bemenu_page=3D[P]age:=20 > bemenu_pageof=3D of=20 > boot_serial=3DNO > bootenv_autolist=3DYES > bootenv_root[2]=3D > bootenvmenu_command[1]=3Dbe_draw_screen 1 goto_menu > bootenvmenu_command[2]=3Dset_bootenv > bootenvmenu_command[3]=3Dset_be_page > beansi_bootfs=3D^[1mbootfs: ^[m > beansi_current=3D^[1mActive: ^[m > beansi_page=3D^[1mP^[mage:=20 > beansi_pageof=3D of=20 > bemenu_bootfs=3Dbootfs:=20 > bemenu_current=3DActive:=20 > bemenu_page=3D[P]age:=20 > bemenu_pageof=3D of=20 > boot_serial=3DNO > bootenv_autolist=3DYES > bootenv_root[2]=3D > bootenvmenu_command[1]=3Dbe_draw_screen 1 goto_menu > bootenvmenu_command[2]=3Dset_bootenv > bootenvmenu_command[3]=3Dset_be_page > bootenvmenu_init=3Dinit_bootenv =20 > bootenvmenu_keycode[1]=3D8 > bootenvmenu_keycode[2]=3D97 > bootenvmenu_keycode[3]=3D112 > bootenvmenu_options=3D4 > bootenvmenu_optionstext=3DBoot Environments: > bootfile=3Dkernel > console=3Duserboot > currdev=3Ddisk0s2a: > efi_max_resolution=3D1x1 > hint.acpi_throttle.0.disabled=3D1 > hint.atkbd.0.at=3Datkbdc > hint.atkbd.0.irq=3D1 > hint.atkbdc.0.at=3Disa > hint.atkbdc.0.port=3D0x060 > hint.atrtc.0.at=3Disa > hint.atrtc.0.irq=3D8 > hint.atrtc.0.port=3D0x70 > hint.attimer.0.at=3Disa > hint.attimer.0.irq=3D0 > hint.attimer.0.port=3D0x40 > hint.fd.0.at=3Dfdc0 > hint.fd.0.drive=3D0 > efi_max_resolution=3D1x1 > hint.acpi_throttle.0.disabled=3D1 > hint.atkbd.0.at=3Datkbdc > hint.atkbd.0.irq=3D1 > hint.atkbdc.0.at=3Disa > hint.atkbdc.0.port=3D0x060 > hint.atrtc.0.at=3Disa > hint.atrtc.0.irq=3D8 > hint.atrtc.0.port=3D0x70 > hint.attimer.0.at=3Disa > hint.attimer.0.irq=3D0 > hint.attimer.0.port=3D0x40 > hint.fd.0.at=3Dfdc0 > hint.fd.0.drive=3D0 > hint.fd.1.at=3Dfdc0 =20 > hint.fd.1.drive=3D1 > hint.fdc.0.at=3Disa > hint.fdc.0.drq=3D2 > hint.fdc.0.irq=3D6 > hint.fdc.0.port=3D0x3F0 > hint.p4tcc.0.disabled=3D1 > hint.ppc.0.at=3Disa > hint.ppc.0.irq=3D7 > hint.psm.0.at=3Datkbdc > hint.psm.0.irq=3D12 > hint.sc.0.at=3Disa > hint.sc.0.flags=3D0x100 > hint.uart.0.at=3Disa > hint.uart.0.flags=3D0x10 > hint.uart.0.irq=3D4 > hint.uart.0.port=3D0x3F8 > hint.uart.1.at=3Disa > hint.uart.1.irq=3D3 > hint.uart.1.port=3D0x2F8 > interpret=3DOK > kernel=3Dkernel > kernel[0]=3Dkernel > hint.psm.0.at=3Datkbdc > hint.psm.0.irq=3D12 > hint.sc.0.at=3Disa > hint.sc.0.flags=3D0x100 > hint.uart.0.at=3Disa > hint.uart.0.flags=3D0x10 > hint.uart.0.irq=3D4 > hint.uart.0.port=3D0x3F8 > hint.uart.1.at=3Disa > hint.uart.1.irq=3D3 > hint.uart.1.port=3D0x2F8 > interpret=3DOK > kernel=3Dkernel > kernel[0]=3Dkernel > kernel[1]=3Dkernel.old =20 > kernel_options=3D > kernels_autodetect=3DNO > loaddev=3Ddisk0s2a: > loader_conf_files=3D/boot/device.hints /boot/loader.conf /boot/loader.con= f.local > mainansi_caption[1]=3D^[1mB^[moot Multi User ^[1m[Enter]^[m > mainansi_caption[2]=3DBoot ^[1mS^[mingle User > mainansi_caption[3]=3D^[1mEsc^[mape to loader prompt > mainansi_caption[6]=3DConfigure Boot ^[1mO^[mptions... > mainmenu_caption[1]=3DBoot Multi User [Enter] > mainmenu_caption[2]=3DBoot [S]ingle User > mainmenu_caption[3]=3D[Esc]ape to loader prompt > mainmenu_caption[6]=3DConfigure Boot [O]ptions... > mainmenu_command[1]=3Dboot > mainmenu_command[2]=3Daltboot > mainmenu_command[3]=3Dgoto_prompt > mainmenu_command[5]=3Dcycle_kernel > mainmenu_command[6]=3D2 goto_menu > mainmenu_init[1]=3Dinit_boot > mainmenu_init[2]=3Dinit_altboot > mainmenu_kernel=3D5 > mainmenu_keycode[3]=3D27 > mainmenu_keycode[5]=3D107 > mainmenu_caption[1]=3DBoot Multi User [Enter] > mainmenu_caption[2]=3DBoot [S]ingle User > mainmenu_caption[3]=3D[Esc]ape to loader prompt > mainmenu_caption[6]=3DConfigure Boot [O]ptions... > mainmenu_command[1]=3Dboot > mainmenu_command[2]=3Daltboot > mainmenu_command[3]=3Dgoto_prompt > mainmenu_command[5]=3Dcycle_kernel > mainmenu_command[6]=3D2 goto_menu > mainmenu_init[1]=3Dinit_boot > mainmenu_init[2]=3Dinit_altboot > mainmenu_kernel=3D5 > mainmenu_keycode[3]=3D27 > mainmenu_keycode[5]=3D107 > mainmenu_keycode[6]=3D111 =20 > mainmenu_options=3D5 > mainmenu_reboot=3D > maintoggled_ansi[1]=3DBoot ^[1mS^[mingle User ^[1m[Enter]^[m > maintoggled_ansi[2]=3DBoot ^[1mM^[multi User > maintoggled_text[1]=3DBoot [S]ingle User [Enter] > maintoggled_text[2]=3DBoot [M]ulti User > menu_caption[1]=3DBoot Multi User [Enter] > menu_caption[2]=3DBoot [S]ingle User > menu_caption[3]=3D[Esc]ape to loader prompt > menu_caption[5]=3D[K]ernel: kernel (1 of 2) > menu_caption[5][0]=3D[K]ernel: kernel (1 of 2) > menu_caption[5][1]=3D[K]ernel: kernel.old (2 of 2) > menu_caption[6]=3DConfigure Boot [O]ptions... > menu_command[1]=3Dboot > menu_command[2]=3Daltboot > menu_command[3]=3Dgoto_prompt > menu_command[5]=3Dcycle_kernel > menu_command[6]=3D2 goto_menu > menu_init[1]=3Dinit_boot > menu_init[2]=3Dinit_altboot > menu_kernel=3D5 > menu_keycode[1]=3D98 > menu_caption[3]=3D[Esc]ape to loader prompt > menu_caption[5]=3D[K]ernel: kernel (1 of 2) > menu_caption[5][0]=3D[K]ernel: kernel (1 of 2) > menu_caption[5][1]=3D[K]ernel: kernel.old (2 of 2) > menu_caption[6]=3DConfigure Boot [O]ptions... > menu_command[1]=3Dboot > menu_command[2]=3Daltboot > menu_command[3]=3Dgoto_prompt > menu_command[5]=3Dcycle_kernel > menu_command[6]=3D2 goto_menu > menu_init[1]=3Dinit_boot > menu_init[2]=3Dinit_altboot > menu_kernel=3D5 > menu_keycode[1]=3D98 > menu_keycode[2]=3D115 =20 > menu_keycode[3]=3D27 > menu_keycode[5]=3D107 > menu_keycode[6]=3D111 > menu_options=3D5 > menu_reboot=3D > menu_timeout_command=3Dboot > menuset_initial=3D1 > menuset_name1=3Dmain > menuset_name2=3Doptions > menuset_name3=3Dbootenv > module_blacklist=3Ddrm drm2 radeonkms i915kms amdgpu > module_path=3D/boot/modules;/boot/dtb;/boot/dtb/overlays > optionsansi_caption[1]=3DBack to Main Menu ^[1m[Backspace]^[m > optionsansi_caption[2]=3DLoad System ^[1mD^[mefaults > optionsansi_caption[3]=3D^[1mA^[mCPI Support ^[34;1mOff^[m > optionsansi_caption[4]=3DSafe ^[1mM^[mode... ^[34;1mOff^[m > optionsansi_caption[5]=3D^[1mS^[mingle User. ^[34;1mOff^[m > optionsansi_caption[6]=3D^[1mV^[merbose..... ^[34;1mOff^[m > optionsmenu_acpi=3D3 > optionsmenu_caption[1]=3DBack to Main Menu [Backspace] > optionsmenu_caption[2]=3DLoad System [D]efaults > optionsmenu_caption[3]=3D[A]CPI Support off > menuset_name2=3Doptions > menuset_name3=3Dbootenv > module_blacklist=3Ddrm drm2 radeonkms i915kms amdgpu > module_path=3D/boot/modules;/boot/dtb;/boot/dtb/overlays > optionsansi_caption[1]=3DBack to Main Menu ^[1m[Backspace]^[m > optionsansi_caption[2]=3DLoad System ^[1mD^[mefaults > optionsansi_caption[3]=3D^[1mA^[mCPI Support ^[34;1mOff^[m > optionsansi_caption[4]=3DSafe ^[1mM^[mode... ^[34;1mOff^[m > optionsansi_caption[5]=3D^[1mS^[mingle User. ^[34;1mOff^[m > optionsansi_caption[6]=3D^[1mV^[merbose..... ^[34;1mOff^[m > optionsmenu_acpi=3D3 > optionsmenu_caption[1]=3DBack to Main Menu [Backspace] > optionsmenu_caption[2]=3DLoad System [D]efaults > optionsmenu_caption[3]=3D[A]CPI Support off > optionsmenu_caption[4]=3DSafe [M]ode... off =20 > optionsmenu_caption[5]=3D[S]ingle User. off > optionsmenu_caption[6]=3D[V]erbose..... off > optionsmenu_command[1]=3D1 goto_menu > optionsmenu_command[2]=3Dset_default_boot_options > optionsmenu_command[3]=3Dtoggle_acpi > optionsmenu_command[4]=3Dtoggle_safemode > optionsmenu_command[5]=3Dtoggle_singleuser > optionsmenu_command[6]=3Dtoggle_verbose > optionsmenu_init[4]=3Dinit_safemode > optionsmenu_init[5]=3Dinit_singleuser > optionsmenu_init[6]=3Dinit_verbose > optionsmenu_keycode[1]=3D8 > optionsmenu_keycode[2]=3D100 > optionsmenu_keycode[3]=3D97 > optionsmenu_keycode[4]=3D109 > optionsmenu_keycode[5]=3D115 > optionsmenu_keycode[6]=3D118 > optionsmenu_options=3D3 > optionsmenu_optionstext=3DBoot Options: > optionstoggled_ansi[3]=3D^[1mA^[mCPI Support ^[32;7mOn^[m > optionstoggled_ansi[4]=3DSafe ^[1mM^[mode... ^[32;7mOn^[m > optionstoggled_ansi[5]=3D^[1mS^[mingle User. ^[32;7mOn^[m > optionsmenu_caption[5]=3D[S]ingle User. off > optionsmenu_caption[6]=3D[V]erbose..... off > optionsmenu_command[1]=3D1 goto_menu > optionsmenu_command[2]=3Dset_default_boot_options > optionsmenu_command[3]=3Dtoggle_acpi > optionsmenu_command[4]=3Dtoggle_safemode > optionsmenu_command[5]=3Dtoggle_singleuser > optionsmenu_command[6]=3Dtoggle_verbose > optionsmenu_init[4]=3Dinit_safemode > optionsmenu_init[5]=3Dinit_singleuser > optionsmenu_init[6]=3Dinit_verbose > optionsmenu_keycode[1]=3D8 > optionsmenu_keycode[2]=3D100 > optionsmenu_keycode[3]=3D97 > optionsmenu_keycode[4]=3D109 > optionsmenu_keycode[5]=3D115 > optionsmenu_keycode[6]=3D118 > optionsmenu_options=3D3 > optionsmenu_optionstext=3DBoot Options: > optionstoggled_ansi[3]=3D^[1mA^[mCPI Support ^[32;7mOn^[m > optionstoggled_ansi[4]=3DSafe ^[1mM^[mode... ^[32;7mOn^[m > optionstoggled_ansi[5]=3D^[1mS^[mingle User. ^[32;7mOn^[m > optionstoggled_ansi[6]=3D^[1mV^[merbose..... ^[32;7mOn^[m=20 > optionstoggled_text[3]=3D[A]CPI Support On > optionstoggled_text[4]=3DSafe [M]ode... On > optionstoggled_text[5]=3D[S]ingle User. On > optionstoggled_text[6]=3D[V]erbose..... On > prompt=3D${interpret} > script.lang=3Dforth > smbios.bios.vendor=3DBHYVE > toggled_ansi[1]=3DBoot ^[1mS^[mingle User ^[1m[Enter]^[m > toggled_ansi[2]=3DBoot ^[1mM^[multi User > toggled_text[1]=3DBoot [S]ingle User [Enter] > toggled_text[2]=3DBoot [M]ulti User > twiddle_divisor=3D1 > vfs.mountroot.timeout=3D10 > zfs_be_currpage=3D1 > OK=20 >=20 > Surely boot_serial changed "NO", but did not booted. >=20 > >=20 > > > Look here > > > https://lists.freebsd.org/pipermail/freebsd-virtualization/2018-Novem= ber/006944.html > > > Simon. > > > You wrote 15.10.2019, 10:51:08: > > > > Hi, all > > > > I'm managing bhyve vm by vm-bhyve-devel (1.3-devel) port > > > > which I've made by github head [1]. When create 13.0-CURRENT > > > > vm with FreeBSD-13.0-CURRENT-amd64-20191011-r353427-memstick.img > > > > as follows: > > > > vm create -s 16GB -t tmpfile.gpWbtMxa tbedfc > > > > vm install -f tbedfc > > > > FreeBSD-13.0-CURRENT-amd64-20191011-r353427-memstick.img < /dev/null > > > > where /vm/.templates/tmpfile.gpWbtMxa is > > > > loader=3D"bhyveload" > > > > cpu=3D2 > > > > memory=3D8GB > > > > network0_type=3D"virtio-net" > > > > network0_switch=3Dlocal > > > > disk0_type=3D"virtio-blk" > > > > disk0_name=3D"disk0.img" > > > > storage=3D16GB > > > > But in install to image, boot freezed at: > > > > =A0| =A0____| =A0 =A0 =A0 =A0 =A0 =A0 | =A0_ \ / ____| =A0__ \ > > > > =A0| |___ _ __ ___ =A0___ | |_) | (___ | | =A0| | > > > > =A0| =A0___| '__/ _ \/ _ \| =A0_ < \___ \| | =A0| | > > > > =A0| | =A0 | | | =A0__/ =A0__/| |_) |____) | |__| | > > > > =A0| | =A0 | | | =A0 =A0| =A0 =A0|| =A0 =A0 | =A0 =A0 =A0| =A0 =A0 = =A0| > > > > =A0|_| =A0 |_| =A0\___|\___||____/|_____/|_____/ =A0 =A0``` =A0 =A0= =A0 =A0 =A0 =A0 =A0 =A0 =A0 > > > > =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0= =A0 =A0 =A0 =A0 =A0 =A0s` `.....---.......--.``` =A0 -/ > > > > =A0+=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3DWelcome to FreeBSD=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D+ +o =A0 .--` =A0 =A0 =A0 =A0 /y:` +. > > > > =A0| =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 =A0 =A0 | =A0yo`:. =A0 =A0 =A0 =A0 =A0 =A0:o =A0 `+- > > > > =A0| =A01. Boot Multi User [Enter] =A0 =A0 =A0 =A0 =A0 =A0 | =A0 y/= =A0 =A0 =A0 =A0 =A0 =A0 =A0 -/` -o/ > > > > =A0| =A02. Boot [S]ingle*User =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0| = =A0.- =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0::/sy+:. > > > > =A0| =A03. [Esc]ape to loader prompt =A0 =A0 =A0 =A0 =A0 | =A0/ =A0= =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 `-- =A0/ > > > > =A0| =A04. Reboot =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0| `: =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 :` > > > > =A0| =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 =A0 =A0 | `: =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 :` > > > > =A0| =A0Options: =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 | =A0/ =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 > > > > =A0| =A05. [K]ernel: kernel (1 of 2) =A0 =A0 =A0 =A0 =A0 | =A0.- = =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0-. > > > > =A0| =A06. Configure Boot [O]ptions... =A0 =A0 =A0 =A0 | =A0 -- =A0= =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 -. > > > > =A0| =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 =A0 =A0 | =A0 =A0`:` =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 `:` > > > > =A0| =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 =A0 =A0 | =A0 =A0 =A0.-- =A0 =A0 =A0 =A0 =A0 =A0 `--. > > > > =A0| =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 =A0 =A0 | =A0 =A0 =A0 =A0 .---.....----. > > > > =A0+=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D+ > > > > =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0= =A0 =A0 =A0 =A0 > > > > /boot/kernel/kernel text=3D0x153f9c0 data=3D0xe0 data=3D0x8007c0 sy= ms=3D[0x8+0x1722d8+0x8+0x190cb2] > > > > Booting... This is not the case for 13.0-CURRENT but also 11.3-STABLE and 12.1-PRERELEASE: root@vm:/.dake/bds # vm create -s 16GB -t tbedf tbedfc root@vm:/.dake/bds # vm install -f tbedfc FreeBSD-11.3-STABLE-amd64-2019101= 1-r353406-memstick.img ______ ____ _____ _____ =20 | ____| | _ \ / ____| __ \=20 | |___ _ __ ___ ___ | |_) | (___ | | | | | ___| '__/ _ \/ _ \| _ < \___ \| | | | | | | | | __/ __/| |_) |____) | |__| | | | | | | | || | | | |_| |_| \___|\___||____/|_____/|_____/ ``` ` s` `.....---.......--.``` -/ +=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3DWelcome to FreeBSD=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D+ +o .--` /y:` +. | | yo`:. :o `+- | 1. Boot Multi User [Enter] | y/ -/` -o/ | 2. Boot [S]ingle User | .- ::/sy+:. | 3. [Esc]ape to loader prompt | / `-- / | 4. Reboot | `: :` | | `: :` | Options: | / / | 5. [K]ernel: kernel (1 of 2) | .- -. | 6. Configure Boot [O]ptions... | -- -. | | `:` `:` | | .-- `--. | | .---.....----.=20 +=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D+ =20 | To get back to the menu, type `menu' and press ENTER or type `boot' and press ENTER to start FreeBSD. Type '?' for a list of commands, 'help' for more detailed help. OK boot /boot/kernel/kernel text=3D0x1579008 data=3D0x145db0+0x4cdea0 syms=3D[0x8+0= x16e168+0x8+0x187010] Booting... \ root@vm:~ # cat /vm/tbedfc/vm-bhyve.log=20 Oct 16 09:34:46: initialising Oct 16 09:34:46: [loader: bhyveload] Oct 16 09:34:46: [cpu: 4] Oct 16 09:34:46: [memory: 4G] Oct 16 09:34:46: [hostbridge: standard] Oct 16 09:34:46: [com ports: com1] Oct 16 09:34:46: [uuid: b5986048-efac-11e9-847a-0cc47ab3cfd4] Oct 16 09:34:46: [utctime: yes] Oct 16 09:34:46: [debug mode: no] Oct 16 09:34:46: [primary disk: disk0.img] Oct 16 09:34:46: [primary disk dev: file] Oct 16 09:34:46: generated static mac 58:9c:fc:05:a3:5e (based on 'tbedfc:0= :1571186086:0') Oct 16 09:34:46: initialising network device tap0 Oct 16 09:34:46: adding tap0 -> vm-local (local addm) Oct 16 09:34:46: bring up tap0 -> vm-local (local addm) Oct 16 09:34:46: booting Oct 16 09:34:46: bhyveload -m 4G -e autoboot_delay=3D20 -e boot_serial=3DNO= -d /vm/.iso/FreeBSD-11.3-STABLE-amd64-20191011-r353406-memstick.img tbedfc Oct 16 09:35:21: [bhyve options: -c 4 -m 4G -AHP -U b5986048-efac-11e9-847= a-0cc47ab3cfd4 -u] Oct 16 09:35:21: [bhyve devices: -s 0,hostbridge -s 31,lpc -s 4:0,virtio-b= lk,/vm/tbedfc/disk0.img -s 5:0,virtio-net,tap0,mac=3D58:9c:fc:05:a3:5e] Oct 16 09:35:21: [bhyve console: -l com1,stdio] Oct 16 09:35:21: [bhyve iso device: -s 3:0,ahci-hd,/vm/.iso/FreeBSD-11.3-S= TABLE-amd64-20191011-r353406-memstick.img] Oct 16 09:35:21: starting bhyve (run 1) root@vm:~ # vm create -s 16GB -t tbedf tbedfc root@vm:/.dake/bds # vm install -f tbedfc FreeBSD-12.1-PRERELEASE-amd64-201= 90913-r352266-memstick.img | ______ ____ _____ _____ =20 | ____| | _ \ / ____| __ \=20 | |___ _ __ ___ ___ | |_) | (___ | | | | | ___| '__/ _ \/ _ \| _ < \___ \| | | | | | | | | __/ __/| |_) |____) | |__| | | | | | | | || | | | |_| |_| \___|\___||____/|_____/|_____/=20 ``` = ` Welcome to FreeBSD s` `.....---.......--.``` -/ +o .--` /y:` +. 1. Boot Multi user [Enter] yo`:. :o `+- 2. Boot Single user y/ -/` -o/ 3. Escape to loader prompt .- ::/sy+:. 4. Reboot / `-- / `: :` Options: `: :` 5. Kernel: default/2kernel (1 of 1) / / 6. Boot Options .- -. -- -. `:` `:` .-- `--. .---.....----. = =20 Exiting menu! Type '?' for a list of commands, 'help' for more detailed help. OK show LINES=3D24 autoboot_delay=3DNO boot_serial=3DNO bootenv_autolist=3DYES bootfile=3Dkernel console=3Duserboot currdev=3Ddisk0s2a: efi_max_resolution=3D1x1 hint.acpi_throttle.0.disabled=3D1 hint.atkbd.0.at=3Datkbdc hint.atkbd.0.irq=3D1 hint.atkbdc.0.at=3Disa hint.atkbdc.0.port=3D0x060 hint.atrtc.0.at=3Disa hint.atrtc.0.irq=3D8 hint.atrtc.0.port=3D0x70 hint.attimer.0.at=3Disa hint.attimer.0.irq=3D0 hint.attimer.0.port=3D0x40 hint.fd.0.at=3Dfdc0 hint.fd.0.drive=3D0 hint.fd.1.at=3Dfdc0 hint.fd.1.drive=3D1 hint.fdc.0.at=3Disa =20 hint.fdc.0.drq=3D2 hint.fdc.0.irq=3D6 hint.fdc.0.port=3D0x3F0 hint.p4tcc.0.disabled=3D1 hint.ppc.0.at=3Disa hint.ppc.0.irq=3D7 hint.psm.0.at=3Datkbdc hint.psm.0.irq=3D12 hint.sc.0.at=3Disa hint.sc.0.flags=3D0x100 hint.uart.0.at=3Disa hint.uart.0.flags=3D0x10 hint.uart.0.irq=3D4 hint.uart.0.port=3D0x3F8 hint.uart.1.at=3Disa hint.uart.1.irq=3D3 hint.uart.1.port=3D0x2F8 interpret=3DOK kernel=3Dkernel kernel_options=3D kernels_autodetect=3DNO loaddev=3Ddisk0s2a: loader_conf_files=3D/boot/device.hints /boot/loader.conf /boot/loader.conf.= local module_blacklist=3Ddrm drm2 radeonkms i915kms amdgpu module_path=3D/boot/modules;/boot/dtb;/boot/dtb/overlays nextboot_conf=3D/boot/nextboot.conf nextboot_enable=3DNO prompt=3D${interpret} script.lang=3Dlua smbios.bios.vendor=3DBHYVE twiddle_divisor=3D1 verbose_loading=3DNO vfs.mountroot.timeout=3D10 OK boot Loading kernel... /boot/kernel/kernel text=3D0x168eb51 data=3D0x1d0a68+0x768d80 syms=3D[0x8+0= x178b00+0x8+0x196889] Loading configured modules... can't find '/boot/entropy' - root@vm:~ # cat /vm/tbedfc/vm-bhyve.log=20 Oct 16 09:45:18: initialising Oct 16 09:45:18: [loader: bhyveload] Oct 16 09:45:18: [cpu: 4] Oct 16 09:45:18: [memory: 4G] Oct 16 09:45:18: [hostbridge: standard] Oct 16 09:45:18: [com ports: com1] Oct 16 09:45:18: [uuid: 20fbd3ef-efae-11e9-847a-0cc47ab3cfd4] Oct 16 09:45:18: [utctime: yes] Oct 16 09:45:18: [debug mode: no] Oct 16 09:45:18: [primary disk: disk0.img] Oct 16 09:45:18: [primary disk dev: file] Oct 16 09:45:18: generated static mac 58:9c:fc:01:c9:dd (based on 'tbedfc:0= :1571186718:0') Oct 16 09:45:18: initialising network device tap0 Oct 16 09:45:18: adding tap0 -> vm-local (local addm) Oct 16 09:45:18: bring up tap0 -> vm-local (local addm) Oct 16 09:45:18: booting Oct 16 09:45:18: bhyveload -m 4G -e autoboot_delay=3D20 -e boot_serial=3DNO= -d /vm/.iso/FreeBSD-12.1-PRERELEASE-amd64-20190913-r352266-memstick.img tb= edfc Oct 16 09:47:06: [bhyve options: -c 4 -m 4G -AHP -U 20fbd3ef-efae-11e9-847= a-0cc47ab3cfd4 -u] Oct 16 09:47:06: [bhyve devices: -s 0,hostbridge -s 31,lpc -s 4:0,virtio-b= lk,/vm/tbedfc/disk0.img -s 5:0,virtio-net,tap0,mac=3D58:9c:fc:01:c9:dd] Oct 16 09:47:06: [bhyve console: -l com1,stdio] Oct 16 09:47:06: [bhyve iso device: -s 3:0,ahci-hd,/vm/.iso/FreeBSD-12.1-P= RERELEASE-amd64-20190913-r352266-memstick.img] Oct 16 09:47:06: starting bhyve (run 1) Oct 16 09:47:36: bhyve exited with status 1 Oct 16 09:47:36: destroying network device tap0 Oct 16 09:47:37: stopped root@vm:~ #=20 For 11.3-STABLE, `show' in boot prompt disturb termcap and could not display loader settings. This problem cause from bhyveload options or any bugs of bhyveload ? > > > > - > > > > Using same image, I installed my note PC successfully. In > > > > above state, > > > > root@vm:~ # cat /vm/tbedfc/tbedfc.conf > > > > loader=3D"bhyveload" > > > > cpu=3D2 > > > > memory=3D8GB > > > > network0_type=3D"virtio-net" > > > > network0_switch=3Dlocal > > > > disk0_type=3D"virtio-blk" > > > > disk0_name=3D"disk0.img" > > > > storage=3D16GB > > > > uuid=3D"90a693df-ef1e-11e9-847a-0cc47ab3cfd4" > > > > network0_mac=3D"58:9c:fc:0b:65:c9" > > > > root@vm:~ # cat /vm/tbedfc/vm-bhyve.log > > > > Oct 15 16:36:56: initialising > > > > Oct 15 16:36:56: =A0[loader: bhyveload] > > > > Oct 15 16:36:56: =A0[cpu: 2] > > > > Oct 15 16:36:56: =A0[memory: 8GB] > > > > Oct 15 16:36:56: =A0[hostbridge: standard] > > > > Oct 15 16:36:56: =A0[com ports: com1] > > > > Oct 15 16:36:56: =A0[uuid: 90a693df-ef1e-11e9-847a-0cc47ab3cfd4] > > > > Oct 15 16:36:56: =A0[utctime: yes] > > > > Oct 15 16:36:56: =A0[debug mode: no] > > > > Oct 15 16:36:56: =A0[primary disk: disk0.img] > > > > Oct 15 16:36:56: =A0[primary disk dev: file] > > > > Oct 15 16:36:56: generated static mac 58:9c:fc:0b:65:c9 (based on '= tbedfc:0:1571125016:0') > > > > Oct 15 16:36:56: initialising network device tap0 > > > > Oct 15 16:36:56: adding tap0 -> vm-local (local addm) > > > > Oct 15 16:36:56: bring up tap0 -> vm-local (local addm) > > > > Oct 15 16:36:56: booting > > > > Oct 15 16:36:56: bhyveload -m 8GB -e autoboot_delay=3D3 -d > > > > /vm/.iso/FreeBSD-13.0-CURRENT-amd64-20191011-r353427-memstick.img t= bedfc > > > > Oct 15 16:37:00: =A0[bhyve options: -c 2 -m 8GB -AHP -U > > > > 90a693df-ef1e-11e9-847a-0cc47ab3cfd4 -u] > > > > Oct 15 16:37:00: =A0[bhyve devices: -s 0,hostbridge -s 31,lpc -s > > > > 4:0,virtio-blk,/vm/tbedfc/disk0.img -s > > > > 5:0,virtio-net,tap0,mac=3D58:9c:fc:0b:65:c9] > > > > Oct 15 16:37:00: =A0[bhyve console: -l com1,stdio] > > > > Oct 15 16:37:00: =A0[bhyve iso device: -s > > > > 3:0,ahci-hd,/vm/.iso/FreeBSD-13.0-CURRENT-amd64-20191011-r353427-me= mstick.img] > > > > Oct 15 16:37:00: starting bhyve (run 1) > > > > root@vm:~ # uname -a > > > > FreeBSD vm.truefc.org 13.0-CURRENT FreeBSD 13.0-CURRENT #0 r353025: > > > > Thu Oct =A03 19:38:47 JST 2019 =A0 =A0 > > > > admin@vm.truefc.org:/ds/obj/current/13.0/r353025/ds/src/current/13.= 0/r353025/amd64.amd64/sys/GENERIC > > > amd64 > > > > root@vm:~ # ifconfig > > > > igb0: flags=3D8943 = metric 0 mtu 1500 > > > > =A0 =A0 =A0 =A0 > > > > > > > options=3D4e523bb > > > > =A0 =A0 =A0 =A0 ether 0c:c4:7a:b3:cf:d4 > > > > =A0 =A0 =A0 =A0 inet xxx.xxx.xx.xx netmask 0xfffffff8 broadcast xxx= .xxx.xx.xx > > > > =A0 =A0 =A0 =A0 media: Ethernet autoselect (1000baseT ) > > > > =A0 =A0 =A0 =A0 status: active > > > > =A0 =A0 =A0 =A0 nd6 options=3D29 > > > > igb1: flags=3D8943 = metric 0 mtu 1500 > > > > =A0 =A0 =A0 =A0 > > > > > > > options=3D4a520b9 > > > > =A0 =A0 =A0 =A0 ether 0c:c4:7a:b3:cf:d5 > > > > =A0 =A0 =A0 =A0 inet 192.168.1.17 netmask 0xffffff00 broadcast 192.= 168.1.255 > > > > =A0 =A0 =A0 =A0 media: Ethernet autoselect (1000baseT ) > > > > =A0 =A0 =A0 =A0 status: active > > > > =A0 =A0 =A0 =A0 nd6 options=3D29 > > > > lo0: flags=3D8049 metric 0 mtu 16384 > > > > =A0 =A0 =A0 =A0 > > > > options=3D680003 > > > > =A0 =A0 =A0 =A0 inet6 ::1 prefixlen 128 > > > > =A0 =A0 =A0 =A0 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3 > > > > =A0 =A0 =A0 =A0 inet 127.0.0.1 netmask 0xff000000 > > > > =A0 =A0 =A0 =A0 groups: lo > > > > =A0 =A0 =A0 =A0 nd6 options=3D21 > > > > vm-public: flags=3D8843 met= ric 0 mtu 1500 > > > > =A0 =A0 =A0 =A0 ether c6:ed:62:0a:b0:4e > > > > =A0 =A0 =A0 =A0 id 00:00:00:00:00:00 priority 32768 hellotime 2 fwd= delay 15 > > > > =A0 =A0 =A0 =A0 maxage 20 holdcnt 6 proto rstp maxaddr 2000 timeout= 1200 > > > > =A0 =A0 =A0 =A0 root id 00:00:00:00:00:00 priority 32768 ifcost 0 p= ort 0 > > > > =A0 =A0 =A0 =A0 member: igb0 flags=3D143 > > > > =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 ifmaxaddr 0 port 1 priority 128 pat= h cost 20000 > > > > =A0 =A0 =A0 =A0 groups: bridge vm-switch viid-4c918@ > > > > =A0 =A0 =A0 =A0 nd6 options=3D1 > > > > vm-local: flags=3D8843 metr= ic 0 mtu 1500 > > > > =A0 =A0 =A0 =A0 ether 8a:d0:25:7d:f7:51 > > > > =A0 =A0 =A0 =A0 id 00:00:00:00:00:00 priority 32768 hellotime 2 fwd= delay 15 > > > > =A0 =A0 =A0 =A0 maxage 20 holdcnt 6 proto rstp maxaddr 2000 timeout= 1200 > > > > =A0 =A0 =A0 =A0 root id 00:00:00:00:00:00 priority 32768 ifcost 0 p= ort 0 > > > > =A0 =A0 =A0 =A0 member: tap0 flags=3D143 > > > > =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 ifmaxaddr 0 port 6 priority 128 pat= h cost 2000000 > > > > =A0 =A0 =A0 =A0 member: igb1 flags=3D143 > > > > =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 ifmaxaddr 0 port 2 priority 128 pat= h cost 20000 > > > > =A0 =A0 =A0 =A0 groups: bridge vm-switch viid-f5dda@ > > > > =A0 =A0 =A0 =A0 nd6 options=3D1 > > > > tap0: flags=3D8943 = metric 0 mtu 1500 > > > > =A0 =A0 =A0 =A0 description: vmnet-tbedfc-0-local > > > > =A0 =A0 =A0 =A0 options=3D80000 > > > > =A0 =A0 =A0 =A0 ether 58:9c:fc:10:ff:df > > > > =A0 =A0 =A0 =A0 groups: tap vm-port > > > > =A0 =A0 =A0 =A0 media: Ethernet autoselect > > > > =A0 =A0 =A0 =A0 status: active > > > > =A0 =A0 =A0 =A0 nd6 options=3D29 > > > > =A0 =A0 =A0 =A0 Opened by PID 85496 > > > > root@vm:~ # > > > > Whats' wrong ? =A0BTW 12.1-PRERELEASE(r352368) and > > > > 12.0-RELEASE-p10(r352368) are nothing happened. > > > > [1] > > > > https://github.com/TrueFC/ports/tree/master/sysutils/vm-bhyve-devel > > > > --- > > > > KIRIYAMA Kazuhiko > > > > _______________________________________________ > > > > freebsd-virtualization@freebsd.org=A0mailing list > > > > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > > > > To unsubscribe, send any mail to > > > > "freebsd-virtualization-unsubscribe@freebsd.org" > > >=20 > > >=20 > > --- > > KIRIYAMA Kazuhiko > >=20 > --- > KIRIYAMA Kazuhiko >=20