From owner-freebsd-virtualization@freebsd.org Wed Dec 23 05:48:43 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 28551A5093F for ; Wed, 23 Dec 2015 05:48:43 +0000 (UTC) (envelope-from torres.g.alex@gmail.com) Received: from mail-vk0-x229.google.com (mail-vk0-x229.google.com [IPv6:2607:f8b0:400c:c05::229]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id D754A13CF for ; Wed, 23 Dec 2015 05:48:42 +0000 (UTC) (envelope-from torres.g.alex@gmail.com) Received: by mail-vk0-x229.google.com with SMTP id j66so128647692vkg.1 for ; Tue, 22 Dec 2015 21:48:42 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=xWBCnD140bxCteVLPwRs0qXsmtDPxUbA7PLJyhyJzyU=; b=Ij4hsQDQlwLWItqHNJbBGlE3JGoYJ1NL632tD6pixKc/44BXJd/APjfOQw0BHI1ejI H1gmiZ7xsJaNd0NzQA9ifibs8P9hbjC7uxQbXCICf1Y7qzkoeJceHqlIDAkljOxjX+dj iV4EQeeo9Ei6x3dnoOgBPxMOpQeVZUCJCGE5OeIwcOIWJbVU8P4wPXEnawl4gYxeGWXg VNyCwNQ2kbAAr8RA+qSgv62knSkYQ/CiZMlFdwfZ99zhZ5V2mX0Drg5Kqdoq5IAEbXL5 aqVA4YoUzU1AghZ0VKRcduOez4WI/NMbJMc26ZKloHMBFj9ySPhKuXxWAsCIt6W8JDep k/Wg== MIME-Version: 1.0 X-Received: by 10.31.179.80 with SMTP id c77mr16313553vkf.50.1450849721798; Tue, 22 Dec 2015 21:48:41 -0800 (PST) Received: by 10.31.174.72 with HTTP; Tue, 22 Dec 2015 21:48:41 -0800 (PST) Date: Wed, 23 Dec 2015 13:48:41 +0800 Message-ID: Subject: 10.2-RELEASE-p7 - bhyve crash ... From: Alex Torres To: freebsd-virtualization@freebsd.org Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 23 Dec 2015 05:48:43 -0000 Hi all, I'm trying to install a Linux guest (debian and ubuntu) using bhyve. Upon installation on either of these guest installs bhyve crashes. OS: 10.2-RELEASE-p7 FreeBSD 10.2-RELEASE-p7 amd64 (GENERIC kernel) GUEST: ubuntu-14.10-server-amd64.iso GUEST: debian-8.2.0-amd64-CD-1.iso Hardware: IBM System x3550 M4 Server -[7914L2M] with the following VT-x extensions: VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID. Load + installation bootstrap: #grub-bhyve -r cd0 -m device.map -M 2048 ubuntu-14.10-server #bhyve -AI -H -P -s 0:0,hostbridge -s 1:0,lpc -s 2:0,virtio-net,tap0 -s 3:0,virtio-blk,./linux.img -s 4:0,ahci-cd,./ubuntu-14.10-server-amd64.iso -l com1,stdio -c 4 -m 2048M ubuntu-14.10-server The Crash Upon installation: Installing the system... =E2=94=9C=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2= =94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94= =80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80= =E2=94=80=E2=94=80=E2=94=90 =E2=94=82 =E2=94=82 =E2=94=82 50% =E2=94=82 =E2=94=82 =E2=94=82 =E2=94=82 [ 158.064496] BUG: unable to handle kernel paging request at 0000000010000000 [ 158.065128] IP: [] __blk_bios_map_sg+0x1b1/0x3c0 =E2=94=82 [ 158.065668] PGD 7065b067 PUD 79126067 PMD 0 =E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2= =94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94= =80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80= =E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=98 [ 158.066071] Oops: 0000 [#1] SMP [ 158.066375] Modules linked in: squashfs xfs libcrc32c jfs btrfs raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq raid1 raid0 multipath linear ghash_clmulni_intel aesni_intel aes_x86_64 ablk_helper cryptd lrw gf128mul glue_helper nls_utf8(E) isofs(E) usb_storage(E) ahci(E) libahci(E) [ 158.069152] CPU: 0 PID: 136 Comm: kworker/u8:5 Tainted: G E 3.16.0-23-generic #31-Ubuntu [ 158.069905] Hardware name: BHYVE, BIOS 1.00 03/14/2014 [ 158.070353] Workqueue: writeback bdi_writeback_workfn (flush-252:0) [ 158.070907] task: ffff88007ba532f0 ti: ffff88007a600000 task.ti: ffff88007a600000 [ 158.071532] RIP: 0010:[] [] __blk_bios_map_sg+0x1b1/0x3c0 [ 158.072265] RSP: 0018:ffff88007a603820 EFLAGS: 00010206 [ 158.072712] RAX: 0000000010000000 RBX: 0000000000004000 RCX: ffff88007a6038a8 [ 158.073306] RDX: 0000000010000001 RSI: 0000000073cb1000 RDI: ffff88007bb1ea20 [ 158.073902] RBP: ffff88007a603898 R08: 0000000000000000 R09: 0000160000000000 [ 158.074496] R10: 000000000000001d R11: 0000000073cb3000 R12: 0000000000000000 [ 158.075091] R13: 0000000000001000 R14: 000000000000001d R15: ffff88007a7ef420 [ 158.075688] FS: 0000000000000000(0000) GS:ffff88007fc00000(0000) knlGS:0000000000000000 [ 158.076360] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 158.076843] CR2: 0000000010000000 CR3: 000000007065a000 CR4: 00000000000406f0 [ 158.077439] Stack: [ 158.077617] ffff88007d001700 ffff88007bb1e5a0 ffff880000093e00 000000000000001d [ 158.078290] ffff88007a6038a8 0100000000000025 ffffea0001cf2c40 0000000000001000 [ 158.078962] ffffea0001cf2c80 0000000000001000 ffff88007bb1e400 ffff880000093e00 [ 158.079632] Call Trace: [ 158.079852] [] blk_rq_map_sg+0x35/0x170 [ 158.080316] [] virtio_queue_rq+0x9d/0x260 [ 158.080795] [] __blk_mq_run_hw_queue+0x1bf/0x320 [ 158.081321] [] blk_mq_run_hw_queue+0x65/0x80 [ 158.081821] [] blk_mq_insert_requests+0xcf/0x130 [ 158.082346] [] blk_mq_flush_plug_list+0x129/0x140 [ 158.082882] [] blk_flush_plug_list+0xd1/0x230 [ 158.083387] [] blk_finish_plug+0x14/0x50 [ 158.083859] [] ext4_writepages+0x3e9/0xcf0 [ 158.084343] [] ? global_dirtyable_memory+0x50/0x50 [ 158.084885] [] do_writepages+0x1e/0x30 [ 158.085341] [] __writeback_single_inode+0x40/0x210 [ 158.085883] [] ? wake_up_bit+0x25/0x30 [ 158.086338] [] writeback_sb_inodes+0x247/0x3b0 [ 158.086849] [] __writeback_inodes_wb+0x9f/0xd0 [ 158.087356] [] wb_writeback+0x223/0x2c0 [ 158.087820] [] bdi_writeback_workfn+0x1b9/0x430 [ 158.088337] [] process_one_work+0x182/0x4e0 [ 158.088829] [] worker_thread+0x6b/0x6a0 [ 158.089290] [] ? process_one_work+0x4e0/0x4e0 [ 158.089796] [] kthread+0xdb/0x100 [ 158.090215] [] ? kthread_create_on_node+0x1c0/0x1c0 [ 158.090764] [] ret_from_fork+0x7c/0xb0 [ 158.091218] [] ? kthread_create_on_node+0x1c0/0x1c0 [ 158.091765] Code: 39 f3 0f 84 4a 01 00 00 48 83 20 fd 4c 89 54 24 18 48 8b 39 48 89 4c 24 20 e8 5c a6 03 00 48 8b 4c 24 20 4c 8b 54 24 18 48 89 01 <48> 8b 30 48 8b 54 24 30 8b 7c 24 3c 83 e6 03 f6 c2 03 0f 85 07 [ 158.094199] RIP [] __blk_bios_map_sg+0x1b1/0x3c0 [ 158.094736] RSP [ 158.095035] CR2: 0000000010000000 [ 158.095320] ---[ end trace 86aa70b9ee9da8be ]--- [ 158.095900] BUG: unable to handle kernel paging request at ffffffffffffffd8 [ 158.096532] IP: [] kthread_data+0x10/0x20 [ 158.097041] PGD 1c16067 PUD 1c18067 PMD 0 [ 158.097447] Oops: 0000 [#2] SMP [ 158.097753] Modules linked in: squashfs xfs libcrc32c jfs btrfs raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq raid1 raid0 multipath linear ghash_clmulni_intel aesni_intel aes_x86_64 ablk_helper cryptd lrw gf128mul glue_helper nls_utf8(E) isofs(E) usb_storage(E) ahci(E) libahci(E) [ 158.100528] CPU: 0 PID: 136 Comm: kworker/u8:5 Tainted: G D E 3.16.0-23-generic #31-Ubuntu [ 158.101278] Hardware name: BHYVE, BIOS 1.00 03/14/2014 [ 158.101730] task: ffff88007ba532f0 ti: ffff88007a600000 task.ti: ffff88007a600000 [ 158.102350] RIP: 0010:[] [] kthread_data+0x10/0x20 [ 158.103032] RSP: 0018:ffff88007a603470 EFLAGS: 00010002 [ 158.103483] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000000001 [ 158.104076] RDX: 0000000000000009 RSI: 0000000000000000 RDI: ffff88007ba532f0 [ 158.104671] RBP: ffff88007a603470 R08: 0000000000000000 R09: 0000000000000001 [ 158.105267] R10: 00000000000055f8 R11: ffff88007a5a0548 R12: ffff88007fc14800 [ 158.105862] R13: ffff88007fc14800 R14: ffff88007ba532f0 R15: 0000000000000000 [ 158.106457] FS: 0000000000000000(0000) GS:ffff88007fc00000(0000) knlGS:0000000000000000 [ 158.107132] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 158.107616] CR2: 0000000000000028 CR3: 000000007065a000 CR4: 00000000000406f0 [ 158.108212] Stack: [ 158.108390] ffff88007a603488 ffffffff8108e761 0000000000000000 ffff88007a6034e8 [ 158.109064] ffffffff81782c9d ffff88007ba532f0 0000000000014800 ffff88007a603fd8 [ 158.109737] 0000000000014800 ffff88007ba532f0 ffff88007ba53a48 ffff88007ba532e0 [ 158.110410] Call Trace: [ 158.110624] [] wq_worker_sleeping+0x11/0x90 [ 158.111116] [] __schedule+0x6ed/0x890 [ 158.111578] [] schedule+0x29/0x70 [ 158.112001] [] do_exit+0x840/0xab0 [ 158.112430] [] oops_end+0xad/0x150 [ 158.112859] [] no_context+0x12c/0x310 [ 158.113308] [] ? __add_to_page_cache_locked+0x140/0x2b0 [ 158.113886] [] __bad_area_nosemaphore+0x7d/0x210 [ 158.114412] [] bad_area_nosemaphore+0x13/0x20 [ 158.114918] [] __do_page_fault+0xce/0x580 [ 158.115394] [] ? __find_get_block_slow+0xd0/0x170 [ 158.115930] [] ? ext4_mb_generate_buddy+0x28f/0x330 [ 158.116479] [] ? __bt_get+0x10f/0x1c0 [ 158.116926] [] do_page_fault+0x31/0x70 [ 158.117382] [] page_fault+0x28/0x30 [ 158.117816] [] ? __blk_bios_map_sg+0x1b1/0x3c0 [ 158.118329] [] blk_rq_map_sg+0x35/0x170 [ 158.118792] [] virtio_queue_rq+0x9d/0x260 [ 158.119268] [] __blk_mq_run_hw_queue+0x1bf/0x320 [ 158.119792] [] blk_mq_run_hw_queue+0x65/0x80 [ 158.120290] [] blk_mq_insert_requests+0xcf/0x130 [ 158.120818] [] blk_mq_flush_plug_list+0x129/0x140 [ 158.121351] [] blk_flush_plug_list+0xd1/0x230 [ 158.121857] [] blk_finish_plug+0x14/0x50 [ 158.122325] [] ext4_writepages+0x3e9/0xcf0 [ 158.122809] [] ? global_dirtyable_memory+0x50/0x50 [ 158.123349] [] do_writepages+0x1e/0x30 [ 158.123807] [] __writeback_single_inode+0x40/0x210 [ 158.124344] [] ? wake_up_bit+0x25/0x30 [ 158.124798] [] writeback_sb_inodes+0x247/0x3b0 [ 158.125311] [] __writeback_inodes_wb+0x9f/0xd0 [ 158.125823] [] wb_writeback+0x223/0x2c0 [ 158.126286] [] bdi_writeback_workfn+0x1b9/0x430 [ 158.126809] [] process_one_work+0x182/0x4e0 [ 158.127298] [] worker_thread+0x6b/0x6a0 [ 158.127762] [] ? process_one_work+0x4e0/0x4e0 [ 158.128266] [] kthread+0xdb/0x100 [ 158.128689] [] ? kthread_create_on_node+0x1c0/0x1c0 [ 158.129240] [] ret_from_fork+0x7c/0xb0 [ 158.129699] [] ? kthread_create_on_node+0x1c0/0x1c0 [ 158.130246] Code: 00 48 89 e5 5d 48 8b 40 c8 48 c1 e8 02 83 e0 01 c3 66 2e 0f 1f 84 00 00 00 00 00 66 66 66 66 90 48 8b 87 c8 04 00 00 55 48 89 e5 <48> 8b 40 d8 5d c3 66 2e 0f 1f 84 00 00 00 00 00 66 66 66 66 90 [ 158.132684] RIP [] kthread_data+0x10/0x20 [ 158.133174] RSP [ 158.133473] CR2: ffffffffffffffd8 [ 158.133758] ---[ end trace 86aa70b9ee9da8bf ]--- [ 158.134147] Fixing recursive fault but reboot is needed! Anyone seen this before ? Any solutions ? -Alex