From owner-freebsd-virtualization@FreeBSD.ORG Mon Oct 21 11:06:57 2013 Return-Path: Delivered-To: freebsd-virtualization@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 3A8D5A85 for ; Mon, 21 Oct 2013 11:06:57 +0000 (UTC) (envelope-from owner-bugmaster@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:1900:2254:206c::16:87]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 26DA02E33 for ; Mon, 21 Oct 2013 11:06:57 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.7/8.14.7) with ESMTP id r9LB6vGb018825 for ; Mon, 21 Oct 2013 11:06:57 GMT (envelope-from owner-bugmaster@FreeBSD.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.7/8.14.7/Submit) id r9LB6uJM018823 for freebsd-virtualization@FreeBSD.org; Mon, 21 Oct 2013 11:06:56 GMT (envelope-from owner-bugmaster@FreeBSD.org) Date: Mon, 21 Oct 2013 11:06:56 GMT Message-Id: <201310211106.r9LB6uJM018823@freefall.freebsd.org> X-Authentication-Warning: freefall.freebsd.org: gnats set sender to owner-bugmaster@FreeBSD.org using -f From: FreeBSD bugmaster To: freebsd-virtualization@FreeBSD.org Subject: Current problem reports assigned to freebsd-virtualization@FreeBSD.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 21 Oct 2013 11:06:57 -0000 Note: to view an individual PR, use: http://www.freebsd.org/cgi/query-pr.cgi?pr=(number). The following is a listing of current problems submitted by FreeBSD users. These represent problem reports covering all versions including experimental development code and obsolete releases. S Tracker Resp. Description -------------------------------------------------------------------------------- o kern/165252 virtualization[vimage] [pf] [panic] kernel panics with VIMAGE and PF o kern/161094 virtualization[vimage] [pf] [panic] kernel panic with pf + VIMAGE wh o kern/160541 virtualization[vimage][pf][patch] panic: userret: Returning on td 0x o kern/160496 virtualization[vimage] [pf] [patch] kernel panic with pf + VIMAGE o kern/148155 virtualization[vimage] [pf] Kernel panic with PF + VIMAGE kernel opt a kern/147950 virtualization[vimage] [carp] VIMAGE + CARP = kernel crash s kern/143808 virtualization[pf] pf does not work inside jail 7 problems total. From owner-freebsd-virtualization@FreeBSD.ORG Wed Oct 23 14:36:59 2013 Return-Path: Delivered-To: virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 44A724F0 for ; Wed, 23 Oct 2013 14:36:59 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from bigwig.baldwin.cx (bigwig.baldwin.cx [IPv6:2001:470:1f11:75::1]) (using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 210372454 for ; Wed, 23 Oct 2013 14:36:59 +0000 (UTC) Received: from jhbbsd.localnet (unknown [209.249.190.124]) by bigwig.baldwin.cx (Postfix) with ESMTPSA id 4C987B93B for ; Wed, 23 Oct 2013 10:36:58 -0400 (EDT) From: John Baldwin To: virtualization@freebsd.org Subject: [PATCH] Tidy usage messages for bhyve and bhyveload Date: Wed, 23 Oct 2013 10:36:55 -0400 User-Agent: KMail/1.13.5 (FreeBSD/8.4-CBSD-20130906; KDE/4.5.5; amd64; ; ) MIME-Version: 1.0 Content-Type: Text/Plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Message-Id: <201310231036.55620.jhb@freebsd.org> X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.2.7 (bigwig.baldwin.cx); Wed, 23 Oct 2013 10:36:58 -0400 (EDT) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 23 Oct 2013 14:36:59 -0000 These are just some cosmetic nits to the usage messages for bhyve and bhyveload so that they are more consistent with other tools in the base system (spaces between options, wrapping at 80 cols, etc.) Index: bhyve/bhyverun.c =================================================================== --- bhyve/bhyverun.c (revision 256946) +++ bhyve/bhyverun.c (working copy) @@ -37,6 +37,7 @@ #include #include +#include #include #include #include @@ -121,9 +122,8 @@ { fprintf(stderr, - "Usage: %s [-aehAHIPW][-g ][-s ][-S ]" - "[-c vcpus][-p pincpu][-m mem]" - " \n" + "Usage: %s [-aehAHIPW] [-g ] [-s ] [-S ]\n" + " %*s [-c vcpus] [-p pincpu] [-m mem] \n" " -a: local apic is in XAPIC mode (default is X2APIC)\n" " -A: create an ACPI table\n" " -g: gdb port\n" @@ -132,13 +132,13 @@ " -H: vmexit from the guest on hlt\n" " -I: present an ioapic to the guest\n" " -P: vmexit from the guest on pause\n" - " -W: force virtio to use single-vector MSI\n" - " -e: exit on unhandled i/o access\n" + " -W: force virtio to use single-vector MSI\n" + " -e: exit on unhandled I/O access\n" " -h: help\n" " -s: PCI slot config\n" " -S: legacy PCI slot config\n" " -m: memory size in MB\n", - progname); + progname, (int)strlen(progname), ""); exit(code); } Index: bhyveload/bhyveload.c =================================================================== --- bhyveload/bhyveload.c (revision 256946) +++ bhyveload/bhyveload.c (working copy) @@ -71,6 +71,7 @@ #include #include #include +#include #include #include #include @@ -568,8 +569,9 @@ { fprintf(stderr, - "usage: %s [-m mem-size][-d ] [-h ] " - "[-e ] \n", progname); + "usage: %s [-m mem-size] [-d ] [-h ]\n" + " %*s [-e ] \n", progname, + (int)strlen(progname), ""); exit(1); } @@ -582,7 +584,7 @@ int opt, error; char *disk_image; - progname = argv[0]; + progname = basename(argv[0]); mem_size = 256 * MB; disk_image = NULL; -- John Baldwin From owner-freebsd-virtualization@FreeBSD.ORG Wed Oct 23 21:43:45 2013 Return-Path: Delivered-To: virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 759CA7D3; Wed, 23 Oct 2013 21:43:45 +0000 (UTC) (envelope-from neelnatu@gmail.com) Received: from mail-ie0-x236.google.com (mail-ie0-x236.google.com [IPv6:2607:f8b0:4001:c03::236]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 29364236B; Wed, 23 Oct 2013 21:43:45 +0000 (UTC) Received: by mail-ie0-f182.google.com with SMTP id as1so2465371iec.13 for ; Wed, 23 Oct 2013 14:43:44 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=6rBqZqmDz25jDiD3IanzDwZaNn/+WXxM0pC0lVOwpB0=; b=y+mM2OQPbob2PtSnZ2ThLze0mL+YSkwVGMzO3eJgv6BCruKDZcJHyVsjLm6JhvRXx9 SrjuXcaDKJ6TNVSzSFiXO8nOy3YRQ+KUBOuwI4smRTfAuyD6avW/9Qehvl2JN0rHnScq kdHmhKqoFlscJl2VlZ6VfS0Uo+QAcBDBCc3dmkyBY6I1MXoe/g/KZw3ziAuagxFQbwCI Ja3pakjbtHG+pfuxVW52MWkdzbu13UCU2+mN7s6+r5eDTbH4ok/OXEPYwRUELIJT3pLJ IfSfvNLnGzgXKeYkRxTUsjMxJ7M36ZWkFMi9ffIQel7/7ooH92f7ZteqnDafCY5bIoWv oWQw== MIME-Version: 1.0 X-Received: by 10.42.63.194 with SMTP id d2mr1708717ici.10.1382564624538; Wed, 23 Oct 2013 14:43:44 -0700 (PDT) Received: by 10.42.165.5 with HTTP; Wed, 23 Oct 2013 14:43:44 -0700 (PDT) In-Reply-To: <201310231036.55620.jhb@freebsd.org> References: <201310231036.55620.jhb@freebsd.org> Date: Wed, 23 Oct 2013 14:43:44 -0700 Message-ID: Subject: Re: [PATCH] Tidy usage messages for bhyve and bhyveload From: Neel Natu To: John Baldwin Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.14 Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 23 Oct 2013 21:43:45 -0000 Hi John, Thanks for the patch - submitted as r257018. best Neel On Wed, Oct 23, 2013 at 7:36 AM, John Baldwin wrote: > These are just some cosmetic nits to the usage messages for bhyve and > bhyveload so that they are more consistent with other tools in the base > system (spaces between options, wrapping at 80 cols, etc.) > > Index: bhyve/bhyverun.c > =================================================================== > --- bhyve/bhyverun.c (revision 256946) > +++ bhyve/bhyverun.c (working copy) > @@ -37,6 +37,7 @@ > > #include > #include > +#include > #include > #include > #include > @@ -121,9 +122,8 @@ > { > > fprintf(stderr, > - "Usage: %s [-aehAHIPW][-g ][-s ][-S ]" > - "[-c vcpus][-p pincpu][-m mem]" > - " \n" > + "Usage: %s [-aehAHIPW] [-g ] [-s ] [-S > ]\n" > + " %*s [-c vcpus] [-p pincpu] [-m mem] \n" > " -a: local apic is in XAPIC mode (default is > X2APIC)\n" > " -A: create an ACPI table\n" > " -g: gdb port\n" > @@ -132,13 +132,13 @@ > " -H: vmexit from the guest on hlt\n" > " -I: present an ioapic to the guest\n" > " -P: vmexit from the guest on pause\n" > - " -W: force virtio to use single-vector MSI\n" > - " -e: exit on unhandled i/o access\n" > + " -W: force virtio to use single-vector MSI\n" > + " -e: exit on unhandled I/O access\n" > " -h: help\n" > " -s: PCI slot config\n" > " -S: legacy PCI slot > config\n" > " -m: memory size in MB\n", > - progname); > + progname, (int)strlen(progname), ""); > > exit(code); > } > Index: bhyveload/bhyveload.c > =================================================================== > --- bhyveload/bhyveload.c (revision 256946) > +++ bhyveload/bhyveload.c (working copy) > @@ -71,6 +71,7 @@ > #include > #include > #include > +#include > #include > #include > #include > @@ -568,8 +569,9 @@ > { > > fprintf(stderr, > - "usage: %s [-m mem-size][-d ] [-h ] " > - "[-e ] \n", progname); > + "usage: %s [-m mem-size] [-d ] [-h ]\n" > + " %*s [-e ] \n", progname, > + (int)strlen(progname), ""); > exit(1); > } > > @@ -582,7 +584,7 @@ > int opt, error; > char *disk_image; > > - progname = argv[0]; > + progname = basename(argv[0]); > > mem_size = 256 * MB; > disk_image = NULL; > > -- > John Baldwin > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to " > freebsd-virtualization-unsubscribe@freebsd.org" > From owner-freebsd-virtualization@FreeBSD.ORG Thu Oct 24 05:34:29 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 8DB0CB2F; Thu, 24 Oct 2013 05:34:29 +0000 (UTC) (envelope-from osidorkin@gmail.com) Received: from mail-ie0-x22b.google.com (mail-ie0-x22b.google.com [IPv6:2607:f8b0:4001:c03::22b]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 5657A2A2B; Thu, 24 Oct 2013 05:34:29 +0000 (UTC) Received: by mail-ie0-f171.google.com with SMTP id tp5so3150324ieb.30 for ; Wed, 23 Oct 2013 22:34:28 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-type; bh=wUHt5wNhBMwiWXXKFQ3cedtPKt3Fa2PVuJgwcZeQ/qk=; b=d2NaadfJRF0Ofv0B2qls6V33IK2l7JlOdEbca07XVAGdSBs0E3CMu4Zg2KraSjvdPc VgvZftE4YuR0/w+nT9xvsf82CDyGBU3KbSQowDPRU2IUD6MTn/4o2T82BgsfY2kxT7m7 kW/nrk/+3ijUAvU7Caj+n3S0d8OkviLIVgeU0npUjUuD13zf+zkGv3iOzUhkx5AXuqTs ZQXnN0FeZTKW7eRGiDD4t0bAMcFbJmP8z+BjoW6Eepq8PEWWyUmraQCRHEK4/Vc22V7n hDxIdgPlyXs+dLSe7R+c1U9mG4E84IkPXPs9z6fbrwMHtjki+YDhoR0iXSUJJfoD8Aay DnOQ== X-Received: by 10.50.107.70 with SMTP id ha6mr422746igb.60.1382592868774; Wed, 23 Oct 2013 22:34:28 -0700 (PDT) MIME-Version: 1.0 Received: by 10.64.250.9 with HTTP; Wed, 23 Oct 2013 22:34:08 -0700 (PDT) In-Reply-To: <794fb75db92a4df0991a147919727277@BL2PR03MB210.namprd03.prod.outlook.com> References: <794fb75db92a4df0991a147919727277@BL2PR03MB210.namprd03.prod.outlook.com> From: Oleg Sidorkin Date: Thu, 24 Oct 2013 09:34:08 +0400 Message-ID: Subject: Re: [Hyper-V][camlock] storvsc driver panics during boot with patches from camlock project To: "Abhishek Gupta (LIS)" Content-Type: text/plain; charset=ISO-8859-1 Cc: Alexander Motin , "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 24 Oct 2013 05:34:29 -0000 Hello again. Camlock patches are now committed and -CURRENT on Hyper-V now panics with almost the same stacktrace: FreeBSD 11.0-CURRENT #16 r257016: Wed Oct 23 21:08:44 UTC 2013 olsi@current:/usr/obj/usr/src/sys/HYPERVKERNEL amd64 FreeBSD clang version 3.3 (tags/RELEASE_33/final 183502) 20130610 CPU: Intel(R) Core(TM) i5-2540M CPU @ 2.60GHz (1309.57-MHz K8-class CPU) Origin = "GenuineIntel" Id = 0x206a7 Family = 0x6 Model = 0x2a Stepping = 7 ...... ZFS filesystem version: 5 ZFS storage pool version: features support (5000) Timecounters tick every 10.000 msec storvsc0 on vmbus0 kernel trap 12 with interrupts disabled Fatal trap 12: page fault while in kernel mode cpuid = 0; apic id = 00 fault virtual address = 0x20 fault code = supervisor read data, page not present instruction pointer = 0x20:0xffffffff804f58cc stack pointer = 0x28:0xfffffe011dd5f5d0 frame pointer = 0x28:0xfffffe011dd5f600 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags = resume, IOPL = 0 current process = 0 (hv_control_1 taskq) [ thread pid 0 tid 100047 ] Stopped at turnstile_broadcast+0x8c: movq 0x20(%rbx,%rax,1),%rdx db> bt Tracing pid 0 tid 100047 td 0xfffff8000331e000 turnstile_broadcast() at turnstile_broadcast+0x8c/frame 0xfffffe011dd5f600 __mtx_unlock_sleep() at __mtx_unlock_sleep+0x60/frame 0xfffffe011dd5f630 unlock_mtx() at unlock_mtx+0x2a/frame 0xfffffe011dd5f640 _sleep() at _sleep+0x18e/frame 0xfffffe011dd5f6c0 cam_periph_runccb() at cam_periph_runccb+0x9e/frame 0xfffffe011dd5f7f0 storvsc_attach() at storvsc_attach+0x6d4/frame 0xfffffe011dd5f890 device_attach() at device_attach+0x3a2/frame 0xfffffe011dd5f8f0 hv_vmbus_child_device_register() at hv_vmbus_child_device_register+0xdb/frame 0xfffffe011dd5f990 vmbus_channel_process_offer() at vmbus_channel_process_offer+0x133/frame 0xfffffe011dd5f9d0 work_item_callback() at work_item_callback+0x26/frame 0xfffffe011dd5f9f0 taskqueue_run_locked() at taskqueue_run_locked+0xe6/frame 0xfffffe011dd5fa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xa8/frame 0xfffffe011dd5fa70 fork_exit() at fork_exit+0x9a/frame 0xfffffe011dd5fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe011dd5fab0 --- trap 0, rip = 0, rsp = 0xfffffe011dd5fb70, rbp = 0 --- Thanks On Tue, Sep 24, 2013 at 3:04 AM, Abhishek Gupta (LIS) wrote: > Hi Oleg, > > Please give us some time. I shall look at it. Thanks for reporting. > > Regards, > Abhishek > > -----Original Message----- > From: owner-freebsd-virtualization@freebsd.org [mailto:owner-freebsd-virtualization@freebsd.org] On Behalf Of Oleg Sidorkin > Sent: Monday, September 23, 2013 7:21 AM > To: freebsd-virtualization@freebsd.org > Cc: Alexander Motin > Subject: [Hyper-V][camlock] storvsc driver panics during boot with patches from camlock project > > Hello. > > I'm running the latest current (amd64) under Hyper-V with hyper-v services enabled. > If camlock patches are applied > (http://people.freebsd.org/~mav/camlock_patches/camlock_20130906.patch), > I'm hitting the following kernel panic during boot: > > FreeBSD 10.0-ALPHA2 #5 r255762M: Sun Sep 22 16:48:21 UTC 2013 > olsi@current:/usr/obj/usr/src/sys/HYPERVKERNEL amd64 FreeBSD clang version 3.3 (tags/RELEASE_33/final 183502) 20130610 > CPU: Intel(R) Core(TM) i5-2540M CPU @ 2.60GHz (1309.17-MHz K8-class CPU) > Origin = "GenuineIntel" Id = 0x206a7 Family = 0x6 Model = 0x2a Stepping = > 7 > .... > Timecounter "Hyper-V" frequency 10000000 Hz quality 10000000 ZFS NOTICE: Prefetch is disabled by default if less than 4GB of RAM is present; > to enable, add "vfs.zfs.prefetch_disable=0" to /boot/loader.conf. > ZFS filesystem version: 5 > ZFS storage pool version: features support (5000) Timecounters tick every 10.000 msec > storvsc0 on vmbus0 > Netvsc initializing... SMP: AP CPU #3 Launched! > SMP: AP CPU #2 Launched! > SMP: AP CPU #1 Launched! > kernel trap 12 with interrupts disabled > > > Fatal trap 12: page fault while in kernel mode cpuid = 3; apic id = 03 > fault virtual address = 0x20 > fault code = supervisor read data, page not present > instruction pointer = 0x20:0xffffffff804f444c > stack pointer = 0x28:0xfffffe011df38610 > frame pointer = 0x28:0xfffffe011df38640 > code segment = base 0x0, limit 0xfffff, type 0x1b > = DPL 0, pres 1, long 1, def32 0, gran 1 > processor eflags = resume, IOPL = 0 > current process = 0 (hv_control_1 taskq) > [ thread pid 0 tid 100046 ] > Stopped at turnstile_broadcast+0x8c: movq 0x20(%rbx,%rax,1),%rdx > db> bt > Tracing pid 0 tid 100046 td 0xfffff80001f20490 > turnstile_broadcast() at turnstile_broadcast+0x8c/frame 0xfffffe011df38640 > __mtx_unlock_sleep() at __mtx_unlock_sleep+0x60/frame 0xfffffe011df38670 > unlock_mtx() at unlock_mtx+0x2a/frame 0xfffffe011df38680 > _sleep() at _sleep+0x18e/frame 0xfffffe011df38700 > cam_periph_runccb() at cam_periph_runccb+0x9e/frame 0xfffffe011df38800 > storvsc_attach() at storvsc_attach+0x6d4/frame 0xfffffe011df388a0 > device_attach() at device_attach+0x396/frame 0xfffffe011df388f0 > hv_vmbus_child_device_register() at > hv_vmbus_child_device_register+0xdb/frame 0xfffffe011df38990 > vmbus_channel_process_offer() at > vmbus_channel_process_offer+0x133/frame 0xfffffe011df389d0 > work_item_callback() at work_item_callback+0x26/frame 0xfffffe011df389f0 > taskqueue_run_locked() at taskqueue_run_locked+0xe6/frame 0xfffffe011df38a40 > taskqueue_thread_loop() at taskqueue_thread_loop+0xa8/frame 0xfffffe011df38a70 > fork_exit() at fork_exit+0x9a/frame 0xfffffe011df38ab0 > fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe011df38ab0 > --- trap 0, rip = 0, rsp = 0xfffffe011df38b70, rbp = 0 --- > db> > > > This patch is not commited yet (CFT thread with changes description is > here: http://lists.freebsd.org/pipermail/freebsd-hackers/2013-September/043333.html), > but it is going to be commited till the end of the year. > > As far as I understand, the invocation chain is storvsc_attach->scan_for_luns->cam_periph_runccb > > Thanks > -- > Oleg Sidorkin > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@freebsd.org" -- Oleg Sidorkin From owner-freebsd-virtualization@FreeBSD.ORG Thu Oct 24 05:50:49 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id DCDB8E65 for ; Thu, 24 Oct 2013 05:50:48 +0000 (UTC) (envelope-from mavbsd@gmail.com) Received: from mail-ea0-x22b.google.com (mail-ea0-x22b.google.com [IPv6:2a00:1450:4013:c01::22b]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 6906A2AEC for ; Thu, 24 Oct 2013 05:50:48 +0000 (UTC) Received: by mail-ea0-f171.google.com with SMTP id n15so908623ead.16 for ; Wed, 23 Oct 2013 22:50:46 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=sender:message-id:date:from:user-agent:mime-version:to:cc:subject :references:in-reply-to:content-type:content-transfer-encoding; bh=AX9om/emyl0R4fyASI5GH2L+2/E4j1kYwMzd2HuZhv8=; b=qpXdPGhUpUSWmnkVCDULpUEkGfXeZdpFzcMtJl41oxWsa3jVk6sXmK/mPNCZj/0byq mJ9iG28kM2Ohx+la+j+7zAyRcwZO1FcmXUsdHTZgXkqtKJS8iUYqM4voFAygvtrRvTCm nSNUzLbO1nT8xUDQ+IyHpY+nkkeY4BgIpEjXRwXFyXk8Tz33mJzpmC+56GEQsUp0HKB/ hYdxgrh6FuZ4ZtzaK3X3wxv1zRYntqnWsAk6FDNJQdklDAedR2AgIVlV/UqpqdIrgz5D bho2I5cfRH2uHT5ETqycnTlb3tlPR2+cOyxS4f6rPSCPJAtoBMkkfUCAWH2505nN5W9m Egdw== X-Received: by 10.15.10.6 with SMTP id f6mr1002929eet.57.1382593846807; Wed, 23 Oct 2013 22:50:46 -0700 (PDT) Received: from mavbook.mavhome.dp.ua ([178.137.150.35]) by mx.google.com with ESMTPSA id e13sm79111931eeu.4.2013.10.23.22.50.44 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Wed, 23 Oct 2013 22:50:45 -0700 (PDT) Sender: Alexander Motin Message-ID: <5268B533.80408@FreeBSD.org> Date: Thu, 24 Oct 2013 08:50:43 +0300 From: Alexander Motin User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:17.0) Gecko/20130616 Thunderbird/17.0.6 MIME-Version: 1.0 To: Oleg Sidorkin Subject: Re: [Hyper-V][camlock] storvsc driver panics during boot with patches from camlock project References: <794fb75db92a4df0991a147919727277@BL2PR03MB210.namprd03.prod.outlook.com> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 24 Oct 2013 05:50:49 -0000 Hi. I took some look and think problems are in scan_for_luns() routine: - After the locking changes scanning normally uses different locks, not the SIM one. That probably caused panic. - But I think that scanning is simply not needed there -- FreeBSD CAM scans every new bus automatically on registration (Even for late registered buses it is done I think at least since FreeBSD 8). I think everything should just work if you remove scan_for_luns() at all. - If you still wish to force scan (due to having information about changed list of devices, etc), then you can make CAM do all the magic for you by calling xpt_rescan(). On 24.10.2013 08:34, Oleg Sidorkin wrote: > Hello again. > > Camlock patches are now committed and -CURRENT on Hyper-V now panics > with almost the same stacktrace: > > FreeBSD 11.0-CURRENT #16 r257016: Wed Oct 23 21:08:44 UTC 2013 > olsi@current:/usr/obj/usr/src/sys/HYPERVKERNEL amd64 > FreeBSD clang version 3.3 (tags/RELEASE_33/final 183502) 20130610 > CPU: Intel(R) Core(TM) i5-2540M CPU @ 2.60GHz (1309.57-MHz K8-class CPU) > Origin = "GenuineIntel" Id = 0x206a7 Family = 0x6 Model = 0x2a > Stepping = 7 > > ...... > > ZFS filesystem version: 5 > ZFS storage pool version: features support (5000) > Timecounters tick every 10.000 msec > storvsc0 on vmbus0 > kernel trap 12 with interrupts disabled > > > Fatal trap 12: page fault while in kernel mode > cpuid = 0; apic id = 00 > fault virtual address = 0x20 > fault code = supervisor read data, page not present > instruction pointer = 0x20:0xffffffff804f58cc > stack pointer = 0x28:0xfffffe011dd5f5d0 > frame pointer = 0x28:0xfffffe011dd5f600 > code segment = base 0x0, limit 0xfffff, type 0x1b > = DPL 0, pres 1, long 1, def32 0, gran 1 > processor eflags = resume, IOPL = 0 > current process = 0 (hv_control_1 taskq) > [ thread pid 0 tid 100047 ] > Stopped at turnstile_broadcast+0x8c: movq 0x20(%rbx,%rax,1),%rdx > db> bt > Tracing pid 0 tid 100047 td 0xfffff8000331e000 > turnstile_broadcast() at turnstile_broadcast+0x8c/frame 0xfffffe011dd5f600 > __mtx_unlock_sleep() at __mtx_unlock_sleep+0x60/frame 0xfffffe011dd5f630 > unlock_mtx() at unlock_mtx+0x2a/frame 0xfffffe011dd5f640 > _sleep() at _sleep+0x18e/frame 0xfffffe011dd5f6c0 > cam_periph_runccb() at cam_periph_runccb+0x9e/frame 0xfffffe011dd5f7f0 > storvsc_attach() at storvsc_attach+0x6d4/frame 0xfffffe011dd5f890 > device_attach() at device_attach+0x3a2/frame 0xfffffe011dd5f8f0 > hv_vmbus_child_device_register() at > hv_vmbus_child_device_register+0xdb/frame 0xfffffe011dd5f990 > vmbus_channel_process_offer() at > vmbus_channel_process_offer+0x133/frame 0xfffffe011dd5f9d0 > work_item_callback() at work_item_callback+0x26/frame 0xfffffe011dd5f9f0 > taskqueue_run_locked() at taskqueue_run_locked+0xe6/frame 0xfffffe011dd5fa40 > taskqueue_thread_loop() at taskqueue_thread_loop+0xa8/frame 0xfffffe011dd5fa70 > fork_exit() at fork_exit+0x9a/frame 0xfffffe011dd5fab0 > fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe011dd5fab0 > --- trap 0, rip = 0, rsp = 0xfffffe011dd5fb70, rbp = 0 --- > > > Thanks > > On Tue, Sep 24, 2013 at 3:04 AM, Abhishek Gupta (LIS) > wrote: >> Hi Oleg, >> >> Please give us some time. I shall look at it. Thanks for reporting. >> >> Regards, >> Abhishek >> >> -----Original Message----- >> From: owner-freebsd-virtualization@freebsd.org [mailto:owner-freebsd-virtualization@freebsd.org] On Behalf Of Oleg Sidorkin >> Sent: Monday, September 23, 2013 7:21 AM >> To: freebsd-virtualization@freebsd.org >> Cc: Alexander Motin >> Subject: [Hyper-V][camlock] storvsc driver panics during boot with patches from camlock project >> >> Hello. >> >> I'm running the latest current (amd64) under Hyper-V with hyper-v services enabled. >> If camlock patches are applied >> (http://people.freebsd.org/~mav/camlock_patches/camlock_20130906.patch), >> I'm hitting the following kernel panic during boot: >> >> FreeBSD 10.0-ALPHA2 #5 r255762M: Sun Sep 22 16:48:21 UTC 2013 >> olsi@current:/usr/obj/usr/src/sys/HYPERVKERNEL amd64 FreeBSD clang version 3.3 (tags/RELEASE_33/final 183502) 20130610 >> CPU: Intel(R) Core(TM) i5-2540M CPU @ 2.60GHz (1309.17-MHz K8-class CPU) >> Origin = "GenuineIntel" Id = 0x206a7 Family = 0x6 Model = 0x2a Stepping = >> 7 >> .... >> Timecounter "Hyper-V" frequency 10000000 Hz quality 10000000 ZFS NOTICE: Prefetch is disabled by default if less than 4GB of RAM is present; >> to enable, add "vfs.zfs.prefetch_disable=0" to /boot/loader.conf. >> ZFS filesystem version: 5 >> ZFS storage pool version: features support (5000) Timecounters tick every 10.000 msec >> storvsc0 on vmbus0 >> Netvsc initializing... SMP: AP CPU #3 Launched! >> SMP: AP CPU #2 Launched! >> SMP: AP CPU #1 Launched! >> kernel trap 12 with interrupts disabled >> >> >> Fatal trap 12: page fault while in kernel mode cpuid = 3; apic id = 03 >> fault virtual address = 0x20 >> fault code = supervisor read data, page not present >> instruction pointer = 0x20:0xffffffff804f444c >> stack pointer = 0x28:0xfffffe011df38610 >> frame pointer = 0x28:0xfffffe011df38640 >> code segment = base 0x0, limit 0xfffff, type 0x1b >> = DPL 0, pres 1, long 1, def32 0, gran 1 >> processor eflags = resume, IOPL = 0 >> current process = 0 (hv_control_1 taskq) >> [ thread pid 0 tid 100046 ] >> Stopped at turnstile_broadcast+0x8c: movq 0x20(%rbx,%rax,1),%rdx >> db> bt >> Tracing pid 0 tid 100046 td 0xfffff80001f20490 >> turnstile_broadcast() at turnstile_broadcast+0x8c/frame 0xfffffe011df38640 >> __mtx_unlock_sleep() at __mtx_unlock_sleep+0x60/frame 0xfffffe011df38670 >> unlock_mtx() at unlock_mtx+0x2a/frame 0xfffffe011df38680 >> _sleep() at _sleep+0x18e/frame 0xfffffe011df38700 >> cam_periph_runccb() at cam_periph_runccb+0x9e/frame 0xfffffe011df38800 >> storvsc_attach() at storvsc_attach+0x6d4/frame 0xfffffe011df388a0 >> device_attach() at device_attach+0x396/frame 0xfffffe011df388f0 >> hv_vmbus_child_device_register() at >> hv_vmbus_child_device_register+0xdb/frame 0xfffffe011df38990 >> vmbus_channel_process_offer() at >> vmbus_channel_process_offer+0x133/frame 0xfffffe011df389d0 >> work_item_callback() at work_item_callback+0x26/frame 0xfffffe011df389f0 >> taskqueue_run_locked() at taskqueue_run_locked+0xe6/frame 0xfffffe011df38a40 >> taskqueue_thread_loop() at taskqueue_thread_loop+0xa8/frame 0xfffffe011df38a70 >> fork_exit() at fork_exit+0x9a/frame 0xfffffe011df38ab0 >> fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe011df38ab0 >> --- trap 0, rip = 0, rsp = 0xfffffe011df38b70, rbp = 0 --- >> db> >> >> >> This patch is not commited yet (CFT thread with changes description is >> here: http://lists.freebsd.org/pipermail/freebsd-hackers/2013-September/043333.html), >> but it is going to be commited till the end of the year. >> >> As far as I understand, the invocation chain is storvsc_attach->scan_for_luns->cam_periph_runccb >> >> Thanks >> -- >> Oleg Sidorkin >> _______________________________________________ >> freebsd-virtualization@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization >> To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@freebsd.org" > > > -- Alexander Motin From owner-freebsd-virtualization@FreeBSD.ORG Fri Oct 25 14:33:43 2013 Return-Path: Delivered-To: virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 7ECFD42A for ; Fri, 25 Oct 2013 14:33:43 +0000 (UTC) (envelope-from symbolics@gmx.com) Received: from mout.gmx.net (mout.gmx.net [212.227.17.21]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 1D9612AC6 for ; Fri, 25 Oct 2013 14:33:43 +0000 (UTC) Received: from lemon ([80.7.17.14]) by mail.gmx.com (mrgmx002) with ESMTPSA (Nemesis) id 0LrvWY-1VgqYV2zja-013aSG for ; Fri, 25 Oct 2013 16:33:41 +0200 Received: by lemon (Postfix, from userid 1001) id 280F6EB352; Fri, 25 Oct 2013 15:33:41 +0100 (BST) Date: Fri, 25 Oct 2013 15:33:41 +0100 From: symbolics@gmx.com To: virtualization@freebsd.org Subject: Three observations on Bhyve Message-ID: <20131025143341.GC26481@lemon> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline X-Provags-ID: V03:K0:BrNPvcAjYKre0sJpEPEglaBWaZ2c7acwK7QBKINEIGENDJ2rwAy YJam5ueeZWaxud7eVX4lPEqgCAo5SNi12xB7ioB2/zINwgJ1gvrAvbN6wUXvXqdD7AevUFI /leERXCzZgEobAPxB5JZ0+Dmo6fHAysVziuBLrq4uiflxVyPghSVosxFRUtjm8BrMyTwczn +NJOesrxtqzEdRUaxS7gA== X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 25 Oct 2013 14:33:43 -0000 Hi A few things I've noticed playing with Bhyve & vmrun.sh (1) You can't boot an i386 ISO. It can't load the kernel. I half expected this would be the case. It would be nice if this did work. (2) VirtIO on a raw disc device seems to have some problems. I tried installing using the -BETA1 amd64 ISO. The disc particulars seem to be detected fine but when I try and commit the partition layout I see: 5vtbd0: hard error cmd=write 290-305 The disc is a 640GB WD SATA disc and I used the automatic scheme, if it makes any difference. * I also had to comment the -f test in vmrun.sh (line 116) of course. (3) I tried to use the live environment in order to play around with (2) a bit more but it lacks the necessary /etc/ttys line. It would be great if this wasn't required *somehow*. Should I file PRs for these issues? Thanks! --sym From owner-freebsd-virtualization@FreeBSD.ORG Fri Oct 25 15:30:35 2013 Return-Path: Delivered-To: virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id A1D97AC2 for ; Fri, 25 Oct 2013 15:30:35 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from alto.onthenet.com.au (alto.OntheNet.com.au [203.13.68.12]) by mx1.freebsd.org (Postfix) with ESMTP id 665492DF1 for ; Fri, 25 Oct 2013 15:30:35 +0000 (UTC) Received: from dommail.onthenet.com.au (dommail.OntheNet.com.au [203.13.70.57]) by alto.onthenet.com.au (Postfix) with ESMTPS id 8B3AA123FA; Sat, 26 Oct 2013 01:30:33 +1000 (EST) Received: from Peters-MacBook-Pro.local (c-67-161-27-37.hsd1.ca.comcast.net [67.161.27.37]) by dommail.onthenet.com.au (MOS 4.2.4-GA) with ESMTP id BPK76968 (AUTH peterg@ptree32.com.au); Sat, 26 Oct 2013 01:30:32 +1000 Message-ID: <526A8E95.7090808@freebsd.org> Date: Fri, 25 Oct 2013 08:30:29 -0700 From: Peter Grehan User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.8; rv:17.0) Gecko/20130801 Thunderbird/17.0.8 MIME-Version: 1.0 To: symbolics@gmx.com Subject: Re: Three observations on Bhyve References: <20131025143341.GC26481@lemon> In-Reply-To: <20131025143341.GC26481@lemon> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 25 Oct 2013 15:30:35 -0000 > (1) You can't boot an i386 ISO. It can't load the kernel. I half > expected this would be the case. It would be nice if this did work. The loader work isn't too bad to get this going, but the bhyve work is quite a bit more effort since the i386 kernel makes a lot more assumptions about the environment, such as the ability to call back into BIOS. On the TODO list. > (2) VirtIO on a raw disc device seems to have some problems. I tried > installing using the -BETA1 amd64 ISO. The disc particulars seem to be > detected fine but when I try and commit the partition layout I see: > > 5vtbd0: hard error cmd=write 290-305 > > The disc is a 640GB WD SATA disc and I used the automatic scheme, if it > makes any difference. That's bhyve colliding with GEOM. There was a thread a while back about being able to exempt certain block devices from being tasted for iSCSI LUN usage - bhyve will probably need something similar. > (3) I tried to use the live environment in order to play around with > (2) a bit more but it lacks the necessary /etc/ttys line. It would be > great if this wasn't required *somehow*. The ttys issue does need to be addressed. This applies for serial console users as well. Hey, works for Linux :) > Should I file PRs for these issues? Yes, always file PRs please :) later, Peter. From owner-freebsd-virtualization@FreeBSD.ORG Fri Oct 25 22:14:40 2013 Return-Path: Delivered-To: virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 9E11347D for ; Fri, 25 Oct 2013 22:14:40 +0000 (UTC) (envelope-from symbolics@gmx.com) Received: from mout.gmx.net (mout.gmx.net [212.227.15.18]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 3AB36263D for ; Fri, 25 Oct 2013 22:14:40 +0000 (UTC) Received: from lemon ([80.7.17.14]) by mail.gmx.com (mrgmx103) with ESMTPSA (Nemesis) id 0MZU7V-1VHKE93d7N-00LCGj for ; Sat, 26 Oct 2013 00:14:32 +0200 Received: by lemon (Postfix, from userid 1001) id 633A4EB3A6; Fri, 25 Oct 2013 23:14:32 +0100 (BST) Date: Fri, 25 Oct 2013 23:14:32 +0100 From: symbolics@gmx.com To: virtualization@freebsd.org Subject: Re: Three observations on Bhyve Message-ID: <20131025221432.GC26814@lemon> References: <20131025143341.GC26481@lemon> <526A8E95.7090808@freebsd.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <526A8E95.7090808@freebsd.org> X-Provags-ID: V03:K0:Ck6GQXjg4I1z9lXyCkZ0P8NNc4CBbVSzeQFtt/+OW+A7TQu1WrI RKEE/4tZOuM3f+UvVvY6+/L8zx2xFJOuFgHSwd/P3TwhhN7Gz62WofBQ0+aQIYXNhW9e1E0 jyZrurFtD4FjjLfleoscyrfi9HhyQRcdhStc9vGT9GbiltsVo0gYu42W0H6rZ+07RFz/qi9 7kza7MmDManAFhMGBxwbw== X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 25 Oct 2013 22:14:40 -0000 On Fri, Oct 25, 2013 at 08:30:29AM -0700, Peter Grehan wrote: > > (1) You can't boot an i386 ISO. It can't load the kernel. I half > > expected this would be the case. It would be nice if this did work. > > The loader work isn't too bad to get this going, but the bhyve work is > quite a bit more effort since the i386 kernel makes a lot more > assumptions about the environment, such as the ability to call back into > BIOS. > > On the TODO list. Great, thank you. > > (2) VirtIO on a raw disc device seems to have some problems. I tried > > installing using the -BETA1 amd64 ISO. The disc particulars seem to be > > detected fine but when I try and commit the partition layout I see: > > > > 5vtbd0: hard error cmd=write 290-305 > > > > The disc is a 640GB WD SATA disc and I used the automatic scheme, if it > > makes any difference. > > That's bhyve colliding with GEOM. There was a thread a while back > about being able to exempt certain block devices from being tasted for > iSCSI LUN usage - bhyve will probably need something similar. Is this different from the kern.geom.notaste sysctl des@ added recently? > > (3) I tried to use the live environment in order to play around with > > (2) a bit more but it lacks the necessary /etc/ttys line. It would be > > great if this wasn't required *somehow*. > > The ttys issue does need to be addressed. This applies for serial > console users as well. Hey, works for Linux :) > > > Should I file PRs for these issues? > > Yes, always file PRs please :) Okay, will set them up tomorrow. Thanks Peter, --sym From owner-freebsd-virtualization@FreeBSD.ORG Sat Oct 26 00:05:09 2013 Return-Path: Delivered-To: virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 4488EE48 for ; Sat, 26 Oct 2013 00:05:09 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from alto.onthenet.com.au (alto.OntheNet.com.au [203.13.68.12]) by mx1.freebsd.org (Postfix) with ESMTP id 08A252B5B for ; Sat, 26 Oct 2013 00:05:08 +0000 (UTC) Received: from dommail.onthenet.com.au (dommail.OntheNet.com.au [203.13.70.57]) by alto.onthenet.com.au (Postfix) with ESMTPS id 4D94411FD3; Sat, 26 Oct 2013 10:05:01 +1000 (EST) Received: from Peter-Grehans-MacBook-Pro-2.local ([64.245.0.210]) by dommail.onthenet.com.au (MOS 4.2.4-GA) with ESMTP id BPK86871 (AUTH peterg@ptree32.com.au); Sat, 26 Oct 2013 10:05:00 +1000 Message-ID: <526B072A.2020400@freebsd.org> Date: Fri, 25 Oct 2013 17:04:58 -0700 From: Peter Grehan User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:24.0) Gecko/20100101 Thunderbird/24.0.1 MIME-Version: 1.0 To: symbolics@gmx.com, virtualization@freebsd.org Subject: Re: Three observations on Bhyve References: <20131025143341.GC26481@lemon> <526A8E95.7090808@freebsd.org> <20131025221432.GC26814@lemon> In-Reply-To: <20131025221432.GC26814@lemon> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 26 Oct 2013 00:05:09 -0000 >> That's bhyve colliding with GEOM. There was a thread a while back >> about being able to exempt certain block devices from being tasted for >> iSCSI LUN usage - bhyve will probably need something similar. > > Is this different from the kern.geom.notaste sysctl des@ added recently? Yes. I've not tried that, but guessing it could be used as a workaround for something like a zvol-backed image where the zvol is created after the sysctl is set. However, what is really needed is something like a blacklist that can prevent specified devices from being seen by GEOM at all, since the internal structure is only relevant to the guest VM. later, Peter. From owner-freebsd-virtualization@FreeBSD.ORG Sat Oct 26 13:51:31 2013 Return-Path: Delivered-To: virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 083EB2F4 for ; Sat, 26 Oct 2013 13:51:31 +0000 (UTC) (envelope-from symbolics@gmx.com) Received: from mout.gmx.net (mout.gmx.net [212.227.15.15]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 9950F2E83 for ; Sat, 26 Oct 2013 13:51:30 +0000 (UTC) Received: from lemon ([80.7.17.14]) by mail.gmx.com (mrgmx101) with ESMTPSA (Nemesis) id 0Man6U-1VFdyK2Tak-00KSa0 for ; Sat, 26 Oct 2013 15:51:22 +0200 Received: by lemon (Postfix, from userid 1001) id E11F4EB39F; Sat, 26 Oct 2013 14:51:21 +0100 (BST) Date: Sat, 26 Oct 2013 14:51:21 +0100 From: symbolics@gmx.com To: virtualization@freebsd.org Subject: Re: Three observations on Bhyve Message-ID: <20131026135121.GA2148@lemon> References: <20131025143341.GC26481@lemon> <526A8E95.7090808@freebsd.org> <20131025221432.GC26814@lemon> <526B072A.2020400@freebsd.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <526B072A.2020400@freebsd.org> X-Provags-ID: V03:K0:CI/bgrhlELt3gVU0LClEcfmZ/YdUjWiqUm9Ah0+OGgEbHI7pAxT B5ggc/2imuuTX7KUl4WT/qwAC13sJbrpal2aYJEYl7V+pgDpI8DfxIqEea0KJa8Uz+9FH1g CUKraCEG9bOKGAfNg8AOgXjNIMOatiJ8V6xBSmNqBLf5TfzXuXEJMAJntoWgLJGk3F1RpSG uTqnKQ4KRi6x2Z7S9QkyQ== Cc: geom@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 26 Oct 2013 13:51:31 -0000 Context: Bhyve guest cannot use disc devices through VirtIO due to interaction with GEOM tasting on the host. On Fri, Oct 25, 2013 at 05:04:58PM -0700, Peter Grehan wrote: > >> That's bhyve colliding with GEOM. There was a thread a while back > >> about being able to exempt certain block devices from being tasted for > >> iSCSI LUN usage - bhyve will probably need something similar. > > > > Is this different from the kern.geom.notaste sysctl des@ added recently? > > Yes. I've not tried that, but guessing it could be used as a > workaround for something like a zvol-backed image where the zvol is > created after the sysctl is set. I tried this out today. My ada1 device is connected via a eSATA port so I removed it, set the sysctl and plugged it back in. Of course it didn't help as the sysctl disables tasting globally so the /dev/ada1 node doesn't get created either. > However, what is really needed is something like a blacklist that can > prevent specified devices from being seen by GEOM at all, since the > internal structure is only relevant to the guest VM. I have been looking at the GEOM code and thinking about what sort of interface I would like. I think I want the ability to tell GEOM not to taste beyond a named provider. # geom disk ada1 Where expands to something like 'notaste'. When this command is invoked a flag is set on the provider that prevents further tasting beyond this point and any existing descendent objects are removed. I have a little code for this and I will see if I can make it work in a reasonable way. I'm CC'ing geom@ because I'd like to know if this approach looks sensible. --sym