From owner-freebsd-virtualization@freebsd.org Mon Feb 11 13:32:11 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8203614D73DE for ; Mon, 11 Feb 2019 13:32:11 +0000 (UTC) (envelope-from ck-lists@cksoft.de) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id E651B6D851 for ; Mon, 11 Feb 2019 13:32:10 +0000 (UTC) (envelope-from ck-lists@cksoft.de) Received: by mailman.ysv.freebsd.org (Postfix) id 9DEF814D73DC; Mon, 11 Feb 2019 13:32:10 +0000 (UTC) Delivered-To: virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 78E3E14D73DB for ; Mon, 11 Feb 2019 13:32:10 +0000 (UTC) (envelope-from ck-lists@cksoft.de) Received: from mx1.cksoft.de (mx1.cksoft.de [IPv6:2001:67c:24f8:1::25:1]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mx1.cksoft.de", Issuer "CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id D01536D84E for ; Mon, 11 Feb 2019 13:32:06 +0000 (UTC) (envelope-from ck-lists@cksoft.de) Received: from m.cksoft.de (m.cksoft.de [IPv6:2001:67c:24f8:2003::25:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mx1.cksoft.de (Postfix) with ESMTPSA id AED291E9EB9 for ; Mon, 11 Feb 2019 14:32:03 +0100 (CET) Received: from amavisfra1.cksoft.de (unknown [IPv6:2001:67c:24f8:2003::25:a1]) by m.cksoft.de (Postfix) with ESMTP id CBB4163017 for ; Mon, 11 Feb 2019 14:32:02 +0100 (CET) X-Virus-Scanned: amavisd-new at cksoft.de Received: from m.cksoft.de ([IPv6:2001:67c:24f8:2003::25:3]) by amavisfra1.cksoft.de (amavisfra1.cksoft.de [IPv6:2001:67c:24f8:2003::25:a1]) (amavisd-new, port 10051) with ESMTP id tuHrVz-NIubL for ; Mon, 11 Feb 2019 14:32:01 +0100 (CET) Received: from nocfra1.cksoft.de (nocfra1.cksoft.de [IPv6:2001:67c:24f8:2001::53:1]) by m.cksoft.de (Postfix) with ESMTP id 90D5863001 for ; Mon, 11 Feb 2019 14:32:01 +0100 (CET) Received: by nocfra1.cksoft.de (Postfix, from userid 1000) id 0238313D6E; Mon, 11 Feb 2019 14:32:00 +0100 (CET) Received: from localhost (localhost [127.0.0.1]) by nocfra1.cksoft.de (Postfix) with ESMTP id F282D139EB for ; Mon, 11 Feb 2019 14:32:00 +0100 (CET) Date: Mon, 11 Feb 2019 14:32:00 +0100 (CET) From: Christian Kratzer X-X-Sender: ck@nocfra1.cksoft.de Reply-To: Christian Kratzer To: virtualization@FreeBSD.org Subject: 12.0-RELEASE und kvm/qemu using on AMD EPYC Message-ID: User-Agent: Alpine 2.21.9999 (BSF 287 2018-06-16) X-NCC-RegID: de.cksoft X-Spammer-Kill-Ratio: 75% MIME-Version: 1.0 Content-Type: text/plain; format=flowed; charset=US-ASCII X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 11 Feb 2019 13:32:11 -0000 Hi, I am running freebsd vm on debian 10 buster with libvirt/kvm/qemu. I have several kvm hosts in the cluster. Some with various intel xeon and others with AMD EPYC 7301 cpu. FreeBSD vms upto 11.2-RELEASE-p9 boo fine on all systems when passing through the host cpu using following libvirt xml FreeBSD 12.0-RELEASE and later hang after boot when swithcing to usermode in start_init: trying /sbin/init Following is dmesg from a succesfull boot of 12.0-RELEASE using host-model on Intel CPU Copyright (c) 1992-2018 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 12.0-RELEASE-p3 GENERIC amd64 FreeBSD clang version 6.0.1 (tags/RELEASE_601/final 335540) (based on LLVM 6.0.1) VT(vga): text 80x25 CPU: QEMU Virtual CPU version 2.1.0 (2400.13-MHz K8-class CPU) Origin="GenuineIntel" Id=0x663 Family=0x6 Model=0x6 Stepping=3 Features=0x783fbfd Features2=0x80a02001 AMD Features=0x20100800 AMD Features2=0x1 Hypervisor: Origin = "KVMKVMKVM" real memory = 1073741824 (1024 MB) avail memory = 1000058880 (953 MB) Event timer "LAPIC" quality 100 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs FreeBSD/SMP: 4 package(s) x 1 core(s) ... Following is dmesg from a succesfull boot of 12.0-RELEASE using host-model on the qemu virtual cpu Copyright (c) 1992-2018 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 12.0-RELEASE-p3 GENERIC amd64 FreeBSD clang version 6.0.1 (tags/RELEASE_601/final 335540) (based on LLVM 6.0.1) VT(vga): text 80x25 CPU: QEMU Virtual CPU version 2.1.0 (2200.06-MHz K8-class CPU) Origin="AuthenticAMD" Id=0x663 Family=0x6 Model=0x6 Stepping=3 Features=0x783fbfd Features2=0x80a02001 AMD Features=0x20100800 AMD Features2=0x65 SVM: NAsids=16 Hypervisor: Origin = "KVMKVMKVM" real memory = 4294967296 (4096 MB) avail memory = 4099080192 (3909 MB) Event timer "LAPIC" quality 100 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs FreeBSD/SMP: 4 package(s) x 1 core(s) Following is dmesg from a succesfull boot of 11.2-RELEASE using host-model on AMD EPYC Copyright (c) 1992-2018 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 11.2-RELEASE-p9 #0: Tue Feb 5 15:30:36 UTC 2019 root@amd64-builder.daemonology.net:/usr/obj/usr/src/sys/GENERIC amd64 FreeBSD clang version 6.0.0 (tags/RELEASE_600/final 326565) (based on LLVM 6.0.0) VT(vga): text 80x25 CPU: AMD EPYC Processor (with IBPB) (2200.05-MHz K8-class CPU) Origin="AuthenticAMD" Id=0x800f12 Family=0x17 Model=0x1 Stepping=2 Features=0x783fbff Features2=0xfff83203 AMD Features=0x2e500800 AMD Features2=0x8003f7 Structured Extended Features=0x201c01ab XSAVE Features=0x7 AMD Extended Feature Extensions ID EBX=0x2001000 SVM: NAsids=16 Hypervisor: Origin = "KVMKVMKVM" real memory = 4294967296 (4096 MB) avail memory = 4088360960 (3898 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs FreeBSD/SMP: 4 package(s) ... And finally following is the failing verbose boot of 12.0-RELEASE on AMD-EPYC Table 'FACP' at 0xbffe104e Table 'APIC' at 0xbffe10c2 APIC: Found table at 0xbffe10c2 APIC: Using the MADT enumerator. Copyright (c) 1992-2018 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 12.0-RELEASE-p3 GENERIC amd64 FreeBSD clang version 6.0.1 (tags/RELEASE_601/final 335540) (based on LLVM 6.0.1) Table 'FACP' at 0xbffe104e Table 'APIC' at 0xbffe10c2 Table 'HPET' at 0xbffe1152 ACPI: No SRAT table found PPIM 0: PA=0xb8000, VA=0xffffffff82810000, size=0x8000, mode=0 pmap: large map 8 PML4 slots (4096 Gb) VT(vga): text 80x25 Preloaded elf kernel "/boot/kernel/kernel" at 0xffffffff8263e000. Preloaded boot_entropy_cache "/boot/entropy" at 0xffffffff826471d0. Table 'FACP' at 0xbffe104e FACP: Found table at 0xbffe104e Calibrating TSC clock ... TSC clock: 2200048246 Hz CPU: AMD EPYC Processor (with IBPB) (2200.05-MHz K8-class CPU) Origin="AuthenticAMD" Id=0x800f12 Family=0x17 Model=0x1 Stepping=2 Features=0x783fbff Features2=0xfff83203 AMD Features=0x2e500800 AMD Features2=0x8003f7 Structured Extended Features=0x209c01ab XSAVE Features=0x7 AMD Extended Feature Extensions ID EBX=0x2001000 SVM: Features=0x0 Revision=1, ASIDs=16 L1 2MB data TLB: 255 entries, 1-way associative L1 2MB instruction TLB: 255 entries, 1-way associative L1 4KB data TLB: 255 entries, 1-way associative L1 4KB instruction TLB: 255 entries, 1-way associative L1 data cache: 64 kbytes, 64 bytes/line, 1 lines/tag, 2-way associative L1 instruction cache: 64 kbytes, 64 bytes/line, 1 lines/tag, 2-way associative L2 2MB unified TLB: 0 entries, disabled/not present L2 4KB data TLB: 512 entries, 4-way associative L2 4KB instruction TLB: 512 entries, 4-way associative L2 unified cache: 512 kbytes, 64 bytes/line, 1 lines/tag, 16-way associative Hypervisor: Origin = "KVMKVMKVM" real memory = 4294967296 (4096 MB) Physical memory chunk(s): 0x0000000000001000 - 0x000000000009efff, 647168 bytes (158 pages) 0x0000000000103000 - 0x00000000001fffff, 1036288 bytes (253 pages) 0x0000000002800000 - 0x00000000b7d44fff, 3042201600 bytes (742725 pages) 0x0000000100000000 - 0x000000013ffe7fff, 1073643520 bytes (262120 pages) avail memory = 4099080192 (3909 MB) Table 'FACP' at 0xbffe104e Table 'APIC' at 0xbffe10c2 Table 'HPET' at 0xbffe1152 ACPI: No DMAR table found ... ... ... ata0: stat0=0x00 err=0x00 lsb=0x00 msb=0x00 ata0: stat1=0x00 err=0x00 lsb=0x00 msb=0x00 ata0: reset tp2 stat0=00 stat1=00 devices=0x0 ata1: reset tp1 mask=03 ostat0=00 ostat1=00 ata1: stat0=0x00 err=0x00 lsb=0x00 msb=0x00 ata1: stat1=0x00 err=0x00 lsb=0x00 msb=0x00 ata1: reset tp2 stat0=00 stat1=00 devices=0x0 Trying to mount root from ufs:/dev/vtbd0p2 [rw]... atrtc0: providing initial system time start_init: trying /sbin/init uhub0: 2 ports with 2 removable, self powered After that the system freezes. I can provide more complete information if somebody tells me what would be helpfull. How should I go about debugging this ??? Greetings Christian -- Christian Kratzer CK Software GmbH Email: ck@cksoft.de Wildberger Weg 24/2 Phone: +49 7032 893 997 - 0 D-71126 Gaeufelden Fax: +49 7032 893 997 - 9 HRB 245288, Amtsgericht Stuttgart Mobile: +49 171 1947 843 Geschaeftsfuehrer: Christian Kratzer Web: http://www.cksoft.de/ From owner-freebsd-virtualization@freebsd.org Mon Feb 11 17:03:15 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B262114DD76D for ; Mon, 11 Feb 2019 17:03:15 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) Received: from admin.sibptus.ru (admin.sibptus.ru [IPv6:2001:19f0:5001:21dc::10]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id B7ABD77BE2 for ; Mon, 11 Feb 2019 17:03:14 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=sibptus.ru; s=20181118; h=Message-ID:Subject:To:From:Date:In-Reply-To; bh=7FsXcogNNQpOvNezNz7jXwCFxoz8f7dqHFpssT+/Zrg=; b=PNgZNVaGmvMtOMkPXfTsYxI2TF n1K5Zjq3Wmem0mVJrLGcj1SWZQE4Zl78168CubJ/29p04w59PtWBjynRN8pX3FpyTYzxMWbRTcnW4 Ni8hR6al3FA/5NFtfq6ZM1Omdk/tlsw8Co65edtQL2p2hh0miuAM6Ln427kvOm+XCKgw=; Received: from vas by admin.sibptus.ru with local (Exim 4.91 (FreeBSD)) (envelope-from ) id 1gtEzA-000KFs-Tk for freebsd-virtualization@freebsd.org; Tue, 12 Feb 2019 00:03:12 +0700 Date: Tue, 12 Feb 2019 00:03:12 +0700 From: Victor Sudakov To: freebsd-virtualization@freebsd.org Subject: mounting/exporting/importing a zfs volume Message-ID: <20190211170312.GA76683@admin.sibptus.ru> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="wac7ysb48OaltWcw" Content-Disposition: inline X-PGP-Key: http://www.dreamwidth.org/pubkey?user=victor_sudakov X-PGP-Fingerprint: 10E3 1171 1273 E007 C2E9 3532 0DA4 F259 9B5E C634 User-Agent: Mutt/1.10.1 (2018-07-13) Sender: Victor Sudakov X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 11 Feb 2019 17:03:15 -0000 --wac7ysb48OaltWcw Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Dear Colleagues, vm-bhyve keeps virtual machines on zfs volumes with volmode=3Ddev. How can I access/mount the filesystems within the volume when the virtual host is offline?=20 If I kept virtual disks in raw files, I could access them as devices with mdconfig. But: root@newserv:~ # mdconfig -a -f /dev/zvol/zroot/vm/mail/disk0=20 mdconfig: /dev/zvol/zroot/vm/mail/disk0 is not a regular file root@newserv:~ #=20 Also, how can I exchange those zfs volumes for use with other hypervisors? They are not real raw disk files so I cannot use sysutils/vmdktool etc. --=20 Victor Sudakov, VAS4-RIPE, VAS47-RIPN 2:5005/49@fidonet http://vas.tomsk.ru/ --wac7ysb48OaltWcw Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQEcBAEBAgAGBQJcYarQAAoJEA2k8lmbXsY0fUAH/2lHOGF0pV7A0Cbnm5HLq0vG VUMpYFqL0ZE46UrmtA68DOBpe7xDRkoakpZBTWrXEgq0LlKArxEoSuLy/anFoa2q ateDZz/prIX3zDXgDBZW8G1PkV+P3Olrl6zHTrCoR1W/85xYWO8ZZI4wFc16/TQm IFKlmoovON6nNWf7L2RlqMPFPcEkkjZCHd9XVrgfDJWpfTpLe7Zj5H2XGwK2/XQL aScDBI212saexdaHloj8kJ6VJfTjA1i8HOTa9h56z7uJLJiPN1lljj1SbFX4L/xE iYyj6YlmdAEWPgvQZng2YQnIs3RKVrs68JBVkp+kmW5k5+MkAyfnI927JaNy5gc= =B44S -----END PGP SIGNATURE----- --wac7ysb48OaltWcw-- From owner-freebsd-virtualization@freebsd.org Mon Feb 11 17:36:49 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id EDF4914DE51F for ; Mon, 11 Feb 2019 17:36:48 +0000 (UTC) (envelope-from paul.g.webster@googlemail.com) Received: from mail-qt1-x835.google.com (mail-qt1-x835.google.com [IPv6:2607:f8b0:4864:20::835]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 790C38102F for ; Mon, 11 Feb 2019 17:36:48 +0000 (UTC) (envelope-from paul.g.webster@googlemail.com) Received: by mail-qt1-x835.google.com with SMTP id z39so3287925qtz.0 for ; Mon, 11 Feb 2019 09:36:48 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=x3y4juz/kNjuPnVWH+ueyRCp3QyyAVETWpHDfl+GAgY=; b=qDLtAsnZkVWKI9TQNUS+EEog9B8fSC/LBAYrAQdeHkfbasvpMT3mmkcQHWh81tl2HD o2Vzi8iUJEi33ramHkos9WtkR1EuuirYxPcLdy9etK6Ig4pSBslEUMept+feL881Nt0q nhRRwyyTzvEG7fkTLHKoLoshZpsZfzxlMQwC0w66S3WmOhAaKGHBdQ4m9bapGk4EA/NE EWYRCWT/TuBYU+BG7AMlAvg+/nKnvcxr26r2jfmbjRBQ9Rec4zzdaW11JhQOHoyx10o6 92ADHNR2tpXvBUOV70XhHAKaJFgJVKJMm5pqP+Dt5oc/mxur8oyAW0XXUzk3D3g/Rb8W UDMA== X-Gm-Message-State: AHQUAubaa9W0EtMMv/uZ5vn4oOdP+dTRuaBGGLnGCi9AoCD65YsZCQRe TVHY3C67LYuP4XtlZQhIwp2eHkNh5aGj6pBJfmJJsg== X-Google-Smtp-Source: AHgI3IZNLfuYeYONnL5Vqj4zg+jsPYxlZTgjJRzmwu9fbo1o+3iotLZwwwxFjTjTRTq7iPr8oE0vGn3Qtgw5MtNkkOQ= X-Received: by 2002:a0c:8a29:: with SMTP id 38mr27027369qvt.222.1549906608022; Mon, 11 Feb 2019 09:36:48 -0800 (PST) MIME-Version: 1.0 References: <20190211170312.GA76683@admin.sibptus.ru> In-Reply-To: <20190211170312.GA76683@admin.sibptus.ru> From: Paul Webster Date: Mon, 11 Feb 2019 17:36:38 +0000 Message-ID: Subject: Re: mounting/exporting/importing a zfs volume To: Victor Sudakov Cc: "freebsd-virtua." X-Rspamd-Queue-Id: 790C38102F X-Spamd-Bar: ------ X-Spamd-Result: default: False [-6.98 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-0.999,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; REPLY(-4.00)[]; NEURAL_HAM_SHORT(-0.98)[-0.980,0]; TAGGED_FROM(0.00)[] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 11 Feb 2019 17:36:49 -0000 mdconfig -a -t vnode -f afaik once they are mounted you could dd them over to the zvols and then resize them from within the vm On Mon, 11 Feb 2019 at 17:04, Victor Sudakov wrote: > Dear Colleagues, > > vm-bhyve keeps virtual machines on zfs volumes with volmode=dev. How can > I access/mount the filesystems within the volume when the virtual host > is offline? > > If I kept virtual disks in raw files, I could access them as devices > with mdconfig. But: > > root@newserv:~ # mdconfig -a -f /dev/zvol/zroot/vm/mail/disk0 > mdconfig: /dev/zvol/zroot/vm/mail/disk0 is not a regular file > root@newserv:~ # > > Also, how can I exchange those zfs volumes for use with other > hypervisors? They are not real raw disk files so I cannot use > sysutils/vmdktool etc. > > -- > Victor Sudakov, VAS4-RIPE, VAS47-RIPN > 2:5005/49@fidonet http://vas.tomsk.ru/ > From owner-freebsd-virtualization@freebsd.org Mon Feb 11 21:36:04 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 22B5A14E49E7 for ; Mon, 11 Feb 2019 21:36:04 +0000 (UTC) (envelope-from darrendavid@gmail.com) Received: from mail-it1-x12d.google.com (mail-it1-x12d.google.com [IPv6:2607:f8b0:4864:20::12d]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 2AC238B3CD for ; Mon, 11 Feb 2019 21:36:03 +0000 (UTC) (envelope-from darrendavid@gmail.com) Received: by mail-it1-x12d.google.com with SMTP id i145so2017249ita.4 for ; Mon, 11 Feb 2019 13:36:03 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=i0dpM8csMImc/VEKNyqjblzAUmyLYqPa0VM1hpL+sfA=; b=R4TCM8a3LyItiDBlVgPcWBOEPSkao2oQnnwm8Es/cdUqE+3QvGMpkNwqlmMubXbJZi WDONMgahl4X22LVys+NvXvAVig+58Fb428SQtWZuUhz4oL+5gFC/YvH4tdclOWvNloZ5 d++l7hKFWyQkrYJEPesuyE0PvVNNb6AaabcF6M2i2g8iVkg9mr+IBzGTIDlwvFFE/aOu OEtASP547jhkY4kGr08xy+QkVEjane0brfIcFBpq/Xn33HDnAK5dB3+JI6OTVwZVOD7G 6iS4l2Wvk5rQQltem4Z5/gMj51XaNFqMFyhU6/UTdPSq0FbNZ7XcTVA5s8HTD/vQzuIp EZaA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=i0dpM8csMImc/VEKNyqjblzAUmyLYqPa0VM1hpL+sfA=; b=KBobmfmXJZKsiljHt7VD3jdYPNdYqCpL3iFIwNcs/B+IrtZ7FgW/B6npcqEn5rOtx4 9qBqwmFIhkGhSADPrItS/uVJMMf6oEw5nc6TWc03yPaXKPUCtA7dz+u5A0YjPrFyZYxH WwuHJtXSiBkbDyan+EynyuWw6YBzBOISPTudyjKRB9IpT4mH8k33ofvJMVsIHodagPWr ahIXAQDQgyuse2mZvuW1/vgUFBueBZsienSiIcmMMt7dpy5+sJovg/N+4A+mgaIrhSXI tgo2QFaGzli4pBDOlfdeDiToPwdlGf8MliP9F8ISiXlukQgUlwNocv6mqnOgsIfVWQgQ hPpA== X-Gm-Message-State: AHQUAuZs6HIbnPU71LiEqZvStyXJ/rNU9WJn7oQwN7ddPJWLyLzvlF2U Tdg+TZzQbxHtjbAGpFtibHt2xxPWYSvUmL56z+oTVA== X-Google-Smtp-Source: AHgI3IbPjQmzIbOQvSwWke7MpzD0ymXAyw04+1+UYLs1fvmifIcUL+wTCEMaX8BjdlktFfDcNr+aO/n3HCBkCJSwr7k= X-Received: by 2002:a5d:88d3:: with SMTP id i19mr180455iol.187.1549920962020; Mon, 11 Feb 2019 13:36:02 -0800 (PST) MIME-Version: 1.0 From: Darren David Date: Mon, 11 Feb 2019 13:35:34 -0800 Message-ID: Subject: Win7 VM zvol usage ballooned to 539G after installing updates To: freebsd-virtualization@freebsd.org X-Rspamd-Queue-Id: 2AC238B3CD X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=R4TCM8a3; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of darrendavid@gmail.com designates 2607:f8b0:4864:20::12d as permitted sender) smtp.mailfrom=darrendavid@gmail.com X-Spamd-Result: default: False [-6.57 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; RCVD_TLS_LAST(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[d.2.1.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; IP_SCORE(-2.62)[ip: (-8.56), ipnet: 2607:f8b0::/32(-2.49), asn: 15169(-1.96), country: US(-0.07)]; NEURAL_HAM_SHORT(-0.95)[-0.948,0]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 11 Feb 2019 21:36:04 -0000 Hi all- Fairly new to bhyve virtualization, and I have a question about disk usage. I set up a sparse zvol on FreeNAS 11.2-RELEASE to house the data for a Windows 7 VM. I install Win 7 Enterprise SP1 and just finished patching/updating to current, and my zvol is reporting 539GB of usage! I have a Win10 VM that's at a reasonable 43GB after all the updates, so I'm wondering what might be causing this rampant ballooning in Win7 specifically. Details: I have my sector size set to 512 (gleaned from reading the adventures of others doing the same install) and I'm using the AHCI driver, as VirtIO didn't seem to boot. Is this normal behavior for Win7 on bhyve or is there something terribly out of whack? Related question - is there a way to compress this back down to a reasonable size or am I stuck with a bloated VM? Thanks in advance, Darren From owner-freebsd-virtualization@freebsd.org Mon Feb 11 22:08:02 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2B70C14E53E4 for ; Mon, 11 Feb 2019 22:08:02 +0000 (UTC) (envelope-from lists@jnielsen.net) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 716F58C100 for ; Mon, 11 Feb 2019 22:08:01 +0000 (UTC) (envelope-from lists@jnielsen.net) Received: by mailman.ysv.freebsd.org (Postfix) id 2A84414E53D0; Mon, 11 Feb 2019 22:08:01 +0000 (UTC) Delivered-To: virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E278114E53C9 for ; Mon, 11 Feb 2019 22:08:00 +0000 (UTC) (envelope-from lists@jnielsen.net) Received: from webmail5.jnielsen.net (webmail5.jnielsen.net [69.87.218.172]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "webmail2.jnielsen.net", Issuer "freebsdsolutions.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 7585A8C0FD for ; Mon, 11 Feb 2019 22:08:00 +0000 (UTC) (envelope-from lists@jnielsen.net) Received: from [10.3.135.13] (50-207-240-162-static.hfc.comcastbusiness.net [50.207.240.162]) (authenticated bits=0) by webmail5.jnielsen.net (8.15.2/8.15.2) with ESMTPSA id x1BM0N6V003891 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Mon, 11 Feb 2019 15:00:27 -0700 (MST) (envelope-from lists@jnielsen.net) X-Authentication-Warning: webmail5.jnielsen.net: Host 50-207-240-162-static.hfc.comcastbusiness.net [50.207.240.162] claimed to be [10.3.135.13] Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 12.2 \(3445.102.3\)) Subject: Re: 12.0-RELEASE und kvm/qemu using on AMD EPYC From: John Nielsen In-Reply-To: Date: Mon, 11 Feb 2019 15:00:22 -0700 Cc: "virtualization@freebsd.org" Content-Transfer-Encoding: quoted-printable Message-Id: References: To: Christian Kratzer X-Mailer: Apple Mail (2.3445.102.3) X-Rspamd-Queue-Id: 7585A8C0FD X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-6.99 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_SHORT(-0.99)[-0.994,0]; REPLY(-4.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 11 Feb 2019 22:08:02 -0000 > On Feb 11, 2019, at 6:32 AM, Christian Kratzer = wrote: >=20 > I am running freebsd vm on debian 10 buster with libvirt/kvm/qemu. >=20 > I have several kvm hosts in the cluster. Some with various intel xeon = and others with AMD EPYC 7301 cpu. >=20 > FreeBSD vms upto 11.2-RELEASE-p9 boo fine on all systems when passing = through the host cpu using following libvirt xml >=20 > > > Probably not the same issue, but this sounds similar to this bug I = reported a few years ago: https://bugs.launchpad.net/qemu/+bug/1329956 It's just as likely to be a bug in Qemu or KVM as it is in FreeBSD IMO. = Maybe you can start by determining which CPU feature or features = trigger(s) the issue. You'll have to hand-roll either some libvirt XML = or qemu command lines to do it. Assuming you want to stick with XML, = first grab the CPU model and features list from `virsh capabilities`. = Then start with just the model without any extra features (using AMD = hardware I have access to as an example, replace "Opteron_G3" as = appropriate): Opteron_G3 If that works, then add the other features a few at a time until you = break it. Here's an example feature list from my same hardware. Opteron_G3 Once you identify the feature or features that cause things to break, = you can report back here, look for open bugs in Qemu or KVM regarding = those features, and/or open new bugs. > FreeBSD 12.0-RELEASE and later hang after boot when swithcing to = usermode in start_init: trying /sbin/init >=20 > Following is dmesg from a succesfull boot of 12.0-RELEASE using = host-model on Intel CPU >=20 > Copyright (c) 1992-2018 The FreeBSD Project. > Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, = 1993, 1994 > The Regents of the University of California. All rights = reserved. > FreeBSD is a registered trademark of The FreeBSD Foundation. > FreeBSD 12.0-RELEASE-p3 GENERIC amd64 > FreeBSD clang version 6.0.1 (tags/RELEASE_601/final 335540) = (based on LLVM 6.0.1) > VT(vga): text 80x25 > CPU: QEMU Virtual CPU version 2.1.0 (2400.13-MHz K8-class CPU) > Origin=3D"GenuineIntel" Id=3D0x663 Family=3D0x6 Model=3D0x6 = Stepping=3D3 > = Features=3D0x783fbfd > Features2=3D0x80a02001 > AMD Features=3D0x20100800 > AMD Features2=3D0x1 > Hypervisor: Origin =3D "KVMKVMKVM" > real memory =3D 1073741824 (1024 MB) > avail memory =3D 1000058880 (953 MB) > Event timer "LAPIC" quality 100 > ACPI APIC Table: > FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs > FreeBSD/SMP: 4 package(s) x 1 core(s) > ... >=20 > Following is dmesg from a succesfull boot of 12.0-RELEASE using = host-model on the qemu virtual cpu >=20 >=20 > Copyright (c) 1992-2018 The FreeBSD Project. > Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, = 1993, 1994 > The Regents of the University of California. All rights = reserved. > FreeBSD is a registered trademark of The FreeBSD Foundation. > FreeBSD 12.0-RELEASE-p3 GENERIC amd64 > FreeBSD clang version 6.0.1 (tags/RELEASE_601/final 335540) = (based on LLVM 6.0.1) > VT(vga): text 80x25 > CPU: QEMU Virtual CPU version 2.1.0 (2200.06-MHz K8-class CPU) > Origin=3D"AuthenticAMD" Id=3D0x663 Family=3D0x6 Model=3D0x6 = Stepping=3D3 > = Features=3D0x783fbfd > Features2=3D0x80a02001 > AMD Features=3D0x20100800 > AMD Features2=3D0x65 > SVM: NAsids=3D16 > Hypervisor: Origin =3D "KVMKVMKVM" > real memory =3D 4294967296 (4096 MB) > avail memory =3D 4099080192 (3909 MB) > Event timer "LAPIC" quality 100 > ACPI APIC Table: > FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs > FreeBSD/SMP: 4 package(s) x 1 core(s) >=20 > Following is dmesg from a succesfull boot of 11.2-RELEASE using = host-model on AMD EPYC >=20 > Copyright (c) 1992-2018 The FreeBSD Project. > Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, = 1993, 1994 > The Regents of the University of California. All rights = reserved. > FreeBSD is a registered trademark of The FreeBSD Foundation. > FreeBSD 11.2-RELEASE-p9 #0: Tue Feb 5 15:30:36 UTC 2019 > = root@amd64-builder.daemonology.net:/usr/obj/usr/src/sys/GENERIC amd64 > FreeBSD clang version 6.0.0 (tags/RELEASE_600/final 326565) = (based on LLVM 6.0.0) > VT(vga): text 80x25 > CPU: AMD EPYC Processor (with IBPB) (2200.05-MHz K8-class CPU) > Origin=3D"AuthenticAMD" Id=3D0x800f12 Family=3D0x17 = Model=3D0x1 Stepping=3D2 > = Features=3D0x783fbff > = Features2=3D0xfff83203 > AMD = Features=3D0x2e500800 > AMD = Features2=3D0x8003f7 > Structured Extended = Features=3D0x201c01ab > XSAVE Features=3D0x7 > AMD Extended Feature Extensions ID EBX=3D0x2001000 > SVM: NAsids=3D16 > Hypervisor: Origin =3D "KVMKVMKVM" > real memory =3D 4294967296 (4096 MB) > avail memory =3D 4088360960 (3898 MB) > Event timer "LAPIC" quality 600 > ACPI APIC Table: > FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs > FreeBSD/SMP: 4 package(s) > ... >=20 >=20 > And finally following is the failing verbose boot of 12.0-RELEASE on = AMD-EPYC >=20 > Table 'FACP' at 0xbffe104e > Table 'APIC' at 0xbffe10c2 > APIC: Found table at 0xbffe10c2 > APIC: Using the MADT enumerator. > Copyright (c) 1992-2018 The FreeBSD Project. > Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, = 1993, 1994 > The Regents of the University of California. All rights = reserved. > FreeBSD is a registered trademark of The FreeBSD Foundation. > FreeBSD 12.0-RELEASE-p3 GENERIC amd64 > FreeBSD clang version 6.0.1 (tags/RELEASE_601/final 335540) = (based on LLVM 6.0.1) > Table 'FACP' at 0xbffe104e > Table 'APIC' at 0xbffe10c2 > Table 'HPET' at 0xbffe1152 > ACPI: No SRAT table found > PPIM 0: PA=3D0xb8000, VA=3D0xffffffff82810000, size=3D0x8000, = mode=3D0 > pmap: large map 8 PML4 slots (4096 Gb) > VT(vga): text 80x25 > Preloaded elf kernel "/boot/kernel/kernel" at = 0xffffffff8263e000. > Preloaded boot_entropy_cache "/boot/entropy" at = 0xffffffff826471d0. > Table 'FACP' at 0xbffe104e > FACP: Found table at 0xbffe104e > Calibrating TSC clock ... TSC clock: 2200048246 Hz > CPU: AMD EPYC Processor (with IBPB) (2200.05-MHz K8-class CPU) > Origin=3D"AuthenticAMD" Id=3D0x800f12 Family=3D0x17 = Model=3D0x1 Stepping=3D2 > = Features=3D0x783fbff > = Features2=3D0xfff83203 > AMD = Features=3D0x2e500800 > AMD = Features2=3D0x8003f7 > Structured Extended = Features=3D0x209c01ab > XSAVE Features=3D0x7 > AMD Extended Feature Extensions ID EBX=3D0x2001000 > SVM: Features=3D0x0 > Revision=3D1, ASIDs=3D16 > L1 2MB data TLB: 255 entries, 1-way associative > L1 2MB instruction TLB: 255 entries, 1-way associative > L1 4KB data TLB: 255 entries, 1-way associative > L1 4KB instruction TLB: 255 entries, 1-way associative > L1 data cache: 64 kbytes, 64 bytes/line, 1 lines/tag, 2-way = associative > L1 instruction cache: 64 kbytes, 64 bytes/line, 1 lines/tag, = 2-way associative > L2 2MB unified TLB: 0 entries, disabled/not present > L2 4KB data TLB: 512 entries, 4-way associative > L2 4KB instruction TLB: 512 entries, 4-way associative > L2 unified cache: 512 kbytes, 64 bytes/line, 1 lines/tag, 16-way = associative > Hypervisor: Origin =3D "KVMKVMKVM" > real memory =3D 4294967296 (4096 MB) > Physical memory chunk(s): > 0x0000000000001000 - 0x000000000009efff, 647168 bytes (158 = pages) > 0x0000000000103000 - 0x00000000001fffff, 1036288 bytes (253 = pages) > 0x0000000002800000 - 0x00000000b7d44fff, 3042201600 bytes = (742725 pages) > 0x0000000100000000 - 0x000000013ffe7fff, 1073643520 bytes = (262120 pages) > avail memory =3D 4099080192 (3909 MB) > Table 'FACP' at 0xbffe104e > Table 'APIC' at 0xbffe10c2 > Table 'HPET' at 0xbffe1152 > ACPI: No DMAR table found > ... > ... > ... > ata0: stat0=3D0x00 err=3D0x00 lsb=3D0x00 msb=3D0x00 > ata0: stat1=3D0x00 err=3D0x00 lsb=3D0x00 msb=3D0x00 > ata0: reset tp2 stat0=3D00 stat1=3D00 devices=3D0x0 > ata1: reset tp1 mask=3D03 ostat0=3D00 ostat1=3D00 > ata1: stat0=3D0x00 err=3D0x00 lsb=3D0x00 msb=3D0x00 > ata1: stat1=3D0x00 err=3D0x00 lsb=3D0x00 msb=3D0x00 > ata1: reset tp2 stat0=3D00 stat1=3D00 devices=3D0x0 > Trying to mount root from ufs:/dev/vtbd0p2 [rw]... > atrtc0: providing initial system time > start_init: trying /sbin/init > uhub0: 2 ports with 2 removable, self powered >=20 > After that the system freezes. >=20 > I can provide more complete information if somebody tells me what = would be helpfull. >=20 > How should I go about debugging this ??? >=20 > Greetings > Christian >=20 > --=20 > Christian Kratzer CK Software GmbH > Email: ck@cksoft.de Wildberger Weg 24/2 > Phone: +49 7032 893 997 - 0 D-71126 Gaeufelden > Fax: +49 7032 893 997 - 9 HRB 245288, Amtsgericht Stuttgart > Mobile: +49 171 1947 843 Geschaeftsfuehrer: Christian = Kratzer > Web: http://www.cksoft.de/ > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to = "freebsd-virtualization-unsubscribe@freebsd.org" >=20 From owner-freebsd-virtualization@freebsd.org Mon Feb 11 23:22:27 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6016714E6D1E for ; Mon, 11 Feb 2019 23:22:27 +0000 (UTC) (envelope-from freebsd-doc@fjl.co.uk) Received: from bs1.fjl.org.uk (bs1.fjl.org.uk [84.45.41.196]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "bs1.fjl.org.uk", Issuer "bs1.fjl.org.uk" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id ECFDC8E7EF for ; Mon, 11 Feb 2019 23:22:26 +0000 (UTC) (envelope-from freebsd-doc@fjl.co.uk) Received: from [192.168.1.35] (host81-153-12-168.range81-153.btcentralplus.com [81.153.12.168]) (authenticated bits=0) by bs1.fjl.org.uk (8.14.4/8.14.4) with ESMTP id x1BN3eA6050742 for ; Mon, 11 Feb 2019 23:03:42 GMT (envelope-from freebsd-doc@fjl.co.uk) Subject: Re: mounting/exporting/importing a zfs volume To: "freebsd-virtualization@freebsd.org" References: <20190211170312.GA76683@admin.sibptus.ru> From: Frank Leonhardt Message-ID: <4465134c-ae48-d39b-dd87-9514da577cc2@fjl.co.uk> Date: Mon, 11 Feb 2019 23:03:41 +0000 User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:60.0) Gecko/20100101 Thunderbird/60.4.0 MIME-Version: 1.0 In-Reply-To: <20190211170312.GA76683@admin.sibptus.ru> Content-Language: en-GB X-Rspamd-Queue-Id: ECFDC8E7EF X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-6.99 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-0.996,0]; NEURAL_HAM_SHORT(-0.99)[-0.991,0]; REPLY(-4.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0] Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 8bit X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 11 Feb 2019 23:22:27 -0000 On 11/02/2019 17:03, Victor Sudakov wrote: > Dear Colleagues, > > vm-bhyve keeps virtual machines on zfs volumes with volmode=dev. How can > I access/mount the filesystems within the volume when the virtual host > is offline? > > If I kept virtual disks in raw files, I could access them as devices > with mdconfig. But: > > root@newserv:~ # mdconfig -a -f /dev/zvol/zroot/vm/mail/disk0 > mdconfig: /dev/zvol/zroot/vm/mail/disk0 is not a regular file > root@newserv:~ # > > Also, how can I exchange those zfs volumes for use with other > hypervisors? They are not real raw disk files so I cannot use > sysutils/vmdktool etc. > I don't know this, but I'll guess(!) If you've set volmode to dev then you get a cdev device in devfs, and you'll never get it to mount. Try using geom instead (which IIRC is the default). HOWEVER, I suspect you're doing this because you're hoping that a ZFS volume is faster than a file.  I went through this, in the hope it wouldn't do CoW and would therefore be a lot better for databases. I was disappointed! Bascially, it's no better than a ZFS file. If that was your plan, use a UFS partition. I don't use ZFS volumes any more; I think they're more useful on Solaris. A md mapped on to a ZFS file seems to be the BSD way, and for VMs just use a file in its own dataset. You can then clone the dataset. Just what you need for nearly identical VMs. Regards, Frank. From owner-freebsd-virtualization@freebsd.org Tue Feb 12 01:31:08 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9E2D514EC227 for ; Tue, 12 Feb 2019 01:31:08 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) Received: from admin.sibptus.ru (admin.sibptus.ru [IPv6:2001:19f0:5001:21dc::10]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 92D0E948C5 for ; Tue, 12 Feb 2019 01:31:07 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=sibptus.ru; s=20181118; h=In-Reply-To:Message-ID:Subject:To:From:Date; bh=Tq3zoTscfpMmo0DhmcldIPqgVOZf7samQ97AZFPTV30=; b=elPBPSF8LFZOJQMzzbdvWUac/7 AaGaL2E2CccgCve+53MQDUfN7WUuD2faRYYUdFRHAQ9XQeMYVXRRXme4t9IB0dkw7BDzCqRKGPIxL MVuqB2mbcRkBfSdLJpErJ4u/zfrC0kCEMbBC0Ta0aLC9YwBXDJOVADUA/N99u/8Oll6g=; Received: from vas by admin.sibptus.ru with local (Exim 4.91 (FreeBSD)) (envelope-from ) id 1gtMug-0004Yd-8H for freebsd-virtualization@freebsd.org; Tue, 12 Feb 2019 08:31:06 +0700 Date: Tue, 12 Feb 2019 08:31:06 +0700 From: Victor Sudakov To: "freebsd-virtua." Subject: Re: mounting/exporting/importing a zfs volume Message-ID: <20190212013106.GA16801@admin.sibptus.ru> References: <20190211170312.GA76683@admin.sibptus.ru> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="BXVAT5kNtrzKuDFl" Content-Disposition: inline In-Reply-To: X-PGP-Key: http://www.dreamwidth.org/pubkey?user=victor_sudakov X-PGP-Fingerprint: 10E3 1171 1273 E007 C2E9 3532 0DA4 F259 9B5E C634 User-Agent: Mutt/1.10.1 (2018-07-13) Sender: Victor Sudakov X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 12 Feb 2019 01:31:08 -0000 --BXVAT5kNtrzKuDFl Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Paul Webster wrote: > mdconfig -a -t vnode -f afaik Sorry, this does not work.=20 root@newserv:~ # mdconfig -a -t vnode /dev/zvol/zroot/vm/mail/disk0 mdconfig: /dev/zvol/zroot/vm/mail/disk0 is not a regular file There must be some other way. > once they are mounted you could dd them=20 Indeed, I can dd the volume to a regular file: dd if=3D/dev/zvol/zroot/vm/mail/disk0 of=3D/var/tmp/rawimage bs=3D1m conv= =3Dsparse and then work with the /var/tmp/rawimage (I can mdconfig it) but it's a was= te of disk space. --=20 Victor Sudakov, VAS4-RIPE, VAS47-RIPN 2:5005/49@fidonet http://vas.tomsk.ru/ --BXVAT5kNtrzKuDFl Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQEcBAEBAgAGBQJcYiHaAAoJEA2k8lmbXsY0QLMH/iW5PrO2MPjmAfn/i1QDpMkH DRgJghpPRteLGALikK9YHPdShRKvTCha8vFKtBTu59cwfmN1szFZX/NyPKU2VEby IDVCwvLkDlxjjnE45MZ7ejW/Zr50JPftX4IskY19dZz3cMUy+hLlOBm7DJAL6ojz /79kVTgJOrE6DLRlEeNEiHIP81x/BVx0s7WugCE+mjtCINlg4KXg+YCgwFF0qFQf ZpuFT0jTw8XIApKFpZ1MCj1d+gaAlmVdsxzXVLRUn7Ajal7zQkIO5vJGE0OqyVdF Wcv0qH425wRb7hlccImGgqo2rXlxdGLSheoCGBcxUP4ZE04RZ1BfRJJvOggEBKQ= =AmnU -----END PGP SIGNATURE----- --BXVAT5kNtrzKuDFl-- From owner-freebsd-virtualization@freebsd.org Tue Feb 12 01:46:48 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C482F14EDF64 for ; Tue, 12 Feb 2019 01:46:48 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) Received: from admin.sibptus.ru (admin.sibptus.ru [IPv6:2001:19f0:5001:21dc::10]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 3383195B4B for ; Tue, 12 Feb 2019 01:46:48 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=sibptus.ru; s=20181118; h=In-Reply-To:Message-ID:Subject:To:From:Date; bh=LYg1waesA/DqhwApgOTcTdBYdf+XkMJcYVewAYaMpVQ=; b=SjjKmoyu52ee+fSZSCk0qU7uGA uGEbPdJwOjeWI8rLjhAUySwfOuTQP6sTPNQwHaahPnuLeKsXb9WO7pIdKjjjg+8aDVsM629OhuUAw g9Tl7wq1F5kkTMvhwEEKfudipDBBZwwB06JORQ/1hPoayCPULk39YFcQb5jzMqV1JnkU=; Received: from vas by admin.sibptus.ru with local (Exim 4.91 (FreeBSD)) (envelope-from ) id 1gtN9r-0004r9-Ci for freebsd-virtualization@freebsd.org; Tue, 12 Feb 2019 08:46:47 +0700 Date: Tue, 12 Feb 2019 08:46:47 +0700 From: Victor Sudakov To: freebsd-virtualization@freebsd.org Subject: Re: mounting/exporting/importing a zfs volume Message-ID: <20190212014647.GB16801@admin.sibptus.ru> References: <20190211170312.GA76683@admin.sibptus.ru> <4465134c-ae48-d39b-dd87-9514da577cc2@fjl.co.uk> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="WYTEVAkct0FjGQmd" Content-Disposition: inline In-Reply-To: <4465134c-ae48-d39b-dd87-9514da577cc2@fjl.co.uk> X-PGP-Key: http://www.dreamwidth.org/pubkey?user=victor_sudakov X-PGP-Fingerprint: 10E3 1171 1273 E007 C2E9 3532 0DA4 F259 9B5E C634 User-Agent: Mutt/1.10.1 (2018-07-13) Sender: Victor Sudakov X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 12 Feb 2019 01:46:49 -0000 --WYTEVAkct0FjGQmd Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Frank Leonhardt wrote: > > > > vm-bhyve keeps virtual machines on zfs volumes with volmode=3Ddev. How = can > > I access/mount the filesystems within the volume when the virtual host > > is offline? > > > > If I kept virtual disks in raw files, I could access them as devices > > with mdconfig. But: > > > > root@newserv:~ # mdconfig -a -f /dev/zvol/zroot/vm/mail/disk0 > > mdconfig: /dev/zvol/zroot/vm/mail/disk0 is not a regular file > > root@newserv:~ # > > > > Also, how can I exchange those zfs volumes for use with other > > hypervisors? They are not real raw disk files so I cannot use > > sysutils/vmdktool etc. > > > I don't know this, but I'll guess(!) >=20 > If you've set volmode to dev then you get a cdev device in devfs, and=20 > you'll never get it to mount. Try using geom instead (which IIRC is the= =20 > default). The default in vm-bhyve is volmode=3Ddev, and I think this is reasonable. Do you know if I can clone an existing volmode=3Ddev volume into a volmode=3Dgeom volume and then work with the clone? >=20 > HOWEVER, I suspect you're doing this because you're hoping that a ZFS=20 > volume is faster than a file.=A0 Well, not actually. > I went through this, in the hope it wouldn't do CoW and would > therefore be a lot better for databases. I was disappointed! > Bascially, it's no better than a ZFS file. If that was your plan, use > a UFS partition.=20 A UFS partition? Where? > I don't use ZFS volumes any more; I=20 > think they're more useful on Solaris. A md mapped on to a ZFS file seems= =20 > to be the BSD way, and for VMs just use a file in its own dataset. You=20 > can then clone the dataset. Just what you need for nearly identical VMs. I've preferred disk0_dev=3D"zvol" VMs for aesthetical reasons since vm-bhyve started supporting them. Those file-based VMs get in the way while backing up $vm_dir, and their disks are not visible in=20 "zfs list -t volume" --=20 Victor Sudakov, VAS4-RIPE, VAS47-RIPN 2:5005/49@fidonet http://vas.tomsk.ru/ --WYTEVAkct0FjGQmd Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQEcBAEBAgAGBQJcYiWHAAoJEA2k8lmbXsY0NRwH/3GMZxAI0q2lxZAbJsfyJdGW ibyAy7oxDNfqlGnf/rdrAsjbLuLayPgTFZmjC1hVM41MFALUhIvJ4Mmsx7vWH0gU Kx7zkUvI5o6O7nmhjrARNrByBP36MbOqbcLb6AxPRSjHc+Dn1I3saW5avmnw1til /KqO7LzaZUFpn/KDEu9nPZ2Lvy9BV2M2VD7zHq8sMWFdiVe+CpnGXEgUP+LTerkV mscBQBLBmYadKdvrW+urbNl0ifYFLMztEbe4aK5rouhj+iKZvXrpJm92f/DdE9qX aYQ6XTqcHz4fn7hOaBQb3sE487qks52hXt7BMyH/g0SQUnBWrg2chLwAv5dxA0E= =JcbD -----END PGP SIGNATURE----- --WYTEVAkct0FjGQmd-- From owner-freebsd-virtualization@freebsd.org Tue Feb 12 02:29:59 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E53D514CF6AB for ; Tue, 12 Feb 2019 02:29:58 +0000 (UTC) (envelope-from paul@redbarn.org) Received: from family.redbarn.org (family.redbarn.org [IPv6:2001:559:8000:cd::5]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 5F15469F53 for ; Tue, 12 Feb 2019 02:29:58 +0000 (UTC) (envelope-from paul@redbarn.org) Received: from [192.168.10.91] (unknown [149.20.48.148]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by family.redbarn.org (Postfix) with ESMTPSA id D0D72892C6; Tue, 12 Feb 2019 02:29:55 +0000 (UTC) Subject: Re: mounting/exporting/importing a zfs volume To: Victor Sudakov Cc: freebsd-virtualization@freebsd.org References: <20190211170312.GA76683@admin.sibptus.ru> <4465134c-ae48-d39b-dd87-9514da577cc2@fjl.co.uk> <20190212014647.GB16801@admin.sibptus.ru> From: Paul Vixie Message-ID: Date: Mon, 11 Feb 2019 18:29:53 -0800 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:52.0) Gecko/20100101 PostboxApp/6.1.10 MIME-Version: 1.0 In-Reply-To: <20190212014647.GB16801@admin.sibptus.ru> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 12 Feb 2019 02:29:59 -0000 Victor Sudakov wrote on 2019-02-11 17:46: ... > I've preferred disk0_dev="zvol" VMs for aesthetical reasons since > vm-bhyve started supporting them. Those file-based VMs get in the way > while backing up $vm_dir, and their disks are not visible in > "zfs list -t volume" +1. -- P Vixie From owner-freebsd-virtualization@freebsd.org Tue Feb 12 08:43:36 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 795DF14DC894 for ; Tue, 12 Feb 2019 08:43:36 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id EA7D08071C for ; Tue, 12 Feb 2019 08:43:35 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) Received: by mailman.ysv.freebsd.org (Postfix) id A923E14DC892; Tue, 12 Feb 2019 08:43:35 +0000 (UTC) Delivered-To: virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9510F14DC88F for ; Tue, 12 Feb 2019 08:43:35 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) Received: from admin.sibptus.ru (admin.sibptus.ru [IPv6:2001:19f0:5001:21dc::10]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id A1C678071A for ; Tue, 12 Feb 2019 08:43:34 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=sibptus.ru; s=20181118; h=In-Reply-To:Message-ID:Subject:To:From:Date; bh=/c/hkQegzXrWSba6mvbqOvNWdCRbC0dQxs/RSrDXbZY=; b=UqIcwhgljPZ+KIePEToZD3IFhx KUoDfmEnKbjGYkRg1bs0J5VBLjOqUV/ZNEzwj2WWC7CQAKKXN0Emf0GmKGtosuTl1uy38ywOgred5 C2xs3YByx96pH5IIQugFAELf9t83SW1koIUYpY/D9ZyUJAL8mLYnzqrGzl/j1whoadpQ=; Received: from vas by admin.sibptus.ru with local (Exim 4.91 (FreeBSD)) (envelope-from ) id 1gtTfB-000CHy-2j for virtualization@freebsd.org; Tue, 12 Feb 2019 15:43:33 +0700 Date: Tue, 12 Feb 2019 15:43:33 +0700 From: Victor Sudakov To: virtualization@freebsd.org Subject: Re: NVMe and Bhyve Message-ID: <20190212084333.GA46685@admin.sibptus.ru> References: <20190207174453.Horde.hWBGfoLlymCpipxLv8WUJo9@app.eeeit.de> <5121268a-1ead-9858-86a7-27f75048feb2@yuripv.net> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="G4iJoqBmSsgzjUCe" Content-Disposition: inline In-Reply-To: <5121268a-1ead-9858-86a7-27f75048feb2@yuripv.net> X-PGP-Key: http://www.dreamwidth.org/pubkey?user=victor_sudakov X-PGP-Fingerprint: 10E3 1171 1273 E007 C2E9 3532 0DA4 F259 9B5E C634 User-Agent: Mutt/1.10.1 (2018-07-13) Sender: Victor Sudakov X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 12 Feb 2019 08:43:36 -0000 --G4iJoqBmSsgzjUCe Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable What's that disk0_type=3D"nvme" thing? I'm curious. In 11.2-RELEASE there is nothing about nvme in bhyve(8). Should I be running CURRENT or what? --=20 Victor Sudakov, VAS4-RIPE, VAS47-RIPN 2:5005/49@fidonet http://vas.tomsk.ru/ --G4iJoqBmSsgzjUCe Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQEcBAEBAgAGBQJcYoc1AAoJEA2k8lmbXsY0jK8H/0K7C/YzcnbT7blNH9jJf8Bn Ng+2F/+l8lkx3KDIncKbchhZwNvbAR4ZMfSNoV1Y6r7OEWmD3ocqhKIxvXyMRtqk 9fjzWtvVtttSC8kdvXJJUJcFbYMqm3utBmVn5NjsECcFHRStqgQcKf7igvFJMAqN ao+aokOBrY3+7JkZuTGfoB+ysgG33/mO+A2lIwUgrI2o/6blT3sqdnYzLQ/8KKPW D19a4YxucmW2HyPw6mUHoS8U/NsjLiCDPGIulhNdjUC42msTQSRsEBiLvjLMArNF 7gwi3ipDmrZdsxbC//IU+DqlNRjY27+kDihn4bity+cF12t+V9UkGwFElYoMKJU= =A/th -----END PGP SIGNATURE----- --G4iJoqBmSsgzjUCe-- From owner-freebsd-virtualization@freebsd.org Tue Feb 12 11:08:16 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2E61414E2717 for ; Tue, 12 Feb 2019 11:08:16 +0000 (UTC) (envelope-from jtubnor@gmail.com) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 889CA86D5A for ; Tue, 12 Feb 2019 11:08:15 +0000 (UTC) (envelope-from jtubnor@gmail.com) Received: by mailman.ysv.freebsd.org (Postfix) id 4430914E2716; Tue, 12 Feb 2019 11:08:15 +0000 (UTC) Delivered-To: virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 32B9114E2715 for ; Tue, 12 Feb 2019 11:08:15 +0000 (UTC) (envelope-from jtubnor@gmail.com) Received: from mail-ot1-f52.google.com (mail-ot1-f52.google.com [209.85.210.52]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id BD71886D59 for ; Tue, 12 Feb 2019 11:08:14 +0000 (UTC) (envelope-from jtubnor@gmail.com) Received: by mail-ot1-f52.google.com with SMTP id m1so3724294otf.5 for ; Tue, 12 Feb 2019 03:08:14 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=lUEIPCTg6JC6TssJRr0bj4+jvkPKz1Fx1GgW9nqGto8=; b=Wq1YAYhpJnPHOyEc6tj5PVOy/h7S7DNC2DLngxaSy+0KanSQCUbiwxpMWSFyfRVcFR g+wYL2AWPUJ9Jc2rW+XqcI7lwHQdJbJNv/xlLk6gZV/b2mpB4//HbyXsV/0AM5BRPEdH cth7xAnwPo4lX16wJfaTPI4Povo1h9gwDROZwWYAQZ6Q3mI2kNPmA+XOQniTQgepEuUm 3Hs4i+5H3FRV13NhgsP0vpGIM9ZS6ZPjMZrfVTDTiLSajzXd0Gn4oKvlCcLrzCkLrb7B YQzTN5RqC8VzGNyyompZZzT3O+enMfGDBlCyokYPhtg/E+Id49ybN/L7cMFWBVgMbuaW kBog== X-Gm-Message-State: AHQUAuZHf+Lk7yizTYeA5oSnSDsI8kvoP+L8Q4Wy2LMPy0OfHDiKZzzs /WYoqSKiv0oiyWkCJ/7lFziKDglST/61JUcdZc8= X-Google-Smtp-Source: AHgI3Ib27BcPvX3hVlsgUtCNs2uCn2JE4PiKrGESfbtzYZwjcNCrbpVTYZmBoXu0ZHGQZWI+gwypD/EdukHydLukBG0= X-Received: by 2002:a9d:7997:: with SMTP id h23mr2897172otm.362.1549969239658; Tue, 12 Feb 2019 03:00:39 -0800 (PST) MIME-Version: 1.0 References: <20190207174453.Horde.hWBGfoLlymCpipxLv8WUJo9@app.eeeit.de> <5121268a-1ead-9858-86a7-27f75048feb2@yuripv.net> <20190212084333.GA46685@admin.sibptus.ru> In-Reply-To: <20190212084333.GA46685@admin.sibptus.ru> From: Jason Tubnor Date: Tue, 12 Feb 2019 22:00:28 +1100 Message-ID: Subject: Re: NVMe and Bhyve To: Victor Sudakov Cc: "freebsd-virtualization@freebsd.org" X-Rspamd-Queue-Id: BD71886D59 X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-6.99 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-0.998,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; REPLY(-4.00)[]; NEURAL_HAM_SHORT(-0.99)[-0.993,0] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 12 Feb 2019 11:08:16 -0000 On Tue, 12 Feb 2019 at 19:43, Victor Sudakov wrote: > What's that disk0_type="nvme" thing? > > I'm curious. In 11.2-RELEASE there is nothing about nvme in bhyve(8). > Should I be running CURRENT or what? > > > It is valid on hosts 12.0-RELEASE and newer. From owner-freebsd-virtualization@freebsd.org Tue Feb 12 13:05:09 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 86C5814E61B2 for ; Tue, 12 Feb 2019 13:05:09 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 097808B5CA for ; Tue, 12 Feb 2019 13:05:09 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) Received: by mailman.ysv.freebsd.org (Postfix) id BE22A14E61B1; Tue, 12 Feb 2019 13:05:08 +0000 (UTC) Delivered-To: virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id AB56814E61B0 for ; Tue, 12 Feb 2019 13:05:08 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) Received: from admin.sibptus.ru (admin.sibptus.ru [IPv6:2001:19f0:5001:21dc::10]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id BBAB38B5C9 for ; Tue, 12 Feb 2019 13:05:07 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=sibptus.ru; s=20181118; h=In-Reply-To:Message-ID:Subject:To:From:Date; bh=574A8g4xhsQ3N5MS2QAZpP/UUDkQUpYRZdLD7priJoY=; b=jUOmAWWzH/BiuyiSCGZQlguBoE n4ejW1cZYIF0720PQpDJJwpzsY4CP9cIMejMGP+6HhGIvv1ceIvp4Vn1mGVO1AAPVCnCdtMOa8Bm6 WkYMCU1LtvDTwElw6UaPfYXhKAj3oQcIt/Lp7I/rEK+K4KCr09SN2ChyHgdv4CkSI100=; Received: from vas by admin.sibptus.ru with local (Exim 4.91 (FreeBSD)) (envelope-from ) id 1gtXkI-000GbG-MA for virtualization@freebsd.org; Tue, 12 Feb 2019 20:05:06 +0700 Date: Tue, 12 Feb 2019 20:05:06 +0700 From: Victor Sudakov To: "freebsd-virtualization@freebsd.org" Subject: Re: NVMe and Bhyve Message-ID: <20190212130506.GA62989@admin.sibptus.ru> References: <20190207174453.Horde.hWBGfoLlymCpipxLv8WUJo9@app.eeeit.de> <5121268a-1ead-9858-86a7-27f75048feb2@yuripv.net> <20190212084333.GA46685@admin.sibptus.ru> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="envbJBWh7q8WU6mo" Content-Disposition: inline In-Reply-To: X-PGP-Key: http://www.dreamwidth.org/pubkey?user=victor_sudakov X-PGP-Fingerprint: 10E3 1171 1273 E007 C2E9 3532 0DA4 F259 9B5E C634 User-Agent: Mutt/1.10.1 (2018-07-13) Sender: Victor Sudakov X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 12 Feb 2019 13:05:09 -0000 --envbJBWh7q8WU6mo Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Jason Tubnor wrote: >=20 > > What's that disk0_type=3D"nvme" thing? > > > > I'm curious. In 11.2-RELEASE there is nothing about nvme in bhyve(8). > > Should I be running CURRENT or what? > > > > > > > It is valid on hosts 12.0-RELEASE and newer. Is it worth it? I mean upgrading from 11.2-RELEASE to 12.0-RELEASE for the sake of nvme, is it useful for running FreeBSD, Linux (Mint, Centos) and Windows10 guests? --=20 Victor Sudakov, VAS4-RIPE, VAS47-RIPN 2:5005/49@fidonet http://vas.tomsk.ru/ --envbJBWh7q8WU6mo Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQEcBAEBAgAGBQJcYsSCAAoJEA2k8lmbXsY0u2oH/0hpH7w/v/hjRDa3AA9b+Ohl cuEdpaV5LNa2fussVAviUrx+58ycbLDPekbaRP+CSg06atyh4xjn6xldcNcug9sQ YU6WrSoUhcFzlAMt6r0KIPas4vz756dtfUKIpBC1a+BOZXmYnrDYTps7wtLpStKI uDyZeNbdeecyiaTjJh0uqAOnV3THlFkpUSqAVGFu5ZGBkui0KNpjVxkr/Hnui6Qe ua37HWJnVOs9sjGTdsWu6/yA6Wqonu8Z3RpNTDUxH33MnqooOlWgWJCOIUbKTBV1 a97pnOfP3HoY/76QZEA0PrRPRlUzJDra5yxqc21BUbxdoJi4CGTtZ0Z/X94ZUgQ= =gJLR -----END PGP SIGNATURE----- --envbJBWh7q8WU6mo-- From owner-freebsd-virtualization@freebsd.org Tue Feb 12 13:57:35 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8992514E7620 for ; Tue, 12 Feb 2019 13:57:35 +0000 (UTC) (envelope-from araujobsdport@gmail.com) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id DB6E98D025 for ; Tue, 12 Feb 2019 13:57:34 +0000 (UTC) (envelope-from araujobsdport@gmail.com) Received: by mailman.ysv.freebsd.org (Postfix) id 9711414E761F; Tue, 12 Feb 2019 13:57:34 +0000 (UTC) Delivered-To: virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 720BC14E761E for ; Tue, 12 Feb 2019 13:57:34 +0000 (UTC) (envelope-from araujobsdport@gmail.com) Received: from mail-lf1-x12f.google.com (mail-lf1-x12f.google.com [IPv6:2a00:1450:4864:20::12f]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id B54018D024 for ; Tue, 12 Feb 2019 13:57:33 +0000 (UTC) (envelope-from araujobsdport@gmail.com) Received: by mail-lf1-x12f.google.com with SMTP id l10so2048819lfh.9 for ; Tue, 12 Feb 2019 05:57:33 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:reply-to:from:date:message-id :subject:to:cc; bh=urW1YqUCL0eNQnVc09AOwYgmzvbd8Zkh3BPRJeePSIo=; b=LwlN4QirAKczrT4q/abQ8KIOZ5NEy4+cr93VOv8HtGvsdHM/UXs7I0dkj2okvstvye G7m3r8BmYc0WAjlPEZZh/d0nRMKYZn5nAANbWUtNECgcW4NOKdpUdJVxo91ccJmlfOAu etnF7zAWHIV1AVIL+npkbiWYgkFxiAk47gj5ufVNGAM0Q3J0gW5uAm5aLmSbT+E+ZM8S HyDey2NTVay7KUyigXvxVFLQMW4CpBTZnyG+cWrM/SpV+48jJBXnx5/vu4MERvH2Gw/2 PweI8hH0cXDdZHlNta/a/ErvqHXNWTtjzLEu9Br/nC0BBOmBG4prHAJfH3DoJXM2yitz qVeQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:reply-to :from:date:message-id:subject:to:cc; bh=urW1YqUCL0eNQnVc09AOwYgmzvbd8Zkh3BPRJeePSIo=; b=udzPdeWGPuImbuZZH4ZA65Zb6xkgJz2cI8aTa2IvGzi1cKBcUCDgfxs0nO0+iG4tqL fCkF81d74HhdIMpc8wZvfZbBnjs8HSAlSCJrlvsGyLEAMosjKDqqOd2t66W5mkhr7rZw ndMYAHGNf+wfRMCMCIi75g9ErTdtLWBjjbZqrp5S4rqpo3kKqruMObRdHhymWiu0fgUs Q4SbUalBqpA97WYlzNLrFJMcX17PFEv+VEaFZA79dLrOsQBloLTzqaVLlHLMV84F2O7M Z/ZhyMkp1HGh1HDrL+SnBoLNBEkn6tCFrPgEL4oSJVPy/zi37hbIk2m4tDsol0W4t9RR fbyQ== X-Gm-Message-State: AHQUAuanZnvPL+js+fBEHBw4aPNSrSgyqafHc2ibxeZsH9ubj1DOJrK6 tw1kl6GRvHG367IyPCd90QMYF1uWsJNIJMsndOtJ1w== X-Google-Smtp-Source: AHgI3IYtHoRiAK40lD6fIalgVi+g3KgYqmkzpBOnLGGLYzGblMrqhlKW33yjZLAEfm0qSwiD9WfxyIGyUSi4URE0YnE= X-Received: by 2002:a19:ae0b:: with SMTP id f11mr2612110lfc.104.1549979852116; Tue, 12 Feb 2019 05:57:32 -0800 (PST) MIME-Version: 1.0 References: <20190207174453.Horde.hWBGfoLlymCpipxLv8WUJo9@app.eeeit.de> <5121268a-1ead-9858-86a7-27f75048feb2@yuripv.net> <20190212084333.GA46685@admin.sibptus.ru> <20190212130506.GA62989@admin.sibptus.ru> In-Reply-To: <20190212130506.GA62989@admin.sibptus.ru> Reply-To: araujo@freebsd.org From: Marcelo Araujo Date: Tue, 12 Feb 2019 21:57:21 +0800 Message-ID: Subject: Re: NVMe and Bhyve To: Victor Sudakov Cc: "freebsd-virtualization@freebsd.org" X-Rspamd-Queue-Id: B54018D024 X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-6.99 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-0.998,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; REPLY(-4.00)[]; NEURAL_HAM_SHORT(-0.99)[-0.993,0] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 12 Feb 2019 13:57:35 -0000 If you have Nvme devices or you want store disks in ram yes, otherwise no. BR, On Tue, Feb 12, 2019, 9:05 PM Victor Sudakov Jason Tubnor wrote: > > > > > What's that disk0_type="nvme" thing? > > > > > > I'm curious. In 11.2-RELEASE there is nothing about nvme in bhyve(8). > > > Should I be running CURRENT or what? > > > > > > > > > > > It is valid on hosts 12.0-RELEASE and newer. > > Is it worth it? I mean upgrading from 11.2-RELEASE to 12.0-RELEASE for > the sake of nvme, is it useful for running FreeBSD, Linux (Mint, > Centos) and Windows10 guests? > > -- > Victor Sudakov, VAS4-RIPE, VAS47-RIPN > 2:5005/49@fidonet http://vas.tomsk.ru/ > From owner-freebsd-virtualization@freebsd.org Tue Feb 12 20:50:52 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5378C14D0A68 for ; Tue, 12 Feb 2019 20:50:52 +0000 (UTC) (envelope-from jtubnor@gmail.com) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 9745B81DEF for ; Tue, 12 Feb 2019 20:50:51 +0000 (UTC) (envelope-from jtubnor@gmail.com) Received: by mailman.ysv.freebsd.org (Postfix) id 55E8814D0A67; Tue, 12 Feb 2019 20:50:51 +0000 (UTC) Delivered-To: virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1627514D0A66 for ; Tue, 12 Feb 2019 20:50:51 +0000 (UTC) (envelope-from jtubnor@gmail.com) Received: from mail-ot1-f50.google.com (mail-ot1-f50.google.com [209.85.210.50]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id A11F581DEC; Tue, 12 Feb 2019 20:50:50 +0000 (UTC) (envelope-from jtubnor@gmail.com) Received: by mail-ot1-f50.google.com with SMTP id n71so85426ota.10; Tue, 12 Feb 2019 12:50:50 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=3VqKAohZoBb/Z2IKbMFs9JQ2dN/zWx8OTqB0R6mxLPQ=; b=j0QLomLTLHMR9W7xVZZLGglJcqGpT72ayryz6Qmn1mUbcUp9gARPybI5Ade9ulru8a sVlvg3d+iDx6rjw+iMKXmotzQw3ibDQU4JRa/lGB8U5Po6aGJrsaCUAvaeuQR3vTjzjK VT2U7L1OYFcC+g0cUSwX/sOGq+5ZqS7oB5OWlNqPau/bPxGMFJ7iLkIiqABcLwOR5X5p TPnu2yDi0tPsRaUGjpPSrhURs1UduO9ibh/OlUMzbUQYvRc4TGHD7LOK2zW03FubkHG7 5APeEOPjfoJxicetbSE57NY5WfGgKZiE23BzGKE8fDcNPYwkpKcb5enrx28r9iiQ2QnJ dGRg== X-Gm-Message-State: AHQUAuZB/h0XTEMvn9um8nMNyL6hrS61J9c6rEm3AblLo8q4emQk57I9 ba/OUvP/fUIAYag6qag9Ewjtrh4LxVxnCuIHlmoC4A== X-Google-Smtp-Source: AHgI3IZZtEIsQBZ6Ebm2x8y9HcEJpZEjvIkGwMeH/bDVyQ+rhW5uYUWdpQDT09cc0CrMA2YWVdUXqCC92nXXpHCCHYI= X-Received: by 2002:a9d:ef3:: with SMTP id 106mr1537702otj.362.1550004643940; Tue, 12 Feb 2019 12:50:43 -0800 (PST) MIME-Version: 1.0 References: <20190207174453.Horde.hWBGfoLlymCpipxLv8WUJo9@app.eeeit.de> <5121268a-1ead-9858-86a7-27f75048feb2@yuripv.net> <20190212084333.GA46685@admin.sibptus.ru> <20190212130506.GA62989@admin.sibptus.ru> In-Reply-To: From: Jason Tubnor Date: Wed, 13 Feb 2019 07:50:32 +1100 Message-ID: Subject: Re: NVMe and Bhyve To: araujo@freebsd.org Cc: Victor Sudakov , "freebsd-virtualization@freebsd.org" X-Rspamd-Queue-Id: A11F581DEC X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-6.95 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-0.997,0]; NEURAL_HAM_SHORT(-0.96)[-0.956,0]; REPLY(-4.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 12 Feb 2019 20:50:52 -0000 On Wed, 13 Feb 2019 at 00:57, Marcelo Araujo wrote: > If you have Nvme devices or you want store disks in ram yes, otherwise no. > > > > > Is it worth it? I mean upgrading from 11.2-RELEASE to 12.0-RELEASE for > > the sake of nvme, is it useful for running FreeBSD, Linux (Mint, > > Centos) and Windows10 guests? > > Or if you are using good SLOG and ARC for your VM zvols. I'm still sorting out some Windows issues with the bhyve nvme presentation for a variety of guest (except freebsd, that works fine) at the moment. I would avoid 12.0-RELEASE as it may introduce other issues with your environment. I am staying on the 11.x branch until 12.1 is released so no nvme except for in the test environment that is running 12-STABLE. From owner-freebsd-virtualization@freebsd.org Tue Feb 12 21:04:19 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id CAA4614D0FD6 for ; Tue, 12 Feb 2019 21:04:18 +0000 (UTC) (envelope-from doctor@doctor.nl2k.ab.ca) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 1EC1D82A32 for ; Tue, 12 Feb 2019 21:04:13 +0000 (UTC) (envelope-from doctor@doctor.nl2k.ab.ca) Received: by mailman.ysv.freebsd.org (Postfix) id 37DD514D0FB3; Tue, 12 Feb 2019 21:04:10 +0000 (UTC) Delivered-To: virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 09F4614D0FB1 for ; Tue, 12 Feb 2019 21:04:10 +0000 (UTC) (envelope-from doctor@doctor.nl2k.ab.ca) Received: from doctor.nl2k.ab.ca (doctor.nl2k.ab.ca [204.209.81.1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 368818294F; Tue, 12 Feb 2019 21:04:00 +0000 (UTC) (envelope-from doctor@doctor.nl2k.ab.ca) Received: from doctor by doctor.nl2k.ab.ca with local (Exim 4.92 (FreeBSD)) (envelope-from ) id 1gtfDU-0003Qu-KM; Tue, 12 Feb 2019 14:03:44 -0700 Date: Tue, 12 Feb 2019 14:03:44 -0700 From: The Doctor To: Jason Tubnor Cc: araujo@freebsd.org, "freebsd-virtualization@freebsd.org" Subject: Re: NVMe and Bhyve Message-ID: <20190212210344.GA12187@doctor.nl2k.ab.ca> References: <20190207174453.Horde.hWBGfoLlymCpipxLv8WUJo9@app.eeeit.de> <5121268a-1ead-9858-86a7-27f75048feb2@yuripv.net> <20190212084333.GA46685@admin.sibptus.ru> <20190212130506.GA62989@admin.sibptus.ru> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.11.2 (2019-01-07) X-Rspamd-Queue-Id: 368818294F X-Spamd-Bar: ------ X-Spamd-Result: default: False [-6.95 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-0.997,0]; NEURAL_HAM_SHORT(-0.95)[-0.954,0]; REPLY(-4.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 12 Feb 2019 21:04:19 -0000 On Wed, Feb 13, 2019 at 07:50:32AM +1100, Jason Tubnor wrote: > On Wed, 13 Feb 2019 at 00:57, Marcelo Araujo > wrote: > > > If you have Nvme devices or you want store disks in ram yes, otherwise no. > > > > > > > > Is it worth it? I mean upgrading from 11.2-RELEASE to 12.0-RELEASE for > > > the sake of nvme, is it useful for running FreeBSD, Linux (Mint, > > > Centos) and Windows10 guests? > > > > > > Or if you are using good SLOG and ARC for your VM zvols. > > I'm still sorting out some Windows issues with the bhyve nvme presentation > for a variety of guest (except freebsd, that works fine) at the moment. I > would avoid 12.0-RELEASE as it may introduce other issues with your > environment. I am staying on the 11.x branch until 12.1 is released so no > nvme except for in the test environment that is running 12-STABLE. I will stay with 11.x until 12.2 is released. > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@freebsd.org" -- Member - Liberal International This is doctor@@nl2k.ab.ca Ici doctor@@nl2k.ab.ca Yahweh, Queen & country!Never Satan President Republic!Beware AntiChrist rising! https://www.empire.kred/ROOTNK?t=94a1f39b Look at Psalms 14 and 53 on Atheism Do not consider painful what is good for you. -Euripides From owner-freebsd-virtualization@freebsd.org Fri Feb 15 04:41:39 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D822214EEC71 for ; Fri, 15 Feb 2019 04:41:38 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 40BF376380 for ; Fri, 15 Feb 2019 04:41:38 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) Received: by mailman.ysv.freebsd.org (Postfix) id EEC4614EEC70; Fri, 15 Feb 2019 04:41:37 +0000 (UTC) Delivered-To: virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DD41B14EEC6F for ; Fri, 15 Feb 2019 04:41:37 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) Received: from admin.sibptus.ru (admin.sibptus.ru [IPv6:2001:19f0:5001:21dc::10]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 169717637C for ; Fri, 15 Feb 2019 04:41:36 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=sibptus.ru; s=20181118; h=In-Reply-To:Message-ID:Subject:To:From:Date; bh=RjYoZc5ILFkXD5p+S3+kQZ/vfvbvbsvfM0q2O9tL2WE=; b=E4Kecf9Mof7juYiO+bZjayOrAG jmNTNeE1DKuzvPDgF2s8p1Y/kOj1j6YOngBbiARiFcW5zqVL4w+y4RKfNrpvg/Vz4Z/k4Q3S2H5Cr cNzKV0ENWCn94N9T5WGGwrRbjsHPOgvp5BJwuwh9BIj3qgDzPb7qcOIhassWWg7ZIcdE=; Received: from vas by admin.sibptus.ru with local (Exim 4.91 (FreeBSD)) (envelope-from ) id 1guVJe-000DiG-Mj for virtualization@freebsd.org; Fri, 15 Feb 2019 11:41:34 +0700 Date: Fri, 15 Feb 2019 11:41:34 +0700 From: Victor Sudakov To: "freebsd-virtualization@freebsd.org" Subject: Re: NVMe and Bhyve Message-ID: <20190215044134.GA52633@admin.sibptus.ru> References: <20190207174453.Horde.hWBGfoLlymCpipxLv8WUJo9@app.eeeit.de> <5121268a-1ead-9858-86a7-27f75048feb2@yuripv.net> <20190212084333.GA46685@admin.sibptus.ru> <20190212130506.GA62989@admin.sibptus.ru> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="oyUTqETQ0mS9luUI" Content-Disposition: inline In-Reply-To: X-PGP-Key: http://www.dreamwidth.org/pubkey?user=victor_sudakov X-PGP-Fingerprint: 10E3 1171 1273 E007 C2E9 3532 0DA4 F259 9B5E C634 User-Agent: Mutt/1.10.1 (2018-07-13) Sender: Victor Sudakov X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 15 Feb 2019 04:41:39 -0000 --oyUTqETQ0mS9luUI Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Jason Tubnor wrote: >=20 > > If you have Nvme devices or you want store disks in ram yes, otherwise = no. > > > > > > > > Is it worth it? I mean upgrading from 11.2-RELEASE to 12.0-RELEASE for > > > the sake of nvme, is it useful for running FreeBSD, Linux (Mint, > > > Centos) and Windows10 guests? > > > >=20 >=20 > Or if you are using good SLOG and ARC for your VM zvols. >=20 > I'm still sorting out some Windows issues with the bhyve nvme presentation > for a variety of guest (except freebsd, that works fine) at the moment. I > would avoid 12.0-RELEASE as it may introduce other issues with your I was just worried that using ahci-hd instead of paravirtualized disks causes suboptimal performance of guests. Do you think there is a hope to get paravirtualized disks support for Windows guests in bhyve? --=20 Victor Sudakov, VAS4-RIPE, VAS47-RIPN 2:5005/49@fidonet http://vas.tomsk.ru/ --oyUTqETQ0mS9luUI Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQEcBAEBAgAGBQJcZkL+AAoJEA2k8lmbXsY08i0H/0taPMoeiSeuzajjvrNERy5W jpsZs7zd0eNApqMdRTvcIUiC7jF8OJkRT3hC3AnMRs4rcD+aiOETBrqe5To0xkiS afMZLjVKBbwQmMPgxFvXhN68elS084rq8y5xj4VU9g4eE8UjYwIOs60/R4lxqr2f 2cbgqbVY587VP8rlqCLlD7x3rtsvTZ5qWCMPj1YdNQ9+HeB5Rc3oAlRsrnMFuPaN cybMNJf8CoiISHKEaM9kF+0SETsCjlbMzSzJl8HkZkZ1rq0s91Rtg+OGO2R6Yv6e usRnFYa5DuciIC6J6oCR19r1irtVyCw0M45dIglAUr4FX6VvRZUex+iO0Qquh30= =FlU/ -----END PGP SIGNATURE----- --oyUTqETQ0mS9luUI-- From owner-freebsd-virtualization@freebsd.org Fri Feb 15 08:08:29 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9EF1514F3B0E for ; Fri, 15 Feb 2019 08:08:29 +0000 (UTC) (envelope-from i.sukhoplyuev@innopolis.university) Received: from st01-ex01.innopolis.ru (st01-ex01.innopolis.ru [188.130.155.27]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.innopolis.ru", Issuer "StartCom Class 3 OV Server CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 1F962842D1 for ; Fri, 15 Feb 2019 08:08:27 +0000 (UTC) (envelope-from i.sukhoplyuev@innopolis.university) X-Assp-Version: 2.6.1(19007) on ASSPF01DCFBL.res.innopolis.ru X-Assp-ID: ASSPF01DCFBL.res.innopolis.ru m1-18094-08050 X-Assp-Session: 7F2FED160A90 (mail 1) X-Assp-Envelope-From: i.sukhoplyuev@innopolis.university X-Assp-Intended-For: freebsd-virtualization@freebsd.org X-Assp-Server-TLS: yes Content-Language: ru-RU Content-Type: multipart/mixed; boundary="_002_a838508a39b84773b5910ea9b451ae3binnopolisuniversity_" DKIM-Signature: v=1; a=rsa-sha256; d=innopolis.university; s=dkim1; c=simple/simple; t=1550218093; h=from:subject:to:date:message-id; bh=BgyRSqEn4i4FyxC3zVLzp/lCv5oh/F2UilbOYA0ophw=; b=hRPgnjCK8gxyibmoXPlc0iiY8TLAsWK7dFpoodB+R04psQSJBjVBbnsho/BMQM6TghqPyrOCsTg xv7lMPdlLjUT2sYae13ACWdavOI89+zMGhDgMVLZofg4D9a8P/uGKg0mZHApI3YcDhtOW38SYD1I9 j7+h/Hc4fZYgK0c0gsJQmoqy7lAloVxWoARYTL8Ew2FP30bVKtmGIoSrmHq0/h+KLeNE8MKmD+eFU kSLdREoNPpzz6UorXwcw33GZpJ5cSMVHjN7oF5QOd27anqOifngyg3teB1/5x/Y2yr+XYpll1q5f/ cwLi9BVewws4+GyQgMq7YDps0SCBM07QtCUg== From: Ilya Sukhoplyuev To: "freebsd-virtualization@freebsd.org" Subject: Multiple bhyve hosts under Linux KVM Thread-Topic: Multiple bhyve hosts under Linux KVM Thread-Index: AQHUw9dN34JdUhuF4kqGhvUnPFuFiw== Date: Fri, 15 Feb 2019 08:08:11 +0000 Message-ID: Accept-Language: ru-RU, en-US X-MS-Has-Attach: yes X-MS-TNEF-Correlator: MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 1F962842D1 X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none (invalid DKIM record) header.d=innopolis.university header.s=dkim1 header.b=hRPgnjCK; dmarc=pass (policy=none) header.from=innopolis.university; spf=pass (mx1.freebsd.org: domain of i.sukhoplyuev@innopolis.university designates 188.130.155.27 as permitted sender) smtp.mailfrom=i.sukhoplyuev@innopolis.university X-Spamd-Result: default: False [-1.03 / 15.00]; ARC_NA(0.00)[]; DMARC_POLICY_ALLOW(-0.50)[innopolis.university,none]; NEURAL_HAM_MEDIUM(-0.92)[-0.923,0]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:188.130.155.27]; TO_MATCH_ENVRCPT_ALL(0.00)[]; HAS_ATTACHMENT(0.00)[]; MIME_GOOD(-0.10)[multipart/mixed,text/plain]; NEURAL_HAM_LONG(-0.99)[-0.988,0]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_SPAM_SHORT(0.69)[0.688,0]; DKIM_TRACE(0.00)[innopolis.university:~]; CTYPE_MIXED_BOGUS(1.00)[]; RCVD_IN_DNSWL_NONE(0.00)[27.155.130.188.list.dnswl.org : 127.0.10.0]; MX_GOOD(-0.01)[mx.innopolis.ru,mx24.innopolis.ru]; R_DKIM_PERMFAIL(0.00)[innopolis.university:s=dkim1]; TO_DN_EQ_ADDR_ALL(0.00)[]; RCVD_COUNT_ZERO(0.00)[0]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:+]; IP_SCORE(0.00)[country: RU(0.00)]; ASN(0.00)[asn:203509, ipnet:188.130.155.0/24, country:RU]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 15 Feb 2019 08:08:30 -0000 --_002_a838508a39b84773b5910ea9b451ae3binnopolisuniversity_ Content-Type: text/plain; charset="koi8-r" Content-Transfer-Encoding: quoted-printable Good day,=20 I have found the question on the FreeBSD wiki about running bhyve hosts un= der Linux KVM on the bhyve's wiki: https://wiki.freebsd.org/bhyve#Q:_Can_I_run_multiple_bhyve_hosts_under_Linu= x_KVM_with_nested_VT-x_EPT.3F=20 During the study work about virtualization I have checked it by repeating t= he part from FreeBSD handbook:=20 https://www.freebsd.org/doc/handbook/virtualization-host-bhyve.html . I have installed nested FreeBSD 10.3, nested Debian, and run two bhyves hos= t with nested FreeBSD 10.3 simultaneously=20 Part of that I recorded in the video: https://www.youtube.com/watch?v=3DyMj= 4m0gc1_k.=20 In the attachments, there are my study logs. You might be interested in sec= tions "Task 2. KVM nested Bhyve" (details) and "Appendix" (some system fing= erprints).=20 Sukhoplyuev Ilya= --_002_a838508a39b84773b5910ea9b451ae3binnopolisuniversity_ Content-Type: text/plain; charset="UTF-8"; name="I_Sukhoplyuev-LIA-Virtual-Machine-Monitors-(Hypervisors).txt" Content-Description: I_Sukhoplyuev-LIA-Virtual-Machine-Monitors-(Hypervisors).zip Content-Disposition: attachment; creation-date="Fri, 15 Feb 2019 07:58:20 GMT"; filename="I_Sukhoplyuev-LIA-Virtual-Machine-Monitors-(Hypervisors).txt"; modification-date="Fri, 15 Feb 2019 07:58:20 GMT"; size="1985754" Content-Transfer-Encoding: quoted-printable The attached in the letter file (I_Sukhoplyuev-LIA-Virtual-Machine-Monitors= -(Hypervisors).zip) has been deleted from the message, as could harm your c= omputer.= --_002_a838508a39b84773b5910ea9b451ae3binnopolisuniversity_-- From owner-freebsd-virtualization@freebsd.org Fri Feb 15 15:37:31 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3815614DE89C for ; Fri, 15 Feb 2019 15:37:31 +0000 (UTC) (envelope-from freebsd-rwg@pdx.rh.CN85.dnsmgr.net) Received: from pdx.rh.CN85.dnsmgr.net (br1.CN84in.dnsmgr.net [69.59.192.140]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id A9F0F6ED18 for ; Fri, 15 Feb 2019 15:37:28 +0000 (UTC) (envelope-from freebsd-rwg@pdx.rh.CN85.dnsmgr.net) Received: from pdx.rh.CN85.dnsmgr.net (localhost [127.0.0.1]) by pdx.rh.CN85.dnsmgr.net (8.13.3/8.13.3) with ESMTP id x1FFbOhg091657; Fri, 15 Feb 2019 07:37:24 -0800 (PST) (envelope-from freebsd-rwg@pdx.rh.CN85.dnsmgr.net) Received: (from freebsd-rwg@localhost) by pdx.rh.CN85.dnsmgr.net (8.13.3/8.13.3/Submit) id x1FFbN3I091656; Fri, 15 Feb 2019 07:37:23 -0800 (PST) (envelope-from freebsd-rwg) From: "Rodney W. Grimes" Message-Id: <201902151537.x1FFbN3I091656@pdx.rh.CN85.dnsmgr.net> Subject: Re: Multiple bhyve hosts under Linux KVM In-Reply-To: To: Ilya Sukhoplyuev Date: Fri, 15 Feb 2019 07:37:23 -0800 (PST) CC: "freebsd-virtualization@freebsd.org" X-Mailer: ELM [version 2.4ME+ PL121h (25)] MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII X-Rspamd-Queue-Id: A9F0F6ED18 X-Spamd-Bar: + Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [1.23 / 15.00]; ARC_NA(0.00)[]; TO_DN_EQ_ADDR_SOME(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; NEURAL_SPAM_SHORT(0.25)[0.251,0]; NEURAL_HAM_LONG(-0.52)[-0.522,0]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_LAST(0.00)[]; DMARC_NA(0.00)[dnsmgr.net]; AUTH_NA(1.00)[]; NEURAL_SPAM_MEDIUM(0.62)[0.619,0]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MX_GOOD(-0.01)[cached: pdx.rh.CN85.dnsmgr.net]; RCPT_COUNT_TWO(0.00)[2]; R_SPF_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:13868, ipnet:69.59.192.0/19, country:US]; MID_RHS_MATCH_FROM(0.00)[]; IP_SCORE(-0.01)[ip: (0.02), ipnet: 69.59.192.0/19(0.01), asn: 13868(-0.01), country: US(-0.07)] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 15 Feb 2019 15:37:31 -0000 > Good day, > > I have found the question on the FreeBSD wiki about running bhyve hosts under Linux KVM on the bhyve's wiki: > https://wiki.freebsd.org/bhyve#Q:_Can_I_run_multiple_bhyve_hosts_under_Linux_KVM_with_nested_VT-x_EPT.3F > > During the study work about virtualization I have checked it by repeating the part from FreeBSD handbook: > https://www.freebsd.org/doc/handbook/virtualization-host-bhyve.html . > > I have installed nested FreeBSD 10.3, nested Debian, and run two bhyves host with nested FreeBSD 10.3 simultaneously > Part of that I recorded in the video: https://www.youtube.com/watch?v=yMj4m0gc1_k. > > > In the attachments, there are my study logs. You might be interested in sections "Task 2. KVM nested Bhyve" (details) and "Appendix" (some system fingerprints). > > Sukhoplyuev Ilya > > Content-Description: I_Sukhoplyuev-LIA-Virtual-Machine-Monitors-(Hypervisors).zip Hello, Thank you for informing us of your work, sadly the email system for freebsd.org has stripped your attachments from the mail so we did not receive them. Could you either provide a link to the work, or if not send me a direct email with them attached by replying to this email and I shall have the text placed in the wiki for others to see. Thanks, -- Rod Grimes rgrimes@freebsd.org From owner-freebsd-virtualization@freebsd.org Fri Feb 15 16:45:20 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9F8A914E08FE for ; Fri, 15 Feb 2019 16:45:20 +0000 (UTC) (envelope-from i.sukhoplyuev@innopolis.university) Received: from st01-ex01.innopolis.ru (st01-ex01.innopolis.ru [188.130.155.27]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.innopolis.ru", Issuer "StartCom Class 3 OV Server CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id E73E971835 for ; Fri, 15 Feb 2019 16:45:18 +0000 (UTC) (envelope-from i.sukhoplyuev@innopolis.university) X-Assp-Version: 2.6.1(19007) on ASSPF01DCFBL.res.innopolis.ru X-Assp-ID: ASSPF01DCFBL.res.innopolis.ru m1-49113-44618 X-Assp-Session: 7F2FEE23FA30 (mail 1) X-Assp-Envelope-From: i.sukhoplyuev@innopolis.university X-Assp-Intended-For: freebsd-virtualization@freebsd.org X-Assp-Intended-For: freebsd-rwg@pdx.rh.CN85.dnsmgr.net X-Assp-Server-TLS: yes Content-Language: ru-RU Content-Type: text/plain; charset="koi8-r" Content-Transfer-Encoding: quoted-printable DKIM-Signature: v=1; a=rsa-sha256; d=innopolis.university; s=dkim1; c=simple/simple; t=1550249111; h=from:subject:to:date:message-id; bh=psru/31cXs1GafDnS1imB1dNXMexXp7TEg5orxNvjjI=; b=gP+B+obakrBkxLiL+pOUCUz2sMJ4qAOH7ajndfEPWbsk4aRwn35rrucbV2WoPWS5WH81KR9vzrw uyXhCimby9MZ0qd74JuCZij8RGBHaoA6cNTMVstP26BuMDHO5QYTQAoYIJm9D1RGejmQtdvvwqBG8 tsmC8jDP6Zi6kRkBGW7e/wb9a+YEE/yqcNWnXDXEyx+CzsCdvJJHd6JDRFIL3pAkZdQKuXxzDpO4y o2JlTpgPKTfR5uBL10d9vtO+vDVOYa/dpL3cKrvyzQK1monX+vvak0a9sRryb9WLj+4QH2FNJ5pyF QAQnMptP9HLr35LhCJoA72+A5JulnfkSZS+g== From: Ilya Sukhoplyuev To: "Rodney W. Grimes" CC: "freebsd-virtualization@freebsd.org" Subject: Re: Multiple bhyve hosts under Linux KVM Thread-Topic: Multiple bhyve hosts under Linux KVM Thread-Index: AQHUw9dN34JdUhuF4kqGhvUnPFuFi6XgzreAgAA9bzs= Date: Fri, 15 Feb 2019 16:45:11 +0000 Message-ID: <34a8cc3f1af74335b2dc58efb079bac6@innopolis.university> References: , <201902151537.x1FFbN3I091656@pdx.rh.CN85.dnsmgr.net> In-Reply-To: <201902151537.x1FFbN3I091656@pdx.rh.CN85.dnsmgr.net> Accept-Language: ru-RU, en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: MIME-Version: 1.0 X-Rspamd-Queue-Id: E73E971835 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none (invalid DKIM record) header.d=innopolis.university header.s=dkim1 header.b=gP+B+oba; dmarc=pass (policy=none) header.from=innopolis.university; spf=pass (mx1.freebsd.org: domain of i.sukhoplyuev@innopolis.university designates 188.130.155.27 as permitted sender) smtp.mailfrom=i.sukhoplyuev@innopolis.university X-Spamd-Result: default: False [-3.10 / 15.00]; ARC_NA(0.00)[]; TO_DN_EQ_ADDR_SOME(0.00)[]; NEURAL_HAM_MEDIUM(-0.99)[-0.988,0]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:188.130.155.27]; DMARC_POLICY_ALLOW(-0.50)[innopolis.university,none]; MIME_GOOD(-0.10)[text/plain]; IP_SCORE(0.00)[country: RU(0.00)]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MX_GOOD(-0.01)[cached: mx.innopolis.ru]; DKIM_TRACE(0.00)[innopolis.university:~]; RCVD_IN_DNSWL_NONE(0.00)[27.155.130.188.list.dnswl.org : 127.0.10.0]; NEURAL_HAM_SHORT(-0.31)[-0.307,0]; R_DKIM_PERMFAIL(0.00)[innopolis.university:s=dkim1]; RCPT_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_ZERO(0.00)[0]; ASN(0.00)[asn:203509, ipnet:188.130.155.0/24, country:RU]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 15 Feb 2019 16:45:20 -0000 Hello,=20 > Thank you for informing us of your work, sadly the email system > for freebsd.org has stripped your attachments from the mail so > we did not receive them.=9A Could you either provide a link to the > work, or if not send me a direct email with them attached > by replying to this email and I shall have the text placed in > the wiki for others to see. I have created public clone part of my reports repository:=20 https://github.com/Suhoy95/SNE-reports-2019-public/tree/4-LIA-2-xen-kvm Feel free to use `pandoc` and `pdflatex` to render README.md into pdf with = `make` Sukhoplyuev Ilya= From owner-freebsd-virtualization@freebsd.org Fri Feb 15 22:31:01 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1DD1F14EBDCD for ; Fri, 15 Feb 2019 22:31:01 +0000 (UTC) (envelope-from mingmingzhaodong@163.com) Received: from proxy208-136.mail.163.com (proxy208-136.mail.163.com [123.125.50.74]) by mx1.freebsd.org (Postfix) with ESMTP id BEA1C88E52 for ; Fri, 15 Feb 2019 22:30:58 +0000 (UTC) (envelope-from mingmingzhaodong@163.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=163.com; s=s110527; h=From:Subject:Date:Message-ID:MIME-Version; bh=JfBuq mw70gVAdwtn8rbSC0w5GA6xH8gP8XIeWTdZpdo=; b=pABZ+a0kg5qL5JuBeNOPc hZuf6Y4U2OmoU+ZqoA5+6OSmjezGUfWSt5f2qUGtTIF4Cx7pr2UjGG/DLriTGuJI gTXZpE1dqulQ5lYoEV/PwaOM1sOjUMYGGt58J6ZUaSHI+F2s0+xDCTqWsHzU+AOO PX4s56VIz58hs2Mmx1paJo= Received: from ibxuxyabg.asia (unknown [183.52.130.226]) by smtp8 (Coremail) with SMTP id DMCowACXxIHrOWdcSxbbFw--.38414S2; Sat, 16 Feb 2019 06:15:08 +0800 (CST) Reply-To: sz01@flago2.com From: uunxd To: freebsd-virtualization Subject: Re: China Direct! Banners and Flags - 6:15:07 Date: Sat, 16 Feb 2019 06:14:54 +0800 Message-ID: <00cb610f4b37$147bd20f$6f07309f$@ibxuxyabg.asia> MIME-Version: 1.0 X-CM-TRANSID: DMCowACXxIHrOWdcSxbbFw--.38414S2 X-Coremail-Antispam: 1Uf129KBjvJXoW7Kw43Kw43ZF4kWr4rJr1UKFg_yoW8CFyDpF Wftw17Awn8tr1jyw17Ar48Xa1Yvrn3J3Z8Xr15Cry8Awn8u3Waqr1YgF1rJFyUZayftry0 qrWqqw1UAwn8AaDanT9S1TB71UUUUUUqnTZGkaVYY2UrUUUUjbIjqfuFe4nvWSU5nxnvy2 9KBjDUYxBIdaVFxhVjvjDU0xZFpf9x07UJWrAUUUUU= X-Originating-IP: [183.52.130.226] X-CM-SenderInfo: 5plqwzhlqj6xpdrg00rj6rljoofrz/xtbBLQxcGFO-96JC-gAAsg X-Rspamd-Queue-Id: BEA1C88E52 X-Spamd-Bar: +++++ Authentication-Results: mx1.freebsd.org; dkim=pass header.d=163.com header.s=s110527 header.b=pABZ+a0k; dmarc=pass (policy=none) header.from=163.com; spf=pass (mx1.freebsd.org: domain of mingmingzhaodong@163.com designates 123.125.50.74 as permitted sender) smtp.mailfrom=mingmingzhaodong@163.com X-Spamd-Result: default: False [5.35 / 15.00]; HAS_REPLYTO(0.00)[sz01@flago2.com]; HAS_XOIP(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:123.125.50.0/24]; FREEMAIL_FROM(0.00)[163.com]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[163.com:+]; MIME_BASE64_TEXT(0.10)[]; DMARC_POLICY_ALLOW(-0.50)[163.com,none]; SUBJECT_HAS_EXCLAIM(0.00)[]; MX_GOOD(-0.01)[cached: 163mx00.mxmail.netease.com]; RCVD_NO_TLS_LAST(0.10)[]; RECEIVED_SPAMHAUS_PBL(0.00)[226.130.52.183.zen.spamhaus.org : 127.0.0.11]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+]; FREEMAIL_ENVFROM(0.00)[163.com]; ASN(0.00)[asn:4808, ipnet:123.125.0.0/18, country:CN]; DWL_DNSWL_NONE(0.00)[163.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; FAKE_REPLY(1.00)[]; R_DKIM_ALLOW(-0.20)[163.com:s=s110527]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_SPAM_SHORT(0.95)[0.951,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; REPLYTO_DOM_NEQ_FROM_DOM(0.00)[]; NEURAL_SPAM_MEDIUM(1.00)[0.999,0]; RCPT_COUNT_ONE(0.00)[1]; IP_SCORE(2.23)[ip: (5.91), ipnet: 123.125.0.0/18(2.70), asn: 4808(2.52), country: CN(0.03)]; NEURAL_SPAM_LONG(0.98)[0.981,0]; RCVD_IN_DNSWL_NONE(0.00)[74.50.125.123.list.dnswl.org : 127.0.5.0]; RCVD_COUNT_TWO(0.00)[2] Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 15 Feb 2019 22:31:01 -0000 DQpIaSxXaXNoIHlvdSBoYXZlIGEgbmljZSBkYXk6KSBJIGFtIGRvaW5nIHNvbWUgcmVzZWFyY2gg b24geW91ciBjb21wYW55IGFuZCBmaW5kIHRoZSBmb2xsb3dpbmcgdHJhZGUgc2hvdyBkaXNwbGF5 cywgYmFubmVycyBhbmQgZmxhZ3Mgd291bGQgYmUgZ3JlYXQgZm9yIHlvdXJzLg0KDQpPdXIgUHJv ZHVjdHM6DQoxLk1PUTogMXBjcyANCjIuQ3VzdG9taXplZCBzaXplIGFuZCBzaGFwZSANCjMuRmFz dCBkZWxpdmVyeTogYXJvdW5kIDMtNWRheXMgDQo0LkZhY3RvcnkgZGlyZWN0IGV4cG9ydCB3aXRo IGNvbXBldGl0aXZlIHByaWNlIGFuZCBxdWFsaXR5IGd1YXJhbnRlZWQNCg0KSG9wZWZ1bGx5ISBU aGVyZSBpcyBhbiBvcHBvcnR1bml0eSBlc3RhYmxpc2hpbmcgYnVzaW5lc3MgcmVsYXRpb24gd2l0 aCB5b3UuDQoNCkZvciBtb3JlIGluZm9tYXRpb24sIFBscyBmZWVsIGZyZWUgdG8gY29udGFjdCB3 aXRoIHN6MDFAZmxhZ28yLmNvbQ0KDQoNCiANCg0KSWYgeW91J3JlIG5vdCBpbnRlcmVzdCBPdXIg SGFuZ2luZyBCYW5uZXJzIHBsZWFzZSBjbGljayBVbnN1YnNjcmliZSBUaGFua3MuICANCg0KIA0K DQogDQoNCiANCg0KDQoNCg0KIA0KDQoNCg0KDQoNCg0KDQogDQoNCi0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tDQoNClNoZSBub2RkZWQuIA0K 44CA44CAIkF0IHRoZSBtb3N0LCBzaXggaG91cnMuIiJUaGlyZCBCcm90aGVyLCBsZXQncyBnbyBh bmQgZ2V0IHRoYXQgZmVsbG93IG92ZXIgaGVyZWFuZCBmb3JjZSBoaW0gdG8gZGVsaXZlciB0aGUg YW50aWRvdGUuIlpoYW8gbGVhcHQgaW4gdGhyZWUgZ3JlYXQgYm91bmRzIG92ZXIgdG8gdGhlIGJv YXQgaW53aGljaCBDaGVuIGFuZCBRaWFuIExvbmcgd2VyZSBzaXR0aW5nLCB3aXRoIGVhY2ggYm91 bmR0b3VjaGluZyBkb3duIG9uIHRoZSBkZWNrIG9mIGEgZGlmZmVyZW50IGJvYXQuIA0KIkhlcmUg YXJlIHRoZSBtYXJrZXQgcmVwb3J0cywiIGhlIGdyb3dsZWQsICJ0aGV5IGFyZSBub3QgdmVyeSBl bmNvdXJhZ2luZy4iIA0KVGhlIHdob2xlIGFmZmFpciB3YXMgc28gc3VkZGVuLCB0aGF0IHRoZXNl IHZlcnkgY291bnR5IGZhbWlsaWVzIGhhZCBzY2FyY2VseSByZWNvdmVyZWQgZnJvbSB0aGVpciBz dXJwcmlzZSBhdCByZWFkaW5nIGEgY2VydGFpbiBwYXJhZ3JhcGggaW4gdGhlIGxlZnQtaGFuZCBj b2x1bW4gb2YgdGhlIFRpbWVzLCBhbm5vdW5jaW5nIHRoZSBtYXJyaWFnZSBvZiAiQXJjaGliYWxk IE1hcnRpbiBGbG95ZCwgQmFua2VyLCBvZiBMb21iYXJkIHN0cmVldCBhbmQgRmVsZGVuIFdvb2Rz LCB0byBFbGl6YSwgb25seSBzdXJ2aXZpbmcgZGF1Z2h0ZXIgb2YgQ2FwdGFpbiBQcm9kZGVyLCIg d2hlbiB0aGUgYnJpZGVncm9vbSZyc3F1bztzIHRyYXZlbGxpbmcgY2FycmlhZ2UgZGFzaGVkIHBh c3QgdGhlIEdvdGhpYyBsb2RnZSBhdCB0aGUgZ2F0ZXMsIGFsb25nIHRoZSBhdmVudWUgYW5kIHVu ZGVyIHRoZSBncmVhdCBzdG9uZSBwb3J0aWNvIGF0IHRoZSBzaWRlIG9mIHRoZSBob3VzZSwgYW5k IEVsaXphIEZsb3lkIGVudGVyZWQgdGhlIGJhbmtlciZyc3F1bztzIG1hbnNpb24sIG5vZGRpbmcg Z29vZC1uYXR1cmVkbHkgdG8gdGhlIGJld2lsZGVyZWQgc2VydmFudHMsIG1hcnNoYWxsZWQgaW50 byB0aGUgaGFsbCB0byByZWNlaXZlIHRoZWlyIG5ldyBtaXN0cmVzcy4gDQpTaGUgZGlzbWlzc2Vk IHRoZSBtYXR0ZXIgZnJvbSBoZXIgbWluZCwgYW5kIHRob3VnaHQgbm8gbW9yZSBvZiBpdCB1bnRp bCBzaGUgc3RvcHBlZCBvbiBoZXIgd2F5IHRvIHRoZSB0aGVhdHJlIHRvIGxlYXJuIGZyb20gdGhl IG9mZmljZSBieSB0ZWxlcGhvbmUgdGhlIG51bWJlciBvZiBkcmF3aW5ncyByZXF1aXJlZC4gDQo= From owner-freebsd-virtualization@freebsd.org Fri Feb 15 23:48:24 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 504C214EDFC1 for ; Fri, 15 Feb 2019 23:48:24 +0000 (UTC) (envelope-from stb@lassitu.de) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 475538C2E4 for ; Fri, 15 Feb 2019 23:48:23 +0000 (UTC) (envelope-from stb@lassitu.de) Received: by mailman.ysv.freebsd.org (Postfix) id 07BFE14EDFBF; Fri, 15 Feb 2019 23:48:23 +0000 (UTC) Delivered-To: virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E97E014EDFBE for ; Fri, 15 Feb 2019 23:48:22 +0000 (UTC) (envelope-from stb@lassitu.de) Received: from gilb.zs64.net (gilb.zs64.net [IPv6:2a00:14b0:4200:32e0::1ea]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "gilb.zs64.net", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 88BF48C2E3 for ; Fri, 15 Feb 2019 23:48:22 +0000 (UTC) (envelope-from stb@lassitu.de) Received: by gilb.zs64.net (Postfix, from stb@lassitu.de) id 92B431F1F4F; Fri, 15 Feb 2019 23:48:19 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 12.2 \(3445.102.3\)) Subject: Re: NVMe and Bhyve From: Stefan Bethke In-Reply-To: <20190215044134.GA52633@admin.sibptus.ru> Date: Sat, 16 Feb 2019 00:48:17 +0100 Cc: "freebsd-virtualization@freebsd.org" Content-Transfer-Encoding: quoted-printable Message-Id: References: <20190207174453.Horde.hWBGfoLlymCpipxLv8WUJo9@app.eeeit.de> <5121268a-1ead-9858-86a7-27f75048feb2@yuripv.net> <20190212084333.GA46685@admin.sibptus.ru> <20190212130506.GA62989@admin.sibptus.ru> <20190215044134.GA52633@admin.sibptus.ru> To: Victor Sudakov X-Mailer: Apple Mail (2.3445.102.3) X-Rspamd-Queue-Id: 88BF48C2E3 X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-6.97 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-0.999,0]; NEURAL_HAM_SHORT(-0.97)[-0.972,0]; REPLY(-4.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 15 Feb 2019 23:48:24 -0000 > Am 15.02.2019 um 05:41 schrieb Victor Sudakov : >=20 > Jason Tubnor wrote: >>=20 >>> If you have Nvme devices or you want store disks in ram yes, = otherwise no. >>>=20 >>>>=20 >>>> Is it worth it? I mean upgrading from 11.2-RELEASE to 12.0-RELEASE = for >>>> the sake of nvme, is it useful for running FreeBSD, Linux (Mint, >>>> Centos) and Windows10 guests? >>>>=20 >>=20 >>=20 >> Or if you are using good SLOG and ARC for your VM zvols. >>=20 >> I'm still sorting out some Windows issues with the bhyve nvme = presentation >> for a variety of guest (except freebsd, that works fine) at the = moment. I >> would avoid 12.0-RELEASE as it may introduce other issues with your >=20 > I was just worried that using ahci-hd instead of paravirtualized disks > causes suboptimal performance of guests. Do you think there is a hope = to get > paravirtualized disks support for Windows guests in bhyve? I was under the impression that the Windows VirtIO disk driver works = with the Bhyve virtio-blk device. You need to provide these drivers to = Windows somehow (for example, as a second CD image during installation): = https://www.linux-kvm.org/page/WindowsGuestDrivers/Download_Drivers Stefan --=20 Stefan Bethke Fon +49 151 14070811 From owner-freebsd-virtualization@freebsd.org Sat Feb 16 04:11:38 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 28A1B14D021D for ; Sat, 16 Feb 2019 04:11:38 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 9B1EE7070A for ; Sat, 16 Feb 2019 04:11:37 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) Received: by mailman.ysv.freebsd.org (Postfix) id 594EB14D0217; Sat, 16 Feb 2019 04:11:37 +0000 (UTC) Delivered-To: virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4716A14D0216 for ; Sat, 16 Feb 2019 04:11:37 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) Received: from admin.sibptus.ru (admin.sibptus.ru [IPv6:2001:19f0:5001:21dc::10]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id C741F70705 for ; Sat, 16 Feb 2019 04:11:35 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=sibptus.ru; s=20181118; h=In-Reply-To:Message-ID:Subject:To:From:Date; bh=qEvbgkmFulA8R6ocdeBfWP4nDdHslRA2BRR96qFKGZI=; b=UHd2TkFaSYVWqKJ1LD3ZkSLrbP hakMJjraxsGWa+yDgK/OuqOPOUGm7hGWqZAqcpmXjMG7mYNAhoAvFwtmzHlQUsiZouAOYZzVjiLbY 4jQxsW1EO3Djq3v3EW9DAI1kDDyuk8B/PbuYd8ief6gzH7x0hs9oatmY5Sfma75VyZ9w=; Received: from vas by admin.sibptus.ru with local (Exim 4.91 (FreeBSD)) (envelope-from ) id 1gurKA-000JeB-66 for virtualization@freebsd.org; Sat, 16 Feb 2019 11:11:34 +0700 Date: Sat, 16 Feb 2019 11:11:34 +0700 From: Victor Sudakov To: "freebsd-virtualization@freebsd.org" Subject: Re: NVMe and Bhyve Message-ID: <20190216041134.GA75357@admin.sibptus.ru> References: <20190207174453.Horde.hWBGfoLlymCpipxLv8WUJo9@app.eeeit.de> <5121268a-1ead-9858-86a7-27f75048feb2@yuripv.net> <20190212084333.GA46685@admin.sibptus.ru> <20190212130506.GA62989@admin.sibptus.ru> <20190215044134.GA52633@admin.sibptus.ru> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="oyUTqETQ0mS9luUI" Content-Disposition: inline In-Reply-To: X-PGP-Key: http://www.dreamwidth.org/pubkey?user=victor_sudakov X-PGP-Fingerprint: 10E3 1171 1273 E007 C2E9 3532 0DA4 F259 9B5E C634 User-Agent: Mutt/1.10.1 (2018-07-13) Sender: Victor Sudakov X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 16 Feb 2019 04:11:38 -0000 --oyUTqETQ0mS9luUI Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Stefan Bethke wrote: > >=20 > > I was just worried that using ahci-hd instead of paravirtualized disks > > causes suboptimal performance of guests. Do you think there is a hope t= o get > > paravirtualized disks support for Windows guests in bhyve? >=20 > I was under the impression that the Windows VirtIO disk driver works > with the Bhyve virtio-blk device. You need to provide these drivers to > Windows somehow (for example, as a second CD image during > installation): > https://www.linux-kvm.org/page/WindowsGuestDrivers/Download_Drivers I use NetKVM (VirtIO network) driver from there all the time, because e1000 is bad. However, I've read a number of bhyve resources including https://wiki.freebsd.org/bhyve/Windows and I've never found a success story with paravirtualized Windows disk drivers.=20 If anyone has been successful with viostor(?), please share your experience. I would be especially grateful for instruction how to install Windows on a viostor disk instead of ahci-hd. --=20 Victor Sudakov, VAS4-RIPE, VAS47-RIPN 2:5005/49@fidonet http://vas.tomsk.ru/ --oyUTqETQ0mS9luUI Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQEcBAEBAgAGBQJcZ412AAoJEA2k8lmbXsY0iIMIALuf3LbEuF6n7ACCfsP131UU vytRT3uzErgdO6gmdCyNeRVfetQzKxH4NAYD4A/IjGyqVDGLcuoneFbauY+Q30B7 INI0zC3v8Nbjcg+qcvirNxSbSODUVfeHZcMP+1TZKzOysGhxi3tK2psEKihZuF6d 7jnCKuSz0DoRtmL5SE20EWeeN4lf/jfDKHL9dY/5+/g10tR1EzW+6JCrCqXa281X 3YWj5j7jAIDUfvccJCbl+Y9/9JGbAmM4t+OYJcBdwfh4iLzAqfHnKXfCA0BLWfhg brO9x3xCbmh2z+sCajnSh6gIC18s9VfEkF0nRK2CfmASgCemUP3mUcEUWcuw1ko= =qtee -----END PGP SIGNATURE----- --oyUTqETQ0mS9luUI-- From owner-freebsd-virtualization@freebsd.org Sat Feb 16 12:39:12 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id AE4E014E3D01 for ; Sat, 16 Feb 2019 12:39:12 +0000 (UTC) (envelope-from doctor@doctor.nl2k.ab.ca) Received: from doctor.nl2k.ab.ca (doctor.nl2k.ab.ca [204.209.81.1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 00E3088DE3 for ; Sat, 16 Feb 2019 12:39:12 +0000 (UTC) (envelope-from doctor@doctor.nl2k.ab.ca) Received: from doctor by doctor.nl2k.ab.ca with local (Exim 4.92 (FreeBSD)) (envelope-from ) id 1guzFD-0007Dq-GL for freebsd-virtualization@freebsd.org; Sat, 16 Feb 2019 05:38:59 -0700 Date: Sat, 16 Feb 2019 05:38:59 -0700 From: The Doctor To: freebsd-virtualization@freebsd.org Subject: Windows 2019 server Message-ID: <20190216123859.GA24315@doctor.nl2k.ab.ca> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.11.2 (2019-01-07) X-Rspamd-Queue-Id: 00E3088DE3 X-Spamd-Bar: +++ X-Spamd-Result: default: False [3.33 / 15.00]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+a]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; NEURAL_SPAM_MEDIUM(0.75)[0.752,0]; RCPT_COUNT_ONE(0.00)[1]; RCVD_TLS_LAST(0.00)[]; NEURAL_SPAM_SHORT(0.86)[0.858,0]; MX_GOOD(-0.01)[cached: doctor.nl2k.ab.ca]; DMARC_POLICY_ALLOW(-0.50)[nl2k.ab.ca,quarantine]; NEURAL_SPAM_LONG(0.55)[0.546,0]; INTRODUCTION(2.00)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:6171, ipnet:204.209.81.0/24, country:CA]; MID_RHS_MATCH_FROM(0.00)[]; IP_SCORE(-0.02)[country: CA(-0.09)]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 16 Feb 2019 12:39:12 -0000 Anyone got Windows 2019 server running in bhyve ? -- Member - Liberal International This is doctor@@nl2k.ab.ca Ici doctor@@nl2k.ab.ca Yahweh, Queen & country!Never Satan President Republic!Beware AntiChrist rising! https://www.empire.kred/ROOTNK?t=94a1f39b Look at Psalms 14 and 53 on Atheism Do not consider painful what is good for you. -Euripides