From owner-freebsd-virtualization@freebsd.org Sun Jan 21 00:06:10 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DBDADECF66C for ; Sun, 21 Jan 2018 00:06:10 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id B4435715A4 for ; Sun, 21 Jan 2018 00:06:10 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: from reviews.nyi.freebsd.org (reviews.nyi.freebsd.org [IPv6:2610:1c1:1:607c::16:b]) by mxrelay.nyi.freebsd.org (Postfix) with ESMTP id 479AF23834 for ; Sun, 21 Jan 2018 00:06:09 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: by reviews.nyi.freebsd.org (Postfix, from userid 1346) id 46971C558C; Sun, 21 Jan 2018 00:06:09 +0000 (UTC) Date: Sun, 21 Jan 2018 00:06:09 +0000 To: freebsd-virtualization@freebsd.org From: "grehan (Peter Grehan)" Reply-to: D13995+333+f248ba92bf0c9c79@reviews.freebsd.org Subject: [Differential] D13995: NVMe controller emulator for bhyve. Message-ID: X-Priority: 3 X-Phabricator-Sent-This-Message: Yes X-Mail-Transport-Agent: MetaMTA X-Auto-Response-Suppress: All X-Phabricator-Mail-Tags: Thread-Topic: D13995: NVMe controller emulator for bhyve. X-Herald-Rules: <95> X-Phabricator-Projects: <#bhyve> X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: Precedence: bulk In-Reply-To: References: Thread-Index: ZGM1NGRjZmQzNjRiMjY5OGVhNjhmY2UxNzhjIFpj2XE= MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Type: text/plain; charset="utf-8" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 21 Jan 2018 00:06:11 -0000 Z3JlaGFuIGFkZGVkIGEgY29tbWVudC4KCgogIExlb24gRGFuZyBoYXMgYWxzbyBiZWVuIHdvcmtp bmcgb24gTlZNZSBlbXVsYXRpb24sIGFuZCBoaXMgdmVyc2lvbiB3b3JrcyB3aXRoIExpbnV4LCBX aW5kb3dzIGFuZCBVRUZJIGJvb3QuIEknbGwgcG9zdCB0aGF0IGNvZGUgZm9yIHJldmlldyBzaW5j ZSBpdCBpcyBhIGJpdCBtb3JlIHJlY2VudCBhbmQgdGVzdGVkLiBJbiB0aGUgbWVhbnRpbWUsIHRo YXQgdmVyc2lvbiBjYW4gYmUgc2VlbiBhdCB3d3cuZnJlZWJzZC5vcmcvfmdyZWhhbi9wY2lfbnZt ZS5jCiAgCiAgKFRoZXJlIGlzIGFsc28gYSB2ZXJzaW9uIG9mIFVFRkkgd2l0aCBOVk1lIHN1cHBv cnQgY29tcGlsZWQgaW4gYXQgd3d3LmZyZWVic2Qub3JnL35ncmVoYW4vQkhZVkVfTlZNZS5mZC54 eiApCgpSRVZJU0lPTiBERVRBSUwKICBodHRwczovL3Jldmlld3MuZnJlZWJzZC5vcmcvRDEzOTk1 CgpFTUFJTCBQUkVGRVJFTkNFUwogIGh0dHBzOi8vcmV2aWV3cy5mcmVlYnNkLm9yZy9zZXR0aW5n cy9wYW5lbC9lbWFpbHByZWZlcmVuY2VzLwoKVG86IHN1eDJtZmdqX2dtYWlsLmNvbSwgZ3JlaGFu LCB0cmFzeiwgaW1wCkNjOiByZ3JpbWVzLCBjZW0sIGZyZWVic2QtdmlydHVhbGl6YXRpb24tbGlz dCwgY2h1Y2sK From owner-freebsd-virtualization@freebsd.org Mon Jan 22 14:54:44 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 736EEEC4B49 for ; Mon, 22 Jan 2018 14:54:44 +0000 (UTC) (envelope-from freebsd@omnilan.de) Received: from mx0.gentlemail.de (mx0.gentlemail.de [IPv6:2a00:e10:2800::a130]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 112757F1E9; Mon, 22 Jan 2018 14:54:43 +0000 (UTC) (envelope-from freebsd@omnilan.de) Received: from mh0.gentlemail.de (mh0.gentlemail.de [IPv6:2a00:e10:2800::a135]) by mx0.gentlemail.de (8.14.5/8.14.5) with ESMTP id w0MEsbA8009747; Mon, 22 Jan 2018 15:54:38 +0100 (CET) (envelope-from freebsd@omnilan.de) Received: from titan.inop.mo1.omnilan.net (s1.omnilan.de [217.91.127.234]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mh0.gentlemail.de (Postfix) with ESMTPSA id 80445EED; Mon, 22 Jan 2018 15:54:37 +0100 (CET) Message-ID: <5A65FB2D.7010908@omnilan.de> Date: Mon, 22 Jan 2018 15:54:37 +0100 From: Harry Schmalzbauer Organization: OmniLAN User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; de-DE; rv:1.9.2.8) Gecko/20100906 Lightning/1.0b2 Thunderbird/3.1.2 MIME-Version: 1.0 To: Peter Grehan CC: Mario Lobo , freebsd-virtualization@freebsd.org Subject: Re: Bhyve passthrough problems References: <20180117202250.6ef90c6d@Papi.lobos> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 8bit X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.2.7 (mx0.gentlemail.de [IPv6:2a00:e10:2800::a130]); Mon, 22 Jan 2018 15:54:39 +0100 (CET) X-Milter: Spamilter (Reciever: mx0.gentlemail.de; Sender-ip: ; Sender-helo: mh0.gentlemail.de; ) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 22 Jan 2018 14:54:44 -0000 Bezüglich Peter Grehan's Nachricht vom 18.01.2018 09:58 (localtime): > Hi Mario, > >> I'm trying to passthrough a firewire pci card to a windows 7 64 guest. > > First, you'll need to verify if that card supports MSI or MSI-x since > that is required by bhyve for passthru support. This can be seen with > 'pciconf -lbc' on the FreeBSD host. > >> VM exits with: >> >> Assertion failed: (mr->name == memp->name), function >> unregister_mem, file /usr/src/usr.sbin/bhyve/mem.c, line 265. >> Abort trap > > This is bug in bhyve when running Windows with PCI devices that have > more than 1 memory BAR (e.g. Intel igb ethernet devices), due to the > order that Windows determines BAR sizes. I've been meaning to fix this > for a long time so will try and get to it. Thanks in advance, Peter! Inderictly related, but also a big improvement for bhyve, could you have a minute on that too: https://lists.freebsd.org/pipermail/freebsd-virtualization/2017-November/005875.html Thanks, -harry From owner-freebsd-virtualization@freebsd.org Mon Jan 22 15:45:13 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 06DCDEC71E9; Mon, 22 Jan 2018 15:45:13 +0000 (UTC) (envelope-from tech-lists@zyxst.net) Received: from out3-smtp.messagingengine.com (out3-smtp.messagingengine.com [66.111.4.27]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id CB4C480F37; Mon, 22 Jan 2018 15:45:12 +0000 (UTC) (envelope-from tech-lists@zyxst.net) Received: from compute4.internal (compute4.nyi.internal [10.202.2.44]) by mailout.nyi.internal (Postfix) with ESMTP id 1B21B20F9A; Mon, 22 Jan 2018 10:45:11 -0500 (EST) Received: from frontend2 ([10.202.2.161]) by compute4.internal (MEProxy); Mon, 22 Jan 2018 10:45:11 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=zyxst.net; h=cc :content-transfer-encoding:content-type:date:from:message-id :mime-version:subject:to:x-me-sender:x-me-sender:x-sasl-enc; s= fm1; bh=++56bBjUYlYN2mdpdkK8MPpgxRZ1iRuq+sz+3b6guKw=; b=ILlFb59B 1XOQcT84RW3XrGref8swEiOZv7eK+VWVBlMq4WOjPGBJ6LpW0Os19k/VBjVQMfhU bx8x3so47y24C09yyQtyhNB2MJd1QReJDF2KeyXrOK160W/tzyCPo3FJv0lJ0ovC UZ+x5jnQ/45B8uLxHnTQE4SZ3xmUAH7gD49hSBOj62NJTvAsoLGogdfQ9MBW7igf dkST1IJAgwnn1mlZFYk4A5pZeyowRWgxxI3z6SY1FVYZ9ba0iRtgZWun9i4REvxA Xfeb63eQW+yvrH+oumFunysWP4uv4VYAgiwPHUP0JFdsbRmKcL67PXg/JsYJWtXh FXeqh6IG95TJhQ== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-transfer-encoding:content-type :date:from:message-id:mime-version:subject:to:x-me-sender :x-me-sender:x-sasl-enc; s=fm1; bh=++56bBjUYlYN2mdpdkK8MPpgxRZ1i Ruq+sz+3b6guKw=; b=H8aej3PGHq6yfdJvDH5HN03NU9RyKpn8XMgUOGykUpeSI 3x8mjwNXZqSXt9LN1aPUt8xjaHyVrO9xPhB3b0S6dAUbGy/0SWx7bQuz1/mJaf+s oBVttyKXtOAMpg1WbwgLEumjcThUu81voEvjaXTMTxgObAKyqwJ3cKWwyLRD97em 8+fP7cnoOMsyvzYoxTGs0MwxUlMCeeh1SwpvNGchyv/zycskCHxDu3sLdFiLrqsg xsTMuZvSSZBmY8VEVLe+R7Dsb8ymEVsxn9LLMmH2AQ/KUKw5kk34E1agmjjOJoZt rvV1+zwXb3If3UnEs4I0KD5r1Y3ATMFfJPC3VBp3w== X-ME-Sender: Received: from desktop.parsley.growveg.org (parsley.growveg.org [82.70.91.97]) by mail.messagingengine.com (Postfix) with ESMTPA id 8AEB6247A9; Mon, 22 Jan 2018 10:45:10 -0500 (EST) To: freebsd-virtualization@freebsd.org From: tech-lists Subject: syncing bhyve instances Cc: freebsd-questions@freebsd.org Message-ID: Date: Mon, 22 Jan 2018 15:45:09 +0000 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:52.0) Gecko/20100101 Thunderbird/52.5.2 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Language: en-GB Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 22 Jan 2018 15:45:13 -0000 Hello lists, If I have two bhyve hosts, production [p] and reserve [r], and on both there are identical guest[s] [1] and [2], what is the best way to sync the guests? What's the best tool? 1. would syncing the guests from the host work? (in other words, running some kind of tool like say rsync on the host work?). What about the internal state of the guest? Could rsync account for changes in its internal state? 2. or would it be better to run a tool like rsync inside each guest? 3. is there a better tool for this than rsync? thanks, -- J. From owner-freebsd-virtualization@freebsd.org Mon Jan 22 16:01:12 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 14138EC7F97 for ; Mon, 22 Jan 2018 16:01:12 +0000 (UTC) (envelope-from jason@corrupted.io) Received: from out3-smtp.messagingengine.com (out3-smtp.messagingengine.com [66.111.4.27]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id D3B91825D1 for ; Mon, 22 Jan 2018 16:01:11 +0000 (UTC) (envelope-from jason@corrupted.io) Received: from compute6.internal (compute6.nyi.internal [10.202.2.46]) by mailout.nyi.internal (Postfix) with ESMTP id 1EFB921007 for ; Mon, 22 Jan 2018 11:01:10 -0500 (EST) Received: from web4 ([10.202.2.214]) by compute6.internal (MEProxy); Mon, 22 Jan 2018 11:01:10 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=corrupted.io; h= content-transfer-encoding:content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to:x-me-sender :x-me-sender:x-sasl-enc; s=mesmtp; bh=m5fqSY1Gx+VJYtxA+5rbaB1BEe CD9Dx+pmRgv3L/9bU=; b=spS3jUVkkHBLhTmoKlOhx8RdWLNgS1qBldm5C2zPS0 H4hgbuktEFH+x/K5ntjM9ZRawCfo2rRLe7CAlnR++UWKllBMwbljKhN1OBALRnou 2Sg9ygcNuEYNcGCsAUlIl9+4h/0NMu/9urbupGfD7cK4luptHWsaZPpRWcEYF9SL U= DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-transfer-encoding:content-type :date:from:in-reply-to:message-id:mime-version:references :subject:to:x-me-sender:x-me-sender:x-sasl-enc; s=fm1; bh=m5fqSY 1Gx+VJYtxA+5rbaB1BEeCD9Dx+pmRgv3L/9bU=; b=ouJ6/LviHYw32cqwFg4BFx hX3z4CvmTyEMxNOYR4UPgc00kx/90oLirMeeZgSRbfm9RlejDzasJblyJFsoPp8j vIXcbD1fOyzJnLHLfBlp4K9LYJstjyItzY8oHz5Ibn+zkfZJmaasOCF4JIC0vW0w 1uugTIxk3Flo6Ulrf0r/NqJyGhOfau9u+3TLHce2lSXOBxrn0pF9HfMki8PL5cRO ZUYRJEZgpoZMxfWXgQ7VfXKfz/v7yRHfZOal4eBWsVrEed+y1M3/38iz4dRmr7rA UJN8mrE9dN+7VKYEpSbBWnBA0Zca/AVg1ZriGekOHf+ZTiYWLCjcg+0EjZ7rVS5A == X-ME-Sender: Received: by mailuser.nyi.internal (Postfix, from userid 99) id F1138BA1AC; Mon, 22 Jan 2018 11:01:09 -0500 (EST) Message-Id: <1516636869.1772621.1243946728.02042214@webmail.messagingengine.com> From: Jason Barbier To: freebsd-virtualization@freebsd.org MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset="utf-8" X-Mailer: MessagingEngine.com Webmail Interface - ajax-75de3051 In-Reply-To: Subject: Re: syncing bhyve instances References: Date: Mon, 22 Jan 2018 08:01:09 -0800 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 22 Jan 2018 16:01:12 -0000 Assuming you wanted sync and not just a shared volume the guest/host running rsync to push/pull would work the best. But to be totally honest what I do right now to allow guests access to stuff on the host file system is just CIFS/SMB shares. It would probably be better to do NFS shares but I have a few windows guests that don't play nice with NFS. There is a bit of future work here though where someone could make some guest utils and stand up a file system bridge. There is some demand there and honestly it could be as simple as what virtualbox does where it provides a CIFS/SMB share through a local pipe. Whatever the solution is there I would lean more toward CIFS/SMB since it does have better cross-platform compatibility. --- Jason Barbier | E: jason@corrupted.io GPG: 0x40B8FA1D72EF0D89 (https://keybase.io/kusuriya) On Mon, Jan 22, 2018, at 7:45 AM, tech-lists wrote: > Hello lists, > > If I have two bhyve hosts, production [p] and reserve [r], and on both > there are identical guest[s] [1] and [2], what is the best way to sync > the guests? What's the best tool? > > 1. would syncing the guests from the host work? (in other words, running > some kind of tool like say rsync on the host work?). What about the > internal state of the guest? Could rsync account for changes in its > internal state? > > 2. or would it be better to run a tool like rsync inside each guest? > > 3. is there a better tool for this than rsync? > > thanks, > -- > J. > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to "freebsd-virtualization- > unsubscribe@freebsd.org" From owner-freebsd-virtualization@freebsd.org Mon Jan 22 16:12:27 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6AA5DEC8718; Mon, 22 Jan 2018 16:12:27 +0000 (UTC) (envelope-from SRS0=8YYm=ER=quip.cz=000.fbsd@elsa.codelab.cz) Received: from elsa.codelab.cz (elsa.codelab.cz [94.124.105.4]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 2F43982DA8; Mon, 22 Jan 2018 16:12:26 +0000 (UTC) (envelope-from SRS0=8YYm=ER=quip.cz=000.fbsd@elsa.codelab.cz) Received: from elsa.codelab.cz (localhost [127.0.0.1]) by elsa.codelab.cz (Postfix) with ESMTP id DCA2028416; Mon, 22 Jan 2018 17:12:17 +0100 (CET) Received: from illbsd.quip.test (ip-86-49-16-209.net.upcbroadband.cz [86.49.16.209]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by elsa.codelab.cz (Postfix) with ESMTPSA id 22CDB2840C; Mon, 22 Jan 2018 17:12:14 +0100 (CET) Subject: Re: syncing bhyve instances To: tech-lists , freebsd-virtualization@freebsd.org Cc: freebsd-questions@freebsd.org References: From: Miroslav Lachman <000.fbsd@quip.cz> Message-ID: Date: Mon, 22 Jan 2018 17:12:13 +0100 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:52.0) Gecko/20100101 Firefox/52.0 SeaMonkey/2.49.1 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 22 Jan 2018 16:12:27 -0000 tech-lists wrote on 2018/01/22 16:45: > Hello lists, > > If I have two bhyve hosts, production [p] and reserve [r], and on both > there are identical guest[s] [1] and [2], what is the best way to sync > the guests? What's the best tool? > > 1. would syncing the guests from the host work? (in other words, running > some kind of tool like say rsync on the host work?). What about the > internal state of the guest? Could rsync account for changes in its > internal state? > > 2. or would it be better to run a tool like rsync inside each guest? > > 3. is there a better tool for this than rsync? It is too vague question. But if you just want poor mans replication I would go with ZFS (send + receive) from host p to r in few minutes intervals. Of course it will not help you with internal states of running VMs. It will just sync filesystems in better way than rsync. (if you have ZFS) Miroslav Lachman From owner-freebsd-virtualization@freebsd.org Mon Jan 22 16:38:30 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 25F56EC9777 for ; Mon, 22 Jan 2018 16:38:30 +0000 (UTC) (envelope-from paul@redbarn.org) Received: from family.redbarn.org (family.redbarn.org [IPv6:2001:559:8000:cd::5]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 1609383A9E for ; Mon, 22 Jan 2018 16:38:29 +0000 (UTC) (envelope-from paul@redbarn.org) Received: from [IPv6:2001:559:8000:c9:25:18f3:ab89:c46d] (unknown [IPv6:2001:559:8000:c9:25:18f3:ab89:c46d]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by family.redbarn.org (Postfix) with ESMTPSA id 0FF7D7594C for ; Mon, 22 Jan 2018 16:38:23 +0000 (UTC) Message-ID: <5A66137D.5090608@redbarn.org> Date: Mon, 22 Jan 2018 08:38:21 -0800 From: Paul Vixie User-Agent: Postbox 5.0.22 (Windows/20171208) MIME-Version: 1.0 To: freebsd-virtualization@freebsd.org Subject: Re: syncing bhyve instances References: In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 22 Jan 2018 16:38:30 -0000 i've used zfs for this, but i have to shut the guest down to do it. i'm using zvols for my guest system disks, so it's shut the guest down (maybe just to single-user mode) make a zfs checkpoint start the guest back up zfs send the checkpoint this also assumes that the sync-destination is a cold spare, sitting in its shutdown state until needed. for live sync you'll have to run software inside the guest that knows how to properly freeze state. for example if there's a live database of any kind you'll want it to be in its quiet state before you sync from it. in those situations, i do use rsync. bhyve could conceivably offer a feature to export the guest RAM, and with a little page-stealing, this could be made into an incremental sync feed. but i predict it would be enormous in size for any non-trivial guest. From owner-freebsd-virtualization@freebsd.org Mon Jan 22 19:47:21 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2CAC7ED2215 for ; Mon, 22 Jan 2018 19:47:21 +0000 (UTC) (envelope-from tech-lists@zyxst.net) Received: from out3-smtp.messagingengine.com (out3-smtp.messagingengine.com [66.111.4.27]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id EFBFF6B350 for ; Mon, 22 Jan 2018 19:47:20 +0000 (UTC) (envelope-from tech-lists@zyxst.net) Received: from compute4.internal (compute4.nyi.internal [10.202.2.44]) by mailout.nyi.internal (Postfix) with ESMTP id B87D620FC0 for ; Mon, 22 Jan 2018 14:47:18 -0500 (EST) Received: from frontend2 ([10.202.2.161]) by compute4.internal (MEProxy); Mon, 22 Jan 2018 14:47:18 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=zyxst.net; h= content-transfer-encoding:content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to:x-me-sender :x-me-sender:x-sasl-enc; s=fm1; bh=SuUgQclq7JMvE+pv+Ug7hWpsj3LSc iMIgfVUXAK1QiE=; b=Jjg8veXGexanepk6G6dh6NOJLKTdLU6bQLWNrY+7sfQ4A dkBWja5gDYZtF8w3K+Oec0oFlh1kmUrGtfLKhrd9ZFgcMSPom23v3EvPA26QwNH5 9F9uCnL0QJh1vS4ksPTUxZ1Ywh1SlDeypGqdGVstyGDc/+xU+ltVqdZv4S1pEAZS q1ptXgGXKljPF5cKOFjxuYjjfZ7syFkB2nTsogEpcrCC78awyEZbldKfYaz6uS/0 wUASeUi0CWD4nxjvfr8gZIevhf3OL556VQUmhjGgxsKhgH+HV2ZnFWI+6TRJW7rK SN3VCYEw+9UXCoAqu7NYi8hkKXOROcWhQ4XRoBnRA== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-transfer-encoding:content-type :date:from:in-reply-to:message-id:mime-version:references :subject:to:x-me-sender:x-me-sender:x-sasl-enc; s=fm1; bh=SuUgQc lq7JMvE+pv+Ug7hWpsj3LSciMIgfVUXAK1QiE=; b=fQ8Nml+mm9DaRwGvCYqZ0h oEqMPYe9p7tB7Sm9YKZ4Cgfp6itlI5O4WCxsoTnb/GmIDHByGume6NZKtHyLthh6 X1sEuvPdBaHyn2uzVC1aXImiUJF4hIwbmxhtZYFCIROXpw146tQ36OswDVzP+Jrx jIz9hymVzGgXoWn47qev81mugqxMErj8x2pvhQASIB9KxWfZ++N12uE4AS4rOhEx 4RxHHl8Kmv32I+QysCl4GlKuV2Rit5hhZw1viqO8uuK3TcZMru3DK/RzBLTWGkIu ndTTSr3Y3JkCe8ArRJ7YrHBzgb3YdF6GiyDlY4HT3HWVa+CwfxWloTHmAFxARhGg == X-ME-Sender: Received: from desktop.parsley.growveg.org (parsley.growveg.org [82.70.91.97]) by mail.messagingengine.com (Postfix) with ESMTPA id 39C49240F8 for ; Mon, 22 Jan 2018 14:47:18 -0500 (EST) Subject: Re: syncing bhyve instances To: freebsd-virtualization@freebsd.org References: <5A66137D.5090608@redbarn.org> From: tech-lists Message-ID: Date: Mon, 22 Jan 2018 19:47:16 +0000 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:52.0) Gecko/20100101 Thunderbird/52.5.2 MIME-Version: 1.0 In-Reply-To: <5A66137D.5090608@redbarn.org> Content-Type: text/plain; charset=utf-8 Content-Language: en-GB Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 22 Jan 2018 19:47:21 -0000 On 22/01/2018 16:38, Paul Vixie wrote: > for live sync you'll have to run software inside the guest that knows > how to properly freeze state. for example if there's a live database of > any kind you'll want it to be in its quiet state before you sync from > it. in those situations, i do use rsync. Yeah, thought it might be this. Sorry I wasn't more clear initially about the use case. Basically, the production server is in a datacentre and the reserve server is on a very fast vdsl service. The reason for the reserve server is, if the production server fails then I swap DNS to point at the reserved server and the guests on it without interruption of service. All guests are running databases (mysql) though they aren't especially busy. So I guess the best bet would be mysql replication for the databases and rsync for everything except mysql? thanks everyone who took the time to answer -- J. From owner-freebsd-virtualization@freebsd.org Mon Jan 22 20:02:57 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A1041ED3012 for ; Mon, 22 Jan 2018 20:02:57 +0000 (UTC) (envelope-from SRS0=8YYm=ER=quip.cz=000.fbsd@elsa.codelab.cz) Received: from elsa.codelab.cz (elsa.codelab.cz [94.124.105.4]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 65F796BFF9 for ; Mon, 22 Jan 2018 20:02:57 +0000 (UTC) (envelope-from SRS0=8YYm=ER=quip.cz=000.fbsd@elsa.codelab.cz) Received: from elsa.codelab.cz (localhost [127.0.0.1]) by elsa.codelab.cz (Postfix) with ESMTP id 9BF2328416; Mon, 22 Jan 2018 21:02:53 +0100 (CET) Received: from illbsd.quip.test (ip-86-49-16-209.net.upcbroadband.cz [86.49.16.209]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by elsa.codelab.cz (Postfix) with ESMTPSA id E8B7828411; Mon, 22 Jan 2018 21:02:51 +0100 (CET) Subject: Re: syncing bhyve instances To: tech-lists , freebsd-virtualization@freebsd.org References: <5A66137D.5090608@redbarn.org> From: Miroslav Lachman <000.fbsd@quip.cz> Message-ID: Date: Mon, 22 Jan 2018 21:02:51 +0100 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:52.0) Gecko/20100101 Firefox/52.0 SeaMonkey/2.49.1 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 22 Jan 2018 20:02:57 -0000 tech-lists wrote on 2018/01/22 20:47: > On 22/01/2018 16:38, Paul Vixie wrote: >> for live sync you'll have to run software inside the guest that knows >> how to properly freeze state. for example if there's a live database of >> any kind you'll want it to be in its quiet state before you sync from >> it. in those situations, i do use rsync. > > Yeah, thought it might be this. Sorry I wasn't more clear initially > about the use case. > > Basically, the production server is in a datacentre and the reserve > server is on a very fast vdsl service. The reason for the reserve server > is, if the production server fails then I swap DNS to point at the > reserved server and the guests on it without interruption of service. > All guests are running databases (mysql) though they aren't especially > busy. So I guess the best bet would be mysql replication for the > databases and rsync for everything except mysql? Forget about uninterrupted services. Even if you have very short times on DNS you will have downtime in minutes until old DNS entries expired. If you need "almost real-time replication" then you definitely need both ends online and do MySQL replication (with all its own problems). And some kind of rsync synchronisation as you said. Miroslav Lachman From owner-freebsd-virtualization@freebsd.org Tue Jan 23 07:25:15 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B2404EB6EBE for ; Tue, 23 Jan 2018 07:25:15 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 87B8D63EE0 for ; Tue, 23 Jan 2018 07:25:15 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: from reviews.nyi.freebsd.org (reviews.nyi.freebsd.org [IPv6:2610:1c1:1:607c::16:b]) by mxrelay.nyi.freebsd.org (Postfix) with ESMTP id 55B46F11 for ; Tue, 23 Jan 2018 06:08:10 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: by reviews.nyi.freebsd.org (Postfix, from userid 1346) id 54A9D9C503; Tue, 23 Jan 2018 06:08:10 +0000 (UTC) Date: Tue, 23 Jan 2018 06:08:10 +0000 To: freebsd-virtualization@freebsd.org From: "grehan (Peter Grehan)" Reply-to: D13995+333+f248ba92bf0c9c79@reviews.freebsd.org Subject: [Differential] D13995: NVMe controller emulator for bhyve. Message-ID: <87cad92be9526ab50541c84e6fb96d1a@localhost.localdomain> X-Priority: 3 X-Phabricator-Sent-This-Message: Yes X-Mail-Transport-Agent: MetaMTA X-Auto-Response-Suppress: All X-Phabricator-Mail-Tags: Thread-Topic: D13995: NVMe controller emulator for bhyve. X-Herald-Rules: <95> X-Phabricator-Projects: <#bhyve> X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: Precedence: bulk In-Reply-To: References: Thread-Index: ZGM1NGRjZmQzNjRiMjY5OGVhNjhmY2UxNzhjIFpm0Uo= MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Type: text/plain; charset="utf-8" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 23 Jan 2018 07:25:15 -0000 Z3JlaGFuIGFkZGVkIGEgY29tbWVudC4KCgogIFRoZSB1cGRhdGVkIHZlcnNpb24gb2YgdGhpcyBj b2RlIGlzIGF0IGh0dHBzOi8vcmV2aWV3cy5mcmVlYnNkLm9yZy9EMTQwMjIKICAKICBJJ3ZlIG1v dmVkIHRoZSByZXZpZXdlci9zdWJzY3JpYmVyIGxpc3Qgb3ZlciBhcyB3ZWxsLgoKUkVWSVNJT04g REVUQUlMCiAgaHR0cHM6Ly9yZXZpZXdzLmZyZWVic2Qub3JnL0QxMzk5NQoKRU1BSUwgUFJFRkVS RU5DRVMKICBodHRwczovL3Jldmlld3MuZnJlZWJzZC5vcmcvc2V0dGluZ3MvcGFuZWwvZW1haWxw cmVmZXJlbmNlcy8KClRvOiBzdXgybWZnal9nbWFpbC5jb20sIGdyZWhhbiwgdHJhc3osIGltcApD Yzogc2VhbmMsIHJncmltZXMsIGNlbSwgZnJlZWJzZC12aXJ0dWFsaXphdGlvbi1saXN0LCBjaHVj awo= From owner-freebsd-virtualization@freebsd.org Tue Jan 23 11:27:08 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0F182ECC7A3 for ; Tue, 23 Jan 2018 11:27:08 +0000 (UTC) (envelope-from agapon@gmail.com) Received: from mail-wm0-f67.google.com (mail-wm0-f67.google.com [74.125.82.67]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id A355576002; Tue, 23 Jan 2018 11:27:07 +0000 (UTC) (envelope-from agapon@gmail.com) Received: by mail-wm0-f67.google.com with SMTP id f3so1204352wmc.1; Tue, 23 Jan 2018 03:27:07 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:cc:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=FCbbLARbFwp+fW9thtoRFyAaJ/Z/A4JgcodkXAun2vM=; b=nwcusL15PDbVr7D1rBTEp2f/kkfhc0sEk/uXYaEbLWmfOamUIt4Kv3SsWyzwK/Chx4 4Hib0Mnpb3BZw/teoD0Z4eqV76sol/bax38VYIJMU03MfzK3vQimxFC7CfZ+Peti6W12 xhXaL/8XVremW9VZYLHJ5/G8jaquLAkFZAeKaODrHrhecT4QNBKXfGTycDh5jR5onsR0 iFAuytRsmymI2TJXaTD7+i3IninCs0KfwOHgkbk0WlUwZ6RdHBrwzv+DEjmd09s0Cp3H /SJlPI5D83SRc7ulDV4RPNYUFlbPLVGctOzyDe0tt39FIP+pGl8b270LDLPs08K5iyq3 Etew== X-Gm-Message-State: AKwxytf8atGpR+R5d8dbbrTJJsoV5gYAEZZV1KDrTccU7vi7l9UdNIlL vid7yFzM1HOmG5yIJBZ6oCO3kKYD X-Google-Smtp-Source: AH8x2267vbbpWkv4K880pJIS04Szg0QdPNiJ3gGps4anGRhLr5WlP+MbQWvnPICyWFqVpQe33YPJzA== X-Received: by 10.80.171.21 with SMTP id s21mr19019250edc.117.1516703673200; Tue, 23 Jan 2018 02:34:33 -0800 (PST) Received: from [192.168.0.88] (east.meadow.volia.net. [93.72.151.96]) by smtp.googlemail.com with ESMTPSA id l60sm10294227edl.83.2018.01.23.02.34.31 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Tue, 23 Jan 2018 02:34:32 -0800 (PST) Subject: Re: Bhyve passthrough problems To: Harry Schmalzbauer , Peter Grehan Cc: "freebsd-virtualization@freebsd.org" References: <20180117202250.6ef90c6d@Papi.lobos> <5A65FB2D.7010908@omnilan.de> From: Andriy Gapon Message-ID: <77304bc9-535b-7283-2f39-41323bce73a7@FreeBSD.org> Date: Tue, 23 Jan 2018 12:34:30 +0200 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:52.0) Gecko/20100101 Thunderbird/52.5.2 MIME-Version: 1.0 In-Reply-To: <5A65FB2D.7010908@omnilan.de> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 23 Jan 2018 11:27:08 -0000 On 22/01/2018 16:54, Harry Schmalzbauer wrote: > Inderictly related, but also a big improvement for bhyve, could you have > a minute on that too: > https://lists.freebsd.org/pipermail/freebsd-virtualization/2017-November/005875.html What you request, has already been committed once and then reverted: https://svnweb.freebsd.org/base?view=revision&revision=282922 https://svnweb.freebsd.org/base?view=revision&revision=283168 Unfortunately, an 'upcoming commit' hasn't come yet. -- Andriy Gapon From owner-freebsd-virtualization@freebsd.org Tue Jan 23 12:53:31 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DBF4FED2686 for ; Tue, 23 Jan 2018 12:53:31 +0000 (UTC) (envelope-from david@wimsey.us) Received: from mail-yw0-x22c.google.com (mail-yw0-x22c.google.com [IPv6:2607:f8b0:4002:c05::22c]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 9A0C77A39F for ; Tue, 23 Jan 2018 12:53:31 +0000 (UTC) (envelope-from david@wimsey.us) Received: by mail-yw0-x22c.google.com with SMTP id u21so129039ywc.2 for ; Tue, 23 Jan 2018 04:53:31 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=wimsey-us.20150623.gappssmtp.com; s=20150623; h=from:message-id:mime-version:subject:date:in-reply-to:cc:to :references; bh=TbkepLgbhBc7nbcgnPMKGYqYQgWqKQaHAKHff8HVFfc=; b=rP1vtsd/IrIdqQ69yxkjLtTLqx4b9cmjhO1ZYF+Db3o/TGsXww3zqV4TmIl6hfOlf4 2YuEqSSSp1fwAg1sVnTNx+cm1JSzCVCJ3hL6iV9HnJ+mYvUUP8jNKhlv7akAxPm9pTq3 h+N/+ZQ2GZ9utcyOTj6cxowxIbkUONppdMcECSWhckBAYNzbUVn1zsgF4LiGLqewwJMn xZ2ux9ZB9A+4qj8YmJ+7CcvoFB/WJ8IrzvW/hJJ0dlwy/f0fnmeDp9aYTLfBRuMOME9D AgyhYSeoDzGd23lsHSi3jmetZm5kgyXFy5gEbOuhHzAlc285enVcbxh+wWkROzfJ/Pjc 2bhA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:message-id:mime-version:subject:date :in-reply-to:cc:to:references; bh=TbkepLgbhBc7nbcgnPMKGYqYQgWqKQaHAKHff8HVFfc=; b=RlcTSsob0OtpcuAX4cZzYLk6NCd5UcMAFWnoOiO9Wt3DnSPkDUEn7I/gIm1Eg+hrug /t61as52Hsf/h8SBGvSDSD16oi+SgugHTgS35ZLYCgnMlLrevDzOPmhtE0fT+lSBsQFs sRlqAAHa0kv25DJXoeIHQNrsco3sHTxhqCQr4HMz7MFRb6eCuFc9g5MCCmlqbVDdQ3qJ yp7rASJMKl7WKKDNMP8kZ2kyJ9FbdaNmSF+Nb5mbBV7M8Q/OLQWAupknk+8+oq+/0F90 xsTxMVf64SKVApq+f5qqEmK1GQr/TZfVbGA/WzOxEUaS6oOUgY6seKzx222rkwRJXNso i5UA== X-Gm-Message-State: AKwxytejZ0Bm2Z4tIfjQSJHSholc+DcjVIaBHPGagFdMkGdZv0G36/9M F1o//Q00iFa8AhuB9MNvd9vIX4xRkbQ= X-Google-Smtp-Source: AH8x227K4E/+2QOfoCJuy/CNcipgjByhYB7apHbX95RJ3VZp7E33jdZIFgKVelmOB6MO+cHidtDAig== X-Received: by 10.129.216.13 with SMTP id d13mr2213818ywj.167.1516712010534; Tue, 23 Jan 2018 04:53:30 -0800 (PST) Received: from [192.168.43.17] (mobile-166-170-53-254.mycingular.net. [166.170.53.254]) by smtp.gmail.com with ESMTPSA id j12sm3680792ywb.91.2018.01.23.04.53.28 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Tue, 23 Jan 2018 04:53:29 -0800 (PST) From: David Wimsey Message-Id: <67983B85-6983-40A9-B7D3-4CD2AAA9517B@wimsey.us> Content-Type: multipart/signed; boundary="Apple-Mail=_2AAC1511-7C79-4743-8C8D-136887FA3D2B"; protocol="application/pgp-signature"; micalg=pgp-sha256 Mime-Version: 1.0 (Mac OS X Mail 10.3 \(3273\)) Subject: Re: syncing bhyve instances Date: Tue, 23 Jan 2018 07:53:26 -0500 In-Reply-To: <5A66137D.5090608@redbarn.org> Cc: freebsd-virtualization@freebsd.org To: Paul Vixie References: <5A66137D.5090608@redbarn.org> X-Mailer: Apple Mail (2.3273) X-Content-Filtered-By: Mailman/MimeDel 2.1.25 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 23 Jan 2018 12:53:32 -0000 --Apple-Mail=_2AAC1511-7C79-4743-8C8D-136887FA3D2B Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 > On Jan 22, 2018, at 11:38 AM, Paul Vixie wrote: >=20 > i've used zfs for this, but i have to shut the guest down to do it. = i'm using zvols for my guest system disks, so it's >=20 > shut the guest down (maybe just to single-user mode) > make a zfs checkpoint > start the guest back up > zfs send the checkpoint >=20 > this also assumes that the sync-destination is a cold spare, sitting = in its shutdown state until needed. >=20 > for live sync you'll have to run software inside the guest that knows = how to properly freeze state. for example if there's a live database of = any kind you'll want it to be in its quiet state before you sync from = it. in those situations, i do use rsync. >=20 > bhyve could conceivably offer a feature to export the guest RAM, and = with a little page-stealing, this could be made into an incremental sync = feed. but i predict it would be enormous in size for any non-trivial = guest. > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to = "freebsd-virtualization-unsubscribe@freebsd.org" Just for reference, I=E2=80=99ve had good experiences with zrep for = keeping ZFS file systems synced. You can cron it pretty much as often = as you want and it=E2=80=99ll handle snapshotting, sending, and cleaning = up of snapshots on both ends in a sane and safe manner. It only helps = with the ZFS sync part of this issue, but its pretty good at that. http://www.bolthole.com/solaris/zrep/ = --Apple-Mail=_2AAC1511-7C79-4743-8C8D-136887FA3D2B Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEEG4HTcn99UQiu6Q3qerZMujxxKYoFAlpnMEYACgkQerZMujxx KYq4BhAApnb6KjuTCzM8G8d5wGe/dJtg4hassBuMy3dOsQgDboY0IHfKOKWHblvr ByUn803gRia+posPV7G8Rfy9liGDKo13ckAI8HjKyshtvpqpQoOayiQoPkzN2FOt mhfPem4EvAGGcE1N112UFqOJdNomdzn8Evj3m4iXkOSEC4uBzezLP3NW1GkekZKS 044plKPu2zfcRB496425angD+fZo9/4y5Fnwi4DctsBz/VaStqCx3kHQnXmY6fF5 PMlWJaDxehtP0oNRVdQCBnbg/cZsF9pxCqmPpoIB68qlmdYz8skuKyJ0ncdTMTMG QeJKwjok+MBgz/XFiv2Q17aZqFHmNjMn58nSpR25dnHS/OgZAJ51/JhM/67chRQs y9XEAYbLfilG4q4/HzysZ5JVNAR3us4mq13koVneCclWUGmado65zXjXqijsg4Ej /LqEqVSGjOE4ZJYCQY76FGa9VntbC1MkmfKaKjvWcpx1YTSkdjnWOkNWfvgu3uyQ a6BcG+cpysep6bIJRq4A9EEmUDFnjz6Nhn8AUJXabIBMLMqam3BYCMVcNLITONjt QjfxtijoCk3bSjMq7qHlsbYIq/FS3Movuoh0vdXby1cjr77AtEHWGyeD+pTS1IvJ AMrztSSwVvzGfY9x5v32d4ZhibIqkljoYiZaGFMm7XeVuMOv8vU= =WomT -----END PGP SIGNATURE----- --Apple-Mail=_2AAC1511-7C79-4743-8C8D-136887FA3D2B-- From owner-freebsd-virtualization@freebsd.org Tue Jan 23 13:00:31 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 626B7ED2B34 for ; Tue, 23 Jan 2018 13:00:31 +0000 (UTC) (envelope-from freebsd@grem.de) Received: from mail.grem.de (outcast.grem.de [213.239.217.27]) by mx1.freebsd.org (Postfix) with SMTP id D102F7A628 for ; Tue, 23 Jan 2018 13:00:30 +0000 (UTC) (envelope-from freebsd@grem.de) Received: (qmail 98025 invoked by uid 89); 23 Jan 2018 13:00:23 -0000 Received: from unknown (HELO ?192.168.250.192?) (mg@grem.de@93.104.68.20) by mail.grem.de with ESMTPA; 23 Jan 2018 13:00:23 -0000 Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (1.0) Subject: Re: syncing bhyve instances From: Michael Gmelin X-Mailer: iPhone Mail (14G60) In-Reply-To: Date: Tue, 23 Jan 2018 14:00:22 +0100 Cc: freebsd-virtualization@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <8BCCEBAF-EDA9-421B-815A-FB4E1BA5B57B@grem.de> References: <5A66137D.5090608@redbarn.org> To: tech-lists X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 23 Jan 2018 13:00:31 -0000 > On 22. Jan 2018, at 20:47, tech-lists wrote: >=20 >> On 22/01/2018 16:38, Paul Vixie wrote: >> for live sync you'll have to run software inside the guest that knows >> how to properly freeze state. for example if there's a live database of >> any kind you'll want it to be in its quiet state before you sync from >> it. in those situations, i do use rsync. >=20 > Yeah, thought it might be this. Sorry I wasn't more clear initially > about the use case. >=20 > Basically, the production server is in a datacentre and the reserve > server is on a very fast vdsl service. The reason for the reserve server > is, if the production server fails then I swap DNS to point at the > reserved server and the guests on it without interruption of service. > All guests are running databases (mysql) though they aren't especially > busy. So I guess the best bet would be mysql replication for the > databases and rsync for everything except mysql? >=20 > thanks everyone who took the time to answer For the database, mysql replication is the way to go (otherwise you would ne= ed to stop/lock the server every time you do a snapshot and you'll get near-= realtime replication which will always be more current than your snapshots).= For the system I'd suggest to create automation for the setup, so you can a= pply changes to both systems without a need to sync/clone/copy from one to t= he other. For anything else left (data files on disk, non-system, non-packag= e, non-config) use regular rsync (or zfs send if your setup permits - I'd st= ick with rsync). Yours, Michael p.s. Make sure to include monitoring (especially replication latency and dat= a integrity) >=20 > --=20 > J. > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@freeb= sd.org" From owner-freebsd-virtualization@freebsd.org Thu Jan 25 15:49:52 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id EFBB4EB6F7C for ; Thu, 25 Jan 2018 15:49:51 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 9B2018350C for ; Thu, 25 Jan 2018 15:49:51 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: from reviews.nyi.freebsd.org (reviews.nyi.freebsd.org [IPv6:2610:1c1:1:607c::16:b]) by mxrelay.nyi.freebsd.org (Postfix) with ESMTP id 8FD8B6E15 for ; Thu, 25 Jan 2018 15:49:51 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: by reviews.nyi.freebsd.org (Postfix, from userid 1346) id 8F2C6CCDCF; Thu, 25 Jan 2018 15:49:51 +0000 (UTC) Date: Thu, 25 Jan 2018 15:49:51 +0000 To: freebsd-virtualization@freebsd.org From: "chuck (Chuck Tuffli)" Reply-to: D13995+333+f248ba92bf0c9c79@reviews.freebsd.org Subject: [Differential] D13995: NVMe controller emulator for bhyve. Message-ID: <9f7bce24a61a85bd15cbf3813ce69932@localhost.localdomain> X-Priority: 3 X-Phabricator-Sent-This-Message: Yes X-Mail-Transport-Agent: MetaMTA X-Auto-Response-Suppress: All X-Phabricator-Mail-Tags: , Thread-Topic: D13995: NVMe controller emulator for bhyve. X-Herald-Rules: <95> X-Phabricator-Projects: <#bhyve> X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: Precedence: bulk In-Reply-To: References: Thread-Index: ZGM1NGRjZmQzNjRiMjY5OGVhNjhmY2UxNzhjIFpp/J8= MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Type: text/plain; charset="utf-8" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 25 Jan 2018 15:49:52 -0000 Y2h1Y2sgYWRkZWQgYSBjb21tZW50LgoKCiAgT3ZlcmFsbCwgaXQgaXMgZXhjaXRpbmcgdG8gc2Vl IHRoaXMgd29yayBiZWluZyBkb25lLiBJIHJlYWxpemUgdGhlIGNvZGUgaXMgaW4gaXRzIGVhcmx5 IHN0YWdlcyBhbmQgaGFzIGFzc2VydHMgdG8gaGVscCBjYXRjaCAidGhlIGltcG9ydGFudCIgY29k ZSBwYXRocywgYnV0IGl0IG1pZ2h0IGJlIGdvb2QgdG8gcmVtb3ZlIHNvbWUgb2YgdGhlIGFzc2Vy dHMgYW5kIGhhdmUgdGhlIGNvbW1hbmRzIHNldCBzdGFuZGFyZCBOVk1lIGVycm9ycyB3aGVyZSBh cHByb3ByaWF0ZS4KCklOTElORSBDT01NRU5UUwoKPiBwY2lfbnZtZS5jOjM3MQo+ICsgICAgVEFJ TFFfSU5JVCgmcWluZm8tPmlvYmhkKTsKPiArICAgIHJldHVybiAwOwo+ICt9CgpzdHlsZSg5KTog VmFsdWVzIGluIHJldHVybiBzdGF0ZW1lbnRzIHNob3VsZAliZSBlbmNsb3NlZCBpbiBwYXJlbnRo ZXNlcy4KCj4gcGNpX252bWUuYzo0MDQKPiArICAgICAqIEF0dGVtcHQgdG8gb3BlbiB0aGUgYmFj a2luZyBpbWFnZS4gVXNlIHRoZSBQQ0kKPiArCSAqIHNsb3QvZnVuYyBmb3IgdGhlIGlkZW50aWZp ZXIgc3RyaW5nLgo+ICsJICovCgpJbmRlbnRhdGlvbiBwcm9ibGVtIGhlcmUgYW5kIGZvciBzZXZl cmFsIGxpbmVzCgo+IHBjaV9udm1lLmM6NDE1Cj4gKyAgICBwY2lfc2V0X2NmZ2RhdGExNihwaSwg UENJUl9WRU5ET1IsIDB4ODA4Nik7Cj4gKyAgICBwY2lfc2V0X2NmZ2RhdGE4KHBpLCBQQ0lSX0NM QVNTLCBQQ0lDX1NUT1JBR0UpOwo+ICsKCkl0IHdvdWxkIGJlIGdvb2QgdG8gc2V0IHRoZSBzdWJj bGFzcyBhbmQgcHJvZ3JhbW1pbmcgaW50ZXJmYWNlIHZhbHVlcy4gSS5lLjoKCmBQQ0lSX1NVQkNM QVNTYCB0byBgMDhoYCBhbmQKYFBDSVJfUFJPR0lGYCB0byBgMDJoYAoKTm90ZSB0aGF0IGJvdGgg dGhlIHZhbHVlcyBhYm92ZSBoYXZlICNkZWZpbmVzIGluIHBjaXJlZy5oCgo+IHBjaV9udm1lLmM6 NTY2Cj4gKwo+ICsgICAgcmV0dXJuOwo+ICt9CgpzdHlsZSg5KSAoSSB0aGluaykgbml0OyBObyBy ZXR1cm4gbmVlZGVkIGZvciB2b2lkIGZ1bmN0aW9ucy4KClJFVklTSU9OIERFVEFJTAogIGh0dHBz Oi8vcmV2aWV3cy5mcmVlYnNkLm9yZy9EMTM5OTUKCkVNQUlMIFBSRUZFUkVOQ0VTCiAgaHR0cHM6 Ly9yZXZpZXdzLmZyZWVic2Qub3JnL3NldHRpbmdzL3BhbmVsL2VtYWlscHJlZmVyZW5jZXMvCgpU bzogc3V4Mm1mZ2pfZ21haWwuY29tLCBncmVoYW4sIHRyYXN6LCBpbXAKQ2M6IGNodWNrLCBzZWFu YywgcmdyaW1lcywgY2VtLCBmcmVlYnNkLXZpcnR1YWxpemF0aW9uLWxpc3QK From owner-freebsd-virtualization@freebsd.org Thu Jan 25 15:55:33 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 97054EB7900 for ; Thu, 25 Jan 2018 15:55:33 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 3A8A683C0A for ; Thu, 25 Jan 2018 15:55:33 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: from reviews.nyi.freebsd.org (reviews.nyi.freebsd.org [IPv6:2610:1c1:1:607c::16:b]) by mxrelay.nyi.freebsd.org (Postfix) with ESMTP id 31B6E6FB1 for ; Thu, 25 Jan 2018 15:55:33 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: by reviews.nyi.freebsd.org (Postfix, from userid 1346) id 3066DCE26A; Thu, 25 Jan 2018 15:55:33 +0000 (UTC) Date: Thu, 25 Jan 2018 15:55:33 +0000 To: freebsd-virtualization@freebsd.org From: "grehan (Peter Grehan)" Reply-to: D13995+333+f248ba92bf0c9c79@reviews.freebsd.org Subject: [Differential] D13995: NVMe controller emulator for bhyve. Message-ID: X-Priority: 3 X-Phabricator-Sent-This-Message: Yes X-Mail-Transport-Agent: MetaMTA X-Auto-Response-Suppress: All X-Phabricator-Mail-Tags: , Thread-Topic: D13995: NVMe controller emulator for bhyve. X-Herald-Rules: <95> X-Phabricator-Projects: <#bhyve> X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: Precedence: bulk In-Reply-To: References: Thread-Index: ZGM1NGRjZmQzNjRiMjY5OGVhNjhmY2UxNzhjIFpp/fU= MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Type: text/plain; charset="utf-8" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 25 Jan 2018 15:55:33 -0000 Z3JlaGFuIHJlcXVlc3RlZCBjaGFuZ2VzIHRvIHRoaXMgcmV2aXNpb24uCmdyZWhhbiBhZGRlZCBh IGNvbW1lbnQuClRoaXMgcmV2aXNpb24gbm93IHJlcXVpcmVzIGNoYW5nZXMgdG8gcHJvY2VlZC4K CgogIENodWNrIC0gdGhlIHJldmlldyBmb3IgdGhpcyBpcyBub3cgaW4gaHR0cHM6Ly9yZXZpZXdz LmZyZWVic2Qub3JnL0QxNDAyMiwgd2hlcmUgSSBiZWxpZXZlIHlvdXIgY29tbWVudHMgaGF2ZSBh bHJlYWR5IGJlZW4gYWRkcmVzc2VkLgoKUkVWSVNJT04gREVUQUlMCiAgaHR0cHM6Ly9yZXZpZXdz LmZyZWVic2Qub3JnL0QxMzk5NQoKRU1BSUwgUFJFRkVSRU5DRVMKICBodHRwczovL3Jldmlld3Mu ZnJlZWJzZC5vcmcvc2V0dGluZ3MvcGFuZWwvZW1haWxwcmVmZXJlbmNlcy8KClRvOiBzdXgybWZn al9nbWFpbC5jb20sIGdyZWhhbiwgdHJhc3osIGltcApDYzogY2h1Y2ssIHNlYW5jLCByZ3JpbWVz LCBjZW0sIGZyZWVic2QtdmlydHVhbGl6YXRpb24tbGlzdAo= From owner-freebsd-virtualization@freebsd.org Thu Jan 25 16:39:23 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5A1ECEBDF1D for ; Thu, 25 Jan 2018 16:39:23 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 09E5885946 for ; Thu, 25 Jan 2018 16:39:23 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: from reviews.nyi.freebsd.org (reviews.nyi.freebsd.org [IPv6:2610:1c1:1:607c::16:b]) by mxrelay.nyi.freebsd.org (Postfix) with ESMTP id 02DCF7637 for ; Thu, 25 Jan 2018 16:39:23 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: by reviews.nyi.freebsd.org (Postfix, from userid 1346) id 02598D497A; Thu, 25 Jan 2018 16:39:23 +0000 (UTC) Date: Thu, 25 Jan 2018 16:39:22 +0000 To: freebsd-virtualization@freebsd.org From: "chuck (Chuck Tuffli)" Reply-to: D13995+333+f248ba92bf0c9c79@reviews.freebsd.org Subject: [Differential] D13995: NVMe controller emulator for bhyve. Message-ID: <31ee41368b7c3d4c62dd9f17e9213417@localhost.localdomain> X-Priority: 3 X-Phabricator-Sent-This-Message: Yes X-Mail-Transport-Agent: MetaMTA X-Auto-Response-Suppress: All X-Phabricator-Mail-Tags: Thread-Topic: D13995: NVMe controller emulator for bhyve. X-Herald-Rules: <95> X-Phabricator-Projects: <#bhyve> X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: Precedence: bulk In-Reply-To: References: Thread-Index: ZGM1NGRjZmQzNjRiMjY5OGVhNjhmY2UxNzhjIFpqCDo= MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Type: text/plain; charset="utf-8" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 25 Jan 2018 16:39:23 -0000 Y2h1Y2sgYWRkZWQgYSBjb21tZW50LgoKCiAgQGdyZWhhbiAgT0suIFNvIGlzIHRoZSB0aG91Z2h0 IHRoYXQgdGhpcyByZXZpZXcgYmUgY2xvc2VkIGFuZCBlZmZvcnRzIHNob3VsZCBmb2N1cyBvbiBo dHRwczovL3Jldmlld3MuZnJlZWJzZC5vcmcvRDE0MDIyPwoKUkVWSVNJT04gREVUQUlMCiAgaHR0 cHM6Ly9yZXZpZXdzLmZyZWVic2Qub3JnL0QxMzk5NQoKRU1BSUwgUFJFRkVSRU5DRVMKICBodHRw czovL3Jldmlld3MuZnJlZWJzZC5vcmcvc2V0dGluZ3MvcGFuZWwvZW1haWxwcmVmZXJlbmNlcy8K ClRvOiBzdXgybWZnal9nbWFpbC5jb20sIGdyZWhhbiwgdHJhc3osIGltcApDYzogY2h1Y2ssIHNl YW5jLCByZ3JpbWVzLCBjZW0sIGZyZWVic2QtdmlydHVhbGl6YXRpb24tbGlzdAo= From owner-freebsd-virtualization@freebsd.org Thu Jan 25 16:41:27 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id CAFCCEBE292 for ; Thu, 25 Jan 2018 16:41:27 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 787BE85AEB for ; Thu, 25 Jan 2018 16:41:27 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: from reviews.nyi.freebsd.org (reviews.nyi.freebsd.org [IPv6:2610:1c1:1:607c::16:b]) by mxrelay.nyi.freebsd.org (Postfix) with ESMTP id 723817795 for ; Thu, 25 Jan 2018 16:41:27 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: by reviews.nyi.freebsd.org (Postfix, from userid 1346) id 71A56D52B5; Thu, 25 Jan 2018 16:41:27 +0000 (UTC) Date: Thu, 25 Jan 2018 16:41:27 +0000 To: freebsd-virtualization@freebsd.org From: "grehan (Peter Grehan)" Reply-to: D13995+333+f248ba92bf0c9c79@reviews.freebsd.org Subject: [Differential] D13995: NVMe controller emulator for bhyve. Message-ID: <91e56c19e0ab76327a68acedc313a1ff@localhost.localdomain> X-Priority: 3 X-Phabricator-Sent-This-Message: Yes X-Mail-Transport-Agent: MetaMTA X-Auto-Response-Suppress: All X-Phabricator-Mail-Tags: Thread-Topic: D13995: NVMe controller emulator for bhyve. X-Herald-Rules: <95> X-Phabricator-Projects: <#bhyve> X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: Precedence: bulk In-Reply-To: References: Thread-Index: ZGM1NGRjZmQzNjRiMjY5OGVhNjhmY2UxNzhjIFpqCLc= MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Type: text/plain; charset="utf-8" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 25 Jan 2018 16:41:28 -0000 Z3JlaGFuIGFkZGVkIGEgY29tbWVudC4KCgogIFllcCwgdGhhdCdzIGNvcnJlY3QuIFRoZSBjb2Rl IGluIHRoZSBuZXcgcmV2aWV3IGlzIGJhc2VkIG9uIHRoaXMgY29kZSBzbyBpdCdzIHJlYWxseSBh IGNvbnRpbnVhdGlvbiBvZiB0aGUgZWZmb3J0LgoKUkVWSVNJT04gREVUQUlMCiAgaHR0cHM6Ly9y ZXZpZXdzLmZyZWVic2Qub3JnL0QxMzk5NQoKRU1BSUwgUFJFRkVSRU5DRVMKICBodHRwczovL3Jl dmlld3MuZnJlZWJzZC5vcmcvc2V0dGluZ3MvcGFuZWwvZW1haWxwcmVmZXJlbmNlcy8KClRvOiBz dXgybWZnal9nbWFpbC5jb20sIGdyZWhhbiwgdHJhc3osIGltcApDYzogY2h1Y2ssIHNlYW5jLCBy Z3JpbWVzLCBjZW0sIGZyZWVic2QtdmlydHVhbGl6YXRpb24tbGlzdAo= From owner-freebsd-virtualization@freebsd.org Thu Jan 25 16:44:38 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E747AEBE550 for ; Thu, 25 Jan 2018 16:44:37 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 921F385DB3 for ; Thu, 25 Jan 2018 16:44:37 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: from reviews.nyi.freebsd.org (reviews.nyi.freebsd.org [IPv6:2610:1c1:1:607c::16:b]) by mxrelay.nyi.freebsd.org (Postfix) with ESMTP id 8963F77FE for ; Thu, 25 Jan 2018 16:44:37 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: by reviews.nyi.freebsd.org (Postfix, from userid 1346) id 88C14D58C2; Thu, 25 Jan 2018 16:44:37 +0000 (UTC) Date: Thu, 25 Jan 2018 16:44:37 +0000 To: freebsd-virtualization@freebsd.org From: "grehan (Peter Grehan)" Reply-to: D13995+333+f248ba92bf0c9c79@reviews.freebsd.org Subject: [Differential] D13995: NVMe controller emulator for bhyve. Message-ID: X-Priority: 3 X-Phabricator-Sent-This-Message: Yes X-Mail-Transport-Agent: MetaMTA X-Auto-Response-Suppress: All X-Phabricator-Mail-Tags: , Thread-Topic: D13995: NVMe controller emulator for bhyve. X-Herald-Rules: <95> X-Phabricator-Projects: <#bhyve> X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: Precedence: bulk In-Reply-To: References: Thread-Index: ZGM1NGRjZmQzNjRiMjY5OGVhNjhmY2UxNzhjIFpqCXU= MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Type: text/plain; charset="utf-8" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 25 Jan 2018 16:44:38 -0000 Z3JlaGFuIGNvbW1hbmRlZXJlZCB0aGlzIHJldmlzaW9uLgpncmVoYW4gZWRpdGVkIHJldmlld2Vy cywgYWRkZWQ6IHN1eDJtZmdqX2dtYWlsLmNvbTsgcmVtb3ZlZDogZ3JlaGFuLgoKUkVWSVNJT04g REVUQUlMCiAgaHR0cHM6Ly9yZXZpZXdzLmZyZWVic2Qub3JnL0QxMzk5NQoKRU1BSUwgUFJFRkVS RU5DRVMKICBodHRwczovL3Jldmlld3MuZnJlZWJzZC5vcmcvc2V0dGluZ3MvcGFuZWwvZW1haWxw cmVmZXJlbmNlcy8KClRvOiBncmVoYW4sIHRyYXN6LCBpbXAsIHN1eDJtZmdqX2dtYWlsLmNvbQpD YzogY2h1Y2ssIHNlYW5jLCByZ3JpbWVzLCBjZW0sIGZyZWVic2QtdmlydHVhbGl6YXRpb24tbGlz dAo= From owner-freebsd-virtualization@freebsd.org Thu Jan 25 16:45:21 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 36E9DEBE5CC for ; Thu, 25 Jan 2018 16:45:21 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id D203F85E24 for ; Thu, 25 Jan 2018 16:45:20 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: from reviews.nyi.freebsd.org (reviews.nyi.freebsd.org [IPv6:2610:1c1:1:607c::16:b]) by mxrelay.nyi.freebsd.org (Postfix) with ESMTP id CA7EF7809 for ; Thu, 25 Jan 2018 16:45:20 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: by reviews.nyi.freebsd.org (Postfix, from userid 1346) id C9E55D5F2A; Thu, 25 Jan 2018 16:45:20 +0000 (UTC) Date: Thu, 25 Jan 2018 16:45:20 +0000 To: freebsd-virtualization@freebsd.org From: "grehan (Peter Grehan)" Reply-to: D13995+333+f248ba92bf0c9c79@reviews.freebsd.org Subject: [Differential] D13995: NVMe controller emulator for bhyve. Message-ID: X-Priority: 3 X-Phabricator-Sent-This-Message: Yes X-Mail-Transport-Agent: MetaMTA X-Auto-Response-Suppress: All X-Phabricator-Mail-Tags: , Thread-Topic: D13995: NVMe controller emulator for bhyve. X-Herald-Rules: <95> X-Phabricator-Projects: <#bhyve> X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: Precedence: bulk In-Reply-To: References: Thread-Index: ZGM1NGRjZmQzNjRiMjY5OGVhNjhmY2UxNzhjIFpqCaA= MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Type: text/plain; charset="utf-8" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 25 Jan 2018 16:45:21 -0000 Z3JlaGFuIGFiYW5kb25lZCB0aGlzIHJldmlzaW9uLgpncmVoYW4gYWRkZWQgYSBjb21tZW50LgoK CiAgQ2xvc2luZyB0aGlzIHJldmlzaW9uIC0gbW92aW5nIHRvIGh0dHBzOi8vcmV2aWV3cy5mcmVl YnNkLm9yZy9EMTQwMjIKClJFVklTSU9OIERFVEFJTAogIGh0dHBzOi8vcmV2aWV3cy5mcmVlYnNk Lm9yZy9EMTM5OTUKCkVNQUlMIFBSRUZFUkVOQ0VTCiAgaHR0cHM6Ly9yZXZpZXdzLmZyZWVic2Qu b3JnL3NldHRpbmdzL3BhbmVsL2VtYWlscHJlZmVyZW5jZXMvCgpUbzogZ3JlaGFuLCB0cmFzeiwg aW1wLCBzdXgybWZnal9nbWFpbC5jb20KQ2M6IGNodWNrLCBzZWFuYywgcmdyaW1lcywgY2VtLCBm cmVlYnNkLXZpcnR1YWxpemF0aW9uLWxpc3QK