From owner-freebsd-virtualization@FreeBSD.ORG Sun Mar 1 02:01:34 2015 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 6A3BBBCB for ; Sun, 1 Mar 2015 02:01:34 +0000 (UTC) Received: from mail-ig0-x22e.google.com (mail-ig0-x22e.google.com [IPv6:2607:f8b0:4001:c05::22e]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 32902B93 for ; Sun, 1 Mar 2015 02:01:34 +0000 (UTC) Received: by igbhn18 with SMTP id hn18so9414233igb.2 for ; Sat, 28 Feb 2015 18:01:33 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=IZyS8Gd6saEarwa3dtsMXiiLm4VkZi0t2rH2sT9Uk8s=; b=Iq60cuv64COYkTtJKyJ66BRvRrs6F+XcdVZcm5D8WO3gD2OcMlfArKo2qVfa1QoHmZ wLukivw2iU8P/O5F4ciYA5OOsv8AexiW6+tRoQdwCEGA91U0HIyQz8j5587uETGi9dtb U+TzjpZEZ7lYZQpv8HUlPtJx3qXBN637KYcGuOLVvX97+1dslVFmaWR/4ucgMi2cY0s7 /S/Y6BKf3BSrFDzOwH+tD2qCtYcxb9pRch1mneVyYAJqE6BfPAT7iHN7HE/QncKdo2Oj p+LN/zhyDQ85FNy8H8H+Dy51xvTgQhOu8v/n907+vZkM48kGWS8bQsRhRZf6sovCG19L a0PA== MIME-Version: 1.0 X-Received: by 10.42.150.130 with SMTP id a2mr23800219icw.69.1425175293563; Sat, 28 Feb 2015 18:01:33 -0800 (PST) Received: by 10.107.156.75 with HTTP; Sat, 28 Feb 2015 18:01:33 -0800 (PST) Date: Sat, 28 Feb 2015 21:01:33 -0500 Message-ID: Subject: HEADS UP: PCI SR-IOV infrastructure has been committed to head From: Ryan Stone To: FreeBSD Current Content-Type: text/plain; charset=UTF-8 X-Mailman-Approved-At: Sun, 01 Mar 2015 04:11:00 +0000 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 01 Mar 2015 02:01:34 -0000 I've just finished committing support for PCI Single Root I/O Virtualization in the pci subsystem to head. This should be a no-op for everyone right now, but there were some minor refactorings in the pci code that could have a lingering bug. I did make sure to test that it boots on a variety of systems (but only i386/amd64, as that's all that I have access to). What's been committed to head is only the pci subsystem side of things, along with the userland tools to configure SR-IOV (along with, I'm happy to say, a full set of man pages). What's not in head yet are any drivers making use of the infrastructure. Full support for ixl(4) is complete and I've sent the patch to jfv@; I hope to see the driver support committed soon. I don't have any word on timelines for getting support in other drivers. Unfortunately adding SR-IOV support to a driver is not trivial as the standard leaves a lot of the details up to particular implementations (in the same way the the PCIe standard does not define how to send a packet from a NIC; instead defining how the PCIe device will expose its registers and whatnot, and its up to the PCIe device and driver to understand how to poke at the registers to send a packet). I have heard anecdotally that a number of driver maintainers have been very interested in this work so I hope that to see more drivers supported SR-IOV in the near future. I encourage all driver maintainers to read over the new manpages and contact me if they have any questions about the new infrastructure. Anybody interested in using SR-IOV should try to attend BSDCan 2015, as I will be giving a talk on the subject. I intend to focus more on the system administration side of configuring and using SR-IOV rather than the details of implementing an SR-IOV driver. If anybody did an "svn up" half-way through my muddled series of commits, sorry about the temporary breakage. My buildworld/buildkernel on r279466 just completed successfully so please make sure that you have at least that revision. If you still have problems, please let me know. I do want to thank John Baldwin for advice about the PCI Subsystem and newbus and Jack Vogel for his help with the Fortville NIC, including getting me early access to the VF driver for testing purposes. Thanks to everybody who reviewed the changes. Specially thanks to Mark Johnston and Sean Mahood, who literally spent hours with me in a meeting room reviewing the entire patch series last summer (thankfully, those hours at least weren't consecutive). Above all, thanks to Sandvine Inc. for sponsoring this work. This is definitely the biggest contribution we've ever made to FreeBSD and I hope to see this kind of thing continue. From owner-freebsd-virtualization@FreeBSD.ORG Sun Mar 1 20:54:20 2015 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 40C309F3; Sun, 1 Mar 2015 20:54:20 +0000 (UTC) Received: from mail-la0-x235.google.com (mail-la0-x235.google.com [IPv6:2a00:1450:4010:c03::235]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id D0FE422F; Sun, 1 Mar 2015 20:54:19 +0000 (UTC) Received: by labgf13 with SMTP id gf13so2049461lab.5; Sun, 01 Mar 2015 12:54:17 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:date:message-id:subject:from:to:cc:content-type; bh=+3S05OpWZstC45NR1/R1Wyf7qqEEwZBMJDzfe/h5w5Y=; b=FM5vwoyXKBpd6+wPINYZ2Ud7zoYUkeHSfk1QOKh8479H48J0O3T0Dnhc424k2MrBMg lkwqWZ2LqdJSmqgl1+EeiS5QqFnkvt77H0uADVatHz6lxJfuTsqStQrk7kg8lgUODVle 8/KgnzWNtZj6r56n3/JbzceLoAJxABoh0H3aZf0VCk7OdzrFiqKuKstIXzOj+XeacXsk KmRpb7+ndpABAK3lW07EMS240rKpNGI8IQfyYBOIGbrg+/y3BbTXvJfevgq3b+tvJAkD jDyi3dsKUVPRl/5pnDuqAz6mLZjLoduGMt9k5huiqfXqntryiD+VUiZSF8ed0FrPlSR7 qErg== MIME-Version: 1.0 X-Received: by 10.152.87.84 with SMTP id v20mr21561759laz.81.1425243257648; Sun, 01 Mar 2015 12:54:17 -0800 (PST) Sender: crodr001@gmail.com Received: by 10.112.82.164 with HTTP; Sun, 1 Mar 2015 12:54:17 -0800 (PST) Date: Sun, 1 Mar 2015 12:54:17 -0800 X-Google-Sender-Auth: 7J-bAVkaEx9_p9xl5PGV-ODwLzo Message-ID: Subject: bhyve failure: vm_run error -1, errno 25 From: Craig Rodrigues To: "freebsd-virtualization@freebsd.org" Content-Type: multipart/mixed; boundary=001a11c3337e177c730510404e35 X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 Cc: "jenkins-admin@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 01 Mar 2015 20:54:20 -0000 --001a11c3337e177c730510404e35 Content-Type: text/plain; charset=ISO-8859-1 Hi, I recently did the following: (1) Updated to svn r279489, rebuilt world/kernel and rebooted. (2) Ran this: sh /usr/share/examples/bhyve/vmrun.sh -m 4G -d /vm/ scan-ci.FreeBSD.org/disk.img vmtest1 (3) Got this error: vm_run error -1, errno 25 See attached log. Any idea what is going on? This VM used to work, and I did not get this error before. This is on wreck.ysv.freebsd.org, so Neel and Peter should have access to debug if necessary. Thanks. -- Craig --001a11c3337e177c730510404e35 Content-Type: text/plain; charset=US-ASCII; name="log2.txt" Content-Disposition: attachment; filename="log2.txt" Content-Transfer-Encoding: base64 X-Attachment-Id: f_i6qx159o0 Y29tbWFuZDogc2ggL3Vzci9zaGFyZS9leGFtcGxlcy9iaHl2ZS92bXJ1bi5zaCAtbSA0RyAtZCAv dm0vc2Nhbi1jaS5GcmVlQlNELm9yZy9kaXNrLmltZyB2bXRlc3QxCkxhdW5jaGluZyB2aXJ0dWFs IG1hY2hpbmUgInZtdGVzdDEiIC4uLgpDb25zb2xlczogdXNlcmJvb3QgIAoKRnJlZUJTRC9hbWQ2 NCBVc2VyIGJvb3QsIFJldmlzaW9uIDEuMQoocm9kcmlnY0B3cmVjay55c3YuZnJlZWJzZC5vcmcs IFR1ZSBPY3QgMjEgMDU6MTg6MTkgVVRDIDIwMTQpCkxvYWRpbmcgL2Jvb3QvZGVmYXVsdHMvbG9h ZGVyLmNvbmYgCkVTQ1tIRVNDW0pFU0NbNzs0NkggYGBgICAgICAgICAgICAgICAgICAgICAgICAg YEVTQ1s4OzQ2SHNgIGAuLi4uLi0tLS4uLi4uLi4tLS5gYGAgICAtL0VTQ1sgIF9fX19fXyAgICAg ICAgICAgICAgIF9fX18gICBfX19fXyBfX19fXyAgCiB8ICBfX19ffCAgICAgICAgICAgICB8ICBf IFwgLyBfX19ffCAgX18gXCAKIHwgfF9fXyBfIF9fIF9fXyAgX19fIHwgfF8pIHwgKF9fXyB8IHwg IHwgfAogfCAgX19ffCAnX18vIF8gXC8gXyBcfCAgXyA8IFxfX18gXHwgfCAgfCB8CiB8IHwgICB8 IHwgfCAgX18vICBfXy98IHxfKSB8X19fXykgfCB8X198IHwKIHwgfCAgIHwgfCB8ICAgIHwgICAg fHwgICAgIHwgICAgICB8ICAgICAgfAogfF98ICAgfF98ICBcX19ffFxfX198fF9fX18vfF9fX19f L3xfX19fXy8gICAgYGBgICAgICAgICAgICAgICAgICAgICAgICAgYAogICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICBzYCBgLi4uLi4tLS0uLi4uLi4uLS0uYGBgICAg LS8KICstLS0tLS0tLS0tLS1XZWxjb21lIHRvIEZyZWVCU0QtLS0tLS0tLS0tLSsgK28gICAuLS1g ICAgICAgICAgL3k6YCAgICAgICsuCiB8ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICB8ICB5b2A6LiAgICAgICAgICAgIDpvICAgICAgYCstCiB8ICAxLiBCb290IE11bHRp IFVzZXIgW0VudGVyXSAgICAgICAgICAgICB8ICAgeS8gICAgICAgICAgICAgICAtL2AgICAtby8K IHwgIDIuIEJvb3QgW1NdaW5nbGUgVXNlciAgICAgICAgICAgICAgICAgIHwgIC4tICAgICAgICAg ICAgICAgICAgOjovc3krOi4KIHwgIDMuIFtFc2NdYXBlIHRvIGxvYWRlciBwcm9tcHQgICAgICAg ICAgIHwgIC8gICAgICAgICAgICAgICAgICAgICBgLS0gIC8KIHwgIDQuIFJlYm9vdCAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgIHwgYDogICAgICAgICAgICAgICAgICAgICAgICAgIDpgCiB8 ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICB8IGA6ICAgICAgICAgICAg ICAgICAgICAgICAgICA6YAogfCAgT3B0aW9uczogICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgfCAgLyAgICAgICAgICAgICAgICAgICAgICAgICAgLwogfCAgNS4gW0tdZXJuZWw6IGtlcm5l bCAoMSBvZiAyKSAgICAgICAgICAgfCAgLi0gICAgICAgICAgICAgICAgICAgICAgICAtLgogfCAg Ni4gQ29uZmlndXJlIEJvb3QgW09dcHRpb25zLi4uICAgICAgICAgfCAgIC0tICAgICAgICAgICAg ICAgICAgICAgIC0uCiB8ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICB8 ICAgIGA6YCAgICAgICAgICAgICAgICAgIGA6YAogfCAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgfCAgICAgIC4tLSAgICAgICAgICAgICBgLS0uCiB8ICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICB8ICAgICAgICAgLi0tLS4uLi4uLS0tLS4KICst LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLSsKICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgCgovYm9vdC9rZXJuZWwva2VybmVsIHRleHQ9MHhm ODQ5ZDggZGF0YT0weDExZGY1OCsweDQ2YzExMCBzeW1zPVsweDgrMHgxNDNjMTArMHg4KzB4MTVk ZmMxXQovYm9vdC9rZXJuZWwvemZzLmtvIHNpemUgMHgyZGQ2NDAgYXQgMHgxYmIxMDAwCmxvYWRp bmcgcmVxdWlyZWQgbW9kdWxlICdvcGVuc29sYXJpcycKL2Jvb3Qva2VybmVsL29wZW5zb2xhcmlz LmtvIHNpemUgMHg4MWYwIGF0IDB4MWU4ZjAwMApCb290aW5nLi4uCnZtX3J1biBlcnJvciAtMSwg ZXJybm8gMjUKClNjcmlwdCBkb25lIG9uIFN1biBNYXIgIDEgMjA6NDY6MTkgMjAxNQo= --001a11c3337e177c730510404e35-- From owner-freebsd-virtualization@FreeBSD.ORG Mon Mar 2 01:47:48 2015 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 42004A9F; Mon, 2 Mar 2015 01:47:48 +0000 (UTC) Received: from mail-we0-x22f.google.com (mail-we0-x22f.google.com [IPv6:2a00:1450:400c:c03::22f]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id CA4DA5F4; Mon, 2 Mar 2015 01:47:47 +0000 (UTC) Received: by wesw62 with SMTP id w62so30449235wes.9; Sun, 01 Mar 2015 17:47:45 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=GN6LWJpXjkVRiUJfG8mQFJc+gfqzcB/Z+5ydu6hLE18=; b=ILL61v5ybiMfDvluRZ0v7D/dLA8+Fr4muGSBRMYMm+w+NQcr6VuAU0W9shm5bw0m6X 3q4C4OolSBRxetPR5/kQ8FMBpBJlX72wAo/4tEobjz30aOsgY+AEzx/4qxG3LFcRye/K eSOVhzMecruM0f64KSqN2tfaLD2YFkSjO30xwF4JmgVveUy1hjBdHDzUp5cBfT6KR0cn 1/GRVpIUC89Rxc6Z0XmHtaAe89fifyv/fdb8ohcGhs0rtw5kx7QVgLvtZsjwub7C8gZ/ 4t1nwILJBcpstsFnXOsGGweQPSGZDAAMhZpnlIYLe5gCBHjieA9XKeLE1ZvAYIGJMbQD RlCw== MIME-Version: 1.0 X-Received: by 10.180.87.106 with SMTP id w10mr30753553wiz.62.1425260865728; Sun, 01 Mar 2015 17:47:45 -0800 (PST) Received: by 10.27.91.79 with HTTP; Sun, 1 Mar 2015 17:47:45 -0800 (PST) In-Reply-To: References: Date: Sun, 1 Mar 2015 17:47:45 -0800 Message-ID: Subject: Re: bhyve failure: vm_run error -1, errno 25 From: Neel Natu To: Craig Rodrigues Content-Type: text/plain; charset=UTF-8 Cc: "jenkins-admin@freebsd.org" , "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 02 Mar 2015 01:47:48 -0000 Hi Craig, On Sun, Mar 1, 2015 at 12:54 PM, Craig Rodrigues wrote: > Hi, > > I recently did the following: > > (1) Updated to svn r279489, rebuilt world/kernel and rebooted. > > (2) Ran this: sh /usr/share/examples/bhyve/vmrun.sh -m 4G -d /vm/ > scan-ci.FreeBSD.org/disk.img vmtest1 > > (3) Got this error: vm_run error -1, errno 25 > See attached log. > > Any idea what is going on? This VM used to work, and I did not > get this error before. > I think that this is due to world and kernel not being in sync: [neel@wreck ~]$ uname -K 1100062 [neel@wreck ~]$ uname -U 1100039 Can you update world and see if the issue persists? best Neel > This is on wreck.ysv.freebsd.org, so Neel and Peter should have access to > debug if necessary. > > Thanks. > > -- > Craig > > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@freebsd.org" From owner-freebsd-virtualization@FreeBSD.ORG Mon Mar 2 16:27:55 2015 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id C3E14826 for ; Mon, 2 Mar 2015 16:27:55 +0000 (UTC) Received: from mail.nomadlogic.org (mail.nomadlogic.org [IPv6:2607:f2f8:a098::4]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id A67FBE07 for ; Mon, 2 Mar 2015 16:27:55 +0000 (UTC) Received: from mail.nomadlogic.org (localhost [127.0.0.1]) (using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by mail.nomadlogic.org (Postfix) with ESMTPS id 4AB1A125EE7 for ; Mon, 2 Mar 2015 08:27:48 -0800 (PST) Received: from cardiff.local (cpe-23-242-83-219.socal.res.rr.com [23.242.83.219]) (using TLSv1 with cipher DHE-RSA-AES128-SHA (128/128 bits)) (No client certificate requested) by mail.nomadlogic.org (Postfix) with ESMTPSA id 3566C125EE1 for ; Mon, 2 Mar 2015 08:27:48 -0800 (PST) Message-ID: <54F48F83.30608@nomadlogic.org> Date: Mon, 02 Mar 2015 08:27:47 -0800 From: Pete Wright User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:31.0) Gecko/20100101 Thunderbird/31.5.0 MIME-Version: 1.0 To: freebsd-virtualization@freebsd.org Subject: Re: HEADS UP: PCI SR-IOV infrastructure has been committed to head References: In-Reply-To: Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 02 Mar 2015 16:27:55 -0000 On 2/28/15 6:01 PM, Ryan Stone wrote: > I've just finished committing support for PCI Single Root I/O > Virtualization in the pci subsystem to head. This should be a no-op > for everyone right now, but there were some minor refactorings in the > pci code that could have a lingering bug. I did make sure to test > that it boots on a variety of systems (but only i386/amd64, as that's > all that I have access to). > awesome - this is great stuff! i'm looking forward to testing this when more driver vendors get sync'd up with this code (specifically solarflare). in lieu of working drivers is there any other testing that can be done now? Cheers, -pete -- Pete Wright pete@nomadlogic.org twitter => @nomadlogicLA From owner-freebsd-virtualization@FreeBSD.ORG Tue Mar 3 18:14:31 2015 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id E9540E68 for ; Tue, 3 Mar 2015 18:14:31 +0000 (UTC) Received: from mail.gloriad.org (mail.gloriad.org [160.36.208.244]) by mx1.freebsd.org (Postfix) with ESMTP id B77FA1FE for ; Tue, 3 Mar 2015 18:14:31 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by mail.gloriad.org (Postfix) with ESMTP id 38E3C4638B3C for ; Tue, 3 Mar 2015 13:08:19 -0500 (EST) X-Virus-Scanned: amavisd-new at mail.gloriad.org Received: from mail.gloriad.org ([127.0.0.1]) by localhost (mail.gloriad.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 5pM7An9qU-3y for ; Tue, 3 Mar 2015 13:08:19 -0500 (EST) Received: from harikadev.gloriad.utk.edu (harikadev.gloriad.utk.edu [160.36.208.154]) by mail.gloriad.org (Postfix) with ESMTPSA id 207D34638B34 for ; Tue, 3 Mar 2015 13:08:19 -0500 (EST) From: Harika Tandra X-Pgp-Agent: GPGMail 2.5b5 Content-Type: multipart/signed; boundary="Apple-Mail=_F1D6391B-67D2-4E91-BB10-FF1F0E4C6388"; protocol="application/pgp-signature"; micalg=pgp-sha512 Subject: Using Vagrant with Bhyve Date: Tue, 3 Mar 2015 13:08:09 -0500 Message-Id: <1A8DF8AA-2DE6-43B4-859C-F121BA90E935@gloriad.org> To: freebsd-virtualization@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 8.2 \(2070.6\)) X-Mailer: Apple Mail (2.2070.6) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 03 Mar 2015 18:14:32 -0000 --Apple-Mail=_F1D6391B-67D2-4E91-BB10-FF1F0E4C6388 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii Hello everyone, I wanted to check if anyone in the community is using Vagrant with Bhyve = ? As per my understanding it requires building custom Vagrant provider for = Bhyve. If anyone has worked on it could you please share your experience. Thanks, HT. --Apple-Mail=_F1D6391B-67D2-4E91-BB10-FF1F0E4C6388 Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP using GPGMail -----BEGIN PGP SIGNATURE----- Comment: GPGTools - http://gpgtools.org iQEcBAEBCgAGBQJU9fiQAAoJEOFgjpnyJx85k0EH/iSBrxgeTc1Jv91j0x3eqIs0 bL+tF2V1lI+S6IHKOK2F0kvgSAlp91JIm8FkkpzWjt5gU/uQwrhY6U2B1tpMfyX/ 9/tibN9w6GI/yLC654yakC9gmGla1WaZsbR2BHyqF6tpSuWfqpHAs+PPxJ+a7UYG JzSblrvSPsV0Xuv4nFG1vySRnLtVSreSiFDq0fQO1gbgzef0i+fRbQnfjJLakM6C 8tL8XqTfKSiVIuqEb6lhCmy0qZGjZat/S/5i7C09C8BAcA2GzDTr8Q9kTrz4KNcV zbKUyozeTDPR0LpeZAcZBrmsOdMuvFHHDQ4FqdU/lzeoOg4PwGdyZWDE9YwY7ls= =Vjq5 -----END PGP SIGNATURE----- --Apple-Mail=_F1D6391B-67D2-4E91-BB10-FF1F0E4C6388-- From owner-freebsd-virtualization@FreeBSD.ORG Thu Mar 5 08:24:46 2015 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id D8485224; Thu, 5 Mar 2015 08:24:46 +0000 (UTC) Received: from mail-la0-x229.google.com (mail-la0-x229.google.com [IPv6:2a00:1450:4010:c03::229]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 55068F4D; Thu, 5 Mar 2015 08:24:46 +0000 (UTC) Received: by labgf13 with SMTP id gf13so25288491lab.5; Thu, 05 Mar 2015 00:24:44 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type; bh=ZitRaF4zJZdAAqs6nB5cjfwhg3porjiS5YCwpr78ovs=; b=Gn4v5BRAqcp8CsTshBK88XLnculcuU9jV2mSsqBwN/8I4mM/r3H80DQ1sgU7QZgj6I pGlOkKwmQwpsme8oVaX3NOK4kVFddFC2FoCCa+OQG4wlZ+13JWeqqg5grcVdBvgmEBK2 vgvsm5Gz/jyCJqXLpPq4RX/U9s7p7uzPtRmlwnvaOeXMTdC1guWCx3gKYMT403T3kN+v uiYVKCyiK5du9qbodrt8VCbUT5i+3SvIXMpz1njpmeNi6JNQ2fcJ23qzhyN04XT4q3wm S44iPkaLSrN5x/Nk/LH2Ee2Z1khzzOG31Hkwa7bAuWr/jOBhlGnh/0dEzrC+kqMAxnYM UI3A== MIME-Version: 1.0 X-Received: by 10.153.4.44 with SMTP id cb12mr6881418lad.26.1425543884377; Thu, 05 Mar 2015 00:24:44 -0800 (PST) Sender: crodr001@gmail.com Received: by 10.112.82.164 with HTTP; Thu, 5 Mar 2015 00:24:44 -0800 (PST) In-Reply-To: References: Date: Thu, 5 Mar 2015 00:24:44 -0800 X-Google-Sender-Auth: 7OQ9tRGs3x-oKVwivLIqcEWsfvo Message-ID: Subject: Re: bhyve failure: vm_run error -1, errno 25 From: Craig Rodrigues To: Neel Natu Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 Cc: "jenkins-admin@freebsd.org" , "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Mar 2015 08:24:46 -0000 On Sun, Mar 1, 2015 at 5:47 PM, Neel Natu wrote: > Hi Craig, > > I think that this is due to world and kernel not being in sync: > > [neel@wreck ~]$ uname -K > 1100062 > [neel@wreck ~]$ uname -U > 1100039 > > Can you update world and see if the issue persists? > > I updated and recompiled everything and now have: [rodrigc@wreck ~]$ uname -K 1100062 [rodrigc@wreck ~]$ uname -U 1100062 I rebooted the system, and now bhyve works. Thanks! -- Craig From owner-freebsd-virtualization@FreeBSD.ORG Sat Mar 7 12:50:00 2015 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 1E422BE9 for ; Sat, 7 Mar 2015 12:50:00 +0000 (UTC) Received: from postout2.mail.lrz.de (postout2.mail.lrz.de [IPv6:2001:4ca0:0:103::81bb:ff8a]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id B99498F0 for ; Sat, 7 Mar 2015 12:49:59 +0000 (UTC) Received: from lxmhs52.srv.lrz.de (localhost [127.0.0.1]) by postout2.mail.lrz.de (Postfix) with ESMTP id 3kzlyS71gGzySc for ; Sat, 7 Mar 2015 13:49:52 +0100 (CET) X-Virus-Scanned: by amavisd-new at lrz.de in lxmhs52.srv.lrz.de X-Spam-Flag: NO X-Spam-Score: -1.887 X-Spam-Level: X-Spam-Status: No, score=-1.887 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, LRZ_DATE_TZ_0000=0.001, LRZ_DKIM_DESTROY_MTA=0.001, LRZ_DMARC_OVERWRITE=0.001, LRZ_FROM_PHRASE=0.001, LRZ_FROM_PRE_SUR=0.001, LRZ_FROM_PRE_SUR_PHRASE=0.001, LRZ_FWD_MS_EX=0.001, LRZ_HAS_X_ORIG_IP=0.001, LRZ_MSGID_AN_AN=0.001, LRZ_MSGID_D_HU=0.001, LRZ_MSGID_SPAM_68=0.001, LRZ_RCVD_MS_EX=0.001, SPF_HELO_NONE=0.001] autolearn=no Received: from postout2.mail.lrz.de ([127.0.0.1]) by lxmhs52.srv.lrz.de (lxmhs52.srv.lrz.de [127.0.0.1]) (amavisd-new, port 20024) with LMTP id Qg2VUh1asgB2 for ; Sat, 7 Mar 2015 13:49:52 +0100 (CET) Received: from BADWLRZ-SW13MB1.ads.mwn.de (BADWLRZ-SW13MB1.ads.mwn.de [IPv6:2001:4ca0:0:108::155]) (using TLSv1 with cipher RC4-SHA (128/128 bits)) (Client CN "BADWLRZ-SW13MB1", Issuer "BADWLRZ-SW13MB1" (not verified)) by postout2.mail.lrz.de (Postfix) with ESMTPS id 3kzlyS32BJzySn for ; Sat, 7 Mar 2015 13:49:52 +0100 (CET) Received: from BADWLRZ-SW13MB1.ads.mwn.de (2001:4ca0:0:108::155) by BADWLRZ-SW13MB1.ads.mwn.de (2001:4ca0:0:108::155) with Microsoft SMTP Server (TLS) id 15.0.1044.25; Sat, 7 Mar 2015 13:49:51 +0100 Received: from BADWLRZ-SW13MB1.ads.mwn.de ([fe80::89:5514:4b27:d8be]) by BADWLRZ-SW13MB1.ads.mwn.de ([fe80::89:5514:4b27:d8be%12]) with mapi id 15.00.1044.021; Sat, 7 Mar 2015 13:49:51 +0100 From: Noah Bergbauer To: "freebsd-virtualization@freebsd.org" Subject: bhyve virtio-net MTU Thread-Topic: bhyve virtio-net MTU Thread-Index: AQHQWNH7gaNw8KNXVk2UjbPmTlFOyw== Date: Sat, 7 Mar 2015 12:49:50 +0000 Message-ID: <1425732590516.79490@tum.de> Accept-Language: de-DE, en-US Content-Language: de-DE X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-exchange-transport-fromentityheader: Hosted x-originating-ip: [217.249.206.110] Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 07 Mar 2015 12:50:00 -0000 Hi,=0A= =0A= I'm running FreeBSD 10.1 on a dedicated server, with a Linux VM in bhyve. T= he handbook tells you to bridge the tap interface to a real network interfa= ce, but that's not an option for me because I only have one IPv4 address. S= o instead, I assigned an internal IP address to bridge0 and used pf(4) to s= et up NAT routing.=0A= All of this works without any issues, but I would like to increase the MTU = of 1500. It's a virtual interface after all, why should it be so low? FreeB= SD's loopback interface's MTU is 16384 and on Linux, it's even 65536.=0A= =0A= So I used ifconfig(8) to increase the MTU of tap0 and just like the manpage= says, bridge0 had the same MTU after I added tap0. On the Linux side, I di= d the same with eth0 and then I sent 2000 byte pings to the host machine.= =0A= =0A= It seems to work, but let's use tcpdump(8) to make sure:=0A= =0A= 02:02:46.244678 IP 10.42.42.100 > 10.42.42.1: ICMP echo request, id 1686, s= eq 3, length 2008=0A= 02:02:46.244983 IP 10.42.42.1 > 10.42.42.100: ICMP echo reply, id 1686, seq= 3, length 1480=0A= 02:02:46.245061 IP 10.42.42.1 > 10.42.42.100: ip-proto-1=0A= 02:02:47.244953 IP 10.42.42.100 > 10.42.42.1: ICMP echo request, id 1686, s= eq 4, length 2008=0A= 02:02:47.245347 IP 10.42.42.1 > 10.42.42.100: ICMP echo reply, id 1686, seq= 4, length 1480=0A= 02:02:47.245422 IP 10.42.42.1 > 10.42.42.100: ip-proto-1=0A= =0A= The entire request goes through the virtio NIC, tap0, bridge0 and finally t= o the host's kernel without any issues. Which then sends a _fragmented_=A0r= eply because apparently it still thinks the MTU is 1500.=0A= =0A= A quick check with route(8) confirms this:=0A= =0A= # route show 10.42.42.100=0A= =A0 =A0route to: 10.42.42.100=0A= destination: 10.42.42.0=0A= =A0 =A0 =A0 =A0mask: 255.255.255.0=0A= =A0 =A0 =A0 =A0 fib: 0=0A= =A0 interface: bridge0=0A= =A0 =A0 =A0 flags: =0A= =A0recvpipe =A0sendpipe =A0ssthresh =A0rtt,msec =A0 =A0mtu =A0 =A0 =A0 =A0w= eight =A0 =A0expire=0A= =A0 =A0 =A0 =A00 =A0 =A0 =A0 =A0 0 =A0 =A0 =A0 =A0 0 =A0 =A0 =A0 =A0 0 =A0 = =A0 =A01500 =A0 =A0 =A0 =A0 1 =A0 =A0 =A0 =A0 0=A0=0A= =0A= So I manually forced a bigger MTU:=0A= =0A= # route change -net 10.42.42.0 -mtu 15000=0A= change net 10.42.42.0=0A= =0A= But now the reply=A0packets get truncated instead of fragmented:=0A= =0A= 02:07:36.921165 IP 10.42.42.100 > 10.42.42.1: ICMP echo request, id 1689, s= eq 3, length 2008=0A= 02:07:36.921624 IP truncated-ip - 6 bytes missing! 10.42.42.1 > 10.42.42.10= 0: ICMP echo reply, id 1689, seq 3, length 2008=0A= 02:07:37.921042 IP 10.42.42.100 > 10.42.42.1: ICMP echo request, id 1689, s= eq 4, length 2008=0A= 02:07:37.921499 IP truncated-ip - 518 bytes missing! 10.42.42.1 > 10.42.42.= 100: ICMP echo reply, id 1689, seq 4, length 2008=0A= 02:07:38.921522 IP 10.42.42.100 > 10.42.42.1: ICMP echo request, id 1689, s= eq 5, length 2008=0A= 02:07:38.922253 IP truncated-ip - 518 bytes missing! 10.42.42.1 > 10.42.42.= 100: ICMP echo reply, id 1689, seq 5, length 2008=0A= 02:07:39.921432 IP 10.42.42.100 > 10.42.42.1: ICMP echo request, id 1689, s= eq 6, length 2008=0A= 02:07:39.922165 IP truncated-ip - 518 bytes missing! 10.42.42.1 > 10.42.42.= 100: ICMP echo reply, id 1689, seq 6, length 2008=0A= 02:07:40.921513 IP 10.42.42.100 > 10.42.42.1: ICMP echo request, id 1689, s= eq 7, length 2008=0A= 02:07:40.922245 IP truncated-ip - 518 bytes missing! 10.42.42.1 > 10.42.42.= 100: ICMP echo reply, id 1689, seq 7, length 2008=0A= 02:07:41.921393 IP 10.42.42.100 > 10.42.42.1: ICMP echo request, id 1689, s= eq 8, length 2008=0A= 02:07:41.922160 IP truncated-ip - 518 bytes missing! 10.42.42.1 > 10.42.42.= 100: ICMP echo reply, id 1689, seq 8, length 2008=0A= 02:07:42.921504 IP 10.42.42.100 > 10.42.42.1: ICMP echo request, id 1689, s= eq 9, length 2008=0A= 02:07:42.922348 IP truncated-ip - 518 bytes missing! 10.42.42.1 > 10.42.42.= 100: ICMP echo reply, id 1689, seq 9, length 2008=0A= 02:07:43.923031 IP 10.42.42.100 > 10.42.42.1: ICMP echo request, id 1689, s= eq 10, length 2008=0A= 02:07:43.924904 IP truncated-ip - 6 bytes missing! 10.42.42.1 > 10.42.42.10= 0: ICMP echo reply, id 1689, seq 10, length 2008=0A= 02:07:44.926832 IP 10.42.42.100 > 10.42.42.1: ICMP echo request, id 1689, s= eq 11, length 2008=0A= 02:07:44.928511 IP truncated-ip - 518 bytes missing! 10.42.42.1 > 10.42.42.= 100: ICMP echo reply, id 1689, seq 11, length 2008=0A= 02:07:45.936968 IP 10.42.42.100 > 10.42.42.1: ICMP echo request, id 1689, s= eq 12, length 2008=0A= 02:07:45.937722 IP truncated-ip - 518 bytes missing! 10.42.42.1 > 10.42.42.= 100: ICMP echo reply, id 1689, seq 12, length 2008=0A= 02:07:46.937453 IP 10.42.42.100 > 10.42.42.1: ICMP echo request, id 1689, s= eq 13, length 2008=0A= 02:07:46.938161 IP truncated-ip - 518 bytes missing! 10.42.42.1 > 10.42.42.= 100: ICMP echo reply, id 1689, seq 13, length 2008=0A= ^C=0A= 22 packets captured=0A= 24 packets received by filter=0A= 0 packets dropped by kernel=0A= =0A= This last dump was on the Linux side. Dumping at tap0 shows that the reply = packets are still okay when they reach bhyve. Apparently they get truncated= by bhyve's virtio-net as increasing the MTU works just fine with=A0Virtual= Box's virtio-net (at least on my Linux machine).=0A= =0A= Any ideas on how I can fix this? I had a quick look at the code and while a= comment indicates that=A0Ethernet-sized packets are assumed=A0(https://svn= web.freebsd.org/base/release/10.1.0/usr.sbin/bhyve/pci_virtio_net.c?revisio= n=3D274417&view=3Dmarkup#l257), I was unable to find code that confirms thi= s.=0A= =0A= Noah= From owner-freebsd-virtualization@FreeBSD.ORG Sat Mar 7 16:21:57 2015 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id B5C26A01 for ; Sat, 7 Mar 2015 16:21:57 +0000 (UTC) Received: from mx1.scaleengine.net (beauharnois2.bhs1.scaleengine.net [142.4.218.15]) by mx1.freebsd.org (Postfix) with ESMTP id 8DD9532F for ; Sat, 7 Mar 2015 16:21:56 +0000 (UTC) Received: from [192.168.1.2] (Seawolf.HML3.ScaleEngine.net [209.51.186.28]) (Authenticated sender: allanjude.freebsd@scaleengine.com) by mx1.scaleengine.net (Postfix) with ESMTPSA id A36219B7BE for ; Sat, 7 Mar 2015 16:21:55 +0000 (UTC) Message-ID: <54FB25C0.7060803@freebsd.org> Date: Sat, 07 Mar 2015 11:22:24 -0500 From: Allan Jude User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:31.0) Gecko/20100101 Thunderbird/31.5.0 MIME-Version: 1.0 To: freebsd-virtualization@freebsd.org Subject: Re: bhyve virtio-net MTU References: <1425732590516.79490@tum.de> In-Reply-To: <1425732590516.79490@tum.de> Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="ILslUU8kIojoROHhbjhtiL55rL4UfWAtU" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 07 Mar 2015 16:21:57 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --ILslUU8kIojoROHhbjhtiL55rL4UfWAtU Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable On 2015-03-07 07:49, Noah Bergbauer wrote: > Hi, >=20 > I'm running FreeBSD 10.1 on a dedicated server, with a Linux VM in bhyv= e. The handbook tells you to bridge the tap interface to a real network i= nterface, but that's not an option for me because I only have one IPv4 ad= dress. So instead, I assigned an internal IP address to bridge0 and used = pf(4) to set up NAT routing. > All of this works without any issues, but I would like to increase the = MTU of 1500. It's a virtual interface after all, why should it be so low?= FreeBSD's loopback interface's MTU is 16384 and on Linux, it's even 6553= 6. >=20 > So I used ifconfig(8) to increase the MTU of tap0 and just like the man= page says, bridge0 had the same MTU after I added tap0. On the Linux side= , I did the same with eth0 and then I sent 2000 byte pings to the host ma= chine. >=20 > It seems to work, but let's use tcpdump(8) to make sure: >=20 > 02:02:46.244678 IP 10.42.42.100 > 10.42.42.1: ICMP echo request, id 168= 6, seq 3, length 2008 > 02:02:46.244983 IP 10.42.42.1 > 10.42.42.100: ICMP echo reply, id 1686,= seq 3, length 1480 > 02:02:46.245061 IP 10.42.42.1 > 10.42.42.100: ip-proto-1 > 02:02:47.244953 IP 10.42.42.100 > 10.42.42.1: ICMP echo request, id 168= 6, seq 4, length 2008 > 02:02:47.245347 IP 10.42.42.1 > 10.42.42.100: ICMP echo reply, id 1686,= seq 4, length 1480 > 02:02:47.245422 IP 10.42.42.1 > 10.42.42.100: ip-proto-1 >=20 > The entire request goes through the virtio NIC, tap0, bridge0 and final= ly to the host's kernel without any issues. Which then sends a _fragmente= d_ reply because apparently it still thinks the MTU is 1500. >=20 > A quick check with route(8) confirms this: >=20 > # route show 10.42.42.100 > route to: 10.42.42.100 > destination: 10.42.42.0 > mask: 255.255.255.0 > fib: 0 > interface: bridge0 > flags: > recvpipe sendpipe ssthresh rtt,msec mtu weight expire > 0 0 0 0 1500 1 0=20 >=20 > So I manually forced a bigger MTU: >=20 > # route change -net 10.42.42.0 -mtu 15000 > change net 10.42.42.0 >=20 > But now the reply packets get truncated instead of fragmented: >=20 > 02:07:36.921165 IP 10.42.42.100 > 10.42.42.1: ICMP echo request, id 168= 9, seq 3, length 2008 > 02:07:36.921624 IP truncated-ip - 6 bytes missing! 10.42.42.1 > 10.42.4= 2.100: ICMP echo reply, id 1689, seq 3, length 2008 > 02:07:37.921042 IP 10.42.42.100 > 10.42.42.1: ICMP echo request, id 168= 9, seq 4, length 2008 > 02:07:37.921499 IP truncated-ip - 518 bytes missing! 10.42.42.1 > 10.42= =2E42.100: ICMP echo reply, id 1689, seq 4, length 2008 > 02:07:38.921522 IP 10.42.42.100 > 10.42.42.1: ICMP echo request, id 168= 9, seq 5, length 2008 > 02:07:38.922253 IP truncated-ip - 518 bytes missing! 10.42.42.1 > 10.42= =2E42.100: ICMP echo reply, id 1689, seq 5, length 2008 > 02:07:39.921432 IP 10.42.42.100 > 10.42.42.1: ICMP echo request, id 168= 9, seq 6, length 2008 > 02:07:39.922165 IP truncated-ip - 518 bytes missing! 10.42.42.1 > 10.42= =2E42.100: ICMP echo reply, id 1689, seq 6, length 2008 > 02:07:40.921513 IP 10.42.42.100 > 10.42.42.1: ICMP echo request, id 168= 9, seq 7, length 2008 > 02:07:40.922245 IP truncated-ip - 518 bytes missing! 10.42.42.1 > 10.42= =2E42.100: ICMP echo reply, id 1689, seq 7, length 2008 > 02:07:41.921393 IP 10.42.42.100 > 10.42.42.1: ICMP echo request, id 168= 9, seq 8, length 2008 > 02:07:41.922160 IP truncated-ip - 518 bytes missing! 10.42.42.1 > 10.42= =2E42.100: ICMP echo reply, id 1689, seq 8, length 2008 > 02:07:42.921504 IP 10.42.42.100 > 10.42.42.1: ICMP echo request, id 168= 9, seq 9, length 2008 > 02:07:42.922348 IP truncated-ip - 518 bytes missing! 10.42.42.1 > 10.42= =2E42.100: ICMP echo reply, id 1689, seq 9, length 2008 > 02:07:43.923031 IP 10.42.42.100 > 10.42.42.1: ICMP echo request, id 168= 9, seq 10, length 2008 > 02:07:43.924904 IP truncated-ip - 6 bytes missing! 10.42.42.1 > 10.42.4= 2.100: ICMP echo reply, id 1689, seq 10, length 2008 > 02:07:44.926832 IP 10.42.42.100 > 10.42.42.1: ICMP echo request, id 168= 9, seq 11, length 2008 > 02:07:44.928511 IP truncated-ip - 518 bytes missing! 10.42.42.1 > 10.42= =2E42.100: ICMP echo reply, id 1689, seq 11, length 2008 > 02:07:45.936968 IP 10.42.42.100 > 10.42.42.1: ICMP echo request, id 168= 9, seq 12, length 2008 > 02:07:45.937722 IP truncated-ip - 518 bytes missing! 10.42.42.1 > 10.42= =2E42.100: ICMP echo reply, id 1689, seq 12, length 2008 > 02:07:46.937453 IP 10.42.42.100 > 10.42.42.1: ICMP echo request, id 168= 9, seq 13, length 2008 > 02:07:46.938161 IP truncated-ip - 518 bytes missing! 10.42.42.1 > 10.42= =2E42.100: ICMP echo reply, id 1689, seq 13, length 2008 > ^C > 22 packets captured > 24 packets received by filter > 0 packets dropped by kernel >=20 > This last dump was on the Linux side. Dumping at tap0 shows that the re= ply packets are still okay when they reach bhyve. Apparently they get tru= ncated by bhyve's virtio-net as increasing the MTU works just fine with V= irtualBox's virtio-net (at least on my Linux machine). >=20 > Any ideas on how I can fix this? I had a quick look at the code and whi= le a comment indicates that Ethernet-sized packets are assumed (https://s= vnweb.freebsd.org/base/release/10.1.0/usr.sbin/bhyve/pci_virtio_net.c?rev= ision=3D274417&view=3Dmarkup#l257), I was unable to find code that confir= ms this. >=20 > Noah > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@fr= eebsd.org" >=20 There is a 'do not fragment' flag you can sent with ping to help debug th= is. --=20 Allan Jude --ILslUU8kIojoROHhbjhtiL55rL4UfWAtU Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.22 (MingW32) iQIcBAEBAgAGBQJU+yXDAAoJEJrBFpNRJZKf/h0QAKaPsajrY+rRPV48CXU+CSqP ktIxTACtXFKfYCxqEHRyspLCBC3qVOJ05G5VkW1cl0wOuGD1p28FtEOtb9xjypeS 8/boChdQuU9H1pkjWdVtkc71CbMKJ0KNvbuU5C3fw8sn73u6TS7D9wQ8Nd0dI2Yp XWRNWRa9P+uQaJ0hy2lyToPGgvbjIQYvZnfFOdn3M2BMsz11DZQ2758U1+zvazJ4 rkKCBNInCUZzb+tWBaXOeAi8qaBPRAaqV9FUvuo/pf14QhmzAtJPxXfe3hTZInoX +f77M4dY5Q1dXtONcDwXpauinTZhso77vN6FwOweG/cV6AU39uEZVELRUehLBTgT 1rKU5robneZh8vE37jWF/mE2faTAv2VqmTt7Zcvvg7fbhjKgJjjVKYAWVPvGOREZ WiiWP7mHGoqlsKY3G0cZi0yU7ZUY5GpcqCrerxkxLC4+Z3Y6zvG21+B/28fdTHYt gjptkA337TfxwzqGVAKeABxcYLevfWEM0omUTV/ZnrAbDxJu9Te2iGHn4NRhIAgP WoEgOJj2tII9P4f57ZbVRjSe0nPiS2NV7UBFOzLQZjGcfXQ/9Kwd7KAYh354Xj0h yLxQSUU45l8Uhtyers9/a0rBxLDz97tOEm94vTT2Nn9Vf0raWYXh7IkHq6Wrl2jI L+Sh8BEF8rUfo4PocJTW =l9n5 -----END PGP SIGNATURE----- --ILslUU8kIojoROHhbjhtiL55rL4UfWAtU-- From owner-freebsd-virtualization@FreeBSD.ORG Sat Mar 7 16:27:05 2015 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id DA674AF7 for ; Sat, 7 Mar 2015 16:27:05 +0000 (UTC) Received: from iredmail.onthenet.com.au (iredmail.onthenet.com.au [203.13.68.150]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 95F723F3 for ; Sat, 7 Mar 2015 16:27:05 +0000 (UTC) Received: from localhost (iredmail.onthenet.com.au [127.0.0.1]) by iredmail.onthenet.com.au (Postfix) with ESMTP id 388AD281164 for ; Sun, 8 Mar 2015 02:27:02 +1000 (EST) X-Amavis-Modified: Mail body modified (using disclaimer) - iredmail.onthenet.com.au X-Virus-Scanned: amavisd-new at iredmail.onthenet.com.au Received: from iredmail.onthenet.com.au ([127.0.0.1]) by localhost (iredmail.onthenet.com.au [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id a4ANrkZR9b03 for ; Sun, 8 Mar 2015 02:27:02 +1000 (EST) Received: from Peters-MacBook-Pro.local (c-76-126-65-88.hsd1.ca.comcast.net [76.126.65.88]) by iredmail.onthenet.com.au (Postfix) with ESMTPSA id 0EC68281161; Sun, 8 Mar 2015 02:26:59 +1000 (EST) Message-ID: <54FB26D1.7010607@freebsd.org> Date: Sat, 07 Mar 2015 08:26:57 -0800 From: Peter Grehan User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:31.0) Gecko/20100101 Thunderbird/31.5.0 MIME-Version: 1.0 To: Noah Bergbauer Subject: Re: bhyve virtio-net MTU References: <1425732590516.79490@tum.de> In-Reply-To: <1425732590516.79490@tum.de> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 07 Mar 2015 16:27:05 -0000 Hi Noah, > Any ideas on how I can fix this? I had a quick look at the code and > while a comment indicates that Ethernet-sized packets are assumed The appended patch is a temporary fix. I'm working on a better one. later, Peter. --- a/e82580/pci_virtio_net.c +++ b/e82580/pci_virtio_net.c @@ -82,7 +82,7 @@ __FBSDID("$FreeBSD: head/usr.sbin/bhyve/pci_virtio_net.c 271338 2014-09-09 22:35 (1 << 21) /* guest can send gratuitous pkts */ #define VTNET_S_HOSTCAPS \ - ( VIRTIO_NET_F_MAC | VIRTIO_NET_F_MRG_RXBUF | VIRTIO_NET_F_STATUS | \ + ( VIRTIO_NET_F_MAC | VIRTIO_NET_F_STATUS | \ VIRTIO_F_NOTIFY_ON_EMPTY) From owner-freebsd-virtualization@FreeBSD.ORG Sat Mar 7 22:46:26 2015 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id E159EC2B for ; Sat, 7 Mar 2015 22:46:26 +0000 (UTC) Received: from mail-ig0-x236.google.com (mail-ig0-x236.google.com [IPv6:2607:f8b0:4001:c05::236]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id AE52EF27 for ; Sat, 7 Mar 2015 22:46:26 +0000 (UTC) Received: by igqa13 with SMTP id a13so12360102igq.0 for ; Sat, 07 Mar 2015 14:46:26 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=message-id:date:from:user-agent:mime-version:to:subject :content-type:content-transfer-encoding; bh=bYQGJybT00kf1BC/koxaywyZv+ynW3K98jdCsqRnr0U=; b=UlP3yagrCICGDHikyKS57kkeqwpdjMcRdOwUHj+gsu/tfdaaSRJEgCbEs3HcUWlp3B UbABNSbryDoj/325L9iEIW8ZR+qhXCpOvXjnlk3IQ0nr5swFxb5dyY0ecajbdLdHyWxh q/gi+HbZBf8HfLn1pm9qQbst2f1NsPi+ziDLx9yZJwR7p+LpqZkhbxa70G7EoyLzNyD3 ln7ZBTNELrrVn8xI/XQF+QJkOOBr4zu+FvqrGMqllMu/cF1PL/bFpM8EnQ3bFmgyyyIw FFqeAVVby5dfsSdkVbY4Y3mQp5papdK8BqN0cn9drL2xAKGl28SbIAicX44QZsBDDnEd CXCg== X-Received: by 10.107.131.13 with SMTP id f13mr16012276iod.50.1425768385971; Sat, 07 Mar 2015 14:46:25 -0800 (PST) Received: from [192.168.0.104] ([66.11.161.139]) by mx.google.com with ESMTPSA id r78sm9488510ioi.22.2015.03.07.14.46.24 for (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Sat, 07 Mar 2015 14:46:24 -0800 (PST) Message-ID: <54FB7FB7.7020509@gmail.com> Date: Sat, 07 Mar 2015 17:46:15 -0500 From: Manas Bhatnagar User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:31.0) Gecko/20100101 Thunderbird/31.5.0 MIME-Version: 1.0 To: freebsd-virtualization@freebsd.org Subject: Bhyve Suspend/Resume Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 07 Mar 2015 22:46:27 -0000 Hello, I am trying to find out if Bhyve in 10-STABLE has support for suspending and resuming guests. Please let me know. A google search returned a mailing list thread from 2013 that shows it is a feature being worked on. Has this work completed or is it still ongoing? Please let me know. Thanks, Manas From owner-freebsd-virtualization@FreeBSD.ORG Sat Mar 7 22:50:46 2015 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 66798E6A for ; Sat, 7 Mar 2015 22:50:46 +0000 (UTC) Received: from mx1.scaleengine.net (beauharnois2.bhs1.scaleengine.net [142.4.218.15]) by mx1.freebsd.org (Postfix) with ESMTP id 3F79EFE7 for ; Sat, 7 Mar 2015 22:50:45 +0000 (UTC) Received: from [192.168.1.2] (Seawolf.HML3.ScaleEngine.net [209.51.186.28]) (Authenticated sender: allanjude.freebsd@scaleengine.com) by mx1.scaleengine.net (Postfix) with ESMTPSA id B8EB59BB6D for ; Sat, 7 Mar 2015 22:50:44 +0000 (UTC) Message-ID: <54FB80E3.3030202@freebsd.org> Date: Sat, 07 Mar 2015 17:51:15 -0500 From: Allan Jude User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:31.0) Gecko/20100101 Thunderbird/31.5.0 MIME-Version: 1.0 To: freebsd-virtualization@freebsd.org Subject: Re: Bhyve Suspend/Resume References: <54FB7FB7.7020509@gmail.com> In-Reply-To: <54FB7FB7.7020509@gmail.com> Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="xIObaCV2Nqm2hDIeDQb14maRMKh6N8arX" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 07 Mar 2015 22:50:46 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --xIObaCV2Nqm2hDIeDQb14maRMKh6N8arX Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable On 2015-03-07 17:46, Manas Bhatnagar wrote: > Hello, >=20 > I am trying to find out if Bhyve in 10-STABLE has support for suspendin= g > and resuming guests. Please let me know. A google search returned a > mailing list thread from 2013 that shows it is a feature being worked > on. Has this work completed or is it still ongoing? Please let me know.= >=20 > Thanks, > Manas > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@fr= eebsd.org" >=20 No, bhyve in stable/10 does not support suspend/resume. --=20 Allan Jude --xIObaCV2Nqm2hDIeDQb14maRMKh6N8arX Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.22 (MingW32) iQIcBAEBAgAGBQJU+4DlAAoJEJrBFpNRJZKfF3EQAJ2Yw/zjY0ZmoSictZI+6+Ph kfckODvCZ0CP4n6IA8ehZBxt09N4gu/X7/XS+Yi7JK9aRCxwVZ4dXp/Zni2l+AWI dlsnQht/B2T3kTEsbG8Vl9kFzD7KAsYgJYo4bY+tZ2vfdV0Qm1+WKfSrzRX5SvNV xao9HKWnUIF2zyQNMWbJDfEKAKiob00wTOicZEuZIfWwxeYiJIdSequ6n/qAoz7V XRuSOV9bqQclY1tz0kVPYLFT/Ut0Ih12QFiXeeVe5pgAlau2uFdgScGFIEuKqPLM oVggbcTkqoClyuN5S0JEdyl/pBomvZTh48CcxkTwiGoocTjSl8pyr1KQEw8S/PnV RIl4MUgp6TRMb+YIT/1OjamkvqG8NjFa/SSRI+1vSTPIXnLpqd/wON2jSDlyeUlp IIH9Pvz3hPd6BZNNDLxmgD8F4zt1GKJl9cWpMK/gMFiRAt2Wohygc4PNcYeQxUe8 0KLFvkUpRjGp/gdncXkrR0iZkD4oeSA6uTPz3B9kdQidMp5hUMHzkoP/SaywfKjG xVRso5CoTcMlsa/vei0NdvnlxveuxjfRoAZtLvxmnY1KWtXI9KAoCvpVpmOzap38 SMayn4sTrtyJ0z9ya5AGGwltRq4+RHpKU/jL9ZiAIc8Rd6RANc7BTV5P8S93IVlZ N8jh7J5mkECiqEhMag7T =/m8B -----END PGP SIGNATURE----- --xIObaCV2Nqm2hDIeDQb14maRMKh6N8arX--