From owner-freebsd-virtualization@freebsd.org Sun Nov 6 01:54:07 2016 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 07C8AC328E7 for ; Sun, 6 Nov 2016 01:54:07 +0000 (UTC) (envelope-from rajil.s@gmail.com) Received: from mail-pf0-x233.google.com (mail-pf0-x233.google.com [IPv6:2607:f8b0:400e:c00::233]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id CBCEF635 for ; Sun, 6 Nov 2016 01:54:06 +0000 (UTC) (envelope-from rajil.s@gmail.com) Received: by mail-pf0-x233.google.com with SMTP id d2so72664983pfd.0 for ; Sat, 05 Nov 2016 18:54:06 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=subject:to:references:from:message-id:date:user-agent:mime-version :in-reply-to:content-transfer-encoding; bh=bnnI/QRRN9KuclwmVyaH8xCifhAEPN7u+qKAPd9pDZs=; b=N2YR7sGu9a2TMs6pHzEEOIsAFoYw86IqK1RBa3AkHfRdXxN6xpGcnB+hyZuIuwBqur LpgmLwq1TRf/DRSAA/bruEogjnzCGEraxv3ekiUGvIh6FpbNtmS7vZEdKEBFbZBzuq2J U1UqRlo9eHqZPe1H18yzODWbGAHVeoRi1WouwkPoLTrnKXLqJGs86ixuJz+8+iSYdgnU 96SvVnAxWJE7BOfVHhyZh4nGYQn7Af8F4FaYrPsjTsQyht0LyhDFKTRj48EMJYSYJKnk 5JAJ2DqMMvhaaa3oQcXTjt8857f8dkoMuZQ1bQZy09c2TKHM9SRGomcHhQIUAq+n9Xgo 5OVA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:subject:to:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-transfer-encoding; bh=bnnI/QRRN9KuclwmVyaH8xCifhAEPN7u+qKAPd9pDZs=; b=DVRKyUcSzAow8/L5WJJe9xYIVUZNAuvLjQxtM6uXxx5gHTndBa2/pE0lF/nTTxtThk daGDsQSmKecOS6bIbuw+60jPoJUv4vx4p+ydHhI4+h3fMDIWJI8Y6aXiDfLo4X6o6foz e3v8o5WHxAvOhISqS3AfQ7Ufo+qKbHsoY2wkGfTPIP3D++Ztx4/Sv1aYFjDyyDfJr4ZR 75V6h3Rmc8kEqz03jA2hCAMXrqTFr3cJBbCv/jjABvGiEHglSGsvyZEOSxO8mbbOVsxS yQQfVIPmKToCy0Z0yRR674UcKJBqJrAu1aW5Oke4kZHO2FIPAt+jrR1Sa/8bzYwILFud 0t6g== X-Gm-Message-State: ABUngveykUmwcrzAouY20z718zAJbA+nyXR5mjGw2FtzB/dRmNKEP4oXuWsSaUSoOsVnjg== X-Received: by 10.99.144.65 with SMTP id a62mr608334pge.103.1478397246084; Sat, 05 Nov 2016 18:54:06 -0700 (PDT) Received: from ?IPv6:2601:2c2:200:12c7:202:c9ff:fe4e:1dc0? ([2601:2c2:200:12c7:202:c9ff:fe4e:1dc0]) by smtp.gmail.com with ESMTPSA id yz6sm30159768pab.35.2016.11.05.18.54.04 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Sat, 05 Nov 2016 18:54:05 -0700 (PDT) Subject: Re: Bhyve and Poor network speed with Intel X540-AT2 To: freebsd-virtualization@FreeBSD.org References: <9fe097c5-c2ef-fda6-8b99-b4e4d7afff05@gmail.com> From: Rajil Saraswat Message-ID: Date: Sat, 5 Nov 2016 20:54:01 -0500 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:45.0) Gecko/20100101 Thunderbird/45.3.0 MIME-Version: 1.0 In-Reply-To: <9fe097c5-c2ef-fda6-8b99-b4e4d7afff05@gmail.com> Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 06 Nov 2016 01:54:07 -0000 On 11/05/16 14:24, Rajil Saraswat wrote: > Hello, > > I am running debian8 in a bhyve instance. The host has a 10g network and > uses Intel X540-AT2 NIC. The guest has a poor network speed in the order > of 2-3 kBps. However, if i disable the hardware offload features of the > NIC it brings the host speed from 10g to 1g, and bhyve shows 1g speed as > well. I use the following in rc.conf > > ifconfig_ix0="-rxcsum -txcsum -vlanmtu -vlanhwtso -tso4 -tso6 > -vlanhwtso -vlanhwcsum up" > > Is there anyway around to get 10g speed on host and better speed in the > vm simultaneously? > > > Thanks > > Rajil > I see the same poor speeds with the host running Mellanox Connectx-2 SFP+ card too. From owner-freebsd-virtualization@freebsd.org Sun Nov 6 04:20:02 2016 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1196CC322BC for ; Sun, 6 Nov 2016 04:20:02 +0000 (UTC) (envelope-from rajil.s@gmail.com) Received: from mail-pf0-x22f.google.com (mail-pf0-x22f.google.com [IPv6:2607:f8b0:400e:c00::22f]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id D7AC61AC2 for ; Sun, 6 Nov 2016 04:20:01 +0000 (UTC) (envelope-from rajil.s@gmail.com) Received: by mail-pf0-x22f.google.com with SMTP id i88so73263827pfk.2 for ; Sat, 05 Nov 2016 21:20:01 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=to:from:subject:message-id:date:user-agent:mime-version :content-transfer-encoding; bh=zbfTwCFgUhQmgpwsAAH4nUAjk/P57wSDxw+8qMoMd2o=; b=u/jdstiyt0ap0p6d6EMuOxnFqyPyE3lAgQ9gXGbBWubv+1G/5k9Fs8iagADlpxd1dK xyrXPcNze7uy3XVy9CnEbTwZeCe0q5jEwk62UsFgQXdTDRKD/LtOUui5yOrfHCBB2zl5 o63OxGO2u0XHhg5dkdZydPDDBvl4KBrz1lbLn9drs/wR2uZ1DJhVhC1k9sDlMr6CGdnR nd8QkUIWj2dkdu2lHv7nlgnx9tvzjqkJdLbWOgqGy44FekMAKnNArGQyYeNR9nLRt4AP V+ma0JiXjLuncR6fnswlExnqd3OevI4jDFRU67SupUWgfLOFt0O2mce841ZL9FSgX199 gAAA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:to:from:subject:message-id:date:user-agent :mime-version:content-transfer-encoding; bh=zbfTwCFgUhQmgpwsAAH4nUAjk/P57wSDxw+8qMoMd2o=; b=NEbTahrb2n3WQ4fJf5FMvI0nweN+jqswSdkSpwCiuVfPBtsCBgrZAfaMdfwlSUKnI/ /xk912SgiA7gEIVSxD5Tvf2/6wX+7mVdc7Jsq49VULJtqZBIcuyum4tUQ+wfsKzEHVqN vlklvJEfrBPYoVLUSynIxKfRBTvDloS9fBIIDNTVjjjbycmVvPPCjACDc8J+2HF6RxEs ter4Ep8kTf+AexKK6ZxCiUbqZ4wbEOGtwW+QQyXtWmVMsEdV5w33KdGxfE8gJMDkrKHg JwDBad+7yrWBpgYYGRqj8t9fnPSIBZq3LaonvaoQ850PDLW5yK8FFW/172b/WCsgGlBN AJHA== X-Gm-Message-State: ABUngve6cig686IJbzoyGBxU6FnyCbHSipE6/aegVI7P49KipwBE3uZwjC5uFZhrmuqPkA== X-Received: by 10.99.167.67 with SMTP id w3mr1227876pgo.1.1478406000761; Sat, 05 Nov 2016 21:20:00 -0700 (PDT) Received: from ?IPv6:2601:2c2:200:12c7:202:c9ff:fe4e:1dc0? ([2601:2c2:200:12c7:202:c9ff:fe4e:1dc0]) by smtp.gmail.com with ESMTPSA id j68sm30510402pfk.95.2016.11.05.21.19.58 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Sat, 05 Nov 2016 21:19:59 -0700 (PDT) To: freebsd-virtualization@FreeBSD.org From: Rajil Saraswat Subject: PCI pass-through does not work Message-ID: Date: Sat, 5 Nov 2016 23:19:55 -0500 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:45.0) Gecko/20100101 Thunderbird/45.3.0 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 06 Nov 2016 04:20:02 -0000 Hello, Following the docs (https://wiki.freebsd.org/bhyve/pci_passthru), i specified pptdevs="3/0/0 3/0/1" in loader.conf for my onboard intel NICs. However, the ixgbe driver still picked up the devices and they appeared in the ifconfig output. Do i need to disable the ixgbe driver in the kernel? Here is the pciconf -v -l output ix0@pci0:3:0:0: class=0x020000 card=0x152815d9 chip=0x15288086 rev=0x01 hdr=0x00 vendor = 'Intel Corporation' device = 'Ethernet Controller 10-Gigabit X540-AT2' class = network subclass = ethernet ix1@pci0:3:0:1: class=0x020000 card=0x152815d9 chip=0x15288086 rev=0x01 hdr=0x00 vendor = 'Intel Corporation' device = 'Ethernet Controller 10-Gigabit X540-AT2' class = network subclass = ethernet Thanks, Rajil From owner-freebsd-virtualization@freebsd.org Sun Nov 6 04:27:22 2016 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B7CACC326EA for ; Sun, 6 Nov 2016 04:27:22 +0000 (UTC) (envelope-from allanjude@freebsd.org) Received: from mx1.scaleengine.net (mx1.scaleengine.net [209.51.186.6]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 95B501E79 for ; Sun, 6 Nov 2016 04:27:22 +0000 (UTC) (envelope-from allanjude@freebsd.org) Received: from [10.1.1.2] (unknown [10.1.1.2]) (Authenticated sender: allanjude.freebsd@scaleengine.com) by mx1.scaleengine.net (Postfix) with ESMTPSA id 0AB88B67B for ; Sun, 6 Nov 2016 04:27:15 +0000 (UTC) Subject: Re: PCI pass-through does not work To: freebsd-virtualization@freebsd.org References: From: Allan Jude Message-ID: <53c43b01-a730-0764-1595-8a0078324a39@freebsd.org> Date: Sun, 6 Nov 2016 00:27:11 -0400 User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.4.0 MIME-Version: 1.0 In-Reply-To: Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="AvP9xNtWPnL4gM94x4O18Xo09RnCjxnr5" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 06 Nov 2016 04:27:22 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --AvP9xNtWPnL4gM94x4O18Xo09RnCjxnr5 Content-Type: multipart/mixed; boundary="PWGc7NS4oH3N33tNKl0H2I8aShtppWMG3"; protected-headers="v1" From: Allan Jude To: freebsd-virtualization@freebsd.org Message-ID: <53c43b01-a730-0764-1595-8a0078324a39@freebsd.org> Subject: Re: PCI pass-through does not work References: In-Reply-To: --PWGc7NS4oH3N33tNKl0H2I8aShtppWMG3 Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable On 2016-11-06 00:19, Rajil Saraswat wrote: > Hello, >=20 > Following the docs (https://wiki.freebsd.org/bhyve/pci_passthru), i > specified pptdevs=3D"3/0/0 3/0/1" in loader.conf for my onboard intel > NICs. However, the ixgbe driver still picked up the devices and they > appeared in the ifconfig output. >=20 > Do i need to disable the ixgbe driver in the kernel? >=20 > Here is the pciconf -v -l output >=20 > ix0@pci0:3:0:0: class=3D0x020000 card=3D0x152815d9 chip=3D0x15288086 re= v=3D0x01 > hdr=3D0x00 > vendor =3D 'Intel Corporation' > device =3D 'Ethernet Controller 10-Gigabit X540-AT2' > class =3D network > subclass =3D ethernet > ix1@pci0:3:0:1: class=3D0x020000 card=3D0x152815d9 chip=3D0x15288086 re= v=3D0x01 > hdr=3D0x00 > vendor =3D 'Intel Corporation' > device =3D 'Ethernet Controller 10-Gigabit X540-AT2' > class =3D network > subclass =3D ethernet >=20 > Thanks, >=20 > Rajil >=20 > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@fr= eebsd.org" >=20 Does your loader.conf also have: vmm_load=3D"YES" to load bhyve? otherwis= e the pptdevs=3D line is never used. --=20 Allan Jude --PWGc7NS4oH3N33tNKl0H2I8aShtppWMG3-- --AvP9xNtWPnL4gM94x4O18Xo09RnCjxnr5 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.22 (MingW32) iQIcBAEBAgAGBQJYHrEiAAoJEBmVNT4SmAt+McQQAMqgIl6dvjaSiudohfwZdcVX dyLfea1xuTKjPVAgqiyNWWuSX3X+hMXo3MAeLqb1z2iwEtyPCH7QCOgls3P1ZS4y LSitvTM4I6T9yheL3zf0trxsN+YB+dwT4VsXJP37WCe6nWHYkqCF4Movcghqbyps igE0OaT9S/vonjaqOX6doQziYJty0/FSIEoYfXt3bVT5XEoTobePlfuxy7R8rdEn KCkUabyXH3lNXy8tfjVI+SfrLxACB6nPoK3UTdmKnGGQTrPPZE4KKqo65rSbCjP8 j2Xu2vPewLdSuSS00zBFDWMAfpCFdmptEYZcSVw1l/jaooVT8RoM+rH3O7fuTbFz Y4Dgh4om8j3piesi4RiqedDJfjew37TPvnG56cDYa3DVelSsFovcfB1uayEo3wks Ffil/tzBzTyt+3s+pxK4oaU7buia4WvMJfdgIRfE3cwH3HzvfgTBX01SKC92h4wg MPjVQjqGnGL62zGar5O0zYRv6U3PsKCJ/cnkEg/Z81+8So6RT+lrT9sg3Y6nTTeH frdWocgCdbHfzm0NEMcreyDDC4I8XakahRqngtwTYuFrNSeP7a4lKPPnqR3gYKbW 1XsQKKnv2TdkhgHpfWv6S7pEizn5ZeHJXINyk8MHdijuuNT5PA3/ShV5+071/mKy 0Gu3yucCwTYU97NyWRTF =R4o2 -----END PGP SIGNATURE----- --AvP9xNtWPnL4gM94x4O18Xo09RnCjxnr5-- From owner-freebsd-virtualization@freebsd.org Sun Nov 6 04:28:06 2016 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id EED89C32763 for ; Sun, 6 Nov 2016 04:28:06 +0000 (UTC) (envelope-from rajil.s@gmail.com) Received: from mail-pf0-x22d.google.com (mail-pf0-x22d.google.com [IPv6:2607:f8b0:400e:c00::22d]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id BD36B1EF8 for ; Sun, 6 Nov 2016 04:28:06 +0000 (UTC) (envelope-from rajil.s@gmail.com) Received: by mail-pf0-x22d.google.com with SMTP id n85so73697803pfi.1 for ; Sat, 05 Nov 2016 21:28:06 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=subject:to:references:from:message-id:date:user-agent:mime-version :in-reply-to; bh=RsFf7ftb6KaNukE+9lf68FpL/5RzCjwJRBuh3AJ1u7E=; b=eZmCGwYfW10CUlZSFM5bhIiD3U1zir3pdfnn1SjN8jeaatp/4dQR00wkfPSutc+EU5 +kXfDBSRsZiQnRi9Mma5Zv5R8yTtuHBgxPovhLZcrzNpoe+b/nJCokC4hCBvLHWlYtMT arc5bCzcbbVjwly91dgnkCndk3Lj2BxqESyxsTX5ZhZjJGO/BpOv6CXO7T7ISYlmzAOQ PIrKaKhInGjOjlZ4HRZd0+b45irfGShLt8U4/mjjpDtYHxc1+S+XZ6L4lLxbL9N395yF xRSQmkcGsEE3t9wizhRlR625bxq2HFjkERwCEvfrLGwUuTIAVhsXAcX0X/ozxu2jnkEt 4nDA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:subject:to:references:from:message-id:date :user-agent:mime-version:in-reply-to; bh=RsFf7ftb6KaNukE+9lf68FpL/5RzCjwJRBuh3AJ1u7E=; b=cRur/2VppU5nTx4V0KULywpLI/paY5/ylwzkXjnIsVyYFa2stwjCdInRacEYX7xBlU h7l8twvZxtMtbT7djknYc5g+Fz4FKSwhkB5nPrxBwUUOlzhPjK9aQbPza+IQP/SpZuQP Gyj/ztzsPekBXmA5I2IS2q2JHsJkDQi0gEyjQkXe2U4EgZfAKYmW6dTxHGTT/jLM/pNU 9T8Ol5ncitzF23CkHjSvpd77qZpGDyL0+FsQ+kNa4DlhjSbAR/tT7xkEJEwFK98+J5Gt MN+vQMKPDg+AaVlLRAdcAafV3qhDI3zDJKcYpeBMpIq4j2PwSEEY9tFi5bPpeASxCwMk bKWQ== X-Gm-Message-State: ABUngvdPkm4Xq8+HxLz/oF41tlbPaExIqSuHkfZZ0elbdYmc5W1KouwIyaC77ndEZamp7A== X-Received: by 10.98.38.199 with SMTP id m190mr1836851pfm.45.1478406486082; Sat, 05 Nov 2016 21:28:06 -0700 (PDT) Received: from ?IPv6:2601:2c2:200:12c7:202:c9ff:fe4e:1dc0? ([2601:2c2:200:12c7:202:c9ff:fe4e:1dc0]) by smtp.gmail.com with ESMTPSA id s64sm30561425pfk.81.2016.11.05.21.28.04 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Sat, 05 Nov 2016 21:28:05 -0700 (PDT) Subject: Re: PCI pass-through does not work To: freebsd-virtualization@FreeBSD.org References: From: Rajil Saraswat Message-ID: Date: Sat, 5 Nov 2016 23:28:02 -0500 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:45.0) Gecko/20100101 Thunderbird/45.3.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 06 Nov 2016 04:28:07 -0000 On 11/05/16 23:24, Ryan Stone wrote: > Did you set vmm_load="YES" in loader.conf? > > > No, i dont have that entry in loader.conf. However, i am successfully running few vm's using vm-bhyve. The rc.conf looks like this vm_enable="YES" vm_dir="zfs:tank/vm" vm_delay="5" From owner-freebsd-virtualization@freebsd.org Sun Nov 6 05:15:29 2016 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 29CD5C3020A for ; Sun, 6 Nov 2016 05:15:29 +0000 (UTC) (envelope-from allanjude@freebsd.org) Received: from mx1.scaleengine.net (mx1.scaleengine.net [209.51.186.6]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 058B29E1 for ; Sun, 6 Nov 2016 05:15:28 +0000 (UTC) (envelope-from allanjude@freebsd.org) Received: from [10.1.1.2] (unknown [10.1.1.2]) (Authenticated sender: allanjude.freebsd@scaleengine.com) by mx1.scaleengine.net (Postfix) with ESMTPSA id 52E96B7BD for ; Sun, 6 Nov 2016 05:15:27 +0000 (UTC) Subject: Re: PCI pass-through does not work To: freebsd-virtualization@freebsd.org References: From: Allan Jude Message-ID: Date: Sun, 6 Nov 2016 01:15:23 -0400 User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.4.0 MIME-Version: 1.0 In-Reply-To: Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="mVmEoXAhQHAOSPE1Rqlv3fTucKARtXNqh" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 06 Nov 2016 05:15:29 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --mVmEoXAhQHAOSPE1Rqlv3fTucKARtXNqh Content-Type: multipart/mixed; boundary="wr4i36RQ4U9SfCVIXuNi4XQ2uNfcFGGPQ"; protected-headers="v1" From: Allan Jude To: freebsd-virtualization@freebsd.org Message-ID: Subject: Re: PCI pass-through does not work References: In-Reply-To: --wr4i36RQ4U9SfCVIXuNi4XQ2uNfcFGGPQ Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable On 2016-11-06 00:28, Rajil Saraswat wrote: >=20 >=20 > On 11/05/16 23:24, Ryan Stone wrote: >> Did you set vmm_load=3D"YES" in loader.conf? >> >> >> > No, i dont have that entry in loader.conf. However, i am successfully > running few vm's using vm-bhyve. The rc.conf looks like this > vm_enable=3D"YES" > vm_dir=3D"zfs:tank/vm" > vm_delay=3D"5" > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@fr= eebsd.org" >=20 Yeah, for passthru to work, you have to load the vmm @ loader time, rather than on first use of bhyve. Adding: vmm_load=3D"YES" to /boot/loader.conf above the pptdevs=3D line, should solve your problem= --=20 Allan Jude --wr4i36RQ4U9SfCVIXuNi4XQ2uNfcFGGPQ-- --mVmEoXAhQHAOSPE1Rqlv3fTucKARtXNqh Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.22 (MingW32) iQIcBAEBAgAGBQJYHrxuAAoJEBmVNT4SmAt+6+0P/0pDe33ni3yHkpS8Uf6qJtPq RVc6q4nfWgSTQfYW/uyINOm62wTfeLIK327QMnGTKTNdEGxOM41lUHSiXAyOmnEw BwGwDMthhk2Y2gR4Emfl77WEPmgI7cPnsegEPdfFa34WFQiK5RJ2eOQAWYWhep6r 7SDCJV7X2MVvaQIXnopxIh0LgdmklJrIWw9MorH/jDBBNF1OLBUjSCf+EKOAqe9q 1L/vADFEMNMJH/uoSciPioMNKQdkBTdkGGfdQbkeT3AglWq+OImE3Kdz/1jFNLSH b4VHjNgBTANyMPoNegbN2OFm+GuAwsu+gl1pTBwUK+tn2MlQSOMDKRCHK3k8CDXv /v18gNBEspwlLqEfUsw1fWawlSPt12u3gAJgnzvsN1FPDSjZJmrVOBcKXby8nLdb QVyZeKGyj6TX1Ul2V849N/MbZ/RlGLjCTBXEj/wD8yQih8TGGZjGjUgeOaxShJDu x4lBQAsg1cTgdAhIyw5kCQkRRUuZC96DHihFnNRJK7kib8Gj2N6HqRRXTZOJ8/5D MgY78E21awLV+ExEWiWhNfFWzzGuh5sapPaakMb31kPzbkUSUBMlthDGHEofpBxk M2jm4MnbdAo9nr0kcjGoG7PHYZIG/tvsWZuam+/10WXmPTsrkx9ftrUj2G3N7euZ RUyj3S6g5nlBL8OF0K0G =bMvj -----END PGP SIGNATURE----- --mVmEoXAhQHAOSPE1Rqlv3fTucKARtXNqh-- From owner-freebsd-virtualization@freebsd.org Sun Nov 6 15:37:11 2016 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 29FA1C32F78 for ; Sun, 6 Nov 2016 15:37:11 +0000 (UTC) (envelope-from rajil.s@gmail.com) Received: from mail-pf0-x232.google.com (mail-pf0-x232.google.com [IPv6:2607:f8b0:400e:c00::232]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id E9CB9905 for ; Sun, 6 Nov 2016 15:37:10 +0000 (UTC) (envelope-from rajil.s@gmail.com) Received: by mail-pf0-x232.google.com with SMTP id d2so78132708pfd.0 for ; Sun, 06 Nov 2016 07:37:10 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=subject:to:references:from:message-id:date:user-agent:mime-version :in-reply-to:content-transfer-encoding; bh=JVyLLPtBedyCbBydjA3MSjIQsC6ZRgqFZZp3Ln9AubI=; b=LWK097tU9iXwH+X2gIR23tEnIL+OarMoG5qm9s4bGcIlW6kcJJlNlKhIkn30DmP74u zcpHsCnARkFkkB+dVrorayeY/UNKRTGUY46lEqO6/meyEUdFbK5jNluqC/fXgcx25z3q YcjEFKfwH4IEF1umKr3kLzt617fSjLWfved30YQb3rxr4dLorF+R0/BduY0YRdChzGle 2JvOxrZNGfwi1tuCJO/J/lMGpKesixkfikH0y0Y+B+kApNkWsJpzvTb9DjrX3+rviqUB yu9FyYNnIwiwjXGmsEJVz3yy3BYUlRBW5VcRDP7lkH/YC10zi50AJ4OYbYQ8VI9yKP// iLKg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:subject:to:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-transfer-encoding; bh=JVyLLPtBedyCbBydjA3MSjIQsC6ZRgqFZZp3Ln9AubI=; b=LNACEeW5iAbwLpALf9cyxtIZSASboidOHtAfbLsJo/uqRcbSpOXpSr0UkdpC5ULafR RvfWvNurpZWtusxlBzfRCXyVXyTOS8p3+Y4Ix3rVLnMJa/aQVnD3m9gVAbo9u6jtlgHL +rlk+SQuYnzPVJlovpOLrLhOnOrD2WCchJ1Qa67weeyDXn/qwkvuZq/b6q+uNcEUxXq5 TEI7CX5ufOaCIuLj69nHp6BU/7XuzpZeuUqzgz6xX3X1RgWIXd5x/VRnOzLQT1eWhwXb pmzaf+83v9eO53BWjjmM5qet417Vl3tIeXhedPiAaLcmCUDCoRqjjQwGvG56kjE6uoCg 7/5w== X-Gm-Message-State: ABUngvfMQ/uWOw+g8tJzCWsq8JiOu0PggFsKH5kBv55/nyx47qagBgMJHV5dDPl496pbSw== X-Received: by 10.99.55.66 with SMTP id g2mr4207259pgn.65.1478446085507; Sun, 06 Nov 2016 07:28:05 -0800 (PST) Received: from ?IPv6:2601:2c2:200:12c7::1a82? ([2601:2c2:200:12c7::1a82]) by smtp.gmail.com with ESMTPSA id b126sm4501807pfg.90.2016.11.06.07.28.03 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Sun, 06 Nov 2016 07:28:04 -0800 (PST) Subject: Re: PCI pass-through does not work To: freebsd-virtualization@freebsd.org References: From: Rajil Saraswat Message-ID: Date: Sun, 6 Nov 2016 09:28:00 -0600 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:45.0) Gecko/20100101 Thunderbird/45.3.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 06 Nov 2016 15:37:11 -0000 On 11/06/2016 12:15 AM, Allan Jude wrote: > > Yeah, for passthru to work, you have to load the vmm @ loader time, > rather than on first use of bhyve. > > Adding: > vmm_load="YES" > > to /boot/loader.conf above the pptdevs= line, should solve your problem > Even after specifying this, ixgbe driver is still taking over. # cat /boot/loader.conf net.fibs=6 net.add_addr_allfibs=0 ipfw_load="YES" net.inet.ip.fw.default_to_accept=1 geom_eli_load="YES" coretemp_load="YES" aesni_load="YES" geom_eli_load="YES" zfs_load="YES" vfs.zfs.min_auto_ashift=12 mlx4_load="YES" mlxen_load="YES" vmm_load="YES pptdevs="3/0/0 3/0/1" # pciconf -l -v |grep ix ix0@pci0:3:0:0: class=0x020000 card=0x152815d9 chip=0x15288086 rev=0x01 hdr=0x00 ix1@pci0:3:0:1: class=0x020000 card=0x152815d9 chip=0x15288086 rev=0x01 hdr=0x00 From owner-freebsd-virtualization@freebsd.org Sun Nov 6 21:00:47 2016 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B7CCAC343C2 for ; Sun, 6 Nov 2016 21:00:47 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 94F07908 for ; Sun, 6 Nov 2016 21:00:47 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id uA6L01Af009795 for ; Sun, 6 Nov 2016 21:00:47 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <201611062100.uA6L01Af009795@kenobi.freebsd.org> From: bugzilla-noreply@FreeBSD.org To: freebsd-virtualization@FreeBSD.org Subject: Problem reports for freebsd-virtualization@FreeBSD.org that need special attention Date: Sun, 06 Nov 2016 21:00:47 +0000 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 06 Nov 2016 21:00:47 -0000 To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- New | 212711 | [typo] bhyve: virtio-rnd PCI ID doesn't match vio New | 212820 | FreeBSD 10-STABLE from latest HEAD and 11-RELEASE Open | 212721 | FreeBSD 11.0-RC2/RC3/RELEASE fails on Hyper-V 201 3 problems total for which you should take action. From owner-freebsd-virtualization@freebsd.org Mon Nov 7 03:53:49 2016 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C17F6C32E20 for ; Mon, 7 Nov 2016 03:53:49 +0000 (UTC) (envelope-from rajil.s@gmail.com) Received: from mail-pf0-x232.google.com (mail-pf0-x232.google.com [IPv6:2607:f8b0:400e:c00::232]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 83F06162 for ; Mon, 7 Nov 2016 03:53:49 +0000 (UTC) (envelope-from rajil.s@gmail.com) Received: by mail-pf0-x232.google.com with SMTP id d2so84222619pfd.0 for ; Sun, 06 Nov 2016 19:53:49 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=subject:references:to:from:message-id:date:user-agent:mime-version :in-reply-to:content-transfer-encoding; bh=qAv4jlghbhJawtaRHYtIIIllS4/jA2YXngp8yRItgq0=; b=deFKCEwJ0Ge7ueRjxNXQPSpsLrx4kw4nELnKokkj1Jd08mUmDjnIXt/XszCqXWuqj8 bbK14nxDPkLw7dbsQwj1TFTR6BXkXsQ32V8qbmg4TMNVvr5csDXBvMThaAMYWXCFPFko pgqaXuBKi0nvSaX5NiMCvQoW2GeJLKfpubNvK/F3xK/zslAk5XvHdxdnmcmytFU2YxZf EEB1RmVF0inWRatFJruXoK9IX9cvDSMyFqNWJLSboEbyCgsu4MT+WzzzqdAXT0r392Cz l03xFZYg1vZ3ijVS6KkyQ179HXz9pzuWGFH7lC/TdLVRsIui4iBRTp19tiaegn1RTmIe PHpQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:subject:references:to:from:message-id:date :user-agent:mime-version:in-reply-to:content-transfer-encoding; bh=qAv4jlghbhJawtaRHYtIIIllS4/jA2YXngp8yRItgq0=; b=NsLWtv+zOnbK7ZJsHAxAtcSYUdFbbxiKA2u0l1Ghu02VxB0KXabjaurejMiTCOsk3C v3ORkGZE5JEMezWR1Z/CCeSCAoKGLh947BTiI2G38R1fa4QWMYYW/Ckzwc7t2wkupk3n FiaT/xK+4lGEpH2UkBXYQSeCYMuyf5v+vlsMdju7a7xuEyz+C3/4LL5yoNpKZiokq3Na Y/1/KRMvxRkPxxdgAKij/3ofFdzaQgQsbBHW/sWKilsYcmC2mMV06vhPqTKE+X2dS54f zgyiPV+VuC4jkfybZHftTYsQDPdoZOI0+NW5gaO7DahMmgDVMRf7UuaH4QjLqvTZCzl9 Ne2g== X-Gm-Message-State: ABUngveCZLXO2M/4irmia+u9/yAlYbpQ64TDyYN97hsYVdPl3kbgIQ80Zh02NDFo2q1YHA== X-Received: by 10.98.160.140 with SMTP id p12mr9674666pfl.122.1478490348736; Sun, 06 Nov 2016 19:45:48 -0800 (PST) Received: from ?IPv6:2601:2c2:200:12c7:202:c9ff:fe4e:1dc0? ([2601:2c2:200:12c7:202:c9ff:fe4e:1dc0]) by smtp.gmail.com with ESMTPSA id r88sm35730825pfe.93.2016.11.06.19.45.47 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Sun, 06 Nov 2016 19:45:48 -0800 (PST) Subject: Re: PCI pass-through does not work References: <9cfd10ac-6957-023a-7797-4b1ed8bad797@gmail.com> To: freebsd-virtualization@FreeBSD.org From: Rajil Saraswat Message-ID: <34e0b3e5-7c22-7922-b287-a7bb35e7e387@gmail.com> Date: Sun, 6 Nov 2016 21:45:44 -0600 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:45.0) Gecko/20100101 Thunderbird/45.3.0 MIME-Version: 1.0 In-Reply-To: <9cfd10ac-6957-023a-7797-4b1ed8bad797@gmail.com> Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 07 Nov 2016 03:53:49 -0000 On 11/06/2016 06:35 PM, Anish Gupta wrote: > Can you boot in verbose mode and send dmesg output? Also is vmm.ko > getting loaded, is it in kldstat? > > -Anish > > Yes, kldstat does show vmm loaded and i have couple of vm's active. The /var/log/messages file is at http://pastebin.com/aKvQVGRT # kldstat Id Refs Address Size Name 1 79 0xffffffff80200000 1fa7c38 kernel 2 1 0xffffffff821a9000 30aec0 zfs.ko 3 2 0xffffffff824b4000 adc0 opensolaris.ko 4 1 0xffffffff824bf000 21bd0 geom_eli.ko 5 1 0xffffffff824e1000 42250 ipfw.ko 6 1 0xffffffff82524000 4c60 coretemp.ko 7 1 0xffffffff82529000 b3e8 aesni.ko 8 2 0xffffffff82535000 587a0 mlx4.ko 9 3 0xffffffff8258e000 1bb10 linuxkpi.ko 10 1 0xffffffff825aa000 23830 mlxen.ko 11 1 0xffffffff82821000 2a05 uhid.ko 12 1 0xffffffff82824000 397c umodem.ko 13 1 0xffffffff82828000 53df ucom.ko 14 1 0xffffffff8282e000 4fac ng_ubt.ko 15 5 0xffffffff82833000 befc netgraph.ko 16 1 0xffffffff8283f000 a58f ng_hci.ko 17 3 0xffffffff8284a000 107c ng_bluetooth.ko 18 1 0xffffffff8284c000 3710 ums.ko 19 1 0xffffffff82850000 d57d ng_l2cap.ko 20 1 0xffffffff8285e000 1b187 ng_btsocket.ko 21 1 0xffffffff8287a000 393d ng_socket.ko 22 1 0xffffffff8287e000 331f00 vmm.ko 23 1 0xffffffff82bb0000 314e nmdm.ko 24 1 0xffffffff82bb4000 9814 if_bridge.ko 25 1 0xffffffff82bbe000 5da6 bridgestp.ko 26 1 0xffffffff82bc4000 5983 if_tap.ko 27 1 0xffffffff82bca000 8400 ipmi.ko 28 1 0xffffffff82bd3000 e93 smbus.ko 29 1 0xffffffff82bd4000 665d nullfs.ko 30 1 0xffffffff82bdb000 587b fdescfs.ko 31 1 0xffffffff82be1000 adec tmpfs.ko From owner-freebsd-virtualization@freebsd.org Mon Nov 7 08:33:26 2016 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D90D2C34949 for ; Mon, 7 Nov 2016 08:33:26 +0000 (UTC) (envelope-from misc-freebsd@talk2dom.com) Received: from mail.shmtech.biz (mail.shmtech.biz [IPv6:2001:41c9:1:37::e]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.shmtech.biz", Issuer "Go Daddy Secure Certification Authority" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 7D6E87B9 for ; Mon, 7 Nov 2016 08:33:26 +0000 (UTC) (envelope-from misc-freebsd@talk2dom.com) Received: from [10.0.1.100] (originc9729.pndsl.co.uk [84.92.225.78]) (authenticated bits=0) by mail.shmtech.biz (8.15.2/8.15.2) with ESMTPSA id uA78XNCT096361 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NO) for ; Mon, 7 Nov 2016 08:33:23 GMT (envelope-from misc-freebsd@talk2dom.com) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=talk2dom.com; s=shmtech4; t=1478507603; x=1479112403; bh=tBLUI8IwKnUJyMrOGo+7oO0yGucGjfnwXwF0JxJCtvg=; h=Subject:To:References:From:Date:In-Reply-To; b=eVCDeOUJ7XAqkat25MG9Lly1VIN0S4E/yqSqoPJ24UE0fu+4jSnRlySQdnaKFgr2v MqtAU5CJJYHIn8lhknxb9pQnsDRYa9SzY+UIo/4WKLHgy2827G180jQkvrBmmu9fQB GRYv5OO9SHCEwzwTQqgNu2qzyGgwxVMeFjPCK66c= X-Authentication-Warning: sendmail: Host originc9729.pndsl.co.uk [84.92.225.78] claimed to be [10.0.1.100] Subject: Re: PCI pass-through does not work To: freebsd-virtualization@freebsd.org References: From: Dom Message-ID: Date: Mon, 7 Nov 2016 08:33:22 +0000 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:45.0) Gecko/20100101 Thunderbird/45.4.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 07 Nov 2016 08:33:26 -0000 On 06/11/2016 15:28, Rajil Saraswat wrote: > On 11/06/2016 12:15 AM, Allan Jude wrote: >> vmm_load="YES" >> > vmm_load="YES > Looks like you might have missed a quote off the end there. From owner-freebsd-virtualization@freebsd.org Mon Nov 7 12:59:45 2016 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DF6D6C34F72 for ; Mon, 7 Nov 2016 12:59:45 +0000 (UTC) (envelope-from rajil.s@gmail.com) Received: from mail-pf0-x235.google.com (mail-pf0-x235.google.com [IPv6:2607:f8b0:400e:c00::235]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id AA81E127 for ; Mon, 7 Nov 2016 12:59:45 +0000 (UTC) (envelope-from rajil.s@gmail.com) Received: by mail-pf0-x235.google.com with SMTP id d2so91289435pfd.0 for ; Mon, 07 Nov 2016 04:59:45 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=subject:to:references:from:message-id:date:user-agent:mime-version :in-reply-to; bh=Ph1G+NeU6r/FK8F2+6bgAokdjyLEbhVLrbYH6+Bs1zA=; b=nDK+TqkZr6XJjFRY1KGFki4fvKUz1izSKBuLUiFN8MWztAW0hdSeeBlSGLhSJbzvBF +rJzZVkl3LGIO12eCNIPcCwKa+AxgjJyT8EZMaBOmWragGmhG8/BpcRAcogDG7EW1yqE jC45ZXC+4BiBq0RFkZLeQxB4/iif1yXem3LeZoNdqpLbxwKjy3RNF4AWGZVeWMOfUePP inw0h7NanLga12FvDucji6xKU8MujuDX8TzWCZGF0ugLTJUdeTxI8ilGF5O1KZiA2+NF nCPPlsrxBX9mmcHT/w1S32ff6oXxwM7EGbuxrhz5tgFFJd8DQgKSn55r/oEwlvUbXJgL xuIw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:subject:to:references:from:message-id:date :user-agent:mime-version:in-reply-to; bh=Ph1G+NeU6r/FK8F2+6bgAokdjyLEbhVLrbYH6+Bs1zA=; b=B8Ctyasy/tekmhIXSLNqXdTP9IHH1AwDy0XXj9UB/Gp+bhgLND7p3asctnDJQrCwE9 a0K0oGaE4CJ2OHQuMS0qvrDwIwn9B5xKT7ovhFj5xvJI+WtjmURPUnVzsEV3SEi0W0je +Suygj6TsBGKuRC4UvpNbdi/ajI2wlW3HhyDZ+IFRD+Tift4Ev01RyzgDC9Nsu7LVZkb 0+on2DVmVe4P3OGZpUfeDOrMwoWZkODPDW5ZzJy+KRxfQafDUujt6tnbe5/9PVrPWgQe Nz8Xz9AeqK8s4b83zyD3asdlO1+PJC8SiV09ugHt7bsfLreJxLYac6BeuHOkGh9lqp4p us4g== X-Gm-Message-State: ABUngvdWXiVB3WpBHKcSjAAClSzSWMTq11MnaGk+T5wO8NR5Hsigjj+QF4tZcytpa5gq1Q== X-Received: by 10.98.31.14 with SMTP id f14mr13313561pff.27.1478523585092; Mon, 07 Nov 2016 04:59:45 -0800 (PST) Received: from ?IPv6:2601:2c2:200:12c7:202:c9ff:fe4e:1dc0? ([2601:2c2:200:12c7:202:c9ff:fe4e:1dc0]) by smtp.gmail.com with ESMTPSA id f62sm1502746pfg.76.2016.11.07.04.59.43 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Mon, 07 Nov 2016 04:59:44 -0800 (PST) Subject: Re: PCI pass-through does not work To: freebsd-virtualization@FreeBSD.org References: <9cfd10ac-6957-023a-7797-4b1ed8bad797@gmail.com> <34e0b3e5-7c22-7922-b287-a7bb35e7e387@gmail.com> From: Rajil Saraswat Message-ID: <0e4cc8f4-da26-7314-3c3d-9af9c8901814@gmail.com> Date: Mon, 7 Nov 2016 06:59:40 -0600 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:45.0) Gecko/20100101 Thunderbird/45.3.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 07 Nov 2016 12:59:46 -0000 On 11/06/2016 10:19 PM, Anish Gupta wrote: > I don't see vmm messages in boot log http://pastebin.com/aKvQVGRT > From previous e-mail, looks like missing end quote (") > > mlxen_load="YES" > vmm_load="YES <<< should be vmm_load="YES*" * > pptdevs="3/0/0 3/0/1" > > -Anish that did it! Interfaces are detached from the host now. From owner-freebsd-virtualization@freebsd.org Mon Nov 7 13:08:55 2016 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 03522C351B0 for ; Mon, 7 Nov 2016 13:08:55 +0000 (UTC) (envelope-from rajil.s@gmail.com) Received: from mail-pf0-x243.google.com (mail-pf0-x243.google.com [IPv6:2607:f8b0:400e:c00::243]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id C929A83E for ; Mon, 7 Nov 2016 13:08:54 +0000 (UTC) (envelope-from rajil.s@gmail.com) Received: by mail-pf0-x243.google.com with SMTP id n85so16132593pfi.3 for ; Mon, 07 Nov 2016 05:08:54 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=to:from:subject:message-id:date:user-agent:mime-version :content-transfer-encoding; bh=xPkPyWkHgNQKehh0CsF3bSVQdq17WUdPFfejWTqOxPU=; b=y4C21BdbARXpefqaoKEdgQXMpYmgs2eeYuo0XpIT3rNKcYKs+DOFfefO6+UZ4BD7gg /blMKWY06db+kEqoaiwdnFTd0oXUTV0rsh0NCR8ZQiINyqU8DvQi/TziThT2nY66eVn+ vPOLnijsjS/QP3lCj/pCYeIoPZZgCdmGJuse5XFrao/dhfFOzPx/KqYUjfpJFaWUD3Yd InwoFsaLE28MO/DMuE1WQCSeSC0A3BDlp15E0yUpZyzs24WApWvTUXJYDGn0wkg2UuI8 0Iv36QAxZMpcYqjChR9VCWZpN/rkkvFrFVxfOLrp7YYubAJorcWPppdDpqyEX81Zvzec D2xQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:to:from:subject:message-id:date:user-agent :mime-version:content-transfer-encoding; bh=xPkPyWkHgNQKehh0CsF3bSVQdq17WUdPFfejWTqOxPU=; b=Qs6xuto3Clv25l5axi+v3qsA4vqXaCR17LP9pHrQLHo1vlC4zM47uEF7Cz0GN7sAUW 9ZgfQSLaSE+TdaIS6IEbycVK+rGDEvjuS4zDd4R3eS9CHXMZXDUE771R+tSrPEfu706M 3TstboS1cfHJdZEFeF7rzW6cdCq1/E8DXugWg8pAGgu9newznwYbyEYlnxqa+gz9/YN7 IUxJnNXTWy5SJjhS9v+iVivAzKKuNqTjlRbWahGrYUkx9P9sFQxJp/IR6rUSWtBX2f9V eS758+PphiszKuNQM25HvnRdTnNQQdbgJDqB0tLyxCvkqICFKS5KYlki45Ge9zESTrDz MZqg== X-Gm-Message-State: ABUngvfD5zTtO4TD8UPZx1wp2Drk9xUs5XVvqvKgPbFGwmTTK1VRCgot6v7YA5cBQX6KOg== X-Received: by 10.99.62.13 with SMTP id l13mr10730371pga.112.1478524134206; Mon, 07 Nov 2016 05:08:54 -0800 (PST) Received: from ?IPv6:2601:2c2:200:12c7:202:c9ff:fe4e:1dc0? ([2601:2c2:200:12c7:202:c9ff:fe4e:1dc0]) by smtp.gmail.com with ESMTPSA id sh9sm40598614pac.41.2016.11.07.05.08.52 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Mon, 07 Nov 2016 05:08:53 -0800 (PST) To: freebsd-virtualization@FreeBSD.org From: Rajil Saraswat Subject: bhyve, ixgbe and debian 8 Message-ID: <124ae089-6215-7632-44cf-319b5f88c0b5@gmail.com> Date: Mon, 7 Nov 2016 07:08:49 -0600 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:45.0) Gecko/20100101 Thunderbird/45.3.0 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 07 Nov 2016 13:08:55 -0000 Hello, I have PCI passthrough working now for the Intel X540-AT2 NIC and is seen inside debian 8 vm. # lspci 00:00.0 Host bridge: Network Appliance Corporation Device 1275 00:04.0 SCSI storage controller: Red Hat, Inc Virtio block device 00:05.0 Ethernet controller: Red Hat, Inc Virtio network device 00:06.0 Ethernet controller: Intel Corporation Ethernet Controller 10-Gigabit X540-AT2 (rev 01) 00:1f.0 ISA bridge: Intel Corporation 82371SB PIIX3 ISA [Natoma/Triton II] However, on loading the module the kernel gives the error #modprobe ixgbe [ 34.929546] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver - version 3.19.1-k [ 34.929549] ixgbe: Copyright (c) 1999-2014 Intel Corporation. [ 34.929706] ixgbe 0000:00:06.0: can't derive routing for PCI INT A [ 34.929708] ixgbe 0000:00:06.0: PCI INT A: no GSI [ 34.930354] ixgbe 0000:00:06.0: Adapter removed [ 34.931710] ixgbe 0000:00:06.0: can't derive routing for PCI INT A [ 34.931717] ixgbe: probe of 0000:00:06.0 failed with error -5 Any idea what could be the issue? Thanks, Rajil From owner-freebsd-virtualization@freebsd.org Mon Nov 7 13:41:15 2016 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DECE9C359D2 for ; Mon, 7 Nov 2016 13:41:15 +0000 (UTC) (envelope-from rajil.s@gmail.com) Received: from mail-pf0-x22f.google.com (mail-pf0-x22f.google.com [IPv6:2607:f8b0:400e:c00::22f]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id AEDD18E4 for ; Mon, 7 Nov 2016 13:41:15 +0000 (UTC) (envelope-from rajil.s@gmail.com) Received: by mail-pf0-x22f.google.com with SMTP id d2so91677162pfd.0 for ; Mon, 07 Nov 2016 05:41:15 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=subject:to:references:from:message-id:date:user-agent:mime-version :in-reply-to:content-transfer-encoding; bh=9OhNB62nEmyERh2PTcQPpPOdw683B8ntZLLyumluL84=; b=GuPq+lk7ezjJ76c88W+AmyOejlhYAmZ+ugwdLfWYRrMJJfQ1sP78sdUzkCd0wNpcIR Vk3sVi6a+Z3sV/xRpIdm5u0VUditpmUKb20jLBmg/ZEy1lomiIkUXUPhBGN3k9MFTubK gdc+ztK8tcGPpwv/Z093+3vLnq4UAa+vySesP0CPzf3itzJJa6bO8UwFqllsCLn4l6fK /1AKHcTx6zcHZV0DaiI1iXzuKaZWuzfb25rEEvsN6Wo0ClNIZDXSgSFUupSL87dk9xyK BewNkDjS4gCfFZv+nSNBY8m42ykRncBEB1e+l706D7kPECZHMkad1TnCF9eWsJvYpoNo Peuw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:subject:to:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-transfer-encoding; bh=9OhNB62nEmyERh2PTcQPpPOdw683B8ntZLLyumluL84=; b=EYgp+ZMgxuBdMOzSAl5CfIfmDoOyOxl9NJFVhTYFpN0I1tj8E+jE+81DtLJsbvX1eG n0axQpER6yF419TPcZxT1ZDr8+AhSCE7UIhTEVdDLAbGOW0Hcmqkunv2pkHmPwXUHvk7 bfnrvUa5kc4cwlgL5ph/ts+TboBUxYl4beULkzFDvHdX6mFwWAwMl11ILPzJBb7M0QjO DBXQD1mRwcmGr3VbYrcomin/0BoJ31r+U4WuH8PlD628dXiXZGQYnZpsrLC1DTF0vvGu nPDnrqt4AHeGL/NcNVLc9VikcFVzqf58lwi6R7SD2S/IPb0NidDHMC4YDe0cL1boIKGV YCCw== X-Gm-Message-State: ABUngveXKOHXMHiHuo0/7wHC0Oe0+Nla+HC+LvY0yZfGhkGAwoEqGGxpPLIJLz8cJx6VVw== X-Received: by 10.98.163.71 with SMTP id s68mr13587349pfe.60.1478526075086; Mon, 07 Nov 2016 05:41:15 -0800 (PST) Received: from ?IPv6:2601:2c2:200:12c7:202:c9ff:fe4e:1dc0? ([2601:2c2:200:12c7:202:c9ff:fe4e:1dc0]) by smtp.gmail.com with ESMTPSA id p14sm40850745par.25.2016.11.07.05.41.13 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Mon, 07 Nov 2016 05:41:14 -0800 (PST) Subject: Re: bhyve, ixgbe and debian 8 To: freebsd-virtualization@FreeBSD.org References: <124ae089-6215-7632-44cf-319b5f88c0b5@gmail.com> From: Rajil Saraswat Message-ID: <8c44e3c4-fcc8-d288-26f0-df742b1c79a7@gmail.com> Date: Mon, 7 Nov 2016 07:41:09 -0600 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:45.0) Gecko/20100101 Thunderbird/45.3.0 MIME-Version: 1.0 In-Reply-To: <124ae089-6215-7632-44cf-319b5f88c0b5@gmail.com> Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 07 Nov 2016 13:41:16 -0000 On 11/07/2016 07:08 AM, Rajil Saraswat wrote: > Hello, > > I have PCI passthrough working now for the Intel X540-AT2 NIC and is > seen inside debian 8 vm. > > # lspci > > 00:00.0 Host bridge: Network Appliance Corporation Device 1275 > 00:04.0 SCSI storage controller: Red Hat, Inc Virtio block device > 00:05.0 Ethernet controller: Red Hat, Inc Virtio network device > 00:06.0 Ethernet controller: Intel Corporation Ethernet Controller > 10-Gigabit X540-AT2 (rev 01) > 00:1f.0 ISA bridge: Intel Corporation 82371SB PIIX3 ISA [Natoma/Triton II] > > > However, on loading the module the kernel gives the error > > #modprobe ixgbe > > [ 34.929546] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver - > version 3.19.1-k > [ 34.929549] ixgbe: Copyright (c) 1999-2014 Intel Corporation. > [ 34.929706] ixgbe 0000:00:06.0: can't derive routing for PCI INT A > [ 34.929708] ixgbe 0000:00:06.0: PCI INT A: no GSI > [ 34.930354] ixgbe 0000:00:06.0: Adapter removed > [ 34.931710] ixgbe 0000:00:06.0: can't derive routing for PCI INT A > [ 34.931717] ixgbe: probe of 0000:00:06.0 failed with error -5 > > Any idea what could be the issue? > > Thanks, > > Rajil > I tried with the second onboard NIC and it worked the first time. iperf showed 10g speeds. After restarting the VM, i get an error for both NICs. This a dual CPU motherboard Supermicro X10DriT with a pair of onboard NICs. [ 0.628758] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver - version 3.19.1-k [ 0.628760] ixgbe: Copyright (c) 1999-2014 Intel Corporation. [ 0.628899] ixgbe 0000:00:06.0: can't derive routing for PCI INT A [ 0.628901] ixgbe 0000:00:06.0: PCI INT A: no GSI [ 0.629519] ixgbe 0000:00:06.0: Adapter removed [ 0.630143] ixgbe 0000:00:06.0: can't derive routing for PCI INT A [ 0.630147] ixgbe: probe of 0000:00:06.0 failed with error -5 [ 0.630199] ixgbe 0000:00:06.1: can't derive routing for PCI INT B [ 0.630200] ixgbe 0000:00:06.1: PCI INT B: no GSI [ 0.630789] ixgbe 0000:00:06.1: Adapter removed [ 0.639469] ixgbe 0000:00:06.1: can't derive routing for PCI INT B [ 0.639473] ixgbe: probe of 0000:00:06.1 failed with error -5 From owner-freebsd-virtualization@freebsd.org Mon Nov 7 14:13:01 2016 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id EE6E8C33676 for ; Mon, 7 Nov 2016 14:13:01 +0000 (UTC) (envelope-from rajil.s@gmail.com) Received: from mail-pf0-x22f.google.com (mail-pf0-x22f.google.com [IPv6:2607:f8b0:400e:c00::22f]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id BD4C3D82 for ; Mon, 7 Nov 2016 14:13:01 +0000 (UTC) (envelope-from rajil.s@gmail.com) Received: by mail-pf0-x22f.google.com with SMTP id d2so91955824pfd.0 for ; Mon, 07 Nov 2016 06:13:01 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=subject:to:references:from:message-id:date:user-agent:mime-version :in-reply-to:content-transfer-encoding; bh=+2dpCnzPdwwQaOekqhJBffvq4B0Qqr8nmR11IYrmIrs=; b=h1Eps55VswWWdpXLkytFxwfX6oF/6a7mOyf2j7dKB+WjVvz3qPfzrQcCjRyHW3CuW0 SiecQbAEGxIS3Zfzr+o9wFz3qyldkwIJKwoVFHLG84UVeKPHk3x+jSTw8Mk+yowwg2em X8sdoRNDweKDnIOberUv3CVjzuv6GjtA7TEvchkQmfO5tu47VIvI6VuyJLuvYNPzWXT1 Amb9FJhdYhMS+r8hPuOSwTRFYb3Tug5FseRcUgH2OSmQyoa0Gs6RsL4/LUh3DAww9NjG dX1HjwPKyDpDbTtHEMTdwmb3jJUSAFwwSnWLYHH3Ctye4tR8A4kpT3WLG/lN7+u1UD1r ozoA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:subject:to:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-transfer-encoding; bh=+2dpCnzPdwwQaOekqhJBffvq4B0Qqr8nmR11IYrmIrs=; b=idlqfZ1Ga1UQLgF3LXXOlxauI2IhRGRomGPFYVu3+tlbEbHlLoCLJwtdvEBJxJIegt kR+06y+NgziBAyrfcz2+BJLJwDbt5vCfSEGQRjFTn+PQXFRJDewIZz2AhYUuqb0/4ShK c2iWU9p2WJqVz86Hh6GCclc1RDNh5J/D+up3Y+QGcnIJXdATH+dWNGNlynOdKRjD+777 /RD0DZ758u6xD0gz8Dx/aB4fajXeqZ3bCxSeUyv0EUcJ84pGxN9F1lDZKAUMRXyYNqbJ EE9Vskm//Ig35l3KimiExLe3Z8ScY6Yid5tVbB6MZ3JikceaxYijX6WW0jzXK8+c59Ox A9kw== X-Gm-Message-State: ABUngvf3tu3gVen/K79GOJdhDkQG/ht8RGmoYx/RDKDcWjcxj6bGAeQIquZZHp+vPUwNqA== X-Received: by 10.99.142.201 with SMTP id k192mr10965867pge.174.1478527981029; Mon, 07 Nov 2016 06:13:01 -0800 (PST) Received: from ?IPv6:2601:2c2:200:12c7:202:c9ff:fe4e:1dc0? ([2601:2c2:200:12c7:202:c9ff:fe4e:1dc0]) by smtp.gmail.com with ESMTPSA id v6sm41156762pab.14.2016.11.07.06.12.59 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Mon, 07 Nov 2016 06:13:00 -0800 (PST) Subject: Re: bhyve, ixgbe and debian 8 To: freebsd-virtualization@FreeBSD.org References: <124ae089-6215-7632-44cf-319b5f88c0b5@gmail.com> <8c44e3c4-fcc8-d288-26f0-df742b1c79a7@gmail.com> From: Rajil Saraswat Message-ID: Date: Mon, 7 Nov 2016 08:12:55 -0600 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:45.0) Gecko/20100101 Thunderbird/45.3.0 MIME-Version: 1.0 In-Reply-To: <8c44e3c4-fcc8-d288-26f0-df742b1c79a7@gmail.com> Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 07 Nov 2016 14:13:02 -0000 On 11/07/2016 07:41 AM, Rajil Saraswat wrote: > On 11/07/2016 07:08 AM, Rajil Saraswat wrote: >> Hello, >> >> I have PCI passthrough working now for the Intel X540-AT2 NIC and is >> seen inside debian 8 vm. >> >> # lspci >> >> 00:00.0 Host bridge: Network Appliance Corporation Device 1275 >> 00:04.0 SCSI storage controller: Red Hat, Inc Virtio block device >> 00:05.0 Ethernet controller: Red Hat, Inc Virtio network device >> 00:06.0 Ethernet controller: Intel Corporation Ethernet Controller >> 10-Gigabit X540-AT2 (rev 01) >> 00:1f.0 ISA bridge: Intel Corporation 82371SB PIIX3 ISA [Natoma/Triton II] >> >> >> However, on loading the module the kernel gives the error >> >> #modprobe ixgbe >> >> [ 34.929546] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver - >> version 3.19.1-k >> [ 34.929549] ixgbe: Copyright (c) 1999-2014 Intel Corporation. >> [ 34.929706] ixgbe 0000:00:06.0: can't derive routing for PCI INT A >> [ 34.929708] ixgbe 0000:00:06.0: PCI INT A: no GSI >> [ 34.930354] ixgbe 0000:00:06.0: Adapter removed >> [ 34.931710] ixgbe 0000:00:06.0: can't derive routing for PCI INT A >> [ 34.931717] ixgbe: probe of 0000:00:06.0 failed with error -5 >> >> Any idea what could be the issue? >> >> Thanks, >> >> Rajil >> > I tried with the second onboard NIC and it worked the first time. iperf > showed 10g speeds. After restarting the VM, i get an error for both > NICs. This a dual CPU motherboard Supermicro X10DriT with a pair of > onboard NICs. > > [ 0.628758] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver - > version 3.19.1-k > [ 0.628760] ixgbe: Copyright (c) 1999-2014 Intel Corporation. > [ 0.628899] ixgbe 0000:00:06.0: can't derive routing for PCI INT A > [ 0.628901] ixgbe 0000:00:06.0: PCI INT A: no GSI > [ 0.629519] ixgbe 0000:00:06.0: Adapter removed > [ 0.630143] ixgbe 0000:00:06.0: can't derive routing for PCI INT A > [ 0.630147] ixgbe: probe of 0000:00:06.0 failed with error -5 > [ 0.630199] ixgbe 0000:00:06.1: can't derive routing for PCI INT B > [ 0.630200] ixgbe 0000:00:06.1: PCI INT B: no GSI > [ 0.630789] ixgbe 0000:00:06.1: Adapter removed > [ 0.639469] ixgbe 0000:00:06.1: can't derive routing for PCI INT B > [ 0.639473] ixgbe: probe of 0000:00:06.1 failed with error -5 > After a cold reboot of the server, the devices are again seen in debian. I guess somehow the devices become unusable when the vm is restarted. [ 1.146946] ixgbe 0000:00:06.0: PCI Express bandwidth of 32GT/s available [ 1.146949] ixgbe 0000:00:06.0: (Speed:5.0GT/s, Width: x8, Encoding Loss:20%) [ 1.146953] ixgbe 0000:00:06.0: This is not sufficient for optimal performance of this card. [ 1.146955] ixgbe 0000:00:06.0: For optimal performance, at least 60GT/s of bandwidth is required. [ 1.146956] ixgbe 0000:00:06.0: A slot with more lanes and/or higher speed is suggested. [ 1.189458] ixgbe 0000:00:06.0: MAC: 3, PHY: 3, PBA No: 030C00-000 [ 1.189461] ixgbe 0000:00:06.0: 0c:c4:7a:de:cc:c0 [ 1.339231] ixgbe 0000:00:06.0: Intel(R) 10 Gigabit Network Connection [ 1.339364] ixgbe 0000:00:06.1: can't derive routing for PCI INT B [ 1.339366] ixgbe 0000:00:06.1: PCI INT B: no GSI [ 1.348140] input: PS/2 Generic Mouse as /devices/platform/i8042/serio1/input/input2 [ 1.566630] tsc: Refined TSC clocksource calibration: 2198.264 MHz [ 1.793929] ixgbe 0000:00:06.1: irq 47 for MSI/MSI-X [ 1.793950] ixgbe 0000:00:06.1: irq 48 for MSI/MSI-X [ 1.795079] ixgbe 0000:00:06.1: Multiqueue Disabled: Rx Queue count = 1, Tx Queue count = 1 [ 1.859258] ixgbe 0000:00:06.1: PCI Express bandwidth of 32GT/s available [ 1.859261] ixgbe 0000:00:06.1: (Speed:5.0GT/s, Width: x8, Encoding Loss:20%) [ 1.859262] ixgbe 0000:00:06.1: This is not sufficient for optimal performance of this card. [ 1.859264] ixgbe 0000:00:06.1: For optimal performance, at least 60GT/s of bandwidth is required. [ 1.859265] ixgbe 0000:00:06.1: A slot with more lanes and/or higher speed is suggested. [ 1.902549] ixgbe 0000:00:06.1: MAC: 3, PHY: 3, PBA No: 030C00-000 [ 1.902554] ixgbe 0000:00:06.1: 0c:c4:7a:de:cc:c1 [ 2.055631] ixgbe 0000:00:06.1: Intel(R) 10 Gigabit Network Connection # cat /proc/interrupts CPU0 0: 45 IO-APIC-edge timer 1: 9 IO-APIC-edge i8042 4: 3756 IO-APIC-edge serial 8: 0 IO-APIC-edge rtc0 9: 0 IO-APIC-fasteoi acpi 12: 138 IO-APIC-edge i8042 40: 0 PCI-MSI-edge virtio0-config 41: 5667 PCI-MSI-edge virtio0-requests 42: 0 PCI-MSI-edge virtio1-config 43: 139 PCI-MSI-edge virtio1-input.0 44: 1 PCI-MSI-edge virtio1-output.0 45: 120 PCI-MSI-edge eth1-TxRx-0 46: 0 PCI-MSI-edge eth1 47: 1170 PCI-MSI-edge eth2-TxRx-0 48: 3 PCI-MSI-edge eth2 NMI: 0 Non-maskable interrupts LOC: 8265 Local timer interrupts SPU: 0 Spurious interrupts PMI: 0 Performance monitoring interrupts IWI: 0 IRQ work interrupts RTR: 0 APIC ICR read retries RES: 0 Rescheduling interrupts CAL: 0 Function call interrupts TLB: 0 TLB shootdowns TRM: 0 Thermal event interrupts THR: 0 Threshold APIC interrupts MCE: 0 Machine check exceptions MCP: 1 Machine check polls HYP: 0 Hypervisor callback interrupts ERR: 0 MIS: 0 From owner-freebsd-virtualization@freebsd.org Mon Nov 7 15:38:12 2016 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1E945C348B0 for ; Mon, 7 Nov 2016 15:38:12 +0000 (UTC) (envelope-from doctor@doctor.nl2k.ab.ca) Received: from doctor.nl2k.ab.ca (doctor.nl2k.ab.ca [204.209.81.1]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 091C4614 for ; Mon, 7 Nov 2016 15:38:08 +0000 (UTC) (envelope-from doctor@doctor.nl2k.ab.ca) Received: from doctor by doctor.nl2k.ab.ca with local (Exim 4.88) (envelope-from ) id 1c3lzk-000C5h-PH; Mon, 07 Nov 2016 08:38:00 -0700 Date: Mon, 7 Nov 2016 08:38:00 -0700 From: The Doctor To: Rajil Saraswat Cc: freebsd-virtualization@FreeBSD.org Subject: Re: bhyve, ixgbe and debian 8 Message-ID: <20161107153800.GB42330@doctor.nl2k.ab.ca> References: <124ae089-6215-7632-44cf-319b5f88c0b5@gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <124ae089-6215-7632-44cf-319b5f88c0b5@gmail.com> User-Agent: Mutt/1.7.1 (2016-10-04) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 07 Nov 2016 15:38:12 -0000 On Mon, Nov 07, 2016 at 07:08:49AM -0600, Rajil Saraswat wrote: > Hello, > > I have PCI passthrough working now for the Intel X540-AT2 NIC and is > seen inside debian 8 vm. > > # lspci > > 00:00.0 Host bridge: Network Appliance Corporation Device 1275 > 00:04.0 SCSI storage controller: Red Hat, Inc Virtio block device > 00:05.0 Ethernet controller: Red Hat, Inc Virtio network device > 00:06.0 Ethernet controller: Intel Corporation Ethernet Controller > 10-Gigabit X540-AT2 (rev 01) > 00:1f.0 ISA bridge: Intel Corporation 82371SB PIIX3 ISA [Natoma/Triton II] > > > However, on loading the module the kernel gives the error > > #modprobe ixgbe > > [ 34.929546] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver - > version 3.19.1-k > [ 34.929549] ixgbe: Copyright (c) 1999-2014 Intel Corporation. > [ 34.929706] ixgbe 0000:00:06.0: can't derive routing for PCI INT A > [ 34.929708] ixgbe 0000:00:06.0: PCI INT A: no GSI > [ 34.930354] ixgbe 0000:00:06.0: Adapter removed > [ 34.931710] ixgbe 0000:00:06.0: can't derive routing for PCI INT A > [ 34.931717] ixgbe: probe of 0000:00:06.0 failed with error -5 > > Any idea what could be the issue? > > Thanks, > > Rajil > Looks like something in Deb8 breaks bhyve. Smae problem with igb . > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@freebsd.org" -- Member - Liberal International This is doctor@@nl2k.ab.ca Ici doctor@@nl2k.ab.ca God,Queen and country!Never Satan President Republic!Beware AntiChrist rising! http://www.fullyfollow.me/rootnl2k Look at Psalms 14 and 53 on Atheism Time for the USA to hold a referendum on its republic and vote to dissolve!! From owner-freebsd-virtualization@freebsd.org Mon Nov 7 20:01:19 2016 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 70B67C35931 for ; Mon, 7 Nov 2016 20:01:19 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from alto.onthenet.com.au (alto.OntheNet.com.au [203.13.68.12]) by mx1.freebsd.org (Postfix) with ESMTP id 3327F650 for ; Mon, 7 Nov 2016 20:01:18 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from iredmail.onthenet.com.au (iredmail.onthenet.com.au [203.13.68.150]) by alto.onthenet.com.au (Postfix) with ESMTPS id E42A420A40F0 for ; Tue, 8 Nov 2016 06:00:55 +1000 (AEST) Received: from localhost (iredmail.onthenet.com.au [127.0.0.1]) by iredmail.onthenet.com.au (Postfix) with ESMTP id DDA11280988 for ; Tue, 8 Nov 2016 06:00:55 +1000 (AEST) X-Amavis-Modified: Mail body modified (using disclaimer) - iredmail.onthenet.com.au Received: from iredmail.onthenet.com.au ([127.0.0.1]) by localhost (iredmail.onthenet.com.au [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id W5BM37-mRgNG for ; Tue, 8 Nov 2016 06:00:55 +1000 (AEST) Received: from Peters-MacBook-Pro-2.local (96-82-80-65-static.hfc.comcastbusiness.net [96.82.80.65]) by iredmail.onthenet.com.au (Postfix) with ESMTPSA id 334CE2808FE; Tue, 8 Nov 2016 06:00:54 +1000 (AEST) Subject: Re: bhyve, ixgbe and debian 8 To: Rajil Saraswat References: <124ae089-6215-7632-44cf-319b5f88c0b5@gmail.com> <8c44e3c4-fcc8-d288-26f0-df742b1c79a7@gmail.com> Cc: freebsd-virtualization@FreeBSD.org From: Peter Grehan Message-ID: Date: Mon, 7 Nov 2016 12:01:05 -0800 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:45.0) Gecko/20100101 Thunderbird/45.4.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-CMAE-Score: 0 X-CMAE-Analysis: v=2.2 cv=DZ1nkrlW c=1 sm=1 tr=0 a=A6CF0fG5TOl4vs6YHvqXgw==:117 a=mwgbnDbW7alINpy3vhoKyg==:17 a=N659UExz7-8A:10 a=L24OOQBejmoA:10 a=8Z_r4jIjMSmzlBasHyoA:9 a=pILNOxqGKmIA:10 a=3cXy1o8xZ6UA:10 wl=host:3 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 07 Nov 2016 20:01:19 -0000 Hi Rajil, >> I tried with the second onboard NIC and it worked the first time. iperf >> showed 10g speeds. After restarting the VM, i get an error for both >> NICs. What's the FreeBSD host version ? There was work done recently to reset passthru devices pre/post running a guest which hopefully should have fixed this. later, Peter. From owner-freebsd-virtualization@freebsd.org Mon Nov 7 20:30:39 2016 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A33C9C35239 for ; Mon, 7 Nov 2016 20:30:39 +0000 (UTC) (envelope-from rajil.s@gmail.com) Received: from mail-qk0-x229.google.com (mail-qk0-x229.google.com [IPv6:2607:f8b0:400d:c09::229]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 5C2F3EA3 for ; Mon, 7 Nov 2016 20:30:39 +0000 (UTC) (envelope-from rajil.s@gmail.com) Received: by mail-qk0-x229.google.com with SMTP id q130so192122176qke.1 for ; Mon, 07 Nov 2016 12:30:39 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=PJDZ6sTuOOUkygBTmx0v9ykFHdibGPwG1/CaxrcS/6Q=; b=N3YeWN4m/SImUkKbnzrqx9O6+55NJ2ZKrekJVlhfE9E/nkjFM1BWx3vdU5IPhFZ92J DTOZiNWD4BkABJ7aAnmqIMofjwvHh4pU6zkt1vw2EqPDPRmKVxod6kJP7zolXpYknwRA SkVvAbTOodIhZ7gyUi3ynTbph9cP2JyXU5QZTFQF3c8enE9IMKzEBCSMiAuFvv7gWAtk 8NlxIarY03hzdBQB9KN0ObNBMOkd2uXmSDxfRSBMZ+Xrg5nDAHou1h3O7OViHRkjXc3p lUNO+rR2hAQjahMLnbI+bcWpNr6w8XMkx5B8S2djnLqZjiTOsRCWItdHEOidxDacHRSO NiUQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=PJDZ6sTuOOUkygBTmx0v9ykFHdibGPwG1/CaxrcS/6Q=; b=WfOHQvBN1lKIU27nj5o/IMVH3Na1g/ruhuo6Wdv0U8OEPRWJZPkM6ISq9NHFN1Mzfv RKsyJIlBW/3o2Qbb43HdmLfzmmsovbf8mKyfy2J9F7WYAaS9ldf2O1pn4eMucJ6PmMGu L4NdMG+4asoOQFPIIezDlm/z4cCcibYbroF2zw0pC8npD5Md+4Qwy2i0uzFzJShmjFU0 sm3nhvQ+jVCRsAp5xJL4MDF6mYA8TAboPx4N6mjIYOF4cYAWbpuur0ClfosbCZ5rqI7/ EcQeBp4gH6FmH7BdMdeSHT2CnDSGr4Z4pGzFF+fF87wt2Dvet4jsno0tnPUfHcWBvPAD t8WA== X-Gm-Message-State: ABUngvder5GHMF3H5/mGAGsPjiqFFBRT98tEteB1Y2JsbcEEjGponR/rFEGc/ISDcCFQBhVHmOgt9pPBdnJc8w== X-Received: by 10.55.16.10 with SMTP id a10mr8145579qkh.66.1478550638435; Mon, 07 Nov 2016 12:30:38 -0800 (PST) MIME-Version: 1.0 Received: by 10.12.149.109 with HTTP; Mon, 7 Nov 2016 12:30:37 -0800 (PST) Received: by 10.12.149.109 with HTTP; Mon, 7 Nov 2016 12:30:37 -0800 (PST) In-Reply-To: References: <124ae089-6215-7632-44cf-319b5f88c0b5@gmail.com> <8c44e3c4-fcc8-d288-26f0-df742b1c79a7@gmail.com> From: Rajil Saraswat Date: Mon, 7 Nov 2016 14:30:37 -0600 Message-ID: Subject: Re: bhyve, ixgbe and debian 8 To: freebsd-virtualization@freebsd.org Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 07 Nov 2016 20:30:39 -0000 On Nov 7, 2016 2:01 PM, "Peter Grehan" wrote: > > Hi Rajil, > > >>> I tried with the second onboard NIC and it worked the first time. iperf >>> showed 10g speeds. After restarting the VM, i get an error for both >>> NICs. > > > What's the FreeBSD host version ? There was work done recently to reset passthru devices pre/post running a guest which hopefully should have fixed this. > > later, > > Peter. > Peter, $ uname -a FreeBSD box.localdomain 11.0-RELEASE-p2 FreeBSD 11.0-RELEASE-p2 #0: Mon Oct 24 06:55:27 UTC 2016 root@amd64-builder.daemonology.net:/usr/obj/usr/src/sys/GENERIC amd64 Cheers, Rajil From owner-freebsd-virtualization@freebsd.org Wed Nov 9 11:14:07 2016 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 93BABC38246 for ; Wed, 9 Nov 2016 11:14:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 830B8C5C for ; Wed, 9 Nov 2016 11:14:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id uA9BE7Qa016155 for ; Wed, 9 Nov 2016 11:14:07 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-virtualization@FreeBSD.org Subject: [Bug 210044] DHCP fails on ixv interface in Amazon EC2 Date: Wed, 09 Nov 2016 11:14:07 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: dfr@rabson.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 09 Nov 2016 11:14:07 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D210044 dfr@rabson.org changed: What |Removed |Added ---------------------------------------------------------------------------- Status|New |Closed Resolution|--- |FIXED --- Comment #3 from dfr@rabson.org --- Verified fixed with 11.0-RELEASE --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Wed Nov 9 17:10:29 2016 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id EF382C38CD5 for ; Wed, 9 Nov 2016 17:10:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id DDBA629F for ; Wed, 9 Nov 2016 17:10:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id uA9HATil041932 for ; Wed, 9 Nov 2016 17:10:29 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-virtualization@FreeBSD.org Subject: [Bug 203682] Slow boot under VMware Fusion w/ UEFI firmware and SMP -- until APs are launched Date: Wed, 09 Nov 2016 17:10:29 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: jhb@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 09 Nov 2016 17:10:30 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D203682 John Baldwin changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |jhb@FreeBSD.org --- Comment #4 from John Baldwin --- As a workaround, try adding 'options EARLY_AP_STARTUP' to your kernel confi= g as it will start the APs sooner and should be fine on amd64. (I plan to enabl= e it by default in 12 "soon". --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Wed Nov 9 17:25:37 2016 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 14E06C3818C for ; Wed, 9 Nov 2016 17:25:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 03D3513E3 for ; Wed, 9 Nov 2016 17:25:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id uA9HPaRP079865 for ; Wed, 9 Nov 2016 17:25:36 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-virtualization@FreeBSD.org Subject: [Bug 203682] Slow boot under VMware Fusion w/ UEFI firmware and SMP -- until APs are launched Date: Wed, 09 Nov 2016 17:25:37 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: jhb@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 09 Nov 2016 17:25:37 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D203682 --- Comment #5 from John Baldwin --- Note that the root issue is probably just that the spin on 'aps_ready' is expensive to simulate on hypervisors. The vcpu is just going to run continually until it gets preempted by the hypervisor if it runs on a real = CPU. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Wed Nov 9 17:32:19 2016 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 89CA9C38303 for ; Wed, 9 Nov 2016 17:32:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 730BB1787 for ; Wed, 9 Nov 2016 17:32:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id uA9HWJJP096802 for ; Wed, 9 Nov 2016 17:32:19 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-virtualization@FreeBSD.org Subject: [Bug 203682] Slow boot under VMware Fusion w/ UEFI firmware and SMP -- until APs are launched Date: Wed, 09 Nov 2016 17:32:19 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: marcel@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 09 Nov 2016 17:32:19 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D203682 --- Comment #6 from Marcel Moolenaar --- (In reply to John Baldwin from comment #4) I can confirm that this solves/addresses the problem sufficiently. A 4 core VM with the EFI frame buffer boots what appears to be normally. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Wed Nov 9 17:35:06 2016 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 42727C3839A for ; Wed, 9 Nov 2016 17:35:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 316641893 for ; Wed, 9 Nov 2016 17:35:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id uA9HZ5QD000304 for ; Wed, 9 Nov 2016 17:35:06 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-virtualization@FreeBSD.org Subject: [Bug 203682] Slow boot under VMware Fusion w/ UEFI firmware and SMP -- until APs are launched Date: Wed, 09 Nov 2016 17:35:06 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: marcel@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 09 Nov 2016 17:35:06 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D203682 --- Comment #7 from Marcel Moolenaar --- (In reply to John Baldwin from comment #5) Very possible. Maybe this theory be validated by using the monitor and mwait instructions on recent CPUs? --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Wed Nov 9 18:12:36 2016 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 290A9C38DB3 for ; Wed, 9 Nov 2016 18:12:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 185A0DF1 for ; Wed, 9 Nov 2016 18:12:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id uA9ICZ8H017066 for ; Wed, 9 Nov 2016 18:12:35 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-virtualization@FreeBSD.org Subject: [Bug 203682] Slow boot under VMware Fusion w/ UEFI firmware and SMP -- until APs are launched Date: Wed, 09 Nov 2016 18:12:36 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: jhb@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 09 Nov 2016 18:12:36 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D203682 --- Comment #8 from John Baldwin --- The problem with monitor/mwait is that it has to be emulated by the hypervi= sor (you get a VM-exit for it), but that's actually hard to do because the hypervisor can't tell when the relevant line is going to be updated (I'm pr= etty sure that bhyve just returns immediately from mwait for example). We can however put the APs to sleep while spinning on aps_ready via hlt and use an= IPI to resume them. This should work with most if not all hypervisors. That s= aid, I do plan to enable EARLY_AP_STARTUP in 12 anyway (perhaps I'll do it at the vendor summit later this week). --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Wed Nov 9 18:25:53 2016 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1DE3AC371CC for ; Wed, 9 Nov 2016 18:25:53 +0000 (UTC) (envelope-from rajil.s@gmail.com) Received: from mail-qt0-x22f.google.com (mail-qt0-x22f.google.com [IPv6:2607:f8b0:400d:c0d::22f]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id C13663B6; Wed, 9 Nov 2016 18:25:52 +0000 (UTC) (envelope-from rajil.s@gmail.com) Received: by mail-qt0-x22f.google.com with SMTP id w33so131808171qtc.3; Wed, 09 Nov 2016 10:25:52 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=pijFDK4V8i/x5VHOgtYojNki9PHWihYRKZFZNdU8mTA=; b=RreCRPUfHTyC8xUuHNd3nQ6OgBYxs4GvTDdcMH7DB8tK+/FWM7sNkznux0EoY6ig8i Jz7pvWaGcO5oaiV20SJHRN+ecW4ChehziWSYbiDaHUmLC+VZ5UhoRnfwqRVYWyqz3Af3 +gterPAFbaiON/G002ARieYV4zbrW7dyqVarrAz5Zj2CbTcoDoSbIrtFx/yhYmhLClAM sZe2VRRUJrglcE7niSA9fTlYB9htQJuqftH2SSqqQO3gX/yybC4ty4dhqEcWMl6cPtxu 9u/k3XZQSOMS3cr/LKy5DH0tmDeVO1PTbrVzXjYJMY2doRy+rdPU8XOsFNnziQiSM9Nh BtNA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=pijFDK4V8i/x5VHOgtYojNki9PHWihYRKZFZNdU8mTA=; b=kdGnSRcT+MYrzNDfs/TJ8unu/xJNdtGxMlKaU4po3FIPZowZ2tpJfvnJXOP9n42HiS X6sK3ahhY811YFpIOuLizM/7X9dTaEVq6hDEi89wOp15qegNfWrzUvstK3AYo/jGYY+t kv99L539iCb1Y/r/0H0P4RQAGpZyW/uXH2pY1OposHlmOFxTaKfmhzbhwgQRsChAWs0P 5ZHLlmnzINJA78LogVtgKgoBzLRtpJvdpoxcdYPMGCb0X5nvQMZ0aCjAm5Gd0qx8konn 6Wz1T5EJRHEgMoVxW9VxbXtvwHvLAQo5gdRQdGJDrDvvbI7weve+P4GByj5KTuzfeALv qEhA== X-Gm-Message-State: ABUngvfcLJTWgGROYS3yajzIRXXvkrwjUN1XtZxFm0Q35N4q4EFpSoad3T7PfGxAi8ekIGF4CWf8Qwbc6Eb8rg== X-Received: by 10.237.34.46 with SMTP id n43mr1159973qtc.105.1478715951834; Wed, 09 Nov 2016 10:25:51 -0800 (PST) MIME-Version: 1.0 Received: by 10.12.149.109 with HTTP; Wed, 9 Nov 2016 10:25:51 -0800 (PST) Received: by 10.12.149.109 with HTTP; Wed, 9 Nov 2016 10:25:51 -0800 (PST) In-Reply-To: References: <124ae089-6215-7632-44cf-319b5f88c0b5@gmail.com> <8c44e3c4-fcc8-d288-26f0-df742b1c79a7@gmail.com> From: Rajil Saraswat Date: Wed, 9 Nov 2016 12:25:51 -0600 Message-ID: Subject: Re: bhyve, ixgbe and debian 8 To: Peter Grehan Cc: freebsd-virtualization@freebsd.org Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 09 Nov 2016 18:25:53 -0000 On Nov 7, 2016 2:01 PM, "Peter Grehan" wrote: > > Hi Rajil, > > >>> I tried with the second onboard NIC and it worked the first time. iperf >>> showed 10g speeds. After restarting the VM, i get an error for both >>> NICs. > > > What's the FreeBSD host version ? There was work done recently to reset passthru devices pre/post running a guest which hopefully should have fixed this. > > later, > > Peter. > Peter, Is this specific to hardware or linux distribution ? Thanks From owner-freebsd-virtualization@freebsd.org Wed Nov 9 19:38:46 2016 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 67BA3C384FE for ; Wed, 9 Nov 2016 19:38:46 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from alto.onthenet.com.au (alto.OntheNet.com.au [203.13.68.12]) by mx1.freebsd.org (Postfix) with ESMTP id 2412EFE9 for ; Wed, 9 Nov 2016 19:38:45 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from iredmail.onthenet.com.au (iredmail.onthenet.com.au [203.13.68.150]) by alto.onthenet.com.au (Postfix) with ESMTPS id 00D2820A40CB for ; Thu, 10 Nov 2016 05:38:23 +1000 (AEST) Received: from localhost (iredmail.onthenet.com.au [127.0.0.1]) by iredmail.onthenet.com.au (Postfix) with ESMTP id E8E90280991 for ; Thu, 10 Nov 2016 05:38:22 +1000 (AEST) X-Amavis-Modified: Mail body modified (using disclaimer) - iredmail.onthenet.com.au Received: from iredmail.onthenet.com.au ([127.0.0.1]) by localhost (iredmail.onthenet.com.au [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id d3MTzpRgGZeZ for ; Thu, 10 Nov 2016 05:38:22 +1000 (AEST) Received: from Peters-MacBook-Pro-2.local (c-67-180-92-13.hsd1.ca.comcast.net [67.180.92.13]) by iredmail.onthenet.com.au (Postfix) with ESMTPSA id 10E56280988; Thu, 10 Nov 2016 05:38:21 +1000 (AEST) Subject: Re: bhyve, ixgbe and debian 8 To: Rajil Saraswat References: <124ae089-6215-7632-44cf-319b5f88c0b5@gmail.com> <8c44e3c4-fcc8-d288-26f0-df742b1c79a7@gmail.com> Cc: freebsd-virtualization@freebsd.org From: Peter Grehan Message-ID: <01f3ebaf-d7ba-79ca-1fe6-b03a7fca35c6@freebsd.org> Date: Wed, 9 Nov 2016 11:38:33 -0800 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:45.0) Gecko/20100101 Thunderbird/45.4.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-CMAE-Score: 0 X-CMAE-Analysis: v=2.2 cv=DZ1nkrlW c=1 sm=1 tr=0 a=A6CF0fG5TOl4vs6YHvqXgw==:117 a=5eVCmCvhg37cu/pjidAGzw==:17 a=IkcTkHD0fZMA:10 a=L24OOQBejmoA:10 a=6I5d2MoRAAAA:8 a=D32kV8LpZdNZSn0lvzcA:9 a=QEXdDO2ut3YA:10 a=_d_j6AihDoYA:10 a=IjZwj45LgO3ly-622nXo:22 wl=host:3 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 09 Nov 2016 19:38:46 -0000 Hi Rajil, > Is this specific to hardware or linux distribution ? Possibly both. The PCI device reset change that I mentioned earlier is https://svnweb.freebsd.org/base?view=revision&revision=306520 If you upgrade to 11-stable you should be able to pick it up and see if it helps. later, Peter. From owner-freebsd-virtualization@freebsd.org Fri Nov 11 04:34:17 2016 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B0A59C39917 for ; Fri, 11 Nov 2016 04:34:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 9F77F88B for ; Fri, 11 Nov 2016 04:34:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id uAB4YHVb079660 for ; Fri, 11 Nov 2016 04:34:17 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-virtualization@FreeBSD.org Subject: [Bug 208931] [patch] [hyperv] [netvsc] hn network driver fails to initialize if_baudrate Date: Fri, 11 Nov 2016 04:34:17 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.3-RELEASE X-Bugzilla-Keywords: patch X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: commit-hook@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 11 Nov 2016 04:34:17 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D208931 --- Comment #5 from commit-hook@freebsd.org --- A commit references this bug: Author: sephe Date: Fri Nov 11 04:33:44 UTC 2016 New revision: 308500 URL: https://svnweb.freebsd.org/changeset/base/308500 Log: MFC 307893 hyperv/hn: Set baudrate properly PR: 208931 Submitted by: Eugene Grosbein Reported by: Eugene Grosbein Sponsored by: Microsoft Changes: _U stable/10/ stable/10/sys/dev/hyperv/netvsc/hv_netvsc_drv_freebsd.c --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Sat Nov 12 00:17:24 2016 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C8302C3A73D for ; Sat, 12 Nov 2016 00:17:24 +0000 (UTC) (envelope-from alex.deiter@gmail.com) Received: from mail-lf0-x241.google.com (mail-lf0-x241.google.com [IPv6:2a00:1450:4010:c07::241]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4D1FCDD8 for ; Sat, 12 Nov 2016 00:17:24 +0000 (UTC) (envelope-from alex.deiter@gmail.com) Received: by mail-lf0-x241.google.com with SMTP id p100so2290649lfg.2 for ; Fri, 11 Nov 2016 16:17:24 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=from:content-transfer-encoding:mime-version:date:subject:message-id :to; bh=/r5b/iO6UYUdP8Y0OzZgveixrWiWBofmPRMMJgPXGPE=; b=C4buMJbBjcDbjydz+0pGFr4aRjZHE9PmzmWkIqZ1KidcRfB9pjOgPpPdihLppbUKj7 5pcfsdQ8hZ4JR0lqqDL9Fxmp8vA4h0TauXdooHeAoxEHcVBSaq69jdWrcHYKH4lAFE3M ZDfG9iH60GUXpOMdLumMmhk1BrEqQcOExb5imfhYXHw7MxbA+tWNl/xiKGRePr1Exxym IUSXijZplPH/1dBlhrKwnwI4vgdIqXA8kre0lB+RbVa9fWjKhgxfgECBgFiNJdGuxvKP fSk6kWWeavYBGZCf6AKhODehxa60bKmJzKn/2pjxlbmXjhO7u7g7JCyabIjAexnCmj7+ eSgA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:from:content-transfer-encoding:mime-version:date :subject:message-id:to; bh=/r5b/iO6UYUdP8Y0OzZgveixrWiWBofmPRMMJgPXGPE=; b=TS+oU2TqQmlJiXJ3tLaYweH/CPi2reR3ULH4IlsV993MZoGdge8SGEuSDcpoU1Uc5I www5ispokpZOI6z9T5SGrBy8vw3NYGqePhKhkKYG8T5kkq8lRHpdRlYuZ9OBfSMi538u ZyYX8zRtELO//4gucYhmWLUb+AnQQYwMecHaPhUsXkIR7Eneo/bExQdAnrqHYjo4aa0a cRIzWcLVF9stfCPGS5S128qcT7wL0FUIiYLadx957oP0BAqWjS4HTX9VLhdYRj/FA+w0 IjrMRroDi3OpISG3EzM2dq14dRKX7k+lVHARriGrIN8YEaSNceWbrLD4CnLIZ48GRls9 bx1Q== X-Gm-Message-State: ABUngves69f/lDa3gcNeyiCSncMEA/8T1racWU3oBxGrJgC/3b99O/b2+L+5Eq7/sZobBA== X-Received: by 10.25.15.36 with SMTP id e36mr2630987lfi.19.1478909842217; Fri, 11 Nov 2016 16:17:22 -0800 (PST) Received: from tiamat.deiter.local ([109.167.157.231]) by smtp.gmail.com with ESMTPSA id u203sm2719619lff.37.2016.11.11.16.17.21 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Fri, 11 Nov 2016 16:17:21 -0800 (PST) From: Alex Deiter Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 10.1 \(3251\)) Date: Sat, 12 Nov 2016 03:17:20 +0300 Subject: [Bug 214432] bhyve VM exiting: reason VMX / exit_reason 2 Message-Id: <530F83B0-DC83-423C-9B3F-EB930FC27F3C@gmail.com> To: freebsd-virtualization@freebsd.org X-Mailer: Apple Mail (2.3251) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 12 Nov 2016 00:17:24 -0000 Hello, I'm trying to start a SmartOS joyent_20161110T013148Z guest VM in bhyve = on FreeBSD/amd64 12.0-CURRENT(r308465). This is what bhyve outputs when the VM starts:=20 # cat device.map=20 (cd0) /test/smartos-latest.iso # cat grub.cfg multiboot /platform/i86pc/kernel/amd64/unix = /platform/i86pc/kernel/amd64/unix -B smartos=3Dtrue,console=3Dttyb module /platform/i86pc/amd64/boot_archive = /platform/i86pc/amd64/boot_archive type=3Drootfs name=3Dramdisk boot # grub-bhyve -m device.map -r cd0 -M 4096M test < grub.cfg # bhyve -m 4096M -s 3,ahci-cd,/test/smartos-latest.iso -s 31,lpc -l = com1,/dev/nmdm0A -l com2,/dev/nmdm1A test vm exit[0] reason VMX rip 0x0000000000000225 inst_length 2 status 0 exit_reason 2 qualification 0x0000000000000000 inst_type 0 inst_error 0 Abort (core dumped) I have no idea what "reason VMX" means or what "exit_reason 2" means. Is there a way to decode that?=20 What kinds of info is required to debug this issue?=20 Thank you! -- Alex Deiter alex.deiter@gmail.com From owner-freebsd-virtualization@freebsd.org Sat Nov 12 00:28:20 2016 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id CB284C3AA1D for ; Sat, 12 Nov 2016 00:28:20 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from alto.onthenet.com.au (alto.OntheNet.com.au [203.13.68.12]) by mx1.freebsd.org (Postfix) with ESMTP id 8E8B51391 for ; Sat, 12 Nov 2016 00:28:20 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from iredmail.onthenet.com.au (iredmail.onthenet.com.au [203.13.68.150]) by alto.onthenet.com.au (Postfix) with ESMTPS id E7BE520C1BEF for ; Sat, 12 Nov 2016 10:28:02 +1000 (AEST) Received: from localhost (iredmail.onthenet.com.au [127.0.0.1]) by iredmail.onthenet.com.au (Postfix) with ESMTP id DF4C5280900 for ; Sat, 12 Nov 2016 10:28:02 +1000 (AEST) X-Amavis-Modified: Mail body modified (using disclaimer) - iredmail.onthenet.com.au Received: from iredmail.onthenet.com.au ([127.0.0.1]) by localhost (iredmail.onthenet.com.au [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id OmNr-mgxWG9K for ; Sat, 12 Nov 2016 10:28:02 +1000 (AEST) Received: from busmail.onthenet.com.au (iredmail.onthenet.com.au [127.0.0.1]) by iredmail.onthenet.com.au (Postfix) with ESMTPSA id BB5E52808F7; Sat, 12 Nov 2016 10:28:02 +1000 (AEST) MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII; format=flowed Content-Transfer-Encoding: 7bit Date: Fri, 11 Nov 2016 16:28:02 -0800 From: grehan@freebsd.org To: Alex Deiter Cc: freebsd-virtualization@freebsd.org Subject: Re: [Bug 214432] bhyve VM exiting: reason VMX / =?UTF-8?Q?exit=5Freason=20=32?= In-Reply-To: <530F83B0-DC83-423C-9B3F-EB930FC27F3C@gmail.com> References: <530F83B0-DC83-423C-9B3F-EB930FC27F3C@gmail.com> Message-ID: <797f78046e400db482df45e13073b229@ptree32.com.au> X-Sender: grehan@freebsd.org User-Agent: OntheNet Business Mail X-CMAE-Score: 0 X-CMAE-Analysis: v=2.2 cv=DZ1nkrlW c=1 sm=1 tr=0 a=A6CF0fG5TOl4vs6YHvqXgw==:117 a=kj9zAlcOel0A:10 a=L24OOQBejmoA:10 a=6I5d2MoRAAAA:8 a=0uhv0JDTcEe-hY71f8IA:9 a=CjuIK1q_8ugA:10 a=rICxaf_bQtsA:10 a=IjZwj45LgO3ly-622nXo:22 wl=host:3 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 12 Nov 2016 00:28:20 -0000 Hi Alex, > I'm trying to start a SmartOS joyent_20161110T013148Z guest VM in > bhyve on FreeBSD/amd64 12.0-CURRENT(r308465). ... > # cat grub.cfg > multiboot /platform/i86pc/kernel/amd64/unix > /platform/i86pc/kernel/amd64/unix -B smartos=true,console=ttyb > module /platform/i86pc/amd64/boot_archive > /platform/i86pc/amd64/boot_archive type=rootfs name=ramdisk > boot The SmartOS kernel issues BIOS calls while running. You will need to boot it with a UEFI/CSM image that provides a BIOS interface - grub-bhyve only does image placement, so a BIOS call from a guest will eventually result in a triple-fault (exit code 2, from the Intel SDM Vol3 Appendix C. Yes, a bit cryptic, and should at least be a text message). Instructions for booting SmartOS are at: https://lists.freebsd.org/pipermail/freebsd-virtualization/2015-October/003833.html though, I'd add another line to that -s 0,hostbridge \ .. which allows recent SmartOS versions to use MSI interrupts for virtio devices. later, Peter. From owner-freebsd-virtualization@freebsd.org Sat Nov 12 00:58:41 2016 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3BDBCC3B067 for ; Sat, 12 Nov 2016 00:58:41 +0000 (UTC) (envelope-from alex.deiter@gmail.com) Received: from mail-lf0-x244.google.com (mail-lf0-x244.google.com [IPv6:2a00:1450:4010:c07::244]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id B36A129; Sat, 12 Nov 2016 00:58:40 +0000 (UTC) (envelope-from alex.deiter@gmail.com) Received: by mail-lf0-x244.google.com with SMTP id o20so2338002lfg.3; Fri, 11 Nov 2016 16:58:40 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=K7S8SK5+hpahV9gZKzAhxxlvmE1hadOLDOWvkOnABY4=; b=hUxcKm/GGek0jH1MQWNXxUJK0WsNFIC9HK/X91ov++6YkWoc1e6uAsWp6c4HaCQ3QN qFRvuN1EJPbdUWadL6Xh2CX/SmYMgjlj5QsxN0DJi+rqXjtNCmeFIU3PVr50hmlq0op6 AyqbYgDcUxS9k9ARkdS5iN5RHvczq/FT7Hrphmh1a9pwrDeONczm9ExRLaW2X3lV4Vw0 TZHVQEl8TSst9h8VbaLZ3tgKPvCHdrnClSejKQYB9z8W1nDhDTkeF0CFrGa8KMM8s0UT 0X9IJgB45OdMG4Gpmhw2Y1s1SSEbD3lsO2rME1ncxCohhyI4DzxU8VJZA0ZQDHu9+u5H S4tQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=K7S8SK5+hpahV9gZKzAhxxlvmE1hadOLDOWvkOnABY4=; b=ZERYZNfFZjnXNa0X1emBtQ00BSvaNXlxwvzHq/lrSMOeCHuqBaaJhlpaSryx5tYVLw 3NL+Divb8NmT6ZtxTY8iQXZJVSlkP1TmvODu2hB1CqTN4vm+cnAFII/3RHmmqOgnInzF Pnu+0CDl3oynh3rxJ2+hAiLxfw8jjqMQeCMpgLrgubYvkjosrOMz02WqApQ43Te3OBut GlF4xFsrqyYOysHlvEVg1gTci29tJRmofBXBTf+9nHEnMa14l4g+FeuAZQ8nmOfZ7t2W PGntFaMjLOtqBanAHKF4AMMuM9/wgyF4tKVptLVYntdjXQcc70GsK7QheaZRpcwgkeMx 1WYg== X-Gm-Message-State: ABUngvdXFDKoL90MAS7r2ZUGYOgZ8FJlksWwfZq6MHIxGDL/9x4AEPa+7gFXXLsJ9cRndg== X-Received: by 10.25.24.98 with SMTP id o95mr3217491lfi.4.1478912318151; Fri, 11 Nov 2016 16:58:38 -0800 (PST) Received: from tiamat.deiter.local ([109.167.157.231]) by smtp.gmail.com with ESMTPSA id x142sm1007285lfa.32.2016.11.11.16.58.36 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Fri, 11 Nov 2016 16:58:36 -0800 (PST) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 10.1 \(3251\)) Subject: Re: [Bug 214432] bhyve VM exiting: reason VMX / exit_reason 2 From: Alex Deiter In-Reply-To: <797f78046e400db482df45e13073b229@ptree32.com.au> Date: Sat, 12 Nov 2016 03:58:34 +0300 Cc: freebsd-virtualization@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <77A6BB15-2D3A-4DEF-AE29-2F1C66BD3D51@gmail.com> References: <530F83B0-DC83-423C-9B3F-EB930FC27F3C@gmail.com> <797f78046e400db482df45e13073b229@ptree32.com.au> To: grehan@freebsd.org X-Mailer: Apple Mail (2.3251) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 12 Nov 2016 00:58:41 -0000 Hello Peter, Thank you very much for your detailed explanation! -- Alex Deiter alex.deiter@gmail.com > On 12 Nov 2016, at 03:28, grehan@freebsd.org wrote: >=20 > Hi Alex, >=20 >> I'm trying to start a SmartOS joyent_20161110T013148Z guest VM in >> bhyve on FreeBSD/amd64 12.0-CURRENT(r308465). > ... >> # cat grub.cfg >> multiboot /platform/i86pc/kernel/amd64/unix >> /platform/i86pc/kernel/amd64/unix -B smartos=3Dtrue,console=3Dttyb >> module /platform/i86pc/amd64/boot_archive >> /platform/i86pc/amd64/boot_archive type=3Drootfs name=3Dramdisk >> boot >=20 > The SmartOS kernel issues BIOS calls while running. You will need to = boot it with a UEFI/CSM image that provides a BIOS interface - = grub-bhyve only does image placement, so a BIOS call from a guest will = eventually result in a triple-fault (exit code 2, from the Intel SDM = Vol3 Appendix C. Yes, a bit cryptic, and should at least be a text = message). >=20 > Instructions for booting SmartOS are at: > = https://lists.freebsd.org/pipermail/freebsd-virtualization/2015-October/00= 3833.html >=20 > though, I'd add another line to that >=20 > -s 0,hostbridge \ >=20 > .. which allows recent SmartOS versions to use MSI interrupts for = virtio devices. >=20 > later, >=20 > Peter.