From owner-freebsd-questions@FreeBSD.ORG Thu May 31 00:39:41 2012 Return-Path: Delivered-To: freebsd-questions@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id BC17D106564A for ; Thu, 31 May 2012 00:39:41 +0000 (UTC) (envelope-from sheshas@gmail.com) Received: from mail-lb0-f182.google.com (mail-lb0-f182.google.com [209.85.217.182]) by mx1.freebsd.org (Postfix) with ESMTP id 3B1018FC21 for ; Thu, 31 May 2012 00:39:40 +0000 (UTC) Received: by lbon10 with SMTP id n10so568827lbo.13 for ; Wed, 30 May 2012 17:39:40 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=FiiRHHhP+liPS8SyNFmzX6cGjZw++0Df3MMLJ60Hti8=; b=oHsGB5qQgNq1W+LKfFrMRuttq3f+CvJ8dowhCZ3dQwNzwRkHYpu3bN8L//wxSJuylL mOTGiJdALE2/wPlQOKQb8XXNBer29OBF5Wy59XDCuDpuJzd+TkxidSBw0Dq9W4aYEzGh LnZjqMZNpsJ27BQL891SD7zt1ubJu4fQ2ywAPBFOwMg47nZ8/qkqH8X+adl+sL/qNGkp iaJGwdBn5vOXPOhyM0uxEoyqAO81SxYFYCyLflqzheOZQStyuxv/T3LdVpxRhNh6uV/m lquZy1Uh+XVeg17FGjFB0ZZuc+87eXpuuyGz6ReBClOrQY/ogPlgZp7TkF+hKzzEjre+ 5C3Q== MIME-Version: 1.0 Received: by 10.152.104.47 with SMTP id gb15mr17448291lab.45.1338424779923; Wed, 30 May 2012 17:39:39 -0700 (PDT) Received: by 10.112.58.7 with HTTP; Wed, 30 May 2012 17:39:39 -0700 (PDT) Date: Wed, 30 May 2012 17:39:39 -0700 Message-ID: From: Shesha Sreenivasamurthy To: freebsd-questions@freebsd.org Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Subject: VT-d not working for FreeBSD 9.0 guest with IXGBE X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 31 May 2012 00:39:41 -0000 Hi, I have an issue with enabling VT-d with freebsd guest and was wondering of anyone out there are experiencing the similar issues. I am using the following setup HOST: Centos 6.2 Hypervisor: KVM Hardware: ixgbe 82599EB (10 GB nic) Guest: freebsd 9.0 Guest Driver version 2.4.4 When I use MSI/MSIX the link status is shown as "no carrier". When I disable MSI and MSIX in the guest so that it can fall back on INTx, I see that the link becomes active. However not packets are sent or received. When pinged from outside, sysctl shows dev.ix.0.queue0.txd_head: 0 dev.ix.0.queue0.rxd_head: 0 dev.ix.0.queue0.rxd_tail: 2047 dev.ix.0.queue0.rx_packets: 0 dev.ix.0.mac_stats.good_octets_rcvd: 320 dev.ix.0.mac_stats.good_pkts_rcvd: 5 When pinged from inside, sysctl shows dev.ix.0.queue0.txd_head: 0 dev.ix.0.queue0.rxd_head: 0 dev.ix.0.queue0.txd_tail: 4 dev.ix.0.queue0.rxd_tail: 2047 dev.ix.0.queue0.tx_packets: 4 dev.ix.0.queue0.rx_packets: 0 dev.ix.0.mac_stats.good_octets_rcvd: 320 dev.ix.0.mac_stats.good_pkts_rcvd: 5 dev.ix.0.mac_stats.good_octets_txd: 0 dev.ix.0.mac_stats.good_pkts_txd: 0 I guess, hardware is getting the packets but not put in the ringbuffer. If I install freebsd 9.0 on bare metel and have the same hardware and same driver running, the link comes up and packets are transferred. Therefore, in case of VT-d (PCI passthrough) the driver is not setting up things correctly. Another data point is, if Centos guests is used instead of freebsd guest, the hardware comes up correctly and can send/receive packets. The freebsd driver that I am using is the one posted on the intel's website. http://downloadcenter.intel.com/Detail_Desc.aspx?agr=Y&ProdId=3189&DwnldID=14688&ProductFamily=Ethernet+Components&ProductLine=Ethernet+Controllers&ProductProduct=Intel%C2%AE+82599+10+Gigabit+Ethernet+Controller&DownloadType=Drivers&OSFullname=FreeBSD*eng