From owner-freebsd-virtualization@freebsd.org Mon Feb 22 20:26:46 2016 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C085EAB0299; Mon, 22 Feb 2016 20:26:46 +0000 (UTC) (envelope-from ricera10@gmail.com) Received: from mail-qk0-f170.google.com (mail-qk0-f170.google.com [209.85.220.170]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 84FA9101A; Mon, 22 Feb 2016 20:26:46 +0000 (UTC) (envelope-from ricera10@gmail.com) Received: by mail-qk0-f170.google.com with SMTP id s68so60326606qkh.3; Mon, 22 Feb 2016 12:26:46 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:content-type; bh=1UhCqo4zVKQgLnnbmMYj7IXgQxEM5kin1WT5WhjwhY8=; b=EsPXbJNxiSCLd16MBiyf9kcFFua9vlLSTn/i6Y2TAwT6EAZDf7jur2CdCbJbla2giU xxOZXW2TOtsmMCNIg+nuUxmbs7bYN1VBxBoP7cNJNWDuLGc/QjSBEwFqWgLYsqnWTBq3 iJyBxR0lkKawl3oatd8n04vMuPlX1k8sAaW5zRv4t5ahChlUzBTgsFquEVEfNw/k0Htb 4OTXL29ls16alTLN6pYXpv/ZP9RC/uykFC/EZvXLNxqxtGUbNIp7t5IwOfdbVM4mydCH SDlXZog6Z+1J/eqi4F8qgENTIGtlePzdK99TmTaSuO58bYtcGJErwGwxL2m1otj10KG6 Pb2Q== X-Gm-Message-State: AG10YORLp7BZAUhE0M2w1iFTV9p6GH7FM6Y6tVeu5Riczp9NOAwz5yn/b4n0VzF8W0adVA== X-Received: by 10.55.81.87 with SMTP id f84mr36145123qkb.10.1456167093602; Mon, 22 Feb 2016 10:51:33 -0800 (PST) Received: from mail-qk0-f179.google.com (mail-qk0-f179.google.com. [209.85.220.179]) by smtp.gmail.com with ESMTPSA id n35sm7133731qgn.10.2016.02.22.10.51.33 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Mon, 22 Feb 2016 10:51:33 -0800 (PST) Received: by mail-qk0-f179.google.com with SMTP id o6so59487405qkc.2; Mon, 22 Feb 2016 10:51:33 -0800 (PST) X-Received: by 10.55.79.79 with SMTP id d76mr36394401qkb.76.1456167093035; Mon, 22 Feb 2016 10:51:33 -0800 (PST) MIME-Version: 1.0 References: In-Reply-To: From: Eric Joyner Date: Mon, 22 Feb 2016 18:51:23 +0000 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: sr-iov issues, reset_hw() failed with error -100 To: Ultima , freebsd-current@freebsd.org, freebsd-virtualization@freebsd.org Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 22 Feb 2016 20:26:47 -0000 Did you do an ifconfig up on ix1 before loading the VF driver? On Sat, Feb 20, 2016 at 11:57 AM Ultima wrote: > Decided to do some testing with iovctl to see how sr-iov is coming along. > Currently when adding the vf's there are a couple errors, and the network > no longer function after iovctl is started. My guess is the reset_hw() call > that is failing. Any ideas why this call would fail? I tested this on both > ports, ix1 is detached and unused for this test, however inserting a cable > results in an unusable port. iovctl -Dd ix1 removes the vf's, however > functionality is still not restored without a system restart. > > FreeBSD S1 11.0-CURRENT FreeBSD 11.0-CURRENT #0 r295736: Wed Feb 17 > 21:17:28 EST 2016 root@S1:/usr/obj/usr/src/sys/MYKERNEL amd64 > > /boot/loader.conf > hw.ix.num_queues="4" > > /etc/iovctl.conf > PF { > device : ix1; > num_vfs : 31; > } > > DEFAULT { > passthrough : true; > } > VF-0 { > passthrough : false; > } > VF-1 { > passthrough : false; > } > > # iovctl -C -f /etc/iovctl.conf > > dmesg > ixv0: 1.4.6-k> at device 0.129 on pci12 > ixv0: Using MSIX interrupts with 2 vectors > ixv0: ixgbe_reset_hw() failed with error -100 > device_attach: ixv0 attach returned 5 > ixv0: 1.4.6-k> at device 0.131 on pci12 > ixv0: Using MSIX interrupts with 2 vectors > ixv0: ixgbe_reset_hw() failed with error -100 > device_attach: ixv0 attach returned 5 > pci12: at device 0.133 (no driver attached) > pci12: at device 0.135 (no driver attached) > pci12: at device 0.137 (no driver attached) > pci12: at device 0.139 (no driver attached) > pci12: at device 0.141 (no driver attached) > pci12: at device 0.143 (no driver attached) > pci12: at device 0.145 (no driver attached) > pci12: at device 0.147 (no driver attached) > pci12: at device 0.149 (no driver attached) > pci12: at device 0.151 (no driver attached) > pci12: at device 0.153 (no driver attached) > pci12: at device 0.155 (no driver attached) > pci12: at device 0.157 (no driver attached) > pci12: at device 0.159 (no driver attached) > pci12: at device 0.161 (no driver attached) > pci12: at device 0.163 (no driver attached) > pci12: at device 0.165 (no driver attached) > pci12: at device 0.167 (no driver attached) > pci12: at device 0.169 (no driver attached) > pci12: at device 0.171 (no driver attached) > pci12: at device 0.173 (no driver attached) > pci12: at device 0.175 (no driver attached) > pci12: at device 0.177 (no driver attached) > pci12: at device 0.179 (no driver attached) > pci12: at device 0.181 (no driver attached) > pci12: at device 0.183 (no driver attached) > pci12: at device 0.185 (no driver attached) > pci12: at device 0.187 (no driver attached) > pci12: at device 0.189 (no driver attached) > > pciconf -lv > ix1@pci0:129:0:1: class=0x020000 card=0x00001458 chip=0x15288086 > rev=0x01 hdr=0x00 > vendor = 'Intel Corporation' > device = 'Ethernet Controller 10-Gigabit X540-AT2' > class = network > subclass = ethernet > none155@pci0:129:0:129: class=0x020000 card=0x00001458 chip=0x15158086 > rev=0x01 hdr=0x00 > vendor = 'Intel Corporation' > device = 'X540 Ethernet Controller Virtual Function' > class = network > subclass = ethernet > none156@pci0:129:0:131: class=0x020000 card=0x00001458 chip=0x15158086 > rev=0x01 hdr=0x00 > vendor = 'Intel Corporation' > device = 'X540 Ethernet Controller Virtual Function' > class = network > subclass = ethernet > ppt0@pci0:129:0:133: class=0x020000 card=0x00001458 chip=0x15158086 > rev=0x01 hdr=0x00 > vendor = 'Intel Corporation' > device = 'X540 Ethernet Controller Virtual Function' > class = network > subclass = ethernet > ppt1@pci0:129:0:135: class=0x020000 card=0x00001458 chip=0x15158086 > rev=0x01 hdr=0x00 > vendor = 'Intel Corporation' > device = 'X540 Ethernet Controller Virtual Function' > class = network > subclass = ethernet > ppt2@pci0:129:0:137: class=0x020000 card=0x00001458 chip=0x15158086 > rev=0x01 hdr=0x00 > vendor = 'Intel Corporation' > device = 'X540 Ethernet Controller Virtual Function' > class = network > subclass = ethernet > ppt3@pci0:129:0:139: class=0x020000 card=0x00001458 chip=0x15158086 > rev=0x01 hdr=0x00 > vendor = 'Intel Corporation' > device = 'X540 Ethernet Controller Virtual Function' > class = network > subclass = ethernet > ppt4@pci0:129:0:141: class=0x020000 card=0x00001458 chip=0x15158086 > rev=0x01 hdr=0x00 > vendor = 'Intel Corporation' > device = 'X540 Ethernet Controller Virtual Function' > class = network > subclass = ethernet > ppt5@pci0:129:0:143: class=0x020000 card=0x00001458 chip=0x15158086 > rev=0x01 hdr=0x00 > vendor = 'Intel Corporation' > device = 'X540 Ethernet Controller Virtual Function' > class = network > subclass = ethernet > ppt6@pci0:129:0:145: class=0x020000 card=0x00001458 chip=0x15158086 > rev=0x01 hdr=0x00 > vendor = 'Intel Corporation' > device = 'X540 Ethernet Controller Virtual Function' > class = network > subclass = ethernet > ppt7@pci0:129:0:147: class=0x020000 card=0x00001458 chip=0x15158086 > rev=0x01 hdr=0x00 > vendor = 'Intel Corporation' > device = 'X540 Ethernet Controller Virtual Function' > class = network > subclass = ethernet > ppt8@pci0:129:0:149: class=0x020000 card=0x00001458 chip=0x15158086 > rev=0x01 hdr=0x00 > vendor = 'Intel Corporation' > device = 'X540 Ethernet Controller Virtual Function' > class = network > subclass = ethernet > ppt9@pci0:129:0:151: class=0x020000 card=0x00001458 chip=0x15158086 > rev=0x01 hdr=0x00 > vendor = 'Intel Corporation' > device = 'X540 Ethernet Controller Virtual Function' > class = network > subclass = ethernet > ppt10@pci0:129:0:153: class=0x020000 card=0x00001458 chip=0x15158086 > rev=0x01 hdr=0x00 > vendor = 'Intel Corporation' > device = 'X540 Ethernet Controller Virtual Function' > class = network > subclass = ethernet > ppt11@pci0:129:0:155: class=0x020000 card=0x00001458 chip=0x15158086 > rev=0x01 hdr=0x00 > vendor = 'Intel Corporation' > device = 'X540 Ethernet Controller Virtual Function' > class = network > subclass = ethernet > ppt12@pci0:129:0:157: class=0x020000 card=0x00001458 chip=0x15158086 > rev=0x01 hdr=0x00 > vendor = 'Intel Corporation' > device = 'X540 Ethernet Controller Virtual Function' > class = network > subclass = ethernet > ppt13@pci0:129:0:159: class=0x020000 card=0x00001458 chip=0x15158086 > rev=0x01 hdr=0x00 > vendor = 'Intel Corporation' > device = 'X540 Ethernet Controller Virtual Function' > class = network > subclass = ethernet > ppt14@pci0:129:0:161: class=0x020000 card=0x00001458 chip=0x15158086 > rev=0x01 hdr=0x00 > vendor = 'Intel Corporation' > device = 'X540 Ethernet Controller Virtual Function' > class = network > subclass = ethernet > ppt15@pci0:129:0:163: class=0x020000 card=0x00001458 chip=0x15158086 > rev=0x01 hdr=0x00 > vendor = 'Intel Corporation' > device = 'X540 Ethernet Controller Virtual Function' > class = network > subclass = ethernet > ppt16@pci0:129:0:165: class=0x020000 card=0x00001458 chip=0x15158086 > rev=0x01 hdr=0x00 > vendor = 'Intel Corporation' > device = 'X540 Ethernet Controller Virtual Function' > class = network > subclass = ethernet > ppt17@pci0:129:0:167: class=0x020000 card=0x00001458 chip=0x15158086 > rev=0x01 hdr=0x00 > vendor = 'Intel Corporation' > device = 'X540 Ethernet Controller Virtual Function' > class = network > subclass = ethernet > ppt18@pci0:129:0:169: class=0x020000 card=0x00001458 chip=0x15158086 > rev=0x01 hdr=0x00 > vendor = 'Intel Corporation' > device = 'X540 Ethernet Controller Virtual Function' > class = network > subclass = ethernet > ppt19@pci0:129:0:171: class=0x020000 card=0x00001458 chip=0x15158086 > rev=0x01 hdr=0x00 > vendor = 'Intel Corporation' > device = 'X540 Ethernet Controller Virtual Function' > class = network > subclass = ethernet > ppt20@pci0:129:0:173: class=0x020000 card=0x00001458 chip=0x15158086 > rev=0x01 hdr=0x00 > vendor = 'Intel Corporation' > device = 'X540 Ethernet Controller Virtual Function' > class = network > subclass = ethernet > ppt21@pci0:129:0:175: class=0x020000 card=0x00001458 chip=0x15158086 > rev=0x01 hdr=0x00 > vendor = 'Intel Corporation' > device = 'X540 Ethernet Controller Virtual Function' > class = network > subclass = ethernet > ppt22@pci0:129:0:177: class=0x020000 card=0x00001458 chip=0x15158086 > rev=0x01 hdr=0x00 > vendor = 'Intel Corporation' > device = 'X540 Ethernet Controller Virtual Function' > class = network > subclass = ethernet > ppt23@pci0:129:0:179: class=0x020000 card=0x00001458 chip=0x15158086 > rev=0x01 hdr=0x00 > vendor = 'Intel Corporation' > device = 'X540 Ethernet Controller Virtual Function' > class = network > subclass = ethernet > ppt24@pci0:129:0:181: class=0x020000 card=0x00001458 chip=0x15158086 > rev=0x01 hdr=0x00 > vendor = 'Intel Corporation' > device = 'X540 Ethernet Controller Virtual Function' > class = network > subclass = ethernet > ppt25@pci0:129:0:183: class=0x020000 card=0x00001458 chip=0x15158086 > rev=0x01 hdr=0x00 > vendor = 'Intel Corporation' > device = 'X540 Ethernet Controller Virtual Function' > class = network > subclass = ethernet > ppt26@pci0:129:0:185: class=0x020000 card=0x00001458 chip=0x15158086 > rev=0x01 hdr=0x00 > vendor = 'Intel Corporation' > device = 'X540 Ethernet Controller Virtual Function' > class = network > subclass = ethernet > ppt27@pci0:129:0:187: class=0x020000 card=0x00001458 chip=0x15158086 > rev=0x01 hdr=0x00 > vendor = 'Intel Corporation' > device = 'X540 Ethernet Controller Virtual Function' > class = network > subclass = ethernet > ppt28@pci0:129:0:189: class=0x020000 card=0x00001458 chip=0x15158086 > rev=0x01 hdr=0x00 > vendor = 'Intel Corporation' > device = 'X540 Ethernet Controller Virtual Function' > class = network > subclass = ethernet > > Ultima > _______________________________________________ > freebsd-current@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-current > To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org" >