From owner-freebsd-net@freebsd.org Thu Nov 21 18:10:46 2019 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 58F891C6B03; Thu, 21 Nov 2019 18:10:46 +0000 (UTC) (envelope-from michal@microwave.sk) Received: from daemon.microwave.sk (daemon.microwave.sk [IPv6:2a01:108:1:1001::d0]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 47Jnfr4g5Nz3FSR; Thu, 21 Nov 2019 18:10:44 +0000 (UTC) (envelope-from michal@microwave.sk) Received: from [192.168.0.128] (static-dsl-28.87-197-110.telecom.sk [87.197.110.28]) by daemon.microwave.sk (Postfix) with ESMTPSA id F2C712A9F; Thu, 21 Nov 2019 19:10:40 +0100 (CET) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 13.0 \(3601.0.10\)) Subject: Re: device_attach: ixv0 attach returned 5 From: =?utf-8?Q?Michal_Van=C4=8Do?= In-Reply-To: Date: Thu, 21 Nov 2019 19:10:40 +0100 Cc: freebsd-net@freebsd.org, freebsd-stable@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <01EC7302-24A6-4441-85A2-4D24C97696ED@microwave.sk> References: <2D60E558-2F48-40EA-BF0D-C350BD005215@microwave.sk> To: Richard Gallamore X-Mailer: Apple Mail (2.3601.0.10) X-Rspamd-Queue-Id: 47Jnfr4g5Nz3FSR X-Spamd-Bar: -- X-Spamd-Result: default: False [-2.41 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_ALLOW(-0.20)[microwave.sk:s=mail]; NEURAL_HAM_MEDIUM(-0.98)[-0.985,0]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+mx]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; MV_CASE(0.50)[]; NEURAL_HAM_LONG(-0.95)[-0.948,0]; TO_DN_SOME(0.00)[]; DKIM_TRACE(0.00)[microwave.sk:+]; DMARC_POLICY_ALLOW(-0.50)[microwave.sk,quarantine]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; IP_SCORE(0.02)[country: SK(0.09)]; ASN(0.00)[asn:31127, ipnet:2a01:108::/32, country:SK]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 21 Nov 2019 18:10:46 -0000 Well then this is really annoying. I can image few other applications = besides virtualization. Jails using vnet bound to VF instead of epair being one = of=20 examples. Any hope that someone will port the SR-IOV from Intel=E2=80=99s = code into the base driver on foreseeable future? regards Michal > On 21 Nov 2019, at 18:52, Richard Gallamore = wrote: >=20 > Hello Michal, >=20 >> I=E2=80=99m running 12-STABLE. Is this a hardware related or possibly = a driver > bug? > This is probably a driver / module bug. >=20 > [1] is a bug on this issue, that I opened some years ago. The last = time > I tested the sr-iov functionality it was working if you compile the = intel > module with sr-iov support enabled but not with the base module. This > was probably a couple years ago though and on 12-CURRENT before > 12 was released. >=20 > Personally I suggest you just avoid sr-iov though and use bridges. = sr-iov > was > a cool idea but it just failed to get an attraction. Probably several > reasons > for this, based on my experience I would say the primary reason is = because > its designed use case is for virtualization, and if you do use this = for > virtualization, you trade the ability to do live migrations due to = using > physical hardware. >=20 > Hope this helps, > Richard Gallamore >=20 > On Thu, Nov 21, 2019 at 3:53 AM Michal Van=C4=8Do via freebsd-stable < > freebsd-stable@freebsd.org> wrote: >=20 >> Hi, >>=20 >> I=E2=80=99m trying to get SR-IOV working with my two port Intel 10G = NIC: >>=20 >> ix0@pci0:3:0:0: class=3D0x020000 card=3D0x15ad15d9 chip=3D0x15ad8086 = rev=3D0x00 >> hdr=3D0x00 >> vendor =3D 'Intel Corporation' >> device =3D 'Ethernet Connection X552/X557-AT 10GBASE-T' >> class =3D network >> subclass =3D ethernet >> ix1@pci0:3:0:1: class=3D0x020000 card=3D0x15ad15d9 chip=3D0x15ad8086 = rev=3D0x00 >> hdr=3D0x00 >> vendor =3D 'Intel Corporation' >> device =3D 'Ethernet Connection X552/X557-AT 10GBASE-T' >> class =3D network >> subclass =3D ethernet >>=20 >> with this iovctl config: >>=20 >> # cat /etc/iovctl_ix1.conf >> PF { >> device: "ix1"; >> num_vfs: 4; >> } >>=20 >> I get 4 PCI devices created: >>=20 >> none57@pci0:3:0:129: class=3D0x020000 card=3D0x15ad15d9 = chip=3D0x15a88086 >> rev=3D0x00 hdr=3D0x00 >> vendor =3D 'Intel Corporation' >> device =3D 'Ethernet Connection X552 Virtual Function' >> class =3D network >> subclass =3D ethernet >> none58@pci0:3:0:131: class=3D0x020000 card=3D0x15ad15d9 = chip=3D0x15a88086 >> rev=3D0x00 hdr=3D0x00 >> vendor =3D 'Intel Corporation' >> device =3D 'Ethernet Connection X552 Virtual Function' >> class =3D network >> subclass =3D ethernet >> none59@pci0:3:0:133: class=3D0x020000 card=3D0x15ad15d9 = chip=3D0x15a88086 >> rev=3D0x00 hdr=3D0x00 >> vendor =3D 'Intel Corporation' >> device =3D 'Ethernet Connection X552 Virtual Function' >> class =3D network >> subclass =3D ethernet >> none60@pci0:3:0:135: class=3D0x020000 card=3D0x15ad15d9 = chip=3D0x15a88086 >> rev=3D0x00 hdr=3D0x00 >> vendor =3D 'Intel Corporation' >> device =3D 'Ethernet Connection X552 Virtual Function' >> class =3D network >> subclass =3D ethernet >>=20 >> But the driver fails to attach with following errors: >>=20 >> ixv0: at device = 0.129 >> on pci4 >> ixv0: ...reset_hw() failure: Reset Failed! >> ixv0: IFDI_ATTACH_PRE failed 5 >> device_attach: ixv0 attach returned 5 >> ixv0: at device = 0.131 >> on pci4 >> ixv0: ...reset_hw() failure: Reset Failed! >> ixv0: IFDI_ATTACH_PRE failed 5 >> device_attach: ixv0 attach returned 5 >> ixv0: at device = 0.133 >> on pci4 >> ixv0: ...reset_hw() failure: Reset Failed! >> ixv0: IFDI_ATTACH_PRE failed 5 >> device_attach: ixv0 attach returned 5 >> ixv0: at device = 0.135 >> on pci4 >> ixv0: ...reset_hw() failure: Reset Failed! >> ixv0: IFDI_ATTACH_PRE failed 5 >> device_attach: ixv0 attach returned 5 >>=20 >> I=E2=80=99m running 12-STABLE. Is this a hardware related or possibly = a driver bug? >>=20 >> regards >> Michal >>=20 >> _______________________________________________ >> freebsd-stable@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-stable >> To unsubscribe, send any mail to = "freebsd-stable-unsubscribe@freebsd.org" >>=20 > _______________________________________________ > freebsd-net@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org"