From owner-freebsd-net@FreeBSD.ORG Tue Mar 24 15:49:31 2015 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id A1120965; Tue, 24 Mar 2015 15:49:31 +0000 (UTC) Received: from mail.strugglingcoder.info (strugglingcoder.info [65.19.130.35]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 805F8B3B; Tue, 24 Mar 2015 15:49:31 +0000 (UTC) Received: from localhost (unknown [10.1.1.3]) (Authenticated sender: hiren@strugglingcoder.info) by mail.strugglingcoder.info (Postfix) with ESMTPSA id 3DBD8D2AD1; Tue, 24 Mar 2015 08:49:31 -0700 (PDT) Date: Tue, 24 Mar 2015 08:49:31 -0700 From: hiren panchasara To: Jack Vogel Subject: Re: Full 32bit flowid from igb(4) Message-ID: <20150324154931.GC53237@strugglingcoder.info> References: <20150323233908.GT53237@strugglingcoder.info> <20150323234214.GU53237@strugglingcoder.info> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="tauoZ0QFNrdllat7" Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.23 (2014-03-12) Cc: Jack F Vogel , FreeBSD Net , Adrian Chadd , erj@freebsd.org, Jason Wolfe X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 24 Mar 2015 15:49:31 -0000 --tauoZ0QFNrdllat7 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On 03/23/15 at 04:58P, Jack Vogel wrote: > I think that line was there at one time outside the RSS define, I believe this was added by Adrian as part of RSS work and was not there before. I may be wrong. > I'd have to > take a look at > the code a bit more, or maybe Eric will.... I'll wait for the comments. Cheers, Hiren >=20 > Jack >=20 >=20 > On Mon, Mar 23, 2015 at 4:42 PM, hiren panchasara < > hiren@strugglingcoder.info> wrote: >=20 > > Correcting Eric's email and subject line. > > > > On 03/23/15 at 04:39P, hiren panchasara wrote: > > > scottl@freebsd.org > > > Bcc: > > > Subject: Full 32bit flowid from igb(4) [was: Re: Unbalanced LACP link] > > > Reply-To: > > > In-Reply-To: <20150319175145.GH53237@strugglingcoder.info> > > > > > > On 03/19/15 at 10:51P, hiren panchasara wrote: > > > > On 03/17/15 at 12:34P, Adrian Chadd wrote: > > > > > On 17 March 2015 at 11:33, Jason Wolfe wro= te: > > > > > > On Mon, Mar 16, 2015 at 2:43 AM, Hans Petter Selasky < > > hps@selasky.org> wrote: > > > > > >> On 03/16/15 10:37, Vitalii Duk wrote: > > > > > >>> > > > > > >>> I've changed use_flowid to 0 and it helped! But isn't it sett= ing > > > > > >>> significant? In a description it says "Shift flowid bits to > > prevent > > > > > >>> multiqueue collisions". > > > > > >> > > > > > >> > > > > > >> Hi, > > > > > >> > > > > > >> Maybe your ethernet hardware is not properly setting the m_flo= wid > > ... > > > > > >> > > > > > >> --HPS > > > > > >> > > > > > > > > > > > > Flip use_flowid back to 1 and try setting > > > > > > net.link.lagg.default_flowid_shift / net.link.lagg.X.flowid_shi= ft > > to 0 > > > > > > as Hiren suggested. r260179 added this shift, which has caused= us > > > > > > balancing issues with the i350/igb. > > > > > > > > > > > > https://svnweb.freebsd.org/base?view=3Drevision&revision=3D2601= 79 > > > > > > > > > > > > Based on Adrian's comment about igb/ixgbe not setting the 'full > > > > > > flowid' under normal conditions, does that mean this shift shou= ld > > be 0 > > > > > > by default to ensure we don't break balancing for devices that = only > > > > > > set the CPU/MSIX queue? > > > > > > > > > > Or we can just see if there's anything wrong with putting the ful= l 32 > > > > > bit RSS flowid in received packets that have them. > > > > > > > > It'd be nice to have but for now I am proposing following to fix a > > known > > > > broken case because of an optimization: > > > > https://reviews.freebsd.org/D2098 > > > > > > Turns out, setting flowid_shift to 0 is not the correct solution. Ple= ase > > > look at the review above for more details. > > > > > > Looking at the code, we have a way to get full flowid but it's hidden > > > under "ifdef RSS": > > > rxr->fmp->m_pkthdr.flowid =3D le32toh(cur->wb.lower.hi_dword.rss); > > > > > > Using just this line gives me good hash on I350 igb(4) chipset that we > > > have. > > > > > > Is it possible to expose this outside RSS? Would this break other > > > things/chips? > > > > > > Cheers, > > > Hiren > > > > > _______________________________________________ > freebsd-net@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" --tauoZ0QFNrdllat7 Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.22 (FreeBSD) iQF8BAEBCgBmBQJVEYeKXxSAAAAAAC4AKGlzc3Vlci1mcHJAbm90YXRpb25zLm9w ZW5wZ3AuZmlmdGhob3JzZW1hbi5uZXRBNEUyMEZBMUQ4Nzg4RjNGMTdFNjZGMDI4 QjkyNTBFMTU2M0VERkU1AAoJEIuSUOFWPt/lWlYH/1XzN27EjGdd7eDHkXFGRMXU nNOTyqWyZbril/emcyznvb887HbMz1dZnpqyMWtgPjJHmRK67bAXgTAdaBLr/HAz NLppdzeL0HmaZ9sx++zbP7+9MGPf6UaCswMoeAb51d3ElJjTtGij9IT08URWhc9P YDVwiQaPADmcMUSm247jEePKJ3cxdpfvA1BIMsEr4CcGucsBuXW+FoHqltpotGN3 aJTjSEoBSOUsiJ+BQoMpykT/yytjjB08CHjZ9g2Fed4g07fuAeAPJBvGRUYK/Bpv S8FnFFk3YaqwbuOv2Ox04GabIRqRZ8CIIznaSLDbjGJ7yL9WRpzn86qdMJGmsZQ= =odC7 -----END PGP SIGNATURE----- --tauoZ0QFNrdllat7--