Date: Wed, 21 Dec 2011 08:23:58 -0700 From: Clint <clint@servedomains.com> To: Luigi Rizzo <rizzo@iet.unipi.it> Cc: freebsd-net@freebsd.org Subject: Re: igb performance/load udp issue Message-ID: <9fec6cc5fb8e42665b6056587f826338@servedomains.com> In-Reply-To: <20111221153456.GA30629@onelab2.iet.unipi.it> References: <2f23773b5165887ac51d19a612bf4c93@servedomains.com> <20111220224814.GA7715@michelle.cdnetworks.com> <5b246a7cf0bceedf39ff5718336b0753@servedomains.com> <CAFOYbcn%2BraVVFThgnZKX6NgEmKPktzeysW60N%2BKOUWNiXO%2B6-g@mail.gmail.com> <91610121f172c87d5095c8ac03ea9837@servedomains.com> <20111221153456.GA30629@onelab2.iet.unipi.it>
next in thread | previous in thread | raw e-mail | index | archive | help
On Wed, 21 Dec 2011 16:34:56 +0100, Luigi Rizzo wrote: > On Wed, Dec 21, 2011 at 08:04:54AM -0700, Clint wrote: >> On Tue, 20 Dec 2011 22:46:46 -0800, Jack Vogel wrote: >> >I was fighting with UDP issues before the latest checkin, so you >> >should >> >look at THAT version, 2.3.1 in HEAD please. >> > >> >Jack >> > >> >> I'm actually running the HEAD version now, but my problems still >> persist. I did notice that the excessive load is now spread across >> multiple cores where before it was isolated to one core at a time. >> This >> version also doesn't suffer from the horrible performance I >> experienced >> with v2.2.5. > > as someone mentioned, it may have to do with the sender > using multiple queues thus causing reordering in the frames, > which then the receiver has to sort (and often, the receive > queue is a list so O(N) complexity per packet.) > > Can you run the igb driver with just a single queue ? > In the bootloader, or before loading the module using "kenv", you > should set > > hw.igb.num_queues = 1 > > This should prevent gratuitous reordering and perhaps fix > your performance. > > cheers > luigi I've already tried that as well, but with the v2.0.3 driver, didn't help. I'll try it again with the HEAD driver tonight. Thanks, Clint
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?9fec6cc5fb8e42665b6056587f826338>