Date: Sun, 23 Aug 2015 15:16:52 +0300 From: Slawa Olhovchenkov <slw@zxy.spb.ru> To: Daniel Braniss <danny@cs.huji.ac.il> Cc: Rick Macklem <rmacklem@uoguelph.ca>, pyunyh@gmail.com, Hans Petter Selasky <hps@selasky.org>, FreeBSD stable <freebsd-stable@freebsd.org>, FreeBSD Net <freebsd-net@freebsd.org>, Gleb Smirnoff <glebius@FreeBSD.org>, Christopher Forgeron <csforgeron@gmail.com> Subject: Re: ix(intel) vs mlxen(mellanox) 10Gb performance Message-ID: <20150823121652.GJ3158@zxy.spb.ru> In-Reply-To: <49173B1F-7B5E-4D59-8651-63D97B0CB5AC@cs.huji.ac.il> References: <1D52028A-B39F-4F9B-BD38-CB1D73BF5D56@cs.huji.ac.il> <55D429A4.3010407@selasky.org> <20150819074212.GB964@michelle.fasterthan.com> <55D43615.1030401@selasky.org> <2013503980.25726607.1439989235806.JavaMail.zimbra@uoguelph.ca> <20150820023024.GB996@michelle.fasterthan.com> <1153838447.28656490.1440193567940.JavaMail.zimbra@uoguelph.ca> <15D19823-08F7-4E55-BBD0-CE230F67D26E@cs.huji.ac.il> <818666007.28930310.1440244756872.JavaMail.zimbra@uoguelph.ca> <49173B1F-7B5E-4D59-8651-63D97B0CB5AC@cs.huji.ac.il>
next in thread | previous in thread | raw e-mail | index | archive | help
On Sun, Aug 23, 2015 at 02:08:56PM +0300, Daniel Braniss wrote: > >> send me the patch and I'll test it ASAP. > >> danny > >> > > Patch is attached. The one for head will also include an update to the comment > > in sys/net/if_var.h, but that isn't needed for testing. > > > well, the plot thickens. > > Yesterday, before running the new kernel, I decided to re run my test, and to my surprise > i was getting good numbers, about 300MGB/s with and without TSO. > > this morning, the numbers were again bad, around 70MGB/s,what the ^%$#@! > > so, after some coffee, I run some more tests, and some conclusions: > using a netapp(*) as the nfs client: > - doing > ifconfig ix0 tso or -tso > does some magic and numbers are back to normal - for a while > > using another Fbsd/zfs as client all is nifty, actually a bit faster than the netapp (not a fair > comparison, since the zfs client is not heavily used) and I can't see any degradation. > > btw, this is with the patch applied, but was seeing similar numbers before the patch. > > running with tso, initially I get around 300MGB/s, but after a while(sorry can't be more scientific) > it drops down to about half, and finally to a pathetic 70MGB/s > > *: while running the tests I monitored the Netapp, and nothing out of the ordinary there. Can you do this https://lists.freebsd.org/pipermail/freebsd-stable/2015-August/083138.html ?
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20150823121652.GJ3158>