Date: Mon, 19 Oct 2009 09:36:36 +0800 From: Adrian Chadd <adrian@freebsd.org> To: Brent Jones <brent@servuhome.net> Cc: Hongtao Yin <htyin@huawei.com>, freebsd-performance@freebsd.org Subject: Re: Comparison of FreeBSD/Linux TCP Throughput performance Message-ID: <d763ac660910181836p45aedc37v1c77f5e96b6df13b@mail.gmail.com> In-Reply-To: <ee9f3b480910181305x5c8661a7mb7bfdd2ddd0a267d@mail.gmail.com> References: <78DB4AE8EF5F4A1EBD3992D7404B2725@china.huawei.com> <d763ac660910180755i7f6fd3c7q8578bfed11978b9d@mail.gmail.com> <ee9f3b480910181305x5c8661a7mb7bfdd2ddd0a267d@mail.gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
uhm: kristy# netperf -H 192.168.10.2 -p 22113 -l 10 TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 192.168.10.2 (192.168.10.2) port 0 AF_INET Recv Send Send Socket Socket Message Elapsed Size Size Size Time Throughput bytes bytes bytes secs. 10^6bits/sec 8192 65536 65536 10.00 862.48 1 megabyte socket buffers threw an error. I'll see why later. Now, as for why 64k socket buffers gave a slower result than 8k socket buffers... ah. If I change the sending end to use 64k socket buffers: TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 192.168.10.2 (192.168.10.2) port 0 AF_INET Recv Send Send Socket Socket Message Elapsed Size Size Size Time Throughput bytes bytes bytes secs. 10^6bits/sec 65536 65536 65536 10.00 916.23 Adrian 2009/10/19 Brent Jones <brent@servuhome.net>: > On Sun, Oct 18, 2009 at 7:55 AM, Adrian Chadd <adrian@freebsd.org> wrote: >> FYI, I installed netperf on my local p4-D test boxes that I use for >> other testing. >> >> 128 byte send/receive buffers on the client side: >> >> kristy# netperf -H 192.168.10.2 -p 22113 -l 10 >> TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 192.168.10.2 >> (192.168.10.2) port 0 AF_INET >> Recv =A0 Send =A0 =A0Send >> Socket Socket =A0Message =A0Elapsed >> Size =A0 Size =A0 =A0Size =A0 =A0 Time =A0 =A0 Throughput >> bytes =A0bytes =A0 bytes =A0 =A0secs. =A0 =A010^6bits/sec >> >> =A08192 =A0 =A0128 =A0 =A0128 =A0 =A010.00 =A0 =A0 426.17 >> >> 1kbyte send/receive buffers: >> >> kristy# netperf -H 192.168.10.2 -p 22113 -l 10 >> TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 192.168.10.2 >> (192.168.10.2) port 0 AF_INET >> Recv =A0 Send =A0 =A0Send >> Socket Socket =A0Message =A0Elapsed >> Size =A0 Size =A0 =A0Size =A0 =A0 Time =A0 =A0 Throughput >> bytes =A0bytes =A0 bytes =A0 =A0secs. =A0 =A010^6bits/sec >> >> =A08192 =A0 1024 =A0 1024 =A0 =A010.00 =A0 =A0 903.39 >> >> 8kbyte send/receive buffers: >> >> kristy# netperf -H 192.168.10.2 -p 22113 -l 10 >> TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 192.168.10.2 >> (192.168.10.2) port 0 AF_INET >> Recv =A0 Send =A0 =A0Send >> Socket Socket =A0Message =A0Elapsed >> Size =A0 Size =A0 =A0Size =A0 =A0 Time =A0 =A0 Throughput >> bytes =A0bytes =A0 bytes =A0 =A0secs. =A0 =A010^6bits/sec >> >> =A08192 =A0 8192 =A0 8192 =A0 =A010.00 =A0 =A0 913.71 >> >> Both boxes are 7.2-REL amd64 boxes on 3.4GHz Pentium-D CPUs using some >> onboard flavour of the intel e1000 NIC: >> >> =A0 =A0device =A0 =A0 =3D '82573E Intel Corporation 82573E Gigabit Ether= net >> Controller (Copper)' >> >> They are connected via a Cisco 3750G L3 switch. In fact, the traffic >> is routed, rather than switched. >> >> My /etc/sysctl.conf: >> >> net.inet.icmp.icmplim=3D0 >> net.inet.icmp.icmplim_output=3D0 >> net.inet.tcp.msl=3D3000 >> net.inet.tcp.sendspace=3D8192 >> net.inet.tcp.recvspace=3D8192 >> kern.maxfilesperproc=3D65536 >> kern.maxfiles=3D262144 >> kern.ipc.maxsockets=3D32768 >> kern.ipc.somaxconn=3D1024 >> kern.ipc.nmbclusters=3D131072 >> net.inet.ip.fw.enable=3D0 >> kern.ipc.somaxconn=3D10240 >> >> 2c, >> >> >> Adrian >> >> 2009/10/15 Hongtao Yin <htyin@huawei.com>: >>> Hi, >>> >>> > > Can you try with 64K and up tp 1MB buffers? > > I see ~1Gbit speeds with my FreeBSD boxes using Broadcom NIC's and > cheap Netgear switches. > I'm not sure how the original tester got such poor numbers, when my > setup is relatively low end, and sustaining Gbit speeds is no major > feat. > > > > -- > Brent Jones > brent@servuhome.net >
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?d763ac660910181836p45aedc37v1c77f5e96b6df13b>