From owner-freebsd-net@FreeBSD.ORG Mon Aug 11 13:01:13 2014 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 31587CE0 for ; Mon, 11 Aug 2014 13:01:13 +0000 (UTC) Received: from mail-qg0-x22f.google.com (mail-qg0-x22f.google.com [IPv6:2607:f8b0:400d:c04::22f]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id DA88223DC for ; Mon, 11 Aug 2014 13:01:12 +0000 (UTC) Received: by mail-qg0-f47.google.com with SMTP id i50so8339237qgf.6 for ; Mon, 11 Aug 2014 06:01:11 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=aBuE0SGJhE7SxhaYHl37SmHKTE18wtQtTqKRLP50vJI=; b=hbX0NR/Z6WLbDW2l7R3rvv4GniyTUVY5V0pFNdMkaVeab5bXZC+3WVzhbF7p+sHYqf oIPgA3/lH/NGEk2XzwU/ok4XAzPy8pw2MUrxrsSKW/GNaZUGJD9ed7ZyH0wvQJzg2/n3 7eBE9Qid5oyqd8PXeVEa3AOYZwL0Lhe/C3omscDSdIR5sc12aEICgY+0rGmQlhdi413Z eWThKtHXIou7tG/JyySFCmqUr0aaDzGlRh6po4MEx5HZw2gDMBqn9Gm24Bc3saSQGfEY tC4xc7Gfg0NG7XE9En2wBLyVXBWa0WlHCPA7hQhxVR2/Di+MJ4Um4pzKA9etpxnUb9t3 5Iaw== MIME-Version: 1.0 X-Received: by 10.140.30.180 with SMTP id d49mr45765670qgd.63.1407762071512; Mon, 11 Aug 2014 06:01:11 -0700 (PDT) Received: by 10.224.65.65 with HTTP; Mon, 11 Aug 2014 06:01:11 -0700 (PDT) In-Reply-To: <31C0C883-A847-4746-96FA-FE3148B4BD31@lurchi.franken.de> References: <20140809184232.GF83475@funkthat.com> <8AE1AC56-D52F-4F13-AAA3-BB96042B37DD@lurchi.franken.de> <20140809204500.GG83475@funkthat.com> <3F6BC212-4223-4AAC-8668-A27075DC55C2@lurchi.franken.de> <20140810022350.GI83475@funkthat.com> <20140810033212.GL83475@funkthat.com> <17A804F3-BEA6-46F4-887F-B68750618FD9@netapp.com> <31C0C883-A847-4746-96FA-FE3148B4BD31@lurchi.franken.de> Date: Mon, 11 Aug 2014 21:01:11 +0800 Message-ID: Subject: Re: A problem on TCP in High RTT Environment. From: Niu Zhixiong To: Michael Tuexen Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.18 Cc: "freebsd-net@freebsd.org" , John-Mark Gurney , "Eggert, Lars" , Bill Yuan X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 11 Aug 2014 13:01:13 -0000 For 60s test at 20Mbps, 200ms delay with hw.igb.num_queues=3D2 speed is 9.5Mbps. and without it the speed is 9.1Mbps. However, SCTP is 17.10. For 60s test at 20Mbps, 150ms delay with hw.igb.num_queues=3D2 speed is 11.1Mbps. and without it the speed is 9.92Mbps. However, SCTP is 18.59. For 60s test at 20Mbps, 150ms delay with hw.igb.num_queues=3D2 speed is 11.13Mbps. and without it the speed is 9.92Mbps. However, SCTP is 18.59. For 60s test at 20Mbps, 100ms delay with hw.igb.num_queues=3D2 speed is 9.9Mbps. and without it the speed is 11.13Mbps. For 60s test at 20Mbps, 50ms delay with hw.igb.num_queues=3D2 speed is 13.1Mbps. and without it the speed is 13.1Mbps. For 60s test at 20Mbps, 10ms delay with hw.igb.num_queues=3D2 speed is 18.0619Mbps. and without it the speed is 18.12Mbps. Regards, Niu Zhixiong =EF=BC=8D=EF=BC=8D=EF=BC=8D=EF=BC=8D=EF=BC=8D=EF=BC=8D=EF=BC=8D=EF=BC=8D=EF= =BC=8D=EF=BC=8D=EF=BC=8D=EF=BC=8D=EF=BC=8D=EF=BC=8D=EF=BC=8D kaiaixi@gmail.com On Mon, Aug 11, 2014 at 7:50 PM, Michael Tuexen < Michael.Tuexen@lurchi.franken.de> wrote: > On 11 Aug 2014, at 09:32, Niu Zhixiong wrote: > > > Thanks for your reminding. I tried hw.igb.num_queues=3D2 just now. But, > the throughput is still slow. And When I tested same things in my Virtual > machine-based environment(use Virtio), the throughput is similar(SCTP is = 2x > than TCP). > So is the curve still the same or is it now constantly half of the SCTP > throughput which > was almost constant for different RTTs... > > Best regards > Michael > > > > Regards, > > Niu Zhixiong > > =EF=BC=8D=EF=BC=8D=EF=BC=8D=EF=BC=8D=EF=BC=8D=EF=BC=8D=EF=BC=8D=EF=BC= =8D=EF=BC=8D=EF=BC=8D=EF=BC=8D=EF=BC=8D=EF=BC=8D=EF=BC=8D=EF=BC=8D > > kaiaixi@gmail.com > > > > > > On Mon, Aug 11, 2014 at 3:08 PM, Eggert, Lars wrote: > > Hi, > > > > On 2014-8-10, at 5:48, Niu Zhixiong wrote: > > > I am using Intel I350-T4 NIC. > > > > igb driver? > > > > I've been having weird issues with this driver under 10-RELEASE, too. O= n > one machine, I had to limit hw.igb.num_queues=3D2 in order to get any sor= t of > useful connectivity. On another machine, I had to severely bump > kern.ipc.nmbclusters & friends. I'm not sure this is the issue here, sinc= e > SCTP seems to be working OK, but I'm not trusting igb NICs at the moment. > > > > Lars > > > >