From owner-freebsd-net@FreeBSD.ORG Tue Aug 14 00:58:23 2007 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 1A93416A417 for ; Tue, 14 Aug 2007 00:58:23 +0000 (UTC) (envelope-from ik1024@gmail.com) Received: from rv-out-0910.google.com (rv-out-0910.google.com [209.85.198.189]) by mx1.freebsd.org (Postfix) with ESMTP id DF85C13C457 for ; Tue, 14 Aug 2007 00:58:22 +0000 (UTC) (envelope-from ik1024@gmail.com) Received: by rv-out-0910.google.com with SMTP id f1so1137675rvb for ; Mon, 13 Aug 2007 17:58:22 -0700 (PDT) DKIM-Signature: a=rsa-sha1; c=relaxed/relaxed; d=gmail.com; s=beta; h=domainkey-signature:received:received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:references; b=Nykj7jg16PchGZwusCfHKn6haWwWK6K7qd872Cm1m10SNXS7YP3Mywi7d6zl/dZ/6dX7SCV7xleniwfS++sewQe/u8b59s5TD9BRcHkGLQbScYMp2jPYsi/Y/fPMQqFNTyRl+wIgrZELcR7r1EoVQN8f0q4MuypX5VA58CexwJQ= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:references; b=JshZf8K3gZ0XIYXhI2cWgUhabP64p6cniak7/u5luW5lbaqIMqjb2C4s76p1uGUXMFYqknFsCTKqs02qRrhfxZVAFGKiTipHSiS4pwmjq5JtrOhvy6aws6YHHiVTUlV35KKpwGUKfGBTsEcmmDgTRPOYHufeDT9NKY1+4ejy4fM= Received: by 10.115.74.1 with SMTP id b1mr1120313wal.1187053102108; Mon, 13 Aug 2007 17:58:22 -0700 (PDT) Received: by 10.114.78.16 with HTTP; Mon, 13 Aug 2007 17:58:22 -0700 (PDT) Message-ID: <7feb82f40708131758t194e93f1k371642524991eb71@mail.gmail.com> Date: Mon, 13 Aug 2007 20:58:22 -0400 From: "Isaac Kohen" To: "Lawrence Stewart" In-Reply-To: <46C0EEB6.6010702@room52.net> MIME-Version: 1.0 References: <20070813183426.C196D45045@ptavv.es.net> <46C0EEB6.6010702@room52.net> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-net@freebsd.org, Kevin Oberman Subject: Re: Very high wide area TCP tuning X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 14 Aug 2007 00:58:23 -0000 I've sent several messages to "freebsd-net-unsubscribe@freebsd.org" and I'm still receiving messages. How do I stop this? On 8/13/07, Lawrence Stewart wrote: > > Hi Kevin, > > Kevin Oberman wrote: > > I am attempting to use a FreeBSD box with either a Myricom or Chelsio > > 10GE card to generate very large TCP streams over cross-country > > links. The RTT for the test path is 94 ms. It is dedicated to my testing > > at this time, so I have no contention other than a few KB of routing > > updates. > > > > Clearly, I need a very large window...about 120 MB, but I am unsure how > > FreeBSD will handle this. (Unless I do other things, I suspect it will > > not be pretty.) I imagine I will need a large kvm space, at the least, > > but are there any other sysctls that are likely to need adjusting to > > make this all work? IS it likely to work better on a amd64 system than a > > i386? > > > > Any suggestions would be appreciated. > > > > We recently wrote a small technical report that covers some of the > issues related to FreeBSD network tuning for some TCP research we've > been doing. > > The report's title is "Tuning and Testing the FreeBSD 6 TCP Stack" and > you can grab it from here: > http://caia.swin.edu.au/reports/070717B/CAIA-TR-070717B.pdf > > We didn't tune for 10GB speeds, but I imagine the principles should all > still apply. As you correctly point out, you'll also probably want to > raise the allowable kernel mem size using the "vm.kmem_size" and > "vm.kmem_size_max" sysctls to avoid any random kernel panics. We used a > kmem size of 500MB which worked flawlessly with our GigE multiflow tests > and left us plenty of room to move. This is something you might have to > use a bit of trial and error to figure out though to ensure you get > something stable. And of course you're going to want to control the > number of flows active at one time based on your kmem setting and > hardware constraints... > > Cheers, > Lawrence > > http://caia.swin.edu.au > _______________________________________________ > freebsd-net@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" >