From owner-freebsd-stable@FreeBSD.ORG Tue Apr 12 22:42:41 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id B56CA106564A for ; Tue, 12 Apr 2011 22:42:41 +0000 (UTC) (envelope-from dan@dan.emsphone.com) Received: from email2.allantgroup.com (email2.emsphone.com [199.67.51.116]) by mx1.freebsd.org (Postfix) with ESMTP id 7895D8FC08 for ; Tue, 12 Apr 2011 22:42:41 +0000 (UTC) Received: from dan.emsphone.com (dan.emsphone.com [199.67.51.101]) by email2.allantgroup.com (8.14.4/8.14.4) with ESMTP id p3CMgZfW019621 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Tue, 12 Apr 2011 17:42:35 -0500 (CDT) (envelope-from dan@dan.emsphone.com) Received: from dan.emsphone.com (smmsp@localhost [127.0.0.1]) by dan.emsphone.com (8.14.4/8.14.4) with ESMTP id p3CMgYjP040159 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Tue, 12 Apr 2011 17:42:34 -0500 (CDT) (envelope-from dan@dan.emsphone.com) Received: (from dan@localhost) by dan.emsphone.com (8.14.4/8.14.4/Submit) id p3CMgYxf040158; Tue, 12 Apr 2011 17:42:34 -0500 (CDT) (envelope-from dan) Date: Tue, 12 Apr 2011 17:42:34 -0500 From: Dan Nelson To: Denny Schierz Message-ID: <20110412224234.GF10022@dan.emsphone.com> References: <1302516039.3223.222.camel@pcdenny> <4DA34331.7000202@tundraware.com> <2C11868B-EE15-4913-A041-E342A387794C@4lin.net> <1302610335.11354.2.camel@pcdenny> <20110412152124.GE10022@dan.emsphone.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20110412152124.GE10022@dan.emsphone.com> X-OS: FreeBSD 8.2-PRERELEASE User-Agent: Mutt/1.5.21 (2010-09-15) X-Virus-Scanned: clamav-milter 0.97 at email2.allantgroup.com X-Virus-Status: Clean X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.2.6 (email2.allantgroup.com [199.67.51.78]); Tue, 12 Apr 2011 17:42:35 -0500 (CDT) X-Scanned-By: MIMEDefang 2.68 on 199.67.51.78 Cc: freebsd-stable Subject: Re: Network throughput: Never =?utf-8?q?get_more_than_112MB/s_?= =?utf-8?b?w7xiZXI=?= two NICs X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 12 Apr 2011 22:42:41 -0000 In the last episode (Apr 12), Dan Nelson said: > In the last episode (Apr 12), Denny Schierz said: > > Am Montag, den 11.04.2011, 21:52 +0200 schrieb Denny Schierz: > > > Am 11.04.2011 um 20:06 schrieb Tim Daneliuk: > > > > Are you certain you are not somehow running active-passive instead of > > > > active-active ... just a thought... > > > > > > 150% sure. I used two dedicated NICs WITHOUT any loadbalancing. The sum > > > has to be more than 112MB/s. > > > > it must me the network. I tested two crossover connections and I've got > > 220MB/s :-) > > Check to see whether your switch ports are oversubscribed (common for older > blade switches, or very high-density blades); sometimes there will be > rectangles enclosing groups of 6-8 ports, which means that they are > controlled by a single chip internally. Moving each of your test machines > to a separate group may improve your performance. .. I missed a line in your original post: > > All are connected through a Cisco Catalyst WS-X4515. This is a supervisor module for a 4500 series chassis, but only has two SFP ports on it. Your servers are unlikely to be plugged into it. They're probably plugged into another module. This page lists some gigabit ethernet modules that oversubscribe their ports, and which ports belong to which groups: http://www.cisco.com/en/US/docs/switches/lan/catalyst4500/hardware/module/guide/03instal.html#wpxref23495 -- Dan Nelson dnelson@allantgroup.com