From owner-freebsd-net@FreeBSD.ORG  Fri Jul 11 05:12:08 2008
Return-Path: <owner-freebsd-net@FreeBSD.ORG>
Delivered-To: freebsd-net@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34])
	by hub.freebsd.org (Postfix) with ESMTP id B5335106564A
	for <freebsd-net@freebsd.org>; Fri, 11 Jul 2008 05:12:08 +0000 (UTC)
	(envelope-from paul@gtcomm.net)
Received: from atlas.gtcomm.net (atlas.gtcomm.net [67.215.15.242])
	by mx1.freebsd.org (Postfix) with ESMTP id 8BDF18FC1A
	for <freebsd-net@freebsd.org>; Fri, 11 Jul 2008 05:12:08 +0000 (UTC)
	(envelope-from paul@gtcomm.net)
Received: from c-76-108-197-4.hsd1.fl.comcast.net ([76.108.197.4]
	helo=[192.168.1.6])
	by atlas.gtcomm.net with esmtpsa (TLSv1:AES256-SHA:256) (Exim 4.67)
	(envelope-from <paul@gtcomm.net>)
	id 1KHAr0-00010l-M0; Fri, 11 Jul 2008 01:07:34 -0400
Message-ID: <4876EC16.5070209@gtcomm.net>
Date: Fri, 11 Jul 2008 01:13:58 -0400
From: Paul <paul@gtcomm.net>
User-Agent: Thunderbird 2.0.0.14 (Windows/20080421)
MIME-Version: 1.0
To: Bruce Evans <brde@optusnet.com.au>
References: <2d3001c8def1$f4309b90$020b000a@bartwrkstxp>	<486FFF70.3090402@gtcomm.net>	<48701921.7090107@gtcomm.net>
	<4871E618.1080500@freebsd.org>	<20080708002228.G680@besplex.bde.org>
	<48724238.2020103@freebsd.org>	<20080708034304.R21502@delplex.bde.org>	<20080708045135.V1022@besplex.bde.org>	<ed91d4a80807071227q5d9ca283g59270a1ab92c80a9@mail.gmail.com>	<48727BA9.6020702@elischer.org>	<20080707221257.GH62764@server.vk2pj.dyndns.org>
	<20080709142008.H26105@delplex.bde.org>
In-Reply-To: <20080709142008.H26105@delplex.bde.org>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
Cc: Peter Jeremy <peterjeremy@optushome.com.au>,
	Julian Elischer <julian@elischer.org>,
	FreeBSD Net <freebsd-net@freebsd.org>
Subject: Re: Freebsd IP Forwarding performance (question,
 and some info) [7-stable, current, em, smp]
X-BeenThere: freebsd-net@freebsd.org
X-Mailman-Version: 2.1.5
Precedence: list
List-Id: Networking and TCP/IP with FreeBSD <freebsd-net.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-net>,
	<mailto:freebsd-net-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-net>
List-Post: <mailto:freebsd-net@freebsd.org>
List-Help: <mailto:freebsd-net-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-net>,
	<mailto:freebsd-net-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Fri, 11 Jul 2008 05:12:08 -0000

I tested Linux in bridge configuration with the same machine and it 
CPUed out at about 600kpps through the bridge..
That's a bit low :/   Soft interrupt using all the cpu.  
Same opteron 2222, 82571EB Pci express NIC.
Tried SMP/ non-smp , load balanced irqs, etc..

Good news is using iptables only adds a few percentage onto the CPU 
usage.   But still, what's with that..
So far FreeBSD got the highest pps rating for forwarding. I  haven't 
tried bridge mode.  Ipfw probably takes a big hit in that too though.

Looking for an 82575 to test..


Paul