From owner-freebsd-net@FreeBSD.ORG  Wed Feb 12 16:52:52 2014
Return-Path: <owner-freebsd-net@FreeBSD.ORG>
Delivered-To: freebsd-net@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
 (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 9D601527
 for <freebsd-net@freebsd.org>; Wed, 12 Feb 2014 16:52:52 +0000 (UTC)
Received: from smarthost1.sentex.ca (smarthost1.sentex.ca
 [IPv6:2607:f3e0:0:1::12])
 (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by mx1.freebsd.org (Postfix) with ESMTPS id 5E91C16D3
 for <freebsd-net@freebsd.org>; Wed, 12 Feb 2014 16:52:52 +0000 (UTC)
Received: from [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a] (saphire3.sentex.ca
 [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a])
 by smarthost1.sentex.ca (8.14.7/8.14.7) with ESMTP id s1CGqj7I043721;
 Wed, 12 Feb 2014 11:52:46 -0500 (EST) (envelope-from mike@sentex.net)
Message-ID: <52FBA6D5.7010308@sentex.net>
Date: Wed, 12 Feb 2014 11:52:37 -0500
From: Mike Tancsa <mike@sentex.net>
Organization: Sentex Communications
User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64;
 rv:24.0) Gecko/20100101 Thunderbird/24.3.0
MIME-Version: 1.0
To: Nikolay Denev <nike_d@cytexbg.com>
Subject: forwarding performance (was Re: missing missing packets in igb stats
 ?)
References: <52EC573B.109@sentex.net>
 <CA+P_MZEZMe8Z8yJ83AQHdsM82hXTTG9rCe0OHogqRYn_PG60wg@mail.gmail.com>
In-Reply-To: <CA+P_MZEZMe8Z8yJ83AQHdsM82hXTTG9rCe0OHogqRYn_PG60wg@mail.gmail.com>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-Scanned-By: MIMEDefang 2.74
Cc: "freebsd-net@freebsd.org" <freebsd-net@freebsd.org>
X-BeenThere: freebsd-net@freebsd.org
X-Mailman-Version: 2.1.17
Precedence: list
List-Id: Networking and TCP/IP with FreeBSD <freebsd-net.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-net>,
 <mailto:freebsd-net-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-net/>
List-Post: <mailto:freebsd-net@freebsd.org>
List-Help: <mailto:freebsd-net-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-net>,
 <mailto:freebsd-net-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Wed, 12 Feb 2014 16:52:52 -0000

On 2/2/2014 6:49 AM, Nikolay Denev wrote:
>
> Just a guess, but this might be happening before the driver.
> Anything interesting in "netstat -s" for ip and udp?
>
> There is some inbound traffic on igb0. Are these ICMP udp port unreach?


In that example it was.  I was overwhelming the traffic sink on the 
other side I think.  Anyways, I have managed to generate errors on the 
forwarding box. I setup a number of vlan interfaces and using fast boxes 
on the edge, I can generate errors.  Now I have been trying to tweak the 
forwarding performance of the box as a router/firewall.  The one box I 
am testing (igb nics) seems to max out at around 1.2Mpps

kern.random.sys.harvest.ethernet=0
kern.random.sys.harvest.interrupt=0
net.inet.ip.fastforwarding=1
net.inet.ip.redirect=0
kern.random.sys.harvest.point_to_point=0

and

hw.igb.max_interrupt_rate=64000


This is a Xeon E31220 @ 3.10GHz.





-- 
-------------------
Mike Tancsa, tel +1 519 651 3400
Sentex Communications, mike@sentex.net
Providing Internet services since 1994 www.sentex.net
Cambridge, Ontario Canada   http://www.tancsa.com/