From owner-freebsd-stable@FreeBSD.ORG Thu Jan 27 17:39:50 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id A4217106566C; Thu, 27 Jan 2011 17:39:50 +0000 (UTC) (envelope-from ml@my.gd) Received: from mail-ww0-f50.google.com (mail-ww0-f50.google.com [74.125.82.50]) by mx1.freebsd.org (Postfix) with ESMTP id 1AC4E8FC0C; Thu, 27 Jan 2011 17:39:49 +0000 (UTC) Received: by wwf26 with SMTP id 26so2264259wwf.31 for ; Thu, 27 Jan 2011 09:39:48 -0800 (PST) Received: by 10.227.182.68 with SMTP id cb4mr1369901wbb.218.1296149988825; Thu, 27 Jan 2011 09:39:48 -0800 (PST) Received: from dfleuriot.local ([83.167.62.196]) by mx.google.com with ESMTPS id y29sm6835608wbd.16.2011.01.27.09.39.36 (version=SSLv3 cipher=RC4-MD5); Thu, 27 Jan 2011 09:39:38 -0800 (PST) Message-ID: <4D41ADD4.6050507@my.gd> Date: Thu, 27 Jan 2011 18:39:32 +0100 From: Damien Fleuriot User-Agent: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2.13) Gecko/20101207 Thunderbird/3.1.7 MIME-Version: 1.0 To: Jeremy Chadwick References: <4D41417A.20904@my.gd> <20110127172724.GA36587@icarus.home.lan> <4D41ABF1.1010405@my.gd> <20110127173723.GA36846@icarus.home.lan> In-Reply-To: <20110127173723.GA36846@icarus.home.lan> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: freebsd-stable@freebsd.org, "Vogel, Jack" , freebsd-pf@freebsd.org Subject: Re: High interrupt rate on a PF box + performance X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 27 Jan 2011 17:39:50 -0000 On 1/27/11 6:37 PM, Jeremy Chadwick wrote: > On Thu, Jan 27, 2011 at 06:31:29PM +0100, Damien Fleuriot wrote: >> >> >> On 1/27/11 6:27 PM, Jeremy Chadwick wrote: >>> On Thu, Jan 27, 2011 at 10:57:14AM +0100, Damien Fleuriot wrote: >>>> Hello list, >>>> >>>> I have a problem with interrupts, network cards, and PF performance. >>>> >>>> We have 2 firewalls running FreeBSD 8.0 for the current master and >>>> FreeBSD 8.1 for the backup host, which I upgraded just yesterday. >>>> >>>> [...] >>>> >>>> vmstat -i >>>> --- >>>> interrupt total rate >>>> irq14: ata0 36 0 >>>> irq16: mfi0 353244 1 >>>> irq21: uhci0 uhci+ 461504 1 >>>> cpu0: timer 615183815 1996 >>>> irq256: bce0 1015412475 3295 >>>> irq257: igb0 1067318584 3464 >>>> irq258: igb0 695648752 2258 >>>> irq259: igb0 2 0 >>>> irq260: igb1 11503857 37 >>>> irq261: igb1 506598 1 >>>> irq262: igb1 69 0 >>>> irq269: bce1 790820 2 >>>> cpu1: timer 615183757 1996 >>>> cpu2: timer 615197165 1996 >>>> cpu3: timer 615197165 1996 >>>> Total 5252757843 17050 >>> >>> There are changes to the igb(4) driver which are in RELENG_8 (8-STABLE), >>> and some which will be in the upcoming 8.2-RELEASE, which may address >>> this. Jack Vogel of Intel would be able to confirm for sure; CC'ing him >>> here. >>> >>> Could you please provide output from the following commands? >>> >>> * pciconf -lvcb (only include igbX entries, thanks) >>> * sysctl -a | grep msi >>> >>> Thanks. >>> >>> I can't help with the CARP-related issues or other stuff you're >>> experiencing. These issues may all be separate problems, hard to say. >>> >> > > What you did here was "pciconf -lvcb | grep igb", or something > equivalent. Indeed, my bad. igb0@pci0:14:0:0: class=0x020000 card=0x145a8086 chip=0x10d68086 rev=0x02 hdr=0x00 vendor = 'Intel Corporation' device = '82575GB Gigabit Network Connection' class = network subclass = ethernet bar [10] = type Memory, range 32, base 0xfd0e0000, size 131072, enabled bar [14] = type Memory, range 32, base 0xfce00000, size 2097152, enabled bar [18] = type I/O Port, range 32, base 0xdce0, size 32, enabled bar [1c] = type Memory, range 32, base 0xfd0dc000, size 16384, enabled cap 01[40] = powerspec 2 supports D0 D3 current D0 cap 05[50] = MSI supports 1 message, 64 bit cap 11[60] = MSI-X supports 10 messages in map 0x1c enabled cap 10[a0] = PCI-Express 2 endpoint max data 256(256) link x4(x4) igb1@pci0:14:0:1: class=0x020000 card=0x145a8086 chip=0x10d68086 rev=0x02 hdr=0x00 vendor = 'Intel Corporation' device = '82575GB Gigabit Network Connection' class = network subclass = ethernet bar [10] = type Memory, range 32, base 0xfd0a0000, size 131072, enabled bar [14] = type Memory, range 32, base 0xfcc00000, size 2097152, enabled bar [18] = type I/O Port, range 32, base 0xdcc0, size 32, enabled bar [1c] = type Memory, range 32, base 0xfd0d8000, size 16384, enabled cap 01[40] = powerspec 2 supports D0 D3 current D0 cap 05[50] = MSI supports 1 message, 64 bit cap 11[60] = MSI-X supports 10 messages in map 0x1c enabled cap 10[a0] = PCI-Express 2 endpoint max data 256(256) link x4(x4)