From owner-freebsd-net@FreeBSD.ORG  Tue Apr 19 19:10:27 2011
Return-Path: <owner-freebsd-net@FreeBSD.ORG>
Delivered-To: freebsd-net@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34])
	by hub.freebsd.org (Postfix) with ESMTP id 46961106564A;
	Tue, 19 Apr 2011 19:10:27 +0000 (UTC)
	(envelope-from fjwcash@gmail.com)
Received: from mail-gw0-f54.google.com (mail-gw0-f54.google.com [74.125.83.54])
	by mx1.freebsd.org (Postfix) with ESMTP id C7DDE8FC13;
	Tue, 19 Apr 2011 19:10:23 +0000 (UTC)
Received: by gwb15 with SMTP id 15so2416gwb.13
	for <multiple recipients>; Tue, 19 Apr 2011 12:10:23 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma;
	h=domainkey-signature:mime-version:in-reply-to:references:date
	:message-id:subject:from:to:cc:content-type
	:content-transfer-encoding;
	bh=Bdyz+pz9mc8GDFlXKxOSuAthDKw5CTu+FLnIIp2X/aI=;
	b=oIo9D1fRhVNZpuGrbhPT73+zAICZspq7F+iTbaigMxfWWubfZSGwwiJGDfQXETijB0
	rqjHCSio/um0HH9jicd2Bn2FMI4jkLEO1VeS9+wsPqxU52ULHqqQmcWTeOP696PW2Amj
	FXkgR2tOddp3DE7Q2DabTQp5tgb6KfPI6vZn0=
DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma;
	h=mime-version:in-reply-to:references:date:message-id:subject:from:to
	:cc:content-type:content-transfer-encoding;
	b=alrsk26eIsGmW4OOKrGYFRib4F27Jk+aoxZVcEMaa3Xwu/7ptxp2UcJFai0yfJ51kP
	CAi3IlZrzsupT6r3N5zsvQLx6vkBf4o5TjrsuTr5ZjUHfdCNGSSr1DHQfPEuEYZvoj2g
	cMUF6Mk4esrElYhtM4QzV2d8Xb5x7Q6ykoBqI=
MIME-Version: 1.0
Received: by 10.91.92.8 with SMTP id u8mr5725573agl.15.1303240223431; Tue, 19
	Apr 2011 12:10:23 -0700 (PDT)
Received: by 10.90.161.16 with HTTP; Tue, 19 Apr 2011 12:10:23 -0700 (PDT)
In-Reply-To: <BANLkTinvc+QitiBoi7f3agiHMdbCWdPvWQ@mail.gmail.com>
References: <alpine.LRH.2.00.1104050303140.2152@filebunker.xip.at>
	<alpine.LRH.2.00.1104061426350.2152@filebunker.xip.at>
	<alpine.LRH.2.00.1104180051450.8693@filebunker.xip.at>
	<BANLkTik39HvVire6Hzi9U6J2BwKV7apCCg@mail.gmail.com>
	<alpine.LRH.2.00.1104181852420.8693@filebunker.xip.at>
	<BANLkTim0hoHDnrweYz+vc7zOvMubddJmGg@mail.gmail.com>
	<BANLkTim6HMGibDB4ucs+tEfqv-LBnF4O-w@mail.gmail.com>
	<E4328014-47D0-4EFC-8C70-5D28823179C8@gmail.com>
	<BANLkTi=q4d58LbeEo3=J8U7vAuXSmouEQA@mail.gmail.com>
	<BANLkTimEvou2f-b8ggLpVDh6RVnnva=wUQ@mail.gmail.com>
	<BANLkTinvc+QitiBoi7f3agiHMdbCWdPvWQ@mail.gmail.com>
Date: Tue, 19 Apr 2011 12:10:23 -0700
Message-ID: <BANLkTim6ELLQS_rDEngFmA8MAjKuB0X+5w@mail.gmail.com>
From: Freddie Cash <fjwcash@gmail.com>
To: "K. Macy" <kmacy@freebsd.org>
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
Cc: Nikolay Denev <ndenev@gmail.com>, Ingo Flaschberger <if@freebsd.org>,
	freebsd-net@freebsd.org
Subject: Re: Routing enhancement - reduce routing table locking
X-BeenThere: freebsd-net@freebsd.org
X-Mailman-Version: 2.1.5
Precedence: list
List-Id: Networking and TCP/IP with FreeBSD <freebsd-net.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-net>,
	<mailto:freebsd-net-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-net>
List-Post: <mailto:freebsd-net@freebsd.org>
List-Help: <mailto:freebsd-net-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-net>,
	<mailto:freebsd-net-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Tue, 19 Apr 2011 19:10:27 -0000

On Tue, Apr 19, 2011 at 12:06 PM, K. Macy <kmacy@freebsd.org> wrote:
> On Tue, Apr 19, 2011 at 8:19 PM, Freddie Cash <fjwcash@gmail.com> wrote:
>> On Tue, Apr 19, 2011 at 7:42 AM, K. Macy <kmacy@freebsd.org> wrote:
>>>> I'm not able to find IFNET_MULTIQUEUE in a recent 8.2-STABLE, is this =
something
>>>> present only in HEAD?
>>>
>>> It looks like it is now EM_MULTIQUEUE.
>>
>> Just curious, how would one enable this to test it? =C2=A0We have igb(4)
>> interfaces in our new storage boxes, and it would be interesting to
>> test whether or not it helps in our setup.
>>
> It should automatically allocate a queue per core up to the max
> supported. Post 8.0 it should be enabled by default for igb:

Ah, you're right.  Looking through "vmstat -i" there is a separate
queue for each CPU core.

SuperMicro H8DGi-F motherboard with igb onboard:
irq256: igb0:que 0               1139206          1
irq257: igb0:que 1                 30632          0
irq258: igb0:que 2                 33896          0
irq259: igb0:que 3                665468          0
irq260: igb0:que 4                297171          0
irq261: igb0:que 5                 43611          0
irq262: igb0:que 6                 30029          0
irq263: igb0:que 7               3326877          4
irq264: igb0:link                      2          0

irq265: igb1:que 0              53522069         77
irq266: igb1:que 1              78335894        113
irq267: igb1:que 2              45704968         65
irq268: igb1:que 3             156102576        225
irq269: igb1:que 4              87793026        126
irq270: igb1:que 5              85639786        123
irq271: igb1:que 6             131898271        190
irq272: igb1:que 7             154087013        222
irq273: igb1:link                      2          0

--=20
Freddie Cash
fjwcash@gmail.com