From owner-freebsd-net@FreeBSD.ORG Mon Sep 24 17:28:02 2007 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D83E416A420 for ; Mon, 24 Sep 2007 17:28:02 +0000 (UTC) (envelope-from jfvogel@gmail.com) Received: from nf-out-0910.google.com (nf-out-0910.google.com [64.233.182.188]) by mx1.freebsd.org (Postfix) with ESMTP id 726B813C45A for ; Mon, 24 Sep 2007 17:28:02 +0000 (UTC) (envelope-from jfvogel@gmail.com) Received: by nf-out-0910.google.com with SMTP id b2so1230116nfb for ; Mon, 24 Sep 2007 10:28:01 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=beta; h=domainkey-signature:received:received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; bh=rsLr4qpMF9BYwrS8aFA2s8fFxMOpQA3hEitfOjdyysw=; b=cTU5BvXEUDR2lfAM7iLIJXF7v1ctsG7ymFFCmOnyvsKFp+/D1i4z11G1dBmxW4lWE5SbtafSb1NehVhrcqARgj5kZNt2Upoi/Es+rXnY2sxR0tTXY84v2O8wulEI0qmWchwXbrwsPrmA9q08uOl+qpxiLy2PX9iv5u7nRlfEJ/o= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=qXeYMVcHrOqnwWYi7eCQ2xRb09s0e+tOgIClVdNQSD35SZdNgezUp/XHvyWV5f5s6Y6B/wo547meBuJap+yON1TM4eGGUd7fS66viwQUiprFPWjWPvcgvYYZWaXFTS9DNIqBRRtYmhBSH3n+iG7zfIg+gw0GMu14Vy4U4HyLNi4= Received: by 10.86.80.5 with SMTP id d5mr4877997fgb.1190654881016; Mon, 24 Sep 2007 10:28:01 -0700 (PDT) Received: by 10.86.100.19 with HTTP; Mon, 24 Sep 2007 10:28:00 -0700 (PDT) Message-ID: <2a41acea0709241028q2503f12fp86eea2d32ac10aa7@mail.gmail.com> Date: Mon, 24 Sep 2007 10:28:00 -0700 From: "Jack Vogel" To: "Kip Macy" In-Reply-To: MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <2a41acea0709221656n4aa62776y488c7f2da262c9f6@mail.gmail.com> <46F614F2.4050402@freebsd.org> Cc: Darren Reed , "freebsd-net@freebsd.org" , FreeBSD Current Subject: Re: TX Multiqueue? X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 24 Sep 2007 17:28:02 -0000 On 9/23/07, Kip Macy wrote: > On 9/23/07, Darren Reed wrote: > > Kip Macy wrote: > > > My ethng branch supports multiple rx and tx queues. > > > > > > -Kip > > > > > > > What are your plans for how we use/manage/interact with the mutiple > > rx/tx queues? > > The rx hardware queue is determined by the hardware. Different > hardware allows for different policies. I just use the stock rss_hash > of a crc32 of the 4-tuple in cxgb. I've added a field to the pkthdr > which cxgb uses the least significant bits of to determine which > outbound queue to use. Its up to the upper layers to determine how to > set those bits. One of the changes that is required to take advantaged > of this is moving the queues into the driver. I've added a new > if_start function to ifnet to take advantage of this. I also have a > normal if_start function for backward compatibility. Yes, the queues in Oplin and Zoar are also a hardware feature, not just some software infrastructure. There are a number of different ways that it can be configured. I did not have some settled notion of how things should be managed but I would rather not have it be something done under the covers in the driver, a configurable stack option seems better to me. This needs to be done right or it will just be a hack, I don't know who the right parties are, it should not be just a one-person decision, those with a stake in this sort of thing should all be involved. Cheers, Jack