From owner-freebsd-net@FreeBSD.ORG Thu Aug 14 05:25:05 2008 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 5CA0A106567F for ; Thu, 14 Aug 2008 05:25:05 +0000 (UTC) (envelope-from jfvogel@gmail.com) Received: from wr-out-0506.google.com (wr-out-0506.google.com [64.233.184.224]) by mx1.freebsd.org (Postfix) with ESMTP id 11B2E8FC17 for ; Thu, 14 Aug 2008 05:25:04 +0000 (UTC) (envelope-from jfvogel@gmail.com) Received: by wr-out-0506.google.com with SMTP id c8so145769wra.27 for ; Wed, 13 Aug 2008 22:25:04 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:cc:in-reply-to:mime-version:content-type :content-transfer-encoding:content-disposition:references; bh=syQMyp3H+2lbvRIJIMcmGc7koQNbWUODq2pr41FU2vA=; b=WMvEL+he/IfR0JMRvUj3MCUDeuUFDPaFYOzyGv3rASGX2omzTBd/pz4iv2FSZQO+hQ mOaC5f/WYs9ais+ePoRI6FaSwgrHjspyJxr41zfcLNAtzBS5Q0SLmBmv66rmB8IIwveJ QhrZGLdk/n8IccahXBFELmEF9tTV91lzATNGU= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version :content-type:content-transfer-encoding:content-disposition :references; b=jig3k6qgbED7bqRWRkIcSssYwwBGDomuHT1fnK4YQb7rvmkSmFPjjuc3q5ykSRbVN8 t23RmVFneIyyA2DCi2tRIjooqbt1En88PzEljsR1+9SBUvanK9g6vDZ+MpuFNBjDUfaz fT/gjRjwhlIMp9Qbw9LYZH7Q1p9C0xUC+kUHo= Received: by 10.90.113.17 with SMTP id l17mr1143663agc.20.1218691503950; Wed, 13 Aug 2008 22:25:03 -0700 (PDT) Received: by 10.100.43.1 with HTTP; Wed, 13 Aug 2008 22:25:03 -0700 (PDT) Message-ID: <2a41acea0808132225s6e77175fnf6780b249ed07058@mail.gmail.com> Date: Wed, 13 Aug 2008 22:25:03 -0700 From: "Jack Vogel" To: Paul In-Reply-To: <48A3BC67.3050905@gtcomm.net> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <2a41acea0808131502y39879a22u39c472bd0b810fc2@mail.gmail.com> <48A3A2DA.8030404@gtcomm.net> <2a41acea0808132135oe9ebc6bk9423ac19f2e9f77a@mail.gmail.com> <48A3BC67.3050905@gtcomm.net> Cc: "freebsd-net@freebsd.org" Subject: Re: HEADS UP: E1000 networking changes in STABLE/7.1 RELEASE X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 14 Aug 2008 05:25:05 -0000 On Wed, Aug 13, 2008 at 10:02 PM, Paul wrote: > The hardware spec sheet says it does support multi queue but only MSI, so I > would suspect it is disabled by default since that would (maybe) cause > performance to be less. > Would it take advantage of multiple cpus to turn on the multiple queues > even without MSIX? (i.e. having more than 1 taskq in freebsd per interface > for receives/sends) > It should still do per-vector masking so it couldn't be THAT bad with the > multi queues enabled but there's probably a good reason why they are > disabled by default eh? Would be > fun to test it out though :> :> > I think even if the driver / bsd split it up into multiple taskq's so it > would take advantage of SMP better that it would work, but that might > require some modifications outside of the ome of his work within a couple weeks. I have also been working on what performance tweaks I havedriver level (which I can think of > a lot) but I guess i"m hoping for an easier solution so > I don't have to go replacing all these 82571EB cards.. They work great, but > the cpus are running out.. Having 3 or 4 idle cpus while the other ones are > struggling due to network load and dropping packets is aggravating :) Will > the 82575/6 cards alleviate that problem or will I still be faced with the > same issue (due to os limitations)? > I plan on buying the dual port ET controller[82576] (which was supoosed to > be shipping last month) but I can't find one anywhere! argh.. The Linux team here implemented multiqueue based on 82571 3 or 4 years ago, they found that without MSIX it just caused more problems than it was worth and they turned it off again until recently. Linux is in a better position right now, Dave Miller has been hacking madly at their stack and they have pretty complete multiqueue support in the stack. One of my friends here at Intel was responsible for a lot of the work and code along the way. I know there's stack work going on, hopefully all drivers will benefit from that as it comes out. Also Kip Macy has been doing some work for a customer that is based on my igb code, he promised to have some patches back to me in a couple weeks, I'm sure it will be good stuff too. I do not know how hard 82576 is to get right now, it has a TON of potential that I have no where near tapped yet. Before the firedrill the last couple of days I had started on updating the ioatdma driver, which we need so that I can put DCA into the igb driver (Direct Cache Access), that should be a big performance enhancer when I can get it done. Jack