From owner-freebsd-net@FreeBSD.ORG  Wed Oct 24 15:38:03 2012
Return-Path: <owner-freebsd-net@FreeBSD.ORG>
Delivered-To: freebsd-net@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52])
 by hub.freebsd.org (Postfix) with ESMTP id 24D3CA31;
 Wed, 24 Oct 2012 15:38:03 +0000 (UTC)
 (envelope-from jfvogel@gmail.com)
Received: from mail-vb0-f54.google.com (mail-vb0-f54.google.com
 [209.85.212.54])
 by mx1.freebsd.org (Postfix) with ESMTP id 84F748FC17;
 Wed, 24 Oct 2012 15:38:02 +0000 (UTC)
Received: by mail-vb0-f54.google.com with SMTP id v11so854856vbm.13
 for <multiple recipients>; Wed, 24 Oct 2012 08:38:01 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
 h=mime-version:in-reply-to:references:date:message-id:subject:from:to
 :cc:content-type;
 bh=839wrh4XoHBVv5sYcuOXLEZFxQ28yDREvDkRNaRtICc=;
 b=iTYRGqQZlOcct4EimPZonbXWbQAXPa8Fi+7M3Q7U3FhvTxBScNs0aCnfNBybnyvrWb
 5Fd70PUhTTcw4bMHw2N2fTbIt405szNwpM+qqbXHH6UhBkYruCv/tN/WM0jnr3dSmz8r
 RwVb59jhSaZnXWQJOdBlUhUFE+yMvramxo7HcRDF8mOArrQvOrxof1c76WO98zz3EM8V
 xhooVvWb19kRVxsv8BX/g3jKcTZ8VsvHMoS3JdgEX29aX5feKSDaRuzk0nxBtqNFJPjY
 ZEqiRD8jgM5xWBDjLZ9WUyLSTB0ZYAZJ7nqPcIf3UjVTGtgDrMkUqVlSGG03FzhIhjTZ
 bO+w==
MIME-Version: 1.0
Received: by 10.52.65.147 with SMTP id x19mr21953510vds.113.1351093081623;
 Wed, 24 Oct 2012 08:38:01 -0700 (PDT)
Received: by 10.58.68.8 with HTTP; Wed, 24 Oct 2012 08:38:01 -0700 (PDT)
In-Reply-To: <201210241107.10775.jhb@freebsd.org>
References: <CAGH67wTjVw8O7i9OCvHVJjVjCAXsNHNhs0LobDi4G9iukgf+eQ@mail.gmail.com>
 <201210241107.10775.jhb@freebsd.org>
Date: Wed, 24 Oct 2012 08:38:01 -0700
Message-ID: <CAFOYbcmUSfEUcQa38HF_dk5CzPUBFa0gpAA+fLqjPjgL6V-sHQ@mail.gmail.com>
Subject: Re: ixgb TSO performance degrades by ~30% between 7.4 and 8.2/9.0/9.1
From: Jack Vogel <jfvogel@gmail.com>
To: John Baldwin <jhb@freebsd.org>
Content-Type: text/plain; charset=ISO-8859-1
X-Content-Filtered-By: Mailman/MimeDel 2.1.14
Cc: Garrett Cooper <yanegomi@gmail.com>, freebsd-net@freebsd.org,
 Jack F Vogel <jfv@freebsd.org>
X-BeenThere: freebsd-net@freebsd.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: Networking and TCP/IP with FreeBSD <freebsd-net.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-net>,
 <mailto:freebsd-net-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-net>
List-Post: <mailto:freebsd-net@freebsd.org>
List-Help: <mailto:freebsd-net-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-net>,
 <mailto:freebsd-net-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Wed, 24 Oct 2012 15:38:03 -0000

On Wed, Oct 24, 2012 at 8:07 AM, John Baldwin <jhb@freebsd.org> wrote:

> On Tuesday, October 23, 2012 6:57:01 pm Garrett Cooper wrote:
> > Hi,
> >
> > Doing some poking around at the ixgb driver with a card I have at
> > $work using netperf and two machines hooked up over crossover, I
> > discovered that while ixgb's throughput performance was fantastic on
> > 7.3/7.4, thoughput performance of the card is degraded on 8.2/9.0/9.1
> > by ~30% (9400Mbps on 7.4 -> 6294Mbps on 9.0 for example). LRO
> > performance on the other hand is fantastic and doesn't degrade with
> > the card across FreeBSD versions. Performance remains constant with
> > ixgb across 8.2/9.0/9.1. I didn't observe the CPU usage.
>
> Interesting, maybe as an experiment try hacking the #ifdef's to use
> if_start() instead of if_transmit().
>
>
That's not a bad idea, I have had cases, for instance some UDP intensive
loads, where I found better performance with the old interface. This was one
reason why I had wanted to change the ifdef's to not just be an OS version
level, making either more easily selectable.

Jack