From owner-freebsd-net@freebsd.org Wed Apr 20 14:12:59 2016 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 56571B1637C for ; Wed, 20 Apr 2016 14:12:59 +0000 (UTC) (envelope-from dmarquess@gmail.com) Received: from mail-io0-x236.google.com (mail-io0-x236.google.com [IPv6:2607:f8b0:4001:c06::236]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 2101D13D5; Wed, 20 Apr 2016 14:12:59 +0000 (UTC) (envelope-from dmarquess@gmail.com) Received: by mail-io0-x236.google.com with SMTP id 2so53397563ioy.1; Wed, 20 Apr 2016 07:12:59 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc; bh=d7QlhltwtollWJTky3hWiPzh2hV2zsDKn9hZeJssCys=; b=LWZ21ZEYFMgHq9pc3+JWLCyG6GsL7c8QaJvvQP43kH9xANR/S38HmX9AM0032qVgfi To9TbcgP7xptzUnEFYI3yHXVOptyCV8yS7TBgQtweYy6STnKtd1evUmhHwjGXi/Xxl6K euH7NS4EHn6FXezIZUNgcOYLg/uPocVmBSj4ozcLPZ1v1csq91B05YeQ1/Kiwxm2kG1i 1cYT9BX8T7/peryjyQBu0CODSRy5uysuU/NqWV6c7wuPjPVQQ/VKK85CuYl2fLor8lju Y8bqLED0RkSnhI9rrJrFJO1gpyyiLtwdcR69qA8IeKa1p00zAyWql9pJ1AtypkWv4Pxg 6fbA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:cc; bh=d7QlhltwtollWJTky3hWiPzh2hV2zsDKn9hZeJssCys=; b=dzVZ45c6ukaw8ZoMQpUDNWU1U5TnSXvS8HC/VDw1/Z26vjVEIjhVa5it6YnkPHKzCG +4j0jjMQTIo3T2Dv64XQe0NEvKalpST0bLfjuKxXSqUiLhq5Rc580JPsWjXr3tufP9LX G4arvTkiEvlFNuISm3eWI3W6Z8sDS5Ia1MMokem1tTFLdE4M+zkQEDHPnPmtV4GDIHtL nl7Uh7Yxx1q6goICpG8xpcU657H7nr1D+cqCerWI7JVaOIf+M1bZ080vWJxQKZ7Kyiv6 nGLjToguo6RJtHxiTjUoPrI9WvROE/EWvRkq72MhATqLtwkgBN/djQfZ+IumnHnFljA3 7X0Q== X-Gm-Message-State: AOPr4FXBZUkiGY5hVKuSJagepR85hO1EC8XwrxNQ1JyKKdbJk6st35Wu+57eOuG6KQWDbXdCE0dNtggQihv9AA== MIME-Version: 1.0 X-Received: by 10.107.198.69 with SMTP id w66mr4710327iof.178.1461161578524; Wed, 20 Apr 2016 07:12:58 -0700 (PDT) Received: by 10.107.156.132 with HTTP; Wed, 20 Apr 2016 07:12:58 -0700 (PDT) In-Reply-To: References: <2C78DBCF-26F2-44D0-A45E-6EE8918648EA@netapp.com> Date: Wed, 20 Apr 2016 09:12:58 -0500 Message-ID: Subject: Re: Issues with ixl(4) From: Dustin Marquess To: "K. Macy" Cc: "Eggert, Lars" , "freebsd-net@freebsd.org" Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.21 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 20 Apr 2016 14:12:59 -0000 I tried backing out that change and everything worked for a few minutes and then started acting up again. Then I notice Sean Bruno's "TCP Packets Drop!!!" email about LACP. I disabled LACP on the switch side and then changed the lagg config from "lacp" to "roundrobin", and so far so good. On the switch side it looks like member ports were randomly bounding in the LACP bundle, and when I'd tcpdump an interface I wouldn't see anything until another LACP&LLDP packet came in. So something seems to be broken with lagg's LACP support recently. The good news is I don't think the route caching is causing this problem. I'll put it back in and retest to make sure though. Thanks for the help! -Dustin On Tue, Apr 19, 2016 at 6:15 PM, K. Macy wrote: > On Mon, Apr 18, 2016 at 10:45 PM, Eggert, Lars wrote: > > I haven't played with lagg+vlan+bridge, but I briefly evaluated XL710 > boards last year ( > https://lists.freebsd.org/pipermail/freebsd-net/2015-October/043584.html) > and saw very poor throughputs and latencies even in very simple setups. As > far as I could figure it out, TSO/LRO wasn't being performed (although > enabled) and so I ran into packet-rate issues. > > > > I basically gave up and went with a different vendor. FWIW, the XL710 > boards in the same machines booted into Linux performed fine. > > > > FWIW, NFLX sees performance close to that of cxgbe (by far the best > maintained, best performing FreeBSD 40G driver) with an iflib > converted driver. The iflib updated driver will be imported by 11 but > won't become the default driver until 11.1 for wont of QA resources at > Intel. > > -M >