From owner-freebsd-net@FreeBSD.ORG  Sat Dec 18 19:13:56 2010
Return-Path: <owner-freebsd-net@FreeBSD.ORG>
Delivered-To: net@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34])
	by hub.freebsd.org (Postfix) with ESMTP id 1C5011065672
	for <net@freebsd.org>; Sat, 18 Dec 2010 19:13:56 +0000 (UTC)
	(envelope-from egrosbein@rdtc.ru)
Received: from eg.sd.rdtc.ru (eg.sd.rdtc.ru [62.231.161.221])
	by mx1.freebsd.org (Postfix) with ESMTP id 600488FC15
	for <net@freebsd.org>; Sat, 18 Dec 2010 19:13:54 +0000 (UTC)
Received: from eg.sd.rdtc.ru (localhost [127.0.0.1])
	by eg.sd.rdtc.ru (8.14.4/8.14.4) with ESMTP id oBIIZmDh090669
	for <net@freebsd.org>; Sun, 19 Dec 2010 00:35:48 +0600 (NOVT)
	(envelope-from egrosbein@rdtc.ru)
Message-ID: <4D0CFEFF.3000902@rdtc.ru>
Date: Sun, 19 Dec 2010 00:35:43 +0600
From: Eugene Grosbein <egrosbein@rdtc.ru>
User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; ru-RU;
	rv:1.9.1.10) Gecko/20100712 Thunderbird/3.0.5
MIME-Version: 1.0
To: net@freebsd.org
Content-Type: text/plain; charset=us-ascii
Content-Transfer-Encoding: 7bit
Cc: 
Subject: lagg/lacp poor traffic distribution
X-BeenThere: freebsd-net@freebsd.org
X-Mailman-Version: 2.1.5
Precedence: list
List-Id: Networking and TCP/IP with FreeBSD <freebsd-net.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-net>,
	<mailto:freebsd-net-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-net>
List-Post: <mailto:freebsd-net@freebsd.org>
List-Help: <mailto:freebsd-net-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-net>,
	<mailto:freebsd-net-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Sat, 18 Dec 2010 19:13:56 -0000

Hi!

I've loaded router using two lagg interfaces in LACP mode.
lagg0 has IP address and two ports (em0 and em1) and carry untagged frames.
lagg1 has no IP address and has two ports (igb0 and igb1) and carry
about 1000 dot-q vlans with lots of hosts in each vlan.

For lagg1, lagg distributes outgoing traffic over two ports just fine.
For lagg0 (untagged ethernet segment with only 2 MAC addresses)
less than 0.07% (54Mbit/s max) of traffic goes to em0
and over 99.92% goes to em1, that's bad.

That's general traffic of several thousands of customers surfing the web,
using torrents etc.  I've glanced over lagg/lacp sources if src/sys/net/
and found nothing suspicious, it should extract and use srcIP/dstIP for hash.

How do I debug this problem?

Eugene Grosbein