From owner-freebsd-questions@FreeBSD.ORG Fri Mar 16 09:46:32 2012 Return-Path: Delivered-To: freebsd-questions@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 9B202106566B for ; Fri, 16 Mar 2012 09:46:32 +0000 (UTC) (envelope-from ml@my.gd) Received: from mail-we0-f182.google.com (mail-we0-f182.google.com [74.125.82.182]) by mx1.freebsd.org (Postfix) with ESMTP id 2387D8FC0C for ; Fri, 16 Mar 2012 09:46:31 +0000 (UTC) Received: by wern13 with SMTP id n13so4873940wer.13 for ; Fri, 16 Mar 2012 02:46:31 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=references:in-reply-to:mime-version:content-transfer-encoding :content-type:message-id:cc:x-mailer:from:subject:date:to :x-gm-message-state; bh=WvgrXk9tbaFa8ftxvtDUnmki+WeV7TaxlUGKRNBqQrA=; b=lTpLKXSqpnh1uHKmrYWx6kmg3fVA6In3xwTf2dCmx/b3/h5EFPfFI/ndqLsSTFPpxc Hp3UGJinsm/jWXXAnzJFOyDcgyeZUJVk+Bm0RaXqMJscEvV1eCEQUpGyzWU6rJi1N8m1 MvWpvj/oyKgQCVy16YI5JkdHURzWNiKJZd8QwJ1KSyTI9ua7xevJXP2OlK248QpVnikb lkkipYXR1M7YNCMOVcYv9dHko5unjIlqV41PYWTQOz4sPNAGG9n4Xx0iVeDU5TNJziEL 4zwUJPXfl+ps5RJN7Gyf295tHgm66uc5kI4vjmE1DMBkJ8XntREG9ZPP7YFrRFx4LONd yMxg== Received: by 10.180.98.8 with SMTP id ee8mr4894599wib.14.1331891191178; Fri, 16 Mar 2012 02:46:31 -0700 (PDT) Received: from [10.147.233.231] ([92.90.16.24]) by mx.google.com with ESMTPS id j3sm20267891wiw.1.2012.03.16.02.46.23 (version=TLSv1/SSLv3 cipher=OTHER); Fri, 16 Mar 2012 02:46:30 -0700 (PDT) References: <1331838392.1453.5.camel@blackfriar.inhio.eu> In-Reply-To: <1331838392.1453.5.camel@blackfriar.inhio.eu> Mime-Version: 1.0 (1.0) Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii Message-Id: <9D882CD7-5BD1-4A49-86AB-DD8A5B86D4EC@my.gd> X-Mailer: iPhone Mail (9A405) From: Damien Fleuriot Date: Fri, 16 Mar 2012 10:45:08 +0100 To: Snoop X-Gm-Message-State: ALoCoQlmm77ri7z0Z8M3wjLGVeONL3PJashmauN/qyuSed7QeSJBw6PtVeuB/i6lH8nJveVNCJ9p Cc: "freebsd-questions@freebsd.org" Subject: Re: LAGG bug or misconfiguration??? X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 16 Mar 2012 09:46:32 -0000 Sorry top posting from phone. Show your switch's port configurations. We're using VLAN tagging over lagg failover interfaces at work and I have al= ready tried the tests you described, to much better results. We're also running 8.2 so the only thing that seems to differ between us is t= he switch config, likely. On 15 Mar 2012, at 20:06, Snoop wrote: > Hi there, > a while after setting up my new server (with 8 jails in it) I've decided > (after postponing several times) to properly check the functionality of > the lagg and the result was very disappointing. >=20 > The test I've done is very simple. > I've started copying a file from one site to another of my VPN network > (from the server I've been testing the net to another node somewhere > else) and in the meantime I've been physically disconnecting the main > network cable to check the responsiveness of the lagg configuration. > Then I've plugged the cable back to check if the traffic would switch > back to the main NIC as it should. >=20 > The result was basically this (lagg0 members: bge0 primary, bge1 > secondary) >=20 > - when bge0 unplugged the traffic switched almost instantaneously to > bge1 > - when bge0 plugged back in, the network stopped working completely with > the two NICs polling synchronously until I manually unplug bge1. Then > within 2-4 seconds traffic goes back on bge0 (I've been waiting for a > little more than a minute maximum to avoid all the active connections on > the server to timeout). >=20 > Now, I've repeated the same test about 10-15 times randomly waiting for > different times between the unplug-replug procedure. The result was > always the same. >=20 > So, below are the ipconfig outputs > - before to start the test > - when bge0 gets unplugged > - when bge0 gets plugged back in >=20 > I couldn't see anything odd. > __________________________________________________________________________= _________ > lagg0: flags=3D8843 metric 0 mtu > 1500 >=20 > options=3D8009b > ether 00:14:ee:00:8a:c0 > inet xxx.xx.xx.224 netmask 0xffffff00 broadcast xxx.xx.xx.255 > inet xxx.xx.xx.227 netmask 0xffffffff broadcast xxx.xx.xx.227 > inet xxx.xx.xx.225 netmask 0xffffffff broadcast xxx.xx.xx.225 > inet 172.16.3.2 netmask 0xffffffff broadcast 172.16.3.2 > inet 172.16.3.3 netmask 0xffffffff broadcast 172.16.3.3 > inet 172.16.3.4 netmask 0xffffffff broadcast 172.16.3.4 > inet 172.16.3.5 netmask 0xffffffff broadcast 172.16.3.5 > inet 172.16.3.6 netmask 0xffffffff broadcast 172.16.3.6 > inet xxx.xx.xx.226 netmask 0xffffffff broadcast xxx.xx.xx.226 > media: Ethernet autoselect > status: active > laggproto failover > laggport: bge1 flags=3D0<> > laggport: bge0 flags=3D5 > __________________________________________________________________________= _________ > lagg0: flags=3D8843 metric 0 mtu > 1500 >=20 > options=3D8009b > ether 00:14:ee:00:8a:c0 > inet xxx.xx.xx.224 netmask 0xffffff00 broadcast xxx.xx.xx.255 > inet xxx.xx.xx.227 netmask 0xffffffff broadcast xxx.xx.xx.227 > inet xxx.xx.xx.225 netmask 0xffffffff broadcast xxx.xx.xx.225 > inet 172.16.3.2 netmask 0xffffffff broadcast 172.16.3.2 > inet 172.16.3.3 netmask 0xffffffff broadcast 172.16.3.3 > inet 172.16.3.4 netmask 0xffffffff broadcast 172.16.3.4 > inet 172.16.3.5 netmask 0xffffffff broadcast 172.16.3.5 > inet 172.16.3.6 netmask 0xffffffff broadcast 172.16.3.6 > inet xxx.xx.xx.226 netmask 0xffffffff broadcast xxx.xx.xx.226 > media: Ethernet autoselect > status: active > laggproto failover > laggport: bge1 flags=3D4 > laggport: bge0 flags=3D1 > __________________________________________________________________________= _________ >=20 > lagg0: flags=3D8843 metric 0 mtu > 1500 >=20 > options=3D8009b > ether 00:14:ee:00:8a:c0 > inet xxx.xx.xx.224 netmask 0xffffff00 broadcast xxx.xx.xx.255 > inet xxx.xx.xx.227 netmask 0xffffffff broadcast xxx.xx.xx.227 > inet xxx.xx.xx.225 netmask 0xffffffff broadcast xxx.xx.xx.225 > inet 172.16.3.2 netmask 0xffffffff broadcast 172.16.3.2 > inet 172.16.3.3 netmask 0xffffffff broadcast 172.16.3.3 > inet 172.16.3.4 netmask 0xffffffff broadcast 172.16.3.4 > inet 172.16.3.5 netmask 0xffffffff broadcast 172.16.3.5 > inet 172.16.3.6 netmask 0xffffffff broadcast 172.16.3.6 > inet xxx.xx.xx.226 netmask 0xffffffff broadcast xxx.xx.xx.226 > media: Ethernet autoselect > status: active > laggproto failover > laggport: bge1 flags=3D0<> > laggport: bge0 flags=3D5 > __________________________________________________________________________= ________ > Also nothing unusual on dmesg: >=20 > ....... > bge0: link state changed to DOWN > bge0: link state changed to UP > bge1: link state changed to DOWN > bge1: link state changed to UP > bge0: link state changed to DOWN > bge0: link state changed to UP > bge1: link state changed to DOWN > bge1: link state changed to UP > bge0: link state changed to DOWN > bge0: link state changed to UP > bge1: link state changed to DOWN > bge1: link state changed to UP > ....... >=20 > The following is the related configuration in rc.conf: >=20 > ....... > ifconfig_bge0=3D"up" > ifconfig_bge1=3D"up" > cloned_interfaces=3D"lagg0" > ifconfig_lagg0=3D"laggproto failover laggport bge0 laggport bge1 > xxx.xx.xx.224/24" > ifconfig_lagg0_alias_0=3D"inet xxx.xx.xx.225/32" > ifconfig_lagg0_alias_1=3D"inet xxx.xx.xx.226/32" > ifconfig_lagg0_alias_2=3D"inet xxx.xx.xx.227/32" > ifconfig_lagg0_alias_3=3D"inet 172.16.3.2/27" > ifconfig_lagg0_alias_4=3D"inet 172.16.3.3/27" > ifconfig_lagg0_alias_5=3D"inet 172.16.3.4/27" > ifconfig_lagg0_alias_6=3D"inet 172.16.3.5/27" > ifconfig_lagg0_alias_7=3D"inet 172.16.3.6/27" > ....... >=20 > The system is an IBM xSeries 336 type 8837 > kern.version: FreeBSD 8.2-RELEASE-p3 #0: Tue Sep 27 18:45:57 UTC 2011 >=20 > Just for the record, I've done the test from the host (xxx.xx.xx.224/24) > not from any of the jail in place. > Any idea or similar issue around? Am I missing something? > Thanks. >=20 >=20 >=20 > -- > Caselle da 1GB, trasmetti allegati fino a 3GB e in piu' IMAP, POP3 e SMTP a= utenticato? GRATIS solo con Email.it http://www.email.it/f >=20 > Sponsor: > Offerta speciale: a partire da soli Euro 18.90 puoi stampare le tue Foto s= u vera Tela Pittorica e creare Quadri fino a 80x50 cm! > Clicca qui: http://adv.email.it/cgi-bin/foclick.cgi?mid=3D11453&d=3D15-3 > _______________________________________________ > freebsd-questions@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-questions > To unsubscribe, send any mail to "freebsd-questions-unsubscribe@freebsd.or= g"