Skip site navigation (1)Skip section navigation (2)
Date:      Mon, 14 Sep 2015 15:50:56 -0300
From:      Marcelo Gondim <gondim@bsdinfo.com.br>
To:        FreeBSD Net <freebsd-net@freebsd.org>
Subject:   Re: Possible LACP problem with FreeBSD 10.2-RELEASE and Juniper MX5
Message-ID:  <55F71710.4010001@bsdinfo.com.br>
In-Reply-To: <55F2005A.1020904@bsdinfo.com.br>
References:  <55F1A095.6010001@bsdinfo.com.br> <55F2005A.1020904@bsdinfo.com.br>

next in thread | previous in thread | raw e-mail | index | archive | help
On 10-09-2015 19:12, Marcelo Gondim wrote:
> On 10-09-2015 12:24, Marcelo Gondim wrote:
>> Hi All,
>>
>> We have a router configured with 2 LACP (lagg0 and lagg1):
>>
>> lagg0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 
>> mtu 1500
>> options=403bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,VLAN_HWTSO> 
>>
>>         ether 00:1b:21:7b:ee:98
>>         inet6 fe80::21b:21ff:fe7b:ee98%lagg0 prefixlen 64 scopeid 0x12
>>         nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
>>         media: Ethernet autoselect
>>         status: active
>>         laggproto lacp lagghash l2,l3,l4
>>         laggport: igb6 flags=1c<ACTIVE,COLLECTING,DISTRIBUTING>
>>         laggport: igb7 flags=1c<ACTIVE,COLLECTING,DISTRIBUTING>
>>
>> lagg1: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 
>> mtu 1500
>> options=403bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,VLAN_HWTSO> 
>>
>>         ether 00:1b:21:7b:ee:6c
>>         inet 189.xxx.xxx.34 netmask 0xfffffffc broadcast 189.113.78.35
>>         inet6 fe80::21b:21ff:fe7b:ee6c%lagg1 prefixlen 64 scopeid 0xf
>>         inet6 2804:56c:0:8::2 prefixlen 64
>>         nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
>>         media: Ethernet autoselect
>>         status: active
>>         laggproto lacp lagghash l2,l3,l4
>>         laggport: igb4 flags=1c<ACTIVE,COLLECTING,DISTRIBUTING>
>>         laggport: igb5 flags=1c<ACTIVE,COLLECTING,DISTRIBUTING>
>>
>> When my Internet traffic is high at night, my BGP session in lagg1 is 
>> giving up and down 4 in 4 minutes.
>> After upgraded to FreeBSD 2.10-RELEASE-p2, this problem started. 
>> Before we were using the FreeBSD 10.1-STABLE r281235 without any 
>> problem.
>>
>> The log have the following messages:
>>
>> /var/log/messages:Sep  9 19:21:43 rt01 kernel: igb5: Interface 
>> stopped DISTRIBUTING, possible flapping
>> /var/log/messages:Sep  9 19:21:44 rt01 kernel: igb4: Interface 
>> stopped DISTRIBUTING, possible flapping
>> /var/log/messages:Sep  9 19:27:01 rt01 kernel: igb5: Interface 
>> stopped DISTRIBUTING, possible flapping
>> /var/log/messages:Sep  9 19:27:01 rt01 kernel: igb4: Interface 
>> stopped DISTRIBUTING, possible flapping
>> /var/log/messages:Sep  9 19:29:13 rt01 kernel: igb5: Interface 
>> stopped DISTRIBUTING, possible flapping
>> /var/log/messages:Sep  9 19:29:14 rt01 kernel: igb4: Interface 
>> stopped DISTRIBUTING, possible flapping
>> /var/log/messages:Sep  9 19:46:10 rt01 kernel: igb5: Interface 
>> stopped DISTRIBUTING, possible flapping
>> /var/log/messages:Sep  9 19:46:11 rt01 kernel: igb4: Interface 
>> stopped DISTRIBUTING, possible flapping
>> /var/log/messages:Sep  9 20:01:02 rt01 kernel: igb4: Interface 
>> stopped DISTRIBUTING, possible flapping
>> /var/log/messages:Sep  9 20:01:03 rt01 kernel: igb5: Interface 
>> stopped DISTRIBUTING, possible flapping
>> /var/log/messages:Sep  9 20:02:08 rt01 kernel: igb5: Interface 
>> stopped DISTRIBUTING, possible flapping
>> /var/log/messages:Sep  9 20:02:09 rt01 kernel: igb4: Interface 
>> stopped DISTRIBUTING, possible flapping
>> /var/log/messages:Sep  9 20:03:54 rt01 kernel: igb5: Interface 
>> stopped DISTRIBUTING, possible flapping
>> /var/log/messages:Sep  9 20:03:57 rt01 kernel: igb4: Interface 
>> stopped DISTRIBUTING, possible flapping
>> /var/log/messages:Sep  9 20:07:05 rt01 kernel: igb5: Interface 
>> stopped DISTRIBUTING, possible flapping
>> /var/log/messages:Sep  9 20:07:06 rt01 kernel: igb4: Interface 
>> stopped DISTRIBUTING, possible flapping
>> /var/log/messages:Sep  9 20:20:49 rt01 kernel: igb5: Interface 
>> stopped DISTRIBUTING, possible flapping
>> /var/log/messages:Sep  9 20:20:50 rt01 kernel: igb4: Interface 
>> stopped DISTRIBUTING, possible flapping
>> /var/log/messages:Sep  9 20:25:39 rt01 kernel: igb4: Interface 
>> stopped DISTRIBUTING, possible flapping
>> /var/log/messages:Sep  9 20:25:40 rt01 kernel: igb5: Interface 
>> stopped DISTRIBUTING, possible flapping
>> /var/log/messages:Sep  9 20:28:55 rt01 kernel: igb5: Interface 
>> stopped DISTRIBUTING, possible flapping
>> /var/log/messages:Sep  9 20:28:56 rt01 kernel: igb4: Interface 
>> stopped DISTRIBUTING, possible flapping
>> /var/log/messages:Sep  9 20:31:39 rt01 kernel: igb5: Interface 
>> stopped DISTRIBUTING, possible flapping
>> /var/log/messages:Sep  9 20:31:39 rt01 kernel: igb4: Interface 
>> stopped DISTRIBUTING, possible flapping
>> /var/log/messages:Sep  9 20:33:29 rt01 kernel: igb4: Interface 
>> stopped DISTRIBUTING, possible flapping
>> /var/log/messages:Sep  9 20:33:30 rt01 kernel: igb5: Interface 
>> stopped DISTRIBUTING, possible flapping
>> /var/log/messages:Sep  9 21:03:38 rt01 kernel: igb5: Interface 
>> stopped DISTRIBUTING, possible flapping
>> /var/log/messages:Sep  9 21:03:38 rt01 kernel: igb4: Interface 
>> stopped DISTRIBUTING, possible flapping
>> /var/log/messages:Sep  9 21:09:39 rt01 kernel: igb5: Interface 
>> stopped DISTRIBUTING, possible flapping
>> /var/log/messages:Sep  9 21:09:39 rt01 kernel: igb4: Interface 
>> stopped DISTRIBUTING, possible flapping
>> /var/log/messages:Sep  9 21:20:51 rt01 kernel: igb5: Interface 
>> stopped DISTRIBUTING, possible flapping
>> /var/log/messages:Sep  9 21:20:52 rt01 kernel: igb4: Interface 
>> stopped DISTRIBUTING, possible flapping
>> /var/log/messages:Sep  9 21:25:24 rt01 kernel: igb5: Interface 
>> stopped DISTRIBUTING, possible flapping
>> /var/log/messages:Sep  9 21:25:25 rt01 kernel: igb4: Interface 
>> stopped DISTRIBUTING, possible flapping
>> /var/log/messages:Sep  9 21:36:22 rt01 kernel: igb5: Interface 
>> stopped DISTRIBUTING, possible flapping
>> /var/log/messages:Sep  9 21:36:23 rt01 kernel: igb4: Interface 
>> stopped DISTRIBUTING, possible flapping
>> /var/log/messages:Sep  9 21:39:26 rt01 kernel: igb5: Interface 
>> stopped DISTRIBUTING, possible flapping
>> /var/log/messages:Sep  9 21:39:27 rt01 kernel: igb4: Interface 
>> stopped DISTRIBUTING, possible flapping
>> /var/log/messages:Sep  9 21:47:40 rt01 kernel: igb5: Interface 
>> stopped DISTRIBUTING, possible flapping
>> /var/log/messages:Sep  9 21:47:40 rt01 kernel: igb4: Interface 
>> stopped DISTRIBUTING, possible flapping
>> /var/log/messages:Sep  9 21:52:19 rt01 kernel: igb5: Interface 
>> stopped DISTRIBUTING, possible flapping
>> /var/log/messages:Sep  9 21:52:19 rt01 kernel: igb4: Interface 
>> stopped DISTRIBUTING, possible flapping
>> /var/log/messages:Sep  9 21:53:01 rt01 kernel: igb5: Interface 
>> stopped DISTRIBUTING, possible flapping
>> /var/log/messages:Sep  9 21:53:01 rt01 kernel: igb4: Interface 
>> stopped DISTRIBUTING, possible flapping
>> /var/log/messages:Sep  9 21:58:53 rt01 kernel: igb5: Interface 
>> stopped DISTRIBUTING, possible flapping
>> /var/log/messages:Sep  9 21:58:53 rt01 kernel: igb4: Interface 
>> stopped DISTRIBUTING, possible flapping
>>
>> Has there been any change in the LACP, during this period, which 
>> could be causing this problem?
>> I'm doing a downgrade in our system to see if this problem happen 
>> tonight.
> Confirmed. I did downgrade the system to 10.1-STABLE r281235 and the 
> problem stopped happening.
> Some change occurred between 10.1-STABLE r281235 and 10.2-RELEASE-p2 
> causing this problem in the system.
>
In about seven days, I will be putting Intel X520-SR2 interfaces on my 
system and will no longer be necessary to use lagg. Not be able to patch 
test any more.
Below the PR open:

https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=203031

Thanks and best regards,





Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?55F71710.4010001>