From owner-freebsd-questions@FreeBSD.ORG Thu Mar 8 09:00:34 2012 Return-Path: Delivered-To: questions@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id A2E3E106564A for ; Thu, 8 Mar 2012 09:00:34 +0000 (UTC) (envelope-from ml@my.gd) Received: from mail-bk0-f54.google.com (mail-bk0-f54.google.com [209.85.214.54]) by mx1.freebsd.org (Postfix) with ESMTP id 135228FC0C for ; Thu, 8 Mar 2012 09:00:33 +0000 (UTC) Received: by bkcjc3 with SMTP id jc3so210957bkc.13 for ; Thu, 08 Mar 2012 01:00:32 -0800 (PST) Received: by 10.204.156.139 with SMTP id x11mr2491511bkw.59.1331197232740; Thu, 08 Mar 2012 01:00:32 -0800 (PST) Received: from dfleuriot-at-hi-media.com ([83.167.62.196]) by mx.google.com with ESMTPS id bw9sm1785348bkb.8.2012.03.08.01.00.31 (version=SSLv3 cipher=OTHER); Thu, 08 Mar 2012 01:00:31 -0800 (PST) Message-ID: <4F58752E.2010405@my.gd> Date: Thu, 08 Mar 2012 10:00:30 +0100 From: Damien Fleuriot User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:10.0.2) Gecko/20120216 Thunderbird/10.0.2 MIME-Version: 1.0 To: bo wang , questions@freebsd.org References: <4F5818A4.20509@hdk5.net> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-Gm-Message-State: ALoCoQm3Pq7+NSR2RN9YPWzuRpMQR2ZlhqfaSU7fsBn+oxvDJFS2aqZVEUCxNHcukuhVL7CTYllA Cc: Subject: Re: Fwd: Some questions about Link Aggregation and Failover X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 08 Mar 2012 09:00:34 -0000 >From your switch, run the following tests: core1.drt.hi-media#test etherchannel load-balance interface port-channel 2 ip 1.2.3.4 5.6.7.8 Would select Gi1/1/1 of Po2 core1.drt.hi-media#test etherchannel load-balance interface port-channel 2 ip 1.2.3.4 5.6.7.9 Would select Gi2/1/1 of Po2 core1.drt.hi-media#test etherchannel load-balance interface port-channel 2 ip 1.2.3.4 5.6.7.10 Would select Gi2/1/1 of Po2 Of course, you'll want to adjust with your own servers and PC IP addresses. On 3/8/12 9:33 AM, bo wang wrote: > ---------- Forwarded message ---------- > From: bo wang > Date: 2012/3/8 > Subject: Re: Some questions about Link Aggregation and Failover > To: noc@hdk5.net > > > Hello: > Please see the picture 1 that is my test before.Doing 2 group in > c3750.When I use PC and server2 to connect server1 fpt server for > download. I find the server1 just use 1 port of lagg, other ports > don't work. > Then I change my test , picture2 is showed. I do only 1 group in > c3750 for server1. And do the same test.I find that there are two > ports of lagg work.The lagg0 top speed can be 140MB/s (server2 speed > is 100MB/S, PC speed is 40MB/s) It can increase top speed. > So what can I do for doinig two group in a switch? > > > > 2012/3/8 bo wang : >> Sorry,I can't understand what your meaning. >> >> Switch#show etherchannel >> Channel-group listing: >> ---------------------- >> >> Group: 1 >> ---------- >> Group state = L2 >> Ports: 2 Maxports = 16 >> Port-channels: 1 Max Port-channels = 16 >> Protocol: LACP >> Minimum Links: 0 >> >> Group: 2 >> ---------- >> Group state = L2 >> Ports: 2 Maxports = 16 >> Port-channels: 1 Max Port-channels = 16 >> Protocol: LACP >> Minimum Links: 0 >> >> >> Switch#show etherchannel detail >> Channel-group listing: >> ---------------------- >> >> Group: 1 >> ---------- >> Group state = L2 >> Ports: 2 Maxports = 16 >> Port-channels: 1 Max Port-channels = 16 >> Protocol: LACP >> Minimum Links: 0 >> Ports in the group: >> ------------------- >> Port: Gi1/0/1 >> ------------ >> >> Port state = Up Mstr Assoc In-Bndl >> Channel group = 1 Mode = Active Gcchange = - >> Port-channel = Po1 GC = - Pseudo port-channel = Po1 >> Port index = 0 Load = 0x00 Protocol = LACP >> >> Flags: S - Device is sending Slow LACPDUs F - Device is sending fast LACPDUs. >> A - Device is in active mode. P - Device is in passive mode. >> >> Local information: >> LACP port Admin Oper Port Port >> Port Flags State Priority Key Key Number State >> Gi1/0/1 SA bndl 32768 0x1 0x1 0x102 0x3D >> >> Partner's information: >> >> LACP port Admin Oper Port Port >> Port Flags Priority Dev ID Age key Key Number State >> Gi1/0/1 SA 32768 0010.18c0.af20 24s 0x0 0x250 0x3 0x3D >> >> Age of the port in the current state: 12d:22h:41m:09s >> >> Port: Gi1/0/2 >> ------------ >> >> Port state = Up Mstr Assoc In-Bndl >> Channel group = 1 Mode = Active Gcchange = - >> Port-channel = Po1 GC = - Pseudo port-channel = Po1 >> Port index = 0 Load = 0x00 Protocol = LACP >> >> Flags: S - Device is sending Slow LACPDUs F - Device is sending fast LACPDUs. >> A - Device is in active mode. P - Device is in passive mode. >> >> Local information: >> LACP port Admin Oper Port Port >> Port Flags State Priority Key Key Number State >> Gi1/0/2 SA bndl 32768 0x1 0x1 0x103 0x3D >> >> Partner's information: >> >> LACP port Admin Oper Port Port >> Port Flags Priority Dev ID Age key Key Number State >> Gi1/0/2 SA 32768 0010.18c0.af20 26s 0x0 0x250 0x4 0x3D >> >> Age of the port in the current state: 12d:22h:41m:15s >> >> Port-channels in the group: >> --------------------------- >> >> Port-channel: Po1 (Primary Aggregator) >> >> ------------ >> >> Age of the Port-channel = 12d:22h:41m:21s >> Logical slot/port = 10/1 Number of ports = 2 >> HotStandBy port = null >> Port state = Port-channel Ag-Inuse >> Protocol = LACP >> Port security = Disabled >> >> Ports in the Port-channel: >> >> Index Load Port EC state No of bits >> ------+------+------+------------------+----------- >> 0 00 Gi1/0/1 Active 0 >> 0 00 Gi1/0/2 Active 0 >> >> Time since last port bundled: 12d:22h:41m:17s Gi1/0/1 >> >> Group: 2 >> ---------- >> Group state = L2 >> Ports: 2 Maxports = 16 >> Port-channels: 1 Max Port-channels = 16 >> Protocol: LACP >> Minimum Links: 0 >> Ports in the group: >> ------------------- >> Port: Gi1/0/13 >> ------------ >> >> Port state = Up Mstr Assoc In-Bndl >> Channel group = 2 Mode = Active Gcchange = - >> Port-channel = Po2 GC = - Pseudo port-channel = Po2 >> Port index = 0 Load = 0x00 Protocol = LACP >> >> Flags: S - Device is sending Slow LACPDUs F - Device is sending fast LACPDUs. >> A - Device is in active mode. P - Device is in passive mode. >> >> Local information: >> LACP port Admin Oper Port Port >> Port Flags State Priority Key Key Number State >> Gi1/0/13 SA bndl 32768 0x2 0x2 0x10E 0x3D >> >> Partner's information: >> >> LACP port Admin Oper Port Port >> Port Flags Priority Dev ID Age key Key Number State >> Gi1/0/13 SA 32768 0010.18c0.af7c 28s 0x0 0x250 0x3 0x3D >> >> Age of the port in the current state: 12d:22h:39m:21s >> >> Port: Gi1/0/14 >> ------------ >> >> Port state = Up Mstr Assoc In-Bndl >> Channel group = 2 Mode = Active Gcchange = - >> Port-channel = Po2 GC = - Pseudo port-channel = Po2 >> Port index = 0 Load = 0x00 Protocol = LACP >> >> Flags: S - Device is sending Slow LACPDUs F - Device is sending fast LACPDUs. >> A - Device is in active mode. P - Device is in passive mode. >> >> Local information: >> LACP port Admin Oper Port Port >> Port Flags State Priority Key Key Number State >> Gi1/0/14 SA bndl 32768 0x2 0x2 0x10F 0x3D >> >> Partner's information: >> >> LACP port Admin Oper Port Port >> Port Flags Priority Dev ID Age key Key Number State >> Gi1/0/14 SA 32768 0010.18c0.af7c 29s 0x0 0x250 0x4 0x3D >> >> Age of the port in the current state: 12d:22h:39m:21s >> >> Port-channels in the group: >> --------------------------- >> >> Port-channel: Po2 (Primary Aggregator) >> >> ------------ >> >> Age of the Port-channel = 12d:22h:39m:26s >> Logical slot/port = 10/2 Number of ports = 2 >> HotStandBy port = null >> Port state = Port-channel Ag-Inuse >> Protocol = LACP >> Port security = Disabled >> >> Ports in the Port-channel: >> >> Index Load Port EC state No of bits >> ------+------+------+------------------+----------- >> 0 00 Gi1/0/13 Active 0 >> 0 00 Gi1/0/14 Active 0 >> >> Time since last port bundled: 12d:22h:39m:22s Gi1/0/14 >> >> >> >> >> 2012/3/8 Al Plant : >>> bo wang wrote: >>>> >>>> Thank your for reply. >>>> First,I think the Link Aggregation can't support too much ports >>>> aggregation.So I change the configure, just get together two >>>> ports.Below are configuration information of c3750: >>> >>> >>> >>> ??? > Switch#show eth 1 sum Check your eth discriptor this is for Linux is >>> not for FreeBSD use ed0 or other FreeBSD >>> >>> >>> >>>> Flags: D - down P - bundled in port-channel >>>> I - stand-alone s - suspended >>>> H - Hot-standby (LACP only) >>>> R - Layer3 S - Layer2 >>>> U - in use f - failed to allocate aggregator >>>> >>>> M - not in use, minimum links not met >>>> u - unsuitable for bundling >>>> w - waiting to be aggregated >>>> d - default port >>>> >>>> >>>> Number of channel-groups in use: 2 >>>> Number of aggregators: 2 >>>> >>>> Group Port-channel Protocol Ports >>>> >>>> ------+-------------+-----------+----------------------------------------------- >>>> 1 Po1(SU) LACP Gi1/0/1(P) Gi1/0/2(P) >>>> >>>> >>>> Switch#show lacp neighbor >>>> Flags: S - Device is requesting Slow LACPDUs >>>> F - Device is requesting Fast LACPDUs >>>> A - Device is in Active mode P - Device is in Passive mode >>>> >>>> Channel group 1 neighbors >>>> >>>> Partner's information: >>>> >>>> LACP port Admin Oper Port >>>> Port >>>> Port Flags Priority Dev ID Age key Key Number >>>> State >>>> Gi1/0/1 SA 32768 0010.18c0.af20 4s 0x0 0x250 0x3 >>>> 0x3D >>>> Gi1/0/2 SA 32768 0010.18c0.af20 4s 0x0 0x250 0x4 >>>> 0x3D >>>> >>>> Channel group 2 neighbors >>>> >>>> Partner's information: >>>> >>>> LACP port Admin Oper Port >>>> Port >>>> Port Flags Priority Dev ID Age key Key Number >>>> State >>>> Gi1/0/13 SA 32768 0010.18c0.af7c 1s 0x0 0x250 0x3 >>>> 0x3D >>>> Gi1/0/14 SA 32768 0010.18c0.af7c 1s 0x0 0x250 0x4 >>>> 0x3D >>>> >>>> >>>> Switch#show lacp neighbor detail >>>> Flags: S - Device is requesting Slow LACPDUs >>>> F - Device is requesting Fast LACPDUs >>>> A - Device is in Active mode P - Device is in Passive mode >>>> >>>> Channel group 1 neighbors >>>> >>>> Partner's information: >>>> >>>> >>>> Partner Partner Partner >>>> Port System ID Port Number Age Flags >>>> Gi1/0/1 32768,0010.18c0.af20 0x3 13s SA >>>> >>>> LACP Partner Partner Partner >>>> Port Priority Oper Key Port State >>>> 32768 0x250 0x3D >>>> >>>> Port State Flags Decode: >>>> Activity: Timeout: Aggregation: Synchronization: >>>> Active Long Yes Yes >>>> >>>> Collecting: Distributing: Defaulted: Expired: >>>> Yes Yes No No >>>> >>>> Partner Partner Partner >>>> Port System ID Port Number Age Flags >>>> Gi1/0/2 32768,0010.18c0.af20 0x4 14s SA >>>> >>>> LACP Partner Partner Partner >>>> Port Priority Oper Key Port State >>>> 32768 0x250 0x3D >>>> >>>> Port State Flags Decode: >>>> Activity: Timeout: Aggregation: Synchronization: >>>> Active Long Yes Yes >>>> >>>> Collecting: Distributing: Defaulted: Expired: >>>> Yes Yes No No >>>> >>>> Channel group 2 neighbors >>>> >>>> Partner's information: >>>> >>>> >>>> Partner Partner Partner >>>> Port System ID Port Number Age Flags >>>> Gi1/0/13 32768,0010.18c0.af7c 0x3 15s SA >>>> >>>> LACP Partner Partner Partner >>>> Port Priority Oper Key Port State >>>> 32768 0x250 0x3D >>>> >>>> Port State Flags Decode: >>>> Activity: Timeout: Aggregation: Synchronization: >>>> Active Long Yes Yes >>>> >>>> Collecting: Distributing: Defaulted: Expired: >>>> Yes Yes No No >>>> >>>> Partner Partner Partner >>>> Port System ID Port Number Age Flags >>>> Gi1/0/14 32768,0010.18c0.af7c 0x4 16s SA >>>> >>>> LACP Partner Partner Partner >>>> Port Priority Oper Key Port State >>>> 32768 0x250 0x3D >>>> >>>> Port State Flags Decode: >>>> Activity: Timeout: Aggregation: Synchronization: >>>> Active Long Yes Yes >>>> >>>> Collecting: Distributing: Defaulted: Expired: >>>> Yes Yes No No >>>> >>>> 2012/3/7 bo wang : >>>>> >>>>> Hello: >>>>> Recently I want to do Link Aggregation for increasing the >>>>> speed. I use a Cisco 3750 Switche and two IBM Server R with BSD >>>>> 9.0 .I do link aggregation According to this page. >>>>> http://www.freebsd.org/doc/en/books/handbook/network-aggregation.html >>>>> I use LACP .But when i have done ,the link aggregation only can >>>>> do Failover .It cann't increase the speed. What is the >>>>> problem?Detailed configuration as follows >>>>> >>>>> in the BSD9.0 /etc/rc.conf >>>>> hostname="bbc04" >>>>> ifconfig_bce2="up" >>>>> ifconfig_bce3="up" >>>>> ifconfig_bce4="up" >>>>> ifconfig_bce5="up" >>>>> ifconfig_bce6="up" >>>>> ifconfig_bce7="up" >>>>> cloned_interfaces="lagg0" >>>>> ifconfig_lagg0="laggproto loadbalance laggport bce2 laggport bce3 >>>>> laggport bce4 laggport bce5 laggport bce6 laggport bce7" >>>>> ipv4_addrs_lagg0="172.16.60.64/16" >>>>> defaultrouter="172.16.0.1" >>>>> sshd_enable="YES" >>>>> pureftpd_enable="YES" >>>>> # Set dumpdev to "AUTO" to enable crash dumps, "NO" to disable >>>>> dumpdev="NO" >>>>> >>>>> the Cisco 3750 configure >>>>> interface range gigabitEthernet 1/0/1-6 >>>>> channel-proto lacp >>>>> channel-group 1 mode active >>>>> >>>>> >>>>> interface range gigabitEthernet 1/0/13-18 >>>>> channel-proto lacp >>>>> channel-group 2 mode active >>>> >>>> _______________________________________________ >>>> >>>> freebsd-questions@freebsd.org mailing list >>>> http://lists.freebsd.org/mailman/listinfo/freebsd-questions >>>> To unsubscribe, send any mail to >>>> "freebsd-questions-unsubscribe@freebsd.org" >>>> >>> >>> >>> -- >>> >>> ~Al Plant - Honolulu, Hawaii - Phone: 808-284-2740 >>> + http://hawaiidakine.com + http://freebsdinfo.org + >>> + http://aloha50.net - Supporting - FreeBSD 7.2 - 8.0 - 9* + >>> < email: noc@hdk5.net > >>> "All that's really worth doing is what we do for others."- Lewis Carrol >>>