Date: Fri, 09 Mar 2012 10:08:48 +0100 From: Damien Fleuriot <ml@my.gd> To: bo wang <wowopla@gmail.com>, questions@freebsd.org Subject: Re: Fwd: Some questions about Link Aggregation and Failover Message-ID: <4F59C8A0.9030405@my.gd> In-Reply-To: <CAAy2jpHdU0WN9Vr_cG1hzDRc0uBE4oRJ7YJWjhL04Bj%2BK_F1Vw@mail.gmail.com> References: <CAAy2jpE=KNm9YtVPznBUb3tzWJ6Nf92YCS-xmT0dBGfEmJ8qjw@mail.gmail.com> <CAAy2jpEQ5RBQbk-qMo5VMuOok3jZ=WxCDRowwvD8mmDqUoGOww@mail.gmail.com> <4F5818A4.20509@hdk5.net> <CAAy2jpEvRgo5mPueG1BYjVHCQjkupmoEi9pR%2BfFFKNYG2tAbpg@mail.gmail.com> <CAAy2jpF3=qXgSzYVonoqQN4JisyqrKoUgS=DH6UKtHa37beY-A@mail.gmail.com> <CAAy2jpHXvCGS%2BhvqreJuCrSGdaO4YsZTJsiN-UBUKsMWPWx=Jw@mail.gmail.com> <4F58752E.2010405@my.gd> <CAAy2jpHdU0WN9Vr_cG1hzDRc0uBE4oRJ7YJWjhL04Bj%2BK_F1Vw@mail.gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
Well that's exactly what I'm trying to show you. Link aggregation will *NOT* allow you to get 200mbs between 2 servers by sending data over the 2 cables. As per the example I pasted below, link aggregation uses a load balancing algorithm to share the traffic across several links. It will *NOT* use *BOTH* links for a single "source ip - destination ip" pair. On 3/9/12 2:15 AM, bo wang wrote: > Hi. Maybe you can't understand me. I mean that how can I do Link > Aggregation for increasing the top speed between two server and a > switch. > 2012/3/8 Damien Fleuriot <ml@my.gd>: >> From your switch, run the following tests: >> >> >> core1.drt.hi-media#test etherchannel load-balance interface port-channel >> 2 ip 1.2.3.4 5.6.7.8 >> Would select Gi1/1/1 of Po2 >> >> core1.drt.hi-media#test etherchannel load-balance interface port-channel >> 2 ip 1.2.3.4 5.6.7.9 >> Would select Gi2/1/1 of Po2 >> >> core1.drt.hi-media#test etherchannel load-balance interface port-channel >> 2 ip 1.2.3.4 5.6.7.10 >> Would select Gi2/1/1 of Po2 >> >> >> >> Of course, you'll want to adjust with your own servers and PC IP addresses. >> >> >> >> >> >> >> On 3/8/12 9:33 AM, bo wang wrote: >>> ---------- Forwarded message ---------- >>> From: bo wang <wowopla@gmail.com> >>> Date: 2012/3/8 >>> Subject: Re: Some questions about Link Aggregation and Failover >>> To: noc@hdk5.net >>> >>> >>> Hello: >>> Please see the picture 1 that is my test before.Doing 2 group in >>> c3750.When I use PC and server2 to connect server1 fpt server for >>> download. I find the server1 just use 1 port of lagg, other ports >>> don't work. >>> Then I change my test , picture2 is showed. I do only 1 group in >>> c3750 for server1. And do the same test.I find that there are two >>> ports of lagg work.The lagg0 top speed can be 140MB/s (server2 speed >>> is 100MB/S, PC speed is 40MB/s) It can increase top speed. >>> So what can I do for doinig two group in a switch? >>> >>> >>> >>> 2012/3/8 bo wang <wowopla@gmail.com>: >>>> Sorry,I can't understand what your meaning. >>>> >>>> Switch#show etherchannel >>>> Channel-group listing: >>>> ---------------------- >>>> >>>> Group: 1 >>>> ---------- >>>> Group state = L2 >>>> Ports: 2 Maxports = 16 >>>> Port-channels: 1 Max Port-channels = 16 >>>> Protocol: LACP >>>> Minimum Links: 0 >>>> >>>> Group: 2 >>>> ---------- >>>> Group state = L2 >>>> Ports: 2 Maxports = 16 >>>> Port-channels: 1 Max Port-channels = 16 >>>> Protocol: LACP >>>> Minimum Links: 0 >>>> >>>> >>>> Switch#show etherchannel detail >>>> Channel-group listing: >>>> ---------------------- >>>> >>>> Group: 1 >>>> ---------- >>>> Group state = L2 >>>> Ports: 2 Maxports = 16 >>>> Port-channels: 1 Max Port-channels = 16 >>>> Protocol: LACP >>>> Minimum Links: 0 >>>> Ports in the group: >>>> ------------------- >>>> Port: Gi1/0/1 >>>> ------------ >>>> >>>> Port state = Up Mstr Assoc In-Bndl >>>> Channel group = 1 Mode = Active Gcchange = - >>>> Port-channel = Po1 GC = - Pseudo port-channel = Po1 >>>> Port index = 0 Load = 0x00 Protocol = LACP >>>> >>>> Flags: S - Device is sending Slow LACPDUs F - Device is sending fast LACPDUs. >>>> A - Device is in active mode. P - Device is in passive mode. >>>> >>>> Local information: >>>> LACP port Admin Oper Port Port >>>> Port Flags State Priority Key Key Number State >>>> Gi1/0/1 SA bndl 32768 0x1 0x1 0x102 0x3D >>>> >>>> Partner's information: >>>> >>>> LACP port Admin Oper Port Port >>>> Port Flags Priority Dev ID Age key Key Number State >>>> Gi1/0/1 SA 32768 0010.18c0.af20 24s 0x0 0x250 0x3 0x3D >>>> >>>> Age of the port in the current state: 12d:22h:41m:09s >>>> >>>> Port: Gi1/0/2 >>>> ------------ >>>> >>>> Port state = Up Mstr Assoc In-Bndl >>>> Channel group = 1 Mode = Active Gcchange = - >>>> Port-channel = Po1 GC = - Pseudo port-channel = Po1 >>>> Port index = 0 Load = 0x00 Protocol = LACP >>>> >>>> Flags: S - Device is sending Slow LACPDUs F - Device is sending fast LACPDUs. >>>> A - Device is in active mode. P - Device is in passive mode. >>>> >>>> Local information: >>>> LACP port Admin Oper Port Port >>>> Port Flags State Priority Key Key Number State >>>> Gi1/0/2 SA bndl 32768 0x1 0x1 0x103 0x3D >>>> >>>> Partner's information: >>>> >>>> LACP port Admin Oper Port Port >>>> Port Flags Priority Dev ID Age key Key Number State >>>> Gi1/0/2 SA 32768 0010.18c0.af20 26s 0x0 0x250 0x4 0x3D >>>> >>>> Age of the port in the current state: 12d:22h:41m:15s >>>> >>>> Port-channels in the group: >>>> --------------------------- >>>> >>>> Port-channel: Po1 (Primary Aggregator) >>>> >>>> ------------ >>>> >>>> Age of the Port-channel = 12d:22h:41m:21s >>>> Logical slot/port = 10/1 Number of ports = 2 >>>> HotStandBy port = null >>>> Port state = Port-channel Ag-Inuse >>>> Protocol = LACP >>>> Port security = Disabled >>>> >>>> Ports in the Port-channel: >>>> >>>> Index Load Port EC state No of bits >>>> ------+------+------+------------------+----------- >>>> 0 00 Gi1/0/1 Active 0 >>>> 0 00 Gi1/0/2 Active 0 >>>> >>>> Time since last port bundled: 12d:22h:41m:17s Gi1/0/1 >>>> >>>> Group: 2 >>>> ---------- >>>> Group state = L2 >>>> Ports: 2 Maxports = 16 >>>> Port-channels: 1 Max Port-channels = 16 >>>> Protocol: LACP >>>> Minimum Links: 0 >>>> Ports in the group: >>>> ------------------- >>>> Port: Gi1/0/13 >>>> ------------ >>>> >>>> Port state = Up Mstr Assoc In-Bndl >>>> Channel group = 2 Mode = Active Gcchange = - >>>> Port-channel = Po2 GC = - Pseudo port-channel = Po2 >>>> Port index = 0 Load = 0x00 Protocol = LACP >>>> >>>> Flags: S - Device is sending Slow LACPDUs F - Device is sending fast LACPDUs. >>>> A - Device is in active mode. P - Device is in passive mode. >>>> >>>> Local information: >>>> LACP port Admin Oper Port Port >>>> Port Flags State Priority Key Key Number State >>>> Gi1/0/13 SA bndl 32768 0x2 0x2 0x10E 0x3D >>>> >>>> Partner's information: >>>> >>>> LACP port Admin Oper Port Port >>>> Port Flags Priority Dev ID Age key Key Number State >>>> Gi1/0/13 SA 32768 0010.18c0.af7c 28s 0x0 0x250 0x3 0x3D >>>> >>>> Age of the port in the current state: 12d:22h:39m:21s >>>> >>>> Port: Gi1/0/14 >>>> ------------ >>>> >>>> Port state = Up Mstr Assoc In-Bndl >>>> Channel group = 2 Mode = Active Gcchange = - >>>> Port-channel = Po2 GC = - Pseudo port-channel = Po2 >>>> Port index = 0 Load = 0x00 Protocol = LACP >>>> >>>> Flags: S - Device is sending Slow LACPDUs F - Device is sending fast LACPDUs. >>>> A - Device is in active mode. P - Device is in passive mode. >>>> >>>> Local information: >>>> LACP port Admin Oper Port Port >>>> Port Flags State Priority Key Key Number State >>>> Gi1/0/14 SA bndl 32768 0x2 0x2 0x10F 0x3D >>>> >>>> Partner's information: >>>> >>>> LACP port Admin Oper Port Port >>>> Port Flags Priority Dev ID Age key Key Number State >>>> Gi1/0/14 SA 32768 0010.18c0.af7c 29s 0x0 0x250 0x4 0x3D >>>> >>>> Age of the port in the current state: 12d:22h:39m:21s >>>> >>>> Port-channels in the group: >>>> --------------------------- >>>> >>>> Port-channel: Po2 (Primary Aggregator) >>>> >>>> ------------ >>>> >>>> Age of the Port-channel = 12d:22h:39m:26s >>>> Logical slot/port = 10/2 Number of ports = 2 >>>> HotStandBy port = null >>>> Port state = Port-channel Ag-Inuse >>>> Protocol = LACP >>>> Port security = Disabled >>>> >>>> Ports in the Port-channel: >>>> >>>> Index Load Port EC state No of bits >>>> ------+------+------+------------------+----------- >>>> 0 00 Gi1/0/13 Active 0 >>>> 0 00 Gi1/0/14 Active 0 >>>> >>>> Time since last port bundled: 12d:22h:39m:22s Gi1/0/14 >>>> >>>> >>>> >>>> >>>> 2012/3/8 Al Plant <noc@hdk5.net>: >>>>> bo wang wrote: >>>>>> >>>>>> Thank your for reply. >>>>>> First,I think the Link Aggregation can't support too much ports >>>>>> aggregation.So I change the configure, just get together two >>>>>> ports.Below are configuration information of c3750: >>>>> >>>>> >>>>> >>>>> ??? > Switch#show eth 1 sum Check your eth discriptor this is for Linux is >>>>> not for FreeBSD use ed0 or other FreeBSD >>>>> >>>>> >>>>> >>>>>> Flags: D - down P - bundled in port-channel >>>>>> I - stand-alone s - suspended >>>>>> H - Hot-standby (LACP only) >>>>>> R - Layer3 S - Layer2 >>>>>> U - in use f - failed to allocate aggregator >>>>>> >>>>>> M - not in use, minimum links not met >>>>>> u - unsuitable for bundling >>>>>> w - waiting to be aggregated >>>>>> d - default port >>>>>> >>>>>> >>>>>> Number of channel-groups in use: 2 >>>>>> Number of aggregators: 2 >>>>>> >>>>>> Group Port-channel Protocol Ports >>>>>> >>>>>> ------+-------------+-----------+----------------------------------------------- >>>>>> 1 Po1(SU) LACP Gi1/0/1(P) Gi1/0/2(P) >>>>>> >>>>>> >>>>>> Switch#show lacp neighbor >>>>>> Flags: S - Device is requesting Slow LACPDUs >>>>>> F - Device is requesting Fast LACPDUs >>>>>> A - Device is in Active mode P - Device is in Passive mode >>>>>> >>>>>> Channel group 1 neighbors >>>>>> >>>>>> Partner's information: >>>>>> >>>>>> LACP port Admin Oper Port >>>>>> Port >>>>>> Port Flags Priority Dev ID Age key Key Number >>>>>> State >>>>>> Gi1/0/1 SA 32768 0010.18c0.af20 4s 0x0 0x250 0x3 >>>>>> 0x3D >>>>>> Gi1/0/2 SA 32768 0010.18c0.af20 4s 0x0 0x250 0x4 >>>>>> 0x3D >>>>>> >>>>>> Channel group 2 neighbors >>>>>> >>>>>> Partner's information: >>>>>> >>>>>> LACP port Admin Oper Port >>>>>> Port >>>>>> Port Flags Priority Dev ID Age key Key Number >>>>>> State >>>>>> Gi1/0/13 SA 32768 0010.18c0.af7c 1s 0x0 0x250 0x3 >>>>>> 0x3D >>>>>> Gi1/0/14 SA 32768 0010.18c0.af7c 1s 0x0 0x250 0x4 >>>>>> 0x3D >>>>>> >>>>>> >>>>>> Switch#show lacp neighbor detail >>>>>> Flags: S - Device is requesting Slow LACPDUs >>>>>> F - Device is requesting Fast LACPDUs >>>>>> A - Device is in Active mode P - Device is in Passive mode >>>>>> >>>>>> Channel group 1 neighbors >>>>>> >>>>>> Partner's information: >>>>>> >>>>>> >>>>>> Partner Partner Partner >>>>>> Port System ID Port Number Age Flags >>>>>> Gi1/0/1 32768,0010.18c0.af20 0x3 13s SA >>>>>> >>>>>> LACP Partner Partner Partner >>>>>> Port Priority Oper Key Port State >>>>>> 32768 0x250 0x3D >>>>>> >>>>>> Port State Flags Decode: >>>>>> Activity: Timeout: Aggregation: Synchronization: >>>>>> Active Long Yes Yes >>>>>> >>>>>> Collecting: Distributing: Defaulted: Expired: >>>>>> Yes Yes No No >>>>>> >>>>>> Partner Partner Partner >>>>>> Port System ID Port Number Age Flags >>>>>> Gi1/0/2 32768,0010.18c0.af20 0x4 14s SA >>>>>> >>>>>> LACP Partner Partner Partner >>>>>> Port Priority Oper Key Port State >>>>>> 32768 0x250 0x3D >>>>>> >>>>>> Port State Flags Decode: >>>>>> Activity: Timeout: Aggregation: Synchronization: >>>>>> Active Long Yes Yes >>>>>> >>>>>> Collecting: Distributing: Defaulted: Expired: >>>>>> Yes Yes No No >>>>>> >>>>>> Channel group 2 neighbors >>>>>> >>>>>> Partner's information: >>>>>> >>>>>> >>>>>> Partner Partner Partner >>>>>> Port System ID Port Number Age Flags >>>>>> Gi1/0/13 32768,0010.18c0.af7c 0x3 15s SA >>>>>> >>>>>> LACP Partner Partner Partner >>>>>> Port Priority Oper Key Port State >>>>>> 32768 0x250 0x3D >>>>>> >>>>>> Port State Flags Decode: >>>>>> Activity: Timeout: Aggregation: Synchronization: >>>>>> Active Long Yes Yes >>>>>> >>>>>> Collecting: Distributing: Defaulted: Expired: >>>>>> Yes Yes No No >>>>>> >>>>>> Partner Partner Partner >>>>>> Port System ID Port Number Age Flags >>>>>> Gi1/0/14 32768,0010.18c0.af7c 0x4 16s SA >>>>>> >>>>>> LACP Partner Partner Partner >>>>>> Port Priority Oper Key Port State >>>>>> 32768 0x250 0x3D >>>>>> >>>>>> Port State Flags Decode: >>>>>> Activity: Timeout: Aggregation: Synchronization: >>>>>> Active Long Yes Yes >>>>>> >>>>>> Collecting: Distributing: Defaulted: Expired: >>>>>> Yes Yes No No >>>>>> >>>>>> 2012/3/7 bo wang <wowopla@gmail.com>: >>>>>>> >>>>>>> Hello: >>>>>>> Recently I want to do Link Aggregation for increasing the >>>>>>> speed. I use a Cisco 3750 Switche and two IBM Server R with BSD >>>>>>> 9.0 .I do link aggregation According to this page. >>>>>>> http://www.freebsd.org/doc/en/books/handbook/network-aggregation.html >>>>>>> I use LACP .But when i have done ,the link aggregation only can >>>>>>> do Failover .It cann't increase the speed. What is the >>>>>>> problem?Detailed configuration as follows >>>>>>> >>>>>>> in the BSD9.0 /etc/rc.conf >>>>>>> hostname="bbc04" >>>>>>> ifconfig_bce2="up" >>>>>>> ifconfig_bce3="up" >>>>>>> ifconfig_bce4="up" >>>>>>> ifconfig_bce5="up" >>>>>>> ifconfig_bce6="up" >>>>>>> ifconfig_bce7="up" >>>>>>> cloned_interfaces="lagg0" >>>>>>> ifconfig_lagg0="laggproto loadbalance laggport bce2 laggport bce3 >>>>>>> laggport bce4 laggport bce5 laggport bce6 laggport bce7" >>>>>>> ipv4_addrs_lagg0="172.16.60.64/16" >>>>>>> defaultrouter="172.16.0.1" >>>>>>> sshd_enable="YES" >>>>>>> pureftpd_enable="YES" >>>>>>> # Set dumpdev to "AUTO" to enable crash dumps, "NO" to disable >>>>>>> dumpdev="NO" >>>>>>> >>>>>>> the Cisco 3750 configure >>>>>>> interface range gigabitEthernet 1/0/1-6 >>>>>>> channel-proto lacp >>>>>>> channel-group 1 mode active >>>>>>> >>>>>>> >>>>>>> interface range gigabitEthernet 1/0/13-18 >>>>>>> channel-proto lacp >>>>>>> channel-group 2 mode active >>>>>> >>>>>> _______________________________________________ >>>>>> >>>>>> freebsd-questions@freebsd.org mailing list >>>>>> http://lists.freebsd.org/mailman/listinfo/freebsd-questions >>>>>> To unsubscribe, send any mail to >>>>>> "freebsd-questions-unsubscribe@freebsd.org" >>>>>> >>>>> >>>>> >>>>> -- >>>>> >>>>> ~Al Plant - Honolulu, Hawaii - Phone: 808-284-2740 >>>>> + http://hawaiidakine.com + http://freebsdinfo.org + >>>>> + http://aloha50.net - Supporting - FreeBSD 7.2 - 8.0 - 9* + >>>>> < email: noc@hdk5.net > >>>>> "All that's really worth doing is what we do for others."- Lewis Carrol >>>>>
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?4F59C8A0.9030405>