From owner-freebsd-questions@FreeBSD.ORG Fri Mar 9 09:08:53 2012 Return-Path: Delivered-To: questions@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 193781065673 for ; Fri, 9 Mar 2012 09:08:53 +0000 (UTC) (envelope-from ml@my.gd) Received: from mail-ee0-f54.google.com (mail-ee0-f54.google.com [74.125.83.54]) by mx1.freebsd.org (Postfix) with ESMTP id 9500E8FC12 for ; Fri, 9 Mar 2012 09:08:52 +0000 (UTC) Received: by eekd17 with SMTP id d17so404021eek.13 for ; Fri, 09 Mar 2012 01:08:51 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=message-id:date:from:user-agent:mime-version:to:subject:references :in-reply-to:content-type:content-transfer-encoding :x-gm-message-state; bh=RoWYWWvNwCNsrrLDZiqEoLTNe4HTUPikRiXQEOewTG0=; b=SOehHEaZbGSEkrYlPOnhsEsjqOucFKF65+3tW18X08x6ui/5D8DIIx7GXV7bmJk86F ajIM2QJ8igfaqwwrs4EuU6b50RER8PR9GfI/YGZZ/rS4b6RRCaJkPsNIE0h+NPJjKY2A i1gaztn/W7SHYP2KJBT4K+4+umizGzI6SNYBG0bhurkL+saaSGc6lHvoBnH74vjsuX95 7T6AqNZiT8WHex0KK/BVB4g002jRfX5/1464RXB5XsGxVU5XUGWntdwHh5+VHxWdWlGD uMbvxmgRaIy5MP7kF23Rjsu2h0C7rl/rRu6wbe61UxDoYIcA7YYqM5VhSnMUtFCA3bf8 xZEA== Received: by 10.213.30.16 with SMTP id s16mr181519ebc.203.1331284131503; Fri, 09 Mar 2012 01:08:51 -0800 (PST) Received: from dfleuriot-at-hi-media.com ([83.167.62.196]) by mx.google.com with ESMTPS id x42sm15783153eeb.1.2012.03.09.01.08.50 (version=SSLv3 cipher=OTHER); Fri, 09 Mar 2012 01:08:50 -0800 (PST) Message-ID: <4F59C8A0.9030405@my.gd> Date: Fri, 09 Mar 2012 10:08:48 +0100 From: Damien Fleuriot User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:10.0.2) Gecko/20120216 Thunderbird/10.0.2 MIME-Version: 1.0 To: bo wang , questions@freebsd.org References: <4F5818A4.20509@hdk5.net> <4F58752E.2010405@my.gd> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-Gm-Message-State: ALoCoQlNioSf4wvHKdK2IZWwNhqN2IiX3luKGv2mdRelxdWoPkReMH8EOI+kJjTFlzXN43oYbMXJ Cc: Subject: Re: Fwd: Some questions about Link Aggregation and Failover X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 09 Mar 2012 09:08:53 -0000 Well that's exactly what I'm trying to show you. Link aggregation will *NOT* allow you to get 200mbs between 2 servers by sending data over the 2 cables. As per the example I pasted below, link aggregation uses a load balancing algorithm to share the traffic across several links. It will *NOT* use *BOTH* links for a single "source ip - destination ip" pair. On 3/9/12 2:15 AM, bo wang wrote: > Hi. Maybe you can't understand me. I mean that how can I do Link > Aggregation for increasing the top speed between two server and a > switch. > 2012/3/8 Damien Fleuriot : >> From your switch, run the following tests: >> >> >> core1.drt.hi-media#test etherchannel load-balance interface port-channel >> 2 ip 1.2.3.4 5.6.7.8 >> Would select Gi1/1/1 of Po2 >> >> core1.drt.hi-media#test etherchannel load-balance interface port-channel >> 2 ip 1.2.3.4 5.6.7.9 >> Would select Gi2/1/1 of Po2 >> >> core1.drt.hi-media#test etherchannel load-balance interface port-channel >> 2 ip 1.2.3.4 5.6.7.10 >> Would select Gi2/1/1 of Po2 >> >> >> >> Of course, you'll want to adjust with your own servers and PC IP addresses. >> >> >> >> >> >> >> On 3/8/12 9:33 AM, bo wang wrote: >>> ---------- Forwarded message ---------- >>> From: bo wang >>> Date: 2012/3/8 >>> Subject: Re: Some questions about Link Aggregation and Failover >>> To: noc@hdk5.net >>> >>> >>> Hello: >>> Please see the picture 1 that is my test before.Doing 2 group in >>> c3750.When I use PC and server2 to connect server1 fpt server for >>> download. I find the server1 just use 1 port of lagg, other ports >>> don't work. >>> Then I change my test , picture2 is showed. I do only 1 group in >>> c3750 for server1. And do the same test.I find that there are two >>> ports of lagg work.The lagg0 top speed can be 140MB/s (server2 speed >>> is 100MB/S, PC speed is 40MB/s) It can increase top speed. >>> So what can I do for doinig two group in a switch? >>> >>> >>> >>> 2012/3/8 bo wang : >>>> Sorry,I can't understand what your meaning. >>>> >>>> Switch#show etherchannel >>>> Channel-group listing: >>>> ---------------------- >>>> >>>> Group: 1 >>>> ---------- >>>> Group state = L2 >>>> Ports: 2 Maxports = 16 >>>> Port-channels: 1 Max Port-channels = 16 >>>> Protocol: LACP >>>> Minimum Links: 0 >>>> >>>> Group: 2 >>>> ---------- >>>> Group state = L2 >>>> Ports: 2 Maxports = 16 >>>> Port-channels: 1 Max Port-channels = 16 >>>> Protocol: LACP >>>> Minimum Links: 0 >>>> >>>> >>>> Switch#show etherchannel detail >>>> Channel-group listing: >>>> ---------------------- >>>> >>>> Group: 1 >>>> ---------- >>>> Group state = L2 >>>> Ports: 2 Maxports = 16 >>>> Port-channels: 1 Max Port-channels = 16 >>>> Protocol: LACP >>>> Minimum Links: 0 >>>> Ports in the group: >>>> ------------------- >>>> Port: Gi1/0/1 >>>> ------------ >>>> >>>> Port state = Up Mstr Assoc In-Bndl >>>> Channel group = 1 Mode = Active Gcchange = - >>>> Port-channel = Po1 GC = - Pseudo port-channel = Po1 >>>> Port index = 0 Load = 0x00 Protocol = LACP >>>> >>>> Flags: S - Device is sending Slow LACPDUs F - Device is sending fast LACPDUs. >>>> A - Device is in active mode. P - Device is in passive mode. >>>> >>>> Local information: >>>> LACP port Admin Oper Port Port >>>> Port Flags State Priority Key Key Number State >>>> Gi1/0/1 SA bndl 32768 0x1 0x1 0x102 0x3D >>>> >>>> Partner's information: >>>> >>>> LACP port Admin Oper Port Port >>>> Port Flags Priority Dev ID Age key Key Number State >>>> Gi1/0/1 SA 32768 0010.18c0.af20 24s 0x0 0x250 0x3 0x3D >>>> >>>> Age of the port in the current state: 12d:22h:41m:09s >>>> >>>> Port: Gi1/0/2 >>>> ------------ >>>> >>>> Port state = Up Mstr Assoc In-Bndl >>>> Channel group = 1 Mode = Active Gcchange = - >>>> Port-channel = Po1 GC = - Pseudo port-channel = Po1 >>>> Port index = 0 Load = 0x00 Protocol = LACP >>>> >>>> Flags: S - Device is sending Slow LACPDUs F - Device is sending fast LACPDUs. >>>> A - Device is in active mode. P - Device is in passive mode. >>>> >>>> Local information: >>>> LACP port Admin Oper Port Port >>>> Port Flags State Priority Key Key Number State >>>> Gi1/0/2 SA bndl 32768 0x1 0x1 0x103 0x3D >>>> >>>> Partner's information: >>>> >>>> LACP port Admin Oper Port Port >>>> Port Flags Priority Dev ID Age key Key Number State >>>> Gi1/0/2 SA 32768 0010.18c0.af20 26s 0x0 0x250 0x4 0x3D >>>> >>>> Age of the port in the current state: 12d:22h:41m:15s >>>> >>>> Port-channels in the group: >>>> --------------------------- >>>> >>>> Port-channel: Po1 (Primary Aggregator) >>>> >>>> ------------ >>>> >>>> Age of the Port-channel = 12d:22h:41m:21s >>>> Logical slot/port = 10/1 Number of ports = 2 >>>> HotStandBy port = null >>>> Port state = Port-channel Ag-Inuse >>>> Protocol = LACP >>>> Port security = Disabled >>>> >>>> Ports in the Port-channel: >>>> >>>> Index Load Port EC state No of bits >>>> ------+------+------+------------------+----------- >>>> 0 00 Gi1/0/1 Active 0 >>>> 0 00 Gi1/0/2 Active 0 >>>> >>>> Time since last port bundled: 12d:22h:41m:17s Gi1/0/1 >>>> >>>> Group: 2 >>>> ---------- >>>> Group state = L2 >>>> Ports: 2 Maxports = 16 >>>> Port-channels: 1 Max Port-channels = 16 >>>> Protocol: LACP >>>> Minimum Links: 0 >>>> Ports in the group: >>>> ------------------- >>>> Port: Gi1/0/13 >>>> ------------ >>>> >>>> Port state = Up Mstr Assoc In-Bndl >>>> Channel group = 2 Mode = Active Gcchange = - >>>> Port-channel = Po2 GC = - Pseudo port-channel = Po2 >>>> Port index = 0 Load = 0x00 Protocol = LACP >>>> >>>> Flags: S - Device is sending Slow LACPDUs F - Device is sending fast LACPDUs. >>>> A - Device is in active mode. P - Device is in passive mode. >>>> >>>> Local information: >>>> LACP port Admin Oper Port Port >>>> Port Flags State Priority Key Key Number State >>>> Gi1/0/13 SA bndl 32768 0x2 0x2 0x10E 0x3D >>>> >>>> Partner's information: >>>> >>>> LACP port Admin Oper Port Port >>>> Port Flags Priority Dev ID Age key Key Number State >>>> Gi1/0/13 SA 32768 0010.18c0.af7c 28s 0x0 0x250 0x3 0x3D >>>> >>>> Age of the port in the current state: 12d:22h:39m:21s >>>> >>>> Port: Gi1/0/14 >>>> ------------ >>>> >>>> Port state = Up Mstr Assoc In-Bndl >>>> Channel group = 2 Mode = Active Gcchange = - >>>> Port-channel = Po2 GC = - Pseudo port-channel = Po2 >>>> Port index = 0 Load = 0x00 Protocol = LACP >>>> >>>> Flags: S - Device is sending Slow LACPDUs F - Device is sending fast LACPDUs. >>>> A - Device is in active mode. P - Device is in passive mode. >>>> >>>> Local information: >>>> LACP port Admin Oper Port Port >>>> Port Flags State Priority Key Key Number State >>>> Gi1/0/14 SA bndl 32768 0x2 0x2 0x10F 0x3D >>>> >>>> Partner's information: >>>> >>>> LACP port Admin Oper Port Port >>>> Port Flags Priority Dev ID Age key Key Number State >>>> Gi1/0/14 SA 32768 0010.18c0.af7c 29s 0x0 0x250 0x4 0x3D >>>> >>>> Age of the port in the current state: 12d:22h:39m:21s >>>> >>>> Port-channels in the group: >>>> --------------------------- >>>> >>>> Port-channel: Po2 (Primary Aggregator) >>>> >>>> ------------ >>>> >>>> Age of the Port-channel = 12d:22h:39m:26s >>>> Logical slot/port = 10/2 Number of ports = 2 >>>> HotStandBy port = null >>>> Port state = Port-channel Ag-Inuse >>>> Protocol = LACP >>>> Port security = Disabled >>>> >>>> Ports in the Port-channel: >>>> >>>> Index Load Port EC state No of bits >>>> ------+------+------+------------------+----------- >>>> 0 00 Gi1/0/13 Active 0 >>>> 0 00 Gi1/0/14 Active 0 >>>> >>>> Time since last port bundled: 12d:22h:39m:22s Gi1/0/14 >>>> >>>> >>>> >>>> >>>> 2012/3/8 Al Plant : >>>>> bo wang wrote: >>>>>> >>>>>> Thank your for reply. >>>>>> First,I think the Link Aggregation can't support too much ports >>>>>> aggregation.So I change the configure, just get together two >>>>>> ports.Below are configuration information of c3750: >>>>> >>>>> >>>>> >>>>> ??? > Switch#show eth 1 sum Check your eth discriptor this is for Linux is >>>>> not for FreeBSD use ed0 or other FreeBSD >>>>> >>>>> >>>>> >>>>>> Flags: D - down P - bundled in port-channel >>>>>> I - stand-alone s - suspended >>>>>> H - Hot-standby (LACP only) >>>>>> R - Layer3 S - Layer2 >>>>>> U - in use f - failed to allocate aggregator >>>>>> >>>>>> M - not in use, minimum links not met >>>>>> u - unsuitable for bundling >>>>>> w - waiting to be aggregated >>>>>> d - default port >>>>>> >>>>>> >>>>>> Number of channel-groups in use: 2 >>>>>> Number of aggregators: 2 >>>>>> >>>>>> Group Port-channel Protocol Ports >>>>>> >>>>>> ------+-------------+-----------+----------------------------------------------- >>>>>> 1 Po1(SU) LACP Gi1/0/1(P) Gi1/0/2(P) >>>>>> >>>>>> >>>>>> Switch#show lacp neighbor >>>>>> Flags: S - Device is requesting Slow LACPDUs >>>>>> F - Device is requesting Fast LACPDUs >>>>>> A - Device is in Active mode P - Device is in Passive mode >>>>>> >>>>>> Channel group 1 neighbors >>>>>> >>>>>> Partner's information: >>>>>> >>>>>> LACP port Admin Oper Port >>>>>> Port >>>>>> Port Flags Priority Dev ID Age key Key Number >>>>>> State >>>>>> Gi1/0/1 SA 32768 0010.18c0.af20 4s 0x0 0x250 0x3 >>>>>> 0x3D >>>>>> Gi1/0/2 SA 32768 0010.18c0.af20 4s 0x0 0x250 0x4 >>>>>> 0x3D >>>>>> >>>>>> Channel group 2 neighbors >>>>>> >>>>>> Partner's information: >>>>>> >>>>>> LACP port Admin Oper Port >>>>>> Port >>>>>> Port Flags Priority Dev ID Age key Key Number >>>>>> State >>>>>> Gi1/0/13 SA 32768 0010.18c0.af7c 1s 0x0 0x250 0x3 >>>>>> 0x3D >>>>>> Gi1/0/14 SA 32768 0010.18c0.af7c 1s 0x0 0x250 0x4 >>>>>> 0x3D >>>>>> >>>>>> >>>>>> Switch#show lacp neighbor detail >>>>>> Flags: S - Device is requesting Slow LACPDUs >>>>>> F - Device is requesting Fast LACPDUs >>>>>> A - Device is in Active mode P - Device is in Passive mode >>>>>> >>>>>> Channel group 1 neighbors >>>>>> >>>>>> Partner's information: >>>>>> >>>>>> >>>>>> Partner Partner Partner >>>>>> Port System ID Port Number Age Flags >>>>>> Gi1/0/1 32768,0010.18c0.af20 0x3 13s SA >>>>>> >>>>>> LACP Partner Partner Partner >>>>>> Port Priority Oper Key Port State >>>>>> 32768 0x250 0x3D >>>>>> >>>>>> Port State Flags Decode: >>>>>> Activity: Timeout: Aggregation: Synchronization: >>>>>> Active Long Yes Yes >>>>>> >>>>>> Collecting: Distributing: Defaulted: Expired: >>>>>> Yes Yes No No >>>>>> >>>>>> Partner Partner Partner >>>>>> Port System ID Port Number Age Flags >>>>>> Gi1/0/2 32768,0010.18c0.af20 0x4 14s SA >>>>>> >>>>>> LACP Partner Partner Partner >>>>>> Port Priority Oper Key Port State >>>>>> 32768 0x250 0x3D >>>>>> >>>>>> Port State Flags Decode: >>>>>> Activity: Timeout: Aggregation: Synchronization: >>>>>> Active Long Yes Yes >>>>>> >>>>>> Collecting: Distributing: Defaulted: Expired: >>>>>> Yes Yes No No >>>>>> >>>>>> Channel group 2 neighbors >>>>>> >>>>>> Partner's information: >>>>>> >>>>>> >>>>>> Partner Partner Partner >>>>>> Port System ID Port Number Age Flags >>>>>> Gi1/0/13 32768,0010.18c0.af7c 0x3 15s SA >>>>>> >>>>>> LACP Partner Partner Partner >>>>>> Port Priority Oper Key Port State >>>>>> 32768 0x250 0x3D >>>>>> >>>>>> Port State Flags Decode: >>>>>> Activity: Timeout: Aggregation: Synchronization: >>>>>> Active Long Yes Yes >>>>>> >>>>>> Collecting: Distributing: Defaulted: Expired: >>>>>> Yes Yes No No >>>>>> >>>>>> Partner Partner Partner >>>>>> Port System ID Port Number Age Flags >>>>>> Gi1/0/14 32768,0010.18c0.af7c 0x4 16s SA >>>>>> >>>>>> LACP Partner Partner Partner >>>>>> Port Priority Oper Key Port State >>>>>> 32768 0x250 0x3D >>>>>> >>>>>> Port State Flags Decode: >>>>>> Activity: Timeout: Aggregation: Synchronization: >>>>>> Active Long Yes Yes >>>>>> >>>>>> Collecting: Distributing: Defaulted: Expired: >>>>>> Yes Yes No No >>>>>> >>>>>> 2012/3/7 bo wang : >>>>>>> >>>>>>> Hello: >>>>>>> Recently I want to do Link Aggregation for increasing the >>>>>>> speed. I use a Cisco 3750 Switche and two IBM Server R with BSD >>>>>>> 9.0 .I do link aggregation According to this page. >>>>>>> http://www.freebsd.org/doc/en/books/handbook/network-aggregation.html >>>>>>> I use LACP .But when i have done ,the link aggregation only can >>>>>>> do Failover .It cann't increase the speed. What is the >>>>>>> problem?Detailed configuration as follows >>>>>>> >>>>>>> in the BSD9.0 /etc/rc.conf >>>>>>> hostname="bbc04" >>>>>>> ifconfig_bce2="up" >>>>>>> ifconfig_bce3="up" >>>>>>> ifconfig_bce4="up" >>>>>>> ifconfig_bce5="up" >>>>>>> ifconfig_bce6="up" >>>>>>> ifconfig_bce7="up" >>>>>>> cloned_interfaces="lagg0" >>>>>>> ifconfig_lagg0="laggproto loadbalance laggport bce2 laggport bce3 >>>>>>> laggport bce4 laggport bce5 laggport bce6 laggport bce7" >>>>>>> ipv4_addrs_lagg0="172.16.60.64/16" >>>>>>> defaultrouter="172.16.0.1" >>>>>>> sshd_enable="YES" >>>>>>> pureftpd_enable="YES" >>>>>>> # Set dumpdev to "AUTO" to enable crash dumps, "NO" to disable >>>>>>> dumpdev="NO" >>>>>>> >>>>>>> the Cisco 3750 configure >>>>>>> interface range gigabitEthernet 1/0/1-6 >>>>>>> channel-proto lacp >>>>>>> channel-group 1 mode active >>>>>>> >>>>>>> >>>>>>> interface range gigabitEthernet 1/0/13-18 >>>>>>> channel-proto lacp >>>>>>> channel-group 2 mode active >>>>>> >>>>>> _______________________________________________ >>>>>> >>>>>> freebsd-questions@freebsd.org mailing list >>>>>> http://lists.freebsd.org/mailman/listinfo/freebsd-questions >>>>>> To unsubscribe, send any mail to >>>>>> "freebsd-questions-unsubscribe@freebsd.org" >>>>>> >>>>> >>>>> >>>>> -- >>>>> >>>>> ~Al Plant - Honolulu, Hawaii - Phone: 808-284-2740 >>>>> + http://hawaiidakine.com + http://freebsdinfo.org + >>>>> + http://aloha50.net - Supporting - FreeBSD 7.2 - 8.0 - 9* + >>>>> < email: noc@hdk5.net > >>>>> "All that's really worth doing is what we do for others."- Lewis Carrol >>>>>