Date: Tue, 17 Nov 2015 16:26:46 +0100 From: Johan Hendriks <joh.hendriks@gmail.com> To: freebsd-stable@freebsd.org Subject: LACP with 3 interfaces. Message-ID: <564B4736.3000100@gmail.com>
next in thread | raw e-mail | index | archive | help
Hello all
We have a NFS server witch has three network ports.
We have bonded these interfaces as a lagg interface, but when we use the
server it looks like only two interfaces are used.
This is our rc.conf file
ifconfig_igb0="up"
ifconfig_igb1="up"
ifconfig_igb2="up"
cloned_interfaces="lagg0"
ifconfig_lagg0="laggproto lacp laggport igb0 laggport igb1 laggport igb2
192.168.100.222 netmask 255.255.255.0"
ifconfig tell us the following.
lagg0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
options=403bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,VLAN_HWTSO>
ether a0:36:9f:7d:fc:2f
inet 192.168.100.222 netmask 0xffffff00 broadcast 192.168.100.255
nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
media: Ethernet autoselect
status: active
laggproto lacp lagghash l2,l3,l4
laggport: igb1 flags=1c<ACTIVE,COLLECTING,DISTRIBUTING>
laggport: igb2 flags=1c<ACTIVE,COLLECTING,DISTRIBUTING>
laggport: igb3 flags=1c<ACTIVE,COLLECTING,DISTRIBUTING>
So all looks fine
But with 4 machines putting a 1GB file on the server one is always using
full wirespeed, the rest is around 30 / 40 MB. It never uses all three
intefaces but two at max.
So we are topped at 200MB/s where we were expecting around 300MB/s
#systat -if shows this also.
It shows two interfaces at work where igb1 is sitting and doing nothing?
/0 /1 /2 /3 /4 /5 /6 /7 /8 /9 /10
Load Average |
Interface Traffic Peak Total
lagg1 in 0.253 KB/s 0.683 KB/s 459.781 KB
out 0.000 KB/s 0.000 KB/s 0.000 KB
lagg0 in 0.289 KB/s 215.439 MB/s 4.113 GB
out 0.091 KB/s 114.269 MB/s 2.061 GB
lo0 in 0.000 KB/s 0.068 KB/s 0.770 KB
out 0.000 KB/s 0.068 KB/s 0.770 KB
igb2 in 0.011 KB/s *98.401 MB/s*
1.039 GB
out 0.022 KB/s 1.474 MB/s 27.311 MB
igb1 in 0.143 KB/s *0.466 KB/s*
192.422 KB
out 0.022 KB/s 1.959 MB/s 27.066 MB
igb0 in 0.135 KB/s *117.340 MB/s *
3.074 GB
out 0.114 KB/s 112.679 MB/s 2.007 GB
Is there something we can do to make sure lagg0 uses all the interfaces.
regards
Johan
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?564B4736.3000100>