Skip site navigation (1)Skip section navigation (2)
Date:      Sun, 14 Jul 2013 09:14:21 -0700 (PDT)
From:      Barney Cordoba <barney_cordoba@yahoo.com>
To:        isp <mline@ukr.net>
Cc:        freebsd-net@freebsd.org
Subject:   Re: Re[2]: FreeBSD router problems
Message-ID:  <1373818461.35904.YahooMailBasic@web121605.mail.ne1.yahoo.com>
In-Reply-To: <3798.1373566301.16193856550018220032@ffe15.ukr.net>

next in thread | previous in thread | raw e-mail | index | archive | help
So why not get a real 10gb/s card? RJ45 10gig is here,=20
and it works a lot better than LAGG.

If you want to get more than 1Gb/s on a single connection,
you'd need to use roundrobin, which will alternate packets
without concern for ordering. Purists will argue against it,
but it does work and modern TCP stacks know how to deal=20
with out of order packets.

ifconfig lagg0 laggproto roundrobin laggport em0 laggport em1

BC


--------------------------------------------
On Thu, 7/11/13, isp <mline@ukr.net> wrote:

 Subject: Re[2]: FreeBSD router problems
 To: "Alan Somers" <asomers@freebsd.org>
 Cc: freebsd-net@freebsd.org
 Date: Thursday, July 11, 2013, 2:11 PM
=20
=20
=20
=20
 I have a real network with more than 4 000 users. In normal
 case, when I
 have two 1Gbps routers, and I split VLAN's between them
 total bandwidth
 if growing up to 1.7 Gbps.
=20
 --- Incoming mail ---
 From: "Alan Somers" <asomers@freebsd.org>
 Date: 11 July 2013, 21:00:41
=20
 How are you benchmarking it?=C2=A0 Each TCP connection only
 uses one member
 of a lagg port.=C2=A0 So if you want to see > 1 Gbps,
 you'll need to
 benchmark with multiple TCP connections.=C2=A0 You may also
 need multiple
 systems; I don't know the full details of LACP.
=20
 On Thu, Jul 11, 2013 at 11:32 AM, isp <=C2=A0 mline@ukr.net=C2=A0
 > wrote:
 >
 >
 >
 > Hi! I have a problem with my FreeBSD router, I can't
 get more than 1 Gbps
 > throught it, but I have 2 Gbps LAGG on it. There are
 only 27 IPFW rules
 > (NAT+Shaping). IPoE only.
 > lagg0 (VLAN's + shaping) - two 'igb' adapters
 > lagg1 (NAT, tso if off) - two 'em' adapters
 >
 > I tried to switch off dummynet, but it doesn't helps.
 >
 > # uname -a
 > [code]FreeBSD router 9.1-RELEASE-p3 FreeBSD
 9.1-RELEASE-p3 #0: Tue Apr 30
 > 20:02:00 EEST 2013=C2=A0
 =C2=A0=C2=A0=C2=A0root@south:/usr/obj/usr/src/sys/ROUTER=C2=A0
 amd64
 >
 > # top -aSPHI
 > last pid: 91712;=C2=A0 load averages:=C2=A0 2.18,=C2=A0
 2.06,
 > 1.97
 > up 20+22:28:36=C2=A0 17:40:22
 > 120 processes: 7 running, 87 sleeping, 26 waiting
 > CPU 0:=C2=A0 0.0% user,=C2=A0 0.0% nice,=C2=A0 1.6%
 system, 38.6% interrupt, 59.8% idle
 > CPU 1:=C2=A0 0.0% user,=C2=A0 0.0% nice,=C2=A0 7.1%
 system, 37.0% interrupt, 55.9% idle
 > CPU 2:=C2=A0 0.0% user,=C2=A0 0.0% nice,=C2=A0 3.9%
 system, 38.6% interrupt, 57.5% idle
 > CPU 3:=C2=A0 0.0% user,=C2=A0 0.0% nice, 15.7% system,
 26.8% interrupt, 57.5% idle
 > Mem: 59M Active, 1102M Inact, 942M Wired, 800M Buf,
 5529M Free
 > Swap: 16G Total, 16G Free
 >
 > PID USERNAME PRI NICE=C2=A0=C2=A0=C2=A0SIZE=C2=A0
 =C2=A0 RES
 STATE=C2=A0=C2=A0=C2=A0C=C2=A0=C2=A0=C2=A0TIME=C2=A0=C2=A0=C2=A0WCPU
 COMMAND
 > 12 root=C2=A0 =C2=A0=C2=A0=C2=A0-72=C2=A0 =C2=A0
 -=C2=A0 =C2=A0=C2=A0=C2=A00K=C2=A0=C2=A0=C2=A0448K RUN=C2=A0
 =C2=A0=C2=A0=C2=A01 153:39 72.22% [intr{swi1:
 > netisr 0}]
 > 11 root=C2=A0 =C2=A0=C2=A0=C2=A0155 ki31=C2=A0
 =C2=A0=C2=A0=C2=A00K=C2=A0 =C2=A0 64K RUN=C2=A0
 =C2=A0=C2=A0=C2=A01 494.2H 65.19% [idle{idle:
 > cpu1}]
 > 11 root=C2=A0 =C2=A0=C2=A0=C2=A0155 ki31=C2=A0
 =C2=A0=C2=A0=C2=A00K=C2=A0 =C2=A0 64K CPU2=C2=A0 =C2=A0 2
 494.3H 64.65% [idle{idle:
 > cpu2}]
 > 11 root=C2=A0 =C2=A0=C2=A0=C2=A0155 ki31=C2=A0
 =C2=A0=C2=A0=C2=A00K=C2=A0 =C2=A0 64K RUN=C2=A0
 =C2=A0=C2=A0=C2=A00 493.3H 63.38% [idle{idle:
 > cpu0}]
 > 11 root=C2=A0 =C2=A0=C2=A0=C2=A0155 ki31=C2=A0
 =C2=A0=C2=A0=C2=A00K=C2=A0 =C2=A0 64K CPU3=C2=A0 =C2=A0 3
 496.4H 62.55% [idle{idle:
 > cpu3}]
 > 12 root=C2=A0 =C2=A0=C2=A0=C2=A0-92=C2=A0 =C2=A0
 -=C2=A0 =C2=A0=C2=A0=C2=A00K=C2=A0=C2=A0=C2=A0448K
 WAIT=C2=A0 =C2=A0 2=C2=A0 58:49=C2=A0 9.38% [intr{irq266:
 > igb0:que}]
 > 12 root=C2=A0 =C2=A0=C2=A0=C2=A0-92=C2=A0 =C2=A0
 -=C2=A0 =C2=A0=C2=A0=C2=A00K=C2=A0=C2=A0=C2=A0448K
 WAIT=C2=A0 =C2=A0 2=C2=A0 59:32=C2=A0 9.03% [intr{irq271:
 > igb1:que}]
 > 12 root=C2=A0 =C2=A0=C2=A0=C2=A0-92=C2=A0 =C2=A0
 -=C2=A0 =C2=A0=C2=A0=C2=A00K=C2=A0=C2=A0=C2=A0448K
 CPU1=C2=A0 =C2=A0 1=C2=A0 59:09=C2=A0 8.94% [intr{irq265:
 > igb0:que}]
 > 12 root=C2=A0 =C2=A0=C2=A0=C2=A0-92=C2=A0 =C2=A0
 -=C2=A0 =C2=A0=C2=A0=C2=A00K=C2=A0=C2=A0=C2=A0448K
 WAIT=C2=A0 =C2=A0 3=C2=A0 57:52=C2=A0 8.01% [intr{irq272:
 > igb1:que}]
 > 12 root=C2=A0 =C2=A0=C2=A0=C2=A0-92=C2=A0 =C2=A0
 -=C2=A0 =C2=A0=C2=A0=C2=A00K=C2=A0=C2=A0=C2=A0448K
 WAIT=C2=A0 =C2=A0 1=C2=A0 59:32=C2=A0 7.96% [intr{irq270:
 > igb1:que}]
 > 12 root=C2=A0 =C2=A0=C2=A0=C2=A0-92=C2=A0 =C2=A0
 -=C2=A0 =C2=A0=C2=A0=C2=A00K=C2=A0=C2=A0=C2=A0448K
 WAIT=C2=A0 =C2=A0 3=C2=A0 55:47=C2=A0 7.81% [intr{irq267:
 > igb0:que}]
 > 12 root=C2=A0 =C2=A0=C2=A0=C2=A0-92=C2=A0 =C2=A0
 -=C2=A0 =C2=A0=C2=A0=C2=A00K=C2=A0=C2=A0=C2=A0448K
 WAIT=C2=A0 =C2=A0 0=C2=A0 55:24=C2=A0 7.23% [intr{irq264:
 > igb0:que}]
 > 12 root=C2=A0 =C2=A0=C2=A0=C2=A0-92=C2=A0 =C2=A0
 -=C2=A0 =C2=A0=C2=A0=C2=A00K=C2=A0=C2=A0=C2=A0448K
 WAIT=C2=A0 =C2=A0 0=C2=A0 56:57=C2=A0 6.69% [intr{irq269:
 > igb1:que}]
 > 12 root=C2=A0 =C2=A0=C2=A0=C2=A0-92=C2=A0 =C2=A0
 -=C2=A0 =C2=A0=C2=A0=C2=A00K=C2=A0=C2=A0=C2=A0448K
 WAIT=C2=A0 =C2=A0 3 203:34=C2=A0 4.74% [intr{irq275:
 > em1:rx 0}]
 > 0 root=C2=A0 =C2=A0=C2=A0=C2=A0-92=C2=A0 =C2=A0 0=C2=A0
 =C2=A0=C2=A0=C2=A00K=C2=A0=C2=A0=C2=A0336K -=C2=A0 =C2=A0
 =C2=A0=C2=A0=C2=A02 427:03=C2=A0 2.64%
 > [kernel{dummynet}]
 > 0 root=C2=A0 =C2=A0=C2=A0=C2=A0-92=C2=A0 =C2=A0 0=C2=A0
 =C2=A0=C2=A0=C2=A00K=C2=A0=C2=A0=C2=A0336K -=C2=A0 =C2=A0
 =C2=A0=C2=A0=C2=A03 206:57=C2=A0 2.54% [kernel{em0
 > que}]
 > 86278 root=C2=A0 =C2=A0 =C2=A0 20=C2=A0 =C2=A0 0
 33348K=C2=A0 8588K select=C2=A0
 0=C2=A0=C2=A0=C2=A08:35=C2=A0 0.54%
 > /usr/local/sbin/snmpd -p /var/run/net_snmpd.pid -r
 > 12 root=C2=A0 =C2=A0=C2=A0=C2=A0-92=C2=A0 =C2=A0
 -=C2=A0 =C2=A0=C2=A0=C2=A00K=C2=A0=C2=A0=C2=A0448K
 WAIT=C2=A0 =C2=A0 2=C2=A0=C2=A0=C2=A07:56=C2=A0 0.20%
 [intr{irq276:
 > em1:tx 0}]
 >
 > # cat /etc/sysctl.conf
 > dev.igb.0.rx_processing_limit=3D4096
 > dev.igb.1.rx_processing_limit=3D4096
 > dev.em.0.rx_int_delay=3D200
 > dev.em.0.tx_int_delay=3D200
 > dev.em.0.rx_abs_int_delay=3D4000
 > dev.em.0.tx_abs_int_delay=3D4000
 > dev.em.0.rx_processing_limit=3D4096
 > dev.em.1.rx_int_delay=3D200
 > dev.em.1.tx_int_delay=3D200
 > dev.em.1.rx_abs_int_delay=3D4000
 > dev.em.1.tx_abs_int_delay=3D4000
 > dev.em.1.rx_processing_limit=3D4096
 > net.inet.ip.forwarding=3D1
 > net.inet.ip.fastforwarding=3D1
 > net.inet.tcp.blackhole=3D2
 > net.inet.udp.blackhole=3D0
 > net.inet.ip.redirect=3D0
 > net.inet.tcp.delayed_ack=3D0
 > net.inet.tcp.recvbuf_max=3D4194304
 > net.inet.tcp.sendbuf_max=3D4194304
 > net.inet.tcp.sack.enable=3D0
 > net.inet.tcp.drop_synfin=3D1
 > net.inet.tcp.nolocaltimewait=3D1
 > net.inet.ip.ttl=3D255
 > net.inet.ip.sourceroute=3D0
 > net.inet.ip.accept_sourceroute=3D0
 > net.inet.udp.recvspace=3D64080
 > net.inet.ip.rtmaxcache=3D1024
 > net.inet.ip.intr_queue_maxlen=3D5120
 > kern.ipc.nmbclusters=3D824288
 > kern.ipc.maxsockbuf=3D83886080
 > kern.ipc.maxsockets=3D102400
 > net.inet.tcp.recvspace=3D95536
 > net.inet.tcp.sendspace=3D95536
 > net.local.stream.recvspace=3D32768
 > net.local.stream.sendspace=3D32768
 > kern.ipc.somaxconn=3D32768
 > net.inet.tcp.maxtcptw=3D65535
 > net.inet.ip.fw.one_pass=3D1
 > net.inet.ip.fw.dyn_max=3D65535
 > net.inet.ip.fw.dyn_buckets=3D2048
 > net.inet.ip.fw.dyn_syn_lifetime=3D10
 > net.inet.ip.fw.dyn_ack_lifetime=3D120
 > net.inet.ip.fw.verbose=3D0
 > net.inet.ip.dummynet.io_fast=3D1
 > net.inet.ip.dummynet.hash_size=3D65536
 > net.inet.ip.dummynet.pipe_slot_limit=3D1000
 > net.inet.icmp.icmplim=3D3000
 > net.inet.icmp.drop_redirect=3D1
 > net.inet.icmp.log_redirect=3D0
 > net.inet.icmp.bmcastecho=3D0
 > net.inet.icmp.maskrepl=3D0
 > kern.random.sys.harvest.ethernet=3D0
 > kern.random.sys.harvest.point_to_point=3D0
 > kern.random.sys.harvest.interrupt=3D0
 > net.inet.raw.maxdgram=3D16384
 > net.inet.raw.recvspace=3D16384
 > net.route.netisr_maxqlen=3D8192
 > net.inet.ip.intr_queue_maxlen=3D10240
 > net.isr.dispatch=3Ddeferred
 >
 > # cat /boot/loader.conf
 > loader_logo=3D"beastie"
 > autoboot_delay=3D3
 > geom_mirror_load=3D"YES"
 > hw.igb.rxd=3D4096
 > hw.igb.txd=3D4096
 > hw.igb.rx_process_limit=3D4096
 > hw.igb.max_interrupt_rate=3D32000
 > hw.igb.num_queues=3D4
 > hw.igb.fc_setting=3D0
 > hw.igb.lro=3D0
 > hw.em.rxd=3D4096
 > hw.em.txd=3D4096
 > hw.em.rx_process_limit=3D4096
 > hw.em.fc_setting=3D0
 > dev.em.0.rx_int_delay=3D200
 > dev.em.0.tx_int_delay=3D200
 > dev.em.0.rx_abs_int_delay=3D4000
 > dev.em.0.tx_abs_int_delay=3D4000
 > dev.em.1.rx_int_delay=3D200
 > dev.em.1.tx_int_delay=3D200
 > dev.em.1.rx_abs_int_delay=3D4000
 > dev.em.1.tx_abs_int_delay=3D4000
 > net.isr.maxthreads=3D4
 > net.isr.bindthreads=3D0
 > net.inet.tcp.tcbhashsize=3D32000
 > net.link.ifqmaxlen=3D10240
 > net.isr.defaultqlimit=3D8192
 >
 > # vmstat -i
 > interrupt=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0
 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 total=C2=A0
 =C2=A0 =C2=A0=C2=A0=C2=A0rate
 > irq20: ehci1=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0
 =C2=A0 =C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A04171628=C2=A0 =C2=A0
 =C2=A0 =C2=A0 =C2=A0 2
 > irq21: atapci0=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0
 =C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A01561194=C2=A0 =C2=A0 =C2=A0
 =C2=A0 =C2=A0 0
 > irq22: ehci0+=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0
 =C2=A0 =C2=A0 =C2=A0 =C2=A0 2713150=C2=A0 =C2=A0 =C2=A0
 =C2=A0 =C2=A0 1
 > cpu0:timer=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0
 =C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A014622957598=C2=A0 =C2=A0
 =C2=A0=C2=A0=C2=A08082
 > irq264: igb0:que 0=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0
 =C2=A0=C2=A0=C2=A0515616328=C2=A0 =C2=A0 =C2=A0 =C2=A0 284
 > irq265: igb0:que 1=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0
 =C2=A0=C2=A0=C2=A0738456087=C2=A0 =C2=A0 =C2=A0 =C2=A0 408
 > irq266: igb0:que 2=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0
 =C2=A0=C2=A0=C2=A0711371660=C2=A0 =C2=A0 =C2=A0 =C2=A0 393
 > irq267: igb0:que 3=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0
 =C2=A0=C2=A0=C2=A0462738813=C2=A0 =C2=A0 =C2=A0 =C2=A0 255
 > irq268: igb0:link=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0
 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 3=C2=A0 =C2=A0
 =C2=A0 =C2=A0 =C2=A0 0
 > irq269: igb1:que 0=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0
 =C2=A0=C2=A0=C2=A0656044816=C2=A0 =C2=A0 =C2=A0 =C2=A0 362
 > irq270: igb1:que 1=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0
 =C2=A0=C2=A0=C2=A0546931002=C2=A0 =C2=A0 =C2=A0 =C2=A0 302
 > irq271: igb1:que 2=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0
 =C2=A0=C2=A0=C2=A0617173223=C2=A0 =C2=A0 =C2=A0 =C2=A0 341
 > irq272: igb1:que 3=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0
 =C2=A0=C2=A0=C2=A0644295672=C2=A0 =C2=A0 =C2=A0 =C2=A0 356
 > irq273: igb1:link=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0
 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 4=C2=A0 =C2=A0
 =C2=A0 =C2=A0 =C2=A0 0
 > irq274: em0=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0
 =C2=A0 =C2=A0 =C2=A0 =C2=A0 557400132=C2=A0 =C2=A0 =C2=A0
 =C2=A0 308
 > irq275: em1:rx 0=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0
 =C2=A0 =C2=A0=C2=A0=C2=A0424252744=C2=A0 =C2=A0 =C2=A0
 =C2=A0 234
 > irq276: em1:tx 0=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0
 =C2=A0 =C2=A0=C2=A0=C2=A0708469817=C2=A0 =C2=A0 =C2=A0
 =C2=A0 391
 > irq277: em1:link=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0
 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A02=C2=A0
 =C2=A0 =C2=A0 =C2=A0 =C2=A0 0
 > cpu3:timer=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0
 =C2=A0 =C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0678408141=C2=A0
 =C2=A0 =C2=A0 =C2=A0 374
 > cpu1:timer=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0
 =C2=A0 =C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0674674076=C2=A0
 =C2=A0 =C2=A0 =C2=A0 372
 > cpu2:timer=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0
 =C2=A0 =C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0621495291=C2=A0
 =C2=A0 =C2=A0 =C2=A0 343
 > Total=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0
 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 23188731381=C2=A0 =C2=A0
 =C2=A0 12816
 >
 > # netstat -w1
 > input=C2=A0 =C2=A0 =C2=A0 =C2=A0 (Total)=C2=A0 =C2=A0
 =C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0output
 > packets=C2=A0 errs idrops=C2=A0 =C2=A0 =C2=A0
 bytes=C2=A0 =C2=A0 packets=C2=A0 errs=C2=A0 =C2=A0 =C2=A0
 bytes colls
 > 442k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0
 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0
 =C2=A0=C2=A0=C2=A0304M=C2=A0 =C2=A0
 =C2=A0=C2=A0=C2=A0457k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0
 =C2=A0 =C2=A0=C2=A0=C2=A0393M=C2=A0 =C2=A0=C2=A0=C2=A00
 > 449k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0
 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0
 =C2=A0=C2=A0=C2=A0308M=C2=A0 =C2=A0
 =C2=A0=C2=A0=C2=A0463k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0
 =C2=A0 =C2=A0=C2=A0=C2=A0395M=C2=A0 =C2=A0=C2=A0=C2=A00
 > 445k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0
 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0
 =C2=A0=C2=A0=C2=A0304M=C2=A0 =C2=A0
 =C2=A0=C2=A0=C2=A0461k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0
 =C2=A0 =C2=A0=C2=A0=C2=A0393M=C2=A0 =C2=A0=C2=A0=C2=A00
 > 439k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0
 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0
 =C2=A0=C2=A0=C2=A0303M=C2=A0 =C2=A0
 =C2=A0=C2=A0=C2=A0456k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0
 =C2=A0 =C2=A0=C2=A0=C2=A0393M=C2=A0 =C2=A0=C2=A0=C2=A00
 > 434k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0
 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0
 =C2=A0=C2=A0=C2=A0297M=C2=A0 =C2=A0
 =C2=A0=C2=A0=C2=A0450k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0
 =C2=A0 =C2=A0=C2=A0=C2=A0387M=C2=A0 =C2=A0=C2=A0=C2=A00
 > 440k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0
 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0
 =C2=A0=C2=A0=C2=A0301M=C2=A0 =C2=A0
 =C2=A0=C2=A0=C2=A0456k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0
 =C2=A0 =C2=A0=C2=A0=C2=A0392M=C2=A0 =C2=A0=C2=A0=C2=A00
 > 438k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0
 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0
 =C2=A0=C2=A0=C2=A0300M=C2=A0 =C2=A0
 =C2=A0=C2=A0=C2=A0455k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0
 =C2=A0 =C2=A0=C2=A0=C2=A0391M=C2=A0 =C2=A0=C2=A0=C2=A00
 >
 > # ifconfig lagg0=C2=A0=C2=A0=C2=A0(internal, 500
 VLAN's)
 > lagg0:
 flags=3D8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST>
 metric 0 mtu
 > 1500
 >
 options=3D401bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSU=
M,TSO4,VLAN_HWTSO>
 > ether a0:36:9f:16:d0:9c
 > media: Ethernet autoselect
 > status: active
 > laggproto lacp lagghash l2,l3,l4
 > laggport: igb1
 flags=3D1c<ACTIVE,COLLECTING,DISTRIBUTING>
 > laggport: igb0
 flags=3D1c<ACTIVE,COLLECTING,DISTRIBUTING>
 >
 > # ifconfig lagg1=C2=A0 =C2=A0 - (external, NAT)
 > lagg1:
 flags=3D8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST>
 metric 0 mtu
 > 1500
 >
 options=3D4209b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,WOL_MAGI=
C,VLAN_HWTSO>
 > ether 00:1e:67:59:ea:89
 > inet =D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.14 netmask=
 0xffffffe0
 broadcast
 > =D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.31
 > inet =D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.70 netmask=
 0xffffffff
 broadcast
 > =D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.70
 > inet =D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.71 netmask=
 0xffffffff
 broadcast
 > =D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.71
 > inet =D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.72 netmask=
 0xffffffff
 broadcast
 > =D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.72
 > inet =D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.73 netmask=
 0xffffffff
 broadcast
 > =D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.73
 > inet =D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.74 netmask=
 0xffffffff
 broadcast
 > =D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.74
 > inet =D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.75 netmask=
 0xffffffff
 broadcast
 > =D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.75
 > inet =D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.76 netmask=
 0xffffffff
 broadcast
 > =D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.76
 > inet =D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.77 netmask=
 0xffffffff
 broadcast
 > =D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.77
 > inet =D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.78 netmask=
 0xffffffff
 broadcast
 > =D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.78
 > inet =D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.79 netmask=
 0xffffffff
 broadcast
 > =D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.79
 > inet =D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.33 netmask=
 0xfffffff0
 broadcast
 > =D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.47
 > media: Ethernet autoselect
 > status: active
 > laggproto lacp lagghash l2,l3,l4
 > laggport: em1
 flags=3D1c<ACTIVE,COLLECTING,DISTRIBUTING>
 > laggport: em0
 flags=3D1c<ACTIVE,COLLECTING,DISTRIBUTING>
 >
 > # netstat -w1 -I em0
 > input=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 (em0)=C2=A0
 =C2=A0 =C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0output
 > packets=C2=A0 errs idrops=C2=A0 =C2=A0 =C2=A0
 bytes=C2=A0 =C2=A0 packets=C2=A0 errs=C2=A0 =C2=A0 =C2=A0
 bytes colls
 > 101k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0
 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0
 =C2=A0=C2=A0=C2=A0111M=C2=A0 =C2=A0 =C2=A0 =C2=A0 36k=C2=A0
 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0 =C2=A0 13M=C2=A0
 =C2=A0=C2=A0=C2=A00
 > 101k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0
 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0
 =C2=A0=C2=A0=C2=A0112M=C2=A0 =C2=A0 =C2=A0 =C2=A0 36k=C2=A0
 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0 =C2=A0 13M=C2=A0
 =C2=A0=C2=A0=C2=A00
 > 100k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0
 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0
 =C2=A0=C2=A0=C2=A0112M=C2=A0 =C2=A0 =C2=A0 =C2=A0 37k=C2=A0
 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0 =C2=A0 13M=C2=A0
 =C2=A0=C2=A0=C2=A00
 >
 > # netstat -w1 -I em1
 > [code]=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0
 input=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 (em1)=C2=A0 =C2=A0
 =C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0output
 > packets=C2=A0 errs idrops=C2=A0 =C2=A0 =C2=A0
 bytes=C2=A0 =C2=A0 packets=C2=A0 errs=C2=A0 =C2=A0 =C2=A0
 bytes colls
 > 100k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0
 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0
 =C2=A0=C2=A0=C2=A0111M=C2=A0 =C2=A0 =C2=A0 =C2=A0 37k=C2=A0
 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0
 =C2=A0=C2=A0=C2=A09.1M=C2=A0 =C2=A0=C2=A0=C2=A00
 > 102k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0
 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0
 =C2=A0=C2=A0=C2=A0113M=C2=A0 =C2=A0 =C2=A0 =C2=A0 39k=C2=A0
 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0 =C2=A0 10M=C2=A0
 =C2=A0=C2=A0=C2=A00
 > 91k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0
 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0
 =C2=A0=C2=A0=C2=A0101M=C2=A0 =C2=A0 =C2=A0 =C2=A0 38k=C2=A0
 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0
 =C2=A0=C2=A0=C2=A09.7M=C2=A0 =C2=A0=C2=A0=C2=A00
 >
 > # netstat -w1 -I igb0
 > input=C2=A0 =C2=A0 =C2=A0
 =C2=A0=C2=A0=C2=A0(igb0)=C2=A0 =C2=A0 =C2=A0 =C2=A0
 =C2=A0=C2=A0=C2=A0output
 > packets=C2=A0 errs idrops=C2=A0 =C2=A0 =C2=A0
 bytes=C2=A0 =C2=A0 packets=C2=A0 errs=C2=A0 =C2=A0 =C2=A0
 bytes colls
 > 39k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0
 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0
 =C2=A0=C2=A0=C2=A09.1M=C2=A0 =C2=A0 =C2=A0 =C2=A0 51k=C2=A0
 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0 =C2=A0 57M=C2=A0
 =C2=A0=C2=A0=C2=A00
 > 38k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0
 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0
 =C2=A0=C2=A0=C2=A09.1M=C2=A0 =C2=A0 =C2=A0 =C2=A0 49k=C2=A0
 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0 =C2=A0 54M=C2=A0
 =C2=A0=C2=A0=C2=A00
 > 39k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0
 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0
 =C2=A0=C2=A0=C2=A09.4M=C2=A0 =C2=A0 =C2=A0 =C2=A0 51k=C2=A0
 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0 =C2=A0 56M=C2=A0
 =C2=A0=C2=A0=C2=A00
 >
 > # netstat -w1 -I igb1
 > input=C2=A0 =C2=A0 =C2=A0
 =C2=A0=C2=A0=C2=A0(igb1)=C2=A0 =C2=A0 =C2=A0 =C2=A0
 =C2=A0=C2=A0=C2=A0output
 > packets=C2=A0 errs idrops=C2=A0 =C2=A0 =C2=A0
 bytes=C2=A0 =C2=A0 packets=C2=A0 errs=C2=A0 =C2=A0 =C2=A0
 bytes colls
 > 36k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0
 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0 =C2=A0 14M=C2=A0
 =C2=A0 =C2=A0 =C2=A0 48k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0
 =C2=A0 =C2=A0 =C2=A0 56M=C2=A0 =C2=A0=C2=A0=C2=A00
 > 35k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0
 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0 =C2=A0 14M=C2=A0
 =C2=A0 =C2=A0 =C2=A0 50k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0
 =C2=A0 =C2=A0 =C2=A0 59M=C2=A0 =C2=A0=C2=A0=C2=A00
 > 34k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0
 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0 =C2=A0 13M=C2=A0
 =C2=A0 =C2=A0 =C2=A0 48k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0
 =C2=A0 =C2=A0 =C2=A0 57M=C2=A0 =C2=A0=C2=A0=C2=A00
 >
 > # netstat -w1 -I lagg0
 > input=C2=A0 =C2=A0 =C2=A0 =C2=A0 (lagg0)=C2=A0 =C2=A0
 =C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0output
 > packets=C2=A0 errs idrops=C2=A0 =C2=A0 =C2=A0
 bytes=C2=A0 =C2=A0 packets=C2=A0 errs=C2=A0 =C2=A0 =C2=A0
 bytes colls
 > 75k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0
 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0 =C2=A0 23M=C2=A0
 =C2=A0 =C2=A0 =C2=A0 98k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0
 =C2=A0 =C2=A0=C2=A0=C2=A0113M=C2=A0 =C2=A0=C2=A0=C2=A00
 > 73k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0
 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0 =C2=A0 21M=C2=A0
 =C2=A0 =C2=A0 =C2=A0 98k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0
 =C2=A0 =C2=A0=C2=A0=C2=A0113M=C2=A0 =C2=A0=C2=A0=C2=A00
 > 73k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0
 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0 =C2=A0 23M=C2=A0
 =C2=A0 =C2=A0 =C2=A0 98k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0
 =C2=A0 =C2=A0=C2=A0=C2=A0112M=C2=A0 =C2=A0=C2=A0=C2=A00
 >
 > # netstat -w1 -I lagg1
 > input=C2=A0 =C2=A0 =C2=A0 =C2=A0 (lagg1)=C2=A0 =C2=A0
 =C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0output
 > packets=C2=A0 errs idrops=C2=A0 =C2=A0 =C2=A0
 bytes=C2=A0 =C2=A0 packets=C2=A0 errs=C2=A0 =C2=A0 =C2=A0
 bytes colls
 > 100k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0
 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0
 =C2=A0=C2=A0=C2=A0112M=C2=A0 =C2=A0 =C2=A0 =C2=A0 74k=C2=A0
 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0 =C2=A0 24M=C2=A0
 =C2=A0=C2=A0=C2=A00
 > 101k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0
 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0
 =C2=A0=C2=A0=C2=A0113M=C2=A0 =C2=A0 =C2=A0 =C2=A0 73k=C2=A0
 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0 =C2=A0 24M=C2=A0
 =C2=A0=C2=A0=C2=A00
 > 102k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0
 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0
 =C2=A0=C2=A0=C2=A0114M=C2=A0 =C2=A0 =C2=A0 =C2=A0 74k=C2=A0
 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0 =C2=A0 24M=C2=A0
 =C2=A0=C2=A0=C2=A00
 >
 >>
 > _______________________________________________
 >=C2=A0=C2=A0=C2=A0freebsd-net@freebsd.org=C2=A0=C2=A0=C2=A0mailing
 list
 >=C2=A0=C2=A0=C2=A0http://lists.freebsd.org/mailman/listinfo/freebsd-net=
=C2=A0
 > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org"
 _______________________________________________=C2=A0 freebsd-net@freebsd.=
org=C2=A0=C2=A0=C2=A0mailing
 list=C2=A0 http://lists.freebsd.org/mailman/listinfo/freebsd-net=C2=A0
 To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org"
 _______________________________________________
 freebsd-net@freebsd.org
 mailing list
 http://lists.freebsd.org/mailman/listinfo/freebsd-net
 To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org"



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?1373818461.35904.YahooMailBasic>