Skip site navigation (1)Skip section navigation (2)
Date:      Fri, 20 Nov 2020 23:18:03 +0000
From:      "Brian Mcgovern (bmcgover)" <bmcgover@cisco.com>
To:        "freebsd-questions@freebsd.org" <freebsd-questions@freebsd.org>
Subject:   12.2 - Issue with lagg not becoming "ACTIVE"
Message-ID:  <BL0PR11MB3442C1CE0607359E7CAC2790C5FF0@BL0PR11MB3442.namprd11.prod.outlook.com>

next in thread | raw e-mail | index | archive | help
I'm running in to a bit of a weird set of circumstances, and I'm guessing i=
ts an issue that someone has likely seen before.

So, I have FreeBSD 12.2 running on a Cisco UCS C240 LFF system. In the box,=
 I have an Intel 4 port 10G card, and an Intel 2 port 40G card. I'm using C=
isco optics for everything.

The 10G card works fine. Individual interfaces, binding them in to pairs wi=
th lagg interfaces, using them for bridges, etc.

The 40G card partially works. As an individual interface, it works fine. If=
 I assign it an IP, or bridge it with the lagg interface on the 10G, it pas=
ses traffic fine.

However, when I try to lagg the two 40G ports together, I don't get an "ACT=
IVE" flag on the lagg interface. I've tried the configuration both with a s=
ingle-switch LACP port-channel setup, and with a dual-switch VPC port chann=
el.

lagg2: flags=3D8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric =
0 mtu 1500
        options=3De503bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VL=
AN_HWCSUM,TSO4,TSO6,VLAN_HWFILTER,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV6>
        ether 40:a6:b7:16:e2:10
        laggproto lacp lagghash l2,l3,l4
        laggport: ixl4 flags=3D18<COLLECTING,DISTRIBUTING>
        laggport: ixl5 flags=3D0<>
        groups: lagg
        media: Ethernet autoselect
        status: active
        nd6 options=3D29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>

And yet, the switch side is showing the port as actively participating in t=
he port channel (as port channel 49). Bringing up the second switch (via VP=
C) has ixl5 going in to COLLECTING,DISTRIBUTING state, but again, no ACTIVE=
 flag.

---------------------------------------------------------------------------=
-----
Group Port-       Type     Protocol  Member Ports
      Channel
---------------------------------------------------------------------------=
-----
5     Po5(SU)     Eth      LACP      Eth1/5(P)    Eth1/6(P)    Eth1/7(P)
                                     Eth1/8(P)
49    Po49(SU)    Eth      LACP      Eth1/49(P)
51    Po51(SU)    Eth      LACP      Eth1/51(P)   Eth1/52(P)

About the only thing I see if interest is that the optics are listed as "Un=
known". Otherwise, the flags here match what I'd expect to see.

ixl4: flags=3D8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0=
 mtu 1500
        options=3De503bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VL=
AN_HWCSUM,TSO4,TSO6,VLAN_HWFILTER,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV6>
        ether 40:a6:b7:16:e2:10
        media: Ethernet autoselect (Unknown <full-duplex>)
        status: active
        nd6 options=3D29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>


I'm hoping it may be a bug in the interface code, but I figured I'd ask to =
see if anyone has any good thoughts and some quick feedback before I start =
digging in to the code to figure it out.

                -Brian



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?BL0PR11MB3442C1CE0607359E7CAC2790C5FF0>