Date: Sat, 16 Apr 2016 12:15:11 +0100 From: Justin Clift <justin@postgresql.org> To: freebsd-infiniband@freebsd.org Subject: How to force IB cards to come up in IB mode? Message-ID: <9C08621D-AAE9-42D0-8079-716CDD9BC5E0@postgresql.org>
next in thread | raw e-mail | index | archive | help
Hi all,
I'm trying to get a new FreeBSD 10.3-STABLE install to work well with
my MHGH28-XTC (dual port ConnectX DDR) cards.
The problem is they're coming up in eth mode, not ib mode, and I can't
seem to get that fixed. :(
=46rom boot:
# ifconfig
mlxen0: flags=3D8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
=
options=3D6d07bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCS=
UM,TSO4,TSO6,LRO,VLAN_HWFILTER,VLAN_HWTSO,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV=
6>
ether 00:02:c9:00:ca:cd
nd6 options=3D29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
media: Ethernet autoselect
status: no carrier
mlxen1: flags=3D8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
=
options=3D6d07bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCS=
UM,TSO4,TSO6,LRO,VLAN_HWFILTER,VLAN_HWTSO,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV=
6>
ether 00:02:c9:00:ca:ce
nd6 options=3D29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
media: Ethernet autoselect
status: no carrier
My loader.conf file seems like it should be correct:
# cat /boot/loader.conf
sys.device.mlx4_core0.mlx4_port1=3D"ib"
sys.device.mlx4_core0.mlx4_port2=3D"ib"
As background, this is a new install (coming from CentOS 6.x, where
it all works well), so I know there's no problem with the cards. =
They're
plugged into a 24 port DDR switch (Voltaire ISR 9024D-M) using active
optical cables.
Any ideas?
Regards and best wishes,
Justin Clift
--
"My grandfather once told me that there are two kinds of people: those
who work and those who take the credit. He told me to try to be in the
first group; there was less competition there."
- Indira Gandhi
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?9C08621D-AAE9-42D0-8079-716CDD9BC5E0>