Date: Sun, 14 Jun 2015 22:12:11 +0300 From: Mihai Vintila <unixro@gmail.com> To: Hans Petter Selasky <hps@selasky.org>, freebsd-infiniband@freebsd.org Subject: Re: Ib0 not working unless i unload ipoib and load it again. Message-ID: <557DD20B.7020508@gmail.com> In-Reply-To: <557DCEA7.3030703@selasky.org> References: <557C79D8.8040403@gmail.com> <557C7D94.9020207@selasky.org> <557DCA80.50203@gmail.com> <557DCEA7.3030703@selasky.org>
next in thread | previous in thread | raw e-mail | index | archive | help
Same behavior:
sysctl -w sys.device.mlx4_core0.mlx4_port1=ib
sys.device.mlx4_core0.mlx4_port1: eth -> ib
ifconfig ib0
ib0: flags=8043<UP,BROADCAST,RUNNING,MULTICAST> metric 0 mtu 2044
options=8009b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,LINKSTATE>
lladdr 0.0.0.48.fe.80.0.0.0.0.0.0.e4.1d.2d.3.0.a.21.31
inet 10.105.0.225 netmask 0xffffff00 broadcast 10.105.0.255
nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
ping 10.105.0.15
PING 10.105.0.15 (10.105.0.15): 56 data bytes
ping: sendto: No route to host
ping: sendto: No route to host
Might worth to mention that this host also holds opensm, and i actually
need to run opensm first next unload/load the module.
But i rather expect that the ib0 state changes along mlx4_core0 state.
Best regards,
Vintila Mihai Alexandru
On 6/14/2015 9:57 PM, Hans Petter Selasky wrote:
> Hi,
>
> On 06/14/15 20:40, Mihai Vintila wrote:
>> Another strange issue. Is that i have:
>> /boot/loader.conf
>> mlx4_core="YES"
>> ibcore_load="YES"
>> mlxen_load="YES"
>> mlx4ib_load="YES"
>> ipoib_load="YES"
>
> If you remove this line from sysctl.conf and run it from the command
> line instead, does it work then?
>
>>
>> and in sysctl.conf
>> sys.device.mlx4_core0.mlx4_port1=ib
>>
>> Only when it boots ib0 is not functional. From what i've noticed if
>> after mlx4_core0 is up i remove ipoib module and add it again it's
>> working.
>>
>> Bellow is a small output from dmesg in which i unload/load ipoib at boot
>> in rc.local and interface still doesn't work and after port is up i do
>> it manually and it starts working:
>> ib0: Attached to mlx4_0 port 1
>> ums0: <vendor 0x0557 product 0x2419, class 0/0, rev 1.10/1.00, addr 2>
>> on usbus0
>> ums0: 3 buttons and [Z] coordinates ID=0
>> ib0: link state changed to DOWN
>> ib0: Attached to mlx4_0 port 1
>> mlx4_core0: mlx4_ib: Port 1 logical link is up
>> ib0: link state changed to DOWN
>> ib0: Attached to mlx4_0 port 1
>> ib0: link state changed to UP
>>
>>
>> in ifconfig only difference is a new lladdr for ib0.
>>
>
> --HPS
>
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?557DD20B.7020508>