From owner-freebsd-infiniband@FreeBSD.ORG  Sun Jun 14 18:56:58 2015
Return-Path: <owner-freebsd-infiniband@FreeBSD.ORG>
Delivered-To: freebsd-infiniband@hub.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 16976D3F
 for <freebsd-infiniband@hub.freebsd.org>; Sun, 14 Jun 2015 18:56:58 +0000 (UTC)
 (envelope-from hps@selasky.org)
Received: from mail.turbocat.net (mail.turbocat.net
 [IPv6:2a01:4f8:d16:4514::2])
 (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
 (Client did not present a certificate)
 by mx1.freebsd.org (Postfix) with ESMTPS id CFE93AB6
 for <freebsd-infiniband@freebsd.org>; Sun, 14 Jun 2015 18:56:57 +0000 (UTC)
 (envelope-from hps@selasky.org)
Received: from laptop015.home.selasky.org
 (cm-176.74.213.204.customer.telag.net [176.74.213.204])
 (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits))
 (No client certificate requested)
 by mail.turbocat.net (Postfix) with ESMTPSA id C2B311FE023;
 Sun, 14 Jun 2015 20:56:54 +0200 (CEST)
Message-ID: <557DCEA7.3030703@selasky.org>
Date: Sun, 14 Jun 2015 20:57:43 +0200
From: Hans Petter Selasky <hps@selasky.org>
User-Agent: Mozilla/5.0 (X11; FreeBSD amd64;
 rv:31.0) Gecko/20100101 Thunderbird/31.7.0
MIME-Version: 1.0
To: Mihai Vintila <unixro@gmail.com>, freebsd-infiniband@freebsd.org
Subject: Re: Ib0 not working unless i unload ipoib and load it again.
References: <557C79D8.8040403@gmail.com> <557C7D94.9020207@selasky.org>
 <557DCA80.50203@gmail.com>
In-Reply-To: <557DCA80.50203@gmail.com>
Content-Type: text/plain; charset=windows-1252; format=flowed
Content-Transfer-Encoding: 7bit
X-BeenThere: freebsd-infiniband@freebsd.org
X-Mailman-Version: 2.1.20
Precedence: list
List-Id: Infiniband on FreeBSD <freebsd-infiniband.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-infiniband>, 
 <mailto:freebsd-infiniband-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-infiniband/>
List-Post: <mailto:freebsd-infiniband@freebsd.org>
List-Help: <mailto:freebsd-infiniband-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-infiniband>, 
 <mailto:freebsd-infiniband-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Sun, 14 Jun 2015 18:56:58 -0000

Hi,

On 06/14/15 20:40, Mihai Vintila wrote:
> Another strange issue. Is that i have:
> /boot/loader.conf
> mlx4_core="YES"
> ibcore_load="YES"
> mlxen_load="YES"
> mlx4ib_load="YES"
> ipoib_load="YES"

If you remove this line from sysctl.conf and run it from the command 
line instead, does it work then?

>
> and in sysctl.conf
> sys.device.mlx4_core0.mlx4_port1=ib
>
> Only when it boots ib0 is not functional. From what i've noticed if
> after mlx4_core0 is up i remove ipoib module and add it again it's working.
>
> Bellow is a small output from dmesg in which i unload/load ipoib at boot
> in rc.local and interface still doesn't work and after port is up i do
> it manually and it starts working:
> ib0: Attached to mlx4_0 port 1
> ums0: <vendor 0x0557 product 0x2419, class 0/0, rev 1.10/1.00, addr 2>
> on usbus0
> ums0: 3 buttons and [Z] coordinates ID=0
> ib0: link state changed to DOWN
> ib0: Attached to mlx4_0 port 1
> mlx4_core0: mlx4_ib: Port 1 logical link is up
> ib0: link state changed to DOWN
> ib0: Attached to mlx4_0 port 1
> ib0: link state changed to UP
>
>
> in ifconfig only difference is a new lladdr for ib0.
>

--HPS