Skip site navigation (1)Skip section navigation (2)
Date:      Wed, 9 Jun 2021 12:23:53 -0300
From:      Christopher Forgeron <csforgeron@gmail.com>
To:        freebsd-hardware@freebsd.org
Subject:   Re: Devices behind PEX 8664 PCIe Switch not detected since 11.0-RELEASE
Message-ID:  <CAB2_NwCrjH3ORbp0E0bv6hwb27TZGtpPRkNPB4frdTd9seqAgg@mail.gmail.com>
In-Reply-To: <CAB2_NwCO19XgEqN3bSHpzoO59jL3pB1PHq64OQ-LhHJaw_9FOg@mail.gmail.com>
References:  <CAB2_NwCO19XgEqN3bSHpzoO59jL3pB1PHq64OQ-LhHJaw_9FOg@mail.gmail.com>

next in thread | previous in thread | raw e-mail | index | archive | help
--00000000000063073c05c456dd21
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

Hello,

 I'm not sure if I should try posting on a different mail list? The problem
is still here, it's beyond my ability to fix, and I'm willing to actively
help out anyone who can point me in the right direction - Anyone with any
ideas?

On Tue, Jun 1, 2021 at 10:44 PM Christopher Forgeron <csforgeron@gmail.com>
wrote:

> Hello,
>
>  I have not been able to upgrade past FreeBSD 10.3 as since versions 11.0=
 -> 13.0 devices behind my fileserver's PCIe Switch are not detected. The s=
witch itself is detected, which is a PEX 8664 PCIe Switch, link below.
>
>  I'm using a Dell M610x blade server, which has a PEX/Broadcom 8664 Switc=
h in it to provide 2 PCIe slots, which I use to run SAS controllers to a dr=
ive array.
>
>  This arrangement has worked perfectly since the early days of 7/8.0, and=
 I've pretty much ran each version of FreeBSD since then, until 11.0 came o=
ut.
>
>  This is when I could no longer see/detect devices plugged into the PCIe =
slots. Things were busy, FreeBSD 10.2 worked well, so it was just left this=
 way for years.
>
>  Now I do need to upgrade software-wise to 13.0, so I've invested some ti=
me tracking down what is happening, with the hopes that a knowledgeable per=
son can fix this up.
>
>  - I have confirmed with 10.3-RELEASE and a 11.0-RELEASE mini-iso boot th=
at the problem starts in 11.0, and I can confirm it's still an issue in 12.=
0 and 13.0. I also boot into a 10.2-RELEASE because I happen to have that h=
andy.  Everything works/detects fine in 10.3 or lower.
>
>  - These are GENERIC kernels, fresh from the iso/img I boot from, nothing=
 custom.
>
>  - I currently have a 10.2 (or 10.3) boot and a 13.0 boot ready to swap b=
ack and forth to try and isolate / probe info. I'll attach a few lspci dump=
s after this message.
>
>  - The card in question is a LSI 2008 Chipset, mps0 - But it's nothing do=
 do with that card/brand/config. I have also installed an Intel X540 Networ=
k card in the PCIe slots and find the same issue - There's nothing behind t=
he PEC 8664 in FreeBSD 13.0, and no problems in 10.2. I have also confirmed=
 that 13.0 boots up and detects the mps0 without issue when I use a differe=
nt system without the PEX 8664
>
>  - At some point in my research I came across a similar issue where the d=
eveloper mentioned that for some reason they were not scanning behind the s=
witch. It was a different chipset and issue, and  I don't have that thread =
handy at the moment, I will post if I come across it again.
>
> Ref:https://www.broadcom.com/products/pcie-switches-bridges/pcie-switches=
/pex8664
>
> I'm rusty, but fairly knowledgeable and useful if you need me to compile =
something, install patches, etc. I could give SSH access, but sending me a =
patch to test may be quicker.
>
> lspci dumps are in my bug report here:
>
> https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D256264
>
> Thanks.
>
>

--00000000000063073c05c456dd21--



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CAB2_NwCrjH3ORbp0E0bv6hwb27TZGtpPRkNPB4frdTd9seqAgg>