Skip site navigation (1)Skip section navigation (2)
Date:      Tue, 3 Jul 2018 14:28:58 +0200
From:      "Oliver Sech" <CrimsonThunder@gmx.net>
To:        freebsd-scsi@freebsd.org
Subject:   problems with SAS JBODs 2
Message-ID:  <trinity-14d18077-ea73-40f6-9e87-d2d4000b1f7e-1530620937871@3c-app-gmx-bs01>

next in thread | raw e-mail | index | archive | help
Hi!
=C2=A0
I use FreeBSD with for a large ZFS pool (over 1PB) and I recently encounte=
red a lot of problems with the JBODs=2E Generally everything works fine unt=
il I replug the shelves=2E
=C2=A0
When I start with a clean system and attach a single shelf every thing see=
ms fine=2E
-> 44 disks show up, I can use the enclosure services (sesutil) and the sy=
stem continues to run without problems=2E
Once I disconnect the SAS cable, wait until all devices disapear and recon=
nect I get all sorts of problems=2E
-> a random number of disks shows up and the enclosure "ses" do not show u=
p
Once I restart the system I can start over again=2E
=C2=A0
On the server with the large pool there are only certain ports on the HBA =
that I can use, otherwise disks will be missing after a reboot and my ZFS p=
ool won't go online=2E
I tried different firmware on the HBA=2E I tried the mpr=2Eko module from =
the broadcom site=2E (I replaced the one in /boot/kernel?)
I tested all the things above with a Linux as OS and everything seems to w=
ork=2E
=C2=A0
=C2=A0
Is there anything I'm missing? A command that can reset the SAS components=
?
=C2=A0
=C2=A0
FreeBSD version: 11=2E1-RELEASE-p11
HBA: broadcom lsi 9305-16e (latest firmware)
JBOD:SC847E2C-R1K28JBOD (two expanders, internally daisy chained)



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?trinity-14d18077-ea73-40f6-9e87-d2d4000b1f7e-1530620937871>