Skip site navigation (1)Skip section navigation (2)
Date:      Wed, 30 Sep 2015 12:39:39 +0100
From:      Tom Evans <tevans.uk@googlemail.com>
Cc:        "freebsd-fs@freebsd.org" <freebsd-fs@freebsd.org>
Subject:   Re: Cannot replace broken hard drive with LSI HBA
Message-ID:  <CAFHbX1%2BdZRyJUMa6nuC8S0NspocAfpRrfWC=ZHW6WeExt_j=qA@mail.gmail.com>
In-Reply-To: <CAOjFWZ69Jw6D1Mo5GyZvHfpTaHW7Dg1-z=LNZ_1PN_YAhy3jrA@mail.gmail.com>
References:  <1443447383.5271.66.camel@data-b104.adm.slu.se> <5609578E.1050606@physics.umn.edu> <560A4640.3030200@internetx.com> <560A9461.8090300@physics.umn.edu> <560A977C.1070102@internetx.com> <560AD2B9.5040706@fuckner.net> <CAOjFWZ69Jw6D1Mo5GyZvHfpTaHW7Dg1-z=LNZ_1PN_YAhy3jrA@mail.gmail.com>

next in thread | previous in thread | raw e-mail | index | archive | help
On Tue, Sep 29, 2015 at 7:25 PM, Freddie Cash <fjwcash@gmail.com> wrote:
> On Tue, Sep 29, 2015 at 11:04 AM, Michael Fuckner <michael@fuckner.net>
> wrote:
>
>> On 9/29/2015 3:51 PM, InterNetX - Juergen Gotteswinter wrote:
>>
>>>  From my Experience using SATA Disks on SAS Controllers, no matter if
>>> theres an Expander between or not or mixed, those Setups keep on beeing
>>> flakey / unreliable. I might work under certain conditions, but its
>>> nothing you can bet on.
>>>
>>> Garret Damore (Illumos Project) describes the problem more detailed here
>>>
>>> http://garrett.damore.org/2010/08/why-sas-sata-is-not-such-great-idea.html
>>>
>>>
>> come on, the article is 5 years old, some things changed since then!
>>
>> - MUX Boards are unreliable and expensive- long time since I last saw
>> those boards
>> - SAS Disks are not just 10/15k high performance Disks anymore, most
>> Nearline Disks are available with native SAS interface as well
>> - if you pick the right disk there is no trouble using SATA Disks on SAS
>> Expanders or SAS Controllers (they should have R/V sensors, optimized
>> FW...).
>> - if you use desktop drives in a shelf with lets say 24 slots you should
>> not expect it to work ;-)
>>
>
> Why not?  ;)
>
> We use desktop-class drives in our backups storage servers without any
> issues.  Even the monster boxes with 90 drives in them (2 JBODs of 45
> drives each) run without issues using desktop-class drives.
>
> We're using a mix of WD Black (1, 2, 4 TB), Toshiba (2 TB), and Seagate (1,
> 2 TB).
>
> 2 systems using 24 drive bays.  2 systems using 90 drive bays.  Plugged
> into SuperMicro SAS expanders and LSI 9211-8i or 9211-8e (I think that's
> the model number) controllers.  All SAS2008 chipsets using mps(4) drivers.
>

Just a me too. This is just for my own personal storage (so everything
is second hand from ebay), but I use LSI SAS2008 [1], which is mps(4),
with a couple of Rackable SE3016 16 bay enclosures, using around 20 of
the cheapest SATA drives[2] I could afford at the time. I've never had
any problems with it, my party trick[3] is to pull and swap drive
locations, it does a full scrub every other weekend, and I've replaced
several drives that have died and resilvered with no complications.

Of course, I don't put that much stress on the hardware, so I'm aware
that problems may not be occurring for me because of that. Perhaps
I've just been lucky so far, but they are easily the best $300 I've
spent on ebay.

No SSDs however, they are all directly attached to motherboard SATA controllers.

Cheers

Tom

[1] With firmware 15, in IT mode - I know, I should update..
[2] Currently a mix of "SAMSUNG HD154UI 1118", "TOSHIBA DT01ABA3 ABB0"
and "WDC WD30EZRX-00M 0A80". Yep, super-cheap consumer desktop hard
drives.
[3] Yes, they are quite dull parties.



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CAFHbX1%2BdZRyJUMa6nuC8S0NspocAfpRrfWC=ZHW6WeExt_j=qA>