Skip site navigation (1)Skip section navigation (2)
Date:      Mon, 21 Nov 2016 09:00:06 +0100 (CET)
From:      =?ISO-8859-1?Q?Trond_Endrest=F8l?= <Trond.Endrestol@fagskolen.gjovik.no>
To:        Paul Macdonald <paul@ifdnrg.com>
Cc:        freebsd-questions@freebsd.org
Subject:   Re: Dell R230's + ZFS via PERC
Message-ID:  <alpine.BSF.2.20.1611210852140.32949@mail.fig.ol.no>
In-Reply-To: <5c6f8cf9-3b10-f631-7a14-986ce08f8b54@ifdnrg.com>
References:  <5c6f8cf9-3b10-f631-7a14-986ce08f8b54@ifdnrg.com>

next in thread | previous in thread | raw e-mail | index | archive | help
On Fri, 18 Nov 2016 20:10-0000, Paul Macdonald wrote:

> Hi,
> 
> We're buying a few of theDell  R230's now,
> 
> The R230's however, whilst having nice 4 x hotswappable bays) have only a
> single sata port on the borard and everything goes via the PERC card.
> 
> ( the R220's had awful ACPI problems which muck up serial access)
> 
> A lot of these are single SSD systems with a few mirrored sata + L2 SSD's for
> caching
> 
> I've read that ZFS prefers direct access to the disks, does anyone have
> info/insight as to running zfs via these percs?

We bought a R320 with the H310 Mini PERC last year. The server runs 
stable/10 amd64. I managed to convince the PERC to run in JBOD mode. 
The four drives are exposed as /dev/mfisyspd0, /dev/mfisyspd1, 
/dev/mfisyspd2, and /dev/mfisyspd3.

ZFS hasn't complained so far, but the mfi driver complains every now 
and then about not being allowed to run patrol read:

mfi0: 1063 (531025200s/0x0020/WARN) - Patrol Read can't be started, as PDs are either not ONLINE, or are in a VD with an active process, or are in an excluded VD

-- 
+-------------------------------+------------------------------------+
| Vennlig hilsen,               | Best regards,                      |
| Trond Endrestøl,              | Trond Endrestøl,                   |
| IT-ansvarlig,                 | System administrator,              |
| Fagskolen Innlandet,          | Gjøvik Technical College, Norway,  |
| tlf. mob.   952 62 567,       | Cellular...: +47 952 62 567,       |
| sentralbord 61 14 54 00.      | Switchboard: +47 61 14 54 00.      |
+-------------------------------+------------------------------------+
From owner-freebsd-questions@freebsd.org  Mon Nov 21 13:58:25 2016
Return-Path: <owner-freebsd-questions@freebsd.org>
Delivered-To: freebsd-questions@mailman.ysv.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3B74BC4C881;
 Mon, 21 Nov 2016 13:58:25 +0000 (UTC)
 (envelope-from dweimer@dweimer.net)
Received: from webmail.dweimer.net (24-240-198-187.static.stls.mo.charter.com
 [24.240.198.187])
 (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
 (Client did not present a certificate)
 by mx1.freebsd.org (Postfix) with ESMTPS id E6073FBA;
 Mon, 21 Nov 2016 13:58:24 +0000 (UTC)
 (envelope-from dweimer@dweimer.net)
Received: from webmail.dweimer.local (localhost [10.9.5.2])
 by webmail.dweimer.net (8.15.2/8.15.2) with ESMTPS id uALDejxS014998
 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO);
 Mon, 21 Nov 2016 07:40:45 -0600 (CST)
 (envelope-from dweimer@dweimer.net)
Received: (from www@localhost)
 by webmail.dweimer.local (8.15.2/8.15.2/Submit) id uALDeiYu014977;
 Mon, 21 Nov 2016 07:40:44 -0600 (CST)
 (envelope-from dweimer@dweimer.net)
X-Authentication-Warning: webmail.dweimer.local: www set sender to
 dweimer@dweimer.net using -f
To: Trond Endrestøl <Trond.Endrestol@fagskolen.gjovik.no>
Subject: Re: Dell R230's + ZFS via PERC
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8;
 format=flowed
Content-Transfer-Encoding: 8bit
Date: Mon, 21 Nov 2016 07:40:44 -0600
From: "Dean E. Weimer" <dweimer@dweimer.net>
Cc: Paul Macdonald <paul@ifdnrg.com>, freebsd-questions@freebsd.org,
 owner-freebsd-questions@freebsd.org
Organization: dweimer.net
Reply-To: dweimer@dweimer.net
Mail-Reply-To: dweimer@dweimer.net
In-Reply-To: <alpine.BSF.2.20.1611210852140.32949@mail.fig.ol.no>
References: <5c6f8cf9-3b10-f631-7a14-986ce08f8b54@ifdnrg.com>
 <alpine.BSF.2.20.1611210852140.32949@mail.fig.ol.no>
Message-ID: <82a1999d3684263c611b4e607ba6c851@dweimer.net>
X-Sender: dweimer@dweimer.net
User-Agent: Roundcube Webmail/1.2.2
X-BeenThere: freebsd-questions@freebsd.org
X-Mailman-Version: 2.1.23
Precedence: list
List-Id: User questions <freebsd-questions.freebsd.org>
List-Unsubscribe: <https://lists.freebsd.org/mailman/options/freebsd-questions>, 
 <mailto:freebsd-questions-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-questions/>;
List-Post: <mailto:freebsd-questions@freebsd.org>
List-Help: <mailto:freebsd-questions-request@freebsd.org?subject=help>
List-Subscribe: <https://lists.freebsd.org/mailman/listinfo/freebsd-questions>, 
 <mailto:freebsd-questions-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Mon, 21 Nov 2016 13:58:25 -0000

On 2016-11-21 2:00 am, Trond Endrestøl wrote:
> On Fri, 18 Nov 2016 20:10-0000, Paul Macdonald wrote:
> 
>> Hi,
>> 
>> We're buying a few of theDell  R230's now,
>> 
>> The R230's however, whilst having nice 4 x hotswappable bays) have 
>> only a
>> single sata port on the borard and everything goes via the PERC card.
>> 
>> ( the R220's had awful ACPI problems which muck up serial access)
>> 
>> A lot of these are single SSD systems with a few mirrored sata + L2 
>> SSD's for
>> caching
>> 
>> I've read that ZFS prefers direct access to the disks, does anyone 
>> have
>> info/insight as to running zfs via these percs?
> 
> We bought a R320 with the H310 Mini PERC last year. The server runs
> stable/10 amd64. I managed to convince the PERC to run in JBOD mode.
> The four drives are exposed as /dev/mfisyspd0, /dev/mfisyspd1,
> /dev/mfisyspd2, and /dev/mfisyspd3.
> 
> ZFS hasn't complained so far, but the mfi driver complains every now
> and then about not being allowed to run patrol read:
> 
> mfi0: 1063 (531025200s/0x0020/WARN) - Patrol Read can't be started, as
> PDs are either not ONLINE, or are in a VD with an active process, or
> are in an excluded VD

Patrol read is a diagnostic procedure it attempts to verify all data can 
be read, its probably safe to ignore the message, though it should be 
able to run. I have a couple of machines running on Dell PERC H700, with 
zfs running on JBOD setup, looks like they are successfully running it.

mfi0: 14748 (532234800s/0x0020/info) - Patrol Read started
mfi0: 14789 (532250323s/0x0020/info) - Patrol Read complete
mfi0: 14790 (532839600s/0x0020/info) - Patrol Read started
mfi0: 14835 (532854948s/0x0020/info) - Patrol Read complete

These machines are under fairly low load outside of 6am to 6pm time 
frame.




-- 
Thanks,
    Dean E. Weimer
    http://www.dweimer.net/



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?alpine.BSF.2.20.1611210852140.32949>