From owner-freebsd-hardware@freebsd.org Sun Jan 7 02:40:49 2018 Return-Path: Delivered-To: freebsd-hardware@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 28873E5E6AE for ; Sun, 7 Jan 2018 02:40:49 +0000 (UTC) (envelope-from leeb@ratnaling.org) Received: from mail-it0-x229.google.com (mail-it0-x229.google.com [IPv6:2607:f8b0:4001:c0b::229]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id E407B6F8BF for ; Sun, 7 Jan 2018 02:40:48 +0000 (UTC) (envelope-from leeb@ratnaling.org) Received: by mail-it0-x229.google.com with SMTP id r6so5784238itr.3 for ; Sat, 06 Jan 2018 18:40:48 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ratnaling-org.20150623.gappssmtp.com; s=20150623; h=mime-version:in-reply-to:references:from:date:message-id:subject:cc; bh=D7Vem/9mhPT4bac1T9D8vmymEdPvGGVDNifK60/tyjE=; b=2NvBcLPm31jUOuvPKDyeXu+ACw2iZ/o4Wlr9gFRKdFkvczyFQhYXFNT6dPV7Au9tdj gOmXG08kcpvS187vENjEnZI1aNsJZI/G+7PwHhcK1YcYBSPlxR9/VhKbPCZJWuRNXDnW curtnE2qwGoSW0Q2FxlPxsL5md9o+GvaOlEoRv7hxeQDS5jzRanpz+ticR1t5nq3yAxe CREDuv14cLvDB99MhFonM/2d362aTJYzFpBk4G2foA/qD9UQonvfLU+Zr2WA4ER1ZZEy EwL0zsYmsQrSsnwGl6bTQqP0c4ojE5CRFJ9fn+gbCvVQwp31hnOm57uuKG7FhWFNB8PW eOWA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:cc; bh=D7Vem/9mhPT4bac1T9D8vmymEdPvGGVDNifK60/tyjE=; b=pfEEB1ZF5JGxC6d87KtBeDCG08TSJAgIfWJEPaluH/03CdcM1minfe7RpSeqg3qbJi AnhuICE/CNvpXa+U3MVKATwnosbDDYvmuQ3nhR9AGkasyXzylTTw05BhX0Ml7kf92ObF 8gyggIDXEYkkMsYr9+URXmng5nVr/XfUanzVFg1FVsKuSsGSSPLCRWcHSZnAuuNtlU5L 9MsgNhJVSy9T2qOXoSDFqfHa35cRHaPBAO8YN3oDSeHI0C0NrjQIiAs24t7YK7GOJ7Cr FIAoOq/JXnSnMeE91SzSSoszA2NgHKg/ENTAMmm5bHHsqsJu48Nc2OQg3PC9467K9Bc6 uxig== X-Gm-Message-State: AKwxyteJyNJXo7MGskP3m8oNrw1XsTBnW75NXDTRYA+ARqYOM9dYwZf0 6C2LnlDbJnYqv7DCG42m86eLv9nkddElWiFBI2TefQ== X-Received: by 10.36.177.5 with SMTP id o5mt3171388itf.50.1515292848037; Sat, 06 Jan 2018 18:40:48 -0800 (PST) MIME-Version: 1.0 Received: by 10.79.157.200 with HTTP; Sat, 6 Jan 2018 18:40:47 -0800 (PST) In-Reply-To: References: <20171116142843.GA25563@mithlond.kdm.org> From: Lee Brown Date: Sat, 6 Jan 2018 18:40:47 -0800 Message-ID: Subject: Re: Does anybody have experience with a MD1420, mpr(4) Cc: freebsd-scsi@freebsd.org, freebsd-hardware@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.25 X-BeenThere: freebsd-hardware@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: General discussion of FreeBSD hardware List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 07 Jan 2018 02:40:49 -0000 On Thu, Nov 16, 2017 at 10:43 AM, Lee Brown wrote: > > > On Thu, Nov 16, 2017 at 6:28 AM, Kenneth D. Merry wrote: > >> On Wed, Nov 15, 2017 at 12:24:47 -0800, Lee Brown wrote: >> > Hi, >> > >> > This is my for foray into DAS, so please be gentle :) Apologies if the >> > cross-post is inappropriate, let me know. >> > >> > I'm looking to build a SAS array with a Dell MD1420. It will be >> attached >> > via a SAS 9300-414E HBA in a Dell R330. >> > >> > I've verified that the server / SAS card should be fine, but just >> wanted to >> > know if anybody has set this up before, or if there's any obvious reason >> > why it wouldn't work. Dell can be a bit weird sometimes. >> > >> > Any information is most welcome. >> >> In theory it should be fine. I haven't used a Dell enclosure recently, >> but >> from posts here, it seems that they like to turn on Type 2 Protection >> Information on the drives. (Assuming you buy the drives from Dell.) >> >> If they do that, you can either reformat, or see the patch here for the >> mpr(4) driver to disable using protection information: >> >> https://docs.freebsd.org/cgi/getmsg.cgi?fetch=308820+0+archi >> ve/2017/freebsd-scsi/20171022.freebsd-scsi >> >> I haven't gotten around to changing things so that we detect the PI in the >> da(4) driver and use 32 byte CDBs when type 2 protection is enabled. (So >> if someone else has time and wants to do it, feel free. It will be >> somewhat messy because we only allocate enough space for 16 byte CDBs >> inside >> the CCB, so you'll need to allocate the CDB separately...) >> >> If you use ZFS, you'll have checksum protection on your data anyway, so PI >> would just be additional protection. >> >> I would also suggest that you update to the latest firmware (currently >> Phase 15) for the SAS controller. You can do that with LSI's sas3flash or >> the FreeBSD mprutil(8) utility. >> >> Ken >> -- >> Kenneth Merry >> ken@FreeBSD.ORG >> > Thanks Ken, > > I'm going to purchase the system. I had no idea about PI, that's a nice > feature for sure. > > This will probably just be iSCSI and NFS4 over a 10Gb NIC (Xen cluster), > so having PI detection is certainly of interest to me. I'll figure out > what I can do to contribute (code/testing) when things have settled. > > Assuming all is well I'll get the 1420 added to the hardware compatibility > list. > > Much appreciated -- lee > Following up, I have the MD1420 installed and attached. The kernel patch works as expected, errors with the flag set to zero, no errors when set to 1. First problem I am having is saving firmware from the card to local storage: root@svr-nas-rl:~ # mprutil flash save firmware mprutil: Fail to save firmware Second problem is performance, 20MB/s sequential write to a single spindle, 200MB/s read. I was expecting at least 100MB/s for the write, maybe my expectations were wrong? root@svr-nas-rl:~ # cp /dev/zero /dev/da0 dT: 1.058s w: 1.000s L(q) ops/s r/s kBps ms/r w/s kBps ms/w %busy Name 1 158 0 0 0.0 158 20206 6.3 99.8| da0 root@svr-nas-rl:~ # cp /dev/da0 /dev/null dT: 1.001s w: 1.000s L(q) ops/s r/s kBps ms/r w/s kBps ms/w %busy Name 1 1587 1587 203171 0.6 0 0 0.0 99.4| da0 root@svr-nas-rl:~ # mprutil show adapter mpr0 Adapter: Board Name: SAS9300-4i4e Board Assembly: H3-25515-00G Chip Name: LSISAS3008 Chip Revision: ALL BIOS Revision: 6.00.00.00 Firmware Revision: 5.00.00.00 Integrated RAID: no root@svr-nas-rl:~ # geom disk list da0 Geom name: da0 Providers: 1. Name: da0 Mediasize: 300000000000 (279G) Sectorsize: 512 Mode: r0w0e0 descr: SEAGATE ST300MM0078 lunid: 5000c500a0f3f977 ident: W0K1BE3R rotationrate: 10000 fwsectors: 63 fwheads: 255