From owner-freebsd-scsi@FreeBSD.ORG Sun Sep 26 00:02:04 2010 Return-Path: Delivered-To: freebsd-scsi@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 3AF5C1065670 for ; Sun, 26 Sep 2010 00:02:04 +0000 (UTC) (envelope-from scottl@samsco.org) Received: from pooker.samsco.org (pooker.samsco.org [168.103.85.57]) by mx1.freebsd.org (Postfix) with ESMTP id D5D1B8FC12 for ; Sun, 26 Sep 2010 00:02:03 +0000 (UTC) Received: from [127.0.0.1] (pooker.samsco.org [168.103.85.57]) (authenticated bits=0) by pooker.samsco.org (8.14.4/8.14.4) with ESMTP id o8PNPopr096282; Sat, 25 Sep 2010 17:25:51 -0600 (MDT) (envelope-from scottl@samsco.org) Mime-Version: 1.0 (Apple Message framework v1081) Content-Type: text/plain; charset=iso-8859-1 From: Scott Long In-Reply-To: <86aan67obp.fsf@ds4.des.no> Date: Sat, 25 Sep 2010 17:25:50 -0600 Content-Transfer-Encoding: quoted-printable Message-Id: References: <2EA9CBBC-3F97-4AF2-BFB5-96DF39FDE376@saers.com> <86aan67obp.fsf@ds4.des.no> To: =?iso-8859-1?Q?Dag-Erling_Sm=F8rgrav?= X-Mailer: Apple Mail (2.1081) X-Spam-Status: No, score=-50.0 required=3.8 tests=ALL_TRUSTED, T_RP_MATCHES_RCVD autolearn=unavailable version=3.3.0 X-Spam-Checker-Version: SpamAssassin 3.3.0 (2010-01-18) on pooker.samsco.org Cc: freebsd-scsi@freebsd.org, Niklas Saers Subject: Re: mfi - setting up disks X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 26 Sep 2010 00:02:04 -0000 On Sep 24, 2010, at 4:45 PM, Dag-Erling Sm=F8rgrav wrote: > Niklas Saers writes: >> In the SuperMicro system where I had problems with the mpt = controller, >> I switched it for a mfi-based controller. I had it set up with 36x >> RAID0 volumes with each their own disk (no way to access the disk >> otherwise I found), and added them to a ZFS system. The numbering >> became a bit weird, so I pulled the disks out one by one and put them >> back to figure out and note down what disk number was in what >> slot. Only test data on my ZFS volume, so I didn't mind that = crashing. >=20 > You can wire down SCSI buses and disks in /boot/device.hints so each > disk always gets the same device number regardless of the order in = which > the disks spin up. The syntax is documented in /sys/conf/NOTES = (search > for "SCSI DEVICE CONFIGURATION"). It's a CAM feature, and mfi uses = CAM, MFI only uses CAM for passthrough access to component drives, not for = normal I/O. Setting CAM wiring hints will not solve the problem at = hand. And the problem at hand isn't really even numbering, it's that = the MFI firmware freaked out and marked the disks inaccessible. I think = that this happened to us at Yahoo once, and we eventually gave up and = replaced the disks. Putting the disks on a non-LSI, non-RAID controller = and writing 0's to the last 10MB worth of sectors (or just writing 0's = to the entire drive) will likely solve the problem, but YMMV. Scott