From owner-freebsd-questions@FreeBSD.ORG Mon Mar 19 16:19:40 2007 Return-Path: X-Original-To: questions@freebsd.org Delivered-To: freebsd-questions@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id C3B8716A406 for ; Mon, 19 Mar 2007 16:19:40 +0000 (UTC) (envelope-from bahamasfranks@gmail.com) Received: from mu-out-0910.google.com (mu-out-0910.google.com [209.85.134.187]) by mx1.freebsd.org (Postfix) with ESMTP id 4314013C595 for ; Mon, 19 Mar 2007 16:19:39 +0000 (UTC) (envelope-from bahamasfranks@gmail.com) Received: by mu-out-0910.google.com with SMTP id g7so1839822muf for ; Mon, 19 Mar 2007 09:19:38 -0700 (PDT) DKIM-Signature: a=rsa-sha1; c=relaxed/relaxed; d=gmail.com; s=beta; h=domainkey-signature:received:received:message-id:date:from:sender:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references:x-google-sender-auth; b=gHAAV+wZfKyOaGltqliP7r1jYAp/zWYmf/8dsA2zAOuuROqlFSySaHg8zYKAFljDbt4/9Xpsz6fiX3KmW097JiC9nI0xY6Km0ng7rOeejW5RFcpiEwSJGZ+13FztkVrns5yqUkQrEUhws0vCXd+kUM5WvgUU2BmS/D4j4JP0aVc= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:message-id:date:from:sender:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references:x-google-sender-auth; b=sQ3wL8PQVT5GF7gxETKSg0HoPhksEzx1VJwj7nv5/lCCeBmhPv0YuTz4NmqymmJXffNhMeirG0JDa4Jv2pqtM9t/5voPPHanw5jlUlhQp1BqjrcY4NJ1OVfb5GOflBYUXVJ99xs2eNGVj0Fc63ZgEdHE51SALro3BpmBJHjVxH8= Received: by 10.82.163.13 with SMTP id l13mr10349085bue.1174319535774; Mon, 19 Mar 2007 08:52:15 -0700 (PDT) Received: by 10.82.175.3 with HTTP; Mon, 19 Mar 2007 08:52:15 -0700 (PDT) Message-ID: <539c60b90703190852s70e2170di49b92de4a41b8e4f@mail.gmail.com> Date: Mon, 19 Mar 2007 08:52:15 -0700 From: "Steve Franks" Sender: bahamasfranks@gmail.com To: "Toomas Aas" In-Reply-To: <45FDAA18.1080203@raad.tartu.ee> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <45BFB6A1.9080200@raad.tartu.ee> <45FDAA18.1080203@raad.tartu.ee> X-Google-Sender-Auth: b35b8c523d50d660 Cc: questions@freebsd.org Subject: Re: Converting from ata-raid to gmirror X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Mar 2007 16:19:41 -0000 On 3/18/07, Toomas Aas wrote: > On January 30th, I wrote: > > > I'm currently running FreeBSD 6.2-RELEASE (amd64) on a system based on > > Intel SE7230NH1-E motherboard, which has Intel ICH7R integrated > > softraid. The machine has two 500 GB drives which are configured as > > RAID1 in BIOS. Unfortunately, this setup seems to have some stability > > issues which I can't figure out how to solve. Specifically, when the > > storage subsystem is put under heavy load (such as doing nightly > > backups) the kernel starts spitting out horrible error messages such as: > > > > FAILURE - out of memory in ata_raid_init_request > > g_vfs_done():ar0s1f[WRITE(offset=8091172864, length=16384)]error = 5 > > FAIg_vfs_done():ar0LURE - out of memsory in ata_raid_1init_reqfu[eWsRItTE(o > > ffset=8091F1A8I9LU2R4E8 ,- oleuntg tohf= 16m3e8m4o)ry]e rirno ra t=a 5 > > _raid_init_requestg > > vfs_done():ar0s1f[WRITE(offsFAeItL=UR8E0 9-1 2o05u6t3 2o,f > > lmeengmtoh=ry1 6i3n8 4a)t]ae_rrraoird _=in i5t > > > > If it looks like garbage, then yes, this is how it appears in > > /var/log/messages. I'm seriously afraid that similar corruption is > > sneaking into important user files. > > > > Only thing I can think of is converting this setup from BIOS-based RAID > > to gmirror. This would involve, I think, modifying /etc/fstab so that it > > references ad4 instead of ar0, then permanently breaking the mirror in > > BIOS, booting up the system with single disk and then basically > > following the gmirror chapter in the handbook. Correct? > > > > I'm also a little uncertain about "permanently breaking the mirror" > > part. I've read all the motherboard and LSI docs I can find and this > > topic isn't covered anywhere. > > Well, finally I could summon up enough courage to perform this procedure > on a production server (such as it is). To break the mirror, I just went > to motherboard BIOS (not the BIOS-based RAID utility) and changed the > 'Configure SATA as' setting from 'RAID' to 'IDE'. Generally everything > seems to have gone OK. The system now runs from /dev/mirror/gm0, which > consists of ad4 and ad6. However, the kernel still sees the old ar0 > array and complains that it's broken. Do I care, or should I just remove > 'device ataraid' from kernel configuration? > > kernel: ar0: WARNING - mirror protection lost. RAID1 array in DEGRADED mode > kernel: ar0: 476772MB status: DEGRADED > kernel: ar0: disk0 READY (master) using ad4 at ata2-master > kernel: ar0: disk1 DOWN no device found for this subdisk > > -- > Toomas > _______________________________________________ > freebsd-questions@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-questions > To unsubscribe, send any mail to "freebsd-questions-unsubscribe@freebsd.org" > I'm just getting into this myself as well, but from previous people who've helped me, I've come to understand that most motherboard 'raid' controllers are not tru hardware raid, just a fancy wrapper around software raid, and they do pretty much exactly the same thing as gmirror - write a special metadata tag near the end of the disk with the info on the mirror. This is what ataraid sees that causes it to find 'ar0' - delete that metadata from the disk, and ar0 will go away. Possibly there is an extra slice with a couple of blocks at the end of the disk? That's about the extent of my knowledge... Steve