From owner-freebsd-questions@FreeBSD.ORG Mon May 18 17:05:02 2009 Return-Path: Delivered-To: freebsd-questions@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 01FD710656C0; Mon, 18 May 2009 17:05:01 +0000 (UTC) (envelope-from achill@matrix.gatewaynet.com) Received: from panix.internal.net (cpe-77-83-190-59-dsl.netone.gr [77.83.190.59]) by mx1.freebsd.org (Postfix) with ESMTP id 39DA48FC0A; Mon, 18 May 2009 17:05:00 +0000 (UTC) (envelope-from achill@matrix.gatewaynet.com) Received: from panix.internal.net (localhost [127.0.0.1]) by panix.internal.net (8.14.3/8.14.3) with ESMTP id n4I7KMmj001368; Mon, 18 May 2009 10:20:22 +0300 (EEST) (envelope-from achill@matrix.gatewaynet.com) Received: by panix.internal.net (8.14.3/8.14.3/Submit) id n4I7KLhM001366; Mon, 18 May 2009 10:20:21 +0300 (EEST) (envelope-from achill@matrix.gatewaynet.com) X-Authentication-Warning: panix.internal.net: achix set sender to achill@matrix.gatewaynet.com using -f From: Achilleas Mantzios Organization: Dynacom Tankers Mgmt To: freebsd-geom@freebsd.org, freebsd-questions@freebsd.org Date: Mon, 18 May 2009 10:20:20 +0300 User-Agent: KMail/1.9.7 MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200905181020.20621.achill@matrix.gatewaynet.com> Cc: Subject: Weird problem with gmirror - cannot add the Good disk when previously failed SATA disk is online X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 May 2009 17:05:08 -0000 Hello, I run 7.1-PRERELEASE, its a home server. today morning after a power failure, the rebuild my root gm0 failed on disk ad4. The messages were: May 18 08:02:02 panix kernel: ad4: WARNING - WRITE_DMA UDMA ICRC error (retrying request) LBA=268091264 May 18 08:02:08 panix kernel: drm0: on vgapci0 May 18 08:02:08 panix kernel: info: [drm] AGP at 0xf0000000 128MB May 18 08:02:08 panix kernel: info: [drm] Initialized i915 1.5.0 20060119 May 18 08:02:08 panix kernel: drm0: [ITHREAD] May 18 08:02:08 panix kernel: ad4: FAILURE - device detached May 18 08:02:08 panix kernel: subdisk4: detached May 18 08:02:08 panix kernel: ad4: detached May 18 08:02:08 panix kernel: GEOM_MIRROR: Device gm0: provider ad4 disconnected. May 18 08:02:08 panix kernel: GEOM_MIRROR: Device gm0: rebuilding provider ad4 stopped. I read http://www.eztiger.org/2008/08/removing-and-re-adding-a-disk-in-gmirror/ hoping that the rebuld failure was temprary and so i tried to just run # gmirror forget gm0 # gmirror insert gm0 ad4 But the system responded (if i remember correctly) Unknown provider ad4. The system no longer could see ad4 being online. So i rebooted the system many times and had these results: -When having put offline ad4 (disconnected by hardware), the system booted ok. -When having both disks online the system responded consistently with: "GEOM_MIRROR: Cannot add disk ad6 to gm0 (error=22)." Which IMO is not very ok, since gm0 should add ad6 without problem, no matter if ad4 is online or not. -When having only ad4 online, then it simply cannot find gm0 at all. (kind of reasonable) So my only option is to have only ad6 online, with a current gmirror status: panix# gmirror status Name Status Components mirror/gm0 COMPLETE ad6 Anyone has an idea of how should i proceed (besides buying a UPS unit!) Is it meaningfull to go for a new Disk to replace current ad4? Why is the presence of the supposed bad disk ad4, affecting gm0, when having already told gm0 to forget about ad4? Thanx for any suggestions. -- Achilleas Mantzios