From owner-freebsd-stable@FreeBSD.ORG Fri Jan 6 22:15:53 2012 Return-Path: Delivered-To: stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 3C2DF106566C for ; Fri, 6 Jan 2012 22:15:53 +0000 (UTC) (envelope-from spawk@acm.poly.edu) Received: from acm.poly.edu (acm.poly.edu [128.238.9.200]) by mx1.freebsd.org (Postfix) with ESMTP id D16FF8FC17 for ; Fri, 6 Jan 2012 22:15:52 +0000 (UTC) Received: (qmail 45784 invoked from network); 6 Jan 2012 21:49:11 -0000 Received: from unknown (HELO ?10.50.50.212?) (spawk@64.147.100.2) by acm.poly.edu with CAMELLIA256-SHA encrypted SMTP; 6 Jan 2012 21:49:11 -0000 Message-ID: <4F076C62.6060604@acm.poly.edu> Date: Fri, 06 Jan 2012 16:49:22 -0500 From: Boris Kochergin User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:9.0) Gecko/20111222 Thunderbird/9.0 MIME-Version: 1.0 To: Gareth de Vaux References: <20120104194313.GA2558@lordcow.org> In-Reply-To: <20120104194313.GA2558@lordcow.org> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: stable@freebsd.org Subject: Re: gmirror not synced X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 06 Jan 2012 22:15:53 -0000 On 01/04/12 14:43, Gareth de Vaux wrote: > Hi all, I've noticed that the md5 hashes of a couple of files on > a gmirror change when I recalculate the hashes. The output usually > cycles between 2 hashes per file. > > I'm guessing this is because each calculation reads the file > randomly from 1 of 2 component drives, and the files in question > had a few bit flips during their original sync. I also assume > this's something you have to live with for gmirror? Is removing > and completely rebuilding the secondary drive the only thing you > can do (which might fix these bit flips but incur others elsewhere)? > _______________________________________________ > freebsd-stable@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" Hi. Bit-flipping is unlikely, but, you can test this hypothesis by having it only ever read from one disk. Use "gmirror configure -b" to change the balancing algorithm of the array to priority and "gmirror configure -p" to change the priority one of of the members. Then, repeat the test for the other member. What I would say is more likely is that you've got bad memory or CPU cache in the machine. I've had this happen to me and that turned out to be the case. And, as the other reply said, it's a good idea to make sure you've got a good backup at this point. -Boris