From owner-freebsd-stable@FreeBSD.ORG Mon Jan 23 20:32:31 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 8C6E6106564A for ; Mon, 23 Jan 2012 20:32:31 +0000 (UTC) (envelope-from olivier@gid0.org) Received: from mail-qy0-f182.google.com (mail-qy0-f182.google.com [209.85.216.182]) by mx1.freebsd.org (Postfix) with ESMTP id 4C1138FC12 for ; Mon, 23 Jan 2012 20:32:30 +0000 (UTC) Received: by qcse1 with SMTP id e1so2382863qcs.13 for ; Mon, 23 Jan 2012 12:32:30 -0800 (PST) MIME-Version: 1.0 Received: by 10.229.134.197 with SMTP id k5mr3261474qct.58.1327349439638; Mon, 23 Jan 2012 12:10:39 -0800 (PST) Received: by 10.229.217.207 with HTTP; Mon, 23 Jan 2012 12:10:39 -0800 (PST) In-Reply-To: <4F1DBA47.8080504@infracaninophile.co.uk> References: <520B9285BCC0498286196195933D67E9@multiplay.co.uk> <4F1DA991.1060601@infracaninophile.co.uk> <7F1E17105173440B8C52DB9AAFA7A400@multiplay.co.uk> <4F1DBA47.8080504@infracaninophile.co.uk> Date: Mon, 23 Jan 2012 21:10:39 +0100 Message-ID: From: Olivier Smedts To: Matthew Seaman X-Gm-Message-State: ALoCoQkUrIQatXWn71zMgVPcYDLiAu5qkZSyTMMLQQ6Oe9BLtCsfytnkPg7CgfkcmxP2pMIFt7/P Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: "freebsd-stable@freebsd.org" , Steven Hartland Subject: Re: ZFS: i/o error - all block copies unavailable on large disk number machines X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 23 Jan 2012 20:32:31 -0000 Le lundi 23 janvier 2012, Matthew Seaman a =E9crit : > On 23/01/2012 19:29, Steven Hartland wrote: >> Initially the zpool was just the first raidz2. Only after install >> was the second raidz2 added to increase capacity. >> >> So what I believe has happened is the new kernel when installed >> happens to have data be located on the second raidz2 which >> consists of disks not available to the BIOS and hence results in >> "all block copies unavailable" from the boot code. > > Exactly what happened to me. You can run into this in a nasty way -- > insert the drives, and expand the zpool on-line, and everything will > carry on quite happily. Until you next reboot, when it just won't come > back. And you can't undo the expansion of the pool: due to the > copy-on-write behaviour of ZFS even overwriting a file in-place stands a > 50% chance of being written to the new vdev. > > In my case, I fixed it by having a separate /boot on some USB sticks -- > this was only ever accessed to read the kernel, kernel modules and > bootloader at boot time, so no worries over performance. Have you tried using a separate /boot on a zfs with copies=3D2 (or the numb= er of vdevs composing the pool) ? > Cheers, > > Matthew > > -- > Dr Matthew J Seaman MA, D.Phil. 7 Priory Courtyard > Flat 3 > PGP: http://www.infracaninophile.co.uk/pgpkey Ramsgate > JID: matthew@infracaninophile.co.uk Kent, CT11 9PW > > --=20 Olivier Smedts _ ASCII ribbon campaign ( ) e-mail: olivier@gid0.org - against HTML email & vCards X www: http://www.gid0.org - against proprietary attachments / \ "Il y a seulement 10 sortes de gens dans le monde : ceux qui comprennent le binaire, et ceux qui ne le comprennent pas."