From owner-freebsd-fs@freebsd.org  Wed May 23 15:12:57 2018
Return-Path: <owner-freebsd-fs@freebsd.org>
Delivered-To: freebsd-fs@mailman.ysv.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
 by mailman.ysv.freebsd.org (Postfix) with ESMTP id 709DDEFFE85
 for <freebsd-fs@mailman.ysv.freebsd.org>; Wed, 23 May 2018 15:12:57 +0000 (UTC)
 (envelope-from arcade@b1t.name)
Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org
 [IPv6:2001:1900:2254:206a::50:5])
 by mx1.freebsd.org (Postfix) with ESMTP id F38836F3AE
 for <freebsd-fs@freebsd.org>; Wed, 23 May 2018 15:12:56 +0000 (UTC)
 (envelope-from arcade@b1t.name)
Received: by mailman.ysv.freebsd.org (Postfix)
 id B2389EFFE84; Wed, 23 May 2018 15:12:56 +0000 (UTC)
Delivered-To: fs@mailman.ysv.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
 by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9F898EFFE83
 for <fs@mailman.ysv.freebsd.org>; Wed, 23 May 2018 15:12:56 +0000 (UTC)
 (envelope-from arcade@b1t.name)
Received: from limbo.b1t.name (limbo.b1t.name [178.218.68.68])
 (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
 (Client did not present a certificate)
 by mx1.freebsd.org (Postfix) with ESMTPS id 273626F3AD
 for <fs@freebsd.org>; Wed, 23 May 2018 15:12:55 +0000 (UTC)
 (envelope-from arcade@b1t.name)
Received: from [172.29.1.147] (probe.42.lan [172.29.1.147])
 by limbo.b1t.name (Postfix) with ESMTPSA id 4F684EB
 for <fs@freebsd.org>; Wed, 23 May 2018 18:06:16 +0300 (EEST)
From: Volodymyr Kostyrko <arcade@b1t.name>
Subject: zfs fails to boot up with error 22
To: "freebsd-fs@freebsd.org" <fs@freebsd.org>
Message-ID: <0d61aa2a-a7bc-4ede-8dde-c0adaba257d8@b1t.name>
Date: Wed, 23 May 2018 18:06:15 +0300
User-Agent: Mozilla/5.0 (X11; DragonFly x86_64; rv:52.0) Gecko/20100101
 Thunderbird/52.7.0
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Language: en-US
Content-Transfer-Encoding: 7bit
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=b1t.name; s=dkim;
 t=1527087977; bh=SbUciBW0ybe2Xv2XUva7zlYRs83WtV0mU2QPvXgMi4U=;
 h=From:Subject:To:Message-ID:Date:MIME-Version:Content-Type:Content-Transfer-Encoding;
 b=YmbIFekHEP0KmzTX4C0W3yrOadoaEO1eImessLObmiDu1hP9mRDu4pRjuaQK5Dv7f4aYpglSuPjqhYRldLpqNIsevOJ1iRWsHlYXHAErSeaU3KoeZU4XF3/L3Q5/sPeo65QdU7xZe7H54MyQWz75/t+tkkfGgmMQIVH9dJ8ATvQ=
X-BeenThere: freebsd-fs@freebsd.org
X-Mailman-Version: 2.1.26
Precedence: list
List-Id: Filesystems <freebsd-fs.freebsd.org>
List-Unsubscribe: <https://lists.freebsd.org/mailman/options/freebsd-fs>,
 <mailto:freebsd-fs-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-fs/>
List-Post: <mailto:freebsd-fs@freebsd.org>
List-Help: <mailto:freebsd-fs-request@freebsd.org?subject=help>
List-Subscribe: <https://lists.freebsd.org/mailman/listinfo/freebsd-fs>,
 <mailto:freebsd-fs-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Wed, 23 May 2018 15:12:57 -0000

Hello.

Just pushed updates to one of dev servers and found out it's unable to 
boot right now. During boot situation resembles what was shown 
previously at:

https://lists.freebsd.org/pipermail/freebsd-fs/2013-September/018246.html

1. Gmirror grabs partitions for two devices (swap/boot)
2. ZFS fails to mount root with error 22.
3. random: unblocking device
4. ZFS retries mount and fails again, exits to debug prompt.

Setting vfs.mountroot.timeout to 300 just makes kernel output another 
error each ~12 seconds. There is a problem with a code, it decreases 
value by one second for each full timeout period.

https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=208882

^^^ Here's where I got those tunables.

My kernel configuration is rather minimal and is very close to MINIMAL. 
Removing geom_mirror fixes the problem. Starting geom_mirror later works 
without any issues.

Machine has UFS root due to rather nasty Cisco firmware that only allows 
one single device to be available during boot.

-- 
Sphinx of black quartz judge my vow.