From owner-freebsd-questions@FreeBSD.ORG Fri Nov 20 17:49:18 2009 Return-Path: Delivered-To: questions@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id A09251065670 for ; Fri, 20 Nov 2009 17:49:18 +0000 (UTC) (envelope-from mwlucas@bewilderbeast.blackhelicopters.org) Received: from bewilderbeast.blackhelicopters.org (bewilderbeast.blackhelicopters.org [198.22.63.8]) by mx1.freebsd.org (Postfix) with ESMTP id 3C1088FC0C for ; Fri, 20 Nov 2009 17:49:17 +0000 (UTC) Received: from bewilderbeast.blackhelicopters.org (localhost [127.0.0.1]) by bewilderbeast.blackhelicopters.org (8.14.3/8.14.3) with ESMTP id nAKHnHW3092910; Fri, 20 Nov 2009 12:49:17 -0500 (EST) (envelope-from mwlucas@bewilderbeast.blackhelicopters.org) Received: (from mwlucas@localhost) by bewilderbeast.blackhelicopters.org (8.14.3/8.14.3/Submit) id nAKHnGAw092909; Fri, 20 Nov 2009 12:49:16 -0500 (EST) (envelope-from mwlucas) Date: Fri, 20 Nov 2009 12:49:16 -0500 From: "Michael W. Lucas" To: Mel Flynn Message-ID: <20091120174916.GA92713@bewilderbeast.blackhelicopters.org> References: <20091119211829.GA86841@bewilderbeast.blackhelicopters.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.4.2.3i X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.2.2 (bewilderbeast.blackhelicopters.org [127.0.0.1]); Fri, 20 Nov 2009 12:49:17 -0500 (EST) Cc: questions@freebsd.org Subject: Re: diskless problem: Lookup of /dev for devfs, error: 13 X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 20 Nov 2009 17:49:18 -0000 On Fri, Nov 20, 2009 at 02:20:54AM -0900, Mel Flynn wrote: > On Thu, 19 Nov 2009 16:18:29 -0500, "Michael W. Lucas" > wrote: > > Hi, > > > > I'm attempting to run a diskless 8.0 i386 workstation on VMWare, using > > an OpenSolaris box as a file store. I get PXE, the kernel loads, but > > when we try to remount the filesystem I get: > > > > ... > > NFS ROOT: XXX.XXX.XXX.XXX:/storage1/vm/netflow > > Lookup of /dev for devfs, error 13 > > exec /sbin/init: error 13 > > exec /sbin/oinit: error 13 > > exec /sbin/init.bak: error 13 > > exec /rescue/inet: error 13 > > exec /stand/sysinstall: error 13 > > init: not found in path > > ... > > > > At first glance, it would appear that /dev is missing. > > Actually, at first glance it would appear that the mount doesn't allow > execution. Interesting. (BTW, this is running on a GENERIC kernel, no firewall.) I did a packet capture on the OpenSolaris NFS server, and found that the kernel load and initial boot takes place over NFSv2. When the FreeBSD box tries to remount root, it sends a NFSv3 FSINFO request. The server returns NFS3ERR_STALE. It appears that that error is generated when the permissions to the mount are revoked... but we just mounted it seconds before? It turns out that there's a whole discussion thread on nfsv2 and v3 interoperability with diskless systems. See http://lists.freebsd.org/pipermail/freebsd-hackers/2008-January/022792.html for a sample message. Short answer: it seems that there are interoperability annoyances with diskless systems and assorted NFS servers. NFS mount options in /etc/fstab seem to be ignored, but you can set them in /boot/loader.conf. boot.nfsroot.options="nfsv2" made FreeBSD try a NFSv2 remout, and the system came up. Thanks for pointing out it seems to be a permissions error, I wouldn't have headed down this route without that. ==ml -- Michael W. Lucas mwlucas@BlackHelicopters.org http://www.MichaelWLucas.com/ Latest book: Cisco Routers for the Desperate, 2nd Edition http://www.CiscoRoutersForTheDesperate.com/