From owner-freebsd-virtualization@FreeBSD.ORG Mon Jan 6 11:06:57 2014 Return-Path: Delivered-To: freebsd-virtualization@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 181FC790 for ; Mon, 6 Jan 2014 11:06:57 +0000 (UTC) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:1900:2254:206c::16:87]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 02AFC10A0 for ; Mon, 6 Jan 2014 11:06:57 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.7/8.14.7) with ESMTP id s06B6uOo045430 for ; Mon, 6 Jan 2014 11:06:56 GMT (envelope-from owner-bugmaster@FreeBSD.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.7/8.14.7/Submit) id s06B6uId045428 for freebsd-virtualization@FreeBSD.org; Mon, 6 Jan 2014 11:06:56 GMT (envelope-from owner-bugmaster@FreeBSD.org) Date: Mon, 6 Jan 2014 11:06:56 GMT Message-Id: <201401061106.s06B6uId045428@freefall.freebsd.org> X-Authentication-Warning: freefall.freebsd.org: gnats set sender to owner-bugmaster@FreeBSD.org using -f From: FreeBSD bugmaster To: freebsd-virtualization@FreeBSD.org Subject: Current problem reports assigned to freebsd-virtualization@FreeBSD.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 06 Jan 2014 11:06:57 -0000 Note: to view an individual PR, use: http://www.freebsd.org/cgi/query-pr.cgi?pr=(number). The following is a listing of current problems submitted by FreeBSD users. These represent problem reports covering all versions including experimental development code and obsolete releases. S Tracker Resp. Description -------------------------------------------------------------------------------- o kern/165252 virtualization[vimage] [pf] [panic] kernel panics with VIMAGE and PF o kern/161094 virtualization[vimage] [pf] [panic] kernel panic with pf + VIMAGE wh o kern/160541 virtualization[vimage][pf][patch] panic: userret: Returning on td 0x o kern/160496 virtualization[vimage] [pf] [patch] kernel panic with pf + VIMAGE o kern/148155 virtualization[vimage] [pf] Kernel panic with PF + VIMAGE kernel opt a kern/147950 virtualization[vimage] [carp] VIMAGE + CARP = kernel crash s kern/143808 virtualization[pf] pf does not work inside jail 7 problems total. From owner-freebsd-virtualization@FreeBSD.ORG Mon Jan 6 22:56:34 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 13210B42; Mon, 6 Jan 2014 22:56:34 +0000 (UTC) Received: from mail-lb0-x22d.google.com (mail-lb0-x22d.google.com [IPv6:2a00:1450:4010:c04::22d]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 631EF12EF; Mon, 6 Jan 2014 22:56:33 +0000 (UTC) Received: by mail-lb0-f173.google.com with SMTP id z5so10261633lbh.4 for ; Mon, 06 Jan 2014 14:56:31 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:date:message-id:subject:from:to:cc:content-type; bh=03l3EQVNwY0X8FYGIH2ASipGpBtUDhzhPkerZLnaulw=; b=buHOYfhG3xAMS1NKZEmCTBkgaX4mwPJnvvFwklIhl9K93jNj4MZ6Kdd6lCuoqoaeyj p0ciNBnoy/GAh4AHtzhW1HQ0lCdrqNsNczR0MJDWPtlSIzbWa0moVB2nNusuzAUiGzCz O2jW7HNzKKyWUo/7EApnZXoMWmfQCsxIj2dytmV97AA1un58SeMfRKSTJQv09FxT6QuV c1g7orZqvMi9Ol9aftRGI98hp+0K6JHxCearHNFivFdkzbFiA5Uh+0WLMIkTj/dGMDfh QuDfj6lUG4lDFFRzSZE5x6cP7cQlX+az15nMhaW8vOA/SmzyC/+WWiS3wX4niGZfZ360 ZMsw== MIME-Version: 1.0 X-Received: by 10.112.143.163 with SMTP id sf3mr42831428lbb.20.1389048991470; Mon, 06 Jan 2014 14:56:31 -0800 (PST) Sender: crodr001@gmail.com Received: by 10.112.38.43 with HTTP; Mon, 6 Jan 2014 14:56:31 -0800 (PST) Date: Mon, 6 Jan 2014 14:56:31 -0800 X-Google-Sender-Auth: idIHN6crbU5TVdNACxdzW3VE7CI Message-ID: Subject: Remote serial console for BHyve VM? From: Craig Rodrigues To: "freebsd-virtualization@freebsd.org" Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.17 Cc: Peter Wemm X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 06 Jan 2014 22:56:34 -0000 Hi, I am working with Sean Bruno to set up some BHyve VM's. Right now, the vmrun.sh script tells BHyve to direct the serial console to stdout. If I want to have the VM's start via an rc.d script, and have the VM be headless, what is the best way to have the VM console still be accessible? Has anyone done something like use netcat to direct the BHyve stdio to a socket? That way the serial console could be accessed remotely via telnet or ssh. Is there a better way to do this? -- Craig From owner-freebsd-virtualization@FreeBSD.ORG Mon Jan 6 23:12:22 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 56FA7E06; Mon, 6 Jan 2014 23:12:22 +0000 (UTC) Received: from alto.onthenet.com.au (alto.OntheNet.com.au [203.13.68.12]) by mx1.freebsd.org (Postfix) with ESMTP id 161AB14AD; Mon, 6 Jan 2014 23:12:21 +0000 (UTC) Received: from dommail.onthenet.com.au (dommail.OntheNet.com.au [203.13.70.57]) by alto.onthenet.com.au (Postfix) with ESMTPS id A5D19122B2; Tue, 7 Jan 2014 09:12:13 +1000 (EST) Received: from Peter-Grehans-MacBook-Pro-2.local ([64.245.0.210]) by dommail.onthenet.com.au (MOS 4.2.4-GA) with ESMTP id BRA66834 (AUTH peterg@ptree32.com.au); Tue, 7 Jan 2014 09:12:12 +1000 Message-ID: <52CB384A.7050405@freebsd.org> Date: Mon, 06 Jan 2014 15:12:10 -0800 From: Peter Grehan User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:24.0) Gecko/20100101 Thunderbird/24.2.0 MIME-Version: 1.0 To: Craig Rodrigues Subject: Re: Remote serial console for BHyve VM? References: In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: Peter Wemm , "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 06 Jan 2014 23:12:22 -0000 Hi Craig, > I am working with Sean Bruno to set up some BHyve VM's. Great ! > If I want to have the VM's start via an rc.d script, and > have the VM be headless, what is the best way to have > the VM console still be accessible? > > Has anyone done something like use netcat > to direct the BHyve stdio to a socket? > That way the serial console could be accessed remotely > via telnet or ssh. > > Is there a better way to do this? One way is to use the cloneable null-modem driver, nmdm(4). Others have used tmux for this, but I'll give a quick overview of the former. kldload nmdm.ko before starting VMs, e.g. at boottime or in rc.conf's kld_list variable. Use the '-c' option for bhyveload to point it at one end of an nmdm instance, and use it in place of "stdio" in the bhyve commandline. bhyveload .... -c /dev/nmdm0A ... bhyve ... -l com1,/dev/nmdm0A ... You can then attach to the other end (nmdm*B) with any tool of your choice - cu, screen, or socat to relay the device to a network connection. Some experimentation may be required :) later, Peter. From owner-freebsd-virtualization@FreeBSD.ORG Tue Jan 7 13:24:39 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id AE43863E; Tue, 7 Jan 2014 13:24:39 +0000 (UTC) Received: from mail.ijs.si (mail.ijs.si [IPv6:2001:1470:ff80::25]) by mx1.freebsd.org (Postfix) with ESMTP id 394441773; Tue, 7 Jan 2014 13:24:39 +0000 (UTC) Received: from amavis-proxy-ori.ijs.si (localhost [IPv6:::1]) by mail.ijs.si (Postfix) with ESMTP id 3dzDpF5m0BzGMnD; Tue, 7 Jan 2014 14:24:37 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=ijs.si; h= user-agent:message-id:references:in-reply-to:organization :subject:subject:from:from:date:date:content-transfer-encoding :content-type:content-type:mime-version:received:received :received:received; s=jakla2; t=1389101072; x=1391693073; bh=NpN yhc32++ITh99bAm0vjXkAsYyBZToVmTkT3Ro9IeM=; b=LA50GyXOhQQXFvCNHRE i4hjo852hu6GYtyDfQafpXjUIIsXyDx2oqnxxc/UeyYb0eC/pIKHA7S/v3Z6VZEt EcmTtF17OvwNApLTHH5uL6QJ8CUhAvbLOAICSG6wIEO2DPstzgv2LVAWuVzK094t XdBhUD3RhbKia8owjaHh8lM4= X-Virus-Scanned: amavisd-new at ijs.si Received: from mail.ijs.si ([IPv6:::1]) by amavis-proxy-ori.ijs.si (mail.ijs.si [IPv6:::1]) (amavisd-new, port 10012) with ESMTP id tXy9jHBNp34N; Tue, 7 Jan 2014 14:24:32 +0100 (CET) Received: from mildred.ijs.si (mailbox.ijs.si [IPv6:2001:1470:ff80::143:1]) by mail.ijs.si (Postfix) with ESMTP; Tue, 7 Jan 2014 14:24:32 +0100 (CET) Received: from neli.ijs.si (neli.ijs.si [193.2.4.95]) by mildred.ijs.si (Postfix) with ESMTP id DE0D5989; Tue, 7 Jan 2014 14:24:31 +0100 (CET) Received: from sleepy.ijs.si ([2001:1470:ff80:e001::1:1]) by neli.ijs.si with HTTP (HTTP/1.1 POST); Tue, 07 Jan 2014 14:24:31 +0100 MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Date: Tue, 07 Jan 2014 14:24:31 +0100 From: Mark Martinec To: Craig Rodrigues Subject: Re: Installer fails with "out of swap space" when installing ZFS-on-root with less then 4 GB mem (10.0-RC4) Organization: J. Stefan Institute In-Reply-To: References: <7a61b7a1f156dcf67b3ba44bca7dd906@mailbox.ijs.si> Message-ID: X-Sender: Mark.Martinec+freebsd@ijs.si User-Agent: Roundcube Webmail/0.9.5 Cc: crodr001@gmail.com, freebsd-stable@freebsd.org, freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 07 Jan 2014 13:24:39 -0000 > On Sun, Jan 5, 2014 at 5:27 PM, Mark Martinec wrote: >> I was playing with bhyve on 10.0-RC4, trying to install another >> 10.0-RC4 >> into a 16 GB ZFS volume using the network installation DVD. Mostly >> kept >> defaults, except that I chose a ZFS-on-root installation. The amd64 >> [guest] >> was given 1 GB of RAM on the first attempt, but failed. It fails on 2 >> GB RAM >> too, but succeeds when given 4 GB of RAM. 2014-01-06 22:13, Craig Rodrigues wrote: > How far did you get with this? If you use BHyve to boot FreeBSD, > the loader which is used is in /usr/src/sys/boot/userboot, and > this loader does not support a complete ZFS-only install. > I recently tried to do this, and the install worked (with 4G of RAM), > but when I tried to reboot the BHyve VM, the VM did not boot. You are right, I wasn't able to boot such newly-installed disk under bhyve. But I was able to verify that the installation was successful: copied the created zfs volume to another host (running 9.2), pointed a VirtualBox .vmdk disk description file to that zfs volume, and VirtualBox was able to successfully boot and run from such disk. So the installer running under bhyve did its job, successfully installed a root-on-zfs 10-RC4. > If you look at: https://admbugs.freebsd.org/show_bug.cgi?id=428#c7 > > you will see I had to use a variation of these steps: > https://wiki.freebsd.org/RootOnZFS/UFSBoot > > where the /boot directory which contained the kernel and loader was on > a > UFS partition, but everything else was on ZFS. That's the only way I > could get the BHyve VM to boot, with userboot. Thanks, useful link. I wish the bhyve would be able to boot off the freebsd-boot partition containing a gptzfsboot bootcode. Devin writes: >> - let the installer mount the available swap partitions before jumping >> into heavy installation work; > That sounds reasonable enough. Thanks for considering! >> - avoid covering an underlying failure with a quickly-redrawn >> installer >> menu; at least some delay after a failure but before erasing the >> screen >> would be useful, avoiding the user to go to great lengths to be able >> to >> capture the failure reason. > > While the error reporting could be improved in that area of bsdinstall > that > you fingered, the perception that the errors are quickly being erased > is > incorrect. What's actually going on is the errors are being shunted > over to > vty1 (Alt+F2) Under bhyve there is only a serial console currently, afict. > as well as /tmp/bsdinstall_log Didn't know that. Thanks for the useful information. > But granted... the error messages that are displayed on vty0 could > certainly > be improved (which will take time). Mark From owner-freebsd-virtualization@FreeBSD.ORG Thu Jan 9 15:50:18 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 4C876892 for ; Thu, 9 Jan 2014 15:50:18 +0000 (UTC) Received: from mail-ee0-x22b.google.com (mail-ee0-x22b.google.com [IPv6:2a00:1450:4013:c00::22b]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id DB5661238 for ; Thu, 9 Jan 2014 15:50:17 +0000 (UTC) Received: by mail-ee0-f43.google.com with SMTP id c13so1402720eek.16 for ; Thu, 09 Jan 2014 07:50:16 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=uThwugh0iWPDJ7pnoI4IeLSoInroQqX4QHwnpfI0EnQ=; b=QlH5oeTUww4to+kOc2PecNXCF4GdnWVS89fnplxsiAWdnk8RKia0rLLG4PQOhmwcxc f6UOteZB3z314p3J+I3mHUSOMcfuLz9/a1jiF55SHnfmz5ss8+uha3Xkz0f/q8pIL6SZ Ug8gCfuC3Mdg8+Zt/h24Do8XxdYrPj2E/tuYSZDLp+N4Mq8A96g3a4EQD5det8ZdWlDw /GfIMOoAdZwwNyhxiKt99H6ZiTnij0i410xWm4xMCtB7d38bRqkc+th3ljB16mm03D+B sd2S0EgSHJZmizf9qfOB7xr44i4+y6q25F5InFQHoo5zzXSqwXjhE3vqKfEizb8D7+j7 IwSQ== MIME-Version: 1.0 X-Received: by 10.14.119.136 with SMTP id n8mr4046439eeh.82.1389282616273; Thu, 09 Jan 2014 07:50:16 -0800 (PST) Received: by 10.14.138.197 with HTTP; Thu, 9 Jan 2014 07:50:16 -0800 (PST) Date: Thu, 9 Jan 2014 10:50:16 -0500 Message-ID: Subject: Virtio Driver From: Robert Simmons To: freebsd-virtualization@freebsd.org Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.17 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 09 Jan 2014 15:50:18 -0000 I've run into an interesting behavior regarding the virtio driver in FreeBSD 9.2-RELEASE with regards to running in a VM on OpenStack. When I attach a volume to the instance running FreeBSD, a device node does not appear in /dev until after a reboot. Is there a way to rescan manually? From owner-freebsd-virtualization@FreeBSD.ORG Fri Jan 10 01:23:07 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 4DE60EC1 for ; Fri, 10 Jan 2014 01:23:07 +0000 (UTC) Received: from mail-qa0-x232.google.com (mail-qa0-x232.google.com [IPv6:2607:f8b0:400d:c00::232]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 0361513CB for ; Fri, 10 Jan 2014 01:23:06 +0000 (UTC) Received: by mail-qa0-f50.google.com with SMTP id cm18so2268620qab.23 for ; Thu, 09 Jan 2014 17:23:06 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=lifeofadishwasher.com; s=google; h=date:from:to:subject:message-id:mime-version:content-type :content-disposition:user-agent; bh=3/NspsydO7KPn2YeMAqwtRdPet9mwLPtb4a+J3rZBcc=; b=ho140ia1UyyvMhEDt07KhsnhKR47q09U8rF6bHJ4H6JiW1LKjmGuxFZ6TR+l0RSNve eRrHReN/H7WjnsbR6e4jOFdT8pwV+tIZsutH0eB0S/1lrv6JZw4LVgUzJaRjTgQ9Rzqx 6JSpZEmhKM9/P7w5lzaS7jzfxGzoW35R7FlDA= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:date:from:to:subject:message-id:mime-version :content-type:content-disposition:user-agent; bh=3/NspsydO7KPn2YeMAqwtRdPet9mwLPtb4a+J3rZBcc=; b=beJCN6lhSBDjFxkKv1LSrG7PUl7w2AC8TvWGfwGurJXGuk1Hcv1VwU5A12MeHbgtKj Dlkb1SqowZ/d5ufijiJOzNFV0B+MpubN8pjrjkR3bjgsSDOFDVlgFaPwvk3LWWKDwKso jBPxG4CO5SmdiaCFVxQjKLfPSDreHsufkR7qZlDDtazsIoS8fIhj01GznNhE6LAiadER QdOoOCnrPqhe0nPXA6XUqSBTnocOXmVfXZbxA7XX6h7SvHMzK9ZfMfXCBdKMKXxyQwkl KO/mVcnTMCEG53d5pU1vCUcYnGPIeGL485IfQTgE1ex0wpKFYgreZZtDKLShSVG1FELD PzZw== X-Gm-Message-State: ALoCoQn9kC2BCx+BcEF8ul1s6KyaszFYvZFFHmvhncuz+t4iHYzjvDKq3WF/HXGeQ3diop9OOa05 X-Received: by 10.224.2.194 with SMTP id 2mr1567140qak.44.1389316986228; Thu, 09 Jan 2014 17:23:06 -0800 (PST) Received: from lifeofadishwasher.com (c-71-206-246-125.hsd1.pa.comcast.net. [71.206.246.125]) by mx.google.com with ESMTPSA id v3sm1428773qap.4.2014.01.09.17.23.04 for (version=TLSv1 cipher=RC4-SHA bits=128/128); Thu, 09 Jan 2014 17:23:05 -0800 (PST) Received: by lifeofadishwasher.com (sSMTP sendmail emulation); Thu, 09 Jan 2014 20:23:04 -0500 Date: Thu, 9 Jan 2014 20:23:04 -0500 From: Derek Schrock To: freebsd-virtualization@freebsd.org Subject: VirtualBox 4.2.20_2 FreeBSD 9.2-RELEASE host multi CPU VM poudriere crash Message-ID: <20140110012304.GC44486@ircbsd.lifeofadishwasher.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.5.22 (2013-10-16) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Jan 2014 01:23:07 -0000 Using VirtualBox 4.2.20_2 (emulators/virtualbox-ose) on a 9.2-RELEASE amd64 4 core (8 CPU with HT) host a FreeBSD 10.0-RC5 amd64 (also tested with 3 and 4) VM with 4 allocated CPUs will repeatedly crashes when I try to build a pkg repo with poudriere (ports-mgmt/poudriere) via the bulk command. >From the VM: root@freebsd10testing:~ # kldstat #VirtualBox additions loaded (tested with/without) Id Refs Address Size Name 1 9 0xffffffff80200000 15f0310 kernel 2 1 0xffffffff81a12000 22d50 vboxguest.ko 3 1 0xffffffff81a35000 543 vboxvideo.ko 4 1 0xffffffff81a36000 16d6c drm.ko root@freebsd10testing:~ # sysctl hw.ncpu hw.ncpu: 4 root@freebsd10testing:~ # uname -a FreeBSD freebsd10testing 10.0-RC5 FreeBSD 10.0-RC5 #0 r260430: Wed Jan 8 05:10:04 UTC 2014 root@snap.freebsd.org:/usr/obj/usr/src/sys/GENERIC amd64 root@freebsd10testing:~ # poudriere bulk -j testing www/firefox ====>> Creating the reference jail... done ====>> Mounting system devices for testing-default ====>> Mounting ports/packages/distfiles ====>> Mounting packages from: /usr/local/poudriere/data/packages/testing-default ====>> Logs: /usr/local/poudriere/data/logs/bulk/testing-default/2014-01-09_19h23m11s /etc/resolv.conf -> /usr/local/poudriere/data/build/testing-default/ref/etc/resolv.conf ====>> Starting jail testing-default ====>> Calculating ports order and dependencies ====>> pkg package missing, skipping sanity ====>> Cleaning the build queue ====>> Building 145 packages using 4 builders ====>> Starting/Cloning builders mount_nullfs: /usr/local/poudriere/data/build/testing-default/03/usr/ports: Device not configured ====>> Error: Failed to mount the ports directory /usr/local/share/poudriere/bulk.sh: 5: Bad file descriptor Write failed: Broken pipe At this point the ssh session dies (Write failed: Broken pipe) and the VM restarts (watching the console via VNC). The crash appears to occur during the building of the reference jails (one per CPU - 4). I don't see anything in /var/log/messages, /var/crash/ is empty, and savecore doesn't dump any core files. I've tested this with 2, 3, 4, 5, and 6 CPUs allocated to the VM and it crashes every time. The only way I can have the VM not crash is with 1 allocated CPU. I believe there's an issue with VirtualBox and FreeBSD 10.0 VM when the VM has multiple CPUs. I don't think this is a poudriere issue however it's the only way I've been able to crash the VM. I've tried extracting multiple ports trees to different locations at the same time thinking it's a disk issue because of the above "Device not configured" (The/a disk disappears?) error, the VM didn't crash. I've tried the same command with a FreeBSD 9.2-RELEASE amd64 4 CPU VM under the same host with out any failure/crashes. Could anyone confirm this with a multi-CPU VM and FreeBSD 10.0RC3/4/5 or recommend any methods on how to debug this issue? From owner-freebsd-virtualization@FreeBSD.ORG Fri Jan 10 11:05:06 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id D43EB26D for ; Fri, 10 Jan 2014 11:05:06 +0000 (UTC) Received: from plane.gmane.org (plane.gmane.org [80.91.229.3]) (using TLSv1 with cipher AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 8BEA5108D for ; Fri, 10 Jan 2014 11:05:06 +0000 (UTC) Received: from list by plane.gmane.org with local (Exim 4.69) (envelope-from ) id 1W1Ztg-0001Tg-0d for freebsd-virtualization@freebsd.org; Fri, 10 Jan 2014 12:05:04 +0100 Received: from august.inf.tu-dresden.de ([141.76.48.124]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Fri, 10 Jan 2014 12:05:04 +0100 Received: from jsteckli by august.inf.tu-dresden.de with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Fri, 10 Jan 2014 12:05:04 +0100 X-Injected-Via-Gmane: http://gmane.org/ To: freebsd-virtualization@freebsd.org From: Julian Stecklina Subject: Re: VirtualBox 4.2.20_2 FreeBSD 9.2-RELEASE host multi CPU VM poudriere crash Date: Fri, 10 Jan 2014 11:59:50 +0100 Lines: 29 Message-ID: References: <20140110012304.GC44486@ircbsd.lifeofadishwasher.com> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="PHdTFe3BUnLHg9qegmo2vw1gobMaOblLG" X-Complaints-To: usenet@ger.gmane.org X-Gmane-NNTP-Posting-Host: august.inf.tu-dresden.de User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:24.0) Gecko/20100101 Thunderbird/24.2.0 In-Reply-To: <20140110012304.GC44486@ircbsd.lifeofadishwasher.com> X-Enigmail-Version: 1.6 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Jan 2014 11:05:06 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --PHdTFe3BUnLHg9qegmo2vw1gobMaOblLG Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable On 01/10/2014 02:23 AM, Derek Schrock wrote: > =3D=3D=3D=3D>> Error: Failed to mount the ports directory > /usr/local/share/poudriere/bulk.sh: 5: Bad file descriptor > Write failed: Broken pipe Have you tried a fsck -f on the disk? Julian --PHdTFe3BUnLHg9qegmo2vw1gobMaOblLG Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iEYEARECAAYFAlLP0qYACgkQ2EtjUdW3H9kKuACfTUfN7k7CuKKJ+ObFzPp9bKH7 16oAoN0u4aIsL1KYJnKnlQ1McKlwLGXN =XF/X -----END PGP SIGNATURE----- --PHdTFe3BUnLHg9qegmo2vw1gobMaOblLG-- From owner-freebsd-virtualization@FreeBSD.ORG Fri Jan 10 13:02:28 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id A203CFA8 for ; Fri, 10 Jan 2014 13:02:28 +0000 (UTC) Received: from mail-qa0-x22f.google.com (mail-qa0-x22f.google.com [IPv6:2607:f8b0:400d:c00::22f]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 5479319CF for ; Fri, 10 Jan 2014 13:02:28 +0000 (UTC) Received: by mail-qa0-f47.google.com with SMTP id f11so3910637qae.20 for ; Fri, 10 Jan 2014 05:02:27 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=lifeofadishwasher.com; s=google; h=date:from:cc:subject:message-id:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; bh=My41jftiWfpfmOM3LFWfpIH/A6yl2nLt2Qt/Fsz2IdA=; b=h+LoylYRhg0nxoW7Er3T4WQfrSCCWHyIdLKyx8Lteu7hnTAGSaTxY/LnHofeAofCyQ QTGv2Yynr2bZ3wHl6zGsD7wRDzfz6dDuPqPxeajhb26pKps4Np2wTvOWjGGkxeAxyzz8 8MAWqeVbgE8uKMGkFgGccRxwJGTx4h0GK0sXo= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:date:from:cc:subject:message-id:references :mime-version:content-type:content-disposition:in-reply-to :user-agent; bh=My41jftiWfpfmOM3LFWfpIH/A6yl2nLt2Qt/Fsz2IdA=; b=BuwpeyPJVnfbmgqV4S9whrm1+LvC/egNDH9fbl/2eOVX8Y30T15d6xlYfbIDNE13oV GUJlT8k1M5wMUNZgE5+kmarTBnJaU24ismXB2rgjr6mAUYQ1tCMco1AlG0bZhVDLmQtq USCsewx1c6pKJFqxlgcnB9gBfwmA4pCR3JVjKwLbgTjOMQc6qDFqsC0i0FtYQCKhIcXv y2BVpBRgVSSWhZmErDn7wcjrRUDjz9k25gaonK3SYiursw2F9/Yc/EeVGdC+Yw5FQ329 LLzwpjKECl9CfUe8PQt4a6VXnZa1kIWJ2HdJ0fLpus2ldjSyk76VSxHhalC48QSK0fv3 S1GQ== X-Gm-Message-State: ALoCoQnBnQAbWBS9ET5I14/r1g0yzUNZ7mF2nZdo/1/zz2MN8SSCsdBCpKtYAV2vQpx0IzAm0GBO X-Received: by 10.224.163.9 with SMTP id y9mr7177826qax.31.1389358947477; Fri, 10 Jan 2014 05:02:27 -0800 (PST) Received: from lifeofadishwasher.com (c-71-206-246-125.hsd1.pa.comcast.net. [71.206.246.125]) by mx.google.com with ESMTPSA id m7sm12517676qer.16.2014.01.10.05.02.26 for (version=TLSv1 cipher=RC4-SHA bits=128/128); Fri, 10 Jan 2014 05:02:27 -0800 (PST) Received: by lifeofadishwasher.com (sSMTP sendmail emulation); Fri, 10 Jan 2014 08:02:25 -0500 Date: Fri, 10 Jan 2014 08:02:25 -0500 From: Derek Schrock Cc: freebsd-virtualization@freebsd.org Subject: Re: VirtualBox 4.2.20_2 FreeBSD 9.2-RELEASE host multi CPU VM poudriere crash Message-ID: <20140110130225.GA34937@ircbsd.lifeofadishwasher.com> References: <20140110012304.GC44486@ircbsd.lifeofadishwasher.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.22 (2013-10-16) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Jan 2014 13:02:28 -0000 Yes, also something I forgot to mention, the crash isn't instant, it will take ~3-4 minutes until the system freezes and the console reboots. I can watch the system create the reference jails via top (poudriere uses cpdup to copy data). On Fri, Jan 10, 2014 at 11:59:50AM +0100, Julian Stecklina wrote: > On 01/10/2014 02:23 AM, Derek Schrock wrote: > > ====>> Error: Failed to mount the ports directory > > /usr/local/share/poudriere/bulk.sh: 5: Bad file descriptor > > Write failed: Broken pipe > > Have you tried a fsck -f on the disk? > > Julian > From owner-freebsd-virtualization@FreeBSD.ORG Fri Jan 10 13:18:26 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id B697E5EB for ; Fri, 10 Jan 2014 13:18:26 +0000 (UTC) Received: from mail-vb0-x229.google.com (mail-vb0-x229.google.com [IPv6:2607:f8b0:400c:c02::229]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 73C981AB6 for ; Fri, 10 Jan 2014 13:18:26 +0000 (UTC) Received: by mail-vb0-f41.google.com with SMTP id p14so3242289vbm.28 for ; Fri, 10 Jan 2014 05:18:25 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=LVJ2Y0f3zPmHbqxVEkVFZeSBymz9a6OhRb4Amp9Qpkk=; b=OiimcTUb0K9BN9IAKZKVlSPELKuj5Mpe1S4lIOWuv7NjTHSDbybFL3r46gH0E+JTeJ TdhvOa0F2qYk0fqQfp+LVajaLzRTT0JB3zm09vEGjbfvc9/VMwCDiJ8WTPv5tNFQHW/t VRKQI0cZZhadmYfavMSxT5USwyHKfMErMAWx32CSsjQLLI7NTNAGZrOOtgpe87cAKLZw JOCLE9ecBXD8+g923XgBpKTbPtWbiCd1Vs0MQHNUZSDto2QYbYUFD9jcE5eVApKil2nl c8am4dj20wEpnp/OaES/nhE6oCZC4q8umo4fyWnau5EoBHidqKRyi3V4GILahlCaD5Po qADQ== MIME-Version: 1.0 X-Received: by 10.52.76.105 with SMTP id j9mr1657175vdw.52.1389359904889; Fri, 10 Jan 2014 05:18:24 -0800 (PST) Received: by 10.58.164.36 with HTTP; Fri, 10 Jan 2014 05:18:24 -0800 (PST) In-Reply-To: <20140110012304.GC44486@ircbsd.lifeofadishwasher.com> References: <20140110012304.GC44486@ircbsd.lifeofadishwasher.com> Date: Fri, 10 Jan 2014 17:18:24 +0400 Message-ID: Subject: Re: VirtualBox 4.2.20_2 FreeBSD 9.2-RELEASE host multi CPU VM poudriere crash From: Mikhail Tsatsenko To: Derek Schrock Content-Type: text/plain; charset=ISO-8859-1 Cc: freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Jan 2014 13:18:26 -0000 2014/1/10 Derek Schrock : > Using VirtualBox 4.2.20_2 (emulators/virtualbox-ose) on a 9.2-RELEASE > amd64 4 core (8 CPU with HT) host a FreeBSD 10.0-RC5 amd64 (also tested > with 3 and 4) VM with 4 allocated CPUs will repeatedly crashes when I > try to build a pkg repo with poudriere (ports-mgmt/poudriere) via the > bulk command. > > From the VM: > root@freebsd10testing:~ # kldstat #VirtualBox additions loaded (tested with/without) > Id Refs Address Size Name > 1 9 0xffffffff80200000 15f0310 kernel > 2 1 0xffffffff81a12000 22d50 vboxguest.ko > 3 1 0xffffffff81a35000 543 vboxvideo.ko > 4 1 0xffffffff81a36000 16d6c drm.ko > root@freebsd10testing:~ # sysctl hw.ncpu > hw.ncpu: 4 > root@freebsd10testing:~ # uname -a > FreeBSD freebsd10testing 10.0-RC5 FreeBSD 10.0-RC5 #0 r260430: Wed Jan 8 05:10:04 UTC 2014 root@snap.freebsd.org:/usr/obj/usr/src/sys/GENERIC amd64 > root@freebsd10testing:~ # poudriere bulk -j testing www/firefox > ====>> Creating the reference jail... done > ====>> Mounting system devices for testing-default > ====>> Mounting ports/packages/distfiles > ====>> Mounting packages from: /usr/local/poudriere/data/packages/testing-default > ====>> Logs: /usr/local/poudriere/data/logs/bulk/testing-default/2014-01-09_19h23m11s > /etc/resolv.conf -> /usr/local/poudriere/data/build/testing-default/ref/etc/resolv.conf > ====>> Starting jail testing-default > ====>> Calculating ports order and dependencies > ====>> pkg package missing, skipping sanity > ====>> Cleaning the build queue > ====>> Building 145 packages using 4 builders > ====>> Starting/Cloning builders > mount_nullfs: /usr/local/poudriere/data/build/testing-default/03/usr/ports: Device not configured > ====>> Error: Failed to mount the ports directory > /usr/local/share/poudriere/bulk.sh: 5: Bad file descriptor > Write failed: Broken pipe > > At this point the ssh session dies (Write failed: Broken pipe) and the > VM restarts (watching the console via VNC). The crash appears to occur > during the building of the reference jails (one per CPU - 4). > > I don't see anything in /var/log/messages, /var/crash/ is empty, and savecore > doesn't dump any core files. > > I've tested this with 2, 3, 4, 5, and 6 CPUs allocated to the VM and it > crashes every time. The only way I can have the VM not crash is with 1 > allocated CPU. I believe there's an issue with VirtualBox and FreeBSD > 10.0 VM when the VM has multiple CPUs. > > I don't think this is a poudriere issue however it's the only way I've been > able to crash the VM. I've tried extracting multiple ports trees to different > locations at the same time thinking it's a disk issue because of the above > "Device not configured" (The/a disk disappears?) error, the VM didn't crash. > > I've tried the same command with a FreeBSD 9.2-RELEASE amd64 4 CPU VM > under the same host with out any failure/crashes. > > Could anyone confirm this with a multi-CPU VM and FreeBSD 10.0RC3/4/5 or > recommend any methods on how to debug this issue? First of all attach serial console to VM and see if there is any kernel messages printed upon crash. Also there is a possibly similar problem: http://lists.freebsd.org/pipermail/freebsd-stable/2014-January/076772.html _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@freebsd.org" -- Mikhail From owner-freebsd-virtualization@FreeBSD.ORG Fri Jan 10 13:40:31 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id EB5B9F19 for ; Fri, 10 Jan 2014 13:40:30 +0000 (UTC) Received: from mail-qe0-x22a.google.com (mail-qe0-x22a.google.com [IPv6:2607:f8b0:400d:c02::22a]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 9D2D91D48 for ; Fri, 10 Jan 2014 13:40:30 +0000 (UTC) Received: by mail-qe0-f42.google.com with SMTP id b4so4495623qen.29 for ; Fri, 10 Jan 2014 05:40:29 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=lifeofadishwasher.com; s=google; h=date:from:cc:subject:message-id:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; bh=p1tVkUZ+e17Vz3YKMlj8U/F6yAcecDDmosM2l3pGxDU=; b=AADDd5RpH7zuzwXrmUh37oVvYiAfTRtp5MuWuL+MqTDgrpxaKZuzhjNkjv9ihMIevY Y1LNec5E9A37xz2RjCVKbKAxJu5lioQWDZuSEdLZcRNUJn79QHtccQ8D+Ful6qxktU6s /tCEGGlazLSlS7LAsnPnc1gSpED1AxloAd6NA= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:date:from:cc:subject:message-id:references :mime-version:content-type:content-disposition:in-reply-to :user-agent; bh=p1tVkUZ+e17Vz3YKMlj8U/F6yAcecDDmosM2l3pGxDU=; b=K6LWSwTgtQ9wu3csFPEZQoKYSDwAIwZSYxZfe/03UC+YtrMyd2d19o2zq4/rCRMlsb HWi+0Inrd4OLSSXAKZ0rptebBmWH9mSuH8HjHf2Ds0H5ijSWMIZI+jZSZsUqyFE+cj4U yC8UB+nweZVLxeR0fAuqBrRrLmAjfWB5tQWFnk7aF0Z6tR6Qq9eP/QVcE5MEbHizbBr5 R/yBWT5h6ngDlaIx/ppW/Y5XUs9U5gt+7jXKAd5qOtngqBSs8f5scocXx8QEHYoQenYW uSGMOUsUxqqgG7oTHEeZAU1CiC+Sp3IGGVMHdyLUG+omgcHVs94jKL92gxHHd87xQ9Cp 3xgA== X-Gm-Message-State: ALoCoQmNcjYB4faGU2Rqrdhr6cVJKi5qMr5kUTnHzLlwmOFK1q8dNGcGU9usVYvMYGOu1QE8F7jY X-Received: by 10.224.44.9 with SMTP id y9mr4106330qae.45.1389361229585; Fri, 10 Jan 2014 05:40:29 -0800 (PST) Received: from lifeofadishwasher.com (c-71-206-246-125.hsd1.pa.comcast.net. [71.206.246.125]) by mx.google.com with ESMTPSA id f8sm11422964qab.19.2014.01.10.05.40.28 for (version=TLSv1 cipher=RC4-SHA bits=128/128); Fri, 10 Jan 2014 05:40:29 -0800 (PST) Received: by lifeofadishwasher.com (sSMTP sendmail emulation); Fri, 10 Jan 2014 08:40:27 -0500 Date: Fri, 10 Jan 2014 08:40:27 -0500 From: Derek Schrock Cc: freebsd-virtualization@freebsd.org Subject: Re: VirtualBox 4.2.20_2 FreeBSD 9.2-RELEASE host multi CPU VM poudriere crash Message-ID: <20140110134027.GB34937@ircbsd.lifeofadishwasher.com> References: <20140110012304.GC44486@ircbsd.lifeofadishwasher.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.22 (2013-10-16) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Jan 2014 13:40:31 -0000 On Fri, Jan 10, 2014 at 05:18:24PM +0400, Mikhail Tsatsenko wrote: > > First of all attach serial console to VM and see if there is any > kernel messages printed upon crash. > > Also there is a possibly similar problem: > http://lists.freebsd.org/pipermail/freebsd-stable/2014-January/076772.html > _______________________________________________ FreeBSD/amd64 (freebsd10testing) (ttyu0) login: Jan 10 08:35:48 freebsd10testing su: dereks to root on /dev/pts/0 panic: handle_written_inodeblock: live inodedep 0xfffff80004eb1a00 cpuid = 0 KDB: stack backtrace: #0 0xffffffff808e7dd0 at kdb_backtrace+0x60 #1 0xffffffff808af8b5 at panic+0x155 #2 0xffffffff80ad3c85 at softdep_disk_write_complete+0x1595 #3 0xffffffff80934cb0 at bufdone_finish+0x30 #4 0xffffffff80934b18 at bufdone+0x78 #5 0xffffffff809346c2 at biodone+0xe2 #6 0xffffffff8081c561 at g_io_schedule_up+0x1b1 #7 0xffffffff8081ca5d at g_up_procbody+0x6d #8 0xffffffff8088198a at fork_exit+0x9a #9 0xffffffff80c758ce at fork_trampoline+0xe Uptime: 2m55s (ada0:ata0:0:0:0): FLUSHCACHE. ACB: e7 00 00 00 00 40 00 00 00 00 00 00 (ada0:ata0:0:0:0): CAM status: Command timeout (ada0:ata0:0:0:0): Error 5, Retries exhausted (ada0:ata0:0:0:0): Synchronize cache failed Dumping 306 out of 4073 MB:(ada0:ata0:0:0:0): WRITE_DMA. ACB: ca 00 d8 6c 26 46 00 00 00 00 01 00 (ada0:ata0:0:0:0): CAM status: Command timeout (ada0:ata0:0:0:0): Error 5, Retries exhausted Aborting dump due to I/O error. ** DUMP FAILED (ERROR 5) ** From owner-freebsd-virtualization@FreeBSD.ORG Fri Jan 10 13:54:42 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id AEE6E66B for ; Fri, 10 Jan 2014 13:54:42 +0000 (UTC) Received: from mail-ve0-x234.google.com (mail-ve0-x234.google.com [IPv6:2607:f8b0:400c:c01::234]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 692C61E98 for ; Fri, 10 Jan 2014 13:54:42 +0000 (UTC) Received: by mail-ve0-f180.google.com with SMTP id jz11so3441605veb.25 for ; Fri, 10 Jan 2014 05:54:41 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:content-transfer-encoding; bh=PpSp3ZldNZ7ZgNASPzCzdFvpbInhdriiuVLjU45cQCY=; b=Mdb8TdV0XVy6Ixor2+uJ0bvXXtql2ruNhVk84LPL9ZHZi9kli4op8CtEeoKjj/TSRY w0AyK4CAN5Cr35zLuOLO7/4gRd2sW+t9oeoqi1AYu/G48g6FhTEFgRiegtNcZ+2Ct2FH xqOsMhlS9rWkqzaNX4PzvTll7D51Cm62e6LXoGqYczGf5BhLAP13hAgc+2W78Y3RMAdu pA6KGyBu67zJuw7dwT+Wv0nICuk+S6+yzCk8edag3tuHDBj2pPL8ATvUQxYkq1o4X1sx hfCl6BUn/wXR7qsBW0E4w+A2hVU2PaflpsWtOTOzo1AJkPpAyHsJAO63glWe8muOwAzW h1hA== MIME-Version: 1.0 X-Received: by 10.58.208.130 with SMTP id me2mr8240822vec.13.1389362081485; Fri, 10 Jan 2014 05:54:41 -0800 (PST) Received: by 10.58.164.36 with HTTP; Fri, 10 Jan 2014 05:54:41 -0800 (PST) In-Reply-To: <20140110134027.GB34937@ircbsd.lifeofadishwasher.com> References: <20140110012304.GC44486@ircbsd.lifeofadishwasher.com> <20140110134027.GB34937@ircbsd.lifeofadishwasher.com> Date: Fri, 10 Jan 2014 17:54:41 +0400 Message-ID: Subject: Re: VirtualBox 4.2.20_2 FreeBSD 9.2-RELEASE host multi CPU VM poudriere crash From: Mikhail Tsatsenko To: Derek Schrock Content-Type: text/plain; charset=KOI8-R Content-Transfer-Encoding: quoted-printable Cc: freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Jan 2014 13:54:42 -0000 2014/1/10 Derek Schrock : > On Fri, Jan 10, 2014 at 05:18:24PM +0400, Mikhail Tsatsenko wrote: >> >> First of all attach serial console to VM and see if there is any >> kernel messages printed upon crash. >> >> Also there is a possibly similar problem: >> http://lists.freebsd.org/pipermail/freebsd-stable/2014-January/076772.ht= ml >> _______________________________________________ > > FreeBSD/amd64 (freebsd10testing) (ttyu0) > > login: Jan 10 08:35:48 freebsd10testing su: dereks to root on /dev/pts/0 > panic: handle_written_inodeblock: live inodedep 0xfffff80004eb1a00 > cpuid =3D 0 > KDB: stack backtrace: > #0 0xffffffff808e7dd0 at kdb_backtrace+0x60 > #1 0xffffffff808af8b5 at panic+0x155 > #2 0xffffffff80ad3c85 at softdep_disk_write_complete+0x1595 > #3 0xffffffff80934cb0 at bufdone_finish+0x30 > #4 0xffffffff80934b18 at bufdone+0x78 > #5 0xffffffff809346c2 at biodone+0xe2 > #6 0xffffffff8081c561 at g_io_schedule_up+0x1b1 > #7 0xffffffff8081ca5d at g_up_procbody+0x6d > #8 0xffffffff8088198a at fork_exit+0x9a > #9 0xffffffff80c758ce at fork_trampoline+0xe ok, that is completely different issue > Uptime: 2m55s > (ada0:ata0:0:0:0): FLUSHCACHE. ACB: e7 00 00 00 00 40 00 00 00 00 00 00 > (ada0:ata0:0:0:0): CAM status: Command timeout > (ada0:ata0:0:0:0): Error 5, Retries exhausted > (ada0:ata0:0:0:0): Synchronize cache failed > Dumping 306 out of 4073 MB:(ada0:ata0:0:0:0): WRITE_DMA. ACB: ca 00 d8 6c= 26 46 00 00 00 00 01 00 > (ada0:ata0:0:0:0): CAM status: Command timeout > (ada0:ata0:0:0:0): Error 5, Retries exhausted > Aborting dump due to I/O error. And that's why you can't get any dumps For some reason device "disappears" from guest machine. Did you check VirtualBox logs for something unusual? > > ** DUMP FAILED (ERROR 5) ** > > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@free= bsd.org" --=20 =ED=C9=C8=C1=C9=CC From owner-freebsd-virtualization@FreeBSD.ORG Fri Jan 10 13:55:35 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 66C3A6B8 for ; Fri, 10 Jan 2014 13:55:35 +0000 (UTC) Received: from mail-qc0-x22d.google.com (mail-qc0-x22d.google.com [IPv6:2607:f8b0:400d:c01::22d]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 1438E1EA1 for ; Fri, 10 Jan 2014 13:55:35 +0000 (UTC) Received: by mail-qc0-f173.google.com with SMTP id i8so423305qcq.18 for ; Fri, 10 Jan 2014 05:55:34 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=lifeofadishwasher.com; s=google; h=date:from:to:subject:message-id:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; bh=UQMvEch+QdZXbGAZeOX0U3uHUHSsuG9FNK3zGfYD7Rs=; b=R6YAG45Zt9LIWyL/lgtAKh9g7URZbwSVJSodEAcjadqQgRFm7xc135ylY7cJQ5UoDy 3cOijB1Ox9vybguc82wLEx2AqRaGz1AYcUUAMkaP12r2ek/gYGAohbaQD7YbUE0c/oS6 j49yNq6jiWt70RTYeEEsr0cahUbqo68seNp3A= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:date:from:to:subject:message-id:references :mime-version:content-type:content-disposition:in-reply-to :user-agent; bh=UQMvEch+QdZXbGAZeOX0U3uHUHSsuG9FNK3zGfYD7Rs=; b=ToE0/3niauk+PZOuYwhjUH5PuFR4QDZRfOTcIFidFBvdDiGBPnsObxQiq+GpePmmkM fY8c86vV2G9NlD9PhZlFqD8d6hO6HjhJ2jfvpkYjufQUeLN3xsyVHrPkiGzmlzQRN84m NIdZCV7AAPf/+CcBRn5mfSpOOBusmK/LSQlQRcKHJnvo97Jd5OhdAM0TdQvhIkVZEAxx hePCrkmk2a+3UU+2f21o1BJms8hldCTaH0D9R+Va4bBiaBY8S4nZxSTsGnRd+UbecbOV sl9G+iCAzawlgz8ekhg8qjvIJixHaXDCwc6WE4l65Do1hlheLOJm2FRGToQ0QWOf2udu f1Gg== X-Gm-Message-State: ALoCoQmVHrDHLFDJGd7/Q6FQzDwz6IO/Wwy/lhaBSq9Rk3Ls0zsElwA+0au/gVVQnS2qAppaIYKL X-Received: by 10.224.128.72 with SMTP id j8mr7672832qas.51.1389362134200; Fri, 10 Jan 2014 05:55:34 -0800 (PST) Received: from lifeofadishwasher.com (c-71-206-246-125.hsd1.pa.comcast.net. [71.206.246.125]) by mx.google.com with ESMTPSA id o10sm11508321qaa.6.2014.01.10.05.55.32 for (version=TLSv1 cipher=RC4-SHA bits=128/128); Fri, 10 Jan 2014 05:55:33 -0800 (PST) Received: by lifeofadishwasher.com (sSMTP sendmail emulation); Fri, 10 Jan 2014 08:55:31 -0500 Date: Fri, 10 Jan 2014 08:55:31 -0500 From: Derek Schrock To: freebsd-virtualization@freebsd.org Subject: Re: VirtualBox 4.2.20_2 FreeBSD 9.2-RELEASE host multi CPU VM poudriere crash Message-ID: <20140110135531.GC34937@ircbsd.lifeofadishwasher.com> References: <20140110012304.GC44486@ircbsd.lifeofadishwasher.com> <20140110134027.GB34937@ircbsd.lifeofadishwasher.com> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="Qxx1br4bt0+wmkIi" Content-Disposition: inline In-Reply-To: <20140110134027.GB34937@ircbsd.lifeofadishwasher.com> User-Agent: Mutt/1.5.22 (2013-10-16) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Jan 2014 13:55:35 -0000 --Qxx1br4bt0+wmkIi Content-Type: text/plain; charset=us-ascii Content-Disposition: inline On Fri, Jan 10, 2014 at 08:40:27AM -0500, Derek Schrock wrote: > FreeBSD/amd64 (freebsd10testing) (ttyu0) > > login: Jan 10 08:35:48 freebsd10testing su: dereks to root on /dev/pts/0 > panic: handle_written_inodeblock: live inodedep 0xfffff80004eb1a00 > cpuid = 0 > KDB: stack backtrace: > #0 0xffffffff808e7dd0 at kdb_backtrace+0x60 > #1 0xffffffff808af8b5 at panic+0x155 > #2 0xffffffff80ad3c85 at softdep_disk_write_complete+0x1595 > #3 0xffffffff80934cb0 at bufdone_finish+0x30 > #4 0xffffffff80934b18 at bufdone+0x78 > #5 0xffffffff809346c2 at biodone+0xe2 > #6 0xffffffff8081c561 at g_io_schedule_up+0x1b1 > #7 0xffffffff8081ca5d at g_up_procbody+0x6d > #8 0xffffffff8088198a at fork_exit+0x9a > #9 0xffffffff80c758ce at fork_trampoline+0xe > Uptime: 2m55s > (ada0:ata0:0:0:0): FLUSHCACHE. ACB: e7 00 00 00 00 40 00 00 00 00 00 00 > (ada0:ata0:0:0:0): CAM status: Command timeout > (ada0:ata0:0:0:0): Error 5, Retries exhausted > (ada0:ata0:0:0:0): Synchronize cache failed > Dumping 306 out of 4073 MB:(ada0:ata0:0:0:0): WRITE_DMA. ACB: ca 00 d8 6c 26 46 00 00 00 00 01 00 > (ada0:ata0:0:0:0): CAM status: Command timeout > (ada0:ata0:0:0:0): Error 5, Retries exhausted > Aborting dump due to I/O error. > > ** DUMP FAILED (ERROR 5) ** > Tried this again and got a totally different set of messages/backtrace. See the attached txt file. --Qxx1br4bt0+wmkIi Content-Type: text/plain; charset=us-ascii Content-Disposition: attachment; filename="console.txt" Fri Jan 10 08:41:58 EST 2014 FreeBSD/amd64 (freebsd10testing) (ttyu0) login: Jan 10 08:42:52 freebsd10testing su: dereks to root on /dev/pts/0 (ada0:ata0:0:0:0): WRITE_DMA. ACB: ca 00 22 18 56 41 00 00 00 00 00 00 (ada0:ata0:0:0:0): CAM status: Command timeout (ada0:ata0:0:0:0): Retrying command ada0 at ata0 bus 0 scbus0 target 0 lun 0 ada0: s/n VB13c30ad6-e4c62d4b detached g_vfs_done():ada0p2[WRITE(offset=11478827008, length=131072)]error = 6 /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=11478958080, length=131072)]error = 6 /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=11479089152, length=131072)]error = 6 /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=11479220224, length=131072)]error = 6 /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=11479351296, length=131072)]error = 6 /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=11479482368, length=131072)]error = 6 /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=11479613440, length=131072)]error = 6 /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13432553472, length=98304)]error = 6 /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13433241600, length=32768)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13384179712, length=8192)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13380444160, length=8192)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13385105408, length=32768)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13385203712, length=32768)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13374017536, length=12288)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13384548352, length=28672)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13384155136, length=24576)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13384089600, length=20480)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=9879846912, length=16384)]error = 6 g_vfs_done():ada0p2[WRITE(offset=13431537664, length=98304)]error = 6 /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13153562624, length=4096)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13380419584, length=24576)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13318057984, length=4096)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=11479744512, length=131072)]error = 6 /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13384876032, length=65536)]error = 6 /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13387264000, length=4096)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13372030976, length=32768)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13373997056, length=20480)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13370130432, length=28672)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13431275520, length=131072)]error = 6 /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13388599296, length=8192)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13309407232, length=4096)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=11479875584, length=131072)]error = 6 /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13431046144, length=65536)]error = 6 /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13431242752, length=32768)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13369237504, length=8192)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13369212928, length=24576)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=11480006656, length=131072)]error = 6 /: got error 6 while accessing filesystem /t error 6 while accessing filesystem g_vfs_done():/: got error 6 while accessing filesystem ada0p2[WRITE(offset=12073500672, length=131072)]error = 6 /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():/: got error 6 while accessing filesystem ada0p2[WRITE(offset=12073631744, length=131072)]/: got error 6 while accessing filesystem error = 6 /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():/: got error 6 while accessing filesystem ada0p2[WRITE(offset=13429997568, length=98304)]/: got error 6 while accessing filesystem error = 6 /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():/: got error 6 while accessing filesystem ada0p2[WRITE(offset=12073893888, length=131072)]/: got error 6 while accessing filesystem error = 6 /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():/: got error 6 while accessing filesystem ada0p2[WRITE(offset=13153529856, length=4096)]/: got error 6 while accessing filesystem error = 6 /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():/: got error 6 while accessing filesystem ada0p2[WRITE(offset=12074024960, length=131072)]/: got error 6 while accessing filesystem error = 6 /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():/: got error 6 while accessing filesystem ada0p2[WRITE(offset=13387255808, length=8192)]/: got error 6 while accessing filesystem error = 6 /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():/: got error 6 while accessing filesystem ada0p2[WRITE(offset=12074156032, length=131072)]/: got error 6 while accessing filesystem error = 6 /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():/: got error 6 while accessing filesystem ada0p2[WRITE(offset=12074319872, length=131072)]/: got error 6 while accessing filesystem error = 6 /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():/: got error 6 while accessing filesystem ada0p2[WRITE(offset=13359972352, length=28672)]/: got error 6 while accessing filesystem error= 6 /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystele accessing filesystem error = 6 /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got err6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 gth=131072)]/: got error 6 while accessing filesystem error = 6 /: got error 6 while accessing filesystem /: got error 6 while aile accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 whilng filesystem ada0p2[WRITE(offset=12074745856, length=131072)]/: got error 6 while accessing filesystem error = 6 /: got error 6rror 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got errs_done():/: got error 6 while accessing filesystem ada0p2[WRITE(offset=13130268672, length=32768)]/: got error 6 while accessing accessing filesystem error = 6 /: got error 6 while accessing filesystem /dev: got error 6 while accessing filesystem /: got er4, length=32768)]/: got error 6 while accessing filesystem error = 6 /: got error 6 while accessing filesystem /dev: got error 6 ada0p2[WRITE(offset=13131415552, length=32768)]/: got error 6 while accessing filesystem error = 6 /: got error 6 while accessi: got error 6 while accessing filesystem ada0p2[WRITE(offset=13131448320, length=32768)]/: got error 6 while accessing filesysteror 6 while accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():/: got error 6 while accessing filesysteessing filesystem /dev: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while ac=32768)]/: got error 6 while accessing filesystem error = 6 /: got error 6 while accessing filesystem /dev: got error 6 while ac24, length=32768)]/: got error 6 while accessing filesystem error = 6 /: got error 6 while accessing filesystem /dev: got error /: got error 6 while accessing filesystem ada0p2[WRITE(offset=13131579392, length=32768)]/: got error 6 while accessing filesyste():/: got error 6 while accessing filesystem ada0p2[WRITE(offset=13131612160, length=32768)]/: got error 6 while accessing filer 6 while accessing filesystem g_vfs_done():/: got error 6 while accessing filesystem ada0p2[WRITE(offset=13131644928, length=32ing filesystem /: got error 6 while accessing filesystem g_vfs_done():/: got error 6 while accessing filesystem ada0p2[WRITE(offilesystem /dev: got error 6 while accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():/: got error 6 whi/: got error 6 while accessing filesystem error = 6 /: got error 6 while accessing filesystem /dev: got error 6 while accessing filesystem error = 6 /: got error 6 while accessing filesystem /dev: got error 6 while accessing filesystem /: got error 6 whileystem g_vfs_done():/: got error 6 while accessing filesystem ada0p2[WRITE(offset=13131776000, length=32768)]/: got error 6 whilerror 6 while accessing filesystem g_vfs_done():/: got error 6 while accessing filesystem ada0p2[WRITE(offset=13131808768, lengthilesystem /: got error 6 while accessing filesystem g_vfs_done():/: got error 6 while accessing filesystem ada0p2[WRITE(offset=1error 6 while accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():/: got error 6 while accessing filesysev: got error 6 while accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():/: got error 6 while accessingccessing filesystem /dev: got error 6 while accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():/: got er = 6 /: got error 6 while accessing filesystem /dev: got error 6 while accessing filesystem /: got error 6 while accessing filelength=32768)]/: got error 6 while accessing filesystem error = 6 /: got error 6 while accessing filesystem /dev: got error 6 whset=13132005376, length=32768)]/: got error 6 while accessing filesystem error = 6 /: got error 6 while accessing filesystem /dessing filesystem ada0p2[WRITE(offset=13132038144, length=32768)]/: got error 6 while accessing filesystem error = 6 /: got errordone():/: got error 6 while accessing filesystem ada0p2[WRITE(offset=13132070912, length=32768)]/: got error 6 while accessing file accessing filesystem g_vfs_done():/: got error 6 while accessing filesystem ada0p2[WRITE(offset=13132103680, length=32768)]/got error 6 while accessing filesystem /dev: got error 6 while accessing filesystem /: got error 6 while accessing filesystem g_6 /: got error 6 while accessing filesystem /dev: got error 6 while accessing filesystem /: got error 6 while accessing filesyst32768)]/: got error 6 while accessing filesystem error = 6 /: got error 6 while accessing filesystem /dev: got error 6 while accoffset=13132201984, length=32768)]/: got error 6 while accessing filesystem error = 6 /: got error 6 while accessing filesystem 6 while accessing filesystem ada0p2[WRITE(offset=13132234752, length=32768)]/: got error 6 while accessing filesystem error = 6):/: got error 6 while accessing filesystem ada0p2[WRITE(offset=13132267520, length=32768)]/: got error 6 while accessing filesyt error 6 while accessing filesystem g_vfs_done():/: got error 6 while accessing filesystem ada0p2[WRITE(offset=13132300288, lenystem /: got error 6 while accessing filesystem g_vfs_done():/: got error 6 while accessing filesystem ada0p2[WRITE(offset=13132system /dev: got error 6 while accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():/: got error 6 while 6 while accessing filesystem /dev: got error 6 while accessing filesystem /: got error 6 while accessing filesystem g_vfs_done( got error 6 while accessing filesystem error = 6 /: got error 6 while accessing filesystem /dev: got error 6 while accessing fi():/: got error 6 while accessing filesystem ada0p2[WRITE(offset=13132431360, length=32768)]/: got error 6 while accessing filesg filesystem ada0p2[WRITE(offset=13132464128, length=32768)]/: got error 6 while accessing filesystem error = 6 /: got error 6 wrror 6 while accessing filesystem g_vfs_done():/: got error 6 while accessing filesystem ada0p2[WRITE(offset=13132496896, lengthor 6 while accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():/: got error 6 while accessing filesystemaccessing filesystem /dev: got error 6 while accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():/: got : got error 6 while accessing filesystem /dev: got error 6 while accessing filesystem /: got error 6 while accessing filesystem error 6 while accessing filesystem error = 6 /: got error 6 while accessing filesystem /dev: got error 6 while accessing filesy32627968, length=32768)]/: got error 6 while accessing filesystem error = 6 /: got error 6 while accessing filesystem /dev: got filesystem ada0p2[WRITE(offset=13132660736, length=32768)]/: got error 6 while accessing filesystem error = 6 /: got error 6 whe():/: got error 6 while accessing filesystem ada0p2[WRITE(offset=13132693504, length=32768)]/: got error 6 while accessing filelesystem g_vfs_done():/: got error 6 while accessing filesystem ada0p2[WRITE(offset=13132726272, length=32768)]/: got error 6 whstem /: got error 6 while accessing filesystem g_vfs_done():/: got error 6 while accessing filesystem ada0p2[WRITE(offset=131327rror 6 while accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():/: got error 6 while accessing filesystle accessing filesystem /dev: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 whcessing filesystem ada0p2[WRITE(offset=13132824576, length=32768)]/: got error 6 while accessing filesystem error = 6 /: got errrror 6 while accessing filesystem ada0p2[WRITE(offset=13132857344, length=32768)]/: got error 6 while accessing filesystem errorssing filesystem g_vfs_done():/: got error 6 while accessing filesystem ada0p2[WRITE(offset=13153443840, length=20480)]/: got erot error 6 while accessing filesystem g_vfs_done():/: got error 6 while accessing filesystem ada0p2[WRITE(offset=13153476608, leor 6 while accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():/: got error 6 while accessing filesystem error 6 while accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():/: got error 6 while accessing filesy /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem gccessing filesystem error = 6 /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 696, length=8192)]/: got error 6 while accessing filesystem error = 6 /: got error 6 while accessing filesystem /: got error 6 whffset=13243711488, length=32768)]/: got error 6 while accessing filesystem error = 6 /: got error 6 while accessing filesystem /e accessing filesystem ada0p2[WRITE(offset=13244432384, length=24576)]/: got error 6 while accessing filesystem error = 6 /: gotfilesystem /: got error 6 while accessing filesystem g_vfs_done():/: got error 6 while accessing filesystem ada0p2[WRITE(offset=e accessing filesystem g_vfs_done():/: got error 6 while accessing filesystem ada0p2[WRITE(offset=13244497920, length=24576)]/: ng filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():/: got error 6 wh accessing filesystem error = 6 /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got errort error 6 while accessing filesystem error = 6 /: got error 6 while accessing filesystem /: got error 6 while accessing filesyst25984, length=4096)]/: got error 6 while accessing filesystem error = 6 /: got error 6 while accessing filesystem /: got error 6esystem ada0p2[WRITE(offset=13249609728, length=32768)]/: got error 6 while accessing filesystem error = 6 /: got error 6 while /: got error 6 while accessing filesystem ada0p2[WRITE(offset=13249740800, length=20480)]/: got error 6 while accessing filesystm g_vfs_done():/: got error 6 while accessing filesystem ada0p2[WRITE(offset=13249761280, length=12288)]/: got error 6 while accem /: got error 6 while accessing filesystem g_vfs_done():/: got error 6 while accessing filesystem ada0p2[WRITE(offset=13251837accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():/: got error 6 while accessing filesystem ada0p2[WRIle accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():/: got em error = 6 /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing ssing filesystem error = 6 /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 wh while accessing filesystem ada0p2[WRITE(offset=13254381568, length=12288)]/: got error 6 while accessing filesystem error = 6 /got error 6 while accessing filesystem ada0p2[WRITE(offset=13256523776, length=32768)]/: got error 6 while accessing filesystem while accessing filesystem g_vfs_done():/: got error 6 while accessing filesystem ada0p2[WRITE(offset=13257408512, length=32768) /: got error 6 while accessing filesystem g_vfs_done():/: got error 6 while accessing filesystem ada0p2[WRITE(offset=1326412185ilesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():/: got error 6 while 6 /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem :/: got error 6 while accessing filesystem ada0p2[WRITE(offset=13264846848, length=28672)]/: got error 6 while accessing filesys got error 6 while accessing filesystem ada0p2[WRITE(offset=13268451328, length=32768)]/: got error 6 while accessing filesystemng filesystem g_vfs_done():/: got error 6 while accessing filesystem ada0p2[WRITE(offset=13269303296, length=28672)]/: got errorhile accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():/: gorror 6 while accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():/: got error 6 while accessing filesyst2)]/: got error 6 while accessing filesystem error = 6 /: got error 6 while accessing filesystem /: got error 6 while accessing ITE(offset=13272350720, length=28672)]/: got error 6 while accessing filesystem error = 6 /: got error 6 while accessing filesysfilesystem ada0p2[WRITE(offset=13272379392, length=4096)]/: got error 6 while accessing filesystem error = 6 /: got error 6 whil: got error 6 while accessing filesystem ada0p2[WRITE(offset=13272940544, length=28672)]/: got error 6 while accessing filesyste/: got error 6 while accessing filesystem g_vfs_done():/: got error 6 while accessing filesystem ada0p2[WRITE(offset=13272969216while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():/: gength=28672)]/: got error 6 while accessing filesystem error = 6 /: got error 6 while accessing filesystem /: got error 6 while :/: got error 6 while accessing filesystem ada0p2[WRITE(offset=13275459584, length=4096)]/: got error 6 while accessing filesyst6 while accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():/: got error 6 while accessing filesystem adhile accessing filesystem error = 6 /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got eg filesystem ada0p2[WRITE(offset=13277265920, length=32768)]/: got error 6 while accessing filesystem error = 6 /: got error 6 wcessing filesystem g_vfs_done():/: got error 6 while accessing filesystem ada0p2[WRITE(offset=13277331456, length=24576)]/: got while accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():/: got error 6 while accessing filesystem ada0le accessing filesystem ada0p2[WRITE(offset=13278314496, length=24576)]/: got error 6 while accessing filesystem error = 6 /: goffset=13278339072, length=8192)]/: got error 6 while accessing filesystem error = 6 /: got error 6 while accessing filesystem /:712, length=32768)]/: got error 6 while accessing filesystem error = 6 /: got error 6 while accessing filesystem /: got error 6 tem ada0p2[WRITE(offset=13282574336, length=32768)]/: got error 6 while accessing filesystem error = 6 /: got error 6 while accer 6 while accessing filesystem ada0p2[WRITE(offset=13282639872, length=24576)]/: got error 6 while accessing filesystem error = _done():/: got error 6 while accessing filesystem ada0p2[WRITE(offset=13282664448, length=8192)]/: got error 6 while accessing file accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():/: got error 6 while accessing filesystem ada0p2 got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem g_vfvfs_done():/: got error 6 while accessing filesystem ada0p2[WRITE(offset=13285588992, length=32768)]/: got error 6 while accessiaccessing filesystem g_vfs_done():/: got error 6 while accessing filesystem ada0p2[WRITE(offset=13286965248, length=32768)]/: goe accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():/: got e6 while accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():/: got error 6 while accessing filesystem adaccessing filesystem error = 6 /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error ile accessing filesystem error = 6 /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got er while accessing filesystem error = 6 /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: gotle accessing filesystem g_vfs_done():/: got error 6 while accessing filesystem ada0p2[WRITE(offset=13289029632, length=65536)]/:r 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():rror = 6 /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filee accessing filesystem error = 6 /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got erro: got error 6 while accessing filesystem error = 6 /: got error 6 while accessing filesystem /: got error 6 while accessing file=4096)]/: got error 6 while accessing filesystem error = 6 /: got error 6 while accessing filesystem /: got error 6 while accesstem ada0p2[WRITE(offset=13290242048, length=28672)]/: got error 6 while accessing filesystem error = 6 /: got error 6 while acceessing filesystem ada0p2[WRITE(offset=13291487232, length=28672)]/: got error 6 while accessing filesystem error = 6 /: got erroe():/: got error 6 while accessing filesystem ada0p2[WRITE(offset=13294010368, length=65536)]/: got error 6 while accessing filestem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesyst536)]/: got error 6 while accessing filesystem error = 6 /: got error 6 while accessing filesystem /: got error 6 while accessin: got error 6 while accessing filesystem g_vfs_done():/: got error 6 while accessing filesystem ada0p2[WRITE(offset=13295124480,tem g_vfs_done():/: got error 6 while accessing filesystem ada0p2[WRITE(offset=13295153152, length=4096)]/: got error 6 while ac6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 em ada0p2[WRITE(offset=13296074752, length=32768)]/: got error 6 while accessing filesystem error = 6 /: got error 6 while accesaccessing filesystem g_vfs_done():/: got error 6 while accessing filesystem ada0p2[WRITE(offset=13296467968, length=65536)]/: gowhile accessing filesystem error = 6 /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got ffset=13296590848, length=8192)]/: got error 6 while accessing filesystem error = 6 /: got error 6 while accessing filesystem /::/: got error 6 while accessing filesystem ada0p2[WRITE(offset=13296685056, length=12288)]/: got error 6 while accessing filesys861184, length=32768)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13296959488, length=2fs_done():ada0p2[WRITE(offset=13296979968, length=12288)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():adale accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13297991680, length=8192)]error = 6 /: got error 6 while accessing file_vfs_done():ada0p2[WRITE(offset=13299613696, length=28672)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0gth=32768)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13300170752, length=32768)]error= 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13300334592, length=24576)]error = 6 /: got error):ada0p2[WRITE(offset=13301055488, length=98304)]error = 6 /: got error 6 while accessing filesystem /: got error 6 while access got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem g_vfe():ada0p2[WRITE(offset=13301940224, length=65536)]error = 6 /: got error 6 while accessing filesystem /: got error 6 while accea0p2[WRITE(offset=13302169600, length=20480)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offsefs_done():ada0p2[WRITE(offset=13304201216, length=28672)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2WRITE(offset=13308035072, length=98304)]error = 6 /: got error 6 while accessing filesystem /: got error 6 while accessing filesor = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13311295488, length=16384)]error = 6 /: got er13313179648, length=65536)]error = 6 /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem g_vfs_d6)]error = 6 /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offseaccessing filesystem g_vfs_done():ada0p2[WRITE(offset=13319897088, length=28672)]error = 6 /: got error 6 while accessing filesysing filesystem /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13320945664, length=16384)]error = 6 732096, length=32768)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13326286848, length=6]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13327138816, length=20480)]error = 6 /: goessing filesystem g_vfs_done():ada0p2[WRITE(offset=13327691776, length=4096)]error = 6 /: got error 6 while accessing filesystemset=13328470016, length=12288)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13328744448,ror = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13330661376, length=16384)]error = 6 /: got e= 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13331595264, length=65536)]error = 6 /: got error_vfs_done():ada0p2[WRITE(offset=13332049920, length=4096)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0psystem g_vfs_done():ada0p2[WRITE(offset=13332578304, length=28672)]error = 6 /: got error 6 while accessing filesystem g_vfs_donerror 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13333069824, length=32768)]error = 6 /: got error 6 while acone():ada0p2[WRITE(offset=13333921792, length=28672)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRI got error 6 while accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13334052864, or 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13334466560, length=12288)]error = 6 /: got error 6 while acces length=65536)]error = 6 /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():ada0p20p2[WRITE(offset=13335031808, length=4096)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=t=13336608768, length=32768)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13336772608, l6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13337067520, length=32768)]error = 6 /: got error 6 while accessin6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13338136576, length=12288)]error = 6 /: got error 6 while accessinWRITE(offset=13339254784, length=8192)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=1334g filesystem g_vfs_done():ada0p2[WRITE(offset=13340626944, length=12288)]error = 6 /: got error 6 while accessing filesystem g_v/: got error 6 while accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13342179328ne():ada0p2[WRITE(offset=13344112640, length=24576)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITffset=13344505856, length=32768)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=1334480076ilesystem g_vfs_done():ada0p2[WRITE(offset=13345751040, length=32768)]error = 6 /: got error 6 while accessing filesystem g_vfs_ filesystem /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13346275328, length=20480)]error = 6 /: grror = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13346308096, length=24576)]error = 6 /: got ():ada0p2[WRITE(offset=13346537472, length=98304)]error = 6 /: got error 6 while accessing filesystem /: got error 6 while acces6 /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem :ada0p2[WRITE(offset=13346787328, length=12288)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(of= 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13347094528, length=20480)]error = 6 /: got errorE(offset=13347258368, length=32768)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=1334729347422208, length=28672)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13347454976, lengtda0p2[WRITE(offset=13347471360, length=16384)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offsWRITE(offset=13347586048, length=98304)]error = 6 /: got error 6 while accessing filesystem /: got error 6 while accessing filesp2[WRITE(offset=13347684352, length=28672)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=r = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13347745792, length=4096)]error = 6 /: got erroile accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():ada0p2ength=8192)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13348864000, length=20480)]errossing filesystem g_vfs_done():ada0p2[WRITE(offset=13349355520, length=24576)]error = 6 /: got error 6 while accessing filesystemssing filesystem g_vfs_done():ada0p2[WRITE(offset=13349421056, length=24576)]error = 6 /: got error 6 while accessing filesystemet=13350109184, length=32768)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13350141952, t=13350928384, length=32768)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13350961152, lrror = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13351272448, length=16384)]error = 6 /: got ot error 6 while accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13352402944, lewhile accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13353177088, length=12288)]error = 6 /: got error 6 while accessing esystem g_vfs_done():ada0p2[WRITE(offset=13353222144, length=98304)]error = 6 /: got error 6 while accessing filesystem /: got eength=24576)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13353902080, length=8192)]erro /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13353943040, length=20480)]error = 6 /: got error 6 t=13354303488, length=20480)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13354323968, lhile accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13357645824, length=32768)] length=65536)]error = 6 /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():ada0p2gth=12288)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13359120384, length=98304)]errorvfs_done():ada0p2[WRITE(offset=13359218688, length=24576)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p59415296, length=98304)]error = 6 /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got errfilesystem g_vfs_done():ada0p2[WRITE(offset=13359534080, length=12288)]error = 6 /: got error 6 while accessing filesystem g_vfsor = 6 /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=1336hile accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13362266112, length=28672)]error = 6 /: got error 6 while accessing f6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13362315264, length=16384)]error = 6 /: got error 6 while accessin8672)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13364658176, length=65536)]error = 6 ccessing filesystem g_vfs_done():ada0p2[WRITE(offset=13365149696, length=28672)]error = 6 /: got error 6 while accessing filesysTE(offset=13365313536, length=32768)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=133655=32768)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13365870592, length=28672)]error = g_vfs_done():ada0p2[WRITE(offset=13369081856, length=131072)]error = 6 /: got error 6 while accessing filesystem /: got error 6 accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13371441152, length=20480)]error = 6 /: got error 6 while accessing filesytem g_vfs_done():ada0p2[WRITE(offset=13371539456, length=32768)]error = 6 /: got error 6 while accessing filesystem g_vfs_done()le accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13373931520, length=65536)]eror = 6 /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesy error 6 while accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13377404928, leng68)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13378682880, length=131072)]error = 6 /:ada0p2[WRITE(offset=13380583424, length=131072)]error = 6 /: got error 6 while accessing filesystem /: got error 6 while access error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13380943872, length=32768)]error = 6 /: got error 6 while aITE(offset=13381238784, length=24576)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13381accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13382352896, length=98304)]error = 6 /: got error 6 while accessing filesyada0p2[WRITE(offset=13382582272, length=32768)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offh=20480)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13288828928, length=4096)]error = 288)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13342629888, length=8192)]error = 6 /:r 6 while accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13383565312, length=98_vfs_done():ada0p2[WRITE(offset=13383663616, length=20480)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0 length=98304)]error = 6 /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 whilot error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13384110080, length=12288)]error = 6 /: got error 6 whileength=32768)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13384187904, length=20480)]erresystem /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13385367552, length=20480)]error = 6 /: got error = 6 /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13386743808, length=32768)]error = 6 /: got erTE(offset=13387530240, length=65536)]error = 6 /: got error 6 while accessing filesystem /: got error 6 while accessing filesystTE(offset=13393231872, length=32768)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=133933 length=8192)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13393920000, length=24576)]er3397032960, length=32768)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13399949312, lengng filesystem g_vfs_done():ada0p2[WRITE(offset=13402853376, length=8192)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13403709440, length=8192)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[r = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13404438528, length=65536)]error = 6 /: got err 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13406928896, length=131072)]error = 6 /: got error 6 while accesscessing filesystem g_vfs_done():ada0p2[WRITE(offset=13408075776, length=65536)]error = 6 /: got error 6 while accessing filesystsystem g_vfs_done():ada0p2[WRITE(offset=13410238464, length=32768)]error = 6 /: got error 6 while accessing filesystem g_vfs_donr = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13411778560, length=32768)]error = 6 /: got err filesystem g_vfs_done():ada0p2[WRITE(offset=13413285888, length=32768)]error = 6 /: got error 6 while accessing filesystem g_vfoffset=13413875712, length=32768)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=134145310essing filesystem g_vfs_done():ada0p2[WRITE(offset=13414584320, length=12288)]error = 6 /: got error 6 while accessing filesysteot error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem g_vfs_ccessing filesystem g_vfs_done():ada0p2[WRITE(offset=13415415808, length=32768)]error = 6 /: got error 6 while accessing filesys accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13415632896, length=8192)]error = 6 /: got error 6 while accessing filesydone():ada0p2[WRITE(offset=13416038400, length=20480)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WR, length=65536)]error = 6 /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem g_vfs_done():ada0p6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13421862912, length=8192)]error = 6 /: got error 6 ot error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13422329856, length=24576)]error = 6 /: got error 6 whileE(offset=13422354432, length=8192)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13424586(offset=13428129792, length=32768)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13432979essing filesystem g_vfs_done():ada0p2[WRITE(offset=13434388480, length=32768)]error = 6 /: got error 6 while accessing filesystefs_done():ada0p2[WRITE(offset=13435731968, length=32768)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13437468672, length=65536)]error = 6 /: got error 6 whil13437657088, length=8192)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13437665280, lenglength=8192)]error = 6 /: got error 6 while accessing filesystem g_vfs_done():ada0p2[WRITE(offset=13438025728, length=65536)]errftdep_deallocate_dependencies: got error 6 while accessing filesystem g_vfs_done():softdep_deallocate_dependencies: got error 6 ffset=13439500288, length=32768)]/: got error 6 while accessing filesystem /: got error 6 while accessing filesystem error = 6 /or 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem g_vfs_done()ystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 while accessing filesystdep_deallocate_dependencies: got error 6 while accessing filesystem /: got error 6 while accessing filesystem /: got error 6 wh: brelvp: Buffer 0xfffffe00f7de5d08 not on queue. cpuid = 2 KDB: stack backtrace: #0 0xffffffff808e7dd0 at kdb_backtrace+0x60 #1xffffffff80ad0234 at softdep_process_journal+0x7c4 #6 0xffffffff80ae4eca at flush_deplist+0x8a #7 0xffffffff80ae2880 at softdep_e+0x47 #9 0xffffffff80aee303 at ffs_fsync+0x23 #10 0xffffffff80d98e18 at VOP_FSYNC_APV+0x98 #11 0xffffffff80955177 at sys_fsync+ --Qxx1br4bt0+wmkIi-- From owner-freebsd-virtualization@FreeBSD.ORG Fri Jan 10 14:26:42 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 6D596A5A for ; Fri, 10 Jan 2014 14:26:42 +0000 (UTC) Received: from mail-qa0-x22c.google.com (mail-qa0-x22c.google.com [IPv6:2607:f8b0:400d:c00::22c]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 1D21710B9 for ; Fri, 10 Jan 2014 14:26:42 +0000 (UTC) Received: by mail-qa0-f44.google.com with SMTP id o15so4167816qap.31 for ; Fri, 10 Jan 2014 06:26:41 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=lifeofadishwasher.com; s=google; h=date:from:to:subject:message-id:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; bh=lyXz2ujoluEDs8NfdVySTrkqiSgsITq3k3x/AGDXpJo=; b=gihcbaEd81sGt81TECLw2cUnsSYc8ZRNRKAJM//vMCptuWdLbxyLwETZaro8X/l2mU lWVPdAtWouTCvWNSjNtc/TxsD+3DwfcApzlM2M94cK0U2+GdcRL0ruG/Jr4sxAb9fuv5 0s5/O2ROJu3YvFFbhmUrOaP+z0GpYrMY2X92Y= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:date:from:to:subject:message-id:references :mime-version:content-type:content-disposition:in-reply-to :user-agent; bh=lyXz2ujoluEDs8NfdVySTrkqiSgsITq3k3x/AGDXpJo=; b=PEue9hAgXLU1UXrCx08qBRu87lEoVdjJhIbLNwpTaRLPA3B/x6eO3kxrHiMoJcQNJR /S2Ndm1SJWqwsWn/yGPmmyoM2mBWd3d7b7paqMhGXF1lUT1C12A/i47qPI6/YdIwDE6i WYC9UEBFVhA3Pe0RzIOAyyvsek4GW3uzPaiXNOK9TLJiaRzqnbGMD4h8omolJ9U5Syuc jGA6tX36ru51aKGEF4awaWrproRXPUceVm9tpF8K/Bl9yOWca1HLaCLQ9VwqqTr8PM79 rbXwaUiNmZ9bZYrg05LgBEVunKyd5W+WW6DYCHxFgr/D4XVnxUs5Prv5ENc9dPVtPk3q Uoig== X-Gm-Message-State: ALoCoQnblnvDWhqOWt3JsdR5+NLb14w9FdxF9b1k5PIUe2ajNeB4SY2KuwA+tRbfaIaHCHOzcmoc X-Received: by 10.49.53.66 with SMTP id z2mr7953881qeo.45.1389364001342; Fri, 10 Jan 2014 06:26:41 -0800 (PST) Received: from lifeofadishwasher.com (c-71-206-246-125.hsd1.pa.comcast.net. [71.206.246.125]) by mx.google.com with ESMTPSA id g10sm11637919qaf.9.2014.01.10.06.26.39 for (version=TLSv1 cipher=RC4-SHA bits=128/128); Fri, 10 Jan 2014 06:26:40 -0800 (PST) Received: by lifeofadishwasher.com (sSMTP sendmail emulation); Fri, 10 Jan 2014 09:26:38 -0500 Date: Fri, 10 Jan 2014 09:26:38 -0500 From: Derek Schrock To: freebsd-virtualization@freebsd.org Subject: Re: VirtualBox 4.2.20_2 FreeBSD 9.2-RELEASE host multi CPU VM poudriere crash Message-ID: <20140110142638.GD34937@ircbsd.lifeofadishwasher.com> References: <20140110012304.GC44486@ircbsd.lifeofadishwasher.com> <20140110134027.GB34937@ircbsd.lifeofadishwasher.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.22 (2013-10-16) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Jan 2014 14:26:42 -0000 On Fri, Jan 10, 2014 at 05:54:41PM +0400, Mikhail Tsatsenko wrote: > And that's why you can't get any dumps > For some reason device "disappears" from guest machine. Did you check > VirtualBox logs for something unusual? Nothing that I can decipher. I see the VM starting and stopping with a lot of statistics. https://gist.github.com/derekschrock/1783575bd66b4e724035 https://gist.github.com/derekschrock/e999a1499d98ba405fa4