From owner-freebsd-stable@FreeBSD.ORG Fri Oct 4 13:29:07 2013 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 9DC5EB92 for ; Fri, 4 Oct 2013 13:29:07 +0000 (UTC) (envelope-from john.marshall@riverwillow.com.au) Received: from mail1.riverwillow.net.au (mail1.riverwillow.net.au [IPv6:2001:8000:1000:1801::36]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 189E22D1A for ; Fri, 4 Oct 2013 13:29:06 +0000 (UTC) Received: from rwpc15.gfn.riverwillow.net.au (rwpc15.gfn.riverwillow.net.au [IPv6:2001:8000:1000:18e1:20c:76ff:fe0a:2117]) (authenticated bits=56) by mail1.riverwillow.net.au (8.14.7/8.14.7) with ESMTP id r94DT0Bj042497 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK) for ; Fri, 4 Oct 2013 23:29:02 +1000 (AEST) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=riverwillow.com.au; s=m1001; t=1380893342; bh=rK8Gf+GS23CYFYDLZz9+xKulpXHubo5yCelfEB6OWsc=; h=Date:From:To:Subject:References:In-Reply-To; b=R5LmIPfA8Tw41eInRWricKIMfTmN3ekHfYOQGlSM4xmSksCzdeDOUOGI77cI7DKSS Y9R2AJX3QsaSMulFTLcsP4ZJWlnM4wvEqSjGGADMFGxxOMs2n6Oo9n4m5iG7hXt2v2 G6WOqNf3ZeWNtQlbwHshYMGDKT64/9QdzZMtJe+4= Date: Fri, 4 Oct 2013 23:29:00 +1000 From: John Marshall To: freebsd-stable@freebsd.org Subject: Re: 9.2-RC4 amd64 panic: vm_page_unwire Message-ID: <20131004132900.GC20752@rwpc15.gfn.riverwillow.net.au> References: <20130927000728.GB19167@rwpc15.gfn.riverwillow.net.au> <20130927081221.GK41229@kib.kiev.ua> <20130928023046.GA1428@rwpc15.gfn.riverwillow.net.au> <20130929212104.GB1370@rwpc15.gfn.riverwillow.net.au> <20130930095507.GD2813@rwpc15.gfn.riverwillow.net.au> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="VbJkn9YxBvnuCH5J" Content-Disposition: inline In-Reply-To: <20130930095507.GD2813@rwpc15.gfn.riverwillow.net.au> OpenPGP: id=A29A84A2; url=http://pki.riverwillow.com.au/pgp/johnmarshall.asc User-Agent: Mutt/1.5.21 (2010-09-15) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Oct 2013 13:29:07 -0000 --VbJkn9YxBvnuCH5J Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Mon, 30 Sep 2013, 19:55 +1000, John Marshall wrote: > > >> > On Fri, 27 Sep 2013, 11:12 +0300, Konstantin Belousov wrote: > > >> >> On Fri, Sep 27, 2013 at 10:07:28AM +1000, John Marshall wrote: > > >> >> > I have made the core.txt.[0-2] files available in the following > > >> >> > directory. The directory is not browsable. > > >> >> > > > >> >> > http://www.riverwillow.net.au/~john/92rc4/ > > >> >> > > >> >> This might be fixed by r254087-r254090 on stable/9. As well as applying those patches to releng/9.2, and still seeing the panic, I have upgraded one of the systems to stable/9 and still see the panic. > Another data point: both systems on which I have seen this panic have > the ipmi driver compiled in. ipmi makes the BMC's watchdog timer > available to the system. I ruled this out. I recompiled a kernel with no ipmi driver (so that removes the watchdog timer too) but the system would still panic on shutdown when stopping ntpd. I have also reverted to the STABLE ntpd distribution (4.6.4p5 2011-12-24) and still see the panic. I took one of the systems back to releng/9.1 (9.1-RELEASE-p7). Its kernel includes the ipmi driver, I am running watchdogd, I am running ntpd, I have rebooted several times and have never seen a panic. So, I now have one system on 9.1-RELEASE (panic-free); and the second system on 9-STABLE (panics). Previously I had both systems on 9.2-RELEASE and panicking. Another common factor with all but one of the panics I have seen is that the process which appears to trigger the panic is a 'realtime' process. rwsrv08# top -b 200 | awk '(/^ PID/ || $5~/^r/)' PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND 1739 root 1 -52 r0 12056K 8040K nanslp 7 0:02 0.00% watchd= ogd 1911 root 1 -52 r0F 32668K 18468K select 7 0:02 0.00% ntpd Here is a recent stable/9 tripping over watchdogd on shutdown: FreeBSD 9.2-STABLE #0 r256029: . Stopping watchdogd. Waiting for PIDS: 1729 panic: vm_page_unwire: page 0xfffffe042bdae2d8's wire count is zero cpuid =3D 1 KDB: stack backtrace: #0 0xffffffff804e8188 at kdb_backtrace+0x68 #1 0xffffffff804adcba at panic+0x21a #2 0xffffffff80718dd2 at vm_page_unwire+0x102 #3 0xffffffff80705a52 at vm_fault_unwire+0xd2 #4 0xffffffff8070db41 at vm_map_delete+0x171 #5 0xffffffff8070ddbf at vm_map_remove+0x5f #6 0xffffffff80711199 at vmspace_exit+0xc9 #7 0xffffffff804773dd at exit1+0x72d #8 0xffffffff804783de at sys_sys_exit+0xe #9 0xffffffff8073e86f at amd64_syscall+0x3bf #10 0xffffffff80729307 at Xfast_syscall+0xf7 --=20 John Marshall --VbJkn9YxBvnuCH5J Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.21 (FreeBSD) iEYEARECAAYFAlJOwpwACgkQw/tAaKKahKJD9gCglM9e6Hc2KWZqL/elRRWO8Tss VwQAoLcL0vOR+FJb6V3WRvZ9Yzk4OHlH =7EN7 -----END PGP SIGNATURE----- --VbJkn9YxBvnuCH5J--