From owner-freebsd-questions@FreeBSD.ORG Sun Feb 6 17:05:03 2011 Return-Path: Delivered-To: freebsd-questions@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 27BFE106566C for ; Sun, 6 Feb 2011 17:05:03 +0000 (UTC) (envelope-from robert@webtent.org) Received: from mail.webtent.org (mail.webtent.org [72.64.244.50]) by mx1.freebsd.org (Postfix) with ESMTP id C7EDB8FC0C for ; Sun, 6 Feb 2011 17:05:02 +0000 (UTC) Received: by mail.webtent.org (Postfix, from userid 27458) id D2885E104F; Sun, 6 Feb 2011 12:05:01 -0500 (EST) Received: from [192.168.1.75] (unknown [192.168.1.75]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) (Authenticated sender: robert@mail.webtent.org) by mail.webtent.org (Postfix) with ESMTPSA id 993A3E0CD5 for ; Sun, 6 Feb 2011 12:05:01 -0500 (EST) Message-ID: <4D4ED4BB.5090704@webtent.org> Date: Sun, 06 Feb 2011 12:04:59 -0500 From: Robert Fitzpatrick Organization: WebTent Networking, Inc. User-Agent: Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.13) Gecko/20101207 Thunderbird/3.1.7 ThunderBrowse/3.3.4 MIME-Version: 1.0 To: FreeBSD Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-WebTent-Disclaimer: robert@webtent.org X-Copyrighted-Material: Please visit http://www.webtent.org/privacy.html X-WebTent-ESMTP: Please visit http://www.webtent.com/email for more information Subject: kern.crit messages X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 06 Feb 2011 17:05:03 -0000 I have a server I installed 8.1-RELEASE on and believe I screwed up when rebuilding the kernel to support QUOTA because now that I am troubleshooting these weird messages in the log, I find I am actually running 9.0-CURRENT. I had a ports file as below when I pulled the source to rebuild the kernel... *default host=cvsup9.us.FreeBSD.org *default base=/usr *default prefix=/usr *default release=cvs tag=. *default release=cvs delete use-rel-suffix compress src-all Using the tag above caused my issue? Now I see some troubling messages in my logs... > Feb 6 11:25:23 backup kernel: lock order reversal: > Feb 6 11:25:23 backup kernel: 1st 0xffffff8014bbbe58 bufwait (bufwait) @ /usr/src/sys/kern/vfs_bio.c:2659 > Feb 6 11:25:23 backup kernel: 2nd 0xffffff002b9d6400 dirhash (dirhash) @ /usr/src/sys/ufs/ufs/ufs_dirhash.c:283 > Feb 6 11:25:23 backup kernel: KDB: stack backtrace: > Feb 6 11:25:23 backup kernel: db_trace_self_wrapper() at db_trace_self_wrapper+0x2a > Feb 6 11:25:23 backup kernel: _witness_debugger() at _witness_debugger+0x2e > Feb 6 11:25:23 backup kernel: witness_checkorder() at witness_checkorder+0x807 > Feb 6 11:25:23 backup kernel: _sx_xlock() at _sx_xlock+0x55 > Feb 6 11:25:23 backup kernel: ufsdirhash_acquire() at ufsdirhash_acquire+0x33 > Feb 6 11:25:23 backup kernel: ufsdirhash_add() at ufsdirhash_add+0x19 > Feb 6 11:25:23 backup kernel: ufs_direnter() at ufs_direnter+0x662 > Feb 6 11:25:23 backup kernel: ufs_makeinode() at ufs_makeinode+0x291 > Feb 6 11:25:23 backup kernel: VOP_CREATE_APV() at VOP_CREATE_APV+0x8d > Feb 6 11:25:23 backup kernel: vn_open_cred() at vn_open_cred+0x46a > Feb 6 11:25:23 backup kernel: kern_openat() at kern_openat+0x181 > Feb 6 11:25:23 backup kernel: syscallenter() at syscallenter+0x1aa > Feb 6 11:25:23 backup kernel: syscall() at syscall+0x4c > Feb 6 11:25:23 backup kernel: Xfast_syscall() at Xfast_syscall+0xe2 > Feb 6 11:25:23 backup kernel: --- syscall (5, FreeBSD ELF64, open), rip = 0x80078118c, rsp = 0x7fffffffad48, rbp = 0x7fffffffb73f --- I also find this message with dmesg... > ad8: 152627MB at ata4-master UDMA100 SATA > ad9: 953869MB at ata4-slave UDMA100 SATA > GEOM: ad8s1: geometry does not match label (255h,63s != 16h,63s). > ad10: 152627MB at ata5-master UDMA100 SATA > ad11: 953869MB at ata5-slave UDMA100 SATA > GEOM: ad9s1: geometry does not match label (255h,63s != 16h,63s). > uhub0: 2 ports with 2 removable, self powered > uhub1: 2 ports with 2 removable, self powered > uhub2: 2 ports with 2 removable, self powered > uhub3: 2 ports with 2 removable, self powered > GEOM: ufsid/4c7aa872e9a44575: geometry does not match label (255h,63s != 16h,63s). > GEOM: ad10s1: geometry does not match label (255h,63s != 16h,63s). > GEOM: ad11s1: geometry does not match label (255h,63s != 16h,63s). > uhub4: 8 ports with 8 removable, self powered > ar0: 152627MB status: READY > ar0: disk0 READY (master) using ad8 at ata4-master > ar0: disk1 READY (mirror) using ad10 at ata5-master > ar1: 953869MB status: READY > ar1: disk0 READY (master) using ad11 at ata5-slave > ar1: disk1 READY (mirror) using ad9 at ata4-slave > SMP: AP CPU #1 Launched! > WARNING: WITNESS option enabled, expect reduced performance. > ugen1.2: at usbus1 > ukbd0: on usbus1 > kbd2 at ukbd0 > ums0: on usbus1 > ums0: 5 buttons and [XYZ] coordinates ID=1 > Trying to mount root from ufs:/dev/ar0s1a > lock order reversal: > 1st 0xffffff0002cdd818 ufs (ufs) @ /usr/src/sys/kern/vfs_lookup.c:501 > 2nd 0xffffff801497ff78 bufwait (bufwait) @ /usr/src/sys/ufs/ffs/ffs_softdep.c:11309 > 3rd 0xffffff0002d4fbd8 ufs (ufs) @ /usr/src/sys/kern/vfs_subr.c:2111 > KDB: stack backtrace: > db_trace_self_wrapper() at db_trace_self_wrapper+0x2a > _witness_debugger() at _witness_debugger+0x2e > witness_checkorder() at witness_checkorder+0x807 > __lockmgr_args() at __lockmgr_args+0xd42 > ffs_lock() at ffs_lock+0x8c > VOP_LOCK1_APV() at VOP_LOCK1_APV+0x9b > _vn_lock() at _vn_lock+0x47 > vget() at vget+0x7b > vfs_hash_get() at vfs_hash_get+0xd5 > ffs_vgetf() at ffs_vgetf+0x48 > softdep_sync_metadata() at softdep_sync_metadata+0x5e3 > ffs_syncvnode() at ffs_syncvnode+0x213 > ffs_truncate() at ffs_truncate+0x557 > ufs_direnter() at ufs_direnter+0x47b > ufs_makeinode() at ufs_makeinode+0x291 > VOP_CREATE_APV() at VOP_CREATE_APV+0x8d > vn_open_cred() at vn_open_cred+0x46a > kern_openat() at kern_openat+0x181 > syscallenter() at syscallenter+0x1aa > syscall() at syscall+0x4c > Xfast_syscall() at Xfast_syscall+0xe2 > --- syscall (5, FreeBSD ELF64, open), rip = 0x80072f18c, rsp = 0x7fffffffead8, rbp = 0 --- > lock order reversal: > 1st 0xffffff8014bbbe58 bufwait (bufwait) @ /usr/src/sys/kern/vfs_bio.c:2659 > 2nd 0xffffff002b9d6400 dirhash (dirhash) @ /usr/src/sys/ufs/ufs/ufs_dirhash.c:283 > KDB: stack backtrace: > db_trace_self_wrapper() at db_trace_self_wrapper+0x2a > _witness_debugger() at _witness_debugger+0x2e > witness_checkorder() at witness_checkorder+0x807 > _sx_xlock() at _sx_xlock+0x55 > ufsdirhash_acquire() at ufsdirhash_acquire+0x33 > ufsdirhash_add() at ufsdirhash_add+0x19 > ufs_direnter() at ufs_direnter+0x662 > ufs_makeinode() at ufs_makeinode+0x291 > VOP_CREATE_APV() at VOP_CREATE_APV+0x8d > vn_open_cred() at vn_open_cred+0x46a > kern_openat() at kern_openat+0x181 > syscallenter() at syscallenter+0x1aa > syscall() at syscall+0x4c > Xfast_syscall() at Xfast_syscall+0xe2 > --- syscall (5, FreeBSD ELF64, open), rip = 0x80078118c, rsp = 0x7fffffffad48, rbp = 0x7fffffffb73f --- Just looking for advice on what to do about all this, can someone help? Thanks, Robert -- Robert