Skip site navigation (1)Skip section navigation (2)
Date:      Sun, 06 Feb 2011 12:04:59 -0500
From:      Robert Fitzpatrick <robert@webtent.org>
To:        FreeBSD <freebsd-questions@freebsd.org>
Subject:   kern.crit messages
Message-ID:  <4D4ED4BB.5090704@webtent.org>

Next in thread | Raw E-Mail | Index | Archive | Help
I have a server I installed 8.1-RELEASE on and believe I screwed up when
rebuilding the kernel to support QUOTA because now that I am
troubleshooting these weird messages in the log, I find I am actually
running 9.0-CURRENT. I had a ports file as below when I pulled the
source to rebuild the kernel...

*default host=cvsup9.us.FreeBSD.org
*default base=/usr
*default prefix=/usr
*default release=cvs tag=.
*default release=cvs delete use-rel-suffix compress
src-all

Using the tag above caused my issue? Now I see some troubling messages
in my logs...

> Feb  6 11:25:23 <kern.crit> backup kernel: lock order reversal:
> Feb  6 11:25:23 <kern.crit> backup kernel: 1st 0xffffff8014bbbe58 bufwait (bufwait) @ /usr/src/sys/kern/vfs_bio.c:2659
> Feb  6 11:25:23 <kern.crit> backup kernel: 2nd 0xffffff002b9d6400 dirhash (dirhash) @ /usr/src/sys/ufs/ufs/ufs_dirhash.c:283
> Feb  6 11:25:23 <kern.crit> backup kernel: KDB: stack backtrace:
> Feb  6 11:25:23 <kern.crit> backup kernel: db_trace_self_wrapper() at db_trace_self_wrapper+0x2a
> Feb  6 11:25:23 <kern.crit> backup kernel: _witness_debugger() at _witness_debugger+0x2e
> Feb  6 11:25:23 <kern.crit> backup kernel: witness_checkorder() at witness_checkorder+0x807
> Feb  6 11:25:23 <kern.crit> backup kernel: _sx_xlock() at _sx_xlock+0x55
> Feb  6 11:25:23 <kern.crit> backup kernel: ufsdirhash_acquire() at ufsdirhash_acquire+0x33
> Feb  6 11:25:23 <kern.crit> backup kernel: ufsdirhash_add() at ufsdirhash_add+0x19
> Feb  6 11:25:23 <kern.crit> backup kernel: ufs_direnter() at ufs_direnter+0x662
> Feb  6 11:25:23 <kern.crit> backup kernel: ufs_makeinode() at ufs_makeinode+0x291
> Feb  6 11:25:23 <kern.crit> backup kernel: VOP_CREATE_APV() at VOP_CREATE_APV+0x8d
> Feb  6 11:25:23 <kern.crit> backup kernel: vn_open_cred() at vn_open_cred+0x46a
> Feb  6 11:25:23 <kern.crit> backup kernel: kern_openat() at kern_openat+0x181
> Feb  6 11:25:23 <kern.crit> backup kernel: syscallenter() at syscallenter+0x1aa
> Feb  6 11:25:23 <kern.crit> backup kernel: syscall() at syscall+0x4c
> Feb  6 11:25:23 <kern.crit> backup kernel: Xfast_syscall() at Xfast_syscall+0xe2
> Feb  6 11:25:23 <kern.crit> backup kernel: --- syscall (5, FreeBSD ELF64, open), rip = 0x80078118c, rsp = 0x7fffffffad48, rbp = 0x7fffffffb73f ---

I also find this message with dmesg...

> ad8: 152627MB <Seagate ST3160811AS 3.AAE> at ata4-master UDMA100 SATA
> ad9: 953869MB <Seagate ST31000528AS CC3E> at ata4-slave UDMA100 SATA
> GEOM: ad8s1: geometry does not match label (255h,63s != 16h,63s).
> ad10: 152627MB <Seagate ST3160811AS 3.AAE> at ata5-master UDMA100 SATA
> ad11: 953869MB <Seagate ST31000528AS CC3E> at ata5-slave UDMA100 SATA
> GEOM: ad9s1: geometry does not match label (255h,63s != 16h,63s).
> uhub0: 2 ports with 2 removable, self powered
> uhub1: 2 ports with 2 removable, self powered
> uhub2: 2 ports with 2 removable, self powered
> uhub3: 2 ports with 2 removable, self powered
> GEOM: ufsid/4c7aa872e9a44575: geometry does not match label (255h,63s != 16h,63s).
> GEOM: ad10s1: geometry does not match label (255h,63s != 16h,63s).
> GEOM: ad11s1: geometry does not match label (255h,63s != 16h,63s).
> uhub4: 8 ports with 8 removable, self powered
> ar0: 152627MB <Intel MatrixRAID RAID1> status: READY
> ar0: disk0 READY (master) using ad8 at ata4-master
> ar0: disk1 READY (mirror) using ad10 at ata5-master
> ar1: 953869MB <Intel MatrixRAID RAID1> status: READY
> ar1: disk0 READY (master) using ad11 at ata5-slave
> ar1: disk1 READY (mirror) using ad9 at ata4-slave
> SMP: AP CPU #1 Launched!
> WARNING: WITNESS option enabled, expect reduced performance.
> ugen1.2: <Rextron> at usbus1
> ukbd0: <USB> on usbus1
> kbd2 at ukbd0
> ums0: <USB> on usbus1
> ums0: 5 buttons and [XYZ] coordinates ID=1
> Trying to mount root from ufs:/dev/ar0s1a
> lock order reversal:
>  1st 0xffffff0002cdd818 ufs (ufs) @ /usr/src/sys/kern/vfs_lookup.c:501
>  2nd 0xffffff801497ff78 bufwait (bufwait) @ /usr/src/sys/ufs/ffs/ffs_softdep.c:11309
>  3rd 0xffffff0002d4fbd8 ufs (ufs) @ /usr/src/sys/kern/vfs_subr.c:2111
> KDB: stack backtrace:
> db_trace_self_wrapper() at db_trace_self_wrapper+0x2a
> _witness_debugger() at _witness_debugger+0x2e
> witness_checkorder() at witness_checkorder+0x807
> __lockmgr_args() at __lockmgr_args+0xd42
> ffs_lock() at ffs_lock+0x8c
> VOP_LOCK1_APV() at VOP_LOCK1_APV+0x9b
> _vn_lock() at _vn_lock+0x47
> vget() at vget+0x7b
> vfs_hash_get() at vfs_hash_get+0xd5
> ffs_vgetf() at ffs_vgetf+0x48
> softdep_sync_metadata() at softdep_sync_metadata+0x5e3
> ffs_syncvnode() at ffs_syncvnode+0x213
> ffs_truncate() at ffs_truncate+0x557
> ufs_direnter() at ufs_direnter+0x47b
> ufs_makeinode() at ufs_makeinode+0x291
> VOP_CREATE_APV() at VOP_CREATE_APV+0x8d
> vn_open_cred() at vn_open_cred+0x46a
> kern_openat() at kern_openat+0x181
> syscallenter() at syscallenter+0x1aa
> syscall() at syscall+0x4c
> Xfast_syscall() at Xfast_syscall+0xe2
> --- syscall (5, FreeBSD ELF64, open), rip = 0x80072f18c, rsp = 0x7fffffffead8, rbp = 0 ---
> lock order reversal:
>  1st 0xffffff8014bbbe58 bufwait (bufwait) @ /usr/src/sys/kern/vfs_bio.c:2659
>  2nd 0xffffff002b9d6400 dirhash (dirhash) @ /usr/src/sys/ufs/ufs/ufs_dirhash.c:283
> KDB: stack backtrace:
> db_trace_self_wrapper() at db_trace_self_wrapper+0x2a
> _witness_debugger() at _witness_debugger+0x2e
> witness_checkorder() at witness_checkorder+0x807
> _sx_xlock() at _sx_xlock+0x55
> ufsdirhash_acquire() at ufsdirhash_acquire+0x33
> ufsdirhash_add() at ufsdirhash_add+0x19
> ufs_direnter() at ufs_direnter+0x662
> ufs_makeinode() at ufs_makeinode+0x291
> VOP_CREATE_APV() at VOP_CREATE_APV+0x8d
> vn_open_cred() at vn_open_cred+0x46a
> kern_openat() at kern_openat+0x181
> syscallenter() at syscallenter+0x1aa
> syscall() at syscall+0x4c
> Xfast_syscall() at Xfast_syscall+0xe2
> --- syscall (5, FreeBSD ELF64, open), rip = 0x80078118c, rsp = 0x7fffffffad48, rbp = 0x7fffffffb73f ---

Just looking for advice on what to do about all this, can someone help?

Thanks, Robert
--
Robert <robert@webtent.org>



Want to link to this message? Use this URL: <http://docs.FreeBSD.org/cgi/mid.cgi?4D4ED4BB.5090704>