Skip site navigation (1)Skip section navigation (2)
Date:      Fri, 12 Feb 2010 10:00:04 GMT
From:      pluknet <pluknet@gmail.com>
To:        freebsd-gnats-submit@FreeBSD.org
Subject:   kern/143837: [irq] [panic] nmi_calltrap in irq257: bce1
Message-ID:  <201002121000.o1CA045m018314@www.freebsd.org>
Resent-Message-ID: <201002121010.o1CAA1CO070197@freefall.freebsd.org>

next in thread | raw e-mail | index | archive | help

>Number:         143837
>Category:       kern
>Synopsis:       [irq] [panic] nmi_calltrap in irq257: bce1
>Confidential:   no
>Severity:       non-critical
>Priority:       medium
>Responsible:    freebsd-bugs
>State:          open
>Quarter:        
>Keywords:       
>Date-Required:
>Class:          sw-bug
>Submitter-Id:   current-users
>Arrival-Date:   Fri Feb 12 10:10:01 UTC 2010
>Closed-Date:
>Last-Modified:
>Originator:     pluknet
>Release:        7.2-RELEASE-p5
>Organization:
>Environment:
FreeBSD host 7.2-RELEASE-p5 FreeBSD 7.2-RELEASE-p5 #22: Mon Dec 14 11:20:09 MSK 2009 root@XXX amd64
>Description:
This is somewhat connected to kern/143521 (? Not sure), kernels are from one /usr/obj, though it's a different box with different setup.

I've got NMI on an almost idle system - FreeBSD 7.2-R amd64, in irq257: bce1.

db> bt 38       
Tracing pid 38 tid 100037 td 0xffffff0001add6e0
cpustop_handler() at cpustop_handler+0x40
ipi_nmi_handler() at ipi_nmi_handler+0x30
trap() at trap+0x31c
nmi_calltrap() at nmi_calltrap+0x8
--- trap 0x13, rip = 0xffffffff80513df4, rsp = 0xfffffffe80038ff0, rbp = 0xfffffffe80141a40 ---
_thread_lock_flags() at _thread_lock_flags+0x64
hardclock_cpu() at hardclock_cpu+0x7d
lapic_handle_timer() at lapic_handle_timer+0x132
Xtimerint() at Xtimerint+0x67
--- interrupt, rip = 0xffffffff80513e03, rsp = 0xfffffffe80141b80, rbp = 0xfffffffe80141bc0 ---
_thread_lock_flags() at _thread_lock_flags+0x73
ithread_loop() at ithread_loop+0x255
fork_exit() at fork_exit+0x11f
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xfffffffe80141d30, rbp = 0 ---

(Again, the end part of backtrace is same as in kern/143521).

db> bt
Tracing pid 22 tid 100013 td 0xffffff0001970a50
kdb_enter_why() at kdb_enter_why+0x3d
siointr1() at siointr1+0x2c5
siointr() at siointr+0x58
intr_execute_handlers() at intr_execute_handlers+0x8b
Xapic_isr1() at Xapic_isr1+0x7f
--- interrupt, rip = 0xffffffff807e7fe3, rsp = 0xfffffffe800babc0, rbp = 0xfffffffe800babe0 ---
spinlock_exit() at spinlock_exit+0x33
sched_idletd() at sched_idletd+0x1ec
fork_exit() at fork_exit+0x11f
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xfffffffe800bad30, rbp = 0 ---

db> show allpcpu
Current CPU: 4

cpuid        = 0
curthread    = 0xffffff0001960a50: pid 26 "idle: cpu0"
curpcb       = 0xfffffffe800ced40
fpcurthread  = none
idlethread   = 0xffffff0001960a50: pid 26 "idle: cpu0"

cpuid        = 1
curthread    = 0xffffff0001970000: pid 25 "idle: cpu1"
curpcb       = 0xfffffffe800c9d40
fpcurthread  = none
idlethread   = 0xffffff0001970000: pid 25 "idle: cpu1"

cpuid        = 2
curthread    = 0xffffff0001970370: pid 24 "idle: cpu2"
curpcb       = 0xfffffffe800c4d40
fpcurthread  = none
idlethread   = 0xffffff0001970370: pid 24 "idle: cpu2"

cpuid        = 3
curthread    = 0xffffff0001add6e0: pid 38 "irq257: bce1"
curpcb       = 0xfffffffe80141d40
fpcurthread  = none
idlethread   = 0xffffff00019706e0: pid 23 "idle: cpu3"

cpuid        = 4
curthread    = 0xffffff0001970a50: pid 22 "idle: cpu4"
curpcb       = 0xfffffffe800bad40
fpcurthread  = none
idlethread   = 0xffffff0001970a50: pid 22 "idle: cpu4"

cpuid        = 5
curthread    = 0xffffff0001971000: pid 21 "idle: cpu5"
curpcb       = 0xfffffffe800b5d40
fpcurthread  = none
idlethread   = 0xffffff0001971000: pid 21 "idle: cpu5"

cpuid        = 6
curthread    = 0xffffff0001971370: pid 20 "idle: cpu6"
curpcb       = 0xfffffffe800b0d40
fpcurthread  = none
idlethread   = 0xffffff0001971370: pid 20 "idle: cpu6"

cpuid        = 7
curthread    = 0xffffff0001954370: pid 19 "idle: cpu7"
curpcb       = 0xfffffffe800abd40
fpcurthread  = none
idlethread   = 0xffffff0001954370: pid 19 "idle: cpu7"

cpuid        = 8
curthread    = 0xffffff00019546e0: pid 18 "idle: cpu8"
curpcb       = 0xfffffffe800a6d40
fpcurthread  = none
idlethread   = 0xffffff00019546e0: pid 18 "idle: cpu8"

cpuid        = 9
curthread    = 0xffffff0001954a50: pid 17 "idle: cpu9"
curpcb       = 0xfffffffe800a1d40
fpcurthread  = none
idlethread   = 0xffffff0001954a50: pid 17 "idle: cpu9"

cpuid        = 10
curthread    = 0xffffff0001960000: pid 16 "idle: cpu10"
curpcb       = 0xfffffffe8009cd40
fpcurthread  = none
idlethread   = 0xffffff0001960000: pid 16 "idle: cpu10"

cpuid        = 11
curthread    = 0xffffff0001960370: pid 15 "idle: cpu11"
curpcb       = 0xfffffffe80097d40
fpcurthread  = none
idlethread   = 0xffffff0001960370: pid 15 "idle: cpu11"

cpuid        = 12
curthread    = 0xffffff00019606e0: pid 14 "idle: cpu12"
curpcb       = 0xfffffffe80092d40
fpcurthread  = none
idlethread   = 0xffffff00019606e0: pid 14 "idle: cpu12"

cpuid        = 13
curthread    = 0xffffff0001953000: pid 13 "idle: cpu13"
curpcb       = 0xfffffffe8008dd40
fpcurthread  = none
idlethread   = 0xffffff0001953000: pid 13 "idle: cpu13"

cpuid        = 14
curthread    = 0xffffff0001953370: pid 12 "idle: cpu14"
curpcb       = 0xfffffffe80088d40
fpcurthread  = none
idlethread   = 0xffffff0001953370: pid 12 "idle: cpu14"

cpuid        = 15
curthread    = 0xffffff00019536e0: pid 11 "idle: cpu15"
curpcb       = 0xfffffffe80083d40
fpcurthread  = none
idlethread   = 0xffffff00019536e0: pid 11 "idle: cpu15"

(Again, allpcpu is same as in kern/143521).

alltrace below.. kernel is in sorta locking SNAFU state.

Tracing command cron pid 52736 tid 101283 td 0xffffff002b210a50
fork_trampoline() at fork_trampoline

Tracing command cron pid 52735 tid 100502 td 0xffffff002283f6e0
sched_switch() at sched_switch+0x1fe
mi_switch() at mi_switch+0x18e
turnstile_wait() at turnstile_wait+0x1ca
_mtx_lock_sleep() at _mtx_lock_sleep+0xb0
vm_fault() at vm_fault+0xec2
trap_pfault() at trap_pfault+0x132
trap() at trap+0x45b
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x80089823c, rsp = 0x7fffffffe530, rbp = 0x800b123a0 ---

Tracing command cron pid 52734 tid 101032 td 0xffffff004210e000
sched_switch() at sched_switch+0x1fe
mi_switch() at mi_switch+0x18e
turnstile_wait() at turnstile_wait+0x1ca
_mtx_lock_sleep() at _mtx_lock_sleep+0xb0
vm_fault() at vm_fault+0xec2
trap_pfault() at trap_pfault+0x132
trap() at trap+0x45b
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x80089823c, rsp = 0x7fffffffe530, rbp = 0x800b123a0 ---

Tracing command cron pid 52733 tid 100216 td 0xffffff0010ec7a50
sched_switch() at sched_switch+0x1fe
mi_switch() at mi_switch+0x18e
turnstile_wait() at turnstile_wait+0x1ca
_mtx_lock_sleep() at _mtx_lock_sleep+0xb0
vm_fault() at vm_fault+0xec2
trap_pfault() at trap_pfault+0x132
trap() at trap+0x45b
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x80089823c, rsp = 0x7fffffffe530, rbp = 0x800b123a0 ---

Tracing command cron pid 52732 tid 100838 td 0xffffff003abf1000
sched_switch() at sched_switch+0x1fe
mi_switch() at mi_switch+0x18e
turnstile_wait() at turnstile_wait+0x1ca
_mtx_lock_sleep() at _mtx_lock_sleep+0xb0
vm_fault() at vm_fault+0xec2
trap_pfault() at trap_pfault+0x132
trap() at trap+0x45b
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x80089823c, rsp = 0x7fffffffe530, rbp = 0x800b123a0 ---

Tracing command cron pid 52731 tid 100441 td 0xffffff0022b2e370
sched_switch() at sched_switch+0x1fe
mi_switch() at mi_switch+0x18e
turnstile_wait() at turnstile_wait+0x1ca
_mtx_lock_sleep() at _mtx_lock_sleep+0xb0
vm_fault() at vm_fault+0xec2
trap_pfault() at trap_pfault+0x132
trap() at trap+0x45b
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x80089823c, rsp = 0x7fffffffe530, rbp = 0x800b123a0 ---

Tracing command cron pid 52730 tid 100558 td 0xffffff0022381a50
sched_switch() at sched_switch+0x1fe
mi_switch() at mi_switch+0x18e
sleepq_wait() at sleepq_wait+0x3b
_sleep() at _sleep+0x367
fork1() at fork1+0x1210
vfork() at vfork+0x1c
syscall() at syscall+0x256
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (66, FreeBSD ELF64, vfork), rip = 0x8008a4add, rsp = 0x7fffffffe670, rbp = 0x800b12070 ---

Tracing command guard pid 52729 tid 100336 td 0xffffff0022ca1000
sched_switch() at sched_switch+0x1fe
mi_switch() at mi_switch+0x18e
sleepq_wait() at sleepq_wait+0x3b
_sleep() at _sleep+0x367
acquire() at acquire+0x7c
_lockmgr() at _lockmgr+0x203
ffs_lock() at ffs_lock+0x96
VOP_LOCK1_APV() at VOP_LOCK1_APV+0x46
_vn_lock() at _vn_lock+0x83
lookup() at lookup+0xde
namei() at namei+0x33e
kern_stat() at kern_stat+0x61
stat() at stat+0x2a
syscall() at syscall+0x256
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (188, FreeBSD ELF64, stat), rip = 0x80083165c, rsp = 0x7fffffffd8a8, rbp = 0x80094dec0 ---

Tracing command exim-4.71-0 pid 52728 tid 100175 td 0xffffff000565b000
sched_switch() at sched_switch+0x1fe
mi_switch() at mi_switch+0x18e
sleepq_wait() at sleepq_wait+0x3b
_sleep() at _sleep+0x367
acquire() at acquire+0x7c
_lockmgr() at _lockmgr+0x203
ffs_lock() at ffs_lock+0x96
VOP_LOCK1_APV() at VOP_LOCK1_APV+0x46
_vn_lock() at _vn_lock+0x83
lookup() at lookup+0xde
namei() at namei+0x33e
kern_execve() at kern_execve+0x20c
execve() at execve+0x3d
syscall() at syscall+0x256
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (59, FreeBSD ELF64, execve), rip = 0x8014e102c, rsp = 0x7fffffffe678, rbp = 0x80173b250 ---

Tracing command sh pid 52727 tid 100949 td 0xffffff00425cda50
sched_switch() at sched_switch+0x1fe
mi_switch() at mi_switch+0x18e
sleepq_wait() at sleepq_wait+0x3b
_sleep() at _sleep+0x367
acquire() at acquire+0x7c
_lockmgr() at _lockmgr+0x203
ffs_lock() at ffs_lock+0x96
VOP_LOCK1_APV() at VOP_LOCK1_APV+0x46
_vn_lock() at _vn_lock+0x83
lookup() at lookup+0xde
namei() at namei+0x33e
elf64_load_file() at elf64_load_file+0xc9
exec_elf64_imgact() at exec_elf64_imgact+0x901
kern_execve() at kern_execve+0x32e
execve() at execve+0x3d
syscall() at syscall+0x256
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (59, FreeBSD ELF64, execve), rip = 0x80091c02c, rsp = 0x7fffffffea48, rbp = 0x800b06258 ---

Tracing command cron pid 52726 tid 100219 td 0xffffff0005729370
sched_switch() at sched_switch+0x1fe
mi_switch() at mi_switch+0x18e
turnstile_wait() at turnstile_wait+0x1ca
_mtx_lock_sleep() at _mtx_lock_sleep+0xb0
vm_fault() at vm_fault+0xec2
trap_pfault() at trap_pfault+0x132
trap() at trap+0x45b
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x80089823c, rsp = 0x7fffffffe530, rbp = 0x800b12070 ---

Tracing command cron pid 52725 tid 100109 td 0xffffff0004d18a50
sched_switch() at sched_switch+0x1fe
mi_switch() at mi_switch+0x18e
turnstile_wait() at turnstile_wait+0x1ca
_mtx_lock_sleep() at _mtx_lock_sleep+0xb0
vnode_pager_lock() at vnode_pager_lock+0xa8
vm_fault() at vm_fault+0x1f4
trap_pfault() at trap_pfault+0x132
trap() at trap+0x45b
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x800912c41, rsp = 0x7fffffffe600, rbp = 0x1 ---

Tracing command cron pid 52724 tid 100852 td 0xffffff0005239370
sched_switch() at sched_switch+0x1fe
mi_switch() at mi_switch+0x18e
turnstile_wait() at turnstile_wait+0x1ca
_mtx_lock_sleep() at _mtx_lock_sleep+0xb0
vnode_pager_lock() at vnode_pager_lock+0xa8
vm_fault() at vm_fault+0x1f4
trap_pfault() at trap_pfault+0x132
trap() at trap+0x45b
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x800912c41, rsp = 0x7fffffffe600, rbp = 0x1 ---
        
Tracing command cron pid 52723 tid 101391 td 0xffffff0042643a50
sched_switch() at sched_switch+0x1fe
mi_switch() at mi_switch+0x18e
turnstile_wait() at turnstile_wait+0x1ca
_mtx_lock_sleep() at _mtx_lock_sleep+0xb0
vnode_pager_lock() at vnode_pager_lock+0xa8
vm_fault() at vm_fault+0x1f4
trap_pfault() at trap_pfault+0x132
trap() at trap+0x45b
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x800912c41, rsp = 0x7fffffffe600, rbp = 0x1 ---

Tracing command cron pid 52722 tid 100395 td 0xffffff0022b81000
sched_switch() at sched_switch+0x1fe
mi_switch() at mi_switch+0x18e
turnstile_wait() at turnstile_wait+0x1ca
_mtx_lock_sleep() at _mtx_lock_sleep+0xb0
vnode_pager_lock() at vnode_pager_lock+0xa8
vm_fault() at vm_fault+0x1f4
trap_pfault() at trap_pfault+0x132
trap() at trap+0x45b
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x800912c41, rsp = 0x7fffffffe600, rbp = 0x1 ---

Tracing command guard pid 52721 tid 100581 td 0xffffff002257e000
sched_switch() at sched_switch+0x1fe
mi_switch() at mi_switch+0x18e
sleepq_wait() at sleepq_wait+0x3b
_sleep() at _sleep+0x367
acquire() at acquire+0x7c
_lockmgr() at _lockmgr+0x203
ffs_lock() at ffs_lock+0x96
VOP_LOCK1_APV() at VOP_LOCK1_APV+0x46
_vn_lock() at _vn_lock+0x83
lookup() at lookup+0xde
namei() at namei+0x33e
kern_stat() at kern_stat+0x61
stat() at stat+0x2a
syscall() at syscall+0x256
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (188, FreeBSD ELF64, stat), rip = 0x80083165c, rsp = 0x7fffffffd8a8, rbp = 0x80094dec0 ---

Tracing command syslogd pid 52720 tid 101269 td 0xffffff002b2596e0
sched_switch() at sched_switch+0x1fe
mi_switch() at mi_switch+0x18e
sleepq_wait() at sleepq_wait+0x3b
_sleep() at _sleep+0x367
acquire() at acquire+0x7c
_lockmgr() at _lockmgr+0x203
ffs_lock() at ffs_lock+0x96
VOP_LOCK1_APV() at VOP_LOCK1_APV+0x46
_vn_lock() at _vn_lock+0x83
lookup() at lookup+0xde
namei() at namei+0x33e
kern_execve() at kern_execve+0x20c
execve() at execve+0x3d
syscall() at syscall+0x256
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (59, FreeBSD ELF64, execve), rip = 0x8007b102c, rsp = 0x7fffffffc7c8, rbp = 0x7fffffffccb0 ---
        
Tracing command cron pid 52719 tid 101259 td 0xffffff002b2a0a50
sched_switch() at sched_switch+0x1fe
mi_switch() at mi_switch+0x18e
sleepq_wait() at sleepq_wait+0x3b
_sleep() at _sleep+0x367
acquire() at acquire+0x7c
_lockmgr() at _lockmgr+0x203
ffs_lock() at ffs_lock+0x96
VOP_LOCK1_APV() at VOP_LOCK1_APV+0x46
_vn_lock() at _vn_lock+0x83
lookup() at lookup+0xde
namei() at namei+0x33e
unp_connect() at unp_connect+0x17a
uipc_connect() at uipc_connect+0x53
kern_connect() at kern_connect+0xae
connect() at connect+0x41
syscall() at syscall+0x256
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (98, FreeBSD ELF64, connect), rip = 0x80091a03c, rsp = 0x7fffffffd7b8, rbp = 0x76697270676f6c2f ---
        
Tracing command cron pid 52718 tid 100715 td 0xffffff002b11fa50
sched_switch() at sched_switch+0x1fe
mi_switch() at mi_switch+0x18e
turnstile_wait() at turnstile_wait+0x1ca
_mtx_lock_sleep() at _mtx_lock_sleep+0xb0
vnode_pager_lock() at vnode_pager_lock+0xa8
vm_fault() at vm_fault+0x1f4
trap_pfault() at trap_pfault+0x132
trap() at trap+0x45b
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x800912c41, rsp = 0x7fffffffe600, rbp = 0x1 ---

Tracing command cron pid 52717 tid 100842 td 0xffffff001028fa50
sched_switch() at sched_switch+0x1fe
mi_switch() at mi_switch+0x18e
sleepq_wait() at sleepq_wait+0x3b
_sleep() at _sleep+0x367
acquire() at acquire+0x7c
_lockmgr() at _lockmgr+0x203
ffs_lock() at ffs_lock+0x96
VOP_LOCK1_APV() at VOP_LOCK1_APV+0x46
_vn_lock() at _vn_lock+0x83
lookup() at lookup+0xde
namei() at namei+0x33e
unp_connect() at unp_connect+0x17a
uipc_connect() at uipc_connect+0x53
kern_connect() at kern_connect+0xae
connect() at connect+0x41
syscall() at syscall+0x256
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (98, FreeBSD ELF64, connect), rip = 0x80091a03c, rsp = 0x7fffffffd7b8, rbp = 0x76697270676f6c2f ---

Tracing command cron pid 52716 tid 100837 td 0xffffff002b496a50
sched_switch() at sched_switch+0x1fe
mi_switch() at mi_switch+0x18e
turnstile_wait() at turnstile_wait+0x1ca
_mtx_lock_sleep() at _mtx_lock_sleep+0xb0
vnode_pager_lock() at vnode_pager_lock+0xa8
vm_fault() at vm_fault+0x1f4
trap_pfault() at trap_pfault+0x132
trap() at trap+0x45b
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x800912c41, rsp = 0x7fffffffe600, rbp = 0x1 ---

Tracing command cron pid 52715 tid 100681 td 0xffffff00225ada50
sched_switch() at sched_switch+0x1fe
mi_switch() at mi_switch+0x18e
turnstile_wait() at turnstile_wait+0x1ca
_mtx_lock_sleep() at _mtx_lock_sleep+0xb0
vnode_pager_lock() at vnode_pager_lock+0xa8
vm_fault() at vm_fault+0x1f4
trap_pfault() at trap_pfault+0x132
trap() at trap+0x45b
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x800912c41, rsp = 0x7fffffffe600, rbp = 0x1 ---

Tracing command cron pid 52714 tid 100753 td 0xffffff002b06ca50
sched_switch() at sched_switch+0x1fe
mi_switch() at mi_switch+0x18e
sleepq_wait() at sleepq_wait+0x3b
_sleep() at _sleep+0x367
acquire() at acquire+0x7c
_lockmgr() at _lockmgr+0x203
ffs_lock() at ffs_lock+0x96
VOP_LOCK1_APV() at VOP_LOCK1_APV+0x46
_vn_lock() at _vn_lock+0x83
lookup() at lookup+0xde
namei() at namei+0x33e
unp_connect() at unp_connect+0x17a
uipc_connect() at uipc_connect+0x53
kern_connect() at kern_connect+0xae
connect() at connect+0x41
syscall() at syscall+0x256
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (98, FreeBSD ELF64, connect), rip = 0x80091a03c, rsp = 0x7fffffffd7b8, rbp = 0x76697270676f6c2f ---

Tracing command cron pid 52713 tid 101000 td 0xffffff00425d8a50
sched_switch() at sched_switch+0x1fe
mi_switch() at mi_switch+0x18e
turnstile_wait() at turnstile_wait+0x1ca
_mtx_lock_sleep() at _mtx_lock_sleep+0xb0
vnode_pager_lock() at vnode_pager_lock+0xa8
vm_fault() at vm_fault+0x1f4
trap_pfault() at trap_pfault+0x132
trap() at trap+0x45b
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x800912c41, rsp = 0x7fffffffe600, rbp = 0x1 ---

Tracing command cron pid 52712 tid 101225 td 0xffffff0042781000
sched_switch() at sched_switch+0x1fe
mi_switch() at mi_switch+0x18e
turnstile_wait() at turnstile_wait+0x1ca
_mtx_lock_sleep() at _mtx_lock_sleep+0xb0
vnode_pager_lock() at vnode_pager_lock+0xa8
vm_fault() at vm_fault+0x1f4
trap_pfault() at trap_pfault+0x132
trap() at trap+0x45b
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x800912c41, rsp = 0x7fffffffe600, rbp = 0x1 ---
        
Tracing command cron pid 52711 tid 100280 td 0xffffff0022bc4a50
sched_switch() at sched_switch+0x1fe
mi_switch() at mi_switch+0x18e
sleepq_wait() at sleepq_wait+0x3b
_sleep() at _sleep+0x367
acquire() at acquire+0x7c
_lockmgr() at _lockmgr+0x203
ffs_lock() at ffs_lock+0x96
VOP_LOCK1_APV() at VOP_LOCK1_APV+0x46
_vn_lock() at _vn_lock+0x83
lookup() at lookup+0xde
namei() at namei+0x33e
unp_connect() at unp_connect+0x17a
uipc_connect() at uipc_connect+0x53
kern_connect() at kern_connect+0xae
connect() at connect+0x41
syscall() at syscall+0x256
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (98, FreeBSD ELF64, connect), rip = 0x80091a03c, rsp = 0x7fffffffd7b8, rbp = 0x76697270676f6c2f ---
        
Tracing command cron pid 52710 tid 100358 td 0xffffff0022b2f370
sched_switch() at sched_switch+0x1fe
mi_switch() at mi_switch+0x18e
turnstile_wait() at turnstile_wait+0x1ca
_mtx_lock_sleep() at _mtx_lock_sleep+0xb0
vnode_pager_lock() at vnode_pager_lock+0xa8
vm_fault() at vm_fault+0x1f4
trap_pfault() at trap_pfault+0x132
trap() at trap+0x45b
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x800912c41, rsp = 0x7fffffffe600, rbp = 0x1 ---

Tracing command crond pid 52709 tid 100771 td 0xffffff002b019370
sched_switch() at sched_switch+0x1fe
mi_switch() at mi_switch+0x18e
sleepq_wait() at sleepq_wait+0x3b
_sleep() at _sleep+0x367
acquire() at acquire+0x7c
_lockmgr() at _lockmgr+0x203
ffs_lock() at ffs_lock+0x96
VOP_LOCK1_APV() at VOP_LOCK1_APV+0x46
_vn_lock() at _vn_lock+0x83
lookup() at lookup+0xde
namei() at namei+0x33e
kern_execve() at kern_execve+0x20c
execve() at execve+0x3d
syscall() at syscall+0x256
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (59, FreeBSD ELF64, execve), rip = 0x80080802c, rsp = 0x7fffffffd6d8, rbp = 0 ---

Tracing command cron pid 52708 tid 100935 td 0xffffff00425cea50
fork_trampoline() at fork_trampoline

Tracing command cron pid 52707 tid 100631 td 0xffffff0022447370
fork_trampoline() at fork_trampoline

Tracing command proftpd pid 52706 tid 100488 td 0xffffff0022d7b6e0
sched_switch() at sched_switch+0x1fe
mi_switch() at mi_switch+0x18e
ast() at ast+0x1e8
doreti_ast() at doreti_ast+0x1f

Tracing command sshd pid 52705 tid 101198 td 0xffffff02809a06e0
sched_switch() at sched_switch+0x1fe
mi_switch() at mi_switch+0x18e
turnstile_wait() at turnstile_wait+0x1ca
_mtx_lock_sleep() at _mtx_lock_sleep+0xb0
vm_fault() at vm_fault+0x623
trap_pfault() at trap_pfault+0x132
trap() at trap+0x45b
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x40d1a6, rsp = 0x7fffffffe5d0, rbp = 0x1 ---

Tracing command sshd pid 52704 tid 101182 td 0xffffff00426436e0
sched_switch() at sched_switch+0x1fe
mi_switch() at mi_switch+0x18e
sleepq_wait() at sleepq_wait+0x3b
_sx_xlock_hard() at _sx_xlock_hard+0x1ee
userland_sysctl() at userland_sysctl+0x1df
__sysctl() at __sysctl+0xaa
syscall() at syscall+0x256
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (202, FreeBSD ELF64, __sysctl), rip = 0x80139837c, rsp = 0x7fffffffe488, rbp = 0x1 ---

Tracing command sshd pid 52703 tid 100927 td 0xffffff002b094000
sched_switch() at sched_switch+0x1fe
mi_switch() at mi_switch+0x18e
ipi_bitmap_handler() at ipi_bitmap_handler+0xa4
Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x76
--- interrupt, rip = 0xffffffff80513df6, rsp = 0xffffffff7e74cbf0, rbp = 0xffffffff7e74cc30 ---
_thread_lock_flags() at _thread_lock_flags+0x66
ast() at ast+0x6a
doreti_ast() at doreti_ast+0x1f

Tracing command sshd pid 52702 tid 100773 td 0xffffff002b265000
sched_switch() at sched_switch+0x1fe
mi_switch() at mi_switch+0x18e
sleepq_wait() at sleepq_wait+0x3b
_sleep() at _sleep+0x367
acquire() at acquire+0x7c
_lockmgr() at _lockmgr+0x203
ffs_lock() at ffs_lock+0x96
VOP_LOCK1_APV() at VOP_LOCK1_APV+0x46
_vn_lock() at _vn_lock+0x83
vget() at vget+0xf9
cache_lookup() at cache_lookup+0x2b8
vfs_cache_lookup() at vfs_cache_lookup+0xc3
VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x40
lookup() at lookup+0x526
namei() at namei+0x33e
kern_access() at kern_access+0x84
syscall() at syscall+0x256
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (33, FreeBSD ELF64, access), rip = 0x80053fcac, rsp = 0x7fffffffe7d8, rbp = 0x7fffffffe830 ---

Tracing command sshd pid 52701 tid 101050 td 0xffffff0004d906e0
sched_switch() at sched_switch+0x1fe
mi_switch() at mi_switch+0x18e
sleepq_wait() at sleepq_wait+0x3b
_sleep() at _sleep+0x367
acquire() at acquire+0x7c
_lockmgr() at _lockmgr+0x203
ffs_lock() at ffs_lock+0x96
VOP_LOCK1_APV() at VOP_LOCK1_APV+0x46
_vn_lock() at _vn_lock+0x83
lookup() at lookup+0xde
namei() at namei+0x33e
elf64_load_file() at elf64_load_file+0xc9
exec_elf64_imgact() at exec_elf64_imgact+0x901
kern_execve() at kern_execve+0x32e
execve() at execve+0x3d
syscall() at syscall+0x256
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (59, FreeBSD ELF64, execve), rip = 0x80131c02c, rsp = 0x7fffffffe5b8, rbp = 0x1 ---

Tracing command cron pid 52700 tid 100578 td 0xffffff00223806e0
sched_switch() at sched_switch+0x1fe
mi_switch() at mi_switch+0x18e
sleepq_wait() at sleepq_wait+0x3b
_sleep() at _sleep+0x367
acquire() at acquire+0x7c
_lockmgr() at _lockmgr+0x668
ffs_lock() at ffs_lock+0x96
VOP_LOCK1_APV() at VOP_LOCK1_APV+0x46
_vn_lock() at _vn_lock+0x83
vget() at vget+0xf9
cache_lookup() at cache_lookup+0x2b8
vfs_cache_lookup() at vfs_cache_lookup+0xc3
VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x40
lookup() at lookup+0x526
namei() at namei+0x33e
kern_stat() at kern_stat+0x61
stat() at stat+0x2a
syscall() at syscall+0x256
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (188, FreeBSD ELF64, stat), rip = 0x80092665c, rsp = 0x7fffffffdfe8, rbp = 0x800b18800 ---

Tracing command cron pid 52699 tid 100988 td 0xffffff0042173000
sched_switch() at sched_switch+0x1fe
mi_switch() at mi_switch+0x18e
sleepq_wait() at sleepq_wait+0x3b
_sx_xlock_hard() at _sx_xlock_hard+0x1ee
userland_sysctl() at userland_sysctl+0x1df
__sysctl() at __sysctl+0xaa
syscall() at syscall+0x256
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (202, FreeBSD ELF64, __sysctl), rip = 0x80093537c, rsp = 0x7fffffffe528, rbp = 0x800b12070 ---

Tracing command cron pid 52698 tid 101135 td 0xffffff00425ca370
sched_switch() at sched_switch+0x1fe
mi_switch() at mi_switch+0x18e
turnstile_wait() at turnstile_wait+0x1ca
_mtx_lock_sleep() at _mtx_lock_sleep+0xb0
vm_fault() at vm_fault+0x623
trap_pfault() at trap_pfault+0x132
trap() at trap+0x45b
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x800933448, rsp = 0x7fffffffe470, rbp = 0x480 ---

Tracing command cron pid 52697 tid 100459 td 0xffffff0022b816e0
sched_switch() at sched_switch+0x1fe
mi_switch() at mi_switch+0x18e
sleepq_wait() at sleepq_wait+0x3b
_sleep() at _sleep+0x367
fork1() at fork1+0x1210
vfork() at vfork+0x1c
syscall() at syscall+0x256
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (66, FreeBSD ELF64, vfork), rip = 0x8008a4add, rsp = 0x7fffffffe670, rbp = 0x800b123a0 ---

Tracing command cron pid 52696 tid 100858 td 0xffffff00421206e0
sched_switch() at sched_switch+0x1fe
mi_switch() at mi_switch+0x18e
turnstile_wait() at turnstile_wait+0x1ca
_mtx_lock_sleep() at _mtx_lock_sleep+0xb0
vnode_pager_lock() at vnode_pager_lock+0xa8
vm_fault() at vm_fault+0x1f4
trap_pfault() at trap_pfault+0x132
trap() at trap+0x45b
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x800933448, rsp = 0x7fffffffe470, rbp = 0x480 ---

Tracing command cron pid 52695 tid 100816 td 0xffffff002b210370
sched_switch() at sched_switch+0x1fe
mi_switch() at mi_switch+0x18e
turnstile_wait() at turnstile_wait+0x1ca
_mtx_lock_sleep() at _mtx_lock_sleep+0xb0
vnode_pager_lock() at vnode_pager_lock+0xa8
vm_fault() at vm_fault+0x1f4
trap_pfault() at trap_pfault+0x132
trap() at trap+0x45b
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x800933448, rsp = 0x7fffffffe470, rbp = 0x480 ---

Tracing command cron pid 52694 tid 100747 td 0xffffff002b2a6370
sched_switch() at sched_switch+0x1fe
mi_switch() at mi_switch+0x18e
turnstile_wait() at turnstile_wait+0x1ca
_mtx_lock_sleep() at _mtx_lock_sleep+0xb0
vnode_pager_lock() at vnode_pager_lock+0xa8
vm_fault() at vm_fault+0x1f4
trap_pfault() at trap_pfault+0x132
trap() at trap+0x45b
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x800933448, rsp = 0x7fffffffe470, rbp = 0x480 ---

Tracing command cron pid 52693 tid 100759 td 0xffffff002b22c6e0
sched_switch() at sched_switch+0x1fe
mi_switch() at mi_switch+0x18e
sleepq_wait() at sleepq_wait+0x3b
_sleep() at _sleep+0x367
acquire() at acquire+0x7c
_lockmgr() at _lockmgr+0x203
ffs_lock() at ffs_lock+0x96
VOP_LOCK1_APV() at VOP_LOCK1_APV+0x46
_vn_lock() at _vn_lock+0x83
lookup() at lookup+0xde
namei() at namei+0x33e
vn_open_cred() at vn_open_cred+0x3ae
kern_open() at kern_open+0x110
syscall() at syscall+0x256
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (5, FreeBSD ELF64, open), rip = 0x800512c6c, rsp = 0x7fffffffe1c8, rbp = 0x800b27780 ---

Tracing command cron pid 52692 tid 101245 td 0xffffff026fafd000
sched_switch() at sched_switch+0x1fe
mi_switch() at mi_switch+0x18e
sleepq_wait() at sleepq_wait+0x3b
_sleep() at _sleep+0x367
fork1() at fork1+0x1210
vfork() at vfork+0x1c
syscall() at syscall+0x256
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (66, FreeBSD ELF64, vfork), rip = 0x8008a4add, rsp = 0x7fffffffe670, rbp = 0x800b12070 ---

Tracing command cron pid 52691 tid 101028 td 0xffffff00426586e0
sched_switch() at sched_switch+0x1fe
mi_switch() at mi_switch+0x18e
sleepq_wait() at sleepq_wait+0x3b
_sleep() at _sleep+0x367
fork1() at fork1+0x1210
vfork() at vfork+0x1c
syscall() at syscall+0x256
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (66, FreeBSD ELF64, vfork), rip = 0x8008a4add, rsp = 0x7fffffffe670, rbp = 0x800b123a0 ---

Tracing command cron pid 52690 tid 101010 td 0xffffff002b222370
sched_switch() at sched_switch+0x1fe
mi_switch() at mi_switch+0x18e
sleepq_wait() at sleepq_wait+0x3b
_sleep() at _sleep+0x367
acquire() at acquire+0x7c
_lockmgr() at _lockmgr+0x203
ffs_lock() at ffs_lock+0x96
VOP_LOCK1_APV() at VOP_LOCK1_APV+0x46
_vn_lock() at _vn_lock+0x83
lookup() at lookup+0xde
namei() at namei+0x33e
vn_open_cred() at vn_open_cred+0x3ae
kern_open() at kern_open+0x110
syscall() at syscall+0x256
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (5, FreeBSD ELF64, open), rip = 0x800512c6c, rsp = 0x7fffffffe1c8, rbp = 0x800b27780 ---

Tracing command cron pid 52689 tid 100633 td 0xffffff001e7b5a50
sched_switch() at sched_switch+0x1fe
mi_switch() at mi_switch+0x18e
ast() at ast+0x1e8
doreti_ast() at doreti_ast+0x1f
[... more, more omitted ..]
>How-To-Repeat:

>Fix:
Not known.

>Release-Note:
>Audit-Trail:
>Unformatted:



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?201002121000.o1CA045m018314>