Date: Sun, 2 Mar 2008 19:43:45 GMT From: Alexey Sopov <admin@aknet.ru> To: freebsd-gnats-submit@FreeBSD.org Subject: kern/121298: [panic] Fatal trap 12: page fault while in kernel mode (em0 taskq) Message-ID: <200803021943.m22JhjJ3096085@www.freebsd.org> Resent-Message-ID: <200803021950.m22Jo0EP041841@freefall.freebsd.org>
next in thread | raw e-mail | index | archive | help
>Number: 121298
>Category: kern
>Synopsis: [panic] Fatal trap 12: page fault while in kernel mode (em0 taskq)
>Confidential: no
>Severity: critical
>Priority: high
>Responsible: freebsd-bugs
>State: open
>Quarter:
>Keywords:
>Date-Required:
>Class: sw-bug
>Submitter-Id: current-users
>Arrival-Date: Sun Mar 02 19:50:00 UTC 2008
>Closed-Date:
>Last-Modified:
>Originator: Alexey Sopov
>Release: 7.0-RELEASE
>Organization:
AkademNET
>Environment:
FreeBSD router.aknet.ru 7.0-RELEASE FreeBSD 7.0-RELEASE #15: Sat Mar 1 21:40:49 MSK 2008 root@router.aknet.ru:/usr/obj/usr/src/sys/proliant-dl385 amd64
>Description:
Machine is a ProLiant DL-385. It acts as a network router. There are a dualport gigabit ethernet em-based controller at PCI-X 133 slot.
Both ports are connected to a ProCurve 3400 switch and each of them holds about 60 VLANS. Machine routes about 200kpps.
Panic happened when I tried to enable polling: ifconfig em0 polling
# cat /var/run/dmesg.boot
Copyright (c) 1992-2008 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 7.0-RELEASE #15: Sat Mar 1 21:40:49 MSK 2008
root@router:/usr/obj/usr/src/sys/proliant-dl385
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: AMD Opteron(tm) Processor 250 (2405.47-MHz K8-class CPU)
Origin = "AuthenticAMD" Id = 0x20f51 Stepping = 1
Features=0x78bfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2>
Features2=0x1<SSE3>
AMD Features=0xe2500800<SYSCALL,NX,MMX+,FFXSR,LM,3DNow!+,3DNow!>
usable memory = 2138902528 (2039 MB)
avail memory = 2064269312 (1968 MB)
ACPI APIC Table: <HP 00000083>
FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs
cpu0 (BSP): APIC ID: 0
cpu1 (AP): APIC ID: 1
MADT: Forcing active-low polarity and level trigger for SCI
ioapic0 <Version 1.1> irqs 0-23 on motherboard
ioapic1 <Version 1.1> irqs 24-27 on motherboard
ioapic2 <Version 1.1> irqs 28-31 on motherboard
ioapic3 <Version 1.1> irqs 32-35 on motherboard
ioapic4 <Version 1.1> irqs 36-39 on motherboard
kbd1 at kbdmux0
acpi0: <HP A05> on motherboard
acpi0: [ITHREAD]
acpi0: Power Button (fixed)
Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000
acpi_timer0: <32-bit timer at 3.579545MHz> port 0x908-0x90b on acpi0
cpu0: <ACPI CPU> on acpi0
powernow0: <Cool`n'Quiet K8> on cpu0
cpu1: <ACPI CPU> on acpi0
powernow1: <Cool`n'Quiet K8> on cpu1
pcib0: <ACPI Host-PCI bridge> on acpi0
pci0: <ACPI PCI bus> on pcib0
pcib1: <ACPI PCI-PCI bridge> at device 3.0 on pci0
pci1: <ACPI PCI bus> on pcib1
ohci0: <OHCI (generic) USB controller> mem 0xf7cf0000-0xf7cf0fff irq 19 at device 0.0 on pci1
ohci0: [GIANT-LOCKED]
ohci0: [ITHREAD]
usb0: OHCI version 1.0, legacy support
usb0: SMM does not respond, resetting
usb0: <OHCI (generic) USB controller> on ohci0
usb0: USB revision 1.0
uhub0: <AMD OHCI root hub, class 9/0, rev 1.00/1.00, addr 1> on usb0
uhub0: 3 ports with 3 removable, self powered
ohci1: <OHCI (generic) USB controller> mem 0xf7ce0000-0xf7ce0fff irq 19 at device 0.1 on pci1
ohci1: [GIANT-LOCKED]
ohci1: [ITHREAD]
usb1: OHCI version 1.0, legacy support
usb1: SMM does not respond, resetting
usb1: <OHCI (generic) USB controller> on ohci1
usb1: USB revision 1.0
uhub1: <AMD OHCI root hub, class 9/0, rev 1.00/1.00, addr 1> on usb1
uhub1: 3 ports with 3 removable, self powered
pci1: <base peripheral> at device 2.0 (no driver attached)
pci1: <base peripheral> at device 2.2 (no driver attached)
vgapci0: <VGA-compatible display> port 0x4400-0x44ff mem 0xf6000000-0xf6ffffff,0xf5ff0000-0xf5ff0fff at device 3.0 on pci1
drm0: <Rage XL> on vgapci0
info: [drm] Initialized mach64 1.0.0 20020904
isab0: <PCI-ISA bridge> at device 4.0 on pci0
isa0: <ISA bus> on isab0
atapci0: <AMD 8111 UDMA133 controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x2000-0x200f at device 4.1 on pci0
ata0: <ATA channel 0> on atapci0
ata0: [ITHREAD]
ata1: <ATA channel 1> on atapci0
ata1: [ITHREAD]
amdpm0: <AMD 756/766/768/8111 Power Management Controller> port 0x9e0-0x9ff at device 4.3 on pci0
smbus0: <System Management Bus> on amdpm0
smb0: <SMBus generic I/O> on smbus0
pcib2: <ACPI PCI-PCI bridge> at device 7.0 on pci0
pci2: <ACPI PCI bus> on pcib2
ciss0: <HP Smart Array 6i> port 0x5000-0x50ff mem 0xf7df0000-0xf7df1fff,0xf7d80000-0xf7dbffff irq 24 at device 4.0 on pci2
ciss0: [ITHREAD]
pcib3: <ACPI PCI-PCI bridge> at device 8.0 on pci0
pci3: <ACPI PCI bus> on pcib3
bge0: <HP NC7782 Gigabit Server Adapter, ASIC rev. 0x2100> mem 0xf7ef0000-0xf7efffff irq 28 at device 6.0 on pci3
miibus0: <MII bus> on bge0
brgphy0: <BCM5704 10/100/1000baseTX PHY> PHY 1 on miibus0
brgphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-FDX, auto
bge0: Ethernet address: 00:17:a4:10:88:30
bge0: [ITHREAD]
bge1: <HP NC7782 Gigabit Server Adapter, ASIC rev. 0x2100> mem 0xf7ee0000-0xf7eeffff irq 29 at device 6.1 on pci3
miibus1: <MII bus> on bge1
brgphy1: <BCM5704 10/100/1000baseTX PHY> PHY 1 on miibus1
brgphy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-FDX, auto
bge1: Ethernet address: 00:17:a4:10:88:2f
bge1: [ITHREAD]
pcib4: <ACPI Host-PCI bridge> on acpi0
pci4: <ACPI PCI bus> on pcib4
pcib5: <ACPI PCI-PCI bridge> at device 9.0 on pci4
pci5: <ACPI PCI bus> on pcib5
pcib6: <ACPI PCI-PCI bridge> at device 10.0 on pci4
pci6: <ACPI PCI bus> on pcib6
em0: <Intel(R) PRO/1000 Network Connection Version - 6.7.3> port 0x6000-0x603f mem 0xf7fe0000-0xf7ffffff,0xf7f80000-0xf7fbffff irq 36 at device 9.0 on pci6
em0: Ethernet address: 00:04:23:b3:ab:08
em0: [FILTER]
em1: <Intel(R) PRO/1000 Network Connection Version - 6.7.3> port 0x6040-0x607f mem 0xf7f60000-0xf7f7ffff,0xf7f00000-0xf7f3ffff irq 37 at device 9.1 on pci6
em1: Ethernet address: 00:04:23:b3:ab:09
em1: [FILTER]
atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
atkbd0: <AT Keyboard> flags 0x1 irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
atkbd0: [ITHREAD]
psm0: <PS/2 Mouse> irq 12 on atkbdc0
psm0: [GIANT-LOCKED]
psm0: [ITHREAD]
psm0: model Generic PS/2 mouse, device ID 0
sio0: <Standard PC COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
sio0: type 16550A
sio0: [FILTER]
orm0: <ISA Option ROMs> at iomem 0xc0000-0xc7fff,0xc8000-0xcbfff,0xee000-0xeffff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
sio1 at port 0x2f8-0x2ff irq 3 on isa0
sio1: type 16550A
sio1: [FILTER]
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
ugen0: <American Power Conversion Smart-UPS 1500 FW:653.12.I USB FW:4.2, class 0/0, rev 1.10/0.06, addr 2> on uhub0
Timecounters tick every 0.976 msec
ipfw2 initialized, divert enabled, rule-based forwarding enabled, default to accept, logging unlimited
acd0: DVDROM <HL-DT-STDVD-ROM GDR-8084N/3.00> at ata0-master UDMA33
SMP: AP CPU #1 Launched!d
a0 at ciss0 bus 0 target 0 lun 0
da0: <COMPAQ RAID 1 VOLUME OK> Fixed Direct Access SCSI-0 device
da0: 135.168MB/s transfers
da0: 34727MB (71122560 512 byte sectors: 255H 32S/T 8716C)
Trying to mount root from ufs:/dev/da0s1a
WARNING: / was not properly dismounted
WARNING: /tmp was not properly dismounted
/tmp: mount pending error: blocks 28 files 0
WARNING: /usr was not properly dismounted
WARNING: /var was not properly dismounted
# kgdb /usr/obj/usr/src/sys/proliant-dl385/kernel.debug ./vmcore.0
[GDB will not be able to debug user-mode threads: /usr/lib/libthread_db.so: Undefined symbol "ps_pglobal_lookup"]
GNU gdb 6.1.1 [FreeBSD]
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB. Type "show warranty" for details.
This GDB was configured as "amd64-marcel-freebsd".
Unread portion of the kernel message buffer:
Fatal trap 12: page fault while in kernel mode
cpuid = 1; apic id = 01
fault virtual address = 0x3c
fault code = supervisor write data, page not present
instruction pointer = 0x8:0xffffffff80218159
stack pointer = 0x10:0xffffffffabe8fb10
frame pointer = 0x10:0xffffffffabe8fb90
code segment = base 0x0, limit 0xfffff, type 0x1b
= DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags = interrupt enabled, resume, IOPL = 0
current process = 33 (em0 taskq)
Physical memory: 2039 MB
Dumping 352 MB: 337 321 305 289 273 257 241 225 209 193 177 161 145 129 113 97 81 65 49 33 17 1
#0 doadump () at pcpu.h:194
194 pcpu.h: No such file or directory.
in pcpu.h
(kgdb) where
#0 doadump () at pcpu.h:194
#1 0xffffffff801b646c in db_fncall (dummy1=Variable "dummy1" is not available.
) at /usr/src/sys/ddb/db_command.c:486
#2 0xffffffff801b6984 in db_command_loop () at /usr/src/sys/ddb/db_command.c:401
#3 0xffffffff801b865f in db_trap (type=Variable "type" is not available.
) at /usr/src/sys/ddb/db_main.c:222
#4 0xffffffff80309b40 in kdb_trap (type=12, code=0, tf=0xffffffffabe8fa60) at /usr/src/sys/kern/subr_kdb.c:502
#5 0xffffffff8047bb91 in trap_fatal (frame=0xffffffffabe8fa60, eva=60) at /usr/src/sys/amd64/amd64/trap.c:719
#6 0xffffffff8047bf64 in trap_pfault (frame=0xffffffffabe8fa60, usermode=0) at /usr/src/sys/amd64/amd64/trap.c:641
#7 0xffffffff8047c8cb in trap (frame=0xffffffffabe8fa60) at /usr/src/sys/amd64/amd64/trap.c:410
#8 0xffffffff8046050e in calltrap () at /usr/src/sys/amd64/amd64/exception.S:169
#9 0xffffffff80218159 in em_rxeof (adapter=0xffffff00012da000, count=21) at /usr/src/sys/dev/em/if_em.c:4629
#10 0xffffffff80218a6f in em_handle_rxtx (context=Variable "context" is not available.
) at /usr/src/sys/dev/em/if_em.c:1561
#11 0xffffffff8031338c in taskqueue_run (queue=0xffffff0001335780) at /usr/src/sys/kern/subr_taskqueue.c:255
#12 0xffffffff80313652 in taskqueue_thread_loop (arg=Variable "arg" is not available.
) at /usr/src/sys/kern/subr_taskqueue.c:374
#13 0xffffffff802c0779 in fork_exit (callout=0xffffffff803135e0 <taskqueue_thread_loop>, arg=0xffffff00012da4d8, frame=0xffffffffabe8fc80)
at /usr/src/sys/kern/kern_fork.c:781
at /usr/src/sys/kern/kern_fork.c:781
#14 0xffffffff804608de in fork_trampoline () at /usr/src/sys/amd64/amd64/exception.S:415
#15 0x0000000000000000 in ?? ()
#16 0x0000000000000000 in ?? ()
#17 0x0000000000000001 in ?? ()
#18 0x0000000000000000 in ?? ()
#19 0x0000000000000000 in ?? ()
#20 0x0000000000000000 in ?? ()
#21 0x0000000000000000 in ?? ()
#22 0x0000000000000000 in ?? ()
#23 0x0000000000000000 in ?? ()
#24 0x0000000000000000 in ?? ()
#25 0x0000000000000000 in ?? ()
#26 0x0000000000000000 in ?? ()
#27 0x0000000000000000 in ?? ()
#28 0x0000000000000000 in ?? ()
#29 0x0000000000000000 in ?? ()
#30 0x0000000000000000 in ?? ()
#31 0x0000000000000000 in ?? ()
#32 0x0000000000000000 in ?? ()
#33 0x0000000000000000 in ?? ()
#34 0x0000000000000000 in ?? ()
#35 0x0000000000000000 in ?? ()
#36 0x0000000000000000 in ?? ()
#37 0x0000000000000000 in ?? ()
#38 0x0000000000000000 in ?? ()
#39 0x00000000008ba000 in ?? ()
#40 0xffffff0001230308 in ?? ()
#41 0xffffffff806bb130 in sleepq_chains ()
#42 0xffffff0001230000 in ?? ()
#43 0x0000000000000001 in ?? ()
#44 0xffffffffabe8fb30 in ?? ()
---Type <return> to continue, or q <return> to quit---
#45 0xffffffffabe8fac8 in ?? ()
#46 0xffffff0001230000 in ?? ()
#47 0xffffffff802ff04f in sched_switch (td=0x0, newtd=Variable "newtd" is not available.
) at /usr/src/sys/kern/sched_ule.c:1898
Previous frame inner to this frame (corrupt stack?)
(kgdb)
>How-To-Repeat:
>Fix:
>Release-Note:
>Audit-Trail:
>Unformatted:
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?200803021943.m22JhjJ3096085>