Date: Wed, 9 Feb 2005 13:35:27 -0800 From: David Rice <drice@globat.com> To: freebsd-hackers@freebsd.org Subject: Fatal trap 12: page fault while in kernel mode - HELP! Message-ID: <200502091335.27289.drice@globat.com>
next in thread | raw e-mail | index | archive | help
We have two NFS file servers running FreeBSD 5.2.1-RELEASE-p9 on Dell
Poweredge 1750's that crash randomly. They each have about 1.3TB of disk.
They are used to server email and web content to several WEB/EMAIL servers.
Followin is the console log messages and the kernel boot messages. Any ideas
as to what the problem may be?
eme: fvp == tvp (can't happen)
ufs_rename: fvp == tvp (can't happen)
ufs_rename: fvp == tvp (can't happen)
ufs_rename: fvp == tvp (can't happen)
ufs_rename: fvp == tvp (can't happen)
Feb 9 07:57:31 dst5 kernel: pid 14842 (send_nsca), uid 0: exited on signal 11
(core dumped)
ufs_rename: fvp == tvp (can't happen)
ufs_rename: fvp == tvp (can't happen)
ufs_rename: fvp == tvp (can't happen)
ufs_rename: fvp == tvp (can't happen)
ufs_rename: fvp == tvp (can't happen)
Feb 9 09:23:55 dst5 kernel: pid 20246 (send_nsca), uid 0: exited on signal 11
(core dumped)
ufs_rename: fvp == tvp (can't happen)
ufs_rename: fvp == tvp (can't happen)
ufs_rename: fvp == tvp (can't happen)
Fatal trap 12: page fault while in kernel mode
cpuid = 1; apic id = 06
fault virtual address = 0x20
fault code = supervisor read, page not present
instruction pointer = 0x8:0xc056471f
stack pointer = 0x10:0xe1b19920
frame pointer = 0x10:0xe1b199b8
code segment = base 0x0, limit 0xfffff, type 0x1b
= DPL 0, pres 1, def32 1, gran 1
processor eflags = interrupt enabled, resume, IOPL = 0
current process = 61 (swi1: net)
kernel: type 12 trap, code=0
Stopped at tcp_output+0xf: movl 0x20(%esi),%eax
db>
db>
db>
--------------------------------------------------------------------------------------------------------------
The Regents of the University of California. All rights reserved.
FreeBSD 5.2.1-RELEASE-p9 #1: Wed Sep 1 18:39:24 PDT 2004
root@dst5.globat.com:/usr/obj/usr/src/sys/DST5
Preloaded elf kernel "/boot/kernel/kernel" at 0xc07c9000.
Preloaded elf module "/boot/kernel/acpi.ko" at 0xc07c921c.
ACPI APIC Table: <DELL PE1750 >
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: Intel(R) Xeon(TM) CPU 2.40GHz (2387.13-MHz 686-class CPU)
Origin = "GenuineIntel" Id = 0xf29 Stepping = 9
Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
real memory = 1073573888 (1023 MB)
avail memory = 1037717504 (989 MB)
FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs
cpu0 (BSP): APIC ID: 0
cpu1 (AP): APIC ID: 6
ioapic0: Changing APIC ID to 8
ioapic1: Changing APIC ID to 9
ioapic2: Changing APIC ID to 10
ioapic0 <Version 1.1> irqs 0-15 on motherboard
ioapic1 <Version 1.1> irqs 16-31 on motherboard
ioapic2 <Version 1.1> irqs 32-47 on motherboard
Pentium Pro MTRR support enabled
npx0: [FAST]
stray irq13
npx0: <math processor> on motherboard
npx0: INT 16 interface
acpi0: <DELL PE1750 > on motherboard
acpi0: Power Button (fixed)
Timecounter "ACPI-safe" frequency 3579545 Hz quality 1000
pcibios: BIOS version 2.10
Using $PIR table, 7 entries at 0xc00fc4a0
acpi_timer0: <32-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0
acpi_cpu0: <CPU> on acpi0
acpi_cpu1: <CPU> on acpi0
acpi_cpu2: <CPU> on acpi0
device_probe_and_attach: acpi_cpu2 attach returned 6
acpi_cpu2: <CPU> on acpi0
device_probe_and_attach: acpi_cpu2 attach returned 6
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
pcib0: slot 15 INTA is routed to irq 15
pci0: <display, VGA> at device 14.0 (no driver attached)
pci0: <serial bus, USB> at device 15.2 (no driver attached)
isab0: <PCI-ISA bridge> at device 15.3 on pci0
isa0: <ISA bus> on isab0
pcib1: <ACPI Host-PCI bridge> on acpi0
pci4: <ACPI PCI bus> on pcib1
mpt0: <LSILogic 1030 Ultra4 Adapter> port 0xdc00-0xdcff mem
0xfcb20000-0xfcb2ffff,0xfcb30000-0xfcb3ffff irq 18 at device 5.0 on pci4
mpt1: <LSILogic 1030 Ultra4 Adapter> port 0xd800-0xd8ff mem
0xfcb00000-0xfcb0ffff,0xfcb10000-0xfcb1ffff irq 19 at device 5.1 on pci4
pcib2: <ACPI Host-PCI bridge> on acpi0
pci3: <ACPI PCI bus> on pcib2
amr0: <LSILogic MegaRAID> mem 0xfcc00000-0xfcc0ffff irq 24 at device 6.0 on
pci3
amr0: <LSILogic PERC 4/DC> Firmware 350O, BIOS 1.09, 128MB RAM
pcib3: <ACPI Host-PCI bridge> on acpi0
pci2: <ACPI PCI bus> on pcib3
bge0: <Broadcom BCM5704C Dual Gigabit Ethernet, ASIC rev. 0x2002> mem
0xfcf20000-0xfcf2ffff,0xfcf30000-0xfcf3ffff irq 16 at device 0.0 on pci2
bge0: Ethernet address: 00:0f:1f:66:34:0e
miibus0: <MII bus> on bge0
brgphy0: <BCM5704 10/100/1000baseTX PHY> on miibus0
brgphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseTX,
1000baseTX-FDX, auto
bge1: <Broadcom BCM5704C Dual Gigabit Ethernet, ASIC rev. 0x2002> mem
0xfcf00000-0xfcf0ffff,0xfcf10000-0xfcf1ffff irq 17 at device 0.1 on pci2
bge1: Ethernet address: 00:0f:1f:66:34:0f
miibus1: <MII bus> on bge1
brgphy1: <BCM5704 10/100/1000baseTX PHY> on miibus1
brgphy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseTX,
1000baseTX-FDX, auto
pcib4: <ACPI Host-PCI bridge> on acpi0
pci1: <ACPI PCI bus> on pcib4
fdc0: <Enhanced floppy controller (i82077, NE72065 or clone)> port
0x3f7,0x3f0-0x3f5 irq 6 drq 2 on acpi0
fdc0: FIFO enabled, 8 bytes threshold
fd0: <1440-KB 3.5" drive> on fdc0 drive 0
sio0 port 0x3f8-0x3ff irq 4 on acpi0
sio0: type 16550A, console
acpi_cpu2: <CPU> on acpi0
device_probe_and_attach: acpi_cpu2 attach returned 6
acpi_cpu2: <CPU> on acpi0
device_probe_and_attach: acpi_cpu2 attach returned 6
orm0: <Option ROMs> at iomem 0xec000-0xeffff,0xc8000-0xcbfff,0xc0000-0xc7fff
on isa0
ata0 at port 0x3f6,0x1f0-0x1f7 irq 14 on isa0
ata0: [MPSAFE]
ata1 at port 0x376,0x170-0x177 irq 15 on isa0
ata1: [MPSAFE]
atkbdc0: <Keyboard controller (i8042)> at port 0x64,0x60 on isa0
ppc0: parallel port not found.
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x100>
sio1: configured irq 3 not in bitmap of probed irqs 0
sio1: port may not be enabled
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
Timecounters tick every 10.000 msec
Waiting 5 seconds for SCSI devices to settle
amrd0: <LSILogic MegaRAID logical drive> on amr0
amrd0: 1400130MB (2867466240 sectors) RAID 5 (optimal)
GEOM: create disk amrd0 dp=0xc681290c
ses0 at mpt0 bus 0 target 6 lun 0
ses0: <PE/PV 1x3 SCSI BP 1.1> Fixed Processor SCSI-2 device
ses0: 3.300MB/s transfers
ses0: SAF-TE Compliant Device
ses1 at amr0 bus 1 target 6 lun 0
ses1: <DELL PV22XS E.17> Fixed Processor SCSI-3 device
ses1: SAF-TE Compliant Device
GEOM: create disk da0 dp=0xc67f1050
SMP: AP CPU #1 Launched!
da0 at mpt0 bus 0 target 0 lun 0
da0: <IBM IC35L036UCDY10-0 S27T> Fixed Direct Access SCSI-3 device
da0: 320.000MB/s transfers (160.000MHz, offset 127, 16bit), Tagged Queueing
Enabled
da0: 34732MB (71132959 512 byte sectors: 255H 63S/T 4427C)
Mounting root from ufs:/dev/da0s1a
Loading configuration files.
Entropy harvesting: interrupts ethernet point_to_point.
swapon: adding /dev/da0s1b as swap device
Starting file system checks:
/dev/da0s1a: FILE SYSTEM CLEAN; SKIPPING CHECKS
/dev/da0s1a: clean, 478283 free (539 frags, 59718 blocks, 0.1% fragmentation)
/dev/amrd0a: FILE SYSTEM CLEAN; SKIPPING CHECKS
/dev/amrd0a: clean, 58453101 free (2261109 frags, 7023999 blocks, 0.3%
fragmentation)
/dev/da0s1e: FILE SYSTEM CLEAN; SKIPPING CHECKS
/dev/da0s1e: clean, 14632669 free (43645 frags, 1823628 blocks, 0.3%
fragmentation)
/dev/da0s1d: FILE SYSTEM CLEAN; SKIPPING CHECKS
/dev/da0s1d: clean, 415316 free (276 frags, 51880 blocks, 0.1% fragmentation)
net.inet.tcp.sendspace: 32768 -> 131072
net.inet.tcp.recvspace: 65536 -> 131072
net.inet.tcp.delayed_ack: 1 -> 0
vfs.ufs.dirhash_maxmem: 2097152 -> 16777216
machdep.cpu_idle_hlt: 1 -> 0
Setting hostname: dst5.globat.com.
bge0: flags=9843<UP,BROADCAST,RUNNING,SIMPLEX,LINK0,MULTICAST> mtu 1500
options=1b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING>
inet 10.1.1.115 netmask 0xffffff00 broadcast 10.1.1.255
inet6 fe80::20f:1fff:fe66:340e%bge0 prefixlen 64 tentative scopeid 0x1
ether 00:0f:1f:66:34:0e
media: Ethernet 1000baseTX <full-duplex> (none)
status: no carrier
bge1: flags=9843<UP,BROADCAST,RUNNING,SIMPLEX,LINK0,MULTICAST> mtu 1500
options=1b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING>
inet 10.1.10.115 netmask 0xffffff00 broadcast 10.1.10.255
inet6 fe80::20f:1fff:fe66:340f%bge1 prefixlen 64 tentative scopeid 0x2
ether 00:0f:1f:66:34:0f
media: Ethernet 100baseTX <full-duplex>
status: active
lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> mtu 16384
inet 127.0.0.1 netmask 0xff000000
inet6 ::1 prefixlen 128
inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3
add net default: gateway 10.1.10.1
Additional routing optibgons:.
hw.bus.deevctl_disable: 0 0-> 1
Mounting N:FS file systems: .
Starting syslgogd.
Feb 6 23:i00:55 dst5 sysloggd: kernel boot afile is /boot/kebrnel/kernel
it link up
Starting ntpdate.
Feb 6 23:01:00 dst5 ntpdate[331]: no server suitable for synchronization
found
Starting rpcbind.
ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/X11R6/lib /usr/local/lib
a.out ldconfig path: /usr/lib/aout /usr/lib/compat/aout /usr/X11R6/lib/aout
Starting mountd.
Starting nfsd.
Starting statd.
Starting lockd.
Starting local daemons:.
Updating motd.
Configuring syscons: blanktime.
Starting sshd.
Initial i386 initialization:.
Additional ABI support:.
Starting cron.
Local package initialization:Starting Big Brother
-> BBOUT.OLD file has over 2000 lines
-> Consider removing it to save space...
Starting external scripts
Starting external script bf-larrd.sh
Starting Local tests (bb-local)...
Big Brother 1.9e started
Starting snmpd.
.
Additional TCP options:.
/etc/rc.d/sysctl: WARNING: sysctl machdep.hlt_logical_cpus does not exist.
Starting inetd.
Starting background file system checks in 60 seconds.
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?200502091335.27289.drice>