Skip site navigation (1)Skip section navigation (2)
Date:      Tue, 26 Apr 2011 16:02:42 +0200
From:      Mikael Bak <mbak@inbox.lv>
To:        freebsd-questions@freebsd.org
Subject:   Suddenly lots processes exits signal 11 (core dumped)
Message-ID:  <4DB6D082.4020907@inbox.lv>

next in thread | raw e-mail | index | archive | help
Hi list,

I have a system running FreeBSD 7.3. Its main function is running
Postfix SMTP server and a few perl based content filters. Nothing exotic
really.

It has been nicely up and running approx 150 days when it suddenly
starts behaving very strange.

First I noticed a converter script failing. It is basically a small
shell script that converts a quite big file replacing a few words using
sed. The output is mostly damaged.

Another problem is that lots of processes exits signal 11 (core dumped).
And I need to restart them by hand. See dmesg output below.

I know I don't give you guys much to go on. I just want to know it it's
possible to find out somehow if some hardware is failing and must be
changed.

My first thought was overheating. But my collegue went to the site and
he said the hardware is not hot at all.

TIA,
Mikael

# dmesg
Copyright (c) 1992-2010 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
	The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 7.3-RELEASE-p2 #0: Mon Jul 12 19:23:19 UTC 2010
    root@amd64-builder.daemonology.net:/usr/obj/usr/src/sys/GENERIC amd64
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: Intel(R) Atom(TM) CPU  330   @ 1.60GHz (1600.01-MHz K8-class CPU)
  Origin = "GenuineIntel"  Id = 0x106c2  Stepping = 2

Features=0xbfe9fbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
  Features2=0x40e31d<SSE3,DTES64,MON,DS_CPL,TM2,SSSE3,CX16,xTPR,PDCM,MOVBE>
  AMD Features=0x20100800<SYSCALL,NX,LM>
  AMD Features2=0x1<LAHF>
  TSC: P-state invariant
  Cores per package: 2
  Logical CPUs per core: 2
usable memory = 3475918848 (3314 MB)
avail memory  = 3353677824 (3198 MB)
ACPI APIC Table: <081309 APIC0925>
FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs
 cpu0 (BSP): APIC ID:  0
 cpu1 (AP): APIC ID:  2
ioapic0: Changing APIC ID to 3
ioapic0 <Version 1.1> irqs 0-23 on motherboard
kbd1 at kbdmux0
acpi0: <081309 RSDT0925> on motherboard
acpi0: [ITHREAD]
acpi0: Power Button (fixed)
acpi0: reservation of fefe1000, 1000 (3) failed
acpi0: reservation of fee01000, ff000 (3) failed
acpi0: reservation of fec00000, 1000 (3) failed
acpi0: reservation of fee00000, 1000 (3) failed
acpi0: reservation of 0, a0000 (3) failed
acpi0: reservation of 100000, dff00000 (3) failed
Timecounter "ACPI-safe" frequency 3579545 Hz quality 850
acpi_timer0: <32-bit timer at 3.579545MHz> port 0x4008-0x400b on acpi0
acpi_hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on
acpi0
Timecounter "HPET" frequency 25000000 Hz quality 900
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
pci0: <memory, RAM> at device 0.1 (no driver attached)
isab0: <PCI-ISA bridge> port 0x4f00-0x4fff at device 3.0 on pci0
isa0: <ISA bus> on isab0
pci0: <memory, RAM> at device 3.1 (no driver attached)
pci0: <serial bus, SMBus> at device 3.2 (no driver attached)
pci0: <memory, RAM> at device 3.3 (no driver attached)
pci0: <processor> at device 3.5 (no driver attached)
ohci0: <OHCI (generic) USB controller> mem 0xfae7f000-0xfae7ffff irq 22
at device 4.0 on pci0
ohci0: [GIANT-LOCKED]
ohci0: [ITHREAD]
usb0: OHCI version 1.0, legacy support
usb0: SMM does not respond, resetting
usb0: <OHCI (generic) USB controller> on ohci0
usb0: USB revision 1.0
uhub0: <nVidia OHCI root hub, class 9/0, rev 1.00/1.00, addr 1> on usb0
uhub0: 6 ports with 6 removable, self powered
ehci0: <EHCI (generic) USB 2.0 controller> mem 0xfae7ec00-0xfae7ecff irq
23 at device 4.1 on pci0
ehci0: [GIANT-LOCKED]
ehci0: [ITHREAD]
usb1: EHCI version 1.0
usb1: companion controller, 12 ports each: usb0
usb1: <EHCI (generic) USB 2.0 controller> on ehci0
usb1: USB revision 2.0
uhub1: <nVidia EHCI root hub, class 9/0, rev 2.00/1.00, addr 1> on usb1
uhub1: 6 ports with 6 removable, self powered
ohci1: <OHCI (generic) USB controller> mem 0xfae7d000-0xfae7dfff irq 20
at device 6.0 on pci0
ohci1: [GIANT-LOCKED]
ohci1: [ITHREAD]
usb2: OHCI version 1.0, legacy support
usb2: SMM does not respond, resetting
usb2: <OHCI (generic) USB controller> on ohci1
usb2: USB revision 1.0
uhub2: <nVidia OHCI root hub, class 9/0, rev 1.00/1.00, addr 1> on usb2
uhub2: 6 ports with 6 removable, self powered
ehci1: <EHCI (generic) USB 2.0 controller> mem 0xfae7e800-0xfae7e8ff irq
21 at device 6.1 on pci0
ehci1: [GIANT-LOCKED]
ehci1: [ITHREAD]
usb3: EHCI version 1.0
usb3: companion controller, 12 ports each: usb2
usb3: <EHCI (generic) USB 2.0 controller> on ehci1
usb3: USB revision 2.0
uhub3: <nVidia EHCI root hub, class 9/0, rev 2.00/1.00, addr 1> on usb3
uhub3: 6 ports with 6 removable, self powered
pci0: <multimedia, HDA> at device 8.0 (no driver attached)
pcib1: <ACPI PCI-PCI bridge> at device 9.0 on pci0
pci1: <ACPI PCI bus> on pcib1
nfe0: <NVIDIA nForce MCP79 Networking Adapter> port 0xd080-0xd087 mem
0xfae7c000-0xfae7cfff,0xfae7e400-0xfae7e4ff,0xfae7e000-0xfae7e00f irq 23
at device 10.0 on pci0
miibus0: <MII bus> on nfe0
rgephy0: <RTL8169S/8110S/8211B media interface> PHY 3 on miibus0
rgephy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT,
1000baseT-FDX, auto
nfe0: Ethernet address: 00:01:2e:2c:b0:56
nfe0: [FILTER]
atapci0: <nVidia ATA controller> port
0xd000-0xd007,0xcc00-0xcc03,0xc880-0xc887,0xc800-0xc803,0xc480-0xc48f
mem 0xfae76000-0xfae77fff irq 20 at device 11.0 on pci0
atapci0: [ITHREAD]
ata2: <ATA channel 0> on atapci0
ata2: [ITHREAD]
ata3: <ATA channel 1> on atapci0
ata3: [ITHREAD]
pcib2: <ACPI PCI-PCI bridge> irq 21 at device 12.0 on pci0
pci2: <ACPI PCI bus> on pcib2
pcib3: <ACPI PCI-PCI bridge> at device 16.0 on pci0
pci3: <ACPI PCI bus> on pcib3
vgapci0: <VGA-compatible display> port 0xec00-0xec7f mem
0xfb000000-0xfbffffff,0xe0000000-0xefffffff,0xf8000000-0xf9ffffff irq 22
at device 0.0 on pci3
pcib4: <ACPI PCI-PCI bridge> irq 22 at device 21.0 on pci0
pci4: <ACPI PCI bus> on pcib4
pci4: <network> at device 0.0 (no driver attached)
pcib5: <ACPI PCI-PCI bridge> irq 23 at device 22.0 on pci0
pci5: <ACPI PCI bus> on pcib5
pcib6: <ACPI PCI-PCI bridge> irq 20 at device 23.0 on pci0
pci6: <ACPI PCI bus> on pcib6
pcib7: <ACPI PCI-PCI bridge> irq 21 at device 24.0 on pci0
pci7: <ACPI PCI bus> on pcib7
acpi_button0: <Power Button> on acpi0
sio0: configured irq 4 not in bitmap of probed irqs 0
sio0: port may not be enabled
sio0: configured irq 4 not in bitmap of probed irqs 0
sio0: port may not be enabled
sio0: <16550A-compatible COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on
acpi0
sio0: type 16550A
sio0: [FILTER]
cpu0: <ACPI CPU> on acpi0
p4tcc0: <CPU Frequency Thermal Control> on cpu0
cpu1: <ACPI CPU> on acpi0
p4tcc1: <CPU Frequency Thermal Control> on cpu1
orm0: <ISA Option ROM> at iomem 0xc0000-0xce7ff on isa0
atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
atkbd0: [ITHREAD]
ppc0: cannot reserve I/O port range
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
sio1: configured irq 3 not in bitmap of probed irqs 0
sio1: port may not be enabled
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
Timecounters tick every 1.000 msec
ad4: 476940MB <Seagate ST3500418AS CC38> at ata2-master UDMA33
ad6: 476940MB <Seagate ST3500418AS CC38> at ata3-master UDMA33
SMP: AP CPU #1 Launched!
GEOM_MIRROR: Device mirror/gm0 launched (2/2).
Trying to mount root from ufs:/dev/mirror/gm0s1a
nfe0: link state changed to UP
pid 767 (clamd), uid 110: exited on signal 11
pid 1046 (clamscan), uid 110: exited on signal 11 (core dumped)
pid 1337 (perl), uid 110: exited on signal 11
pid 8777 (smtpd), uid 125: exited on signal 10
pid 8876 (smtpd), uid 125: exited on signal 10
pid 548 (named), uid 53: exited on signal 6
pid 10246 (smtpd), uid 125: exited on signal 10
pid 12223 (smtpd), uid 125: exited on signal 10
pid 13347 (perl), uid 110: exited on signal 10
pid 14959 (clamscan), uid 0: exited on signal 10 (core dumped)
pid 19583 (clamscan), uid 0: exited on signal 11 (core dumped)
pid 20467 (gpg2), uid 0: exited on signal 11 (core dumped)
pid 20471 (cp), uid 0: exited on signal 11 (core dumped)
pid 20478 (bash), uid 0: exited on signal 11 (core dumped)
pid 20263 (bash), uid 0: exited on signal 11 (core dumped)
sigreturn: rflags = 0x1020a
a
pid 16204 (master), uid 0: exited on signal 10
pid 21243 (clamscan), uid 0: exited on signal 11 (core dumped)
pid 22102 (clamscan), uid 0: exited on signal 11 (core dumped)
pid 22125 (clamscan), uid 0: exited on signal 11 (core dumped)
pid 22200 (clamscan), uid 0: exited on signal 11 (core dumped)
pid 23161 (clamscan), uid 0: exited on signal 10 (core dumped)
pid 26288 (clamscan), uid 0: exited on signal 11 (core dumped)
pid 26542 (smtpd), uid 125: exited on signal 10
pid 26821 (smtpd), uid 125: exited on signal 10
pid 27204 (clamscan), uid 0: exited on signal 11 (core dumped)
pid 27236 (clamscan), uid 0: exited on signal 11 (core dumped)
pid 27245 (clamscan), uid 0: exited on signal 11 (core dumped)
pid 28583 (clamscan), uid 0: exited on signal 10 (core dumped)
pid 28696 (perl), uid 110: exited on signal 10
pid 27729 (clamd), uid 110: exited on signal 11
pid 29680 (clamscan), uid 110: exited on signal 11 (core dumped)
pid 29690 (clamscan), uid 110: exited on signal 11 (core dumped)
pid 29719 (clamscan), uid 110: exited on signal 11 (core dumped)
pid 29781 (clamscan), uid 110: exited on signal 10 (core dumped)
pid 29808 (clamscan), uid 110: exited on signal 11 (core dumped)
pid 29884 (clamscan), uid 110: exited on signal 11 (core dumped)
pid 30531 (clamscan), uid 0: exited on signal 10 (core dumped)
pid 30686 (clamd), uid 110: exited on signal 11
pid 30935 (smtpd), uid 125: exited on signal 10
pid 31024 (clamscan), uid 110: exited on signal 11 (core dumped)
pid 31061 (clamscan), uid 110: exited on signal 11 (core dumped)
pid 31083 (smtpd), uid 125: exited on signal 10
pid 31147 (smtpd), uid 125: exited on signal 10
pid 31630 (sendmail), uid 0: exited on signal 11 (core dumped)
pid 31738 (clamscan), uid 0: exited on signal 11 (core dumped)
pid 31759 (clamscan), uid 0: exited on signal 11 (core dumped)
pid 32455 (smtpd), uid 125: exited on signal 10
pid 38591 (clamscan), uid 110: exited on signal 6 (core dumped)
pid 38954 (clamscan), uid 110: exited on signal 11 (core dumped)
pid 39045 (clamscan), uid 110: exited on signal 10 (core dumped)
pid 39087 (clamscan), uid 110: exited on signal 10 (core dumped)
pid 39098 (clamscan), uid 110: exited on signal 10 (core dumped)
pid 39148 (clamscan), uid 110: exited on signal 10 (core dumped)
pid 39184 (clamscan), uid 110: exited on signal 11 (core dumped)
pid 39225 (clamscan), uid 110: exited on signal 11 (core dumped)
pid 39247 (clamscan), uid 110: exited on signal 11 (core dumped)
pid 39279 (clamscan), uid 110: exited on signal 11 (core dumped)
pid 40210 (clamscan), uid 110: exited on signal 10 (core dumped)
pid 40352 (clamscan), uid 110: exited on signal 11 (core dumped)
pid 40642 (clamscan), uid 0: exited on signal 11 (core dumped)
pid 40667 (clamscan), uid 0: exited on signal 11 (core dumped)
pid 43747 (clamscan), uid 110: exited on signal 11 (core dumped)
pid 45077 (clamscan), uid 110: exited on signal 10 (core dumped)
pid 45987 (clamscan), uid 110: exited on signal 11 (core dumped)
pid 46699 (gpg2), uid 0: exited on signal 11
pid 46795 (clamscan), uid 0: exited on signal 11 (core dumped)
pid 46807 (clamscan), uid 0: exited on signal 11 (core dumped)
pid 46857 (rm), uid 0: exited on signal 11 (core dumped)
pid 46867 (rm), uid 0: exited on signal 11 (core dumped)
pid 46873 (clamscan), uid 110: exited on signal 10 (core dumped)



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?4DB6D082.4020907>