Date: Tue, 25 Jul 2006 11:19:27 -0700 From: "Rob Connon (Info)" <rob.info@vfs.com> To: freebsd-questions@freebsd.org Subject: FreeBSD 6 Hard Lock no logs Message-ID: <44C660AF.5040206@vfs.com>
next in thread | raw e-mail | index | archive | help
This is a cryptographically signed message in MIME format.
--------------ms000209070607070205030503
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
Hi,
I have a web/mail server thats running the lastest version of FreeBSD
6.0-RELEASE-p9 #4. In the last month or so it's started hard locking..
when the machine locks up i can still ping it and get connects from
telneting to 80,22,etc sometimes i get a banner and sometimes i dont..
but there are
no errors on the console or in the logs.
The odd thing is the locking seems to happen within a certain time
window (mon,tues) and never end of the week or weekend.. i suspected it
could have been
a bad cron job but nothing falls into that time frame.
As a test i've been rebooting the server everynight to see if that would
help the machine get past the begining of the week with out a hang and
again this morning
even though i rebooted last night at 10pm hung around 9:47am.
The machine is a Dell PowerEdge 2550, I've had dell come and replace the
MB and have ran all their diagnostics aswell with no errors reported..
I've been reading alot about APIC and ACPI and people having similar
issues but nothing that fits the bill... below is the dmesg and output
of vmstat -i.. another odd thing is the rate for the CPU timer is
extremely high compared to other machines with similar hardware or
faster hardware.
Any help on where to look next would be awesome.
interrupt total rate
irq1: atkbd0 107 0
irq6: fdc0 10 0
irq13: npx0 1 0
irq14: ata0 74 0
irq16: fxp0 27110 12
irq20: amr0 105950 48
cpu0: timer 4385477 1999
cpu1: timer 4369967 1992
Total 8888696 4053
Copyright (c) 1992-2005 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD 6.0-RELEASE-p9 #4: Thu Jun 22 14:54:15 PDT 2006
root@taurus.packetsafe.net:/usr/src/sys/i386/compile/SMP
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: Intel(R) Pentium(R) III CPU family 1266MHz (1258.22-MHz
686-class CPU)
Origin = "GenuineIntel" Id = 0x6b1 Stepping = 1
Features=0x383fbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,MMX,FXSR,SSE>
real memory = 1073676288 (1023 MB)
avail memory = 1041612800 (993 MB)
ACPI APIC Table: <DELL PE2550 >
FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs
cpu0 (BSP): APIC ID: 1
cpu1 (AP): APIC ID: 0
ioapic0: Changing APIC ID to 2
ioapic1: Changing APIC ID to 3
MADT: Forcing active-low polarity and level trigger for SCI
ioapic0 <Version 1.1> irqs 0-15 on motherboard
ioapic1 <Version 1.1> irqs 16-31 on motherboard
npx0: [FAST]
npx0: <math processor> on motherboard
npx0: INT 16 interface
acpi0: <DELL PE2550> on motherboard
acpi0: Power Button (fixed)
pci_link0: <ACPI PCI Link LNK0> irq 5 on acpi0
pci_link1: <ACPI PCI Link LNK1> irq 10 on acpi0
pci_link2: <ACPI PCI Link LNK2> on acpi0
pci_link3: <ACPI PCI Link LNK3> on acpi0
pci_link4: <ACPI PCI Link LNK4> irq 5 on acpi0
pci_link5: <ACPI PCI Link LNK5> irq 10 on acpi0
pci_link6: <ACPI PCI Link LNK6> on acpi0
pci_link7: <ACPI PCI Link LNK7> on acpi0
pci_link8: <ACPI PCI Link LNK8> on acpi0
pci_link9: <ACPI PCI Link LNK9> on acpi0
pci_link10: <ACPI PCI Link LNKA> on acpi0
pci_link11: <ACPI PCI Link LNKB> on acpi0
pci_link12: <ACPI PCI Link LNKC> on acpi0
pci_link13: <ACPI PCI Link LNKD> on acpi0
pci_link14: <ACPI PCI Link LNKE> on acpi0
pci_link15: <ACPI PCI Link LNKF> irq 10 on acpi0
pci_link16: <ACPI PCI Link LUSB> irq 11 on acpi0
Timecounter "ACPI-safe" frequency 3579545 Hz quality 1000
acpi_timer0: <32-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0
cpu0: <ACPI CPU> on acpi0
cpu1: <ACPI CPU> on acpi0
pcib0: <ACPI Host-PCI bridge> on acpi0
pci0: <ACPI PCI bus> on pcib0
pcib1: <PCI-PCI bridge> at device 2.0 on pci0
pci1: <PCI bus> on pcib1
pcib2: <PCI-PCI bridge> at device 0.0 on pci1
pci2: <PCI bus> on pcib2
amr0: <LSILogic MegaRAID 1.51> mem 0xf0000000-0xf7ffffff irq 20 at
device 0.0 on pci2
amr0: <LSILogic PERC 3/DC> Firmware 197O, BIOS 3.35, 128MB RAM
pci1: <mass storage, SCSI> at device 1.0 (no driver attached)
pci0: <display, VGA> at device 14.0 (no driver attached)
isab0: <PCI-ISA bridge> port 0x8a0-0x8af at device 15.0 on pci0
isa0: <ISA bus> on isab0
atapci0: <ServerWorks ROSB4 UDMA33 controller> port
0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x8b0-0x8bf at device 15.1 on pci0
ata0: <ATA channel 0> on atapci0
ata1: <ATA channel 1> on atapci0
ohci0: <OHCI (generic) USB controller> mem 0xfe400000-0xfe400fff irq 11
at device 15.2 on pci0
ohci0: [GIANT-LOCKED]
usb0: OHCI version 1.0, legacy support
usb0: <OHCI (generic) USB controller> on ohci0
usb0: USB revision 1.0
uhub0: (0x1166) OHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub0: 2 ports with 2 removable, self powered
pcib3: <ACPI Host-PCI bridge> on acpi0
pci3: <ACPI PCI bus> on pcib3
bge0: <Broadcom BCM5700 Gigabit Ethernet, ASIC rev. 0x7104> mem
0xfeb00000-0xfeb0ffff irq 17 at device 8.0 on pci3
miibus0: <MII bus> on bge0
brgphy0: <BCM5401 10/100/1000baseTX PHY> on miibus0
brgphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseTX,
1000baseTX-FDX, auto
bge0: Ethernet address: 00:06:5b:f5:87:93
pcib4: <ACPI Host-PCI bridge> on acpi0
pci4: <ACPI PCI bus> on pcib4
pcib5: <ACPI PCI-PCI bridge> at device 2.0 on pci4
pci5: <ACPI PCI bus> on pcib5
fxp0: <Intel 82559 Pro/100 Ethernet> port 0xbcc0-0xbcff mem
0xfe900000-0xfe900fff,0xfe700000-0xfe7fffff irq 16 at device 4.0 on pci4
miibus1: <MII bus> on fxp0
inphy0: <i82555 10/100 media interface> on miibus1
inphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
fxp0: Ethernet address: 00:06:5b:f5:87:92
fdc0: <floppy drive controller> port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0
fdc0: [FAST]
fd0: <1440-KB 3.5" drive> on fdc0 drive 0
atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
sio0: <16550A-compatible COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on
acpi0
sio0: type 16550A
sio1: <16550A-compatible COM port> port 0x2f8-0x2ff irq 3 on acpi0
sio1: type 16550A
ppc0: <ECP parallel printer port> port 0x378-0x37f,0x778-0x77f irq 7 drq
1 on acpi0
ppc0: Generic chipset (ECP/PS2/NIBBLE) in COMPATIBLE mode
ppc0: FIFO with 16/16/8 bytes threshold
ppbus0: <Parallel port bus> on ppc0
plip0: <PLIP network interface> on ppbus0
lpt0: <Printer> on ppbus0
lpt0: Interrupt-driven port
ppi0: <Parallel I/O> on ppbus0
pmtimer0 on isa0
orm0: <ISA Option ROMs> at iomem 0xc0000-0xc7fff,0xec000-0xeffff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
Timecounters tick every 1.000 msec
acd0: CDROM <SAMSUNG CD-ROM SN-124/q009> at ata0-master PIO4
amrd0: <LSILogic MegaRAID logical drive> on amr0
amrd0: 104040MB (213073920 sectors) RAID 5 (optimal)
ses0 at amr0 bus 0 target 6 lun 0
ses0: <DELL 1x4 U2W SCSI BP 1.32> Fixed Processor SCSI-2 device
ses0: SAF-TE Compliant Device
SMP: AP CPU #1 Launched!
--------------ms000209070607070205030503
Content-Type: application/x-pkcs7-signature; name="smime.p7s"
Content-Transfer-Encoding: base64
Content-Disposition: attachment; filename="smime.p7s"
Content-Description: S/MIME Cryptographic Signature
MIAGCSqGSIb3DQEHAqCAMIACAQExCzAJBgUrDgMCGgUAMIAGCSqGSIb3DQEHAQAAoIIH3TCC
AkkwggGyoAMCAQICAw+1/DANBgkqhkiG9w0BAQQFADBiMQswCQYDVQQGEwJaQTElMCMGA1UE
ChMcVGhhd3RlIENvbnN1bHRpbmcgKFB0eSkgTHRkLjEsMCoGA1UEAxMjVGhhd3RlIFBlcnNv
bmFsIEZyZWVtYWlsIElzc3VpbmcgQ0EwHhcNMDUxMDIwMTgxNjU3WhcNMDYxMDIwMTgxNjU3
WjBCMR8wHQYDVQQDExZUaGF3dGUgRnJlZW1haWwgTWVtYmVyMR8wHQYJKoZIhvcNAQkBFhBy
b2IuaW5mb0B2ZnMuY29tMIGfMA0GCSqGSIb3DQEBAQUAA4GNADCBiQKBgQCrrgaqYmutxRyB
j7lOloc8vvKxBMXxBoX6ZPH4izXz7mYxe2aZhTXgvyO6anUcxdF7Cc4dv87zp/HnBHdteiMg
NCiHmlB5qOmkVdlScMnmSHAyirWSpO+N5DeO74Rjs+c8icizMPIWP1Acx/P9IZt+DcOv5m/4
gXQi7k+lASj78QIDAQABoy0wKzAbBgNVHREEFDASgRByb2IuaW5mb0B2ZnMuY29tMAwGA1Ud
EwEB/wQCMAAwDQYJKoZIhvcNAQEEBQADgYEAet3R0PmERIg0JAuBvOPKIy+ao/6Pr2/+5N3w
/cCpDJjuNQHVJamNt/yySEF1vtAlDcAn0uaoRwLwDlcRX9/Nn6+x1xIIszEhWJCJHBzlfTpu
QpCxGuwhWoPWPwcUym070ODTFHSnx9PEzG/3LxxRplH5lqK3c/Bs4aJhDOb7zjcwggJJMIIB
sqADAgECAgMPtfwwDQYJKoZIhvcNAQEEBQAwYjELMAkGA1UEBhMCWkExJTAjBgNVBAoTHFRo
YXd0ZSBDb25zdWx0aW5nIChQdHkpIEx0ZC4xLDAqBgNVBAMTI1RoYXd0ZSBQZXJzb25hbCBG
cmVlbWFpbCBJc3N1aW5nIENBMB4XDTA1MTAyMDE4MTY1N1oXDTA2MTAyMDE4MTY1N1owQjEf
MB0GA1UEAxMWVGhhd3RlIEZyZWVtYWlsIE1lbWJlcjEfMB0GCSqGSIb3DQEJARYQcm9iLmlu
Zm9AdmZzLmNvbTCBnzANBgkqhkiG9w0BAQEFAAOBjQAwgYkCgYEAq64GqmJrrcUcgY+5TpaH
PL7ysQTF8QaF+mTx+Is18+5mMXtmmYU14L8jump1HMXRewnOHb/O86fx5wR3bXojIDQoh5pQ
eajppFXZUnDJ5khwMoq1kqTvjeQ3ju+EY7PnPInIszDyFj9QHMfz/SGbfg3Dr+Zv+IF0Iu5P
pQEo+/ECAwEAAaMtMCswGwYDVR0RBBQwEoEQcm9iLmluZm9AdmZzLmNvbTAMBgNVHRMBAf8E
AjAAMA0GCSqGSIb3DQEBBAUAA4GBAHrd0dD5hESINCQLgbzjyiMvmqP+j69v/uTd8P3AqQyY
7jUB1SWpjbf8skhBdb7QJQ3AJ9LmqEcC8A5XEV/fzZ+vsdcSCLMxIViQiRwc5X06bkKQsRrs
IVqD1j8HFMptO9Dg0xR0p8fTxMxv9y8cUaZR+Zait3PwbOGiYQzm+843MIIDPzCCAqigAwIB
AgIBDTANBgkqhkiG9w0BAQUFADCB0TELMAkGA1UEBhMCWkExFTATBgNVBAgTDFdlc3Rlcm4g
Q2FwZTESMBAGA1UEBxMJQ2FwZSBUb3duMRowGAYDVQQKExFUaGF3dGUgQ29uc3VsdGluZzEo
MCYGA1UECxMfQ2VydGlmaWNhdGlvbiBTZXJ2aWNlcyBEaXZpc2lvbjEkMCIGA1UEAxMbVGhh
d3RlIFBlcnNvbmFsIEZyZWVtYWlsIENBMSswKQYJKoZIhvcNAQkBFhxwZXJzb25hbC1mcmVl
bWFpbEB0aGF3dGUuY29tMB4XDTAzMDcxNzAwMDAwMFoXDTEzMDcxNjIzNTk1OVowYjELMAkG
A1UEBhMCWkExJTAjBgNVBAoTHFRoYXd0ZSBDb25zdWx0aW5nIChQdHkpIEx0ZC4xLDAqBgNV
BAMTI1RoYXd0ZSBQZXJzb25hbCBGcmVlbWFpbCBJc3N1aW5nIENBMIGfMA0GCSqGSIb3DQEB
AQUAA4GNADCBiQKBgQDEpjxVc1X7TrnKmVoeaMB1BHCd3+n/ox7svc31W/Iadr1/DDph8r9R
zgHU5VAKMNcCY1osiRVwjt3J8CuFWqo/cVbLrzwLB+fxH5E2JCoTzyvV84J3PQO+K/67GD4H
v0CAAmTXp6a7n2XRxSpUhQ9IBH+nttE8YQRAHmQZcmC3+wIDAQABo4GUMIGRMBIGA1UdEwEB
/wQIMAYBAf8CAQAwQwYDVR0fBDwwOjA4oDagNIYyaHR0cDovL2NybC50aGF3dGUuY29tL1Ro
YXd0ZVBlcnNvbmFsRnJlZW1haWxDQS5jcmwwCwYDVR0PBAQDAgEGMCkGA1UdEQQiMCCkHjAc
MRowGAYDVQQDExFQcml2YXRlTGFiZWwyLTEzODANBgkqhkiG9w0BAQUFAAOBgQBIjNFQg+oL
LswNo2asZw9/r6y+whehQ5aUnX9MIbj4Nh+qLZ82L8D0HFAgk3A8/a3hYWLD2ToZfoSxmRsA
xRoLgnSeJVCUYsfbJ3FXJY3dqZw5jowgT2Vfldr394fWxghOrvbqNOUQGls1TXfjViF4gtwh
GTXeJLHTHUb/XV9lTzGCArowggK2AgEBMGkwYjELMAkGA1UEBhMCWkExJTAjBgNVBAoTHFRo
YXd0ZSBDb25zdWx0aW5nIChQdHkpIEx0ZC4xLDAqBgNVBAMTI1RoYXd0ZSBQZXJzb25hbCBG
cmVlbWFpbCBJc3N1aW5nIENBAgMPtfwwCQYFKw4DAhoFAKCCAacwGAYJKoZIhvcNAQkDMQsG
CSqGSIb3DQEHATAcBgkqhkiG9w0BCQUxDxcNMDYwNzI1MTgxOTI3WjAjBgkqhkiG9w0BCQQx
FgQUk60k+aE3T1Eu8LttiiNjwD62F2AwUgYJKoZIhvcNAQkPMUUwQzAKBggqhkiG9w0DBzAO
BggqhkiG9w0DAgICAIAwDQYIKoZIhvcNAwICAUAwBwYFKw4DAgcwDQYIKoZIhvcNAwICASgw
eAYJKwYBBAGCNxAEMWswaTBiMQswCQYDVQQGEwJaQTElMCMGA1UEChMcVGhhd3RlIENvbnN1
bHRpbmcgKFB0eSkgTHRkLjEsMCoGA1UEAxMjVGhhd3RlIFBlcnNvbmFsIEZyZWVtYWlsIElz
c3VpbmcgQ0ECAw+1/DB6BgsqhkiG9w0BCRACCzFroGkwYjELMAkGA1UEBhMCWkExJTAjBgNV
BAoTHFRoYXd0ZSBDb25zdWx0aW5nIChQdHkpIEx0ZC4xLDAqBgNVBAMTI1RoYXd0ZSBQZXJz
b25hbCBGcmVlbWFpbCBJc3N1aW5nIENBAgMPtfwwDQYJKoZIhvcNAQEBBQAEgYAkr3G2zCvo
3lobq73KNr830gwpTRNMvGNZtGfhFhq8shemH1D58cnB2imPHS/yKiUSNAPp4vDYTrmn9FHs
K5zC17K7CCOYHD/A/E7K4UQ3GUn+kwy8ZOOjobz95QiOJ7pVzib4BaSVMXTGe4RXH9wqns8n
nryHgrZUin7tmZcTUgAAAAAAAA==
--------------ms000209070607070205030503--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?44C660AF.5040206>