Skip site navigation (1)Skip section navigation (2)
Date:      Sat, 20 Dec 2003 19:07:41 +0100
From:      "Oivind H. Danielsen" <oivind.danielsen@kopek.net>
To:        <freebsd-stable@freebsd.org>
Subject:   WRITE command timeout
Message-ID:  <NMEPLAHDNAPMGKOIJMLLIEFNCAAA.oivind.danielsen@kopek.net>

next in thread | raw e-mail | index | archive | help
This is a multi-part message in MIME format.

------=_NextPart_000_0004_01C3C72C.8AD09600
Content-Type: text/plain;
	charset="iso-8859-1"
Content-Transfer-Encoding: 7bit

Hello.

We have been running FreeBSD 4.6-5.1 systems for 1.5 years and are being
plagued  by these:

 Dec 18 15:15:39 <> /kernel: ad0: WRITE command timeout tag=0 serv=0 -
resetting
 Dec 19 15:03:23 <> /kernel: ad0: READ command timeout tag=0 serv=0 -
resetting


In our rack we have 34 identical drives (IBM IC35L080AVVA07).

  24 drives on Windows 2000    : no problems.
   4 drives on Linux 2.4.x     : no problems.

   2 drives on RELENG_4_8
    (VIA 82C686, VIA C3)       : no problems

   4 drives on RELENG_4_8
    (nVIDIA nForce, XP 2000+)  : r/w timeouts, fs corruption.

  (1 drive/system, 6 FreeBSD boxes)

The good systems have been running the 1.5 years without a hitch. The
four identical RELENG_4_8 systems have all had corrupted filesystems (at
least once every two months).


We have tried the following:

 - Changed ATA100 cables (3 diff. types, all 80-wire)
 - Disabled DMA (use PIO4) (hw.ata.ata_dma="0" in loader.conf)
 - Disabled DMA in BIOS setup
 - Changed motherboard (MSI MS6734, VIA KM400, vt8235 ATA)
 - Changed power supply (added 100W)
 - RELENG_5_1.

None of these changes has helped. The only change seen when disabling
DMA is  additional messages: "timeout waiting for DRQ - resetting".


I have searched the net for more information on this topic for over a
year, and  all I find is replies like:

  - "Just change the cable, dude.."   (did that, still timeouts)
  - "IBM drives are bad for you."     (seen this with other drives too)
                                      (drives work well on Linux/W2k)
  - "Disabling DMA fixes it."         (tried that, it didn't)
  - "ATA is for wimps. SCSI rulezz."  (different discussion)


# sysctl hw.ata
hw.ata.ata_dma: 0
hw.ata.wc: 1
hw.ata.tags: 0
hw.ata.atapi_dma: 0

# atacontrol mode 0
Master = PIO4
Slave  = ???

# atacontrol info 0
Master:  ad0 <IC35L080AVVA07-0/VA4OA52A> ATA/ATAPI rev 5
Slave:       no device present


dmesg, pciconf and kernel config are attached. No special compilation
options  (except -DIPFW2) are used. I can provide more information on
request.

We're now running FreeBSD 4.8-RELEASE-p14 and FreeBSD 5.1-RELEASE-p8,
but the  problem has been around since we started out with 4.6 I
believe.  The "good" and "bad" FreeBSD systems all use the same
kernel/world.


The reason why we have used such low-end hardware in these boxes is that
they are  part of a highly redundant cluster solution for crypto
processing (no storage is used for application purposes). This means the
system can cope with the occasional fs corruption, but we would still
prefer to get rid of it.


I know this problem has been discussed before, but wanted to add more
data to the  discussion. I don't think all of the reports should be
attributed to bad HW. Nevertheless, even if the hardware is broken, the
system should preferably  function equally well/bad as with Linux/W2k.


Any help is greatly appreciated.


Best Regards,

Oivind H. Danielsen

------=_NextPart_000_0004_01C3C72C.8AD09600
Content-Type: text/plain;
	name="dmesg.txt"
Content-Transfer-Encoding: quoted-printable
Content-Disposition: attachment;
	filename="dmesg.txt"

Copyright (c) 1992-2003 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
	The Regents of the University of California. All rights reserved.
FreeBSD 4.8-RELEASE-p14 #0: Sat Dec  6 00:30:50 CET 2003
Timecounter "i8254"  frequency 1193182 Hz
CPU: AMD Athlon(TM) XP 2000+ (1662.38-MHz 686-class CPU)
  Origin =3D "AuthenticAMD"  Id =3D 0x662  Stepping =3D 2
  =
Features=3D0x383fbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE=
,MCA,CMOV,PAT,PSE36,MMX,FXSR,SSE>
  AMD Features=3D0xc0400000<AMIE,DSP,3DNow!>
real memory  =3D 503234560 (491440K bytes)
avail memory =3D 485507072 (474128K bytes)
Preloaded elf kernel "kernel" at 0xc03e3000.
Pentium Pro MTRR support enabled
md0: Malloc disk
Using $PIR table, 10 entries at 0xc00f20b0
npx0: <math processor> on motherboard
npx0: INT 16 interface
pcib0: <Host to PCI bridge> on motherboard
pci0: <PCI bus> on pcib0
pci0: <unknown card> (vendor=3D0x10de, dev=3D0x01ac) at 0.1
pci0: <unknown card> (vendor=3D0x10de, dev=3D0x01ad) at 0.2
pci0: <unknown card> (vendor=3D0x10de, dev=3D0x01aa) at 0.3
isab0: <PCI to ISA bridge (vendor=3D10de device=3D01b2)> at device 1.0 =
on pci0
isa0: <ISA bus> on isab0
pci0: <unknown card> (vendor=3D0x10de, dev=3D0x01b4) at 1.1 irq 5
ohci0: <OHCI (generic) USB controller> mem 0xe7000000-0xe7000fff irq 10 =
at device 2.0 on pci0
usb0: OHCI version 1.0
usb0: SMM does not respond, resetting
usb0: <OHCI (generic) USB controller> on ohci0
usb0: USB revision 1.0
uhub0: (0x10de) OHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub0: 3 ports with 3 removable, self powered
ohci1: <OHCI (generic) USB controller> mem 0xe6800000-0xe6800fff irq 10 =
at device 3.0 on pci0
usb1: OHCI version 1.0
usb1: <OHCI (generic) USB controller> on ohci1
usb1: USB revision 1.0
uhub1: (0x10de) OHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub1: 3 ports with 3 removable, self powered
pci0: <unknown card> (vendor=3D0x10de, dev=3D0x01c3) at 4.0 irq 10
pci0: <unknown card> (vendor=3D0x10de, dev=3D0x01b0) at 5.0 irq 5
pci0: <unknown card> (vendor=3D0x10de, dev=3D0x01b1) at 6.0 irq 11
pcib1: <PCI to PCI bridge (vendor=3D10de device=3D01b8)> at device 8.0 =
on pci0
pci1: <PCI bus> on pcib1
pcib2: <DEC 21150 PCI-PCI bridge> at device 6.0 on pci1
pci2: <PCI bus> on pcib2
fxp0: <Intel Pro 10/100B/100+ Ethernet> port 0xb800-0xb83f mem =
0xe4000000-0xe40fffff,0xe4800000-0xe4800fff irq 5 at device 4.0 on pci2
fxp0: Ethernet address 00:08:9b:14:72:0f
inphy0: <i82555 10/100 media interface> on miibus0
inphy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
fxp1: <Intel Pro 10/100B/100+ Ethernet> port 0xb400-0xb43f mem =
0xe3000000-0xe30fffff,0xe3800000-0xe3800fff irq 5 at device 5.0 on pci2
fxp1: Ethernet address 00:08:9b:14:72:10
inphy1: <i82555 10/100 media interface> on miibus1
inphy1:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
fxp2: <Intel Pro 10/100B/100+ Ethernet> port 0xb000-0xb03f mem =
0xe2000000-0xe20fffff,0xe2800000-0xe2800fff irq 5 at device 6.0 on pci2
fxp2: Ethernet address 00:08:9b:14:71:9b
inphy2: <i82555 10/100 media interface> on miibus2
inphy2:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
fxp3: <Intel Pro 10/100B/100+ Ethernet> port 0xa800-0xa83f mem =
0xe1000000-0xe10fffff,0xe1800000-0xe1800fff irq 5 at device 7.0 on pci2
fxp3: Ethernet address 00:08:9b:14:71:9c
inphy3: <i82555 10/100 media interface> on miibus3
inphy3:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
atapci0: <nVIDIA nForce ATA100 controller> port 0x9800-0x980f at device =
9.0 on pci0
ata0: at 0x1f0 irq 14 on atapci0
ata1: at 0x170 irq 15 on atapci0
pcib3: <PCI to PCI bridge (vendor=3D10de device=3D01b7)> at device 30.0 =
on pci0
pci3: <PCI bus> on pcib3
pci3: <NVidia model 01a0 graphics accelerator> at 0.0 irq 11
orm0: <Option ROM> at iomem 0xd0000-0xd3fff on isa0
fdc0: <NEC 72065B or clone> at port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on =
isa0
fdc0: FIFO enabled, 8 bytes threshold
fd0: <1440-KB 3.5" drive> on fdc0 drive 0
atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on =
isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=3D0x100>
sio0 at port 0x3f8-0x3ff irq 4 flags 0x10 on isa0
sio0: type 16550A, console
sio1 at port 0x2f8-0x2ff irq 3 on isa0
sio1: type 16550A
ppc0: <Parallel port> at port 0x378-0x37f irq 7 on isa0
ppc0: SMC-like chipset (ECP/EPP/PS2/NIBBLE) in COMPATIBLE mode
ppc0: FIFO with 16/16/9 bytes threshold
ipfw2 initialized, divert enabled, rule-based forwarding enabled, =
default to deny, logging limited to 100 packets/entry by default
ad0: 78533MB <IC35L080AVVA07-0> [159560/16/63] at ata0-master PIO4
Mounting root from ufs:/dev/ad0s1a

------=_NextPart_000_0004_01C3C72C.8AD09600
Content-Type: text/plain;
	name="kernel_config.txt"
Content-Transfer-Encoding: quoted-printable
Content-Disposition: attachment;
	filename="kernel_config.txt"

machine		i386
cpu		I386_CPU
cpu		I486_CPU
cpu		I586_CPU
cpu		I686_CPU
ident		GENERIC
maxusers	0

makeoptions	DEBUG=3D-g		#Build kernel with gdb(1) debug symbols

options 	MATH_EMULATE		#Support for x87 emulation
options 	INET			#InterNETworking
options 	INET6			#IPv6 communications protocols
options 	FFS			#Berkeley Fast Filesystem
options 	FFS_ROOT		#FFS usable as root device [keep this!]
options 	SOFTUPDATES		#Enable FFS soft updates support
options 	UFS_DIRHASH		#Improve performance on big directories
options 	MFS			#Memory Filesystem
options 	MD_ROOT			#MD is a potential root device
options 	NFS			#Network Filesystem
options 	NFS_ROOT		#NFS usable as root device, NFS required
options 	MSDOSFS			#MSDOS Filesystem
options 	CD9660			#ISO 9660 Filesystem
options 	CD9660_ROOT		#CD-ROM usable as root, CD9660 required
options 	PROCFS			#Process filesystem
options 	COMPAT_43		#Compatible with BSD 4.3 [KEEP THIS!]
options 	SCSI_DELAY=3D15000	#Delay (in ms) before probing SCSI
options 	UCONSOLE		#Allow users to grab the console
options 	USERCONFIG		#boot -c editor
options 	VISUAL_USERCONFIG	#visual boot -c editor
options 	KTRACE			#ktrace(1) support
options 	SYSVSHM			#SYSV-style shared memory
options 	SYSVMSG			#SYSV-style message queues
options 	SYSVSEM			#SYSV-style semaphores
options 	P1003_1B		#Posix P1003_1B real-time extensions
options 	_KPOSIX_PRIORITY_SCHEDULING
options		ICMP_BANDLIM		#Rate limit bad replies
options 	KBD_INSTALL_CDEV	# install a CDEV entry in /dev
options 	COMPAT_LINUX

# To make an SMP kernel, the next two are needed
#options 	SMP			# Symmetric MultiProcessor Kernel
#options 	APIC_IO			# Symmetric (APIC) I/O

device		isa
device		pci

# Floppy drives
device		fdc0	at isa? port IO_FD1 irq 6 drq 2
device		fd0	at fdc0 drive 0

# ATA and ATAPI devices
device		ata0	at isa? port IO_WD1 irq 14
device		ata1	at isa? port IO_WD2 irq 15
device		ata
device		atadisk			# ATA disk drives
device		atapicd			# ATAPI CDROM drives
options 	ATA_STATIC_ID		#Static device numbering

# SCSI peripherals
device		scbus		# SCSI bus (required)
device		da		# Direct Access (disks)
device		sa		# Sequential Access (tape etc)
device		cd		# CD
device		pass		# Passthrough device (direct SCSI access)

device		twe		# 3ware Escalade

# atkbdc0 controls both the keyboard and the PS/2 mouse
device		atkbdc0	at isa? port IO_KBD
device		atkbd0	at atkbdc? irq 1 flags 0x1
device		psm0	at atkbdc? irq 12

device		vga0	at isa?

# splash screen/screen saver
pseudo-device	splash

# syscons is the default console driver, resembling an SCO console
device		sc0	at isa? flags 0x100

# Floating point support - do not disable.
device		npx0	at nexus? port IO_NPX irq 13

# Power management support (see LINT for more options)
device		apm0    at nexus? disable flags 0x20 # Advanced Power Management

# Serial (COM) ports
device		sio0	at isa? port IO_COM1 flags 0x10 irq 4
device		sio1	at isa? port IO_COM2 irq 3

# Parallel port
device		ppc0	at isa? irq 7
device		ppbus		# Parallel port bus (required)

# PCI Ethernet NICs.
device		de		# DEC/Intel DC21x4x (``Tulip'')
device		em		# Intel PRO/1000 adapter Gigabit Ethernet Card (``Wiseman'')
device		txp		# 3Com 3cR990 (``Typhoon'')
device		vx		# 3Com 3c590, 3c595 (``Vortex'')

# PCI Ethernet NICs that use the common MII bus controller code.
# NOTE: Be sure to keep the 'device miibus' line in order to use these =
NICs!
device		miibus		# MII bus support
device		dc		# DEC/Intel 21143 and various workalikes
device		fxp		# Intel EtherExpress PRO/100B (82557, 82558)
device		pcn		# AMD Am79C97x PCI 10/100 NICs
device		rl		# RealTek 8129/8139
device		sf		# Adaptec AIC-6915 (``Starfire'')
device		sis		# Silicon Integrated Systems SiS 900/SiS 7016
device		ste		# Sundance ST201 (D-Link DFE-550TX)
device		tl		# Texas Instruments ThunderLAN
device		tx		# SMC EtherPower II (83c170 ``EPIC'')
device		vr		# VIA Rhine, Rhine II
device		wb		# Winbond W89C840F
device		xl		# 3Com 3c90x (``Boomerang'', ``Cyclone'')
device		bge		# Broadcom BCM570x (``Tigon III'')

# Pseudo devices - the number indicates how many units to allocate.
pseudo-device	loop		# Network loopback
pseudo-device	ether		# Ethernet support
pseudo-device	vlan	4	#VLAN support
pseudo-device	tun		# Packet tunnel.
pseudo-device	pty		# Pseudo-ttys (telnet etc)
pseudo-device	md		# Memory "disks"
pseudo-device	gif		# IPv6 and IPv4 tunneling
pseudo-device	faith	1	# IPv6-to-IPv4 relaying (translation)

# The `bpf' pseudo-device enables the Berkeley Packet Filter.
# Be aware of the administrative consequences of enabling this!
pseudo-device	bpf		#Berkeley packet filter

# USB support
device		uhci		# UHCI PCI->USB interface
device		ohci		# OHCI PCI->USB interface
device		usb		# USB Bus (required)
device		ugen		# Generic
device		uhid		# "Human Interface Devices"
device		ukbd		# Keyboard
device		ulpt		# Printer
device		ums		# Mouse

options 	IPFIREWALL		#firewall
options		IPFW2
options 	IPDIVERT		#divert sockets
options 	IPFIREWALL_VERBOSE	#enable logging to syslogd(8)
options 	IPFIREWALL_VERBOSE_LIMIT=3D100	#limit verbosity

------=_NextPart_000_0004_01C3C72C.8AD09600
Content-Type: text/plain;
	name="pciconf.txt"
Content-Transfer-Encoding: quoted-printable
Content-Disposition: attachment;
	filename="pciconf.txt"

chip0@pci0:0:0:	class=3D0x060000 card=3D0x00000000 chip=3D0x01a410de =
rev=3D0xb2 hdr=3D0x00
    vendor   =3D 'NVIDIA Corporation'
    device   =3D 'nForce AGP Controller'
    class    =3D bridge
    subclass =3D HOST-PCI
none0@pci0:0:1:	class=3D0x050000 card=3D0x0c1110de chip=3D0x01ac10de =
rev=3D0xb2 hdr=3D0x00
    vendor   =3D 'NVIDIA Corporation'
    device   =3D 'nForce 2x0/415/4x0 Memory Controller'
    class    =3D memory
    subclass =3D RAM
none1@pci0:0:2:	class=3D0x050000 card=3D0x0c1110de chip=3D0x01ad10de =
rev=3D0xb2 hdr=3D0x00
    vendor   =3D 'NVIDIA Corporation'
    device   =3D 'nForce 2x0/415/4x0 Memory Controller'
    class    =3D memory
    subclass =3D RAM
none2@pci0:0:3:	class=3D0x050000 card=3D0x0c1110de chip=3D0x01aa10de =
rev=3D0xb2 hdr=3D0x00
    vendor   =3D 'NVIDIA Corporation'
    device   =3D 'nForce 220/230 Memory Controller (DDR)'
    class    =3D memory
    subclass =3D RAM
isab0@pci0:1:0:	class=3D0x060100 card=3D0x0c1110de chip=3D0x01b210de =
rev=3D0xc3 hdr=3D0x00
    vendor   =3D 'NVIDIA Corporation'
    device   =3D 'nForce HUB Interface'
    class    =3D bridge
    subclass =3D PCI-ISA
none3@pci0:1:1:	class=3D0x0c0500 card=3D0x0c1110de chip=3D0x01b410de =
rev=3D0xc1 hdr=3D0x00
    vendor   =3D 'NVIDIA Corporation'
    device   =3D 'nForce MCP SMBus Controller'
    class    =3D serial bus
    subclass =3D SMBus
ohci0@pci0:2:0:	class=3D0x0c0310 card=3D0x0c1110de chip=3D0x01c210de =
rev=3D0xc3 hdr=3D0x00
    vendor   =3D 'NVIDIA Corporation'
    device   =3D 'nForce MCP OHCI USB Controller'
    class    =3D serial bus
    subclass =3D USB
ohci1@pci0:3:0:	class=3D0x0c0310 card=3D0x0c1110de chip=3D0x01c210de =
rev=3D0xc3 hdr=3D0x00
    vendor   =3D 'NVIDIA Corporation'
    device   =3D 'nForce MCP OHCI USB Controller'
    class    =3D serial bus
    subclass =3D USB
none4@pci0:4:0:	class=3D0x020000 card=3D0x0c111043 chip=3D0x01c310de =
rev=3D0xc2 hdr=3D0x00
    vendor   =3D 'NVIDIA Corporation'
    device   =3D 'nForce MCP Networking Adapter'
    class    =3D network
    subclass =3D ethernet
none5@pci0:5:0:	class=3D0x040100 card=3D0x0c111043 chip=3D0x01b010de =
rev=3D0xc2 hdr=3D0x00
    vendor   =3D 'NVIDIA Corporation'
    device   =3D 'nForce MCP Audio Processing Unit (Dolby Digital)'
    class    =3D multimedia
    subclass =3D audio
none6@pci0:6:0:	class=3D0x040100 card=3D0x83841043 chip=3D0x01b110de =
rev=3D0xc2 hdr=3D0x00
    vendor   =3D 'NVIDIA Corporation'
    device   =3D 'nForce MCP Audio Codec Interface'
    class    =3D multimedia
    subclass =3D audio
pcib1@pci0:8:0:	class=3D0x060400 card=3D0x00000044 chip=3D0x01b810de =
rev=3D0xc2 hdr=3D0x01
    vendor   =3D 'NVIDIA Corporation'
    device   =3D 'nForce PCI Bridge'
    class    =3D bridge
    subclass =3D PCI-PCI
atapci0@pci0:9:0:	class=3D0x01018a card=3D0x0c1110de chip=3D0x01bc10de =
rev=3D0xc3 hdr=3D0x00
    vendor   =3D 'NVIDIA Corporation'
    device   =3D 'nForce MCP ATA Controller'
    class    =3D mass storage
    subclass =3D ATA
pcib3@pci0:30:0:	class=3D0x060400 card=3D0x00000000 chip=3D0x01b710de =
rev=3D0xb2 hdr=3D0x01
    vendor   =3D 'NVIDIA Corporation'
    device   =3D 'nForce AGP Host to PCI Bridge'
    class    =3D bridge
    subclass =3D PCI-PCI
pcib2@pci1:6:0:	class=3D0x060400 card=3D0x000000dc chip=3D0x00221011 =
rev=3D0x06 hdr=3D0x01
    vendor   =3D 'Digital Equipment Corporation'
    device   =3D '21150-AA PCI to PCI Bridge'
    class    =3D bridge
    subclass =3D PCI-PCI
fxp0@pci2:4:0:	class=3D0x020000 card=3D0x100c8086 chip=3D0x12298086 =
rev=3D0x08 hdr=3D0x00
    vendor   =3D 'Intel Corporation'
    device   =3D '82557/8/9 EtherExpress PRO/100(B) Ethernet Adapter'
    class    =3D network
    subclass =3D ethernet
fxp1@pci2:5:0:	class=3D0x020000 card=3D0x100c8086 chip=3D0x12298086 =
rev=3D0x08 hdr=3D0x00
    vendor   =3D 'Intel Corporation'
    device   =3D '82557/8/9 EtherExpress PRO/100(B) Ethernet Adapter'
    class    =3D network
    subclass =3D ethernet
fxp2@pci2:6:0:	class=3D0x020000 card=3D0x100c8086 chip=3D0x12298086 =
rev=3D0x08 hdr=3D0x00
    vendor   =3D 'Intel Corporation'
    device   =3D '82557/8/9 EtherExpress PRO/100(B) Ethernet Adapter'
    class    =3D network
    subclass =3D ethernet
fxp3@pci2:7:0:	class=3D0x020000 card=3D0x100c8086 chip=3D0x12298086 =
rev=3D0x08 hdr=3D0x00
    vendor   =3D 'Intel Corporation'
    device   =3D '82557/8/9 EtherExpress PRO/100(B) Ethernet Adapter'
    class    =3D network
    subclass =3D ethernet
none7@pci3:0:0:	class=3D0x030000 card=3D0x00000000 chip=3D0x01a010de =
rev=3D0xb1 hdr=3D0x00
    vendor   =3D 'NVIDIA Corporation'
    device   =3D 'GeForce2 [Crush11] Integrated Graphics'
    class    =3D display
    subclass =3D VGA

------=_NextPart_000_0004_01C3C72C.8AD09600--




Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?NMEPLAHDNAPMGKOIJMLLIEFNCAAA.oivind.danielsen>