Date: Wed, 20 Nov 2002 19:02:37 +0100 (CET) From: Herve Boulouis <boulouis@nerim.net> To: FreeBSD-gnats-submit@FreeBSD.org Cc: raphit@noemie.org Subject: kern/45535: nfs client panic Message-ID: <200211201802.gAKI2bTQ026080@sveren.raphit.net>
next in thread | raw e-mail | index | archive | help
>Number: 45535
>Category: kern
>Synopsis: nfs client panic
>Confidential: no
>Severity: critical
>Priority: medium
>Responsible: freebsd-bugs
>State: open
>Quarter:
>Keywords:
>Date-Required:
>Class: sw-bug
>Submitter-Id: current-users
>Arrival-Date: Wed Nov 20 10:10:01 PST 2002
>Closed-Date:
>Last-Modified:
>Originator: Herve Boulouis
>Release: FreeBSD 4.6-STABLE i386
>Organization:
Nerim - French DSL ISP
>Environment:
System: FreeBSD sveren 4.6-STABLE FreeBSD 4.6-STABLE #0: Mon Jul 15 14:47:55 CEST 2002 root@sveren:/usr/obj/usr/src/sys/SVEREN i386
>Description:
Our news reader machine runs inn with some cnfs buffers on an nfs-mounted filesystem. The problem is that the
kernel panics less than an hour after starting inn. The NFS server runs FreeBSD 4.7-stable and exports 2 large
filesystems of 100 GB with one file (cnfs buffer) on each. The NFS client runs 4.6-STABLE but the problem also
happens with 4.7-STABLE.
The problem seems related to NFS since the kernel panics when open()'ing a file over nfs. (see backtrace)
Here are some infos about the machines :
* NFS Client :
-- Stripped dmesg :
Copyright (c) 1992-2002 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD 4.6-STABLE #0: Mon Jul 15 14:47:55 CEST 2002
root@sveren:/usr/obj/usr/src/sys/SVEREN
Timecounter "i8254" frequency 1193182 Hz
Timecounter "TSC" frequency 999725161 Hz
CPU: Pentium III/Pentium III Xeon/Celeron (999.73-MHz 686-class CPU)
Origin = "GenuineIntel" Id = 0x686 Stepping = 6
Features=0x383f9ff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,MMX,FXSR,SSE>
real memory = 268353536 (262064K bytes)
config> q
avail memory = 257777664 (251736K bytes)
Preloaded elf kernel "kernel" at 0xc034f000.
Preloaded userconfig_script "/boot/kernel.conf" at 0xc034f09c.
Pentium Pro MTRR support enabled
Using $PIR table, 8 entries at 0xc00f1280
npx0: <math processor> on motherboard
npx0: INT 16 interface
pcib0: <Host to PCI bridge> on motherboard
pci0: <PCI bus> on pcib0
pcib2: <VIA 82C598MVP (Apollo MVP3) PCI-PCI (AGP) bridge> at device 1.0 on pci0
pci1: <PCI bus> on pcib2
pci1: <Cirrus Logic GD5465 SVGA controller> at 0.0 irq 11
isab0: <VIA 82C686 PCI-ISA bridge> at device 4.0 on pci0
isa0: <ISA bus> on isab0
atapci0: <VIA 82C686 ATA100 controller> port 0xd800-0xd80f at device 4.1 on pci0
ata0: at 0x1f0 irq 14 on atapci0
ata1: at 0x170 irq 15 on atapci0
sym0: <875> port 0xb800-0xb8ff mem 0xf6800000-0xf6800fff,0xf7000000-0xf70000ff irq 10 at device 7.0 on pci0
sym0: Tekram NVRAM, ID 7, Fast-20, SE, parity checking
xl0: <3Com 3cSOHO100-TX OfficeConnect> port 0xb400-0xb47f mem 0xf6000000-0xf600007f irq 5 at device 9.0 on pci0
xl0: Ethernet address: 00:04:76:99:65:69
miibus0: <MII bus> on xl0
xlphy0: <3Com internal media interface> on miibus0
xlphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
pcib1: <Host to PCI bridge> on motherboard
pci2: <PCI bus> on pcib1
ata1-slave: ATA identify retries exceeded
ata1-master: ATA identify retries exceeded
ad0: 78533MB <IC35L080AVVA07-0> [159560/16/63] at ata0-master UDMA100
ad1: 73308MB <IBM-DTLA-307075> [148945/16/63] at ata0-slave UDMA100
da0 at sym0 bus 0 target 0 lun 0
da0: <IBM DDYS-T18350N S96H> Fixed Direct Access SCSI-3 device
da0: 40.000MB/s transfers (20.000MHz, offset 16, 16bit), Tagged Queueing Enabled
da0: 17501MB (35843670 512 byte sectors: 255H 63S/T 2231C)
WARNING: / was not properly dismounted
-- file system info :
biggoron:/exports/ad12s1e /biggoron/ad12s1e nfs rw,tcp,nfsv3,soft
biggoron:/exports/ad14s1e /biggoron/ad14s1e nfs rw,tcp,nfsv3,soft
bash-2.05$ ls -al /biggoron/ad12s1e/
total 114308261
drwxr-xr-x 2 news news 512 Nov 20 17:50 .
drwxr-xr-x 4 root wheel 512 Nov 20 17:39 ..
-rw-r--r-- 1 news news 117037334528 Nov 20 18:07 BIGBIN2
bash-2.05$ df -h
Filesystem Size Used Avail Capacity Mounted on
/dev/da0s1a 62M 38M 19M 66% /
/dev/da0s1e 3.9G 2.4G 1.2G 68% /home
/dev/da0s1f 1.9G 589M 1.2G 32% /usr
/dev/da0s1g 2.9G 315M 2.4G 11% /var
/dev/da0s1h 7.5G 6.2G 797M 89% /data
/dev/ad0c 74G 45G 24G 66% /stuff
/dev/ad1c 69G 68G -4.6G 107% /stuff/videos/films
procfs 4.0K 4.0K 0B 100% /proc
biggoron:/exports/ad12s1e 114G 109G 4.0G 96% /biggoron/ad12s1e
biggoron:/exports/ad14s1e 114G 109G 4.0G 96% /biggoron/ad14s1e
-- panic info :
panic: vinvalbuf: flush failed
syncing disks... 407 401 397 392 386 383 378 378 326 324 324 306 304 302 300 299 297 295 295 288 288 283 281 280 280 278 278 278 278 278 278 278 278 278 278 278 278 278 278 278 278 278 278 278 278
done
Uptime: 104d1h16m0s
dumping to dev #da/0x20001, offset 160
dump 255 254 253 252 251 250 249 248 247 246 245 244 243 242 241 240 239 238 237 236 235 234 233 232 231 230 229 228 227 226 225 224 223 222 221 220 219 218 217 216 215 214 213 212 211 210 209 208 207 206 205 204 203 202 201 200 199 198 197 196 195 194 193 192 191 190 189 188 187 186 185 184 183 182 181 180 179 178 177 176 175 174 173 172 171 170 169 168 167 166 165 164 163 162 161 160 159 158 157 156 155 154 153 152 151 150 149 148 147 146 145 144 143 142 141 140 139 138 137 136 135 134 133 132 131 130 129 128 127 126 125 124 123 122 121 120 119 118 117 116 115 114 113 112 111 110 109 108 107 106 105 104 103 102 101 100 99 98 97 96 95 94 93 92 91 90 89 88 87 86 85 84 83 82 81 80 79 78 77 76 75 74 73 72 71 70 69 68 67 66 65 64 63 62 61 60 59 58 57 56 55 54 53 52 51 50 49 48 47 46 45 44 43 42 41 40 39 38 37 36 35 34 33 32 31 30 29 28 27 26 25 24 23 22 21 20 19 18 17 16 15 14 13 12 11 10 9 8 7 6 5 4 3 2 1 0
---
#0 0xc015358e in dumpsys ()
(kgdb) bt
#0 0xc015358e in dumpsys ()
#1 0xc015335f in boot ()
#2 0xc0153784 in poweroff_wait ()
#3 0xc01800f1 in vinvalbuf ()
#4 0xc01d333c in nfs_vinvalbuf ()
#5 0xc01f6e51 in nfs_open ()
#6 0xc018756b in vn_open ()
#7 0xc0183470 in open ()
#8 0xc026e67d in syscall2 ()
#9 0xc0262ad5 in Xint0x80_syscall ()
#10 0x806687b in ?? ()
#11 0x8063e38 in ?? ()
#12 0x805ee3d in ?? ()
#13 0x8049e55 in ?? ()
The kernel & core dump are available upon request
* NFS Server :
-- Stripped dmesg :
Copyright (c) 1992-2002 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD 4.7-STABLE #0: Fri Nov 15 18:54:24 CET 2002
root@biggoron:/usr/src/sys/compile/BIGGORON
Timecounter "i8254" frequency 1193182 Hz
Timecounter "TSC" frequency 1817905668 Hz
CPU: Pentium 4 (1817.91-MHz 686-class CPU)
Origin = "GenuineIntel" Id = 0xf24 Stepping = 4
Features=0x3febfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,<b28>,ACC>
real memory = 536788992 (524208K bytes)
avail memory = 518275072 (506128K bytes)
Preloaded elf kernel "kernel" at 0xc03e8000.
Preloaded userconfig_script "/boot/kernel.conf" at 0xc03e809c.
netsmb_dev: loaded
Pentium Pro MTRR support enabled
Using $PIR table, 13 entries at 0xc00f2450
npx0: <math processor> on motherboard
npx0: INT 16 interface
pcib0: <Intel 82845 Host to PCI bridge> on motherboard
pci0: <PCI bus> on pcib0
pcib1: <Intel 82845 PCI-PCI (AGP) bridge> at device 1.0 on pci0
pci1: <PCI bus> on pcib1
pcib2: <Intel 82801BA/BAM (ICH2) Hub to PCI bridge> at device 30.0 on pci0
pci2: <PCI bus> on pcib2
atapci0: <Promise TX2 ATA133 controller> port 0xa400-0xa40f,0xa800-0xa803,0xb000-0xb007,0xb400-0xb403,0xb800-0xb807 mem 0xf5800000-0xf5803fff irq 5 at devic
e 2.0 on pci2
ata2: at 0xb800 on atapci0
ata3: at 0xb000 on atapci0
fxp0: <Intel Pro/100 Ethernet> port 0xa000-0xa03f mem 0xf5000000-0xf5000fff irq 3 at device 8.0 on pci2
fxp0: Ethernet address 00:e0:18:b7:a6:70
inphy0: <i82562ET 10/100 media interface> on miibus0
inphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
atapci1: <Promise ATA66 controller> port 0x8400-0x843f,0x8800-0x8803,0x9000-0x9007,0x9400-0x9403,0x9800-0x9807 mem 0xf4800000-0xf481ffff irq 7 at device 9.0
on pci2
ata4: at 0x9800 on atapci1
ata5: at 0x9000 on atapci1
atapci2: <Promise ATA66 controller> port 0x6800-0x683f,0x7000-0x7003,0x7400-0x7407,0x7800-0x7803,0x8000-0x8007 mem 0xf4000000-0xf401ffff irq 5 at device 10.
0 on pci2
ata6: at 0x8000 on atapci2
ata7: at 0x7400 on atapci2
pci2: <Matrox MGA Millennium 2064W graphics accelerator> at 12.0 irq 3
atapci3: <Intel ICH4 ATA100 controller> port 0xf000-0xf00f,0-0x3,0-0x7,0-0x3,0-0x7 irq 10 at device 31.1 on pci0
ata0: at 0x1f0 irq 14 on atapci3
ata1: at 0x170 irq 15 on atapci3
IPsec: Initialized Security Association Processing.
IP Filter: v3.4.29 initialized. Default = pass all, Logging = enabled
ad0: 117800MB <IC35L120AVVA07-0> [239340/16/63] at ata0-master UDMA100
ad2: 117800MB <IC35L120AVVA07-0> [239340/16/63] at ata1-master UDMA100
ad8: 117800MB <IC35L120AVVA07-0> [239340/16/63] at ata4-master UDMA66
ad10: 117800MB <IC35L120AVVA07-0> [239340/16/63] at ata5-master UDMA66
ad12: 117800MB <IC35L120AVVA07-0> [239340/16/63] at ata6-master UDMA66
ad14: 117800MB <IC35L120AVVA07-0> [239340/16/63] at ata7-master UDMA66
ar0: 235600MB <ATA RAID0 array> [30034/255/63] status: READY subdisks:
0 READY ad4: 117800MB <IC35L120AVVA07-0> [239340/16/63] at ata2-master UDMA100
1 READY ad6: 117800MB <IC35L120AVVA07-0> [239340/16/63] at ata3-master UDMA100
Mounting root from ufs:/dev/ad0s1a
>How-To-Repeat:
Run inn with large (100 GB) cnfs buffers over nfs and wait
>Fix:
dunno
>Release-Note:
>Audit-Trail:
>Unformatted:
To Unsubscribe: send mail to majordomo@FreeBSD.org
with "unsubscribe freebsd-bugs" in the body of the message
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?200211201802.gAKI2bTQ026080>