Skip site navigation (1)Skip section navigation (2)
Date:      Fri, 14 Aug 2009 20:04:21 -0700 (PDT)
From:      Jeff Richards <bsd24x7@yahoo.com>
To:        freebsd-stable@freebsd.org
Subject:   Re: Multiple USB drives stability question
Message-ID:  <558655.92355.qm@web110104.mail.gq1.yahoo.com>
In-Reply-To: <449180.49075.qm@web110112.mail.gq1.yahoo.com>

next in thread | previous in thread | raw e-mail | index | archive | help
I just tested my 2nd 1TB gmirror device on another system with FBSD 7.2.=A0=
 I was getting full throughput on the drive and no lockup using bonnie++ an=
d also monitoring with gstat.

I then moved those drives back on my main server.=A0 When I booted the syst=
em I hung on the 320GB gmirror devices.=A0 Previously the 1st 1TB gmirror a=
nd 320GB gmirror were attached to the integrated USB ports on the motherboa=
rd.=A0 I moved the 320GB gmirror to a PCI USB adapter.

The 2 320GB drives in the gmirror were da5 and da6.=A0 Here's what I saw on=
 the console:

(da6:umass-sim6:6:0:0): SYNCHRONIZE CACHE(10). CDB: 35 0 0 0 0 0 0 0 0 0
(da6:umass-sim6:6:0:0): CAM Status: SCSI Status Error
(da6:umass-sim6:6:0:0): SCSI Status: Check Condition
(da6:umass-sim6:6:0:0): ILLEGAL REQUEST asc:20,0
(da6:umass-sim6:6:0:0): Invalid command operation mode
(da6:umass-sim6:6:0:0): Unretryable error
GEOM_MIRROR: Request failed (error=3D5), da6[READ(offset=3D512, length=3D51=
2)]
GEOM_MIRROR: Device gm-san: provider da6 disconnected.
(da5:umass-sim5:5:0:0): SYNCHRONIZE CACHE(10). CDB: 35 0 0 0 0 0 0 0 0 0
(da5:umass-sim5:5:0:0): CAM Status: SCSI Status Error
(da5:umass-sim5:5:0:0): SCSI Status: Check Condition
(da5:umass-sim5:5:0:0): ILLEGAL REQUEST asc:20,0
(da5:umass-sim5:5:0:0): Invalid command operation mode
(da5:umass-sim5:5:0:0): Unretryable error
GEOM_JOURNAL: BIO_FLUSH not supported by mirror/gm-san.

I waited for a few minutes with no change in the console.=A0 I then detache=
d one of the USB drives (which happened to be da6) and saw this:

umass6: at uhub7 port 4 (addr 4) disconnected
(da6:umass-sim6:6:0:0): lost device

Nothing else changed for a few minutes so I powered off the system.=A0 When=
 I brought it back up the 320GB gmirror device was out of sync, but apart f=
rom that all devices were online.

Below are the kernel messages from the second boot:

Copyright (c) 1992-2009 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
=A0=A0=A0=A0=A0=A0=A0 The Regents of the University of California. All righ=
ts reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 7.2-RELEASE #0: Fri May=A0 1 08:49:13 UTC 2009
=A0=A0=A0 root@walker.cse.buffalo.edu:/usr/obj/usr/src/sys/GENERIC
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: Intel(R) Celeron(R) CPU 2.26GHz (2266.67-MHz 686-class CPU)
=A0 Origin =3D "GenuineIntel"=A0 Id =3D 0xf49=A0 Stepping =3D 9
=A0 Features=3D0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,=
PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
=A0 Features2=3D0x441d<SSE3,DTES64,MON,DS_CPL,CNXT-ID,xTPR>
=A0 AMD Features2=3D0x1<LAHF>
real memory=A0 =3D 1877868544 (1790 MB)
avail memory =3D 1826934784 (1742 MB)
ACPI APIC Table: <P4M900 AWRDACPI>
ioapic0 <Version 0.3> irqs 0-23 on motherboard
ioapic1 <Version 0.3> irqs 24-47 on motherboard
kbd1 at kbdmux0
acpi0: <P4M900 AWRDACPI> on motherboard
acpi0: [ITHREAD]
acpi0: Power Button (fixed)
acpi0: reservation of 0, a0000 (3) failed
acpi0: reservation of 100000, 6fde0000 (3) failed
Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0
acpi_hpet0: <High Precision Event Timer> iomem 0xfe800000-0xfe8003ff on acp=
i0
device_attach: acpi_hpet0 attach returned 12
acpi_button0: <Power Button> on acpi0
acpi_button1: <Sleep Button> on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
pcib1: <PCI-PCI bridge> at device 1.0 on pci0
pci1: <PCI bus> on pcib1
vgapci0: <VGA-compatible display> mem 0xc0000000-0xcfffffff,0xfb000000-0xfb=
ffffff irq 16 at device 0.0 on pci1
pcib2: <ACPI PCI-PCI bridge> irq 27 at device 2.0 on pci0
pci2: <ACPI PCI bus> on pcib2
pcib3: <ACPI PCI-PCI bridge> irq 31 at device 3.0 on pci0
pci3: <ACPI PCI bus> on pcib3
atapci0: <VIA 8237S SATA150 controller> port 0xfc00-0xfc07,0xf800-0xf803,0x=
f400-0xf407,0xf000-0xf003,0xec00-0xec0f,0xe800-0xe8ff irq 21 at device 15.0=
 on pci0
atapci0: [ITHREAD]
ata2: <ATA channel 0> on atapci0
ata2: [ITHREAD]
ata3: <ATA channel 1> on atapci0
ata3: [ITHREAD]
atapci1: <VIA 8237S UDMA133 controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,=
0x376,0xe400-0xe40f at device 15.1 on pci0
ata0: <ATA channel 0> on atapci1
ata0: [ITHREAD]
ata1: <ATA channel 1> on atapci1
ata1: [ITHREAD]
uhci0: <VIA 83C572 USB controller> port 0xe000-0xe01f irq 20 at device 16.0=
 on pci0
uhci0: [GIANT-LOCKED]
uhci0: [ITHREAD]
usb0: <VIA 83C572 USB controller> on uhci0
usb0: USB revision 1.0
uhub0: <VIA UHCI root hub, class 9/0, rev 1.00/1.00, addr 1> on usb0
uhub0: 2 ports with 2 removable, self powered
uhci1: <VIA 83C572 USB controller> port 0xdc00-0xdc1f irq 22 at device 16.1=
 on pci0
uhci1: [GIANT-LOCKED]
uhci1: [ITHREAD]
usb1: <VIA 83C572 USB controller> on uhci1
usb1: USB revision 1.0
uhub1: <VIA UHCI root hub, class 9/0, rev 1.00/1.00, addr 1> on usb1
uhub1: 2 ports with 2 removable, self powered
uhci2: <VIA 83C572 USB controller> port 0xd800-0xd81f irq 21 at device 16.2=
 on pci0
uhci2: [GIANT-LOCKED]
uhci2: [ITHREAD]
usb2: <VIA 83C572 USB controller> on uhci2
usb2: USB revision 1.0
uhub2: <VIA UHCI root hub, class 9/0, rev 1.00/1.00, addr 1> on usb2
uhub2: 2 ports with 2 removable, self powered
uhci3: <VIA 83C572 USB controller> port 0xd400-0xd41f irq 23 at device 16.3=
 on pci0
uhci3: [GIANT-LOCKED]
uhci3: [ITHREAD]
usb3: <VIA 83C572 USB controller> on uhci3
usb3: USB revision 1.0
uhub3: <VIA UHCI root hub, class 9/0, rev 1.00/1.00, addr 1> on usb3
uhub3: 2 ports with 2 removable, self powered
ehci0: <VIA VT6202 USB 2.0 controller> mem 0xfdfff000-0xfdfff0ff irq 21 at =
device 16.4 on pci0
ehci0: [GIANT-LOCKED]
ehci0: [ITHREAD]
usb4: EHCI version 1.0
usb4: companion controllers, 2 ports each: usb0 usb1 usb2 usb3
usb4: <VIA VT6202 USB 2.0 controller> on ehci0
usb4: USB revision 2.0
uhub4: <VIA EHCI root hub, class 9/0, rev 2.00/1.00, addr 1> on usb4
uhub4: 8 ports with 8 removable, self powered
umass0: <Initio HDT721010SLA360, class 0/0, rev 2.00/1.43, addr 2> on uhub4
umass1: <Initio WD1002FBYS-01A6B, class 0/0, rev 2.00/1.43, addr 3> on uhub=
4
umass2: <Initio WD1002FBYS-01A6B, class 0/0, rev 2.00/1.43, addr 4> on uhub=
4
umass3: <Initio HDT721010SLA360, class 0/0, rev 2.00/1.43, addr 5> on uhub4
isab0: <PCI-ISA bridge> at device 17.0 on pci0
isa0: <ISA bus> on isab0
vr0: <VIA VT6102 Rhine II 10/100BaseTX> port 0xd000-0xd0ff mem 0xfdffe000-0=
xfdffe0ff irq 23 at device 18.0 on pci0
vr0: Quirks: 0x0
vr0: Revision: 0x7c
miibus0: <MII bus> on vr0
rlphy0: <RTL8201L 10/100 media interface> PHY 1 on miibus0
rlphy0:=A0 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
vr0: Ethernet address: 00:e0:4d:2b:19:ed
vr0: [ITHREAD]
pcib4: <ACPI PCI-PCI bridge> at device 19.1 on pci0
pci4: <ACPI PCI bus> on pcib4
ohci0: <NEC uPD 9210 USB controller> mem 0xfdaff000-0xfdafffff irq 16 at de=
vice 3.0 on pci4
ohci0: [GIANT-LOCKED]
ohci0: [ITHREAD]
usb5: OHCI version 1.0
usb5: <NEC uPD 9210 USB controller> on ohci0
usb5: USB revision 1.0
uhub5: <NEC OHCI root hub, class 9/0, rev 1.00/1.00, addr 1> on usb5
uhub5: 3 ports with 3 removable, self powered
ohci1: <NEC uPD 9210 USB controller> mem 0xfdafe000-0xfdafefff irq 17 at de=
vice 3.1 on pci4
ohci1: [GIANT-LOCKED]
ohci1: [ITHREAD]
usb6: OHCI version 1.0
usb6: <NEC uPD 9210 USB controller> on ohci1
usb6: USB revision 1.0
uhub6: <NEC OHCI root hub, class 9/0, rev 1.00/1.00, addr 1> on usb6
uhub6: 2 ports with 2 removable, self powered
ehci1: <NEC uPD 720100 USB 2.0 controller> mem 0xfdafd000-0xfdafd0ff irq 18=
 at device 3.2 on pci4
ehci1: [GIANT-LOCKED]
ehci1: [ITHREAD]
usb7: EHCI version 1.0
usb7: companion controllers, 3 ports each: usb5 usb6
usb7: <NEC uPD 720100 USB 2.0 controller> on ehci1
usb7: USB revision 2.0
uhub7: <NEC EHCI root hub, class 9/0, rev 2.00/1.00, addr 1> on usb7
uhub7: 5 ports with 5 removable, self powered
umass4: <Western Digital External HDD, class 0/0, rev 2.00/1.02, addr 2> on=
 uhub7
umass5: <ADS Technologies USB2.0 Drive Kit, class 0/0, rev 2.00/0.01, addr =
3> on uhub7
umass5: Get Max Lun not supported (STALLED)
umass6: <ADS Technologies USB2.0 Drive Kit, class 0/0, rev 2.00/0.01, addr =
4> on uhub7
umass6: Get Max Lun not supported (STALLED)
sym0: <875> port 0x9c00-0x9cff mem 0xfdafc000-0xfdafc0ff,0xfdafb000-0xfdafb=
fff irq 17 at device 4.0 on pci4
sym0: No NVRAM, ID 7, Fast-20, SE, parity checking
sym0: [ITHREAD]
pcib5: <ACPI Host-PCI bridge> on acpi0
pci128: <ACPI PCI bus> on pcib5
pci128: <multimedia, HDA> at device 1.0 (no driver attached)
acpi_tz0: <Thermal Zone> on acpi0
fdc0: <floppy drive controller> port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0
fdc0: [FILTER]
sio0: configured irq 4 not in bitmap of probed irqs 0
sio0: port may not be enabled
sio0: configured irq 4 not in bitmap of probed irqs 0
sio0: port may not be enabled
sio0: <16550A-compatible COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on acp=
i0
sio0: type 16550A
sio0: [FILTER]
atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
atkbd0: [ITHREAD]
psm0: <PS/2 Mouse> irq 12 on atkbdc0
psm0: [GIANT-LOCKED]
psm0: [ITHREAD]
psm0: model IntelliMouse, device ID 3
cpu0: <ACPI CPU> on acpi0
p4tcc0: <CPU Frequency Thermal Control> on cpu0
acpi_hpet0: <High Precision Event Timer> iomem 0xfe800000-0xfe8003ff on acp=
i0
device_attach: acpi_hpet0 attach returned 12
pmtimer0 on isa0
orm0: <ISA Option ROMs> at iomem 0xc0000-0xc97ff,0xcc000-0xcdfff pnpid ORM0=
000 on isa0
ppc0: <Parallel port> at port 0x378-0x37f irq 7 on isa0
ppc0: Generic chipset (NIBBLE-only) in COMPATIBLE mode
ppbus0: <Parallel port bus> on ppc0
ppbus0: [ITHREAD]
plip0: <PLIP network interface> on ppbus0
plip0: WARNING: using obsoleted IFF_NEEDSGIANT flag
lpt0: <Printer> on ppbus0
lpt0: Interrupt-driven port
ppi0: <Parallel I/O> on ppbus0
ppc0: [GIANT-LOCKED]
ppc0: [ITHREAD]
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=3D0x300>
sio1: configured irq 3 not in bitmap of probed irqs 0
sio1: port may not be enabled
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
Timecounter "TSC" frequency 2266665820 Hz quality 800
Timecounters tick every 1.000 msec
ad0: 78533MB <Hitachi HDS722580VLAT20 V32OA63A> at ata0-master UDMA100
acd0: DMA limited to UDMA33, device found non-ATA66 cable
acd0: DVDR <LITE-ON DVDRW SOHW-1633S/BS0S> at ata1-master UDMA33
acd1: CDRW <LITE-ON LTR-48327S/PTS1> at ata1-slave UDMA33
Waiting 5 seconds for SCSI devices to settle
GEOM_LABEL: Label for provider ad0s1a is ufsid/4a42cfbde524d087.
GEOM_LABEL: Label for provider ad0s1d is ufsid/4a42cfc21242e734.
GEOM_LABEL: Label for provider ad0s1e is ufsid/4a42cfbdfcdf27b1.
GEOM_LABEL: Label for provider ad0s1f is ufsid/4a42cfbd65525a3f.
GEOM_LABEL: Label for provider ad0s1g is ufsid/4a42cfbd75a68b18.
GEOM_LABEL: Label for provider ad0s2d is ufsid/4a42cfbdcada79a0.
GEOM_LABEL: Label for provider ad0s2e is ufsid/4a42cfc28b730061.
GEOM_LABEL: Label for provider ad0s2f is ufsid/4a42cfc236be6f59.
GEOM_JOURNAL: Journal 503343105: ad0s2g contains data.
GEOM_JOURNAL: Journal 503343105: ad0s2g contains journal.
GEOM_JOURNAL: Journal ad0s2g clean.
GEOM_LABEL: Label for provider ad0s2g.journal is ufsid/4a430e552079b936.
(probe12:sym0:0:5:0): TEST UNIT READY. CDB: 0 0 0 0 0 0
(probe12:sym0:0:5:0): CAM Status: SCSI Status Error
(probe12:sym0:0:5:0): SCSI Status: Check Condition
(probe12:sym0:0:5:0): UNIT ATTENTION asc:29,2
(probe12:sym0:0:5:0): SCSI bus reset occurred
(probe12:sym0:0:5:0): Retrying Command (per Sense Data)
sa0 at sym0 bus 0 target 5 lun 0
sa0: <HP C5713A H307> Removable Sequential Access SCSI-3 device
sa0: 40.000MB/s transfers (20.000MHz, offset 16, 16bit)
ch0 at sym0 bus 0 target 5 lun 1
ch0: <HP C5713A H307> Removable Changer SCSI-3 device
ch0: 40.000MB/s transfers (20.000MHz, offset 16, 16bit)
ch0: 6 slots, 1 drive, 0 pickers, 0 portals
da0 at umass-sim0 bus 0 target 0 lun 0
da0: <Initio HDT721010SLA360 1.43> Fixed Direct Access SCSI-0 device
da0: 40.000MB/s transfers
da0: 953869MB (1953525168 512 byte sectors: 255H 63S/T 121601C)
da1 at umass-sim1 bus 1 target 0 lun 0
da1: <Initio WD1002FBYS-01A6B 1.43> Fixed Direct Access SCSI-0 device
da1: 40.000MB/s transfers
da1: 953869MB (1953525168 512 byte sectors: 255H 63S/T 121601C)
da2 at umass-sim2 bus 2 target 0 lun 0
da2: <Initio WD1002FBYS-01A6B 1.43> Fixed Direct Access SCSI-0 device
da2: 40.000MB/s transfers
da2: 953869MB (1953525168 512 byte sectors: 255H 63S/T 121601C)
da3 at umass-sim3 bus 3 target 0 lun 0
da3: <Initio HDT721010SLA360 1.43> Fixed Direct Access SCSI-0 device
da3: 40.000MB/s transfers
da3: 953869MB (1953525168 512 byte sectors: 255H 63S/T 121601C)
da4 at umass-sim4 bus 4 target 0 lun 0
da4: <WD 1600BEVExternal 1.02> Fixed Direct Access SCSI-0 device
da4: 40.000MB/s transfers
da4: 152627MB (312581808 512 byte sectors: 255H 63S/T 19457C)
da5 at umass-sim5 bus 5 target 0 lun 0
da5: <WDC WD25 00JB-00GVC0 \\0000\\0000> Fixed Direct Access SCSI-0 device
da5: 40.000MB/s transfers
da5: 238475MB (488397168 512 byte sectors: 255H 63S/T 30401C)
da6 at umass-sim6 bus 6 target 0 lun 0
da6: <WDC WD25 00JB-00GVA0 \\0000\\0000> Fixed Direct Access SCSI-0 device
da6: 40.000MB/s transfers
da6: 238475MB (488397168 512 byte sectors: 255H 63S/T 30401C)
GEOM_MIRROR: Device mirror/gm-bacula launched (2/2).
GEOM_MIRROR: Device mirror/gm-media launched (2/2).
GEOM_MIRROR: Device mirror/gm-san launched (1/2).
GEOM_MIRROR: Device gm-san: rebuilding provider da5.
GEOM_JOURNAL: Journal 3034050800: mirror/gm-bacula contains data.
GEOM_JOURNAL: Journal 3034050800: mirror/gm-bacula contains journal.
GEOM_JOURNAL: Journal mirror/gm-bacula clean.
GEOM_JOURNAL: Journal 262277634: mirror/gm-media contains data.
GEOM_JOURNAL: Journal 262277634: mirror/gm-media contains journal.
GEOM_JOURNAL: Journal mirror/gm-media clean.
GEOM_LABEL: Label for provider da4s1 is ufsid/49273a95d669d784.
GEOM_LABEL: Label for provider da4s1 is ufs/backup.
GEOM_JOURNAL: Journal 2270030291: mirror/gm-san contains data.
GEOM_JOURNAL: Journal 2270030291: mirror/gm-san contains journal.
GEOM_JOURNAL: Journal mirror/gm-san clean.
(da6:umass-sim6:6:0:0): SYNCHRONIZE CACHE(10). CDB: 35 0 0 0 0 0 0 0 0 0
(da6:umass-sim6:6:0:0): CAM Status: SCSI Status Error
(da6:umass-sim6:6:0:0): SCSI Status: Check Condition
(da6:umass-sim6:6:0:0): ILLEGAL REQUEST asc:20,0
(da6:umass-sim6:6:0:0): Invalid command operation code
(da6:umass-sim6:6:0:0): Unretryable error
GEOM_MIRROR: Request failed (error=3D5). da6[READ(offset=3D0, length=3D512)=
]
GEOM_JOURNAL: BIO_FLUSH not supported by mirror/gm-san.
GEOM_LABEL: Label for provider mirror/gm-bacula.journal is ufsid/4a509cddbd=
500a7e.
GEOM_LABEL: Label for provider mirror/gm-media.journal is ufsid/4a3f26878cf=
7f367.
GEOM_LABEL: Label for provider mirror/gm-san.journal is ufsid/4a40c57f604c2=
e44.
Trying to mount root from ufs:/dev/ad0s1a
GEOM_LABEL: Label ufsid/4a42cfbde524d087 removed.
GEOM_LABEL: Label for provider ad0s1a is ufsid/4a42cfbde524d087.
GEOM_LABEL: Label ufsid/49273a95d669d784 removed.
GEOM_LABEL: Label ufsid/4a42cfbdfcdf27b1 removed.
GEOM_LABEL: Label for provider da4s1c is ufsid/49273a95d669d784.
GEOM_LABEL: Label for provider ad0s1e is ufsid/4a42cfbdfcdf27b1.
GEOM_LABEL: Label ufsid/4a42cfbd65525a3f removed.
GEOM_LABEL: Label for provider ad0s1f is ufsid/4a42cfbd65525a3f.
GEOM_LABEL: Label ufsid/4a42cfbd75a68b18 removed.
GEOM_LABEL: Label for provider ad0s1g is ufsid/4a42cfbd75a68b18.
GEOM_LABEL: Label ufsid/4a42cfbdcada79a0 removed.
GEOM_LABEL: Label for provider ad0s2d is ufsid/4a42cfbdcada79a0.
GEOM_LABEL: Label ufsid/4a42cfc28b730061 removed.
GEOM_LABEL: Label for provider ad0s2e is ufsid/4a42cfc28b730061.
GEOM_LABEL: Label ufsid/4a42cfc21242e734 removed.
GEOM_LABEL: Label for provider ad0s1d is ufsid/4a42cfc21242e734.
GEOM_LABEL: Label ufsid/4a42cfc236be6f59 removed.
GEOM_LABEL: Label for provider ad0s2f is ufsid/4a42cfc236be6f59.
GEOM_LABEL: Label ufsid/4a42cfbde524d087 removed.
GEOM_LABEL: Label ufsid/4a42cfbdfcdf27b1 removed.
GEOM_LABEL: Label ufsid/4a42cfbd65525a3f removed.
GEOM_LABEL: Label ufsid/4a42cfbd75a68b18 removed.
GEOM_LABEL: Label ufsid/4a42cfbdcada79a0 removed.
GEOM_LABEL: Label ufsid/4a430e552079b936 removed.
GEOM_LABEL: Label ufsid/4a42cfc28b730061 removed.
GEOM_LABEL: Label ufsid/4a42cfc21242e734 removed.
GEOM_LABEL: Label ufsid/4a42cfc236be6f59 removed.
GEOM_LABEL: Label ufsid/4a3f26878cf7f367 removed.
GEOM_LABEL: Label ufsid/4a40c57f604c2e44 removed.
GEOM_LABEL: Label ufsid/49273a95d669d784 removed.
fuse4bsd: version 0.3.9-pre1, FUSE ABI 7.8
GEOM_LABEL: Label ufsid/4a509cddbd500a7e removed.


--- On Fri, 8/14/09, Jeff Richards <bsd24x7@yahoo.com> wrote:

From: Jeff Richards <bsd24x7@yahoo.com>
Subject: Multiple USB drives stability question
To: freebsd-stable@freebsd.org
Date: Friday, August 14, 2009, 8:19 PM

Is there a practical limit on the number of active USB drives with FreeBSD?=
=A0 I've had stability issues using multiple USB drives as storage.

My initial design goal was cheap, hot-swappable storage.=A0 I am only using=
 a 100MB network currently so throughput on the storage is not a problem as=
 I can't push the data to/from the drives faster than what my network reque=
sts are.=A0=20

I first tried my setup on 7.0, then migrated to a newer PC, then upgraded t=
o 7.2.=20
=A0
I have the following USB drive setup:

1 320GB gmirror (320x2) + gjournal + ufs2
1 1TB gmirror (1TBx2) + gjournal + ufs2
1 150GB gjournal=A0 + ufs2

I also have another 1TB gmirror (1TBx2) + gjournal but removed it.=A0 The s=
ystem crashed when I used these drives (bacula or bonnie++) so I pulled the=
m to test on another system.

Recently my stability issue has been when I have been writing data to the 1=
50GB gjournal drive from the 320GB gmirror device (USB device -> USB device=
).=A0 It will be working fine, then all I/O stops on the 150GB drive.=A0 Th=
e system remains responding to other USB devices etc. for a while.=A0 I try=
 rebooting and the system crashes with gjournal errors (didn't write down, =
but I will later).=A0=20

Every time this happens the 1TB gmirror comes up fine but one of the 320GB =
providers is missing.=A0 No problem after 'gmirror forget' and 'gmirror ins=
ert'.=A0 Everything rebuilds fine.=A0 The 150GB gjournal drive is fine afte=
r a 'fsck -y'.

I do pair the gmirror drives to the same USB adapter.=A0 Found out after in=
itial testing with multiple USB adapters that they do not appear standard e=
nough to cross adapters like I would for a production server at work to pre=
vent SPOF with an adapter.

I have tried Linux as well with softraid and LVM2 on the same hardware.=A0 =
It worked fine until I applied software updates and the udev took 30+ minut=
es to boot.=A0 I went back to FreeBSD.=A0 Even when I crashed I was back up=
 in 2-5 minutes.

I can and will provide more detail if requested.=A0 My concern is that the =
issue seems to continue no matter what hardware/OS changes I try.

Thanks in advance.





_______________________________________________
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org"
=0A=0A=0A      



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?558655.92355.qm>