From owner-freebsd-stable@FreeBSD.ORG Sat Aug 15 03:04:23 2009 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 6F04C106568B for ; Sat, 15 Aug 2009 03:04:23 +0000 (UTC) (envelope-from bsd24x7@yahoo.com) Received: from n9.bullet.re3.yahoo.com (n9.bullet.re3.yahoo.com [68.142.237.94]) by mx1.freebsd.org (Postfix) with SMTP id 0304D8FC52 for ; Sat, 15 Aug 2009 03:04:22 +0000 (UTC) Received: from [68.142.230.28] by n9.bullet.re3.yahoo.com with NNFMP; 15 Aug 2009 03:04:22 -0000 Received: from [67.195.9.83] by t1.bullet.re2.yahoo.com with NNFMP; 15 Aug 2009 03:18:32 -0000 Received: from [67.195.9.105] by t3.bullet.mail.gq1.yahoo.com with NNFMP; 15 Aug 2009 03:04:21 -0000 Received: from [127.0.0.1] by omp109.mail.gq1.yahoo.com with NNFMP; 15 Aug 2009 03:04:21 -0000 X-Yahoo-Newman-Property: ymail-3 X-Yahoo-Newman-Id: 717572.34300.bm@omp109.mail.gq1.yahoo.com Received: (qmail 93891 invoked by uid 60001); 15 Aug 2009 03:04:21 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1250305461; bh=MMRuHxiaKkiaye0a52g/hnbLBJv9rjQuvjOyzubuPTE=; h=Message-ID:X-YMail-OSG:Received:X-Mailer:Date:From:Subject:To:In-Reply-To:MIME-Version:Content-Type; b=nhbi5L5yfaIQ3oRaXGiDCsA6cN8BEgsH+id2SIWJLZT9x2LarEBaSNCO+mUKLD1tP2IaU+uv1rXvJL1InFWbjvCWHNHfIemuDReEh6ZOLN7ze/l5QqIms0iQgdiG0V5g3r1A3tCnu4+lwtbivtNq4BNohY6OQbYTWOv97kEwbkc= DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=Message-ID:X-YMail-OSG:Received:X-Mailer:Date:From:Subject:To:In-Reply-To:MIME-Version:Content-Type; b=J0ErT9WeDmZOTDuEzsazb8AWOk0Y/NmHlOykI8Om85RPxqaspKXqn0uzgEcWwE+Wf0UtMsaCQiAP80q1kHZtr0MTZcvYlT2ltCPsqVJt8bFfsTgU/GKCT1RMm4gFix87a/PG1DnLbzsuM1TOWKZWlVGIpFLs+y91LU/dvRrrakE=; Message-ID: <558655.92355.qm@web110104.mail.gq1.yahoo.com> X-YMail-OSG: cVj6MhIVM1n_zizoq3cPvc9v9Ajdpi7a1Vgl2Q9Vf_m6s9lKQDj8PAdpli2IC_.Vkt.z6BJ4iRVMAE2FOMcUBRsJOz5Oz5DgO1RibQjDBF_aNWs06HwhjUGeg.o2nNFtAGm6kX1OVxNDfQd.4ZyFfpAHUHQWOsqxYP5EB4hjmOBUFqpcbyCzdG2oUct6dbbMnjPcMSDB_BOMwRatvJcsZDlwlojclce_Qh7I2qQIFiQeBRgUxSHw17VnSt25PgTdptTIykJk5vdT6D9xurEDll8TpXtd.ZOcRwpyxYbuDwLmpir0zxxlF85KX0rz3dQk939oeS6ppAjJO3vL1v5nOnx13Q-- Received: from [75.90.1.160] by web110104.mail.gq1.yahoo.com via HTTP; Fri, 14 Aug 2009 20:04:21 PDT X-Mailer: YahooMailClassic/6.1.2 YahooMailWebService/0.7.338.1 Date: Fri, 14 Aug 2009 20:04:21 -0700 (PDT) From: Jeff Richards To: freebsd-stable@freebsd.org In-Reply-To: <449180.49075.qm@web110112.mail.gq1.yahoo.com> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Subject: Re: Multiple USB drives stability question X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 15 Aug 2009 03:04:23 -0000 I just tested my 2nd 1TB gmirror device on another system with FBSD 7.2.=A0= I was getting full throughput on the drive and no lockup using bonnie++ an= d also monitoring with gstat. I then moved those drives back on my main server.=A0 When I booted the syst= em I hung on the 320GB gmirror devices.=A0 Previously the 1st 1TB gmirror a= nd 320GB gmirror were attached to the integrated USB ports on the motherboa= rd.=A0 I moved the 320GB gmirror to a PCI USB adapter. The 2 320GB drives in the gmirror were da5 and da6.=A0 Here's what I saw on= the console: (da6:umass-sim6:6:0:0): SYNCHRONIZE CACHE(10). CDB: 35 0 0 0 0 0 0 0 0 0 (da6:umass-sim6:6:0:0): CAM Status: SCSI Status Error (da6:umass-sim6:6:0:0): SCSI Status: Check Condition (da6:umass-sim6:6:0:0): ILLEGAL REQUEST asc:20,0 (da6:umass-sim6:6:0:0): Invalid command operation mode (da6:umass-sim6:6:0:0): Unretryable error GEOM_MIRROR: Request failed (error=3D5), da6[READ(offset=3D512, length=3D51= 2)] GEOM_MIRROR: Device gm-san: provider da6 disconnected. (da5:umass-sim5:5:0:0): SYNCHRONIZE CACHE(10). CDB: 35 0 0 0 0 0 0 0 0 0 (da5:umass-sim5:5:0:0): CAM Status: SCSI Status Error (da5:umass-sim5:5:0:0): SCSI Status: Check Condition (da5:umass-sim5:5:0:0): ILLEGAL REQUEST asc:20,0 (da5:umass-sim5:5:0:0): Invalid command operation mode (da5:umass-sim5:5:0:0): Unretryable error GEOM_JOURNAL: BIO_FLUSH not supported by mirror/gm-san. I waited for a few minutes with no change in the console.=A0 I then detache= d one of the USB drives (which happened to be da6) and saw this: umass6: at uhub7 port 4 (addr 4) disconnected (da6:umass-sim6:6:0:0): lost device Nothing else changed for a few minutes so I powered off the system.=A0 When= I brought it back up the 320GB gmirror device was out of sync, but apart f= rom that all devices were online. Below are the kernel messages from the second boot: Copyright (c) 1992-2009 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 =A0=A0=A0=A0=A0=A0=A0 The Regents of the University of California. All righ= ts reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 7.2-RELEASE #0: Fri May=A0 1 08:49:13 UTC 2009 =A0=A0=A0 root@walker.cse.buffalo.edu:/usr/obj/usr/src/sys/GENERIC Timecounter "i8254" frequency 1193182 Hz quality 0 CPU: Intel(R) Celeron(R) CPU 2.26GHz (2266.67-MHz 686-class CPU) =A0 Origin =3D "GenuineIntel"=A0 Id =3D 0xf49=A0 Stepping =3D 9 =A0 Features=3D0xbfebfbff =A0 Features2=3D0x441d =A0 AMD Features2=3D0x1 real memory=A0 =3D 1877868544 (1790 MB) avail memory =3D 1826934784 (1742 MB) ACPI APIC Table: ioapic0 irqs 0-23 on motherboard ioapic1 irqs 24-47 on motherboard kbd1 at kbdmux0 acpi0: on motherboard acpi0: [ITHREAD] acpi0: Power Button (fixed) acpi0: reservation of 0, a0000 (3) failed acpi0: reservation of 100000, 6fde0000 (3) failed Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 acpi_hpet0: iomem 0xfe800000-0xfe8003ff on acp= i0 device_attach: acpi_hpet0 attach returned 12 acpi_button0: on acpi0 acpi_button1: on acpi0 pcib0: port 0xcf8-0xcff on acpi0 pci0: on pcib0 pcib1: at device 1.0 on pci0 pci1: on pcib1 vgapci0: mem 0xc0000000-0xcfffffff,0xfb000000-0xfb= ffffff irq 16 at device 0.0 on pci1 pcib2: irq 27 at device 2.0 on pci0 pci2: on pcib2 pcib3: irq 31 at device 3.0 on pci0 pci3: on pcib3 atapci0: port 0xfc00-0xfc07,0xf800-0xf803,0x= f400-0xf407,0xf000-0xf003,0xec00-0xec0f,0xe800-0xe8ff irq 21 at device 15.0= on pci0 atapci0: [ITHREAD] ata2: on atapci0 ata2: [ITHREAD] ata3: on atapci0 ata3: [ITHREAD] atapci1: port 0x1f0-0x1f7,0x3f6,0x170-0x177,= 0x376,0xe400-0xe40f at device 15.1 on pci0 ata0: on atapci1 ata0: [ITHREAD] ata1: on atapci1 ata1: [ITHREAD] uhci0: port 0xe000-0xe01f irq 20 at device 16.0= on pci0 uhci0: [GIANT-LOCKED] uhci0: [ITHREAD] usb0: on uhci0 usb0: USB revision 1.0 uhub0: on usb0 uhub0: 2 ports with 2 removable, self powered uhci1: port 0xdc00-0xdc1f irq 22 at device 16.1= on pci0 uhci1: [GIANT-LOCKED] uhci1: [ITHREAD] usb1: on uhci1 usb1: USB revision 1.0 uhub1: on usb1 uhub1: 2 ports with 2 removable, self powered uhci2: port 0xd800-0xd81f irq 21 at device 16.2= on pci0 uhci2: [GIANT-LOCKED] uhci2: [ITHREAD] usb2: on uhci2 usb2: USB revision 1.0 uhub2: on usb2 uhub2: 2 ports with 2 removable, self powered uhci3: port 0xd400-0xd41f irq 23 at device 16.3= on pci0 uhci3: [GIANT-LOCKED] uhci3: [ITHREAD] usb3: on uhci3 usb3: USB revision 1.0 uhub3: on usb3 uhub3: 2 ports with 2 removable, self powered ehci0: mem 0xfdfff000-0xfdfff0ff irq 21 at = device 16.4 on pci0 ehci0: [GIANT-LOCKED] ehci0: [ITHREAD] usb4: EHCI version 1.0 usb4: companion controllers, 2 ports each: usb0 usb1 usb2 usb3 usb4: on ehci0 usb4: USB revision 2.0 uhub4: on usb4 uhub4: 8 ports with 8 removable, self powered umass0: on uhub4 umass1: on uhub= 4 umass2: on uhub= 4 umass3: on uhub4 isab0: at device 17.0 on pci0 isa0: on isab0 vr0: port 0xd000-0xd0ff mem 0xfdffe000-0= xfdffe0ff irq 23 at device 18.0 on pci0 vr0: Quirks: 0x0 vr0: Revision: 0x7c miibus0: on vr0 rlphy0: PHY 1 on miibus0 rlphy0:=A0 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto vr0: Ethernet address: 00:e0:4d:2b:19:ed vr0: [ITHREAD] pcib4: at device 19.1 on pci0 pci4: on pcib4 ohci0: mem 0xfdaff000-0xfdafffff irq 16 at de= vice 3.0 on pci4 ohci0: [GIANT-LOCKED] ohci0: [ITHREAD] usb5: OHCI version 1.0 usb5: on ohci0 usb5: USB revision 1.0 uhub5: on usb5 uhub5: 3 ports with 3 removable, self powered ohci1: mem 0xfdafe000-0xfdafefff irq 17 at de= vice 3.1 on pci4 ohci1: [GIANT-LOCKED] ohci1: [ITHREAD] usb6: OHCI version 1.0 usb6: on ohci1 usb6: USB revision 1.0 uhub6: on usb6 uhub6: 2 ports with 2 removable, self powered ehci1: mem 0xfdafd000-0xfdafd0ff irq 18= at device 3.2 on pci4 ehci1: [GIANT-LOCKED] ehci1: [ITHREAD] usb7: EHCI version 1.0 usb7: companion controllers, 3 ports each: usb5 usb6 usb7: on ehci1 usb7: USB revision 2.0 uhub7: on usb7 uhub7: 5 ports with 5 removable, self powered umass4: on= uhub7 umass5: on uhub7 umass5: Get Max Lun not supported (STALLED) umass6: on uhub7 umass6: Get Max Lun not supported (STALLED) sym0: <875> port 0x9c00-0x9cff mem 0xfdafc000-0xfdafc0ff,0xfdafb000-0xfdafb= fff irq 17 at device 4.0 on pci4 sym0: No NVRAM, ID 7, Fast-20, SE, parity checking sym0: [ITHREAD] pcib5: on acpi0 pci128: on pcib5 pci128: at device 1.0 (no driver attached) acpi_tz0: on acpi0 fdc0: port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0 fdc0: [FILTER] sio0: configured irq 4 not in bitmap of probed irqs 0 sio0: port may not be enabled sio0: configured irq 4 not in bitmap of probed irqs 0 sio0: port may not be enabled sio0: <16550A-compatible COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on acp= i0 sio0: type 16550A sio0: [FILTER] atkbdc0: port 0x60,0x64 irq 1 on acpi0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] atkbd0: [ITHREAD] psm0: irq 12 on atkbdc0 psm0: [GIANT-LOCKED] psm0: [ITHREAD] psm0: model IntelliMouse, device ID 3 cpu0: on acpi0 p4tcc0: on cpu0 acpi_hpet0: iomem 0xfe800000-0xfe8003ff on acp= i0 device_attach: acpi_hpet0 attach returned 12 pmtimer0 on isa0 orm0: at iomem 0xc0000-0xc97ff,0xcc000-0xcdfff pnpid ORM0= 000 on isa0 ppc0: at port 0x378-0x37f irq 7 on isa0 ppc0: Generic chipset (NIBBLE-only) in COMPATIBLE mode ppbus0: on ppc0 ppbus0: [ITHREAD] plip0: on ppbus0 plip0: WARNING: using obsoleted IFF_NEEDSGIANT flag lpt0: on ppbus0 lpt0: Interrupt-driven port ppi0: on ppbus0 ppc0: [GIANT-LOCKED] ppc0: [ITHREAD] sc0: at flags 0x100 on isa0 sc0: VGA <16 virtual consoles, flags=3D0x300> sio1: configured irq 3 not in bitmap of probed irqs 0 sio1: port may not be enabled vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 Timecounter "TSC" frequency 2266665820 Hz quality 800 Timecounters tick every 1.000 msec ad0: 78533MB at ata0-master UDMA100 acd0: DMA limited to UDMA33, device found non-ATA66 cable acd0: DVDR at ata1-master UDMA33 acd1: CDRW at ata1-slave UDMA33 Waiting 5 seconds for SCSI devices to settle GEOM_LABEL: Label for provider ad0s1a is ufsid/4a42cfbde524d087. GEOM_LABEL: Label for provider ad0s1d is ufsid/4a42cfc21242e734. GEOM_LABEL: Label for provider ad0s1e is ufsid/4a42cfbdfcdf27b1. GEOM_LABEL: Label for provider ad0s1f is ufsid/4a42cfbd65525a3f. GEOM_LABEL: Label for provider ad0s1g is ufsid/4a42cfbd75a68b18. GEOM_LABEL: Label for provider ad0s2d is ufsid/4a42cfbdcada79a0. GEOM_LABEL: Label for provider ad0s2e is ufsid/4a42cfc28b730061. GEOM_LABEL: Label for provider ad0s2f is ufsid/4a42cfc236be6f59. GEOM_JOURNAL: Journal 503343105: ad0s2g contains data. GEOM_JOURNAL: Journal 503343105: ad0s2g contains journal. GEOM_JOURNAL: Journal ad0s2g clean. GEOM_LABEL: Label for provider ad0s2g.journal is ufsid/4a430e552079b936. (probe12:sym0:0:5:0): TEST UNIT READY. CDB: 0 0 0 0 0 0 (probe12:sym0:0:5:0): CAM Status: SCSI Status Error (probe12:sym0:0:5:0): SCSI Status: Check Condition (probe12:sym0:0:5:0): UNIT ATTENTION asc:29,2 (probe12:sym0:0:5:0): SCSI bus reset occurred (probe12:sym0:0:5:0): Retrying Command (per Sense Data) sa0 at sym0 bus 0 target 5 lun 0 sa0: Removable Sequential Access SCSI-3 device sa0: 40.000MB/s transfers (20.000MHz, offset 16, 16bit) ch0 at sym0 bus 0 target 5 lun 1 ch0: Removable Changer SCSI-3 device ch0: 40.000MB/s transfers (20.000MHz, offset 16, 16bit) ch0: 6 slots, 1 drive, 0 pickers, 0 portals da0 at umass-sim0 bus 0 target 0 lun 0 da0: Fixed Direct Access SCSI-0 device da0: 40.000MB/s transfers da0: 953869MB (1953525168 512 byte sectors: 255H 63S/T 121601C) da1 at umass-sim1 bus 1 target 0 lun 0 da1: Fixed Direct Access SCSI-0 device da1: 40.000MB/s transfers da1: 953869MB (1953525168 512 byte sectors: 255H 63S/T 121601C) da2 at umass-sim2 bus 2 target 0 lun 0 da2: Fixed Direct Access SCSI-0 device da2: 40.000MB/s transfers da2: 953869MB (1953525168 512 byte sectors: 255H 63S/T 121601C) da3 at umass-sim3 bus 3 target 0 lun 0 da3: Fixed Direct Access SCSI-0 device da3: 40.000MB/s transfers da3: 953869MB (1953525168 512 byte sectors: 255H 63S/T 121601C) da4 at umass-sim4 bus 4 target 0 lun 0 da4: Fixed Direct Access SCSI-0 device da4: 40.000MB/s transfers da4: 152627MB (312581808 512 byte sectors: 255H 63S/T 19457C) da5 at umass-sim5 bus 5 target 0 lun 0 da5: Fixed Direct Access SCSI-0 device da5: 40.000MB/s transfers da5: 238475MB (488397168 512 byte sectors: 255H 63S/T 30401C) da6 at umass-sim6 bus 6 target 0 lun 0 da6: Fixed Direct Access SCSI-0 device da6: 40.000MB/s transfers da6: 238475MB (488397168 512 byte sectors: 255H 63S/T 30401C) GEOM_MIRROR: Device mirror/gm-bacula launched (2/2). GEOM_MIRROR: Device mirror/gm-media launched (2/2). GEOM_MIRROR: Device mirror/gm-san launched (1/2). GEOM_MIRROR: Device gm-san: rebuilding provider da5. GEOM_JOURNAL: Journal 3034050800: mirror/gm-bacula contains data. GEOM_JOURNAL: Journal 3034050800: mirror/gm-bacula contains journal. GEOM_JOURNAL: Journal mirror/gm-bacula clean. GEOM_JOURNAL: Journal 262277634: mirror/gm-media contains data. GEOM_JOURNAL: Journal 262277634: mirror/gm-media contains journal. GEOM_JOURNAL: Journal mirror/gm-media clean. GEOM_LABEL: Label for provider da4s1 is ufsid/49273a95d669d784. GEOM_LABEL: Label for provider da4s1 is ufs/backup. GEOM_JOURNAL: Journal 2270030291: mirror/gm-san contains data. GEOM_JOURNAL: Journal 2270030291: mirror/gm-san contains journal. GEOM_JOURNAL: Journal mirror/gm-san clean. (da6:umass-sim6:6:0:0): SYNCHRONIZE CACHE(10). CDB: 35 0 0 0 0 0 0 0 0 0 (da6:umass-sim6:6:0:0): CAM Status: SCSI Status Error (da6:umass-sim6:6:0:0): SCSI Status: Check Condition (da6:umass-sim6:6:0:0): ILLEGAL REQUEST asc:20,0 (da6:umass-sim6:6:0:0): Invalid command operation code (da6:umass-sim6:6:0:0): Unretryable error GEOM_MIRROR: Request failed (error=3D5). da6[READ(offset=3D0, length=3D512)= ] GEOM_JOURNAL: BIO_FLUSH not supported by mirror/gm-san. GEOM_LABEL: Label for provider mirror/gm-bacula.journal is ufsid/4a509cddbd= 500a7e. GEOM_LABEL: Label for provider mirror/gm-media.journal is ufsid/4a3f26878cf= 7f367. GEOM_LABEL: Label for provider mirror/gm-san.journal is ufsid/4a40c57f604c2= e44. Trying to mount root from ufs:/dev/ad0s1a GEOM_LABEL: Label ufsid/4a42cfbde524d087 removed. GEOM_LABEL: Label for provider ad0s1a is ufsid/4a42cfbde524d087. GEOM_LABEL: Label ufsid/49273a95d669d784 removed. GEOM_LABEL: Label ufsid/4a42cfbdfcdf27b1 removed. GEOM_LABEL: Label for provider da4s1c is ufsid/49273a95d669d784. GEOM_LABEL: Label for provider ad0s1e is ufsid/4a42cfbdfcdf27b1. GEOM_LABEL: Label ufsid/4a42cfbd65525a3f removed. GEOM_LABEL: Label for provider ad0s1f is ufsid/4a42cfbd65525a3f. GEOM_LABEL: Label ufsid/4a42cfbd75a68b18 removed. GEOM_LABEL: Label for provider ad0s1g is ufsid/4a42cfbd75a68b18. GEOM_LABEL: Label ufsid/4a42cfbdcada79a0 removed. GEOM_LABEL: Label for provider ad0s2d is ufsid/4a42cfbdcada79a0. GEOM_LABEL: Label ufsid/4a42cfc28b730061 removed. GEOM_LABEL: Label for provider ad0s2e is ufsid/4a42cfc28b730061. GEOM_LABEL: Label ufsid/4a42cfc21242e734 removed. GEOM_LABEL: Label for provider ad0s1d is ufsid/4a42cfc21242e734. GEOM_LABEL: Label ufsid/4a42cfc236be6f59 removed. GEOM_LABEL: Label for provider ad0s2f is ufsid/4a42cfc236be6f59. GEOM_LABEL: Label ufsid/4a42cfbde524d087 removed. GEOM_LABEL: Label ufsid/4a42cfbdfcdf27b1 removed. GEOM_LABEL: Label ufsid/4a42cfbd65525a3f removed. GEOM_LABEL: Label ufsid/4a42cfbd75a68b18 removed. GEOM_LABEL: Label ufsid/4a42cfbdcada79a0 removed. GEOM_LABEL: Label ufsid/4a430e552079b936 removed. GEOM_LABEL: Label ufsid/4a42cfc28b730061 removed. GEOM_LABEL: Label ufsid/4a42cfc21242e734 removed. GEOM_LABEL: Label ufsid/4a42cfc236be6f59 removed. GEOM_LABEL: Label ufsid/4a3f26878cf7f367 removed. GEOM_LABEL: Label ufsid/4a40c57f604c2e44 removed. GEOM_LABEL: Label ufsid/49273a95d669d784 removed. fuse4bsd: version 0.3.9-pre1, FUSE ABI 7.8 GEOM_LABEL: Label ufsid/4a509cddbd500a7e removed. --- On Fri, 8/14/09, Jeff Richards wrote: From: Jeff Richards Subject: Multiple USB drives stability question To: freebsd-stable@freebsd.org Date: Friday, August 14, 2009, 8:19 PM Is there a practical limit on the number of active USB drives with FreeBSD?= =A0 I've had stability issues using multiple USB drives as storage. My initial design goal was cheap, hot-swappable storage.=A0 I am only using= a 100MB network currently so throughput on the storage is not a problem as= I can't push the data to/from the drives faster than what my network reque= sts are.=A0=20 I first tried my setup on 7.0, then migrated to a newer PC, then upgraded t= o 7.2.=20 =A0 I have the following USB drive setup: 1 320GB gmirror (320x2) + gjournal + ufs2 1 1TB gmirror (1TBx2) + gjournal + ufs2 1 150GB gjournal=A0 + ufs2 I also have another 1TB gmirror (1TBx2) + gjournal but removed it.=A0 The s= ystem crashed when I used these drives (bacula or bonnie++) so I pulled the= m to test on another system. Recently my stability issue has been when I have been writing data to the 1= 50GB gjournal drive from the 320GB gmirror device (USB device -> USB device= ).=A0 It will be working fine, then all I/O stops on the 150GB drive.=A0 Th= e system remains responding to other USB devices etc. for a while.=A0 I try= rebooting and the system crashes with gjournal errors (didn't write down, = but I will later).=A0=20 Every time this happens the 1TB gmirror comes up fine but one of the 320GB = providers is missing.=A0 No problem after 'gmirror forget' and 'gmirror ins= ert'.=A0 Everything rebuilds fine.=A0 The 150GB gjournal drive is fine afte= r a 'fsck -y'. I do pair the gmirror drives to the same USB adapter.=A0 Found out after in= itial testing with multiple USB adapters that they do not appear standard e= nough to cross adapters like I would for a production server at work to pre= vent SPOF with an adapter. I have tried Linux as well with softraid and LVM2 on the same hardware.=A0 = It worked fine until I applied software updates and the udev took 30+ minut= es to boot.=A0 I went back to FreeBSD.=A0 Even when I crashed I was back up= in 2-5 minutes. I can and will provide more detail if requested.=A0 My concern is that the = issue seems to continue no matter what hardware/OS changes I try. Thanks in advance. _______________________________________________ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" =0A=0A=0A