From owner-freebsd-stable@FreeBSD.ORG Sat Aug 15 00:33:20 2009 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 002D610656A4 for ; Sat, 15 Aug 2009 00:33:19 +0000 (UTC) (envelope-from bsd24x7@yahoo.com) Received: from n9.bullet.re3.yahoo.com (n9.bullet.re3.yahoo.com [68.142.237.94]) by mx1.freebsd.org (Postfix) with SMTP id AC51E8FC77 for ; Sat, 15 Aug 2009 00:33:19 +0000 (UTC) Received: from [68.142.230.28] by n9.bullet.re3.yahoo.com with NNFMP; 15 Aug 2009 00:19:49 -0000 Received: from [67.195.9.83] by t1.bullet.re2.yahoo.com with NNFMP; 15 Aug 2009 00:33:59 -0000 Received: from [67.195.9.110] by t3.bullet.mail.gq1.yahoo.com with NNFMP; 15 Aug 2009 00:19:48 -0000 Received: from [127.0.0.1] by omp114.mail.gq1.yahoo.com with NNFMP; 15 Aug 2009 00:19:48 -0000 X-Yahoo-Newman-Property: ymail-3 X-Yahoo-Newman-Id: 687870.52501.bm@omp114.mail.gq1.yahoo.com Received: (qmail 57955 invoked by uid 60001); 15 Aug 2009 00:19:48 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1250295588; bh=lFISiojipzJUhAlrloZkolkA0SY7ZvMZioJuVppg3eE=; h=Message-ID:X-YMail-OSG:Received:X-Mailer:Date:From:Subject:To:MIME-Version:Content-Type; b=pgICU7f3yRp7VlgqgPtSGFEfSfdJA9LCumkcT479eqK++fOB7kfTyBLtlI2Kduc374QEXJO90HCO1ALIuu43RwMOQEbKcQsfEhQPKw/bv/mK4dak9lR+nWzH+szu2DmiVMmsExSedDhAkBFQ0o7yGt7VcFYtCk60snwtpU0TST8= DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=Message-ID:X-YMail-OSG:Received:X-Mailer:Date:From:Subject:To:MIME-Version:Content-Type; b=ZgIZBNwJw92mYkxwjLSmkywydKV6xHSiwnCRdw9d/aQsAN3d1kheXstw8pj11CZpeQzEwjm3QM1/Qw44pF2X8tv7gjA5SWKzCR36iBr7SIkk3RwAbIelp9YdV3WGTAJJ/bZCQp/+8nbGlJXGK+iNC9Op3K7XZHe+EPdi0M1rHxM=; Message-ID: <449180.49075.qm@web110112.mail.gq1.yahoo.com> X-YMail-OSG: oXs2IkcVM1l8v.ss3L7RtXhn_FOZF4VmHfnLswUHujEJhPcYLEEDaTgKMLfu91o7Viz57OP6xPar5dJD7k31GDZtmpi3xleKwQHMVZ_oSdiZ81_iJ4IaZiJ.JfWOa8d1fvbDucCuWSHcP0M06VemCssZEoXPUFEmszFTEePSxaKputSN1obIv_RRfcW9JXfhJ2aU5I1in4YeUyAB0Zyy34jHJbDKHHHGNrECADx02JXz1NvBTwog1g1qGvKoCIB3iMhb0r61H1v1Iw-- Received: from [75.90.1.160] by web110112.mail.gq1.yahoo.com via HTTP; Fri, 14 Aug 2009 17:19:48 PDT X-Mailer: YahooMailClassic/6.1.2 YahooMailWebService/0.7.338.1 Date: Fri, 14 Aug 2009 17:19:48 -0700 (PDT) From: Jeff Richards To: freebsd-stable@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Subject: Multiple USB drives stability question X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 15 Aug 2009 00:33:20 -0000 Is there a practical limit on the number of active USB drives with FreeBSD?= =A0 I've had stability issues using multiple USB drives as storage. My initial design goal was cheap, hot-swappable storage.=A0 I am only using= a 100MB network currently so throughput on the storage is not a problem as= I can't push the data to/from the drives faster than what my network reque= sts are.=A0=20 I first tried my setup on 7.0, then migrated to a newer PC, then upgraded t= o 7.2.=20 =A0 I have the following USB drive setup: 1 320GB gmirror (320x2) + gjournal + ufs2 1 1TB gmirror (1TBx2) + gjournal + ufs2 1 150GB gjournal=A0 + ufs2 I also have another 1TB gmirror (1TBx2) + gjournal but removed it.=A0 The s= ystem crashed when I used these drives (bacula or bonnie++) so I pulled the= m to test on another system. Recently my stability issue has been when I have been writing data to the 1= 50GB gjournal drive from the 320GB gmirror device (USB device -> USB device= ).=A0 It will be working fine, then all I/O stops on the 150GB drive.=A0 Th= e system remains responding to other USB devices etc. for a while.=A0 I try= rebooting and the system crashes with gjournal errors (didn't write down, = but I will later).=A0=20 Every time this happens the 1TB gmirror comes up fine but one of the 320GB = providers is missing.=A0 No problem after 'gmirror forget' and 'gmirror ins= ert'.=A0 Everything rebuilds fine.=A0 The 150GB gjournal drive is fine afte= r a 'fsck -y'. I do pair the gmirror drives to the same USB adapter.=A0 Found out after in= itial testing with multiple USB adapters that they do not appear standard e= nough to cross adapters like I would for a production server at work to pre= vent SPOF with an adapter. I have tried Linux as well with softraid and LVM2 on the same hardware.=A0 = It worked fine until I applied software updates and the udev took 30+ minut= es to boot.=A0 I went back to FreeBSD.=A0 Even when I crashed I was back up= in 2-5 minutes. I can and will provide more detail if requested.=A0 My concern is that the = issue seems to continue no matter what hardware/OS changes I try. Thanks in advance. =0A=0A=0A