From owner-freebsd-current@FreeBSD.ORG Wed Sep 7 09:37:04 2011 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 20049106564A for ; Wed, 7 Sep 2011 09:37:04 +0000 (UTC) (envelope-from matt.thyer@gmail.com) Received: from mail-ww0-f42.google.com (mail-ww0-f42.google.com [74.125.82.42]) by mx1.freebsd.org (Postfix) with ESMTP id A04D58FC15 for ; Wed, 7 Sep 2011 09:37:03 +0000 (UTC) Received: by wwe5 with SMTP id 5so1774329wwe.1 for ; Wed, 07 Sep 2011 02:37:02 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=vvSgP7Sof8teC0UzmE38+TWUXZGKDMPKH+UAE2zG76Q=; b=bkCIbJSxzmtlvsveZL6XFvjIyDrHM/c+uaP5Q74ouvIkMqjiy+b0AtKommwK+uDkPX z9U275UnUW3VuWobiEF1FeSgCdxL6NmGFKIoarbAeOPIjiX13BwaBNICrlM7OUXKF4wq sw6K5dbuQ0IivJPc+5kBLTMhLzUb4juWlUuu8= MIME-Version: 1.0 Received: by 10.216.137.232 with SMTP id y82mr4592184wei.104.1315388222341; Wed, 07 Sep 2011 02:37:02 -0700 (PDT) Received: by 10.216.11.9 with HTTP; Wed, 7 Sep 2011 02:37:02 -0700 (PDT) In-Reply-To: <799446056.115188.1315369441902.JavaMail.root@mail-01.cse.ucsc.edu> References: <799446056.115188.1315369441902.JavaMail.root@mail-01.cse.ucsc.edu> Date: Wed, 7 Sep 2011 19:07:02 +0930 Message-ID: From: Matt Thyer To: Tim Gustafson Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-current@freebsd.org Subject: Re: RELENG_8 / mpt / zpool Errors X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 07 Sep 2011 09:37:04 -0000 On 7 September 2011 13:54, Tim Gustafson wrote: > > What are the drives exactly? You may have issues like TLER or > > frequent head parking. Are these SATA, SCSI or SAS and are port > > multipliers in use? > > root@bsd-03: dmesg | grep da6 > da6 at mpt0 bus 0 scbus1 target 1 lun 0 > da6: Fixed Direct Access SCSI-5 device > da6: 300.000MB/s transfers > da6: Command Queueing enabled > da6: 1907729MB (3907029168 512 byte sectors: 255H 63S/T 243201C) > > The drives are housed in two of the following enclosures: > > ses0 at mpt0 bus 0 scbus1 target 32 lun 0 > ses0: Fixed Enclosure Services SCSI-5 device > ses0: 300.000MB/s transfers > ses0: Command Queueing enabled > ses0: SCSI-3 SES Device > > Each enclosure is directly connected by a dedicated cable to the 2-port > controller: > > mps0: port 0xfc00-0xfcff mem > 0xef5f0000-0xef5fffff,0xef580000-0xef5bffff irq 44 at device 0.0 on pci1 > mps0: Firmware: 07.15.04.00 > mps0: IOCCapabilities: > 185c > mps0: [ITHREAD] > > > -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- > Tim Gustafson > tjg@soe.ucsc.edu > Baskin School of Engineering > 831-459-5354 > UC Santa Cruz Baskin Engineering > 317B > > -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- > You'll be interested in the thread "PCIe SATA HBA for ZFS on -STABLE" on the FreeBSD-STABLE list between 31 May 2011 and 12 June 2011. Jeremy Chadwick's post on the 1st of June is particularly enlightening. Advice is: Use -STABLE and not -RELEASE Upgrade firmware Avoid port multipliers I'm having no troubles but with 8 identical SATA disks instead of SAS. As I'm using cheap 4K green drives I had to use wdidle3.exe to fix the 8 second head parking and I also had to use gnop to force my ZFS pool to use 4K transfers. mps0: port 0xee00-0xeeff mem 0xfbdfc000-0xfbdfffff,0xfbd80000-0xfbdbffff irq 16 at device 0.0 on pci1 mps0: Firmware: 07.00.00.00 da0 at mps0 bus 0 scbus0 target 0 lun 0 da0: Fixed Direct Access SCSI-5 device da0: 300.000MB/s transfers da0: Command Queueing enabled da0: 1907729MB (3907029168 512 byte sectors: 255H 63S/T 243201C)