From owner-freebsd-scsi@FreeBSD.ORG Tue Mar 3 03:06:02 2009 Return-Path: Delivered-To: freebsd-scsi@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 1E8A51065678 for ; Tue, 3 Mar 2009 03:06:02 +0000 (UTC) (envelope-from josh@tcbug.org) Received: from out3.smtp.messagingengine.com (out3.smtp.messagingengine.com [66.111.4.27]) by mx1.freebsd.org (Postfix) with ESMTP id E730D8FC17 for ; Tue, 3 Mar 2009 03:06:01 +0000 (UTC) (envelope-from josh@tcbug.org) Received: from compute1.internal (compute1.internal [10.202.2.41]) by out1.messagingengine.com (Postfix) with ESMTP id 163F12D0EC0; Mon, 2 Mar 2009 22:06:01 -0500 (EST) Received: from heartbeat2.messagingengine.com ([10.202.2.161]) by compute1.internal (MEProxy); Mon, 02 Mar 2009 22:06:01 -0500 X-Sasl-enc: yp14kPFIqAcw2F48U/ArWNnKz2vm4zOO4RfK5SNj+VBH 1236049560 Received: from [10.0.1.198] (c-66-41-132-62.hsd1.mn.comcast.net [66.41.132.62]) by mail.messagingengine.com (Postfix) with ESMTPSA id A075047B93; Mon, 2 Mar 2009 22:06:00 -0500 (EST) Message-Id: <89312829-73A5-463B-8F9C-8CC30FB262B1@tcbug.org> From: Josh Paetzel To: Andrew Snow In-Reply-To: <49AC5EB3.4020601@modulus.org> Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v930.3) Date: Mon, 2 Mar 2009 21:05:58 -0600 References: <09CE3D22-431A-433F-9CAF-6896FF77DDB1@tcbug.org> <49AC5EB3.4020601@modulus.org> X-Mailer: Apple Mail (2.930.3) Cc: freebsd-scsi@FreeBSD.org Subject: Re: twa driver and 3ware 9690SA issues X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 03 Mar 2009 03:06:02 -0000 On Mar 2, 2009, at 4:33 PM, Andrew Snow wrote: > Josh Paetzel wrote: >> Which wasn't that much of an issue, as SATA drives aren't capable >> of sustained sequential 100 MB/sec transfers anyways > > As Scott said, this number is not reflective of actual negotiated > rate, and is nothing to worry about. Great, thanks. > >> u0 RAID-10 OK - - 64K 596.025 >> ON OFF >> 838860800 bytes transferred in 6.923690 secs (121158052 bytes/sec) >> Kind of what I expect, and faster than 100 Megs/sec > > Well, that's a RAID10 and capable of doing much faster than 120MB/s. > Hrmm, I was under the impression that a single read or write would only see the sequential transfer rate of one side of the stripe set, and that would be fairly close to 120 Megs/sec. > Sorry, but you cannot expect anywhere near close to the theoretical > unformatted maximum media transfer rate of the disks you're testing, > especially under FreeBSD and UFS. > No need to apologize. > Testing the raw disks doesn't necessarily help either because then > there's no operating system read-ahead or write-caching, which is > necessary to lower the latency between access requests. > > I don't believe you're getting any SCSI or 3ware problems - just > FreeBSD kernel and filesystem issues. > > UFS is performance is a bit bizarre: for example I see faster > sequential write speeds than read speeds! ZFS improves the situation > alot and I get much closer to the theoritical max with my drives. > > To give you an idea of how much more efficient ZFS is: I had a 16 > disk 3ware SATA RAID6, with UFS, and battery-backed cache. I > converted to a 14 disk ZFS software RAIDZ2 with a smaller 3ware > mirrored boot disk. > > Quick benchmarked using dd as follows: > > Creating a 6GB file: UFS+3ware=308mb/s ZFS=357mb/s > Reading a 6GB file: UFS+3ware=113mb/s ZFS=424mb/s > > > > - Andrew ZFS probably isn't an option for me. A lot of these systems max out at 8 gigs of RAM, and postgresql eats a huge chunk of that, also the controllers on the motherboard don't always report back drive failures to the OS, as well as have occasional failures detecting new drives when we need to hot swap, as well as having my biggest concern, no battery backed cache. :( My main question has been answered, the link speed that the driver reports is imaginary. Thanks, Josh Paetzel