From owner-freebsd-questions@FreeBSD.ORG Wed Jan 17 03:01:27 2007 Return-Path: X-Original-To: freebsd-questions@freebsd.org Delivered-To: freebsd-questions@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 3C89C16A52E; Wed, 17 Jan 2007 03:01:27 +0000 (UTC) (envelope-from ivoras@fer.hr) Received: from min.macrovision.com (fw.macrovision.com [192.156.198.62]) by mx1.freebsd.org (Postfix) with ESMTP id EE47713C457; Wed, 17 Jan 2007 03:01:26 +0000 (UTC) (envelope-from ivoras@fer.hr) Received: from mail pickup service by min.macrovision.com with Microsoft SMTPSVC; Tue, 16 Jan 2007 18:48:41 -0800 Received: from lancelot.macrovision.com ([10.99.0.240]) by min.macrovision.com with Microsoft SMTPSVC(6.0.3790.1830); Tue, 16 Jan 2007 16:32:13 -0800 Received: from mx2.freebsd.org (mx2.freebsd.org [69.147.83.53]) by lancelot.macrovision.com (8.13.1/8.13.1) with ESMTP id l0H0W0fl021137 for ; Tue, 16 Jan 2007 16:32:05 -0800 Received: from hub.freebsd.org (hub.freebsd.org [69.147.83.54]) by mx2.freebsd.org (Postfix) with ESMTP id BFDAA72B4A; Wed, 17 Jan 2007 00:26:14 +0000 (GMT) (envelope-from owner-freebsd-performance@freebsd.org) Received: from hub.freebsd.org (localhost [127.0.0.1]) by hub.freebsd.org (Postfix) with ESMTP id 4AFF716A51B; Wed, 17 Jan 2007 00:26:12 +0000 (UTC) (envelope-from owner-freebsd-performance@freebsd.org) X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id CD98A16A412; Wed, 17 Jan 2007 00:26:05 +0000 (UTC) (envelope-from ivoras@fer.hr) Received: from ls405.t-com.hr (ls405.t-com.hr [195.29.150.135]) by mx1.freebsd.org (Postfix) with ESMTP id 566E513C448; Wed, 17 Jan 2007 00:26:05 +0000 (UTC) (envelope-from ivoras@fer.hr) Received: from ls242.t-com.hr (ls242.t-com.hr [195.29.150.134]) by ls405.t-com.hr (Postfix) with ESMTP id D4601143AB7; Wed, 17 Jan 2007 00:53:18 +0100 (CET) Received: from ls242.t-com.hr (localhost.localdomain [127.0.0.1]) by ls242.t-com.hr (Qmlai) with ESMTP id BC72310F805B; Wed, 17 Jan 2007 00:53:18 +0100 (CET) Received: from ls242.t-com.hr (localhost.localdomain [127.0.0.1]) by ls242.t-com.hr (Qmlai) with ESMTP id A654510F8059; Wed, 17 Jan 2007 00:53:18 +0100 (CET) X-Envelope-Sender-Info: qNMqIwJL6pMxrLsv6Bv6QwbAS50Yr5Qqas2jRir/hsbKYW+NL8qJhtwp0O8kWM3b X-Envelope-Sender: ivoras@fer.hr Received: from [10.0.0.101] (83-131-108-141.adsl.net.t-com.hr [83.131.108.141]) by ls242.t-com.hr (Qmali) with ESMTP id 4443C6C003C; Wed, 17 Jan 2007 00:53:17 +0100 (CET) Message-ID: <45AD6651.5010107@fer.hr> Date: Wed, 17 Jan 2007 00:57:05 +0100 From: Ivan Voras User-Agent: Thunderbird 1.5.0.9 (Windows/20061207) MIME-Version: 1.0 To: "Wood, Russell" References: In-Reply-To: X-Enigmail-Version: 0.94.1.2 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enig21B123D9444D806EC45519D7" X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Sender: owner-freebsd-performance@freebsd.org Errors-To: owner-freebsd-performance@freebsd.org X-PMX-Version: 5.2.1.279297, Antispam-Engine: 2.4.0.264935, Antispam-Data: 2007.1.16.161933 X-PerlMx-Spam: Gauge=IIIIIII, Probability=7%, Report='__BAT_BOUNDARY 0, __CT 0, __CTYPE_HAS_BOUNDARY 0, __CTYPE_MULTIPART 0, __HAS_MSGID 0, __MIME_VERSION 0, __SANE_MSGID 0, __USER_AGENT 0, __cbl.abuseat.org_TIMEOUT , __dnsbl.njabl.org_TIMEOUT , __sbl.spamhaus.org_TIMEOUT ' X-OriginalArrivalTime: 17 Jan 2007 00:32:20.0731 (UTC) FILETIME=[F3100CB0:01C739CE] Cc: freebsd-performance@freebsd.org, freebsd-questions@freebsd.org Subject: Re: Very Poor Raid Card Performance X-BeenThere: freebsd-questions@freebsd.org List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Jan 2007 03:01:27 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enig21B123D9444D806EC45519D7 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Wood, Russell wrote: > I have an LSI MegaRaid with three drives at RAID 5: works a > god-damn-treat. I don't know what my throughput is on RAID 5 but RAID 0= > was fast (70MB/s+). Mine was RAID5. Hmm, oops, it wasn't LSI but HP/Compaq CISS, battery backed, SATA on SAS. da0 at ciss0 bus 0 target 0 lun 0 da0: Fixed Direct Access SCSI-0 device da0: 135.168MB/s transfers da0: 476886MB (976662896 512 byte sectors: 255H 32S/T 65535C) > Were you doing these tests a few hours after initializing the array, by= > any chance? If so, then the poor performance could be because the array= > was `in build' while you were using it, and therefore you'd get very > poor performance. Yes, I observed BIOS status. Here's a typical run of bonnie++: Version 1.93c ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP xxx.com 2500M 358 99 13446 4 7068 2 559 96 97548 23 300.0 10 Latency 23236us 848ms 488ms 191ms 214ms 175ms My reading of iostat during 'dd' is that writes perform good until the on-controller cache gets filled, then it slows down: tty da0 pass0 cpu tin tout KB/t tps MB/s KB/t tps MB/s us ni sy in id =2E.. 0 60 0.00 0 0.00 0.00 0 0.00 0 0 0 0 100 1 64 127.93 217 27.08 0.00 0 0.00 0 0 5 0 95 0 61 125.92 400 49.14 0.00 0 0.00 0 0 2 1 98 0 61 128.00 107 13.36 0.00 0 0.00 0 0 2 0 98 0 61 128.00 107 13.36 0.00 0 0.00 0 0 2 0 98 0 61 128.00 104 12.99 0.00 0 0.00 0 0 2 0 98 Cache size is 128MB, 75% dedicated to write caching. --------------enig21B123D9444D806EC45519D7 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.4 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFFrWZYldnAQVacBcgRAnHEAJ4vXIxQL0kUSVnhyCCWH47HTisKjQCdFLBx LLKpARmf0xI5udqqNOznODg= =ajTN -----END PGP SIGNATURE----- --------------enig21B123D9444D806EC45519D7--