From owner-freebsd-performance@FreeBSD.ORG Tue Nov 1 00:23:07 2005 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id EC6B916A41F for ; Tue, 1 Nov 2005 00:23:07 +0000 (GMT) (envelope-from francisco@natserv.net) Received: from zoraida.natserv.net (p65-147.acedsl.com [66.114.65.147]) by mx1.FreeBSD.org (Postfix) with ESMTP id 8235043D70 for ; Tue, 1 Nov 2005 00:23:07 +0000 (GMT) (envelope-from francisco@natserv.net) Received: from localhost (localhost.natserv.net [127.0.0.1]) by zoraida.natserv.net (Postfix) with ESMTP id 870867DFA; Mon, 31 Oct 2005 19:23:06 -0500 (EST) Date: Mon, 31 Oct 2005 19:23:06 -0500 (EST) From: Francisco Reyes X-X-Sender: fran@zoraida.natserv.net To: Mike Tancsa In-Reply-To: <6.2.3.4.0.20051029001622.05bf16f8@64.7.153.2> Message-ID: <20051031192143.V5132@zoraida.natserv.net> References: <000801c5d434$579de280$b3db87d4@multiplay.co.uk> <6.2.3.4.0.20051018234157.085cd7b8@64.7.153.2> <20051029001047.P43285@zoraida.natserv.net> <6.2.3.4.0.20051029001622.05bf16f8@64.7.153.2> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Cc: FreeBSD Performance Subject: Re: SATA: RAID 5 controller recommendations X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: francisco@natserv.net List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 01 Nov 2005 00:23:08 -0000 On Sat, 29 Oct 2005, Mike Tancsa wrote: >> >>> I use the 3ware line (8xxx) and they are very stable, but not the fastest. >>> For speed, check out the cards from Areca. Native FreeBSD support and >>> they are FAST >>> >>> http://www.areca.com.tw/products/html/pcix-sata.htm Saw a review last night of the Areca cards vs the latest 3ware. The areca cards were about twice as fast, but the article says that they are about twice as expensive (or something on that area). :-( How did the prices compare? From owner-freebsd-performance@FreeBSD.ORG Tue Nov 1 03:25:54 2005 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 9BC5816A420 for ; Tue, 1 Nov 2005 03:25:54 +0000 (GMT) (envelope-from mike@sentex.net) Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [64.7.153.18]) by mx1.FreeBSD.org (Postfix) with ESMTP id 7389143D5F for ; Tue, 1 Nov 2005 03:25:48 +0000 (GMT) (envelope-from mike@sentex.net) Received: from pumice3.sentex.ca (pumice3.sentex.ca [64.7.153.26]) by smarthost1.sentex.ca (8.13.4/8.13.4) with ESMTP id jA13PmEm025820 for ; Mon, 31 Oct 2005 22:25:48 -0500 (EST) (envelope-from mike@sentex.net) Received: from lava.sentex.ca (pyroxene.sentex.ca [199.212.134.18]) by pumice3.sentex.ca (8.13.4/8.13.4) with ESMTP id jA13PlAm020992; Mon, 31 Oct 2005 22:25:48 -0500 (EST) (envelope-from mike@sentex.net) Received: from simian.sentex.net (simeon.sentex.ca [192.168.43.27]) by lava.sentex.ca (8.13.3/8.13.3) with ESMTP id jA13PiWF073043 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Mon, 31 Oct 2005 22:25:46 -0500 (EST) (envelope-from mike@sentex.net) Message-Id: <6.2.3.4.0.20051031222320.06601518@64.7.153.2> X-Mailer: QUALCOMM Windows Eudora Version 6.2.3.4 Date: Mon, 31 Oct 2005 22:24:55 -0500 To: francisco@natserv.net From: Mike Tancsa In-Reply-To: <20051031192143.V5132@zoraida.natserv.net> References: <000801c5d434$579de280$b3db87d4@multiplay.co.uk> <6.2.3.4.0.20051018234157.085cd7b8@64.7.153.2> <20051029001047.P43285@zoraida.natserv.net> <6.2.3.4.0.20051029001622.05bf16f8@64.7.153.2> <20051031192143.V5132@zoraida.natserv.net> Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii"; format=flowed X-Virus-Scanned: by amavisd-new X-Scanned-By: MIMEDefang 2.51 on 64.7.153.18 X-Scanned-By: MIMEDefang 2.53 on 64.7.153.26 Cc: FreeBSD Performance Subject: Re: SATA: RAID 5 controller recommendations X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 01 Nov 2005 03:25:54 -0000 At 07:23 PM 31/10/2005, Francisco Reyes wrote: >On Sat, 29 Oct 2005, Mike Tancsa wrote: > >>> >>>>I use the 3ware line (8xxx) and they are very stable, but not the >>>>fastest. For speed, check out the cards from Areca. Native >>>>FreeBSD support and they are FAST >>>>http://www.areca.com.tw/products/html/pcix-sata.htm > >Saw a review last night of the Areca cards vs the latest 3ware. The >areca cards were about twice as fast, but the article says that they >are about twice as expensive (or something on that area). :-( Which 3ware were they comparing ? The 9500SX was a little bit more than the 4 port ARECA here in Canada. Still waiting for RAM so I can test. Hopefully later this week :( ---Mike From owner-freebsd-performance@FreeBSD.ORG Tue Nov 1 05:52:29 2005 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 4084916A41F for ; Tue, 1 Nov 2005 05:52:29 +0000 (GMT) (envelope-from francisco@natserv.net) Received: from zoraida.natserv.net (p65-147.acedsl.com [66.114.65.147]) by mx1.FreeBSD.org (Postfix) with ESMTP id E0EDB43D48 for ; Tue, 1 Nov 2005 05:52:28 +0000 (GMT) (envelope-from francisco@natserv.net) Received: from localhost (localhost.natserv.net [127.0.0.1]) by zoraida.natserv.net (Postfix) with ESMTP id F27F37DC1; Tue, 1 Nov 2005 00:52:27 -0500 (EST) Date: Tue, 1 Nov 2005 00:52:27 -0500 (EST) From: Francisco Reyes X-X-Sender: fran@zoraida.natserv.net To: Mike Tancsa In-Reply-To: <6.2.3.4.0.20051031222320.06601518@64.7.153.2> Message-ID: <20051101005137.G6044@zoraida.natserv.net> References: <000801c5d434$579de280$b3db87d4@multiplay.co.uk> <6.2.3.4.0.20051018234157.085cd7b8@64.7.153.2> <20051029001047.P43285@zoraida.natserv.net> <6.2.3.4.0.20051029001622.05bf16f8@64.7.153.2> <20051031192143.V5132@zoraida.natserv.net> <6.2.3.4.0.20051031222320.06601518@64.7.153.2> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Cc: FreeBSD Performance Subject: Re: SATA: RAID 5 controller recommendations X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: francisco@natserv.net List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 01 Nov 2005 05:52:29 -0000 On Mon, 31 Oct 2005, Mike Tancsa wrote: > Which 3ware were they comparing ? The 9500SX was a little bit more than the > 4 port ARECA here in Canada. It was the 9500SX.. Don't recall the models for the ARECA, but they compared it to two. From owner-freebsd-performance@FreeBSD.ORG Tue Nov 1 07:14:11 2005 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id EC45616A420 for ; Tue, 1 Nov 2005 07:14:11 +0000 (GMT) (envelope-from ap@bnc.net) Received: from mailomat.net (mailomat.net [217.110.117.101]) by mx1.FreeBSD.org (Postfix) with ESMTP id 0255843D6A for ; Tue, 1 Nov 2005 07:14:05 +0000 (GMT) (envelope-from ap@bnc.net) X-BNC-SpamCatcher-Score: 2 [X] Received: from [194.39.192.125] (account bnc-mail@mailrelay.mailomat.net HELO bnc.net) by mailomat.net (CommuniGate Pro SMTP 4.3.6) with ESMTPSA id 5795529; Tue, 01 Nov 2005 08:14:00 +0100 Received: from [194.39.192.154] (account ap HELO [194.39.192.154]) by bnc.net (CommuniGate Pro SMTP 4.3.5) with ESMTPSA id 1337624; Tue, 01 Nov 2005 08:15:33 +0100 In-Reply-To: <20051031192143.V5132@zoraida.natserv.net> References: <000801c5d434$579de280$b3db87d4@multiplay.co.uk> <6.2.3.4.0.20051018234157.085cd7b8@64.7.153.2> <20051029001047.P43285@zoraida.natserv.net> <6.2.3.4.0.20051029001622.05bf16f8@64.7.153.2> <20051031192143.V5132@zoraida.natserv.net> Mime-Version: 1.0 (Apple Message framework v734) Content-Type: text/plain; charset=US-ASCII; delsp=yes; format=flowed Message-Id: <2B37E74B-7FE9-430E-A0B6-611C2086A653@bnc.net> Content-Transfer-Encoding: 7bit From: Achim Patzner Date: Tue, 1 Nov 2005 08:13:56 +0100 To: francisco@natserv.net X-Mailer: Apple Mail (2.734) Cc: FreeBSD Performance , Mike Tancsa Subject: Re: SATA: RAID 5 controller recommendations X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 01 Nov 2005 07:14:12 -0000 Am 01.11.2005 um 01:23 schrieb Francisco Reyes: >>>> I use the 3ware line (8xxx) and they are very stable, but not >>>> the fastest. For speed, check out the cards from Areca. Native >>>> FreeBSD support and they are FAST >>>> http://www.areca.com.tw/products/html/pcix-sata.htm > > Saw a review last night of the Areca cards vs the latest 3ware. The > areca cards were about twice as fast, but the article says that > they are about twice as expensive (or something on that area). :-( Seems like a good price; the German distributor seems a bit more greedy. They're even more expensive than ICP Vortex S-ATA RAID cards - and definitely not better than those (ICP has yet another advantage - S-ATA and IDE RAIDS are using the same driver). Achim From owner-freebsd-performance@FreeBSD.ORG Tue Nov 1 13:30:06 2005 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id EA04C16A420 for ; Tue, 1 Nov 2005 13:30:06 +0000 (GMT) (envelope-from mike@sentex.net) Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [64.7.153.18]) by mx1.FreeBSD.org (Postfix) with ESMTP id 18F5943D4C for ; Tue, 1 Nov 2005 13:30:05 +0000 (GMT) (envelope-from mike@sentex.net) Received: from pumice3.sentex.ca (pumice3.sentex.ca [64.7.153.26]) by smarthost1.sentex.ca (8.13.4/8.13.4) with ESMTP id jA1DU5NQ068249 for ; Tue, 1 Nov 2005 08:30:05 -0500 (EST) (envelope-from mike@sentex.net) Received: from lava.sentex.ca (pyroxene.sentex.ca [199.212.134.18]) by pumice3.sentex.ca (8.13.4/8.13.4) with ESMTP id jA1DU46e087605; Tue, 1 Nov 2005 08:30:04 -0500 (EST) (envelope-from mike@sentex.net) Received: from simian.sentex.net (simeon.sentex.ca [192.168.43.27]) by lava.sentex.ca (8.13.3/8.13.3) with ESMTP id jA1DU2E2074785 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Tue, 1 Nov 2005 08:30:02 -0500 (EST) (envelope-from mike@sentex.net) Message-Id: <6.2.3.4.0.20051101082743.054f8fc0@64.7.153.2> X-Mailer: QUALCOMM Windows Eudora Version 6.2.3.4 Date: Tue, 01 Nov 2005 08:29:15 -0500 To: francisco@natserv.net From: Mike Tancsa In-Reply-To: <20051101005137.G6044@zoraida.natserv.net> References: <000801c5d434$579de280$b3db87d4@multiplay.co.uk> <6.2.3.4.0.20051018234157.085cd7b8@64.7.153.2> <20051029001047.P43285@zoraida.natserv.net> <6.2.3.4.0.20051029001622.05bf16f8@64.7.153.2> <20051031192143.V5132@zoraida.natserv.net> <6.2.3.4.0.20051031222320.06601518@64.7.153.2> <20051101005137.G6044@zoraida.natserv.net> Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii"; format=flowed X-Virus-Scanned: by amavisd-new X-Scanned-By: MIMEDefang 2.51 on 64.7.153.18 X-Scanned-By: MIMEDefang 2.53 on 64.7.153.26 Cc: FreeBSD Performance Subject: Re: SATA: RAID 5 controller recommendations X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 01 Nov 2005 13:30:07 -0000 At 12:52 AM 01/11/2005, Francisco Reyes wrote: >On Mon, 31 Oct 2005, Mike Tancsa wrote: >>Which 3ware were they comparing ? The 9500SX was a little bit more >>than the 4 port ARECA here in Canada. > >It was the 9500SX.. Don't recall the models for the ARECA, but they >compared it to two. I would for sure check pricing with Areca as here in Canada thats not the case at all. I have bought a few directly from them and turn around is fast and ordering painless. ---Mike From owner-freebsd-performance@FreeBSD.ORG Tue Nov 1 15:21:38 2005 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 0074416A421 for ; Tue, 1 Nov 2005 15:21:37 +0000 (GMT) (envelope-from francisco@natserv.net) Received: from zoraida.natserv.net (p65-147.acedsl.com [66.114.65.147]) by mx1.FreeBSD.org (Postfix) with ESMTP id 5A53643D6D for ; Tue, 1 Nov 2005 15:21:34 +0000 (GMT) (envelope-from francisco@natserv.net) Received: from localhost (localhost.natserv.net [127.0.0.1]) by zoraida.natserv.net (Postfix) with ESMTP id 8386F7E99; Tue, 1 Nov 2005 10:21:33 -0500 (EST) Date: Tue, 1 Nov 2005 10:21:33 -0500 (EST) From: Francisco Reyes X-X-Sender: fran@zoraida.natserv.net To: Mike Tancsa In-Reply-To: <6.2.3.4.0.20051101082743.054f8fc0@64.7.153.2> Message-ID: <20051101102039.U32251@zoraida.natserv.net> References: <000801c5d434$579de280$b3db87d4@multiplay.co.uk> <6.2.3.4.0.20051018234157.085cd7b8@64.7.153.2> <20051029001047.P43285@zoraida.natserv.net> <6.2.3.4.0.20051029001622.05bf16f8@64.7.153.2> <20051031192143.V5132@zoraida.natserv.net> <6.2.3.4.0.20051031222320.06601518@64.7.153.2> <20051101005137.G6044@zoraida.natserv.net> <6.2.3.4.0.20051101082743.054f8fc0@64.7.153.2> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Cc: FreeBSD Performance Subject: Re: SATA: RAID 5 controller recommendations X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: francisco@natserv.net List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 01 Nov 2005 15:21:38 -0000 On Tue, 1 Nov 2005, Mike Tancsa wrote: > I would for sure check pricing with Areca Will do. I think I have a new server we will be making in a few months and thinking will go with an Areca card card for it. From owner-freebsd-performance@FreeBSD.ORG Tue Nov 1 21:23:12 2005 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 434B716A41F for ; Tue, 1 Nov 2005 21:23:12 +0000 (GMT) (envelope-from mike@sentex.net) Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [64.7.153.18]) by mx1.FreeBSD.org (Postfix) with ESMTP id 9811143D46 for ; Tue, 1 Nov 2005 21:23:11 +0000 (GMT) (envelope-from mike@sentex.net) Received: from pumice3.sentex.ca (pumice3.sentex.ca [64.7.153.26]) by smarthost1.sentex.ca (8.13.4/8.13.4) with ESMTP id jA1LNAFJ032656 for ; Tue, 1 Nov 2005 16:23:10 -0500 (EST) (envelope-from mike@sentex.net) Received: from lava.sentex.ca (pyroxene.sentex.ca [199.212.134.18]) by pumice3.sentex.ca (8.13.4/8.13.4) with ESMTP id jA1LNAA6004508 for ; Tue, 1 Nov 2005 16:23:10 -0500 (EST) (envelope-from mike@sentex.net) Received: from simian.sentex.net (simeon.sentex.ca [192.168.43.27]) by lava.sentex.ca (8.13.3/8.13.3) with ESMTP id jA1LN8BU077867 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO) for ; Tue, 1 Nov 2005 16:23:08 -0500 (EST) (envelope-from mike@sentex.net) Message-Id: <6.2.3.4.0.20051101161812.0730a180@64.7.153.2> X-Mailer: QUALCOMM Windows Eudora Version 6.2.3.4 Date: Tue, 01 Nov 2005 16:22:57 -0500 To: FreeBSD Performance From: Mike Tancsa In-Reply-To: <20051031192143.V5132@zoraida.natserv.net> References: <000801c5d434$579de280$b3db87d4@multiplay.co.uk> <6.2.3.4.0.20051018234157.085cd7b8@64.7.153.2> <20051029001047.P43285@zoraida.natserv.net> <6.2.3.4.0.20051029001622.05bf16f8@64.7.153.2> <20051031192143.V5132@zoraida.natserv.net> Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii"; format=flowed X-Virus-Scanned: by amavisd-new X-Scanned-By: MIMEDefang 2.51 on 64.7.153.18 X-Scanned-By: MIMEDefang 2.53 on 64.7.153.26 Subject: Benchmarks to run (was Re: SATA: RAID 5 controller recommendations X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 01 Nov 2005 21:23:12 -0000 At 07:23 PM 31/10/2005, Francisco Reyes wrote: >On Sat, 29 Oct 2005, Mike Tancsa wrote: > >>> >>>>I use the 3ware line (8xxx) and they are very stable, but not the >>>>fastest. For speed, check out the cards from Areca. Native >>>>FreeBSD support and they are FAST >>>>http://www.areca.com.tw/products/html/pcix-sata.htm > >Saw a review last night of the Areca cards vs the latest 3ware. The >areca cards were about twice as fast, but the article says that they >are about twice as expensive (or something on that area). :-( OK, I finally got the RAM for a server that will be in my lab for another week before going out to a customers. I was going to test out the 9500SX and Areca using a bunch of different programs from the simple (dd) to not quite so simple (one of our large radius data sets in mysql) and see how things compare. Anyone have any requests for me to run ? The only thing I will change on the box is an Areca for the 9500SX. Other than that, the hardware will be the same. bonnie, iozone, bonnie++. Apps I will load up will be mysql. CPU: Intel(R) Xeon(TM) CPU 3.00GHz (2992.51-MHz 686-class CPU) Origin = "GenuineIntel" Id = 0xf41 Stepping = 1 Features=0xbfebfbff Features2=0x641d> AMD Features=0x20000000 Hyperthreading: 2 logical CPUs I am booting off an IDE drive and will run all tests against a single RAID5 volume I will start with the 3ware tonight 3ware device driver for 9000 series storage controllers, version: 3.50.02.012 twa0: <3ware 9000 series Storage Controller> port 0xdf80-0xdfbf mem 0xdc000000-0xddffffff,0xdeeff000-0xdeefffff irq 24 at device 3.0 on pci3 twa0: [FAST] twa0: INFO: (0x15: 0x1300): Controller details:: Model 9550SX-4LP, 4 ports, Firmware FE9X 3.01.01.028, BIOS BE9X 3.01.00.024 da0 at twa0 bus 0 target 0 lun 0 da0: Fixed Direct Access SCSI-3 device da0: 100.000MB/s transfers da0: 343290MB (703057920 512 byte sectors: 255H 63S/T 43763C) From owner-freebsd-performance@FreeBSD.ORG Tue Nov 1 22:16:28 2005 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id B7C5D16A420 for ; Tue, 1 Nov 2005 22:16:28 +0000 (GMT) (envelope-from darcy@wavefire.com) Received: from mail2.dbitech.ca (radius.wavefire.com [64.141.13.252]) by mx1.FreeBSD.org (Postfix) with SMTP id 595E143D5D for ; Tue, 1 Nov 2005 22:16:22 +0000 (GMT) (envelope-from darcy@wavefire.com) Received: (qmail 18106 invoked from network); 2 Nov 2005 00:38:17 -0000 Received: from dbitech.internal.wavefire.ca (64.141.15.12) by radius.wavefire.com with SMTP; 2 Nov 2005 00:38:17 -0000 From: Darcy Buskermolen Organization: Wavefire Technologies Corp To: freebsd-performance@freebsd.org Date: Tue, 1 Nov 2005 14:16:50 -0800 User-Agent: KMail/1.8.2 References: <000801c5d434$579de280$b3db87d4@multiplay.co.uk> <20051031192143.V5132@zoraida.natserv.net> <6.2.3.4.0.20051101161812.0730a180@64.7.153.2> In-Reply-To: <6.2.3.4.0.20051101161812.0730a180@64.7.153.2> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200511011416.50573.darcy@wavefire.com> Subject: Re: Benchmarks to run (was Re: SATA: RAID 5 controller recommendations X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 01 Nov 2005 22:16:28 -0000 On Tuesday 01 November 2005 13:22, Mike Tancsa wrote: > At 07:23 PM 31/10/2005, Francisco Reyes wrote: > >On Sat, 29 Oct 2005, Mike Tancsa wrote: > >>>>I use the 3ware line (8xxx) and they are very stable, but not the > >>>>fastest. For speed, check out the cards from Areca. Native > >>>>FreeBSD support and they are FAST > >>>>http://www.areca.com.tw/products/html/pcix-sata.htm > > > >Saw a review last night of the Areca cards vs the latest 3ware. The > >areca cards were about twice as fast, but the article says that they > >are about twice as expensive (or something on that area). :-( > > OK, I finally got the RAM for a server that will be in my lab for > another week before going out to a customers. I was going to test > out the 9500SX and Areca using a bunch of different programs from the > simple (dd) to not quite so simple (one of our large radius data sets > in mysql) and see how things compare. Anyone have any requests for > me to run ? The only thing I will change on the box is an Areca for > the 9500SX. Other than that, the hardware will be the same. > > bonnie, iozone, bonnie++. Apps I will load up will be mysql. I'd like to see some PostgreSQL numbers specificaly under high concurancy, This can easily provided by pgbench. If you need more info on how to do this this please feel free to contact me and I'll give you the quick and dirty > > > > > CPU: Intel(R) Xeon(TM) CPU 3.00GHz (2992.51-MHz 686-class CPU) > Origin = "GenuineIntel" Id = 0xf41 Stepping = 1 > > Features=0xbfebfbffA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS, HTT,TM,PBE> > Features2=0x641d> > AMD Features=0x20000000 > Hyperthreading: 2 logical CPUs > > > I am booting off an IDE drive and will run all tests against a single > RAID5 volume > > I will start with the 3ware tonight > > 3ware device driver for 9000 series storage controllers, version: > 3.50.02.012 twa0: <3ware 9000 series Storage Controller> port 0xdf80-0xdfbf > mem 0xdc000000-0xddffffff,0xdeeff000-0xdeefffff irq 24 at device 3.0 on > pci3 twa0: [FAST] > twa0: INFO: (0x15: 0x1300): Controller details:: Model 9550SX-4LP, 4 > ports, Firmware FE9X 3.01.01.028, BIOS BE9X 3.01.00.024 > da0 at twa0 bus 0 target 0 lun 0 > da0: Fixed Direct Access SCSI-3 device > da0: 100.000MB/s transfers > da0: 343290MB (703057920 512 byte sectors: 255H 63S/T 43763C) > > > _______________________________________________ > freebsd-performance@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-performance > To unsubscribe, send any mail to > "freebsd-performance-unsubscribe@freebsd.org" -- Darcy Buskermolen Wavefire Technologies Corp. http://www.wavefire.com ph: 250.717.0200 fx: 250.763.1759 From owner-freebsd-performance@FreeBSD.ORG Wed Nov 2 10:17:05 2005 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id CC5D016A42B for ; Wed, 2 Nov 2005 10:17:05 +0000 (GMT) (envelope-from mv@roq.com) Received: from p4.roq.com (ns1.ecoms.com [207.44.130.137]) by mx1.FreeBSD.org (Postfix) with ESMTP id 6997C43D48 for ; Wed, 2 Nov 2005 10:17:04 +0000 (GMT) (envelope-from mv@roq.com) Received: from p4.roq.com (localhost.roq.com [127.0.0.1]) by p4.roq.com (Postfix) with ESMTP id 7F6F84C4F7; Wed, 2 Nov 2005 10:17:27 +0000 (GMT) Received: from [192.168.0.2] (ppp157-158.static.internode.on.net [150.101.157.158]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by p4.roq.com (Postfix) with ESMTP id 761774C4F6; Wed, 2 Nov 2005 10:17:26 +0000 (GMT) Message-ID: <4368921C.40305@roq.com> Date: Wed, 02 Nov 2005 21:17:00 +1100 From: Michael VInce User-Agent: Mozilla/5.0 (X11; U; FreeBSD amd64; en-US; rv:1.7.12) Gecko/20051019 X-Accept-Language: en-us, en MIME-Version: 1.0 To: Steven Hartland References: <000801c5d434$579de280$b3db87d4@multiplay.co.uk> In-Reply-To: <000801c5d434$579de280$b3db87d4@multiplay.co.uk> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: ClamAV using ClamSMTP Cc: freebsd-performance@freebsd.org Subject: Re: SATA: RAID 5 controller recommendations X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 02 Nov 2005 10:17:06 -0000 For SATA I have always been getting the Dell 750s (now 850s) which use the 'aac' Adaptec AdvancedRAID Controller driver, do 'man aac' for more details. Dell supply them with a 64meg cache and are hardware raid, I have always just installed FreeBSD on them and only 1 hard drive comes up as RAID should be. I have only been ordering the machines in dual drive mirror 1 Raid, but you could get a PowerEdge Tower servers like the 830 which do raid 5, I never used one though. Alternatively all the Dell SCSI RAID systems have 256megs cache which use the LSI Logic MegaRAID ( man amr ) Stay away from the ultra low end SC1425 systems they have some kind of software based raid. The thing I have noticed is that if you compare other (often claiming to be much cheaper) servers from other companies they often really skimp on their hard drive subsystems with software based stuff claiming its RAID. I used to be anti Dell and build my own U1 servers from case and up and had a keen interest in cheap RAID technologies but I gave up a little while ago. I believe Dell are great value when you consider their RAID implementations and as long as you are happy with Intel chips. Mike Steven Hartland wrote: > Anyone got any SATA RAID 5 controllers they can recommend > 64Bit PCIX. > > Steve > > > ================================================ > This e.mail is private and confidential between Multiplay (UK) Ltd. > and the person or entity to whom it is addressed. In the event of > misdirection, the recipient is prohibited from using, copying, > printing or otherwise disseminating it or any information contained in > it. > In the event of misdirection, illegible or incomplete transmission > please telephone (023) 8024 3137 > or return the E.mail to postmaster@multiplay.co.uk. > > _______________________________________________ > freebsd-performance@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-performance > To unsubscribe, send any mail to > "freebsd-performance-unsubscribe@freebsd.org" From owner-freebsd-performance@FreeBSD.ORG Wed Nov 2 10:22:06 2005 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 4C38916A41F for ; Wed, 2 Nov 2005 10:22:06 +0000 (GMT) (envelope-from ray@redshift.com) Received: from outgoing.redshift.com (outgoing.redshift.com [207.177.231.8]) by mx1.FreeBSD.org (Postfix) with ESMTP id 0ADCA43D45 for ; Wed, 2 Nov 2005 10:22:05 +0000 (GMT) (envelope-from ray@redshift.com) Received: from workstation (216-228-19-21.dsl.redshift.com [216.228.19.21]) by outgoing.redshift.com (Postfix) with SMTP id EB7029E7AE; Wed, 2 Nov 2005 02:22:05 -0800 (PST) Message-Id: <3.0.1.32.20051102022205.00a73dc0@pop.redshift.com> X-Mailer: na X-Sender: redshift.com Date: Wed, 02 Nov 2005 02:22:05 -0800 To: Mike Tancsa , FreeBSD Performance From: ray@redshift.com In-Reply-To: <6.2.3.4.0.20051101161812.0730a180@64.7.153.2> References: <20051031192143.V5132@zoraida.natserv.net> <000801c5d434$579de280$b3db87d4@multiplay.co.uk> <6.2.3.4.0.20051018234157.085cd7b8@64.7.153.2> <20051029001047.P43285@zoraida.natserv.net> <6.2.3.4.0.20051029001622.05bf16f8@64.7.153.2> <20051031192143.V5132@zoraida.natserv.net> Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Cc: Subject: Re: Benchmarks to run (was Re: SATA: RAID 5 controller recommendations X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 02 Nov 2005 10:22:06 -0000 At 04:22 PM 11/1/2005 -0500, Mike Tancsa wrote: | At 07:23 PM 31/10/2005, Francisco Reyes wrote: | >On Sat, 29 Oct 2005, Mike Tancsa wrote: | > | >>> | >>>>I use the 3ware line (8xxx) and they are very stable, but not the | >>>>fastest. For speed, check out the cards from Areca. Native | >>>>FreeBSD support and they are FAST | >>>>http://www.areca.com.tw/products/html/pcix-sata.htm | > | >Saw a review last night of the Areca cards vs the latest 3ware. The | >areca cards were about twice as fast, but the article says that they | >are about twice as expensive (or something on that area). :-( | | OK, I finally got the RAM for a server that will be in my lab for | another week before going out to a customers. I was going to test | out the 9500SX and Areca using a bunch of different programs from the | simple (dd) to not quite so simple (one of our large radius data sets | in mysql) and see how things compare. Anyone have any requests for | me to run ? The only thing I will change on the box is an Areca for | the 9500SX. Other than that, the hardware will be the same. | | bonnie, iozone, bonnie++. Apps I will load up will be mysql. | | | | | CPU: Intel(R) Xeon(TM) CPU 3.00GHz (2992.51-MHz 686-class CPU) | Origin = "GenuineIntel" Id = 0xf41 Stepping = 1 | Features=0xbfebfbff | Features2=0x641d> | AMD Features=0x20000000 | Hyperthreading: 2 logical CPUs | | | I am booting off an IDE drive and will run all tests against a single | RAID5 volume | | I will start with the 3ware tonight Hi Mike, I have some benchmarks I wrote in PHP that build a database and update it, etc. I will setup the files so they are a little more clear and send them to you if you like. All you need is to have PHP loaded on the machine and then create a single MySQL database. Let me know if you are game. Ray From owner-freebsd-performance@FreeBSD.ORG Wed Nov 2 10:26:18 2005 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id E02F616A41F for ; Wed, 2 Nov 2005 10:26:18 +0000 (GMT) (envelope-from ray@redshift.com) Received: from outgoing.redshift.com (outgoing.redshift.com [207.177.231.8]) by mx1.FreeBSD.org (Postfix) with ESMTP id 7956743D49 for ; Wed, 2 Nov 2005 10:26:18 +0000 (GMT) (envelope-from ray@redshift.com) Received: from workstation (216-228-19-21.dsl.redshift.com [216.228.19.21]) by outgoing.redshift.com (Postfix) with SMTP id 7CF019E7AF; Wed, 2 Nov 2005 02:26:18 -0800 (PST) Message-Id: <3.0.1.32.20051102022618.00a73dc0@pop.redshift.com> X-Mailer: na X-Sender: redshift.com Date: Wed, 02 Nov 2005 02:26:18 -0800 To: Michael VInce ,Steven Hartland From: ray@redshift.com In-Reply-To: <4368921C.40305@roq.com> References: <000801c5d434$579de280$b3db87d4@multiplay.co.uk> <000801c5d434$579de280$b3db87d4@multiplay.co.uk> Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Cc: freebsd-performance@freebsd.org Subject: Re: SATA: RAID 5 controller recommendations X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 02 Nov 2005 10:26:19 -0000 At 09:17 PM 11/2/2005 +1100, Michael VInce wrote: | For SATA I have always been getting the Dell 750s (now 850s) which use | the 'aac' | Adaptec AdvancedRAID Controller driver, do 'man aac' for more details. | Dell supply them with a 64meg cache and are hardware raid, I have always | just installed FreeBSD on them and only 1 hard drive comes up as RAID | should be. | | I have only been ordering the machines in dual drive mirror 1 Raid, but | you could get a PowerEdge Tower servers like the 830 which do raid 5, I | never used one though. | Alternatively all the Dell SCSI RAID systems have 256megs cache which | use the LSI Logic MegaRAID ( man amr ) | Stay away from the ultra low end SC1425 systems they have some kind of | software based raid. | | The thing I have noticed is that if you compare other (often claiming to | be much cheaper) servers from other companies they often really skimp on | their hard drive subsystems with software based stuff claiming its RAID. | | I used to be anti Dell and build my own U1 servers from case and up and | had a keen interest in cheap RAID technologies but I gave up a little | while ago. | I believe Dell are great value when you consider their RAID | implementations and as long as you are happy with Intel chips. | | Mike | | Steven Hartland wrote: | | > Anyone got any SATA RAID 5 controllers they can recommend | > 64Bit PCIX. | > | > Steve Steve - 3ware is very good. Mike - I have some benchmarks from a guy using a Dell with a raid and was surprised to see how slow they were compared to our other hardware. I didn't run them myself, but the guy is on the list here some place. I can send you a copy of the spreadsheet if you want to look it over. Ray From owner-freebsd-performance@FreeBSD.ORG Wed Nov 2 10:36:51 2005 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 1DAFA16A41F for ; Wed, 2 Nov 2005 10:36:51 +0000 (GMT) (envelope-from markus.kovero@multiwise.fi) Received: from fep01-app.kolumbus.fi (fep01-0.kolumbus.fi [193.229.0.41]) by mx1.FreeBSD.org (Postfix) with ESMTP id 40A6C43D48 for ; Wed, 2 Nov 2005 10:36:49 +0000 (GMT) (envelope-from markus.kovero@multiwise.fi) Received: from [192.168.2.100] (really [84.230.130.250]) by fep01-app.kolumbus.fi with ESMTP id <20051102103646.NFCT515.fep01-app.kolumbus.fi@[192.168.2.100]> for ; Wed, 2 Nov 2005 12:36:46 +0200 Message-ID: <436896BD.6090405@multiwise.fi> Date: Wed, 02 Nov 2005 12:36:45 +0200 From: Markus Kovero User-Agent: Mozilla Thunderbird 1.0.2 (X11/20050731) X-Accept-Language: en-us, en MIME-Version: 1.0 To: freebsd-performance@freebsd.org References: <000801c5d434$579de280$b3db87d4@multiplay.co.uk> <000801c5d434$579de280$b3db87d4@multiplay.co.uk> <3.0.1.32.20051102022618.00a73dc0@pop.redshift.com> In-Reply-To: <3.0.1.32.20051102022618.00a73dc0@pop.redshift.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Subject: Re: SATA: RAID 5 controller recommendations X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 02 Nov 2005 10:36:51 -0000 Dell's CERC sata raid thingy works fast for me but when I turn SMP on read performance drops 50%+ (raid1,raid5,raid10 and single volumes). I don't know if its aac problem or what. In leenox it works very well though. Yours Markus Kovero ray@redshift.com wrote: >At 09:17 PM 11/2/2005 +1100, Michael VInce wrote: >| For SATA I have always been getting the Dell 750s (now 850s) which use >| the 'aac' >| Adaptec AdvancedRAID Controller driver, do 'man aac' for more details. >| Dell supply them with a 64meg cache and are hardware raid, I have always >| just installed FreeBSD on them and only 1 hard drive comes up as RAID >| should be. >| >| I have only been ordering the machines in dual drive mirror 1 Raid, but >| you could get a PowerEdge Tower servers like the 830 which do raid 5, I >| never used one though. >| Alternatively all the Dell SCSI RAID systems have 256megs cache which >| use the LSI Logic MegaRAID ( man amr ) >| Stay away from the ultra low end SC1425 systems they have some kind of >| software based raid. >| >| The thing I have noticed is that if you compare other (often claiming to >| be much cheaper) servers from other companies they often really skimp on >| their hard drive subsystems with software based stuff claiming its RAID. >| >| I used to be anti Dell and build my own U1 servers from case and up and >| had a keen interest in cheap RAID technologies but I gave up a little >| while ago. >| I believe Dell are great value when you consider their RAID >| implementations and as long as you are happy with Intel chips. >| >| Mike >| >| Steven Hartland wrote: >| >| > Anyone got any SATA RAID 5 controllers they can recommend >| > 64Bit PCIX. >| > >| > Steve > >Steve - 3ware is very good. > >Mike - I have some benchmarks from a guy using a Dell with a raid and was >surprised to see how slow they were compared to our other hardware. I didn't >run them myself, but the guy is on the list here some place. I can send you a >copy of the spreadsheet if you want to look it over. > >Ray > >_______________________________________________ >freebsd-performance@freebsd.org mailing list >http://lists.freebsd.org/mailman/listinfo/freebsd-performance >To unsubscribe, send any mail to "freebsd-performance-unsubscribe@freebsd.org" > > From owner-freebsd-performance@FreeBSD.ORG Wed Nov 2 10:47:52 2005 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 746F216A41F for ; Wed, 2 Nov 2005 10:47:52 +0000 (GMT) (envelope-from ap@bnc.net) Received: from bis.bonn.org (www.bis.bonn.org [217.110.117.102]) by mx1.FreeBSD.org (Postfix) with ESMTP id D9D2A43D46 for ; Wed, 2 Nov 2005 10:47:50 +0000 (GMT) (envelope-from ap@bnc.net) X-SpamCatcher-Score: 64 [XX] Received: from [194.39.192.125] (account bnc-mail@mailrelay.mailomat.net HELO bnc.net) by bis.bonn.org (CommuniGate Pro SMTP 4.2) with ESMTP-TLS id 1628569; Wed, 02 Nov 2005 11:47:46 +0100 Received: from [194.39.192.154] (account ap HELO [194.39.192.154]) by bnc.net (CommuniGate Pro SMTP 4.3.5) with ESMTPSA id 1340181; Wed, 02 Nov 2005 11:47:45 +0100 In-Reply-To: <4368921C.40305@roq.com> References: <000801c5d434$579de280$b3db87d4@multiplay.co.uk> <4368921C.40305@roq.com> Mime-Version: 1.0 (Apple Message framework v746.2) Content-Type: text/plain; charset=US-ASCII; delsp=yes; format=flowed Message-Id: Content-Transfer-Encoding: 7bit From: Achim Patzner Date: Wed, 2 Nov 2005 11:47:42 +0100 To: Michael VInce X-Mailer: Apple Mail (2.746.2) Cc: freebsd-performance@freebsd.org, Steven Hartland Subject: Re: SATA: RAID 5 controller recommendations X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 02 Nov 2005 10:47:52 -0000 > For SATA I have always been getting the Dell 750s (now 850s) which > use the 'aac' > Adaptec AdvancedRAID Controller driver, do 'man aac' for more details. Did you ever have to replace a failed drive? You might try it, just to see if you're still happy afterwards. Achim From owner-freebsd-performance@FreeBSD.ORG Wed Nov 2 12:29:59 2005 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id BC52216A41F for ; Wed, 2 Nov 2005 12:29:59 +0000 (GMT) (envelope-from mike@sentex.net) Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [64.7.153.18]) by mx1.FreeBSD.org (Postfix) with ESMTP id B612143D48 for ; Wed, 2 Nov 2005 12:29:57 +0000 (GMT) (envelope-from mike@sentex.net) Received: from pumice3.sentex.ca (pumice3.sentex.ca [64.7.153.26]) by smarthost1.sentex.ca (8.13.4/8.13.4) with ESMTP id jA2CTvsG000569 for ; Wed, 2 Nov 2005 07:29:57 -0500 (EST) (envelope-from mike@sentex.net) Received: from lava.sentex.ca (pyroxene.sentex.ca [199.212.134.18]) by pumice3.sentex.ca (8.13.4/8.13.4) with ESMTP id jA2CTuxa076811; Wed, 2 Nov 2005 07:29:56 -0500 (EST) (envelope-from mike@sentex.net) Received: from simian.sentex.net (simeon.sentex.ca [192.168.43.27]) by lava.sentex.ca (8.13.3/8.13.3) with ESMTP id jA2CTriM080302 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Wed, 2 Nov 2005 07:29:54 -0500 (EST) (envelope-from mike@sentex.net) Message-Id: <6.2.3.4.0.20051102072534.0668f150@64.7.153.2> X-Mailer: QUALCOMM Windows Eudora Version 6.2.3.4 Date: Wed, 02 Nov 2005 07:29:32 -0500 To: Achim Patzner , Michael VInce From: Mike Tancsa In-Reply-To: References: <000801c5d434$579de280$b3db87d4@multiplay.co.uk> <4368921C.40305@roq.com> Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii"; format=flowed X-Virus-Scanned: by amavisd-new X-Scanned-By: MIMEDefang 2.51 on 64.7.153.18 X-Scanned-By: MIMEDefang 2.53 on 64.7.153.26 Cc: freebsd-performance@freebsd.org, Steven Hartland Subject: Re: SATA: RAID 5 controller recommendations X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 02 Nov 2005 12:29:59 -0000 At 05:47 AM 02/11/2005, Achim Patzner wrote: >>For SATA I have always been getting the Dell 750s (now 850s) which >>use the 'aac' >>Adaptec AdvancedRAID Controller driver, do 'man aac' for more details. > >Did you ever have to replace a failed drive? You might try it, just >to see if you're still happy afterwards. Thats one thing I must say about 3ware that I really like. I have been using the cards for years now and have not had issues when it came to swapping out dead drives. I havent had the opportunity to do it with the ARECA yet in production to see how it works, only as a test. ---Mike From owner-freebsd-performance@FreeBSD.ORG Wed Nov 2 13:06:49 2005 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 15AED16A421 for ; Wed, 2 Nov 2005 13:06:49 +0000 (GMT) (envelope-from anderson@centtech.com) Received: from mh1.centtech.com (moat3.centtech.com [207.200.51.50]) by mx1.FreeBSD.org (Postfix) with ESMTP id 4A2B543D45 for ; Wed, 2 Nov 2005 13:06:44 +0000 (GMT) (envelope-from anderson@centtech.com) Received: from [10.177.171.220] (neutrino.centtech.com [10.177.171.220]) by mh1.centtech.com (8.13.1/8.13.1) with ESMTP id jA2D6h4e045527 for ; Wed, 2 Nov 2005 07:06:43 -0600 (CST) (envelope-from anderson@centtech.com) Message-ID: <4368B9E1.4020009@centtech.com> Date: Wed, 02 Nov 2005 07:06:41 -0600 From: Eric Anderson User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; en-US; rv:1.7.12) Gecko/20051021 X-Accept-Language: en-us, en MIME-Version: 1.0 To: freebsd-performance@freebsd.org References: <000801c5d434$579de280$b3db87d4@multiplay.co.uk> <4368921C.40305@roq.com> <6.2.3.4.0.20051102072534.0668f150@64.7.153.2> In-Reply-To: <6.2.3.4.0.20051102072534.0668f150@64.7.153.2> Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: ClamAV 0.82/1157/Wed Nov 2 04:04:16 2005 on mh1.centtech.com X-Virus-Status: Clean Subject: Re: SATA: RAID 5 controller recommendations X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 02 Nov 2005 13:06:49 -0000 Mike Tancsa wrote: > At 05:47 AM 02/11/2005, Achim Patzner wrote: > >>> For SATA I have always been getting the Dell 750s (now 850s) which >>> use the 'aac' >>> Adaptec AdvancedRAID Controller driver, do 'man aac' for more details. >> >> >> Did you ever have to replace a failed drive? You might try it, just >> to see if you're still happy afterwards. > > > Thats one thing I must say about 3ware that I really like. I have been > using the cards for years now and have not had issues when it came to > swapping out dead drives. I havent had the opportunity to do it with > the ARECA yet in production to see how it works, only as a test. Just as another note for those searching the archives, I buy nearly only Dell servers (1850's and 2850's these days), and I typically do RAID1 in them, and occasionally RAID5. They are plenty fast to support the RAID1 and RAID5 with the local disks, but any real high performance data storage I connect via Fibre channel array built as a 16 disk RAID0+1 (or RAID10 depending who you ask). Changing out dead drives (or even live ones) has never been an issue. Eric -- ------------------------------------------------------------------------ Eric Anderson Sr. Systems Administrator Centaur Technology Anything that works is better than anything that doesn't. ------------------------------------------------------------------------ From owner-freebsd-performance@FreeBSD.ORG Wed Nov 2 13:19:58 2005 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 080B616A41F for ; Wed, 2 Nov 2005 13:19:58 +0000 (GMT) (envelope-from ap@bnc.net) Received: from bis.bonn.org (www.bis.bonn.org [217.110.117.102]) by mx1.FreeBSD.org (Postfix) with ESMTP id A096443D58 for ; Wed, 2 Nov 2005 13:19:50 +0000 (GMT) (envelope-from ap@bnc.net) X-SpamCatcher-Score: 64 [XX] Received: from [194.39.192.125] (account bnc-mail@mailrelay.mailomat.net HELO bnc.net) by bis.bonn.org (CommuniGate Pro SMTP 4.2) with ESMTP-TLS id 1628881; Wed, 02 Nov 2005 14:19:47 +0100 Received: from [194.39.192.154] (account ap HELO [194.39.192.154]) by bnc.net (CommuniGate Pro SMTP 4.3.5) with ESMTPSA id 1340201; Wed, 02 Nov 2005 14:19:46 +0100 In-Reply-To: <6.2.3.4.0.20051102072534.0668f150@64.7.153.2> References: <000801c5d434$579de280$b3db87d4@multiplay.co.uk> <4368921C.40305@roq.com> <6.2.3.4.0.20051102072534.0668f150@64.7.153.2> Mime-Version: 1.0 (Apple Message framework v746.2) Content-Type: text/plain; charset=US-ASCII; delsp=yes; format=flowed Message-Id: Content-Transfer-Encoding: 7bit From: Achim Patzner Date: Wed, 2 Nov 2005 14:19:41 +0100 To: Mike Tancsa X-Mailer: Apple Mail (2.746.2) Cc: FreeBSD Performance Subject: Re: SATA: RAID 5 controller recommendations X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 02 Nov 2005 13:19:58 -0000 Am 02.11.2005 um 13:29 schrieb Mike Tancsa: > At 05:47 AM 02/11/2005, Achim Patzner wrote: >>> For SATA I have always been getting the Dell 750s (now 850s) which >>> use the 'aac' >>> Adaptec AdvancedRAID Controller driver, do 'man aac' for more >>> details. >> >> Did you ever have to replace a failed drive? You might try it, just >> to see if you're still happy afterwards. > > Thats one thing I must say about 3ware that I really like. I have > been using the cards for years now and have not had issues when it > came to swapping out dead drives. Right on target. For a long time I preferred the 3ware controllers over Mylex, Adaptec and LSI-based products even though they were dead slow in comparison. Mylex tended to destroy RAID sets if one made a mistake exchanging dead disks, LSI controllers often forgot their configuration and only repaired sets if the replacement was made by adding a new spare to the controller (having a different SCSI id than the disk that was broken) and activating it and Adaptec... don't make me cry. Most of our customers replaced all controllers by ICP GDT controllers; Adaptec having bought them and _of course_ replacing them by an inferior (yes, I tried the ARC series) product got me a bit afraid - I don't care for the price of the equipment but I need safe mechanisms. Achim From owner-freebsd-performance@FreeBSD.ORG Wed Nov 2 13:30:16 2005 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id BCEED16A41F for ; Wed, 2 Nov 2005 13:30:16 +0000 (GMT) (envelope-from ray@redshift.com) Received: from outgoing.redshift.com (outgoing.redshift.com [207.177.231.8]) by mx1.FreeBSD.org (Postfix) with ESMTP id 3243C43D48 for ; Wed, 2 Nov 2005 13:30:16 +0000 (GMT) (envelope-from ray@redshift.com) Received: from workstation (216-228-19-21.dsl.redshift.com [216.228.19.21]) by outgoing.redshift.com (Postfix) with SMTP id 3139197F1B; Wed, 2 Nov 2005 05:30:15 -0800 (PST) Message-Id: <3.0.1.32.20051102053015.00a73dc0@pop.redshift.com> X-Mailer: na X-Sender: redshift.com Date: Wed, 02 Nov 2005 05:30:15 -0800 To: Mike Tancsa ,Achim Patzner , Michael VInce From: ray@redshift.com In-Reply-To: <6.2.3.4.0.20051102072534.0668f150@64.7.153.2> References: <000801c5d434$579de280$b3db87d4@multiplay.co.uk> <4368921C.40305@roq.com> Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Cc: freebsd-performance@freebsd.org, Steven Hartland Subject: Re: SATA: RAID 5 controller recommendations X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 02 Nov 2005 13:30:16 -0000 At 07:29 AM 11/2/2005 -0500, Mike Tancsa wrote: | At 05:47 AM 02/11/2005, Achim Patzner wrote: | >>For SATA I have always been getting the Dell 750s (now 850s) which | >>use the 'aac' | >>Adaptec AdvancedRAID Controller driver, do 'man aac' for more details. | > | >Did you ever have to replace a failed drive? You might try it, just | >to see if you're still happy afterwards. | | Thats one thing I must say about 3ware that I really like. I have | been using the cards for years now and have not had issues when it | came to swapping out dead drives. I havent had the opportunity to | do it with the ARECA yet in production to see how it works, only as a test. | | ---Mike Mike, Here is a link to the mysql benchmarks I was talking about. If you can run them using the 3ware raid and the other raid, I would be interested to see what sort of results you get. Feel free to contact me if you have any questions. http://www.redshift.com/~ray/mysql_bench These are my personal benchmarks I use here, but I added a file to try to walk you through stuff and in case you want to share them with anyone else, etc. If you have any questions, please feel free to e-mail me. Take care! Ray From owner-freebsd-performance@FreeBSD.ORG Thu Nov 3 02:13:24 2005 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 77E2116A41F for ; Thu, 3 Nov 2005 02:13:24 +0000 (GMT) (envelope-from mv@roq.com) Received: from p4.roq.com (ns1.ecoms.com [207.44.130.137]) by mx1.FreeBSD.org (Postfix) with ESMTP id 253EB43D45 for ; Thu, 3 Nov 2005 02:13:24 +0000 (GMT) (envelope-from mv@roq.com) Received: from p4.roq.com (localhost.roq.com [127.0.0.1]) by p4.roq.com (Postfix) with ESMTP id 686A74CF5C; Thu, 3 Nov 2005 02:13:48 +0000 (GMT) Received: from [192.168.46.52] (ppp166-27.static.internode.on.net [150.101.166.27]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by p4.roq.com (Postfix) with ESMTP id 7D7B44CED8; Thu, 3 Nov 2005 02:13:47 +0000 (GMT) Message-ID: <4369723C.1060006@roq.com> Date: Thu, 03 Nov 2005 13:13:16 +1100 From: Michael VInce User-Agent: Mozilla/5.0 (X11; U; FreeBSD amd64; en-US; rv:1.7.12) Gecko/20051019 X-Accept-Language: en-us, en MIME-Version: 1.0 To: ray@redshift.com References: <000801c5d434$579de280$b3db87d4@multiplay.co.uk> <4368921C.40305@roq.com> <3.0.1.32.20051102053015.00a73dc0@pop.redshift.com> In-Reply-To: <3.0.1.32.20051102053015.00a73dc0@pop.redshift.com> Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: ClamAV using ClamSMTP Cc: freebsd-performance@freebsd.org Subject: Re: SATA: RAID 5 controller recommendations X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 03 Nov 2005 02:13:24 -0000 ray@redshift.com wrote: >At 07:29 AM 11/2/2005 -0500, Mike Tancsa wrote: >| At 05:47 AM 02/11/2005, Achim Patzner wrote: >| >>For SATA I have always been getting the Dell 750s (now 850s) which >| >>use the 'aac' >| >>Adaptec AdvancedRAID Controller driver, do 'man aac' for more details. >| > >| >Did you ever have to replace a failed drive? You might try it, just >| >to see if you're still happy afterwards. >| >| Thats one thing I must say about 3ware that I really like. I have >| been using the cards for years now and have not had issues when it >| came to swapping out dead drives. I havent had the opportunity to >| do it with the ARECA yet in production to see how it works, only as a test. >| >| ---Mike > >Mike, > > Here is a link to the mysql benchmarks I was talking about. If you can run >them using the 3ware raid and the other raid, I would be interested to see what >sort of results you get. Feel free to contact me if you have any questions. > >http://www.redshift.com/~ray/mysql_bench > > These are my personal benchmarks I use here, but I added a file to try to walk >you through stuff and in case you want to share them with anyone else, etc. If >you have any questions, please feel free to e-mail me. > >Take care! > >Ray > > > I would like to give it a shot but don't really have time at the moment. I might do it sometime in the future though. Thanks anyway. Mike From owner-freebsd-performance@FreeBSD.ORG Thu Nov 3 02:16:09 2005 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 8C12E16A41F for ; Thu, 3 Nov 2005 02:16:09 +0000 (GMT) (envelope-from mv@roq.com) Received: from p4.roq.com (ns1.ecoms.com [207.44.130.137]) by mx1.FreeBSD.org (Postfix) with ESMTP id E468A43D49 for ; Thu, 3 Nov 2005 02:16:08 +0000 (GMT) (envelope-from mv@roq.com) Received: from p4.roq.com (localhost.roq.com [127.0.0.1]) by p4.roq.com (Postfix) with ESMTP id 5AB674D058; Thu, 3 Nov 2005 02:16:33 +0000 (GMT) Received: from [192.168.46.52] (ppp166-27.static.internode.on.net [150.101.166.27]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by p4.roq.com (Postfix) with ESMTP id DBB3D4D093; Thu, 3 Nov 2005 02:16:30 +0000 (GMT) Message-ID: <436972DE.8070002@roq.com> Date: Thu, 03 Nov 2005 13:15:58 +1100 From: Michael VInce User-Agent: Mozilla/5.0 (X11; U; FreeBSD amd64; en-US; rv:1.7.12) Gecko/20051019 X-Accept-Language: en-us, en MIME-Version: 1.0 To: Markus Kovero References: <000801c5d434$579de280$b3db87d4@multiplay.co.uk> <000801c5d434$579de280$b3db87d4@multiplay.co.uk> <3.0.1.32.20051102022618.00a73dc0@pop.redshift.com> <436896BD.6090405@multiwise.fi> In-Reply-To: <436896BD.6090405@multiwise.fi> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: ClamAV using ClamSMTP Cc: freebsd-performance@freebsd.org Subject: Re: SATA: RAID 5 controller recommendations X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 03 Nov 2005 02:16:09 -0000 I have seen some network based SMP related performance problems vanish in 6.0 tests, admittedly I haven't done hard drive based tests but I wouldn't surprise me of performance drops on HDs in SMP on 6.0 are gone as well. Mike Markus Kovero wrote: > Dell's CERC sata raid thingy works fast for me but when I turn SMP on > read performance drops 50%+ (raid1,raid5,raid10 and single volumes). > I don't know if its aac problem or what. > In leenox it works very well though. > > Yours > Markus Kovero > > ray@redshift.com wrote: > >> At 09:17 PM 11/2/2005 +1100, Michael VInce wrote: >> | For SATA I have always been getting the Dell 750s (now 850s) which >> use | the 'aac' >> | Adaptec AdvancedRAID Controller driver, do 'man aac' for more details. >> | Dell supply them with a 64meg cache and are hardware raid, I have >> always | just installed FreeBSD on them and only 1 hard drive comes >> up as RAID | should be. >> | | I have only been ordering the machines in dual drive mirror 1 >> Raid, but | you could get a PowerEdge Tower servers like the 830 >> which do raid 5, I | never used one though. >> | Alternatively all the Dell SCSI RAID systems have 256megs cache >> which | use the LSI Logic MegaRAID ( man amr ) >> | Stay away from the ultra low end SC1425 systems they have some kind >> of | software based raid. >> | | The thing I have noticed is that if you compare other (often >> claiming to | be much cheaper) servers from other companies they >> often really skimp on | their hard drive subsystems with software >> based stuff claiming its RAID. >> | | I used to be anti Dell and build my own U1 servers from case and >> up and | had a keen interest in cheap RAID technologies but I gave up >> a little | while ago. >> | I believe Dell are great value when you consider their RAID | >> implementations and as long as you are happy with Intel chips. >> | | Mike >> | | Steven Hartland wrote: >> | | > Anyone got any SATA RAID 5 controllers they can recommend >> | > 64Bit PCIX. >> | > >> | > Steve >> >> Steve - 3ware is very good. >> >> Mike - I have some benchmarks from a guy using a Dell with a raid and >> was >> surprised to see how slow they were compared to our other hardware. >> I didn't >> run them myself, but the guy is on the list here some place. I can >> send you a >> copy of the spreadsheet if you want to look it over. >> >> Ray >> >> _______________________________________________ >> freebsd-performance@freebsd.org mailing list >> http://lists.freebsd.org/mailman/listinfo/freebsd-performance >> To unsubscribe, send any mail to >> "freebsd-performance-unsubscribe@freebsd.org" >> >> > From owner-freebsd-performance@FreeBSD.ORG Thu Nov 3 03:34:02 2005 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 06E6216A41F for ; Thu, 3 Nov 2005 03:34:02 +0000 (GMT) (envelope-from mike@sentex.net) Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [64.7.153.18]) by mx1.FreeBSD.org (Postfix) with ESMTP id 8ABBF43D45 for ; Thu, 3 Nov 2005 03:34:01 +0000 (GMT) (envelope-from mike@sentex.net) Received: from pumice6.sentex.ca (pumice6.sentex.ca [64.7.153.21]) by smarthost1.sentex.ca (8.13.4/8.13.4) with ESMTP id jA33Y0pX013202 for ; Wed, 2 Nov 2005 22:34:00 -0500 (EST) (envelope-from mike@sentex.net) Received: from lava.sentex.ca (pyroxene.sentex.ca [199.212.134.18]) by pumice6.sentex.ca (8.13.4/8.13.3) with ESMTP id jA33Y0YZ017798; Wed, 2 Nov 2005 22:34:00 -0500 (EST) (envelope-from mike@sentex.net) Received: from simian.sentex.net (simeon.sentex.ca [192.168.43.27]) by lava.sentex.ca (8.13.3/8.13.3) with ESMTP id jA33XwvZ083462 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Wed, 2 Nov 2005 22:33:59 -0500 (EST) (envelope-from mike@sentex.net) Message-Id: <6.2.3.4.0.20051102222452.0564eda0@64.7.153.2> X-Mailer: QUALCOMM Windows Eudora Version 6.2.3.4 Date: Wed, 02 Nov 2005 22:33:24 -0500 To: Michael VInce From: Mike Tancsa In-Reply-To: <436972DE.8070002@roq.com> References: <000801c5d434$579de280$b3db87d4@multiplay.co.uk> <000801c5d434$579de280$b3db87d4@multiplay.co.uk> <3.0.1.32.20051102022618.00a73dc0@pop.redshift.com> <436896BD.6090405@multiwise.fi> <436972DE.8070002@roq.com> Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii"; format=flowed X-Virus-Scanned: by amavisd-new X-Scanned-By: MIMEDefang 2.51 on 64.7.153.18 X-Scanned-By: MIMEDefang 2.53 on 64.7.153.21 Cc: freebsd-performance@freebsd.org Subject: Re: SATA: RAID 5 controller recommendations X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 03 Nov 2005 03:34:02 -0000 At 09:15 PM 02/11/2005, Michael VInce wrote: >I have seen some network based SMP related performance problems >vanish in 6.0 tests, admittedly I haven't done hard drive based >tests but I wouldn't surprise me of performance drops on HDs in SMP >on 6.0 are gone as well. Yes, I noticed that well. Unfortunately I seem to have a bad drive as well so I will have to try swapping it tomorrow. Although it might just be a cable / connector issue as smartmontools doesnt see anything on the drive. da0: Fixed Direct Access SCSI-3 device da0: 100.000MB/s transfers da0: 343290MB (703057920 512 byte sectors: 255H 63S/T 43763C) twa0: ERROR: (0x04: 0x0009): Drive timeout detected: port=0 twa0: ERROR: (0x04: 0x0009): Drive timeout detected: port=0 twa0: ERROR: (0x04: 0x0009): Drive timeout detected: port=0 twa0: ERROR: (0x04: 0x0009): Drive timeout detected: port=0 twa0: ERROR: (0x04: 0x0009): Drive timeout detected: port=0 twa0: ERROR: (0x04: 0x0009): Drive timeout detected: port=0 twa0: ERROR: (0x04: 0x0009): Drive timeout detected: port=0 twa0: ERROR: (0x04: 0x0009): Drive timeout detected: port=0 twa0: ERROR: (0x04: 0x0009): Drive timeout detected: port=0 twa0: ERROR: (0x04: 0x0009): Drive timeout detected: port=0 twa0: ERROR: (0x04: 0x0009): Drive timeout detected: port=0 twa0: ERROR: (0x04: 0x0009): Drive timeout detected: port=0 twa0: ERROR: (0x04: 0x0009): Drive timeout detected: port=0 twa0: ERROR: (0x04: 0x0009): Drive timeout detected: port=0 twa0: ERROR: (0x04: 0x0009): Drive timeout detected: port=0 twa0: ERROR: (0x04: 0x0002): Degraded unit: unit=0, port=0 >Mike > > >Markus Kovero wrote: > >>Dell's CERC sata raid thingy works fast for me but when I turn SMP >>on read performance drops 50%+ (raid1,raid5,raid10 and single volumes). >>I don't know if its aac problem or what. >>In leenox it works very well though. >> >>Yours >>Markus Kovero >> >>ray@redshift.com wrote: >> >>>At 09:17 PM 11/2/2005 +1100, Michael VInce wrote: >>>| For SATA I have always been getting the Dell 750s (now 850s) >>>which use | the 'aac' >>>| Adaptec AdvancedRAID Controller driver, do 'man aac' for more details. >>>| Dell supply them with a 64meg cache and are hardware raid, I >>>have always | just installed FreeBSD on them and only 1 hard drive >>>comes up as RAID | should be. >>>| | I have only been ordering the machines in dual drive mirror 1 >>>Raid, but | you could get a PowerEdge Tower servers like the 830 >>>which do raid 5, I | never used one though. >>>| Alternatively all the Dell SCSI RAID systems have 256megs cache >>>which | use the LSI Logic MegaRAID ( man amr ) >>>| Stay away from the ultra low end SC1425 systems they have some >>>kind of | software based raid. >>>| | The thing I have noticed is that if you compare other (often >>>claiming to | be much cheaper) servers from other companies they >>>often really skimp on | their hard drive subsystems with software >>>based stuff claiming its RAID. >>>| | I used to be anti Dell and build my own U1 servers from case >>>and up and | had a keen interest in cheap RAID technologies but I >>>gave up a little | while ago. >>>| I believe Dell are great value when you consider their RAID | >>>implementations and as long as you are happy with Intel chips. >>>| | Mike >>>| | Steven Hartland wrote: >>>| | > Anyone got any SATA RAID 5 controllers they can recommend >>>| > 64Bit PCIX. >>>| > >>>| > Steve >>> >>>Steve - 3ware is very good. >>> >>>Mike - I have some benchmarks from a guy using a Dell with a raid and was >>>surprised to see how slow they were compared to our other hardware. >>>I didn't >>>run them myself, but the guy is on the list here some place. I >>>can send you a >>>copy of the spreadsheet if you want to look it over. >>> >>>Ray >>> >>>_______________________________________________ >>>freebsd-performance@freebsd.org mailing list >>>http://lists.freebsd.org/mailman/listinfo/freebsd-performance >>>To unsubscribe, send any mail to >>>"freebsd-performance-unsubscribe@freebsd.org" >>> >_______________________________________________ >freebsd-performance@freebsd.org mailing list >http://lists.freebsd.org/mailman/listinfo/freebsd-performance >To unsubscribe, send any mail to "freebsd-performance-unsubscribe@freebsd.org" From owner-freebsd-performance@FreeBSD.ORG Thu Nov 3 19:42:49 2005 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id A817916A41F for ; Thu, 3 Nov 2005 19:42:49 +0000 (GMT) (envelope-from markus.kovero@multiwise.fi) Received: from fep30-app.kolumbus.fi (fep30-0.kolumbus.fi [193.229.0.32]) by mx1.FreeBSD.org (Postfix) with ESMTP id F2BA243D53 for ; Thu, 3 Nov 2005 19:42:48 +0000 (GMT) (envelope-from markus.kovero@multiwise.fi) Received: from [192.168.2.100] (really [84.230.130.250]) by fep30-app.kolumbus.fi with ESMTP id <20051103194246.JAVM15053.fep30-app.kolumbus.fi@[192.168.2.100]>; Thu, 3 Nov 2005 21:42:46 +0200 Message-ID: <436A6832.9040708@multiwise.fi> Date: Thu, 03 Nov 2005 21:42:42 +0200 From: Markus Kovero User-Agent: Mozilla Thunderbird 1.0.2 (X11/20050731) X-Accept-Language: en-us, en MIME-Version: 1.0 To: Mike Tancsa , freebsd-performance@freebsd.org References: <000801c5d434$579de280$b3db87d4@multiplay.co.uk> <000801c5d434$579de280$b3db87d4@multiplay.co.uk> <3.0.1.32.20051102022618.00a73dc0@pop.redshift.com> <436896BD.6090405@multiwise.fi> <436972DE.8070002@roq.com> <6.2.3.4.0.20051102222452.0564eda0@64.7.153.2> In-Reply-To: <6.2.3.4.0.20051102222452.0564eda0@64.7.153.2> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: Subject: Re: SATA: RAID 5 controller recommendations X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 03 Nov 2005 19:42:49 -0000 Actually, read performance drop is still there under FreeBSD 6.0 RC1 Yours Markus Kovero Mike Tancsa wrote: > At 09:15 PM 02/11/2005, Michael VInce wrote: > >> I have seen some network based SMP related performance problems >> vanish in 6.0 tests, admittedly I haven't done hard drive based tests >> but I wouldn't surprise me of performance drops on HDs in SMP on 6.0 >> are gone as well. > > > Yes, I noticed that well. Unfortunately I seem to have a bad drive as > well so I will have to try swapping it tomorrow. Although it might > just be a cable / connector issue as smartmontools doesnt see anything > on the drive. > > da0: Fixed Direct Access SCSI-3 device > da0: 100.000MB/s transfers > da0: 343290MB (703057920 512 byte sectors: 255H 63S/T 43763C) > twa0: ERROR: (0x04: 0x0009): Drive timeout detected: port=0 > twa0: ERROR: (0x04: 0x0009): Drive timeout detected: port=0 > twa0: ERROR: (0x04: 0x0009): Drive timeout detected: port=0 > twa0: ERROR: (0x04: 0x0009): Drive timeout detected: port=0 > twa0: ERROR: (0x04: 0x0009): Drive timeout detected: port=0 > twa0: ERROR: (0x04: 0x0009): Drive timeout detected: port=0 > twa0: ERROR: (0x04: 0x0009): Drive timeout detected: port=0 > twa0: ERROR: (0x04: 0x0009): Drive timeout detected: port=0 > twa0: ERROR: (0x04: 0x0009): Drive timeout detected: port=0 > twa0: ERROR: (0x04: 0x0009): Drive timeout detected: port=0 > twa0: ERROR: (0x04: 0x0009): Drive timeout detected: port=0 > twa0: ERROR: (0x04: 0x0009): Drive timeout detected: port=0 > twa0: ERROR: (0x04: 0x0009): Drive timeout detected: port=0 > twa0: ERROR: (0x04: 0x0009): Drive timeout detected: port=0 > twa0: ERROR: (0x04: 0x0009): Drive timeout detected: port=0 > twa0: ERROR: (0x04: 0x0002): Degraded unit: unit=0, port=0 > > >> Mike >> >> >> Markus Kovero wrote: >> >>> Dell's CERC sata raid thingy works fast for me but when I turn SMP >>> on read performance drops 50%+ (raid1,raid5,raid10 and single >>> volumes). >>> I don't know if its aac problem or what. >>> In leenox it works very well though. >>> >>> Yours >>> Markus Kovero >>> >>> ray@redshift.com wrote: >>> >>>> At 09:17 PM 11/2/2005 +1100, Michael VInce wrote: >>>> | For SATA I have always been getting the Dell 750s (now 850s) >>>> which use | the 'aac' >>>> | Adaptec AdvancedRAID Controller driver, do 'man aac' for more >>>> details. >>>> | Dell supply them with a 64meg cache and are hardware raid, I have >>>> always | just installed FreeBSD on them and only 1 hard drive comes >>>> up as RAID | should be. >>>> | | I have only been ordering the machines in dual drive mirror 1 >>>> Raid, but | you could get a PowerEdge Tower servers like the 830 >>>> which do raid 5, I | never used one though. >>>> | Alternatively all the Dell SCSI RAID systems have 256megs cache >>>> which | use the LSI Logic MegaRAID ( man amr ) >>>> | Stay away from the ultra low end SC1425 systems they have some >>>> kind of | software based raid. >>>> | | The thing I have noticed is that if you compare other (often >>>> claiming to | be much cheaper) servers from other companies they >>>> often really skimp on | their hard drive subsystems with software >>>> based stuff claiming its RAID. >>>> | | I used to be anti Dell and build my own U1 servers from case >>>> and up and | had a keen interest in cheap RAID technologies but I >>>> gave up a little | while ago. >>>> | I believe Dell are great value when you consider their RAID | >>>> implementations and as long as you are happy with Intel chips. >>>> | | Mike >>>> | | Steven Hartland wrote: >>>> | | > Anyone got any SATA RAID 5 controllers they can recommend >>>> | > 64Bit PCIX. >>>> | > >>>> | > Steve >>>> >>>> Steve - 3ware is very good. >>>> >>>> Mike - I have some benchmarks from a guy using a Dell with a raid >>>> and was >>>> surprised to see how slow they were compared to our other hardware. >>>> I didn't >>>> run them myself, but the guy is on the list here some place. I can >>>> send you a >>>> copy of the spreadsheet if you want to look it over. >>>> >>>> Ray >>>> >>>> _______________________________________________ >>>> freebsd-performance@freebsd.org mailing list >>>> http://lists.freebsd.org/mailman/listinfo/freebsd-performance >>>> To unsubscribe, send any mail to >>>> "freebsd-performance-unsubscribe@freebsd.org" >>>> >> _______________________________________________ >> freebsd-performance@freebsd.org mailing list >> http://lists.freebsd.org/mailman/listinfo/freebsd-performance >> To unsubscribe, send any mail to >> "freebsd-performance-unsubscribe@freebsd.org" > > > _______________________________________________ > freebsd-performance@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-performance > To unsubscribe, send any mail to > "freebsd-performance-unsubscribe@freebsd.org" From owner-freebsd-performance@FreeBSD.ORG Fri Nov 4 03:13:14 2005 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 0DC8316A41F for ; Fri, 4 Nov 2005 03:13:14 +0000 (GMT) (envelope-from drechsau@geeks.org) Received: from mail.geeks.org (jacobs.geeks.org [204.153.247.1]) by mx1.FreeBSD.org (Postfix) with ESMTP id B8B3043D45 for ; Fri, 4 Nov 2005 03:13:13 +0000 (GMT) (envelope-from drechsau@geeks.org) Received: from [216.250.176.99] (gold.staff.iphouse.net [216.250.176.99]) (using TLSv1 with cipher RC4-SHA (128/128 bits)) (No client certificate requested) by mail.geeks.org (Postfix) with ESMTP id E23A31591FF; Thu, 3 Nov 2005 21:13:11 -0600 (CST) In-Reply-To: References: <000801c5d434$579de280$b3db87d4@multiplay.co.uk> <4368921C.40305@roq.com> Mime-Version: 1.0 (Apple Message framework v746.2) Content-Type: text/plain; charset=US-ASCII; delsp=yes; format=flowed Message-Id: <6BBC8E0F-35CD-4E43-A470-B71BFD84BEBB@geeks.org> Content-Transfer-Encoding: 7bit From: Mike Horwath Date: Thu, 3 Nov 2005 21:13:11 -0600 To: Achim Patzner X-Mailer: Apple Mail (2.746.2) Cc: Michael VInce , freebsd-performance@freebsd.org, Steven Hartland Subject: Re: SATA: RAID 5 controller recommendations X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Nov 2005 03:13:14 -0000 On Nov 2, 2005, at 4:47 AM, Achim Patzner wrote: >> For SATA I have always been getting the Dell 750s (now 850s) which >> use the 'aac' >> Adaptec AdvancedRAID Controller driver, do 'man aac' for more >> details. > > Did you ever have to replace a failed drive? You might try it, just > to see if you're still happy afterwards. I have many times on the perc3 and perc4 ones (adaptec and lsi) and it works. Did you have something to add or just making an offhanded comment without anything to add? -- Mike Horwath, reachable via drechsau@Geeks.ORG From owner-freebsd-performance@FreeBSD.ORG Sat Nov 5 12:57:56 2005 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 35B3716A41F for ; Sat, 5 Nov 2005 12:57:56 +0000 (GMT) (envelope-from joao.barros@gmail.com) Received: from xproxy.gmail.com (xproxy.gmail.com [66.249.82.193]) by mx1.FreeBSD.org (Postfix) with ESMTP id 6F95343D55 for ; Sat, 5 Nov 2005 12:57:52 +0000 (GMT) (envelope-from joao.barros@gmail.com) Received: by xproxy.gmail.com with SMTP id t14so86524wxc for ; Sat, 05 Nov 2005 04:57:51 -0800 (PST) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:to:subject:mime-version:content-type:content-transfer-encoding:content-disposition; b=kFnQ9Nly3wV3dLaR9To2c4NTvfovOlS5WpD+wq4C49MhLete2gfVeDMN0gceLdOWhIzHZb506rc3BsfRtPiJrboEnSJhh4V3rwrMbVmsg5yz1i8SgKeLDnACiWzYxD460BX7swLgThqEvBKcXYN6W0g570iFkZitFU0hbrvUrcQ= Received: by 10.70.24.17 with SMTP id 17mr3040998wxx; Sat, 05 Nov 2005 04:57:51 -0800 (PST) Received: by 10.70.9.10 with HTTP; Sat, 5 Nov 2005 04:57:51 -0800 (PST) Message-ID: <70e8236f0511050457s5ce6d8batf805fbc9edd91360@mail.gmail.com> Date: Sat, 5 Nov 2005 12:57:51 +0000 From: Joao Barros To: freebsd-performance@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Content-Disposition: inline Subject: Poor Samba throughput on 6.0 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 05 Nov 2005 12:57:56 -0000 Hi, Last month I started a thread[1] on current@ about this, but I guess I should have done it here, my apologies for that. After my initial post I did some more testing and I'm going to start clean here with all my findings :) I started with Samba 3 installed on a PIII 733MHz with fxp (82559) and a RAID5 consisting of 4 drives connected to an amr. Performance reading or writing was poor, around 5.5MB/s measured on two Windows clients and iostat never topped that by much. cpu was mbufs were available and there were no IRQs shared. To dismiss the amr out of the question I tried with a local IDE attached yielding the same results. I then tested the same on a machine I have at work, an HP Proliant server, Pentium 4 3.06GHz, used SMP instead of GENERIC to use HTT. I could get 8MB/s with 2 read or write simultaneous operations. With 1 operation I still can only get 6MB/s This machine has 1GB ram and after copying a 700MB file to it it was all ca= ched. A copy to dev/null took 1 second. A copy via samba took the same time as if there was no cache for it. iostat always showed 0.0 during the operation so that pretty much takes disks, controllers, IO out of the picture. Both machines have cpu, IO and mbufs to spare and they still can't use them. Why? [1] http://lists.freebsd.org/pipermail/freebsd-current/2005-October/057116.= html -- Joao Barros