From owner-freebsd-database Thu Mar 28 16:10: 0 2002 Delivered-To: freebsd-database@freebsd.org Received: from mrout1.yahoo.com (mrout1.yahoo.com [216.145.54.171]) by hub.freebsd.org (Postfix) with ESMTP id 4E7E337B417 for ; Thu, 28 Mar 2002 16:09:59 -0800 (PST) Received: from yahoo-inc.com (scrappy.corp.yahoo.com [207.126.232.28]) by mrout1.yahoo.com (8.11.6/8.11.6/y.out) with ESMTP id g2T09kA81771 for ; Thu, 28 Mar 2002 16:09:46 -0800 (PST) Message-ID: <3CA3B060.6CB405EC@yahoo-inc.com> Date: Thu, 28 Mar 2002 16:08:00 -0800 From: Cheen Qian X-Mailer: Mozilla 4.73 [en] (X11; I; FreeBSD 4.3-YAHOO-20020310 i386) X-Accept-Language: en MIME-Version: 1.0 To: freebsd-database@FreeBSD.ORG Subject: please subscribe me. Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Sender: owner-freebsd-database@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.ORG thanks. To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-database" in the body of the message From owner-freebsd-database Fri Mar 29 8:24:32 2002 Delivered-To: freebsd-database@freebsd.org Received: from mail1.acecape.com (mail.acedsl.com [66.114.74.12]) by hub.freebsd.org (Postfix) with ESMTP id 3C04E37B416 for ; Fri, 29 Mar 2002 08:24:29 -0800 (PST) Received: from p65-147.acedsl.com (p65-147.acedsl.com [66.114.65.147]) by mail1.acecape.com (8.12.2/8.12.2) with ESMTP id g2TGOS14005803 for ; Fri, 29 Mar 2002 11:24:28 -0500 Date: Fri, 29 Mar 2002 11:33:16 -0500 (EST) From: Francisco Reyes X-X-Sender: fran@zoraida.natserv.net To: FreeBSD DB List Subject: Raid configuration Message-ID: <20020329113017.L51218-100000@zoraida.natserv.net> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Sender: owner-freebsd-database@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.ORG Anyone has any experience with FreeBSD + RAID + SQL database? In particular I am using PostgreSQL I am leaning towards RAID 10 with 4 disks Given that PostgreSQL doesn't support table-spaces yet I would have the first two mirrored disk for the database and the other two for the logs. To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-database" in the body of the message From owner-freebsd-database Fri Mar 29 16:23:42 2002 Delivered-To: freebsd-database@freebsd.org Received: from ws2.hk5.outblaze.com (202-77-181-84.outblaze.com [202.77.181.84]) by hub.freebsd.org (Postfix) with SMTP id D3D0037B41B for ; Fri, 29 Mar 2002 16:23:34 -0800 (PST) Received: (qmail 24234 invoked by uid 1001); 30 Mar 2002 00:23:33 -0000 Message-ID: <20020330002333.24233.qmail@graffiti.net> Content-Type: text/plain; charset="iso-8859-1" Content-Disposition: inline Content-Transfer-Encoding: 7bit Mime-Version: 1.0 X-Mailer: MIME-tools 4.104 (Entity 4.117) Received: from [66.51.217.108] by ws2.hk5.outblaze.com with http for tedstriker@graffiti.net; Sat, 30 Mar 2002 08:23:32 +0800 From: "Ted Striker" To: , Date: Sat, 30 Mar 2002 08:23:32 +0800 Subject: Re: Raid configuration X-Originating-Ip: 66.51.217.108 X-Originating-Server: ws2.hk5.outblaze.com Sender: owner-freebsd-database@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.ORG We are using RAID10 on Postgres. Also a 4 disk configuration. Since our RAID goes through only one card, it sees the whole RAID10 as one disk. ----- Original Message ----- From: Francisco Reyes Date: Fri, 29 Mar 2002 11:33:16 -0500 (EST) To: FreeBSD DB List Subject: Raid configuration > Anyone has any experience with FreeBSD + RAID + SQL database? > In particular I am using PostgreSQL > > I am leaning towards RAID 10 with 4 disks > Given that PostgreSQL doesn't support table-spaces yet I would have the > first two mirrored disk for the database and the other two for the logs. > > > > To Unsubscribe: send mail to majordomo@FreeBSD.org > with "unsubscribe freebsd-database" in the body of the message > -- _______________________________________________ Get your free email from http://www.graffiti.net Powered by Outblaze To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-database" in the body of the message From owner-freebsd-database Fri Mar 29 17:54:56 2002 Delivered-To: freebsd-database@freebsd.org Received: from mail1.acecape.com (mail.acedsl.com [66.114.74.12]) by hub.freebsd.org (Postfix) with ESMTP id A483C37B405 for ; Fri, 29 Mar 2002 17:54:53 -0800 (PST) Received: from p65-147.acedsl.com (p65-147.acedsl.com [66.114.65.147]) by mail1.acecape.com (8.12.2/8.12.2) with ESMTP id g2U1sq14025155; Fri, 29 Mar 2002 20:54:52 -0500 Date: Fri, 29 Mar 2002 21:03:43 -0500 (EST) From: Francisco Reyes X-X-Sender: fran@zoraida.natserv.net To: Ted Striker Cc: FreeBSD DB List Subject: Re: Raid configuration In-Reply-To: <20020330002333.24233.qmail@graffiti.net> Message-ID: <20020329205657.M52321-100000@zoraida.natserv.net> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Sender: owner-freebsd-database@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.ORG On Sat, 30 Mar 2002, Ted Striker wrote: > We are using RAID10 on Postgres. Also a 4 disk configuration. > > Since our RAID goes through only one card, it sees the whole RAID10 > as one disk. How has the raid helped? Did you do any before/after tests? Care to share specs. Our current setup is a desktop with 1GB ram, Petium III 1.3Ghz CPU. IDE disk for OS and 2 SCSI 10K rpm drives. First SCSI is database and second logs. Currently there is the possibility that I may get $$ for a serious server and I am wondering what to get. From what I have read so far FreeBSD with multiple CPUs does not play nice with PostgreSQL, so that leaves out SMP. I am thinking 4GB ram and 4 15K rpm drives on raid 10. I guess I could do the same thing you did and make them all one volume. On the current machine I rarely ever have more than 2 or 3 connections so I have increased significantly the shared, wal, sort and vacuum buffers. I keep stats of many of the operations, but unfortunately I have increased the buffers exactly when my data was expected to grow signifcantly. Example.. I doubled my WAL buffers, sort and vacuum buffers the same day that I added a new table with 3 million records. One thing that does seem to have helped is increasing the vacuum buffers. Although I have not timed it, but previously it seemed like it took forever to do a vacuum full.. since increasing the buffers to 64MB it doesn't seem to take so long. This we don't measure yet because I have been doing the vacuum fulls manually. Not sure yet how long the vacuum fulls would take and didn't want them to interfere with normal processing.. specially since I have been added more data recently and my time-frames keep changing. To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-database" in the body of the message From owner-freebsd-database Fri Mar 29 23:22: 0 2002 Delivered-To: freebsd-database@freebsd.org Received: from ws2.hk5.outblaze.com (202-77-181-84.outblaze.com [202.77.181.84]) by hub.freebsd.org (Postfix) with SMTP id 4ACE137B405 for ; Fri, 29 Mar 2002 23:21:50 -0800 (PST) Received: (qmail 845 invoked by uid 1001); 30 Mar 2002 07:21:44 -0000 Message-ID: <20020330072143.844.qmail@graffiti.net> Content-Type: text/plain; charset="iso-8859-1" Content-Disposition: inline Content-Transfer-Encoding: 7bit Mime-Version: 1.0 X-Mailer: MIME-tools 4.104 (Entity 4.117) Received: from [66.51.217.108] by ws2.hk5.outblaze.com with http for tedstriker@graffiti.net; Sat, 30 Mar 2002 15:21:43 +0800 From: "Ted Striker" To: Cc: Date: Sat, 30 Mar 2002 15:21:43 +0800 Subject: Re: Raid configuration X-Originating-Ip: 66.51.217.108 X-Originating-Server: ws2.hk5.outblaze.com Sender: owner-freebsd-database@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.ORG Well with our machine we're still in the "before" stage, so there is really no "after" to compare. About your RAID, normally the more cards you can use, the better. More cards will usually make I/O faster and also more fault tolerant. Our one card is a single point of failure, so that isn't the most optimal situation, but the best we can do right now. I believe a RAID10 would probably be faster for you, since it can read and write from more disks in parallel, versus having only one disk at a time to read or write to. Another great thing about the RAID10 is that you can lose a disk, and not lose any data or performance, while the disk is offline. ----- Original Message ----- From: Francisco Reyes Date: Fri, 29 Mar 2002 21:03:43 -0500 (EST) To: Ted Striker Subject: Re: Raid configuration > On Sat, 30 Mar 2002, Ted Striker wrote: > > > We are using RAID10 on Postgres. Also a 4 disk configuration. > > > > Since our RAID goes through only one card, it sees the whole RAID10 > > as one disk. > > How has the raid helped? > Did you do any before/after tests? > Care to share specs. > > Our current setup is a desktop with 1GB ram, Petium III 1.3Ghz CPU. > IDE disk for OS and 2 SCSI 10K rpm drives. First SCSI is database and > second logs. > > Currently there is the possibility that I may get $$ for a serious server > and I am wondering what to get. > > From what I have read so far FreeBSD with multiple CPUs does not play nice > with PostgreSQL, so that leaves out SMP. > > I am thinking 4GB ram and 4 15K rpm drives on raid 10. I guess I could do > the same thing you did and make them all one volume. > > On the current machine I rarely ever have more than 2 or 3 connections so > I have increased significantly the shared, wal, sort and vacuum buffers. > > I keep stats of many of the operations, but unfortunately I have increased > the buffers exactly when my data was expected to grow signifcantly. > > Example.. I doubled my WAL buffers, sort and vacuum buffers the same day > that I added a new table with 3 million records. > > One thing that does seem to have helped is increasing the vacuum buffers. > Although I have not timed it, but previously it seemed like it took > forever to do a vacuum full.. since increasing the buffers to 64MB it > doesn't seem to take so long. This we don't measure yet because I have > been doing the vacuum fulls manually. Not sure yet how long the vacuum > fulls would take and didn't want them to interfere with normal > processing.. specially since I have been added more data recently and my > time-frames keep changing. > > -- _______________________________________________ Get your free email from http://www.graffiti.net Powered by Outblaze To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-database" in the body of the message From owner-freebsd-database Sat Mar 30 1:55: 4 2002 Delivered-To: freebsd-database@freebsd.org Received: from mgw1.MEIway.com (mgw1.meiway.com [212.73.210.75]) by hub.freebsd.org (Postfix) with ESMTP id 8064937B417 for ; Sat, 30 Mar 2002 01:54:59 -0800 (PST) Received: from mail.Go2France.com (ms1.meiway.com [212.73.210.73]) by mgw1.MEIway.com (Postfix Relay Hub) with ESMTP id 70BFE16B1E for ; Sat, 30 Mar 2002 10:54:57 +0100 (CET) Received: from LenConrad.Go2France.com [193.252.44.38] by mail.Go2France.com with ESMTP (SMTPD32-6.06) id A0851CFD0388; Sat, 30 Mar 2002 11:16:37 +0100 Message-Id: <5.1.0.14.2.20020330105203.03223910@mail.Go2France.com> X-Sender: LConrad@Go2France.com@mail.Go2France.com X-Mailer: QUALCOMM Windows Eudora Version 5.1 Date: Sat, 30 Mar 2002 10:54:18 +0100 To: freebsd-database@freebsd.org From: Len Conrad Subject: Re: Raid configuration In-Reply-To: <20020330072143.844.qmail@graffiti.net> Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii"; format=flowed Sender: owner-freebsd-database@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.ORG >use, the better. More cards will usually make I/O faster in this thread, nobody has mentioned on-board cache. For the guy (msg deleted) who has the 2400A, have you put the 128 mb cache on the board? about $50. I think the cache makes that 32-bit board more attractive than the 3ware boards with no cache. Len http://MenAndMice.com/DNS-training http://BIND8NT.MEIway.com : ISC BIND for NT4 & W2K http://IMGate.MEIway.com : Build free, hi-perf, anti-abuse mail gateways To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-database" in the body of the message