From owner-freebsd-stable@FreeBSD.ORG Mon Feb 15 00:33:11 2010 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id B0D6D106566C for ; Mon, 15 Feb 2010 00:33:11 +0000 (UTC) (envelope-from dan@langille.org) Received: from nyi.unixathome.org (nyi.unixathome.org [64.147.113.42]) by mx1.freebsd.org (Postfix) with ESMTP id 712188FC0A for ; Mon, 15 Feb 2010 00:33:11 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by nyi.unixathome.org (Postfix) with ESMTP id BD62550843; Mon, 15 Feb 2010 00:33:10 +0000 (GMT) X-Virus-Scanned: amavisd-new at unixathome.org Received: from nyi.unixathome.org ([127.0.0.1]) by localhost (nyi.unixathome.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id wS7F7EL4hYdG; Mon, 15 Feb 2010 00:33:09 +0000 (GMT) Received: from smtp-auth.unixathome.org (smtp-auth.unixathome.org [10.4.7.7]) (Authenticated sender: hidden) by nyi.unixathome.org (Postfix) with ESMTPSA id 8405850823 ; Mon, 15 Feb 2010 00:33:09 +0000 (GMT) Message-ID: <4B789643.7020606@langille.org> Date: Sun, 14 Feb 2010 19:33:07 -0500 From: Dan Langille User-Agent: Thunderbird 2.0.0.23 (Windows/20090812) MIME-Version: 1.0 To: Dan Naumov References: <4B786D3A.3000408@langille.org> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 8bit Cc: FreeBSD-STABLE Mailing List Subject: Re: hardware for home use large storage X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 15 Feb 2010 00:33:11 -0000 Dan Naumov wrote: > On Mon, Feb 15, 2010 at 12:42 AM, Dan Naumov wrote: >> On Sun, Feb 14, 2010 at 11:38 PM, Dan Langille wrote: >>> Dan Naumov wrote: >>>>> On Sun, 14 Feb 2010, Dan Langille wrote: >>>>>> After creating three different system configurations (Athena, >>>>>> Supermicro, and HP), my configuration of choice is this Supermicro >>>>>> setup: >>>>>> >>>>>> 1. Samsung SATA CD/DVD Burner $20 (+ $8 shipping) >>>>>> 2. SuperMicro 5046A $750 (+$43 shipping) >>>>>> 3. LSI SAS 3081E-R $235 >>>>>> 4. SATA cables $60 >>>>>> 5. Crucial 3×2G ECC DDR3-1333 $191 (+ $6 shipping) >>>>>> 6. Xeon W3520 $310 >>>> You do realise how much of a massive overkill this is and how much you >>>> are overspending? >>> >>> I appreciate the comments and feedback. I'd also appreciate alternative >>> suggestions in addition to what you have contributed so far. Spec out the >>> box you would build. >> ====================== >> Case: Fractal Design Define R2 - 89 euro: >> http://www.fractal-design.com/?view=product&prod=32 >> >> Mobo/CPU: Supermicro X7SPA-H / Atom D510 - 180-220 euro: >> http://www.supermicro.com/products/motherboard/ATOM/ICH9/X7SPA.cfm?typ=H >> >> PSU: Corsair 400CX 80+ - 59 euro: >> http://www.corsair.com/products/cx/default.aspx >> >> RAM: Corsair 2x2GB, DDR2 800MHz SO-DIMM, CL5 - 85 euro >> ====================== >> Total: ~435 euro >> >> The motherboard has 6 native AHCI-capable ports on ICH9R controller >> and you have a PCI-E slot free if you want to add an additional >> controller card. Feel free to blow the money you've saved on crazy >> fast SATA disks and if your system workload is going to have a lot of >> random reads, then spend 200 euro on a 80gb Intel X25-M for use as a >> dedicated L2ARC device for your pool. > > And to expand a bit, if you want that crazy performance without > blowing silly amounts of money: > > Get a dock for holding 2 x 2,5" disks in a single 5,25" slot and put > it at the top, in the only 5,25" bay of the case. That sounds very interesting. I just looking around for such a thing, and could not find it. Is there a more specific name? URL? > Now add an > additional PCI-E SATA controller card, like the often mentioned PCIE > SIL3124. http://www.newegg.com/Product/Product.aspx?Item=N82E16816124026 for $35 > Now you have 2 x 2,5" disk slots and 8 x 3,5" disk slots, > with 6 native SATA ports on the motherboard and more ports on the > controller card. Now get 2 x 80gb Intel SSDs and put them into the > dock. Now partition each of them in the following fashion: > > 1: swap: 4-5gb > 2: freebsd-zfs: ~10-15gb for root filesystem > 3: freebsd-zfs: rest of the disk: dedicated L2ARC vdev > > GMirror your SSD swap partitions. > Make a ZFS mirror pool out of your SSD root filesystem partitions > Build your big ZFS pool however you like out of the mechanical disks you have. > Add the 2 x ~60gb partitions as dedicated independant L2ARC devices > for your SATA disk ZFS pool. > > Now you have redundant swap, redundant and FAST root filesystem and > your ZFS pool of SATA disks has 120gb worth of L2ARC space on the > SSDs. The L2ARC vdevs dont need to be redundant, because should an IO > error occur while reading off L2ARC, the IO is deferred to the "real" > data location on the pool of your SATA disks. You can also remove your > L2ARC vdevs from your pool at will, on a live pool. That is nice. Thank you.