From owner-freebsd-fs@FreeBSD.ORG Thu May 12 03:56:00 2011 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 06A5E106566C for ; Thu, 12 May 2011 03:56:00 +0000 (UTC) (envelope-from fjwcash@gmail.com) Received: from mail-gy0-f182.google.com (mail-gy0-f182.google.com [209.85.160.182]) by mx1.freebsd.org (Postfix) with ESMTP id AF51F8FC16 for ; Thu, 12 May 2011 03:55:59 +0000 (UTC) Received: by gyg13 with SMTP id 13so505401gyg.13 for ; Wed, 11 May 2011 20:55:59 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:in-reply-to:references:date :message-id:subject:from:to:cc:content-type :content-transfer-encoding; bh=irQ/V/RYJGBt7AcbvtwFEO75vMGvANZdp5IjoQCCFFY=; b=XUk/aRexC8GcoTrlj44WS/xAfZ1ghXowqRxcckmFO8Zx1TFR0SppydcyD9VOyHK1ok 3bS0EE0fqJyp4CMHXoq1vnf7HGu1Aio7MCOx66c3vnfkCKHFe4HNNUNQw6bfNwAYdGlj vnoOSw+E+W1BulqRpWPOBSGR/hniQ0aE6shUo= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:content-transfer-encoding; b=Zshe1bSaA2CvuVE8VZYZMMhBo7ewvxD/h1/CeE5M33uAZJ/l8xAEl9KmEm9JHMUM/q hVebspe62GVpKjP16OPWDnLAaJ9GlbtWTTCGfxxkmXuq3rhjqbrswb7i7vZb6eIofXnk uN/uyWaPjhIatlAAYmMm+sOW1tvwttdGvtwEM= MIME-Version: 1.0 Received: by 10.90.135.8 with SMTP id i8mr131088agd.113.1305172556994; Wed, 11 May 2011 20:55:56 -0700 (PDT) Received: by 10.90.52.15 with HTTP; Wed, 11 May 2011 20:55:56 -0700 (PDT) In-Reply-To: <20110512033626.GA52047@icarus.home.lan> References: <4DCA5620.1030203@dannysplace.net> <4DCB455C.4020805@dannysplace.net> <20110512033626.GA52047@icarus.home.lan> Date: Wed, 11 May 2011 20:55:56 -0700 Message-ID: From: Freddie Cash To: Jeremy Chadwick Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Cc: freebsd-fs@freebsd.org Subject: Re: ZFS: How to enable cache and logs. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 12 May 2011 03:56:00 -0000 On Wed, May 11, 2011 at 8:36 PM, Jeremy Chadwick wrote: > On Wed, May 11, 2011 at 09:51:58PM -0500, Bob Friesenhahn wrote: >> On Thu, 12 May 2011, Danny Carroll wrote: >> > >> >Replying to myself in order to summarise the recommendations (when usin= g >> >v28): >> >- Don't use SSD for the Log device. =C2=A0Write speed tends to be a pro= blem. >> >> DO use SSD for the log device. =C2=A0The log device is only used for >> synchronous writes. =C2=A0Except for certain usages (E.g. database and >> NFS server) most writes will be asynchronous and never be written to >> the log. =C2=A0Huge synchronous writes will also bypass the SSD log >> device. The log device is for reducing latency on small synchronous >> writes. > > Bob, please correct me if I'm wrong, but as I understand it a log device > (ZIL) effectively limits the overall write speed of the pool itself. Nope. Using a separate log device removes sync writes from the I/O path of the rest of the pool, thus increasing the total write throughput for the pool. > Danny might also find this URL useful: > > http://constantin.glez.de/blog/2011/02/frequently-asked-questions-about-f= lash-memory-ssds-and-zfs Read the linked articles. For example: http://constantin.glez.de/blog/2010/07/solaris-zfs-synchronous-writes-and-z= il-explained Most sync writes go to the ZIL. If the ZIL is part of the pool, then the pool has to issue two separate writes (once to the ZIL, then later to the pool as part of the normal async txg). If the ZIL is a separate device, then there's no write contention with the rest of the pool. Not every sync write goes to the ZIL. Only writes under a certain size (64 KB or something like that). Every OpenSolaris, Oracle Solaris, Nexenta admin will recommend getting an enterprise-grade, write-optimised, SLC-based SSD (preferably with a supercap) for use as the SLOG device. Especially if you're using ZFS for anything database-related, or serving files over NFS, everyone says the same: get an SSD for SLOG usage. Why would it be any different for ZFS on FreeBSD? There are plenty of benchmarks online and in the zfs-discuss mailing list that shows the benefits to using an SSD-based SLOG. --=20 Freddie Cash fjwcash@gmail.com