From owner-freebsd-fs@FreeBSD.ORG Wed Oct 12 16:37:12 2011 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 115A9106566B for ; Wed, 12 Oct 2011 16:37:12 +0000 (UTC) (envelope-from brodbd@uw.edu) Received: from mail-ey0-f182.google.com (mail-ey0-f182.google.com [209.85.215.182]) by mx1.freebsd.org (Postfix) with ESMTP id 9E3A38FC08 for ; Wed, 12 Oct 2011 16:37:11 +0000 (UTC) Received: by eyd10 with SMTP id 10so1209161eyd.13 for ; Wed, 12 Oct 2011 09:37:10 -0700 (PDT) MIME-Version: 1.0 Received: by 10.213.108.84 with SMTP id e20mr943637ebp.82.1318437430550; Wed, 12 Oct 2011 09:37:10 -0700 (PDT) Received: by 10.213.112.130 with HTTP; Wed, 12 Oct 2011 09:37:10 -0700 (PDT) In-Reply-To: References: Date: Wed, 12 Oct 2011 09:37:10 -0700 Message-ID: From: David Brodbeck To: freebsd-fs@freebsd.org Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Subject: Re: ZFS/compression/performance X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 12 Oct 2011 16:37:12 -0000 On Wed, Oct 12, 2011 at 5:02 AM, Johannes Totz wrote: > I just did a simple write test yesterday: > > 1) 6 MB/sec for gzip, 1.36x ratio > 2) 34 MB/sec for lzjb, 1.23x ratio > > I'll stick with lzjb. It's good enough to get rid of most of the > redundancy and speed is acceptable. > That's what we use on our text-heavy filesystems on our OpenSolaris server. (We work with large text corpora, so we have hundreds of gigabytes of pure text.) My benchmarks showed the performance hit for reads is nonexistent when viewed over NFS, and the performance hit for writes is relatively small...plus we don't write to that filesystem much. We see about 1.5x compression overall, with a little over 2x on some datasets that are particularly compressible. -- David Brodbeck System Administrator, Linguistics University of Washington