From owner-freebsd-questions@FreeBSD.ORG Mon Apr 21 12:09:24 2008 Return-Path: Delivered-To: freebsd-questions@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 33EF71065670 for ; Mon, 21 Apr 2008 12:09:24 +0000 (UTC) (envelope-from wojtek@wojtek.tensor.gdynia.pl) Received: from wojtek.tensor.gdynia.pl (wojtek.tensor.gdynia.pl [IPv6:2001:4070:101:2::1]) by mx1.freebsd.org (Postfix) with ESMTP id 97E8F8FC12 for ; Mon, 21 Apr 2008 12:09:23 +0000 (UTC) (envelope-from wojtek@wojtek.tensor.gdynia.pl) Received: from wojtek.tensor.gdynia.pl (localhost [IPv6:::1]) by wojtek.tensor.gdynia.pl (8.14.2/8.14.2) with ESMTP id m3LC9IVB003310; Mon, 21 Apr 2008 14:09:19 +0200 (CEST) (envelope-from wojtek@wojtek.tensor.gdynia.pl) Received: from localhost (wojtek@localhost) by wojtek.tensor.gdynia.pl (8.14.2/8.14.2/Submit) with ESMTP id m3KFEwo0001174; Sun, 20 Apr 2008 17:14:59 +0200 (CEST) (envelope-from wojtek@wojtek.tensor.gdynia.pl) Date: Sun, 20 Apr 2008 17:14:58 +0200 (CEST) From: Wojciech Puchar To: hideo In-Reply-To: <20080419172100.GA3638@lastamericanempire.com> Message-ID: <20080420170922.W1173@wojtek.tensor.gdynia.pl> References: <20080419172100.GA3638@lastamericanempire.com> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Cc: freebsd-questions@freebsd.org Subject: Re: gmirror, geli, gjournal performance X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 21 Apr 2008 12:09:24 -0000 > > I was replacing a disk in a gmirror+geli pair and decided to compare > the performance of gmirror+geli+gjournal before adding the new disk. too much mixer in one to give exact answer. gmirror - no slowdown, faster reads when at least 2 concurrent, near 0 CPU load geli - high CPU load, performance depends mostly on CPU gjournal - extra overhead on writes, no difference on reads. > When using these three together is the appropriate order to 1) fdisk > and label 2) mirror the disk, 3) geli the partitions, and 4) use the > geli partitions for gjournal label? right. > With respect to performance, I find the writes to the gjournal disk > about half as fast, which I expected from the benchmarks I've seen. which - with geli, means twice CPU load. do you really need gjournal. > However, reading a single file is identical between the two: > > dd if=/sofupdates/1.mpg of=/dev/null bs=1m > 994049168 bytes transferred in 34.858793 secs (28516454 bytes/sec) > > dd if=/gjournal/1.mpg of=/dev/null bs=1m > 994049168 bytes transferred in 34.335267 secs (28951258 bytes/sec) > > Is this expected? I was under the impression that reads should be > somewhat faster with gjournal. wrong impression. reads are the same. it's best to make sure your hardware and kernel config are OK and system doesn't crash every day, and don't use gjournal. fsck isn't that long, is used only after crash, it's not worth extra overhead under NORMAL operation. with geli - divide your system to partitions the way that not secret data are not geli encrypted. for sure your /usr may be unencrypted, just move /usr/local/etc to somewhere out of /usr geli is very good but needs lots of CPU power. on my core 2 duo system i was able to get total of 100MB/s (concurrent from many disks) with geli, at that point both cores was fully used.