From owner-freebsd-stable@FreeBSD.ORG  Mon Nov  2 13:14:39 2009
Return-Path: <owner-freebsd-stable@FreeBSD.ORG>
Delivered-To: freebsd-stable@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34])
	by hub.freebsd.org (Postfix) with ESMTP id C004F1065698;
	Mon,  2 Nov 2009 13:14:39 +0000 (UTC)
	(envelope-from 000.fbsd@quip.cz)
Received: from elsa.codelab.cz (elsa.codelab.cz [94.124.105.4])
	by mx1.freebsd.org (Postfix) with ESMTP id 7E54E8FC13;
	Mon,  2 Nov 2009 13:14:39 +0000 (UTC)
Received: from localhost (localhost.codelab.cz [127.0.0.1])
	by elsa.codelab.cz (Postfix) with ESMTP id F0AF519E019;
	Mon,  2 Nov 2009 14:14:37 +0100 (CET)
Received: from [192.168.1.2] (r5bb235.net.upc.cz [86.49.61.235])
	(using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits))
	(No client certificate requested)
	by elsa.codelab.cz (Postfix) with ESMTPSA id D018719E027;
	Mon,  2 Nov 2009 14:14:35 +0100 (CET)
Message-ID: <4AEEDB3B.5020600@quip.cz>
Date: Mon, 02 Nov 2009 14:14:35 +0100
From: Miroslav Lachman <000.fbsd@quip.cz>
User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US;
	rv:1.9.1.4) Gecko/20091017 SeaMonkey/2.0
MIME-Version: 1.0
To: Ivan Voras <ivoras@freebsd.org>
References: <772532900-1257123963-cardhu_decombobulator_blackberry.rim.net-1402739480-@bda715.bisx.prod.on.blackberry>	<hcma4s$c49$1@ger.gmane.org>	<4AEEBD4B.1050407@quip.cz>
	<hcmhbj$40s$1@ger.gmane.org>
In-Reply-To: <hcmhbj$40s$1@ger.gmane.org>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit
Cc: freebsd-stable@freebsd.org
Subject: Re: Performance issues with 8.0 ZFS and sendfile/lighttpd
X-BeenThere: freebsd-stable@freebsd.org
X-Mailman-Version: 2.1.5
Precedence: list
List-Id: Production branch of FreeBSD source code <freebsd-stable.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-stable>, 
	<mailto:freebsd-stable-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-stable>
List-Post: <mailto:freebsd-stable@freebsd.org>
List-Help: <mailto:freebsd-stable-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-stable>,
	<mailto:freebsd-stable-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Mon, 02 Nov 2009 13:14:39 -0000

Ivan Voras wrote:
> Miroslav Lachman wrote:

[..]

>> I have more strange issue with Lighttpd in jail on top of ZFS.
>> Lighttpd is serving static content (mp3 downloads thru flash player).
>> Is runs fine for relatively small number of parallel clients with
>> bandwidth about 30 Mbps, but after some number of clients is reached
>> (about 50-60 parallel clients) the throughput drops down to 6 Mbps.
>>
>> I can server hundereds of clients on same HW using Lighttpd not in
>> jail and UFS2 with gjournal instead of ZFS reaching 100 Mbps (maybe
>> more).
>>
>> I don't know if it is ZFS or Jail issue.
>
> Do you have actual disk IO or is the vast majority of your data served
> from the caches? (actually - the same question to the OP)

I had ZFS zpool as mirror of two SATA II drives (500GB) and in the peak 
iostat (or systat -vm or gstat) shows about 80 tps / 60% busy.

In case of UFS, I am using gmirrored 1TB SATA II drives working nice 
with 160 or more tps.

Both setups are using FreeBSD 7.x amd64 with GENERIC kernel, 4GB of RAM.

As the ZFS + Lighttpd in jail was unreliable, I am no longer using it, 
but if you want some more info for debuging, I can set it up again.

Miroslav Lachman