From owner-freebsd-stable@FreeBSD.ORG Tue Jan 19 09:34:39 2010 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id AC497106568D for ; Tue, 19 Jan 2010 09:34:39 +0000 (UTC) (envelope-from kraduk@googlemail.com) Received: from mail-fx0-f227.google.com (mail-fx0-f227.google.com [209.85.220.227]) by mx1.freebsd.org (Postfix) with ESMTP id 305C98FC1E for ; Tue, 19 Jan 2010 09:34:38 +0000 (UTC) Received: by fxm27 with SMTP id 27so3144755fxm.3 for ; Tue, 19 Jan 2010 01:34:38 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlemail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :date:message-id:subject:from:to:cc:content-type; bh=jg3Pgq71gq8jeJCcPGSHnzVKUOse+FZRFpROD/SkFlo=; b=mfYaGtJEB3W98rZx17v1Yx0ScLb5dPvmidyE+gtGiRlhqTpCHOkrF1cDwlE7HpUwzj iORp9VfJzCZbVpQh5x1mEW/bMvlXTbvMxdB27QCkRKO5KssIeAEH/nDFIS1Cb/3YqcoM vPksTGpT+PaDFOSSca+ggUMcyRPAuD8CE6YS0= DomainKey-Signature: a=rsa-sha1; c=nofws; d=googlemail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; b=czisEekzGTIJ7/4gqrV1mIerdVGtvw1+ygNT3TEEtQxqgT1aChr61JrN0eTOWrMmDZ 457sZ6vg0SCoLpLRmqcFVsBzN0dsyCXcK4UOG8N2AQpDzI84H9Fjwe0/Au89otdxh7lZ du/SAQeXxJnAD1zoWoy8E9xid03VLVsk74ExI= MIME-Version: 1.0 Received: by 10.239.190.137 with SMTP id x9mr138985hbh.18.1263892155986; Tue, 19 Jan 2010 01:09:15 -0800 (PST) In-Reply-To: <4B54C5EE.5070305@pp.dyndns.biz> References: <4B54C100.9080906@mail.zedat.fu-berlin.de> <4B54C5EE.5070305@pp.dyndns.biz> Date: Tue, 19 Jan 2010 09:09:15 +0000 Message-ID: From: krad To: =?ISO-8859-1?Q?Morgan_Wesstr=F6m?= Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: "O. Hartmann" , FreeBSD Stable , freebsd-questions@freebsd.org Subject: Re: immense delayed write to file system (ZFS and UFS2), performance issues X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 19 Jan 2010 09:34:39 -0000 2010/1/18 Morgan Wesstr=F6m > O. Hartmann wrote: > > I realise a strange behaviour of several FreeBSD 8.0-STABLE/amd64 boxes= . > > All boxes have the most recent STABLE. One box is a UP system, two > > others SMP boxes, one with a Q6600 4-core, another XEON with 2x 4-cores > > (Dell Poweredge III). > > > > Symptome: All boxes have ZFS and UFS2 filesystems. Since two weeks or > > so, sometimes the I/O performance drops massively when doing 'svn > > update', 'make world' or even 'make kernel'. It doesn't matter what > > memory and how many cpu the box has, it get stuck for several seconds > > and freezing. On the UP box, this is sometimes for 10 - 20 seconds. > > A very interesting phenomenon is the massively delayed file writing on > > ZFS filesystems I realise. Editing a file in 'vi' running on one XTerm > > and having in another Xterminal my shell for compiling this file, it > > takes sometimes up to 20 seconds to get the file updated after it has > > been written. It's like having an old, slow NFS connection with long > > cache delays. > > These massively delayed file transactions are not necessarely under > > heavy load, sometimes they occur in a relaxed situation. They seem to > > occur much more often on the UP box than on the SMP boxes, but this > > strange phenomenon also occur on the Dell Poweredge II, which has 16GB > > RAM and summa summarum 16 cores. This phenomenon does occur on ZFS- and > > UFS2 filesystems as well. It is hardly reproducable. > > > > Is there any known issue? > > > > Ragrds, > > Oliver > > > The disks involved don't happen to be Western Digital Green Power disks, > do they? The Intelli-Park function in these disks are wrecking havoc > with I/O in Linux-land at least, causing massive stalls and iowait > through the roof during the 25-30 seconds it takes for the heads to > unload after parking. I have two of these disks sitting on my desk now > collecting dust... > /Morgan > _______________________________________________ > freebsd-questions@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-questions > To unsubscribe, send any mail to " > freebsd-questions-unsubscribe@freebsd.org" > ZFS is copy on write, therefore to optimize the write performance it delays writes for a long as possible, upto a set maximum time. It will then flush to the disks. How long this time is depends on how much free ram you have available. Assuming processes are eating up all your ram I would imagine yo= u are hitting the max limit. I'm not sure exactly what its set to on bsd but = I know the default on opensolaris is 30s. I think this explains your delayed writes. Not sure what will cause the lock ups though.