From owner-freebsd-current@FreeBSD.ORG  Tue Oct 15 11:53:44 2013
Return-Path: <owner-freebsd-current@FreeBSD.ORG>
Delivered-To: freebsd-current@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
 (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTP id 6BACB80C
 for <freebsd-current@freebsd.org>; Tue, 15 Oct 2013 11:53:44 +0000 (UTC)
 (envelope-from supportme@ukr.net)
Received: from frv196.fwdcdn.com (frv196.fwdcdn.com [212.42.77.196])
 (using TLSv1.2 with cipher DHE-RSA-AES128-SHA (128/128 bits))
 (No client certificate requested)
 by mx1.freebsd.org (Postfix) with ESMTPS id 269AE2A08
 for <freebsd-current@freebsd.org>; Tue, 15 Oct 2013 11:53:43 +0000 (UTC)
DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=ukr.net;
 s=ffe; 
 h=Content-Transfer-Encoding:Content-Type:MIME-Version:References:In-Reply-To:Message-Id:To:Subject:From:Date;
 bh=TyclM4L4jeSewdtEfQekCZ5CCWyhR820wpaGaK0fWLg=; 
 b=ajNEhFzpvCAyIBM14TCF8UAekePbZOSth77illNTYnbeE9fUX74I3tFSGGLWnbd7+8py/oR16bXB1oD/Qk1cTiOtkEtc8n/IKygRzQWdzxkUnApIawmJh4RI5Z5FU6Nsu3c2rAsIJoUF7oPimruhZ07AJHysowr1MG15K07p4LI=;
Received: from [10.10.10.45] (helo=frv45.ukr.net)
 by frv196.fwdcdn.com with smtp ID 1VW3Bt-000K5X-ER
 for freebsd-current@freebsd.org; Tue, 15 Oct 2013 14:53:33 +0300
Date: Tue, 15 Oct 2013 14:53:31 +0300
From: Dmitriy Makarov <supportme@ukr.net>
Subject: Re: vmstat -z: zfs related failures on r255173
To: freebsd-current@freebsd.org
X-Mailer: freemail.ukr.net 5.0
Message-Id: <1381837350.494453682.d94z37mg@frv45.ukr.net>
In-Reply-To: <1381521443.74219922.8eyuscyw@frv45.ukr.net>
References: <1381521443.74219922.8eyuscyw@frv45.ukr.net>
MIME-Version: 1.0
Received: from supportme@ukr.net by frv45.ukr.net;
 Tue, 15 Oct 2013 14:53:32 +0300
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: binary
Content-Disposition: inline
X-BeenThere: freebsd-current@freebsd.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: Discussions about the use of FreeBSD-current
 <freebsd-current.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-current>, 
 <mailto:freebsd-current-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-current>
List-Post: <mailto:freebsd-current@freebsd.org>
List-Help: <mailto:freebsd-current-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-current>,
 <mailto:freebsd-current-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Tue, 15 Oct 2013 11:53:44 -0000

Please, any idea, thougth, help! 
Maybe what information can be useful for diggin - anything...

System what I'm talkin about has a huge problem: performance degradation in short time period (day-two). Don't know can we somehow relate this vmstat fails with degradation.


 
> Hi all
> 
> On CURRENT r255173 we have some interesting values from vmstat -z : REQ = FAIL
> 
> [server]# vmstat -z
> ITEM                   SIZE  LIMIT     USED     FREE      REQ FAIL SLEEP
> ....... skipped....
> NCLNODE:                528,      0,       0,       0,       0,   0,   0
> space_seg_cache:         64,      0,  289198,  299554,25932081,25932081,   0
> zio_cache:              944,      0,   37512,   50124,1638254119,1638254119,   0
> zio_link_cache:          48,      0,   50955,   38104,1306418638,1306418638,   0
> sa_cache:                80,      0,   63694,      56,  198643,198643,   0
> dnode_t:                864,      0,  128813,       3,  184863,184863,   0
> dmu_buf_impl_t:         224,      0, 1610024,  314631,157119686,157119686,   0
> arc_buf_hdr_t:          216,      0,82949975,   56107,156352659,156352659,   0
> arc_buf_t:               72,      0, 1586866,  314374,158076670,158076670,   0
> zil_lwb_cache:          192,      0,    6354,    7526, 2486242,2486242,   0
> zfs_znode_cache:        368,      0,   63694,      16,  198643,198643,   0
> ..... skipped ......
> 
> Can anybody explain this strange failures in zfs related parameters in vmstat, can we do something with this and is this really bad signal?
> 
> Thanks!