From owner-freebsd-current@FreeBSD.ORG Fri Oct 17 04:10:31 2014 Return-Path: Delivered-To: current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id D05B423D; Fri, 17 Oct 2014 04:10:31 +0000 (UTC) Received: from anubis.delphij.net (anubis.delphij.net [IPv6:2001:470:1:117::25]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "anubis.delphij.net", Issuer "StartCom Class 1 Primary Intermediate Server CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id B4AD6CCB; Fri, 17 Oct 2014 04:10:31 +0000 (UTC) Received: from delphij-macbook.home.us.delphij.net (unknown [IPv6:2001:470:83bf:0:14f4:f167:6c7a:fce4]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by anubis.delphij.net (Postfix) with ESMTPSA id 091FE3A1F; Thu, 16 Oct 2014 21:10:31 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=delphij.net; s=anubis; t=1413519031; x=1413533431; bh=SfnrGzueCF9MRC2ek5cax3DnRNglwirXPkkHvyqKmFY=; h=Date:From:Reply-To:To:CC:Subject:References:In-Reply-To; b=NszhTEg2dcNN7Kps3S4ZLJqh6ipWEUh/pc2eMYI7rgE2B6V9buTHyhm35BBZ+mSo2 smdugX0FsdO0WuNJGK+M2FJObCI1yJgaUfdgF6JDSX1LzSxqI6+MqATsVcD9X/3H3g GzyWu/Vw7EmCINBjYAPZt8yPXGvv6V0gud3FrWKI= Message-ID: <544096B3.20306@delphij.net> Date: Thu, 16 Oct 2014 21:10:27 -0700 From: Xin Li Reply-To: d@delphij.net Organization: The FreeBSD Project MIME-Version: 1.0 To: "James R. Van Artsdalen" , d@delphij.net Subject: Re: zfs recv hangs in kmem arena References: <54250AE9.6070609@jrv.org> <543FAB3C.4090503@jrv.org> <543FEE6F.5050007@delphij.net> <54409050.4070401@jrv.org> In-Reply-To: <54409050.4070401@jrv.org> Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit Cc: freebsd-fs@freebsd.org, "James R. Van Artsdalen" , current@freebsd.org X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 17 Oct 2014 04:10:31 -0000 -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA512 On 10/16/14 8:43 PM, James R. Van Artsdalen wrote: > On 10/16/2014 11:12 AM, Xin Li wrote: >>> On 9/26/2014 1:42 AM, James R. Van Artsdalen wrote: >>>> FreeBSD BLACKIE.housenet.jrv 10.1-BETA2 FreeBSD 10.1-BETA2 >>>> #2 r272070M: Wed Sep 24 17:36:56 CDT 2014 >>>> james@BLACKIE.housenet.jrv:/usr/obj/usr/src/sys/GENERIC >>>> amd64 >>>> >>>> With current STABLE10 I am unable to replicate a ZFS pool >>>> using zfs send/recv without zfs hanging in state "kmem >>>> arena", within the first 4TB or so (of a 23TB Pool). > >> What does procstat -kk 1176 (or the PID of your 'zfs' process >> that stuck in that state) say? >> >> Cheers, >> > SUPERTEX:/root# ps -lp 866 UID PID PPID CPU PRI NI VSZ RSS > MWCHAN STAT TT TIME COMMAND 0 866 863 0 52 0 66800 > 29716 kmem are D+ 1 57:40.82 zfs recv -duvF BIGTOX > SUPERTEX:/root# procstat -kk 866 PID TID COMM TDNAME > KSTACK 866 101573 zfs - mi_switch+0xe1 > sleepq_wait+0x3a _cv_wait+0x16d vmem_xalloc+0x568 vmem_alloc+0x3d > kmem_malloc+0x33 keg_alloc_slab+0xcd keg_fetch_slab+0x151 > zone_fetch_slab+0x7e zone_import+0x40 uma_zalloc_arg+0x34e > arc_get_data_buf+0x31a arc_buf_alloc+0xaa dmu_buf_will_fill+0x169 > dmu_write+0xfc dmu_recv_stream+0xd40 zfs_ioc_recv+0x94e > zfsdev_ioctl+0x5ca Do you have any special tuning in your /boot/loader.conf? Cheers, -----BEGIN PGP SIGNATURE----- iQIcBAEBCgAGBQJUQJazAAoJEJW2GBstM+ns6dQQAK4NM6X40d7tS7pqoTQvZbrD U0u5kid703tWgAlSFzvORxeOEB94BxcHu/z1a68nGhUlL2kip8SirWV9A1rqBpes i4T6asHYTcFj4OvaPfSoA7lSVsZIaLK+RscraN1b7hehSG9UExeYF8D7cRIguhoa 1Gnlv5iZZkjJZGjR0R6DmxC8C1CyNxAZBXnj1L+ofpgUzqH0Rw2TCW1XVKqMcxvI 5lpt+V0uu7MPNgjzgVy/1z5ZD2SUBPco0eHuN/Npj0c6HkmHkoWqd53vxrBhlyCP eDbzLw7QTO7PaV5hAuC9y9/X1JGlmTVa0GP2irKuE5t1bAbVwUPQqpn+iiFs1Le8 34fL/jkCeSBY6voYYj100CBU1/1mZOh93wuY6FdMVWPJp/bsjbDUtKZUmosGU86j ZMikfVNl5Jc5dmH30JGFCDOWzfaFq+V34toSfYIihaBQPyFov0Mr7De5MvQ7VJ7D qiXDcfAXE99CXzAboYpruwrbxyxTqhUmXlWp2uCPqvmo0WhVUsROmhhXhWXkG3tS S7L0n4X8kgklveirZWq/oDsg4JXNTP2ernNdAYyhD7TbG/N4INdFaVuqZkDVDgny ibwY0HEzg2zskJOJBqr9a21fZx6c2dvJ1n+j5BaAq6ve2Hw2NyvUVWfMTknp4I8j t/JJtsDNs9xokH/veS3J =aBKI -----END PGP SIGNATURE-----