From owner-freebsd-questions@FreeBSD.ORG Mon Feb 4 16:21:23 2013 Return-Path: Delivered-To: freebsd-questions@freebsd.org Received: from mx1.freebsd.org (mx1.FreeBSD.org [8.8.178.115]) by hub.freebsd.org (Postfix) with ESMTP id D9DCD291 for ; Mon, 4 Feb 2013 16:21:23 +0000 (UTC) (envelope-from paul@kraus-haus.org) Received: from mail-ve0-f173.google.com (mail-ve0-f173.google.com [209.85.128.173]) by mx1.freebsd.org (Postfix) with ESMTP id 8633F72D for ; Mon, 4 Feb 2013 16:21:23 +0000 (UTC) Received: by mail-ve0-f173.google.com with SMTP id oz10so4885486veb.4 for ; Mon, 04 Feb 2013 08:21:17 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=x-received:subject:mime-version:content-type:from:in-reply-to:date :content-transfer-encoding:message-id:references:to:x-mailer :x-gm-message-state; bh=MTOH9bpXOjotkL9pWNTeGP53sNhF/U2Umq493r2XRxw=; b=jEby/5pbxPSkeV2t+k5cpJ8lq9KzfbLl9W7lyyi8xl3rBEjAZTmat0U8cVUuC3hGPu AB89wFpIWnWwu7U5fMgIM450JVJEQVq0WhHl0HdcRNaIqMq4RCVRzWIuJ9+dGlwQ++zj 8qosKp1Svunid5i5GnM6R0BI/c7F4zoGOltQP+yM7wH/rWqhA9Fjxl36cgS9m/3no+Ge HvwsT/ib7L3gsNhOTRVhqGVs9Y4gbQOd8l90mvsVjuG0hnnybqc6QX0zUVyRLg1v99KI CBdhF/jbOPkB/b1Gbwh1jiSigkahSV1OKrqH0VmtEgcO/AXOaCN89kjyhr+J9GFmlYUz hoVA== X-Received: by 10.220.226.70 with SMTP id iv6mr23080889vcb.9.1359994877578; Mon, 04 Feb 2013 08:21:17 -0800 (PST) Received: from mini1.kraus-haus.org ([96.236.21.119]) by mx.google.com with ESMTPS id sk8sm22362797vdb.13.2013.02.04.08.21.14 (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Mon, 04 Feb 2013 08:21:16 -0800 (PST) Subject: Re: [zfs-discuss] zfs + NFS + FreeBSD with performance prob Mime-Version: 1.0 (Apple Message framework v1085) Content-Type: text/plain; charset=us-ascii From: Paul Kraus In-Reply-To: <20130131221627.GA91823@pcjas.obspm.fr> Date: Mon, 4 Feb 2013 11:21:12 -0500 Content-Transfer-Encoding: quoted-printable Message-Id: <509EB11C-E279-44C5-91C2-3A93249919F5@kraus-haus.org> References: <20130131221627.GA91823@pcjas.obspm.fr> To: zfs-discuss@opensolaris.org, FreeBSD Mailing List X-Mailer: Apple Mail (2.1085) X-Gm-Message-State: ALoCoQnLJHMqA/2e1DNKsDeqtup7yIQXdR9E2jGcdFwNiveEB4oWBYe3fC3cw9O1t49h4ZXKVonL X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 04 Feb 2013 16:21:23 -0000 On Jan 31, 2013, at 5:16 PM, Albert Shih wrote: > Well I've server running FreeBSD 9.0 with (don't count / on differents > disks) zfs pool with 36 disk. >=20 > The performance is very very good on the server. >=20 > I've one NFS client running FreeBSD 8.3 and the performance over NFS = is > very good :=20 >=20 > For example : Read from the client and write over NFS to ZFS: >=20 > [root@ .tmp]# time tar xf /tmp/linux-3.7.5.tar=20 >=20 > real 1m7.244s > user 0m0.921s > sys 0m8.990s >=20 > this client is on 1Gbits/s network cable and same network switch as = the > server. >=20 > I've a second NFS client running FreeBSD 9.1-Stable, and on this = second > client the performance is catastrophic. After 1 hour the tar isn't = finish. > OK this second client is connect with 100Mbit/s and not on the same = switch. > But well from 2 min --> ~ 90 min ...:-( >=20 > I've try for this second client to change on the ZFS-NFS server the >=20 > zfs set sync=3Ddisabled=20 >=20 > and that change nothing. I have been using FreeBSD 9 with ZFS and NFS to a couple Mac OS X = (10.6.8 Snow Leopard) boxes and I get between 40 and 50 MB/sec = throughput on a Gigabit ethernet link. Since you have already ruled out = the known sync issue with ZFS and no SSD-based write cache, then perhaps = you are running into an NFS 3 vs. NFS 4 issue. I am not sure if Mac OS X = is using NFS 3 or NFS 4. -- Paul Kraus Deputy Technical Director, LoneStarCon 3 Sound Coordinator, Schenectady Light Opera Company