From owner-freebsd-questions@FreeBSD.ORG  Mon Jun 16 08:56:24 2014
Return-Path: <owner-freebsd-questions@FreeBSD.ORG>
Delivered-To: freebsd-questions@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id CB41BEA5
 for <freebsd-questions@freebsd.org>; Mon, 16 Jun 2014 08:56:24 +0000 (UTC)
Received: from ipmail05.adl6.internode.on.net (ipmail05.adl6.internode.on.net
 [IPv6:2001:44b8:8060:ff02:300:1:6:5])
 by mx1.freebsd.org (Postfix) with ESMTP id 623D92853
 for <freebsd-questions@freebsd.org>; Mon, 16 Jun 2014 08:56:24 +0000 (UTC)
Received: from ppp118-210-37-37.lns20.adl2.internode.on.net (HELO
 leader.local) ([118.210.37.37])
 by ipmail05.adl6.internode.on.net with ESMTP; 16 Jun 2014 18:26:16 +0930
Message-ID: <539EB12E.6040903@ShaneWare.Biz>
Date: Mon, 16 Jun 2014 18:26:14 +0930
From: Shane Ambler <FreeBSD@ShaneWare.Biz>
User-Agent: Mozilla/5.0 (X11; FreeBSD amd64;
 rv:24.0) Gecko/20100101 Thunderbird/24.5.0
MIME-Version: 1.0
To: Dennis Glatting <freebsd@pki2.com>, 
 FreeBSD Questions <freebsd-questions@freebsd.org>
Subject: Re: Large ZFS arrays?
References: <1402846139.4722.352.camel@btw.pki2.com>
 <CALfReye2_c3y7kyTVBfGOj=9NRKKi7KrFdH7jz6KQxgV1Csa6g@mail.gmail.com>
In-Reply-To: <CALfReye2_c3y7kyTVBfGOj=9NRKKi7KrFdH7jz6KQxgV1Csa6g@mail.gmail.com>
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
X-BeenThere: freebsd-questions@freebsd.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: User questions <freebsd-questions.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-questions>, 
 <mailto:freebsd-questions-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-questions/>
List-Post: <mailto:freebsd-questions@freebsd.org>
List-Help: <mailto:freebsd-questions-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-questions>, 
 <mailto:freebsd-questions-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Mon, 16 Jun 2014 08:56:24 -0000

On 16/06/2014 17:12, krad wrote:
> its also worth maybe looking at a distributed  file system as well such as
> moosefs or afs. This may or may not be appropriate for your workload so
> careful consideration would be needed. However if its right for you there
> are are potentially a lot of benefits. This can obviously be underpinned
> with zfs, but would require multiple machines to make it worth while.
> 
> 
> On 15 June 2014 16:28, Dennis Glatting <freebsd@pki2.com> wrote:
> 
>> Anyone built a large ZFS infrastructures (PB size) and care to share
>> words of wisdom?

ixsystems haven't published results of their tests yet - 3/4 PB
http://www.ixsystems.com/whats-new/terafiler-preview/

You could try contacting them or keep an eye out for the results, they
planned to dismantle it June so we should see results soon.