Date: Thu, 21 Jan 2016 21:08:57 -0800 From: David Christensen <dpchrist@holgerdanske.com> To: freebsd-questions@freebsd.org Subject: Re: ZFS performance help sought Message-ID: <56A1B969.4020107@holgerdanske.com> In-Reply-To: <20160121205139.GG4538@blisses.org> References: <20160121205139.GG4538@blisses.org>
next in thread | previous in thread | raw e-mail | index | archive | help
On 01/21/2016 12:51 PM, Mason Loring Bliss wrote: > I've bounced back and forth between FreeBSD and Linux, and one of the reasons > why I tend to part with FreeBSD is frustration with ZFS performance. ... > Running FreeBSD, a zfs send/receive from one pool to another makes my system > almost unusably slow and even begins to dig me into swap a little. ... > I've moved back to FreeBSD on this box now, and I'd like to resolve this > issue. I don't know if it's a matter of fixing something broken in FreeBSD's > scheduling or tuning ZFS somehow such that it's friendlier. ... > The box has FreeBSD 10.2, eight gigs of RAM, and I'm dealing with pools 1TB > or smaller. No deduplication. ... On 01/21/2016 04:12 PM, Mason Loring Bliss wrote: > This is with the current test transfer going, with the settings noted > previously: > > extended device statistics > device r/s w/s kr/s kw/s qlen svc_t %b > ada0 182.6 0.0 23369.6 0.0 1 3.2 30 > ada1 212.5 0.0 27200.6 0.0 0 3.1 33 > ada2 0.0 486.9 0.0 61652.4 0 4.5 64 > ada3 0.0 798.1 0.0 101236.2 1 4.7 75 > ada4 0.0 0.0 0.0 0.0 0 0.0 0 > da0 0.0 0.0 0.0 0.0 0 0.0 0 > cd0 0.0 0.0 0.0 0.0 0 0.0 0 > > the sending pool is a mirror on ada0,1, and the receiving pool in > this case is a mirror on ada2,3. > > The disks in question: > > ada0: <ST500DM002-1BD142 KC43> ATA8-ACS SATA 3.x device > ada0: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) > ada1: <WDC WD5000AAKX-22ERMA0 17.01H17> ATA8-ACS SATA 3.x device > ada1: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) > ada2: <Hitachi HDS721010KLA330 GKAOA9DA> ATA-7 SATA 2.x device > ada2: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) > ada3: <WDC WD10EZEX-00BN5A0 01.01A01> ACS-2 ATA SATA 3.x device > ada3: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) 1. Have you tested the disks, cables, and controllers individually using disk manufacturer diagnostics? E.g. for Seagate, SeaTools for DOS (bootable CD based on FreeDOS; MS-DOS not required): http://www.seagate.com/support/downloads/seatools/ 2. Have you tested the disks individually using FreeBSD without ZFS? 3. Have you tested the disks individually using FreeBSD with ZFS? 4. Have you tested ada0,1 as a FreeBSD ZFS mirror? 5. Have you tested ada2,3 as a FreeBSD ZFS mirror? David
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?56A1B969.4020107>