From owner-freebsd-scsi@FreeBSD.ORG Thu Feb 14 13:25:58 2013 Return-Path: Delivered-To: freebsd-scsi@freebsd.org Received: from mx1.freebsd.org (mx1.FreeBSD.org [8.8.178.115]) by hub.freebsd.org (Postfix) with ESMTP id 3323CE11 for ; Thu, 14 Feb 2013 13:25:58 +0000 (UTC) (envelope-from sven@crashme.org) Received: from celaeno.tauri.mw.lg.virgo.supercluster.net (celaeno.tauri.mw.lg.virgo.supercluster.net [213.252.140.33]) by mx1.freebsd.org (Postfix) with ESMTP id DBF261FE for ; Thu, 14 Feb 2013 13:25:57 +0000 (UTC) Received: from miram.persei.mw.lg.virgo.supercluster.net ([213.252.140.37] helo=[192.168.20.6]) by celaeno.tauri.mw.lg.virgo.supercluster.net with esmtps (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32) (Exim 4.76) (envelope-from ) id 1U5yQP-0003F0-7d for freebsd-scsi@freebsd.org; Thu, 14 Feb 2013 13:00:29 +0000 Message-ID: <511CDFEE.10307@crashme.org> Date: Thu, 14 Feb 2013 14:00:30 +0100 From: Sven Brandenburg User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:17.0) Gecko/20130106 Thunderbird/17.0.2 MIME-Version: 1.0 To: freebsd-scsi@freebsd.org Subject: Re: Increase mps sequential read performance with ZFS/zvol References: <510E987C.4090509@oxit.fi> <510E9FD1.5070907@freebsd.org> <20130205023609.GA99100@FreeBSD.org> In-Reply-To: <20130205023609.GA99100@FreeBSD.org> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Spam-Score: 0.2 (/) X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 14 Feb 2013 13:25:58 -0000 On 02/05/2013 03:36 AM, John wrote: [..] > Gmultipath is used to bind the disks such that each disk can be > addressed by either controller and the I/O balanced. > > The zfs pool consists of 24 mirrors, each pair one from each shelf. > The multipaths are rotated such that I/O is balanced between shelves > and controllers. [..] Not sure if this applicable to your problem but in a similar setup like yours, I found gmultipath in round-robin mode to be terrible for performance. Afaik the D2700 have their own caching controllers and may shield you from this, but if HBAs are directly connected to the disk, concurrent IO requests from two 'sides' via gmultipath seem to terrorize them, cutting effective read performance down by at least 75%. Try to switch gmultipath to active/passive. I bet its faster :) regards, Sven