From owner-freebsd-questions@FreeBSD.ORG Sat Oct 12 15:53:59 2013 Return-Path: Delivered-To: freebsd-questions@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id DB0ED705 for ; Sat, 12 Oct 2013 15:53:59 +0000 (UTC) (envelope-from aurfalien@gmail.com) Received: from mail-oa0-x22f.google.com (mail-oa0-x22f.google.com [IPv6:2607:f8b0:4003:c02::22f]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id A6C3723BC for ; Sat, 12 Oct 2013 15:53:59 +0000 (UTC) Received: by mail-oa0-f47.google.com with SMTP id i1so3331355oag.34 for ; Sat, 12 Oct 2013 08:53:59 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=from:content-type:content-transfer-encoding:subject:date:message-id :to:mime-version; bh=Uj5OBXQ56P0uEbGsaLElY0U1PHMWlpTrEV6tDamaon4=; b=IamuiSBM0R1UzKTfHKRLtKlvzEAFKao0ItwyPVh/WCn7Rf++ys8WGHrVerpqgHSv+g jEZnUzPkbJDlVd1mK2VMwg3LoDCUonijZfsU5pmAxahxKHUPRa/yBOwtFznwu1lYw4eu vg6L7iY7cC6lv+nxh7eNDhU5Xs8qVyyZEK8sZ0jx+DlEoUcqLRa6ukuzrkBCMaKJ50WZ NsNBnwVGOgtWb+w3EQy9Lu9oHXorXwsUqW45rgNmK2SzoIUHmk/QEaVF5mxBX+H8SgTv KbOmd1XkTL1zxbzVMir+bIMwEEXAVOs8sLB4HZBdZTu8lz/1D+Rhi28b0YrBL9LJ3d6v BqmA== X-Received: by 10.60.93.67 with SMTP id cs3mr19564934oeb.12.1381593238989; Sat, 12 Oct 2013 08:53:58 -0700 (PDT) Received: from [192.168.1.74] (75-63-29-182.lightspeed.irvnca.sbcglobal.net. [75.63.29.182]) by mx.google.com with ESMTPSA id rr6sm104028394oeb.0.1969.12.31.16.00.00 (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Sat, 12 Oct 2013 08:53:57 -0700 (PDT) From: aurfalien Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Subject: FreeBSD, Centos and ZFS Date: Sat, 12 Oct 2013 08:53:55 -0700 Message-Id: To: FreeBSD Questions Mailing List Mime-Version: 1.0 (Apple Message framework v1085) X-Mailer: Apple Mail (2.1085) X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 12 Oct 2013 15:53:59 -0000 Hi, I would like to first say that by no means is this a "hey, why is my Mac = faster then my PC" kind of email. I'm really hoping its an LSI driver issue. My hardware; 39 SATA drives via SAS expanders 2 SSD for ZIL 2 SSD for L2Arc 128GB ECC Ram Intel 2400SC Mobo 2 Xeon E5 Hexacore procs 2 LSI 9207 HBAs 1 LSI 9206 HBA I've 13 vdev RaidZ setup. Not a super system, but not a shabby one either. Used local (non network) IOzone and dd tests for some simple prelim = testing just to gauge were I'm at with this bad boy. My ZFS tunables are the same BTW as I did some tweaks. My CentOS 6.4 box is a solid 20-30% faster then my FreeBSD 9.2 box. = I've the graphs if any one is interested. But I'm hoping that some one has ran into this and that yes, there are = some tweaks one can do to the LSI driver? I guess? Perhaps a sysctl = value? I didn't want to vomit too much info in my first email about this so = yes, its meant to be some what general with some decent info to get the = dialogue started. Many thanks in advance for any insight. Linux is not an option as it does not return pre attributes on write = replies which is important in our mostly NFS env. - aurf