From owner-freebsd-fs@FreeBSD.ORG Sun Oct 21 00:11:03 2012 Return-Path: Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id EBC3F5B3 for ; Sun, 21 Oct 2012 00:11:03 +0000 (UTC) (envelope-from freebsd@pki2.com) Received: from btw.pki2.com (btw.pki2.com [IPv6:2001:470:a:6fd::2]) by mx1.freebsd.org (Postfix) with ESMTP id 93A8F8FC08 for ; Sun, 21 Oct 2012 00:11:03 +0000 (UTC) Received: from [127.0.0.1] (localhost [127.0.0.1]) by btw.pki2.com (8.14.5/8.14.5) with ESMTP id q9L0AvWx057130 for ; Sat, 20 Oct 2012 17:10:57 -0700 (PDT) (envelope-from freebsd@pki2.com) Subject: ZFS HBAs + LSI chip sets (Was: ZFS hang (system #2)) From: Dennis Glatting To: freebsd-fs@FreeBSD.org In-Reply-To: <508322EC.4080700@FreeBSD.org> References: <1350698905.86715.33.camel@btw.pki2.com> <1350711509.86715.59.camel@btw.pki2.com> <50825598.3070505@FreeBSD.org> <1350744349.88577.10.camel@btw.pki2.com> <1350765093.86715.69.camel@btw.pki2.com> <508322EC.4080700@FreeBSD.org> Content-Type: text/plain; charset="ISO-8859-1" Date: Sat, 20 Oct 2012 17:10:57 -0700 Message-ID: <1350778257.86715.106.camel@btw.pki2.com> Mime-Version: 1.0 X-Mailer: Evolution 2.32.1 FreeBSD GNOME Team Port Content-Transfer-Encoding: 7bit X-yoursite-MailScanner-Information: Dennis Glatting X-yoursite-MailScanner-ID: q9L0AvWx057130 X-yoursite-MailScanner: Found to be clean X-MailScanner-From: freebsd@pki2.com X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 21 Oct 2012 00:11:04 -0000 I chosen the LSI2008 chip set because the code was donated by LSI, and they therefore demonstrated interest in supporting their products under FreeBSD, and that chip set is found in a lot of places, notably Supermicro boards. Additionally, there were stories of success on the lists for several boards. That said, I have received private email from others expressing frustration with ZFS and the "hang" problems, which I believe are also the LSI chips. I have two questions for the broader list: 1) What HBAs are you using for ZFS and what is your level of success/stability? Also, what is your load? 2) How well is the LSI chip sets supported under FreeBSD? I'm not all that crazy on the idea of replacing eight to ten LSI boards but I am less crazy on the idea of this problem's continuance. I do have three Areca 1880i boards (not used for ZFS, rather dumb RAID) however two of them failed within the first year for no apparent reason -- I just walked in my lab one day and was greeted by hosed systems. Consequently, I'm not all that keen on Areca. I am in the process of releasing a spec for purchase of a Supermicro in a SC848 chassis, and an identical one next FY. I would appreciate a clue as to what HBA would be a good/better choice. The vendor spec'd Supermicro boards with the LSI2008 chips. I own four or six of the AOC-USAS2-L8e boards, two of which I destroyed, but there wasn't much difference between them and the 9211.