From owner-freebsd-fs@freebsd.org Mon Aug 22 16:29:03 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2FA1ABC2C06 for ; Mon, 22 Aug 2016 16:29:03 +0000 (UTC) (envelope-from fjwcash@gmail.com) Received: from mail-oi0-x22a.google.com (mail-oi0-x22a.google.com [IPv6:2607:f8b0:4003:c06::22a]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id E85351DF8 for ; Mon, 22 Aug 2016 16:29:02 +0000 (UTC) (envelope-from fjwcash@gmail.com) Received: by mail-oi0-x22a.google.com with SMTP id l203so158853534oib.1 for ; Mon, 22 Aug 2016 09:29:02 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=lyu/f3PX6sLXwrSTk8kF8u7qiHJhOr8VzqU12NvPg70=; b=STfUrhPAwBG69kgqqsKMasE2k50qLNAZYAQpqfm149GiXUIfWZVxSJehI/1NtJh2uY jro1DM8oQJg2vSMkd61uaZXL8LuesiU0jYWTLn9kmexsWbucW8sbJ9C93WyTGkhEbTRJ QFEf1TskrNiRwAWnUgbHPtgwPLULOxBLPV0vAoKeELZZJgqYNZnXwZeLEhugG6TcmNYh 7cMD45lgNnNJ8uzcVevIJO2fLdtaLoiVPwMyJnmFxrYk+pPK+d6+XLYF16mB02DFbIEL xDtLKy/qga7A0S08QDxLpGDh3MjcnWu1QhXCWN1XSsAYDvz8fCS7h1/giz3TsBtiSmlc Y1JQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=lyu/f3PX6sLXwrSTk8kF8u7qiHJhOr8VzqU12NvPg70=; b=jGd5w7gGo0P9j3DVbQ4amgLY04OglcnNdYXBC4ZmrfQUJbJ164EW+XhlP4bM0f40Wq GhuuWR4nkkQl4AQUus5y8WgBWz60hwwNuH1O6xYF0nryW934jhfKyE77b+Sy6rhyjyop omQnEZgw98oxHhTh0WlSCv+/HYodDXyiO60vkiXbhZ++QPRPGuB0ygUFYhxBSzM2gPwy 0jbcvmoAveH95/+Z1YAoatxjJuEmEER5K7VGX1iHRjkAWM6rMI+5phHbESH1D3mW2rjJ XkmidwVyuPDdTYXh0dyNpgZa1khfHTMJB2KRPx0sz1pef8V1oJ/OStQRZJ+eYLpNS4wn xElQ== X-Gm-Message-State: AEkoout7gNzIbZlBZRBfMij06K5/2C1A2OApidaSWDUgNqVnqO2MnfMaqdVQb8wRC91+KyvB3ZdFGPGXP+Tcfw== X-Received: by 10.157.35.49 with SMTP id j46mr14941205otb.38.1471883342295; Mon, 22 Aug 2016 09:29:02 -0700 (PDT) MIME-Version: 1.0 Received: by 10.202.237.68 with HTTP; Mon, 22 Aug 2016 09:29:01 -0700 (PDT) In-Reply-To: References: From: Freddie Cash Date: Mon, 22 Aug 2016 09:29:01 -0700 Message-ID: Subject: Re: Recommended HBA for ZFS, contemporary To: Karl Denninger Cc: FreeBSD Filesystems Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.22 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 22 Aug 2016 16:29:03 -0000 On Mon, Aug 22, 2016 at 9:22 AM, Karl Denninger wrote: > I'm still a fan of the LSI SAS-9211 cards along with (for higher > density) a SAS port expander. I've been extremely happy with this > combination with one caveat -- most systems must boot from the actual > card and not a port on the expander(s) you connect to it due to BIOS > constraints. They're also crazily cost-effective on-balance. > > In practice this means you have 4 ports on the base card available (2 > used for mirrored boot drives, 2 for other things) and the rest of the > disks go on the expander, or you run more than one card. > =E2=80=8BAlternatively, you can use the SATA/SAS ports on the motherboard f= or the OS drives / to boot from, leaving all the ports on the HBAs for the data disks. :) We also use the motherboard ports for the ZFS Log and Cache devices, to separate the I/O channels. Granted, this depends on the motherboard having good quality SATA controllers, but most are good enough for booting/loading programs from. > The "smarter" the card the dumber the results tend to be when ZFS is in > use, in my experience :) > =E2=80=8BThat's a great way to explain things. Will have to remember that = one!=E2=80=8B --=20 Freddie Cash fjwcash@gmail.com