From owner-freebsd-drivers@freebsd.org Wed May 30 03:44:25 2018 Return-Path: Delivered-To: freebsd-drivers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 83C19EF941E for ; Wed, 30 May 2018 03:44:25 +0000 (UTC) (envelope-from rowley.evan@gmail.com) Received: from mail-io0-x233.google.com (mail-io0-x233.google.com [IPv6:2607:f8b0:4001:c06::233]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 146D16CD9F for ; Wed, 30 May 2018 03:44:25 +0000 (UTC) (envelope-from rowley.evan@gmail.com) Received: by mail-io0-x233.google.com with SMTP id g1-v6so20028924iob.2 for ; Tue, 29 May 2018 20:44:25 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=OMNL6FpVUCdnkMsLOwpL2mGudw70D2rNWXqqzyxup+g=; b=eN8851/mgiFwm0/2uza8PcHpF5Twypevq6boOYPc3b2xIIonk7IWYkKLxJsJcwq7z3 3m6fR5ERpmjpfRj98L9CYPv0je1EJEiz0VYMMLCK0k85i3Z8mMu9fCYPFpX8gu4fVTPb vA6WnFKp8gQH124FuniWeUa8Ix3n57kK0BlDXPkVlS/CJFsqhcMFZQct46KbP26j/lSS 5KaYOoZBuYWcu9X+8DWAzhzNTZSBGBGaQXZSiq1IW0cmImwLwC71PLjcfC0aq0UW/U1w ZhHiaD7kF6qAAvlj26K+C0cbFyVpPMsbUfZoh9eHChWVDqSjK3vonmqISRv2pZEO1tyP WDTg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=OMNL6FpVUCdnkMsLOwpL2mGudw70D2rNWXqqzyxup+g=; b=kUcREHEp+K+pPbmnxz2rfZCrWYe+03hA1+3Z1HhtbguZTl2JY3RuPzrgDyocBZXx3O 1Rd5Plx4scWb9p5rjcgz9pF/qu2xmzj639xiL/8PNIJgUVOlHn6r+9PxLOu2o3048m9d 9EXlSw55ZFkoZ2tOUjw51j+AD5MbIp+RSEL9FsViagkIWPMOVKMBOaYY/Fn03Dvq4qnm YXSzXJhQF4oGIM6wqOooVCGPauSE3OlGPBFLiYLOp0KLImpCikoxbFfwL4QJPNcTM64E OjaVcuEgex6ffkS+8EUwzq2Tzcr0QSoEWvsd6eB/jVwjicmdfNCxjPh3KvC4+z2v3jHx PkEQ== X-Gm-Message-State: APt69E0GF3jfem1jEBBZPVaZ2cvQDzSGpw5+flKCnNO+cSg+JKi0zWzr Ak5vKIwiiB56JSnjrXTxBcvjkKwUUFnOs4rj78+J071p X-Google-Smtp-Source: ADUXVKI2TpCh4c9ev///4b2zLjHTS5/HZVrhpWE6fYzdGpcOTyeCxjV5OPo2/Psb/sfg5gtGJPnPTAjTFacLA/SwoFI= X-Received: by 2002:a6b:3110:: with SMTP id j16-v6mr773922ioa.249.1527651864066; Tue, 29 May 2018 20:44:24 -0700 (PDT) MIME-Version: 1.0 Received: by 2002:a4f:1f42:0:0:0:0:0 with HTTP; Tue, 29 May 2018 20:44:23 -0700 (PDT) In-Reply-To: References: <94579286-7fcc-86ff-41d3-ceb6508f9b11@disroot.org> From: Evan Rowley Date: Tue, 29 May 2018 23:44:23 -0400 Message-ID: Subject: Re: Matching mps driver in 11.1-STABLE to LSI 2008 firmware To: "Peter G." Cc: freebsd-drivers@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.26 X-BeenThere: freebsd-drivers@freebsd.org X-Mailman-Version: 2.1.26 Precedence: list List-Id: Writing device drivers for FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 30 May 2018 03:44:25 -0000 Hi All, I realized that for some time I had been messaging Peter directly (Sorry about that!), and not the FreeBSD drivers mailing list. I have come to the conclusion that this is not a firmware/driver mismatch issue, rather it appears to be quirkiness with how FreeBSD 11.1 handles these particular drives. This conclusion was reached after updating the LSI SAS 2008 firmware on several machines to the latest version & still seeing drive errors. Interestingly, I can get these drives working fine under both Ubuntu 16.04 and SmartOS. Fromatting, creating a zpool, and doing ZFS scrubs all work OK. The errors shown in the following Gist are what I see on every FreeBSD machine I connect these to, even on machines which don't have an LSI SAS 2008 controller: https://gist.github.com/equalunique/ b34cd7d88b98d750074b82540c576d37 Many of these errors show up for each SAS drive: (da0:mps0:0:15:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code) (da0:mps0:0:15:0): Error 22, Unretryable error (da0:mps0:0:15:0): READ(10). CDB: 28 00 74 70 6d af 00 00 01 00 (da0:mps0:0:15:0): CAM status: SCSI Status Error (da0:mps0:0:15:0): SCSI status: Check Condition (da0:mps0:0:15:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code) (da0:mps0:0:15:0): Error 22, Unretryable error The drives are IBM branded Seagate ST1000NM0001 drives, matching FRU numbers 49Y1903, 49Y1930, and 49Y1939. Possibly related, here is another user reporting similar errors with FreeBSD 9 and the same model of Seagate disk: https://groups.google.com/ forum/#!topic/mailing.freebsd.questions/HplQgV3oy88 On Fri, Apr 27, 2018 at 5:47 PM, Peter G. wrote: > On 27/04/2018 21:56, Evan Rowley wrote: > > Thank you for your email! Sorry, I was confused before and specified > > 11.1-STABLE when I actually meant 11.1-RELEASE. > > > > Most likley I will need to flash these to the firmware version you are > > using: 20.00.07.00 > > > > Here are pictures of what I see using v19 firmware, which did work stable > > on older versions of FreeBSD's mps driver: http://imgur.com/gallery/ > Ka5naWd > > > > I wish there was a way to determine before testing which version firmware > > newer versions of FreeBSD mps driver require. > > Please just post your whole dmesg, so e.g. we could see what controller > that is and how the system recognizes it. > > -- > PG > -- - EJR