From owner-freebsd-stable@freebsd.org Sat Nov 14 17:48:27 2015 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7E7CFA2F121 for ; Sat, 14 Nov 2015 17:48:27 +0000 (UTC) (envelope-from stephen.mcconnell@avagotech.com) Received: from mail-pa0-x233.google.com (mail-pa0-x233.google.com [IPv6:2607:f8b0:400e:c03::233]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 506DA1455 for ; Sat, 14 Nov 2015 17:48:27 +0000 (UTC) (envelope-from stephen.mcconnell@avagotech.com) Received: by pacdm15 with SMTP id dm15so131146157pac.3 for ; Sat, 14 Nov 2015 09:48:26 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=avagotech.com; s=google; h=from:references:in-reply-to:mime-version:thread-index:date :message-id:subject:to:cc:content-type; bh=iZmCo413bd/fPfDo6eRIlNPAxbsawdAO49apxIB6a8M=; b=pPNGZK+/HMX91WFX6+zqzYOYhODTWW4otybW/UWZJ7FLzyBBQJkytiI4FNcJXwnOzE ZG7uaq8mrQ4OzOW4vc+f+1ZWdcz7fmhm0pXZ+qQDDHDSKVwJ8QiSApHnH3rmGioS0EV/ fhPihtnFy0fvFEvxD8dAex0rVmLrU4ImxwrpI= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:from:references:in-reply-to:mime-version :thread-index:date:message-id:subject:to:cc:content-type; bh=iZmCo413bd/fPfDo6eRIlNPAxbsawdAO49apxIB6a8M=; b=GZxElWw/NLUsf4nBB44Sn9e9Adf2EGTQFOZrz0VBHblZU02NpzKbMcrwQADOZyLIaY rcyLGRFBe8tltl6JG7IKfqHTvwRIrkkhNGblN7SpubralgZbjRgqDvdcYfFSLgBrbCSE FJSksgBklaMnnD7W1pGlo6YwcA4mU8+oF/2nCiD4MaHtpuq0zxuqzZ7tap9TehBM+i6Y KGYqvN0dwu45kD21mwhc8WzKDU6gsc1LNOAhCA81YwW5QfkIUWByomp7KJGAL2onOft9 pHJ07RkVz97H6BhfeidPH1sxMYvtjymd66cZHDf/8DU7WQe5PvuI8U2jvKU/e/vBYXmz 2Jvw== X-Gm-Message-State: ALoCoQkgfqHfwc3GeYXssU1BxuFXuAD3wyTJsQ2tTrExrKciJQCGMrrHddYAvSI/6jh+Uo9z0wTi X-Received: by 10.68.234.166 with SMTP id uf6mr41213699pbc.126.1447523306653; Sat, 14 Nov 2015 09:48:26 -0800 (PST) From: Stephen Mcconnell References: <5644FF09.9090200@free.de> <56472686.5030301@free.de> <20151114143104.GA41119@in-addr.com> In-Reply-To: <20151114143104.GA41119@in-addr.com> MIME-Version: 1.0 X-Mailer: Microsoft Outlook 14.0 Thread-Index: AQFhXRusR+GdddNzZ8oSjZyIsh0UKQMSh1vDAl0LBhUDGm818582+0og Date: Sat, 14 Nov 2015 10:48:24 -0700 Message-ID: Subject: RE: LSI SAS2008 mps driver preferred firmware version To: Gary Palmer , Kai Gallasch Cc: freebsd-scsi@freebsd.org, Royce Williams , freebsd-stable Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 14 Nov 2015 17:48:27 -0000 > -----Original Message----- > From: owner-freebsd-scsi@freebsd.org [mailto:owner-freebsd- > scsi@freebsd.org] On Behalf Of Gary Palmer > Sent: Saturday, November 14, 2015 7:31 AM > To: Kai Gallasch > Cc: freebsd-scsi@freebsd.org; Royce Williams; freebsd-stable > Subject: Re: LSI SAS2008 mps driver preferred firmware version > > On Sat, Nov 14, 2015 at 01:18:14PM +0100, Kai Gallasch wrote: > > On 12.11.2015 23:20 Royce Williams wrote: > > > Firmware should match driver, e.g.: > > > > > > mps0: Firmware: 19.00.00.00, Driver: 19.00.00.00-fbs > > > > > > > > > Some of this may help -- not yet updated for 10.2, but may still be useful: > > > > > > http://roycebits.blogspot.com/2015/01/freebsd-lsi-sas9211-8i-hba-fir > > > mware.html > > > > Thanks! Lots of information about reflashing the 9211-8i. > > So I upgraded the old firmare of the controller from > > > > mps0: Firmware: 05.00.17.00, Driver: 20.00.00.00-fbsd to mps0: > > Firmware: 20.00.04.00, Driver: 20.00.00.00-fbsd (FreeBSD 10.2) > > > > As I understand it the firmware 20.00.00.00 was pulled by avago and > > replaced with the fixed version 20.00.04.00 > > > > I will give feedback if I notice any problems with this FW version. > > > > As a side note: Flashing the 9211-8i to the new firmware version > > changed the way FreeBSD orders the disk devices on this server: > > > > With the old firmware it looked like this: > > > > root@:~ # camcontrol devlist > > at scbus0 target 10 lun 0 (pass0,da0) > > at scbus0 target 11 lun 0 (pass1,da1) > > at scbus0 target 12 lun 0 (pass2,da2) > INTEL SSDSC2BA10 0270> at scbus0 target 13 lun 0 (pass3,da3) > WD2001FYYG-01SL3 VR08> at scbus0 target 14 lun 0 (pass4,da4) > WD2001FYYG-01SL3 VR08> at scbus0 target 15 lun 0 (pass5,da5) > WD2001FYYG-01SL3 VR08> at scbus0 target 16 lun 0 (pass6,da6) > WD2001FYYG-01SL3 VR08> at scbus0 target 17 lun 0 (pass7,da7) > WD2001FYYG-01SL3 VR08> at scbus0 target 18 lun 0 (pass8,da8) > WD2001FYYG-01SL3 VR08> at scbus0 target 19 lun 0 (pass9,da9) > WD2001FYYG-01SL3 VR08> at scbus0 target 20 lun 0 (pass10,da10) > WD2001FYYG-01SL3 VR08> at scbus0 target 21 lun 0 (pass11,da11) > HYDE12 0341> at scbus0 target 22 lun 0 (pass12,ses0) > Enclosure 1.00 0001> at scbus7 target 0 lun 0 (pass13,ses1) > > > > The order is according to the order the disks are placed in the drive > > bays: (da0, bay1; da1, bay2, ..) > > > > > > With the new firmware it now looks like this: > > > > at scbus0 target 8 lun 0 (pass0,da0) > WD2001FYYG-01SL3 VR08> at scbus0 target 9 lun 0 (pass1,da1) > WD2001FYYG-01SL3 VR08> at scbus0 target 10 lun 0 (pass2,da2) > WD2001FYYG-01SL3 VR08> at scbus0 target 11 lun 0 (pass3,da3) > WD2001FYYG-01SL3 VR08> at scbus0 target 12 lun 0 (pass4,da4) > WD2001FYYG-01SL3 VR08> at scbus0 target 13 lun 0 (pass5,da5) > WD2001FYYG-01SL3 VR08> at scbus0 target 14 lun 0 (pass6,da6) > WD2001FYYG-01SL3 VR08> at scbus0 target 15 lun 0 (pass7,da7) > INTEL SSDSC2BA10 0270> at scbus0 target 16 lun 0 (pass8,da8) > INTEL SSDSC2BA10 0270> at scbus0 target 17 lun 0 (pass9,da9) > HUS156030VLS600 A5D0> at scbus0 target 18 lun 0 (pass10,da10) > HUS156030VLS600 A760> at scbus0 target 19 lun 0 (pass11,da11) > HYDE12 0341> at scbus0 target 20 lun 0 (pass12,ses0) > Enclosure 1.00 0001> at scbus7 target 0 lun 0 (pass13,ses1) > > > > So now the drive stuck in the last drive bay is seen as da0 and the > > drive in the first drive bay as da11 > > > > But: In the controller BIOS the scan order of the drives did not > > change at all with the new firmware! So the change is only in the way > > FreeBSD sees the drives. > > > > My explanation for this change in drive ordering is, that my 9211-8i > > is a SUN branded one (SGX-SAS6-INT-Z) and the server is a SUN server. > > So maybe the original firmware contained some adaptations for this > > server, that are missing in the new firmware. > > > > Can the way FreeBSD orders scanned SAS drives be changed? If not, no > > problem, as I use partition labels for my zfs pools and the disks are > > also labeled on the server as well. > > You can do thinks in /boot/loader.conf to hard code bus and drive > assignments. > > e.g. > > hint.da.0.at="scbus0" > hint.da.0.target="19" > hint.da.0.unit="0" > hint.da.1.at="scbus0" > hint.da.1.target="18" > hint.da.1.unit="0" > > See scsi(4) or cam(4) for more hints. > > You're probably better off using GPT labels though, as they will survive any > future disk order changes. The fact the target numbers changed means that > loader.conf changes will fix the current issue but may not work properly after > any future firmware updates. > > Gary The driver and card have a way of keeping the order of disks persistent across reboots. Probably the reason that your drive order has changed is when you flashed the new firmware on the card, the NVRAM that stores this information on your card was erased. You can set your card up for either disk persistent mapping or Enclosure/Slot mapping or you can turn mapping off all together. When you boot up the first time, as disks are discovered they are placed in the mapping table on the card and then kept in that order forever, until the data is erased or mapping is turned off. So, I would say it's possible that you do not have mapping turned on or it's possible that the new firmware changed this setting from disk persistence to Enclosure/Slot persistence or vice versa, or something like that. Maybe too much information, but that's probably what happened. > _______________________________________________ > freebsd-scsi@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-scsi > To unsubscribe, send any mail to "freebsd-scsi-unsubscribe@freebsd.org"