From owner-freebsd-questions@freebsd.org Mon Mar 12 22:18:17 2018 Return-Path: Delivered-To: freebsd-questions@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A3F36F4FF9C; Mon, 12 Mar 2018 22:18:17 +0000 (UTC) (envelope-from vrwmiller@gmail.com) Received: from mail-ua0-x242.google.com (mail-ua0-x242.google.com [IPv6:2607:f8b0:400c:c08::242]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 344EE777F9; Mon, 12 Mar 2018 22:18:17 +0000 (UTC) (envelope-from vrwmiller@gmail.com) Received: by mail-ua0-x242.google.com with SMTP id c14so7916302uak.7; Mon, 12 Mar 2018 15:18:17 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=Yc3dGhWuBJH+uN3w68cIQ7LnX5govoeC1Inhaa3H3IM=; b=dkdul6Vci7YodimGZEqmP4A5mUe4ZAmvNMMsqg/pikburjSm6R0FRjm9aSbNhgKAUU D3wdm+VK4xMFjtFMtt22phj6dh409zuAiKn1HWIKIraKCGWJO8Cr4hTLZqriAeCJS+Q2 XC3coqBjfJnlG2Ez7EJKdc/O3D+2CeQaZOMMRhC4VmMiuIfgHDcoy0rPdLuvkrjwxk5j SPsbWBXSU16xiAKfjjpgkLooylw1pd1JiOWNmEqjB4txmC6S3feH4BnkpGuA9xIjKcM1 OnQo6KBb6+riY+DrtGTpFFC3kW55y9qTWlfr3xUrXIH+COsltsFc+lkO0UvQFyURybkM p0dA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=Yc3dGhWuBJH+uN3w68cIQ7LnX5govoeC1Inhaa3H3IM=; b=MHcHnq88XvLZzweAAP+EJp2PkAHohhRc//z12rPL5QECe032RuEcEZK5RGABdeCZ1z pV/2oB4VlzbnSE7Vh6OXbYCh/F3mfkOKnTENRNtuRA7SRdhT9QpzG7Web0aG6Y46BRxF aMwMxPZr2e9auhgaTqH1bnOZ2jDCWVfhqAS2MLIMiEH7x3MJCl8WpZ2ICOc6SIM6xk0o B4UAf5ab3aNvutU/vXul3KmQdg95Opp5w21HuVyJEAi11MHbrDuFgZl075qCmfZZRzTr MHyYKqy440uqTfnB9cZaaBqjMHxXgDbEZyQKheCCuWBAZVmR+tiXuTZUeHdtghc/m8UM GSSg== X-Gm-Message-State: AElRT7EOFYtyJcSNT7t34L/4gr3V473FHZwr565P7h5AXGhWfwzhCQ/i 3Psx4RSXFopwC1f7iadRxCUNawyB+T6ME4TlZf1IDw== X-Google-Smtp-Source: AG47ELs2tzW3Mlq4ihe6a8vk1EHpmsJk0+htOSCVhEgNsKBZcKB70lxdQDmFOWI7FmIgd7jSi3DZWX8mx6gLCH6C1Lg= X-Received: by 10.176.75.216 with SMTP id b24mr6290580uag.137.1520893095160; Mon, 12 Mar 2018 15:18:15 -0700 (PDT) MIME-Version: 1.0 Received: by 10.176.73.195 with HTTP; Mon, 12 Mar 2018 15:18:14 -0700 (PDT) From: Rick Miller Date: Mon, 12 Mar 2018 18:18:14 -0400 Message-ID: Subject: FreeBSD 11.x fails to boot w/ SAS3 4Kn HDD and LSISAS3008 on SuperMicro X10DRH-iT To: FreeBSD Questions , freebsd-geom@freebsd.org, freebsd-stable@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.25 X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 12 Mar 2018 22:18:18 -0000 Hi all, Thanks in advance to anyone that might be able to help. I subscribed to freebsd-geom@ so that the list did not need to "reply-all". Having trouble getting FreeBSD 11-STABLE @ r329011 to boot from SAS3 4Kn HDDs via LSISAS 3008 HBA on a SuperMicro X10DRH-iT motherboard after an apparent installation. All internal media (including all other disks attached to the HBA) were removed to eliminate other storage being the reason the system won't boot. This occurs specifically in CSM mode, but the preference is to boot via UEFI mode instead. Anyway...booting the machine via the memstick image demonstrates the LSISAS 3008 controller attaching via mpr(4) (whose manpage describes the controller being supported[1]): mpr0@pci0:3:0:0: class=0x010700 card=0x080815d9 chip=0x00971000 rev=0x02 hdr=0x00 vendor = 'LSI Logic / Symbios Logic' device = 'SAS3008 PCI-Express Fusion-MPT SAS-3' class = mass storage subclass = SAS The only inserted disk attaches as da0 as illustrated by dmesg: ses0: pass0,da0: Elemne t descriptor: 'Slot00' da0 at mpr0 bus 0 scbus0 target 8 lun 0 ses0: pass0,da0: SAS Device Slot Element: 1 Phys at Slot 0 ses0: phy 0: SAS device type 1 id 0 ses0: phy 0: protocols: initiator( None ) Target( SSP ) ses0: phy 0: parent 500304801e870bff addr 5000c500a012814d da0: Fixed Direct Access SPC-4 SCSI device da0: Serial Number $serial_number da0: 1200.000MB/s transfers da0: Command queueing enabled da0: 1907729MB (488378648 4096 byte sectors) The original goal was to boot via zfs root, but when that failed, subsequent installations used the "Auto (UFS) option" to partition the disk. For example, the first installation gpart'd the disk as: # gpart show da0 => 6 488378635 da0 GPT (1.8T) 6 128 1 freebsd-boot (512K) 134 487325568 2 freebsd-ufs (1.8T) 487325702 1048576 3 freebsd-swap (4.0G) 488374278 4363 - free - (17M) The result was a reboot loop. When the system reached the point of reading the disk, it just rebooted and continued doing so. There was no loader or beastie menu. Thus, thinking that it could be the partition layout requirements of the 4Kn disks, it was gpart'd like the below[2][3]. This was done by exiting to the shell during the partition phase of bsdinstall and manually gpart'ing the disk according to the below, mounting da0p2 at /mnt and placing an fstab at /tmp/bsdinstall_etc/fstab that included mount entries for /dev/da0p2 at / and /dev/da0p3 as swap. # gpart show da0 => 6 488378635 da0 GPT (1.8T) 6 34 - free - (136K) 40 512 1 freebsd-boot (2.0M) 552 419430400 2 freebsd-ufs (1.6T) 419430952 1048576 3 freebsd-swap (4.0G) 420479528 67899113 - free - (259G) When configured as such, the system rebooted at the completion of the install and appeared to roll through the boot order, which specifies the HDD first, then CD/DVD, then network. It did attempt to boot via network, but is irrelevant here. All the hardware is alleged to be supported by FreeBSD as best I can tell and OS installation apparently works. I'm at a loss as to why the OS won't boot. Does someone have feedback or input that may expose why it doesn't boot? FWIW, a RHEL7 install was also attempted, which also does not boot. [1] https://www.freebsd.org/cgi/man.cgi?query=mpr&apropos=0&sektion=4&manpath=FreeBSD+11.1-RELEASE&arch=default&format=html [2] https://lists.freebsd.org/pipermail/freebsd-hardware/ 2013-September/007380.html [3] http://www.wonkity.com/~wblock/docs/html/disksetup.html -- Take care Rick Miller