Date: Fri, 11 Dec 2015 22:02:02 -0500 From: Mykel@mWare.ca To: freebsd-scsi@freebsd.org Subject: Re: Informal(?) sesX messages Message-ID: <566B8E2A.8070404@mWare.ca> In-Reply-To: <CAOtMX2ibBUkS58EXfTc=Aznf_oc%2B_y4fC1xNAo=1F-yNSmTwSA@mail.gmail.com> References: <566B4F68.2040807@mWare.ca> <CAOtMX2ibBUkS58EXfTc=Aznf_oc%2B_y4fC1xNAo=1F-yNSmTwSA@mail.gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
On 15-12-11 17:44, Alan Somers wrote: > On Fri, Dec 11, 2015 at 3:34 PM, <Mykel@mware.ca> wrote: >> Hi all, please CC me on reply as I'm not subscribed to this list. >> >> I've got one of those Supermicro 72-drive monster machines, all ZFS'd = up. >> https://www.supermicro.com/products/system/4u/6048/SSG-6048R-E1CR72L.c= fm >> >> And before & after replacing a faulty SAS Expander and a pair of = cables >> (gobs of WRITE/ABORT errors), I'm still occasionally seeing these = kernel >> messages (in groups), and I'm not sure if they're benign, or pointing = to a >> SAS expander event... or what. I admit, this is my first time dealing = with a >> machine with SAS expanders, so I'm a bit out of my depth in diagnosis >> thereof. >> >> Dec 11 16:06:54 ZFS-AF kernel: ses5: da7,pass7: Element descriptor: = 'Slot00' >> Dec 11 16:06:54 ZFS-AF kernel: ses5: da7,pass7: SAS Device Slot = Element: 1 >> Phys at Slot 0 >> Dec 11 16:06:54 ZFS-AF kernel: ses5: phy 0: SAS device type 1 id 0 >> Dec 11 16:06:54 ZFS-AF kernel: ses5: phy 0: protocols: Initiator( = None ) >> Target( SSP ) >> Dec 11 16:06:54 ZFS-AF kernel: ses5: phy 0: parent 500304801ea2df3f = addr >> 5000c500844bd449 >> > These look like device arrival notifications. If you scroll up, do > you see any departure notifications? They should look like this: > > mps0: mpssas_prepare_remove: Sending reset for target ID 10 > da0 at mps0 bus 0 scbus0 target 10 lun 0 > da0: <ATA Hitachi HUA72201 A39C> s/n JPW930HQ15H26H detached > mps0: Unfreezing devq for target ID 10 > xpt_release_devq(): requested 1 > present 0 > (da0:mps0:0:10:0): Periph destroyed > > Also, could you post your HBA and expander firmware versions? For the > HBA, use "sysctl dev.mps.0.firmware_version". For the expander, > install sg3_utils and do "sg_inq --hex --len=3D64 ses0". The firmware > version is the dotted quad at the end. > > # sg_inq --hex --len=3D64 ses0 > 00 0d 00 05 02 34 00 40 02 41 49 43 20 43 4f 52 50 ....4.@.AI= C CORP > 10 53 41 53 20 36 47 20 45 78 70 61 6e 64 65 72 20 SAS 6G = Expander > 20 30 62 30 31 78 33 36 2d 31 2e 31 31 2e 31 2e 31 0b01x36-1.= 11.1.1 > 30 00 20 20 20 20 20 20 20 > > -Alan I can say, without doubt, that I do NOT have any preceding=20 detachments... which is why I'm so baffled by the messages. If the=20 devices aren't de/reattaching, what's the point of these informal/benign=20 ones? I am familiar with them from other hot-swap and disk failure=20 scenarios in other machines. Could this be a driver bug not logging the disconnection? But when I=20 hot-unplugged them, I do see that in dmesg. Or does SAS do something where it might renegotiate or reconfigure the=20 lanes, and I'm just seeing it do that? Thanks, Myke dev.mpr.0.driver_version: 09.255.01.00-fbsd dev.mpr.0.firmware_version: 06.00.00.00 dev.mpr.1.driver_version: 09.255.01.00-fbsd dev.mpr.1.firmware_version: 08.00.00.00 dev.mpr.2.driver_version: 09.255.01.00-fbsd dev.mpr.2.firmware_version: 08.00.00.00 [root@ZFS-AF ~]# sg_inq --hex --len=3D64 ses0 00 0d 00 05 02 33 00 40 02 4c 53 49 20 20 20 20 20 ....3.@.LSI 10 53 41 53 33 78 34 38 20 20 20 20 20 20 20 20 20 SAS3x48 20 30 37 30 31 78 34 38 2d 36 36 2e 37 2e 31 2e 31 0701x48-66.7.1.= 1 30 37 00 20 20 20 20 20 20 7. [root@ZFS-AF ~]# sg_inq --hex --len=3D64 ses1 00 0d 00 05 02 33 00 40 02 4c 53 49 20 20 20 20 20 ....3.@.LSI 10 53 41 53 33 78 33 36 20 20 20 20 20 20 20 20 20 SAS3x36 20 30 37 30 31 78 33 36 2d 36 36 2e 37 2e 31 2e 31 0701x36-66.7.1.= 1 30 37 00 20 20 20 20 20 20 7. [root@ZFS-AF ~]# sg_inq --hex --len=3D64 ses2 SCSI INQUIRY failed on ses2, res=3D-1 [root@ZFS-AF ~]# sg_inq --hex --len=3D64 ses3 SCSI INQUIRY failed on ses3, res=3D-1 [root@ZFS-AF ~]# sg_inq --hex --len=3D64 ses4 00 0d 00 05 02 33 00 40 02 4c 53 49 20 20 20 20 20 ....3.@.LSI 10 53 41 53 33 78 32 38 20 20 20 20 20 20 20 20 20 SAS3x28 20 30 37 30 31 78 32 38 2d 36 36 2e 37 2e 31 2e 31 0701x28-66.7.1.= 1 30 37 00 20 20 20 20 20 20 7. [root@ZFS-AF ~]# sg_inq --hex --len=3D64 ses5 00 0d 00 05 02 33 00 40 02 4c 53 49 20 20 20 20 20 ....3.@.LSI 10 53 41 53 33 78 34 38 20 20 20 20 20 20 20 20 20 SAS3x48 20 30 37 30 31 78 34 38 2d 36 36 2e 37 2e 31 2e 31 0701x48-66.7.1.= 1 30 37 00 20 20 20 20 20 20 7. [root@ZFS-AF ~]# And here's dmesg after fresh reboot: [root@ZFS-AF ~]# dmesg Copyright (c) 1992-2015 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 10.2-RELEASE-p7 #0: Mon Nov 2 14:19:39 UTC 2015 root@amd64-builder.daemonology.net:/usr/obj/usr/src/sys/GENERIC amd64 FreeBSD clang version 3.4.1 (tags/RELEASE_34/dot1-final 208032) 20140512 CPU: Intel(R) Xeon(R) CPU E5-2609 v3 @ 1.90GHz (1900.04-MHz K8-class CPU) Origin=3D"GenuineIntel" Id=3D0x306f2 Family=3D0x6 Model=3D0x3f = Stepping=3D2 Features=3D0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PG= E,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE> Features2=3D0x7ffefbff<SSE3,PCLMULQDQ,DTES64,MON,DS_CPL,VMX,SMX,EST,TM2,S= SSE3,<b11>,FMA,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,= TSCDLT,AESNI,XSAVE,OSXSAVE,AVX,F16C,RDRAND> AMD Features=3D0x2c100800<SYSCALL,NX,Page1GB,RDTSCP,LM> AMD Features2=3D0x21<LAHF,ABM> Structured Extended=20 Features=3D0x37ab<FSGSBASE,TSCADJ,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,NF= PUSG> XSAVE Features=3D0x1<XSAVEOPT> VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics real memory =3D 137438953472 (131072 MB) avail memory =3D 133408280576 (127228 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: <ALASKA A M I > FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs FreeBSD/SMP: 2 package(s) x 6 core(s) cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 2 cpu2 (AP): APIC ID: 4 cpu3 (AP): APIC ID: 6 cpu4 (AP): APIC ID: 8 cpu5 (AP): APIC ID: 10 cpu6 (AP): APIC ID: 16 cpu7 (AP): APIC ID: 18 cpu8 (AP): APIC ID: 20 cpu9 (AP): APIC ID: 22 cpu10 (AP): APIC ID: 24 cpu11 (AP): APIC ID: 26 ioapic0 <Version 2.0> irqs 0-23 on motherboard ioapic1 <Version 2.0> irqs 24-47 on motherboard ioapic2 <Version 2.0> irqs 48-71 on motherboard random: <Software, Yarrow> initialized module_register_init: MOD_LOAD (vesa, 0xffffffff80db8e60, 0) error 19 kbd1 at kbdmux0 acpi0: <ALASKA A M I > on motherboard acpi0: Power Button (fixed) cpu0: <ACPI CPU> on acpi0 cpu1: <ACPI CPU> on acpi0 cpu2: <ACPI CPU> on acpi0 cpu3: <ACPI CPU> on acpi0 cpu4: <ACPI CPU> on acpi0 cpu5: <ACPI CPU> on acpi0 cpu6: <ACPI CPU> on acpi0 cpu7: <ACPI CPU> on acpi0 cpu8: <ACPI CPU> on acpi0 cpu9: <ACPI CPU> on acpi0 cpu10: <ACPI CPU> on acpi0 cpu11: <ACPI CPU> on acpi0 atrtc0: <AT realtime clock> port 0x70-0x71,0x74-0x77 irq 8 on acpi0 Event timer "RTC" frequency 32768 Hz quality 0 attimer0: <AT timer> port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 350 Event timer "HPET1" frequency 14318180 Hz quality 340 Event timer "HPET2" frequency 14318180 Hz quality 340 Event timer "HPET3" frequency 14318180 Hz quality 340 Event timer "HPET4" frequency 14318180 Hz quality 340 Event timer "HPET5" frequency 14318180 Hz quality 340 Event timer "HPET6" frequency 14318180 Hz quality 340 Event timer "HPET7" frequency 14318180 Hz quality 340 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: <ACPI Host-PCI bridge> on acpi0 pci255: <ACPI PCI bus> on pcib0 pcib1: <ACPI Host-PCI bridge> on acpi0 pci127: <ACPI PCI bus> on pcib1 pcib2: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0 pci0: <ACPI PCI bus> on pcib2 pcib3: <ACPI PCI-PCI bridge> irq 26 at device 1.0 on pci0 pci1: <ACPI PCI bus> on pcib3 pcib4: <ACPI PCI-PCI bridge> irq 32 at device 2.0 on pci0 pci2: <ACPI PCI bus> on pcib4 mpr0: <Avago Technologies (LSI) SAS3008> port 0x6000-0x60ff mem=20 0xc7400000-0xc740ffff irq 32 at device 0.0 on pci2 mpr0: IOCFacts : MsgVersion: 0x205 HeaderVersion: 0x2300 IOCNumber: 0 IOCExceptions: 0x0 MaxChainDepth: 128 NumberOfPorts: 1 RequestCredit: 3072 ProductID: 0x2221 IOCRequestFrameSize: 32 MaxInitiators: 1 MaxTargets: 256 MaxSasExpanders: 48 MaxEnclosures: 16 HighPriorityCredit: 128 MaxReplyDescriptorPostQueueDepth: 65504 ReplyFrameSize: 32 MaxVolumes: 0 MaxDevHandle: 313 MaxPersistentEntries: 128 mpr0: Firmware: 06.00.00.00, Driver: 09.255.01.00-fbsd mpr0: IOCCapabilities:=20 7a85c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,EventReplay,MSIXInde= x,HostDisc> pcib5: <ACPI PCI-PCI bridge> irq 32 at device 2.2 on pci0 pci3: <ACPI PCI bus> on pcib5 mpr1: <Avago Technologies (LSI) SAS3008> port 0x5000-0x50ff mem=20 0xc7240000-0xc724ffff,0xc7200000-0xc723ffff irq 34 at device 0.0 on pci3 mpr1: IOCFacts : MsgVersion: 0x205 HeaderVersion: 0x2300 IOCNumber: 0 IOCExceptions: 0x0 MaxChainDepth: 128 NumberOfPorts: 1 RequestCredit: 3072 ProductID: 0x2221 IOCRequestFrameSize: 32 MaxInitiators: 1 MaxTargets: 256 MaxSasExpanders: 48 MaxEnclosures: 16 HighPriorityCredit: 128 MaxReplyDescriptorPostQueueDepth: 65504 ReplyFrameSize: 32 MaxVolumes: 0 MaxDevHandle: 313 MaxPersistentEntries: 128 mpr1: Firmware: 08.00.00.00, Driver: 09.255.01.00-fbsd mpr1: IOCCapabilities:=20 7a85c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,EventReplay,MSIXInde= x,HostDisc> pcib6: <ACPI PCI-PCI bridge> irq 40 at device 3.0 on pci0 pci4: <ACPI PCI bus> on pcib6 pcib7: <ACPI PCI-PCI bridge> irq 40 at device 3.2 on pci0 pci5: <ACPI PCI bus> on pcib7 ix0: <Intel(R) PRO/10GbE PCI-Express Network Driver, Version - 2.8.3>=20 port 0x4020-0x403f mem 0xc7c00000-0xc7dfffff,0xc7e04000-0xc7e07fff irq=20 42 at device 0.0 on pci5 ix0: Using MSIX interrupts with 9 vectors ix0: Ethernet address: 0c:c4:7a:35:12:c0 ix0: PCI Express Bus: Speed 5.0GT/s Width x8 ix1: <Intel(R) PRO/10GbE PCI-Express Network Driver, Version - 2.8.3>=20 port 0x4000-0x401f mem 0xc7a00000-0xc7bfffff,0xc7e00000-0xc7e03fff irq=20 45 at device 0.1 on pci5 ix1: Using MSIX interrupts with 9 vectors ix1: Ethernet address: 0c:c4:7a:35:12:c1 ix1: PCI Express Bus: Speed 5.0GT/s Width x8 pci0: <unknown> at device 17.0 (no driver attached) ahci0: <Intel Wellsburg AHCI SATA controller> port=20 0x7110-0x7117,0x7100-0x7103,0x70f0-0x70f7,0x70e0-0x70e3,0x7020-0x703f=20 mem 0xc7538000-0xc75387ff irq 16 at device 17.4 on pci0 ahci0: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported ahcich0: <AHCI channel> at channel 0 on ahci0 ahcich1: <AHCI channel> at channel 1 on ahci0 ahcich2: <AHCI channel> at channel 2 on ahci0 ahcich3: <AHCI channel> at channel 3 on ahci0 ahciem0: <AHCI enclosure management bridge> on ahci0 xhci0: <XHCI (generic) USB 3.0 controller> mem 0xc7500000-0xc750ffff irq=20 19 at device 20.0 on pci0 xhci0: 32 bytes context size, 64-bit DMA usbus0 on xhci0 pci0: <simple comms> at device 22.0 (no driver attached) pci0: <simple comms> at device 22.1 (no driver attached) ehci0: <EHCI (generic) USB 2.0 controller> mem 0xc7534000-0xc75343ff irq=20 18 at device 26.0 on pci0 usbus1: EHCI version 1.0 usbus1 on ehci0 pcib8: <ACPI PCI-PCI bridge> irq 16 at device 28.0 on pci0 pci6: <ACPI PCI bus> on pcib8 pcib9: <ACPI PCI-PCI bridge> irq 16 at device 28.4 on pci0 pci7: <ACPI PCI bus> on pcib9 pcib10: <ACPI PCI-PCI bridge> at device 0.0 on pci7 pci8: <ACPI PCI bus> on pcib10 vgapci0: <VGA-compatible display> port 0x3000-0x307f mem=20 0xc6000000-0xc6ffffff,0xc7000000-0xc701ffff irq 16 at device 0.0 on pci8 vgapci0: Boot video device ehci1: <EHCI (generic) USB 2.0 controller> mem 0xc7533000-0xc75333ff irq=20 18 at device 29.0 on pci0 usbus2: EHCI version 1.0 usbus2 on ehci1 isab0: <PCI-ISA bridge> at device 31.0 on pci0 isa0: <ISA bus> on isab0 ahci1: <Intel Wellsburg AHCI SATA controller> port=20 0x7070-0x7077,0x7060-0x7063,0x7050-0x7057,0x7040-0x7043,0x7000-0x701f=20 mem 0xc7532000-0xc75327ff irq 16 at device 31.2 on pci0 ahci1: AHCI v1.30 with 6 6Gbps ports, Port Multiplier not supported ahcich4: <AHCI channel> at channel 0 on ahci1 ahcich5: <AHCI channel> at channel 1 on ahci1 ahcich6: <AHCI channel> at channel 2 on ahci1 ahcich7: <AHCI channel> at channel 3 on ahci1 ahcich8: <AHCI channel> at channel 4 on ahci1 ahcich9: <AHCI channel> at channel 5 on ahci1 ahciem1: <AHCI enclosure management bridge> on ahci1 pcib11: <ACPI Host-PCI bridge> on acpi0 pci128: <ACPI PCI bus> on pcib11 pcib12: <ACPI PCI-PCI bridge> at device 0.0 on pci128 pci129: <ACPI PCI bus> on pcib12 pcib13: <ACPI PCI-PCI bridge> irq 50 at device 1.0 on pci128 pci130: <ACPI PCI bus> on pcib13 pcib14: <ACPI PCI-PCI bridge> irq 56 at device 2.0 on pci128 pci131: <ACPI PCI bus> on pcib14 em0: <Intel(R) PRO/1000 Network Connection 7.4.2> port 0xf020-0xf03f mem=20 0xfbea0000-0xfbebffff,0xfbe80000-0xfbe9ffff irq 56 at device 0.0 on = pci131 em0: Using an MSI interrupt em0: Ethernet address: 00:26:55:d3:1b:3a em1: <Intel(R) PRO/1000 Network Connection 7.4.2> port 0xf000-0xf01f mem=20 0xfbe40000-0xfbe5ffff,0xfbe20000-0xfbe3ffff irq 60 at device 0.1 on = pci131 em1: Using an MSI interrupt em1: Ethernet address: 00:26:55:d3:1b:3b pcib15: <ACPI PCI-PCI bridge> irq 56 at device 2.2 on pci128 pci132: <ACPI PCI bus> on pcib15 ix2: <Intel(R) PRO/10GbE PCI-Express Network Driver, Version - 2.8.3>=20 mem 0xfb800000-0xfb9fffff,0xfba04000-0xfba07fff irq 61 at device 0.0 on=20 pci132 ix2: Using MSIX interrupts with 9 vectors ix2: Ethernet address: a0:36:9f:5d:40:a8 ix2: PCI Express Bus: Speed 5.0GT/s Width x8 ix3: <Intel(R) PRO/10GbE PCI-Express Network Driver, Version - 2.8.3>=20 mem 0xfb600000-0xfb7fffff,0xfba00000-0xfba03fff irq 58 at device 0.1 on=20 pci132 ix3: Using MSIX interrupts with 9 vectors ix3: Ethernet address: a0:36:9f:5d:40:aa ix3: PCI Express Bus: Speed 5.0GT/s Width x8 pcib16: <ACPI PCI-PCI bridge> irq 64 at device 3.0 on pci128 pci133: <ACPI PCI bus> on pcib16 mpr2: <Avago Technologies (LSI) SAS3008> port 0xe000-0xe0ff mem=20 0xfbc40000-0xfbc4ffff,0xfbc00000-0xfbc3ffff irq 64 at device 0.0 on = pci133 mpr2: IOCFacts : MsgVersion: 0x205 HeaderVersion: 0x2300 IOCNumber: 0 IOCExceptions: 0x0 MaxChainDepth: 128 NumberOfPorts: 1 RequestCredit: 3072 ProductID: 0x2221 IOCRequestFrameSize: 32 MaxInitiators: 1 MaxTargets: 256 MaxSasExpanders: 48 MaxEnclosures: 16 HighPriorityCredit: 128 MaxReplyDescriptorPostQueueDepth: 65504 ReplyFrameSize: 32 MaxVolumes: 0 MaxDevHandle: 313 MaxPersistentEntries: 128 mpr2: Firmware: 08.00.00.00, Driver: 09.255.01.00-fbsd mpr2: IOCCapabilities:=20 7a85c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,EventReplay,MSIXInde= x,HostDisc> acpi_button0: <Power Button> on acpi0 uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0 ipmi0: <IPMI System Interface> port 0xca2,0xca3 on acpi0 ipmi0: KCS mode found at io 0xca2 on acpi orm0: <ISA Option ROMs> at iomem=20 0xc0000-0xc7fff,0xc8000-0xc87ff,0xc8800-0xc97ff,0xc9800-0xca7ff,0xca800-0= xcb7ff,0xcb800-0xcc7ff,0xcc800-0xcd7ff=20 on isa0 sc0: <System console> at flags 0x100 on isa0 sc0: CGA <16 virtual consoles, flags=3D0x300> vga0: <Generic ISA VGA> at port 0x3d0-0x3db iomem 0xb8000-0xbffff on isa0 ppc0: cannot reserve I/O port range est0: <Enhanced SpeedStep Frequency Control> on cpu0 est1: <Enhanced SpeedStep Frequency Control> on cpu1 est2: <Enhanced SpeedStep Frequency Control> on cpu2 est3: <Enhanced SpeedStep Frequency Control> on cpu3 est4: <Enhanced SpeedStep Frequency Control> on cpu4 est5: <Enhanced SpeedStep Frequency Control> on cpu5 est6: <Enhanced SpeedStep Frequency Control> on cpu6 est7: <Enhanced SpeedStep Frequency Control> on cpu7 est8: <Enhanced SpeedStep Frequency Control> on cpu8 est9: <Enhanced SpeedStep Frequency Control> on cpu9 est10: <Enhanced SpeedStep Frequency Control> on cpu10 est11: <Enhanced SpeedStep Frequency Control> on cpu11 random: unblocking device. usbus0: 5.0Gbps Super Speed USB v3.0 ZFS filesystem version: 5 ZFS storage pool version: features support (5000) Timecounters tick every 1.000 msec usbus1: 480Mbps High Speed USB v2.0 usbus2: 480Mbps High Speed USB v2.0 ugen0.1: <0x8086> at usbus0 uhub0: <0x8086 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0 ugen1.1: <Intel> at usbus1 uhub1: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus1 ugen2.1: <Intel> at usbus2 uhub2: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus2 ipmi0: IPMI device rev. 1, firmware rev. 2.14, version 2.0 ipmi0: Number of channels 2 ipmi0: Attached watchdog uhub1: 2 ports with 2 removable, self powered uhub2: 2 ports with 2 removable, self powered uhub0: 21 ports with 21 removable, self powered ugen0.2: <Apple, Inc.> at usbus0 uhub3: <Apple, Inc. Keyboard Hub, class 9/0, rev 2.00/96.15, addr 1> on=20 usbus0 mpr0: SAS Address from SAS device page0 =3D 5000c500844c64e5 mpr0: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x000a>=20 enclosureHandle<0x0002> slot 5 mpr0: At enclosure level 0 and connector name ( ) mpr0: SAS Address from SAS device page0 =3D 5000c500844d8de5 mpr0: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x000b>=20 enclosureHandle<0x0002> slot 6 mpr0: At enclosure level 0 and connector name ( ) mpr0: SAS Address from SAS device page0 =3D 5000c500844d6865 mpr0: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x000c>=20 enclosureHandle<0x0002> slot 7 mpr0: At enclosure level 0 and connector name ( ) mpr1: SAS Address for SATA device =3D 9683a928e2b4aab3 mpr0: SAS Address from SAS device page0 =3D 5000c500844c9a3d mpr0: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x000d>=20 enclosureHandle<0x0002> slot 15 mpr0: At enclosure level 0 and connector name ( ) mpr0: SAS Address from SAS device page0 =3D 50030480090b8d3d mpr0: Found device <4411<SmpInit,SspTarg,SepDev>,End Device> <12.0Gbps>=20 handle<0x000e> enclosureHandle<0x0002> slot 24 mpr0: At enclosure level 0 and connector name ( ) mpr2: SAS Address from SAS device page0 =3D 5000c500844bb641 mpr2: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x000b>=20 enclosureHandle<0x0002> slot 0 mpr2: At enclosure level 0 and connector name ( ) mpr1: SAS Address for SATA device =3D 9684b128e2b4aab3 mpr2: SAS Address from SAS device page0 =3D 5000c500844ba865 mpr2: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x000c>=20 enclosureHandle<0x0002> slot 1 mpr1: SAS Address for SATA device =3D 9687a328e2b4aab3 ugen1.2: <vendor 0x8087> at usbus1 uhub4: <vendor 0x8087 product 0x800a, class 9/0, rev 2.00/0.05, addr 2>=20 on usbus1 ugen2.2: <vendor 0x8087> at usbus2 uhub5: <vendor 0x8087 product 0x8002, class 9/0, rev 2.00/0.05, addr 2>=20 on usbus2 mpr2: At enclosure level 0 and connector name ( ) mpr2: SAS Address from SAS device page0 =3D 5000c500844c6699 mpr2: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x0011>=20 enclosureHandle<0x0002> slot 2 mpr2: At enclosure level 0 and connector name ( ) mpr1: SAS Address for SATA device =3D 9586a528e2b4aab3 mpr2: SAS Address from SAS device page0 =3D 5000c500844bd9d5 mpr2: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x0012>=20 enclosureHandle<0x0002> slot 3 mpr2: At enclosure level 0 and connector name ( ) mpr2: SAS Address from SAS device page0 =3D 5000c500844d8c29 mpr2: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x0013>=20 enclosureHandle<0x0002> slot 4 mpr2: At enclosure level 0 and connector name ( ) mpr1: SAS Address from SAS device page0 =3D 5000c5007788ad75 mpr1: mpr2: SAS Address from SAS device page0 =3D 5000c500844ba3c1 mpr2: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x0014>=20 enclosureHandle<0x0002> slot 5 mpr2: At enclosure level 0 and connector name ( ) Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x000a>=20 enclosureHandle<0x0002> slot 0 mpr1: At enclosure level 0 and connector name ( ) mpr2: SAS Address from SAS device page0 =3D 5000c500844ca251 mpr2: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x0015>=20 enclosureHandle<0x0002> slot 6 mpr2: At enclosure level 0 and connector name ( ) mpr2: SAS Address from SAS device page0 =3D 5000c500844bcc31 mpr2: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x0016>=20 enclosureHandle<0x0002> slot 7 mpr2: At enclosure level 0 and connector name ( ) mpr1: SAS Address from SAS device page0 =3D 5000c5007799d161 mpr1: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x000b>=20 enclosureHandle<0x0002> slot 1 mpr1: At enclosure level 0 and connector name ( ) mpr2: SAS Address from SAS device page0 =3D 5000c500844bda45 mpr2: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x0017>=20 enclosureHandle<0x0002> slot 8 mpr2: At enclosure level 0 and connector name ( ) mpr1: SAS Address from SAS device page0 =3D 5000c5007788fd71 mpr1: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x000c>=20 enclosureHandle<0x0002> slot 2 mpr1: At enclosure level 0 and connector name ( ) mpr2: SAS Address from SAS device page0 =3D 5000c500844c8579 mpr2: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x0018>=20 enclosureHandle<0x0002> slot 9 mpr2: At enclosure level 0 and connector name ( ) mpr1: SAS Address from SAS device page0 =3D 5000c5007788d7f9 mpr1: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x000d>=20 enclosureHandle<0x0002> slot 3 mpr1: At enclosure level 0 and connector name ( ) mpr2: SAS Address from SAS device page0 =3D 5000c500844c7ee1 mpr2: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x0019>=20 enclosureHandle<0x0002> slot 10 mpr2: At enclosure level 0 and connector name ( ) mpr1: SAS Address from SAS device page0 =3D 50030480090b8d88 mpr2: SAS Address from SAS device page0 =3D 5000c500844d01fd mpr2: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x001a>=20 enclosureHandle<0x0002> slot 11 mpr2: At enclosure level 0 and connector name ( ) mpr1: SAS Address from SATA device =3D 9683a928e2b4aab3 mpr1: Found device <81<SataDev>,End Device> <12.0Gbps> handle<0x000e>=20 enclosureHandle<0x0002> slot 4 mpr1: At enclosure level 0 and connector name ( ) mpr1: SAS Address from SAS device page0 =3D 5000c500844c2185 mpr1: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x000f>=20 enclosureHandle<0x0002> slot 5 mpr1: At enclosure level 0 and connector name ( ) mpr2: SAS Address from SAS device page0 =3D 500304801ea2dfbd mpr2: Found device <4411<SmpInit,SspTarg,SepDev>,End Device> <12.0Gbps>=20 handle<0x001f> enclosureHandle<0x0002> slot 12 mpr2: At enclosure level 0 and connector name ( ) mpr1: SAS Address from SAS device page0 =3D 5000c500844d7ca1 mpr1: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x0010>=20 enclosureHandle<0x0002> slot 6 mpr1: At enclosure level 0 and connector name ( ) mpr1: SAS Address from SAS device page0 =3D 5000c500844c5db5 mpr1: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x0011>=20 enclosureHandle<0x0002> slot 7 mpr1: At enclosure level 0 and connector name ( ) mpr1: SAS Address from SAS device page0 =3D 50030480090b8d90 mpr2: SAS Address from SAS device page0 =3D 5000c500844bd449 mpr2: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x000d>=20 enclosureHandle<0x0003> slot 0 mpr2: At enclosure level 0 and connector name ( ) mpr1: SAS Address from SATA device =3D 9684b128e2b4aab3 mpr1: Found device <81<SataDev>,End Device> <12.0Gbps> handle<0x0012>=20 enclosureHandle<0x0002> slot 12 mpr1: At enclosure level 0 and connector name ( ) mpr2: SAS Address from SAS device page0 =3D 5000c500844bc9b1 mpr2: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x000e>=20 enclosureHandle<0x0003> slot 1 mpr2: At enclosure level 0 and connector name ( ) mpr1: SAS Address from SAS device page0 =3D 50030480090b8d91 mpr2: SAS Address from SAS device page0 =3D 5000c500844d6ea1 mpr2: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x000f>=20 enclosureHandle<0x0003> slot 2 mpr2: At enclosure level 0 and connector name ( ) mpr1: SAS Address from SATA device =3D 9687a328e2b4aab3 mpr1: Found device <81<SataDev>,End Device> <12.0Gbps> handle<0x0013>=20 enclosureHandle<0x0002> slot 13 mpr1: At enclosure level 0 and connector name ( ) mpr2: SAS Address from SAS device page0 =3D 5000c500844b9785 mpr2: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x0010>=20 enclosureHandle<0x0003> slot 3 mpr2: At enclosure level 0 and connector name ( ) mpr1: SAS Address from SAS device page0 =3D 50030480090b8d92 mpr2: SAS Address from SAS device page0 =3D 5000c500844bda21 mpr2: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x001b>=20 enclosureHandle<0x0003> slot 4 mpr2: At enclosure level 0 and connector name ( ) mpr1: SAS Address from SATA device =3D 9586a528e2b4aab3 mpr1: Found device <81<SataDev>,End Device> <12.0Gbps> handle<0x0014>=20 enclosureHandle<0x0002> slot 14 mpr1: At enclosure level 0 and connector name ( ) mpr2: SAS Address from SAS device page0 =3D 5000c500844d050d mpr2: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x001c>=20 enclosureHandle<0x0003> slot 5 mpr2: At enclosure level 0 and connector name ( ) mpr1: SAS Address from SAS device page0 =3D 5000c500844d028d mpr1: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x0015>=20 enclosureHandle<0x0002> slot 15 mpr1: At enclosure level 0 and connector name ( ) mpr1: SAS Address from SAS device page0 =3D 50030480090b8dbd mpr1: Found device <4411<SmpInit,SspTarg,SepDev>,End Device> <12.0Gbps>=20 handle<0x0016> enclosureHandle<0x0002> slot 24 mpr1: At enclosure level 0 and connector name ( ) mpr2: SAS Address from SAS device page0 =3D 5000c500844c81cd mpr2: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x001d>=20 enclosureHandle<0x0003> slot 6 mpr2: At enclosure level 0 and connector name ( ) mpr2: SAS Address from SAS device page0 =3D 5000c500844bf42d mpr2: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x001e>=20 enclosureHandle<0x0003> slot 7 mpr2: At enclosure level 0 and connector name ( ) mpr2: SAS Address from SAS device page0 =3D 5000c500844cf71d mpr2: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x0020>=20 enclosureHandle<0x0003> slot 8 mpr2: At enclosure level 0 and connector name ( ) mpr2: SAS Address from SAS device page0 =3D 5000c500844bde8d mpr2: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x0021>=20 enclosureHandle<0x0003> slot 9 mpr2: At enclosure level 0 and connector name ( ) mpr2: SAS Address from SAS device page0 =3D 5000c500844d66c9 mpr2: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x0022>=20 enclosureHandle<0x0003> slot 10 mpr2: At enclosure level 0 and connector name ( ) mpr2: SAS Address from SAS device page0 =3D 5000c500844cf01d mpr2: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x0023>=20 enclosureHandle<0x0003> slot 11 mpr2: At enclosure level 0 and connector name ( ) mpr2: SAS Address from SAS device page0 =3D 500304801ea2df3d mpr2: Found device <4411<SmpInit,SspTarg,SepDev>,End Device> <12.0Gbps>=20 handle<0x0024> enclosureHandle<0x0003> slot 24 mpr2: At enclosure level 0 and connector name ( ) uhub4: 6 ports with 6 removable, self powered uhub5: 8 ports with 8 removable, self powered uhub3: 3 ports with 2 removable, bus powered ugen0.3: <Apple Inc.> at usbus0 ukbd0: <Apple Inc. Apple Keyboard, class 0/0, rev 2.00/0.74, addr 2> on=20 usbus0 kbd0 at ukbd0 ugen0.4: <vendor 0x0557> at usbus0 uhub6: <vendor 0x0557 product 0x7000, class 9/0, rev 2.00/0.00, addr 3>=20 on usbus0 uhub6: 4 ports with 3 removable, self powered ugen0.5: <vendor 0x0557> at usbus0 ukbd1: <vendor 0x0557 product 0x2419, class 0/0, rev 1.10/1.00, addr 4>=20 on usbus0 kbd2 at ukbd1 da0 at mpr0 bus 0 scbus0 target 13 lun 0 da0: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device da0: Serial Number Z4F0BTFL0000R551Y6M9 da0: 1200.000MB/s transfers da0: Command Queueing enabled da0: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C) da1 at mpr0 bus 0 scbus0 target 14 lun 0 da2 at mpr0 bus 0 scbus0 target 15 lun 0 da1: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device da1: Serial Number Z4F0BFJS0000R548WQDM da1: 1200.000MB/s transfers da1: Command Queueing enabled da1: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C) da2: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device da2: Serial Number Z4F0BG670000R548ZWZP da2: 1200.000MB/s transfers da2: Command Queueing enabled da2: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C) da3 at mpr0 bus 0 scbus0 target 23 lun 0 da4 at mpr1 bus 0 scbus1 target 8 lun 0 da3: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device da3: Serial Number Z4F0BSKY0000R548Z0E2 da3: 1200.000MB/s transfers da3: Command Queueing enabled da3: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C) da11 at mpr1 bus 0 scbus1 target 15 lun 0 da11: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device da4: <SEAGATE ST600MP0005 N003> Fixed Direct Access SPC-4 SCSI device da9 at mpr1 bus 0 scbus1 target 13 lun 0 da9: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device da9: Serial Number Z4F0BVZP0000R551Y333 da9: 1200.000MB/s transfers da9: Command Queueing enabled da9: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C) da11: Serial Number Z4F0BTLX0000R551NW3V da11: 1200.000MB/s transfers da11: Command Queueing enabled da11: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C) da5 at mpr1 bus 0 scbus1 target 9 lun 0 da4: Serial Number S7M016SG0000S439LVPG da4: 1200.000MB/s transfers da4: Command Queueing enabled da4: 572325MB (1172123568 512 byte sectors: 255H 63S/T 72961C) da10 at mpr1 bus 0 scbus1 target 14 lun 0 da6 at mpr1 bus 0 scbus1 target 10 lun 0 da5: <SEAGATE ST600MP0005 N003> Fixed Direct Access SPC-4 SCSI device da5: Serial Number S7M01AYK0000J503B7CT da5: 1200.000MB/s transfers da5: Command Queueing enabled da5: 572325MB (1172123568 512 byte sectors: 255H 63S/T 72961C) da10: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device da6: <SEAGATE ST600MP0005 N003> Fixed Direct Access SPC-4 SCSI device da6: Serial Number S7M016TK0000J448E26D da6: 1200.000MB/s transfers da6: Command Queueing enabled da6: 572325MB (1172123568 512 byte sectors: 255H 63S/T 72961C) da10: Serial Number Z4F0BFW70000R548WR5D da10: 1200.000MB/s transfers da10: Command Queueing enabled da10: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C) da8 at mpr1 bus 0 scbus1 target 12 lun 0 da8: <ATA SAMSUNG MZ7KM960 003Q> Fixed Direct Access SPC-4 SCSI device da8: Serial Number S2L2NWAG701294P da8: 1200.000MB/s transfers da8: Command Queueing enabled da8: 915715MB (1875385008 512 byte sectors: 255H 63S/T 116737C) da7 at mpr1 bus 0 scbus1 target 11 lun 0 da13 at mpr1 bus 0 scbus1 target 21 lun 0 da13: <ATA SAMSUNG MZ7KM960 003Q> Fixed Direct Access SPC-4 SCSI device da13: Serial Number S2L2NWAG701298J da13: 1200.000MB/s transfers da13: Command Queueing enabled da13: 915715MB (1875385008 512 byte sectors: 255H 63S/T 116737C) da16 at mpr2 bus 0 scbus14 target 8 lun 0 da16: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device da16: Serial Number Z4F0BMKW0000R551NVS4 da16: 1200.000MB/s transfers da16: Command Queueing enabled da16: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C) da19 at mpr2 bus 0 scbus14 target 11 lun 0 da19: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device da19: Serial Number Z4F0BMC60000R551NWQB da19: 1200.000MB/s transfers da19: Command Queueing enabled da19: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C) da14 at mpr1 bus 0 scbus1 target 22 lun 0 da14: <ATA SAMSUNG MZ7KM960 003Q> Fixed Direct Access SPC-4 SCSI device da14: Serial Number S2L2NWAG701287L da14: 1200.000MB/s transfers da14: Command Queueing enabled da14: 915715MB (1875385008 512 byte sectors: 255H 63S/T 116737C) da17 at mpr2 bus 0 scbus14 target 9 lun 0 da17: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device da17: Serial Number Z4F0BMTX0000R551NUEH da17: 1200.000MB/s transfers da17: Command Queueing enabled da17: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C) da20 at mpr2 bus 0 scbus14 target 12 lun 0 da20: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device da20: Serial Number Z4F0BFL20000R548HJTN da20: 1200.000MB/s transfers da20: Command Queueing enabled da20: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C) da23 at mpr2 bus 0 scbus14 target 15 lun 0 da23: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device da23: Serial Number Z4F0BM690000R551NSDP da23: 1200.000MB/s transfers da23: Command Queueing enabled da23: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C) da26 at mpr2 bus 0 scbus14 target 18 lun 0 da26: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device da26: Serial Number Z4F0BT4B0000R551NVJD da26: 1200.000MB/s transfers da26: Command Queueing enabled da26: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C) da28 at mpr2 bus 0 scbus14 target 39 lun 0 da28: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device da28: Serial Number Z4F0BMEA0000R551PA2G da28: 1200.000MB/s transfers da28: Command Queueing enabled da28: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C) da31 at mpr2 bus 0 scbus14 target 42 lun 0 da31: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device da31: Serial Number Z4F0BN5C0000R551NW9C da31: 1200.000MB/s transfers da31: Command Queueing enabled da31: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C) da34 at mpr2 bus 0 scbus14 target 45 lun 0 da34: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device da34: Serial Number Z4F0BT3M0000R551NTPG da34: 1200.000MB/s transfers da34: Command Queueing enabled da34: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C) da37 at mpr2 bus 0 scbus14 target 48 lun 0 da37: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device da37: Serial Number Z4F0BMGK0000R551NWLG da37: 1200.000MB/s transfers da37: Command Queueing enabled da37: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C) da7: <SEAGATE ST600MP0005 N003> Fixed Direct Access SPC-4 SCSI device da7: Serial Number S7M016V90000J449GN30 da7: 1200.000MB/s transfers da7: Command Queueing enabled da7: 572325MB (1172123568 512 byte sectors: 255H 63S/T 72961C) da15 at mpr1 bus 0 scbus1 target 23 lun 0 da22 at mpr2 bus 0 scbus14 target 14 lun 0 da22: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device da15: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device da15: Serial Number Z4F0BRB00000R551NWNR da15: 1200.000MB/s transfers da15: Command Queueing enabled da15: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C) da18 at mpr2 bus 0 scbus14 target 10 lun 0 da18: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device da18: Serial Number Z4F0BTDW0000R544PAJB da18: 1200.000MB/s transfers da18: Command Queueing enabled da18: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C) da21 at mpr2 bus 0 scbus14 target 13 lun 0 da21: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device da21: Serial Number Z4F0BMX90000R551NVLQ da21: 1200.000MB/s transfers da21: Command Queueing enabled da21: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C) da24 at mpr2 bus 0 scbus14 target 16 lun 0 da24: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device da24: Serial Number Z4F0BLZD0000R551NWQ5 da24: 1200.000MB/s transfers da24: Command Queueing enabled da24: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C) da27 at mpr2 bus 0 scbus14 target 19 lun 0 da27: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device da27: Serial Number Z4F0BRBA0000R551NUC6 da27: 1200.000MB/s transfers da27: Command Queueing enabled da27: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C) da29 at mpr2 bus 0 scbus14 target 40 lun 0 da29: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device da29: Serial Number Z4F0BM7E0000R551P9UJ da29: 1200.000MB/s transfers da29: Command Queueing enabled da29: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C) da32 at mpr2 bus 0 scbus14 target 43 lun 0 da32: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device da32: Serial Number Z4F0BLZF0000R551NUWR da32: 1200.000MB/s transfers da32: Command Queueing enabled da32: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C) da35 at mpr2 bus 0 scbus14 target 46 lun 0 da35: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device da35: Serial Number Z4F0BLN00000R551P9CY da35: 1200.000MB/s transfers da35: Command Queueing enabled da35: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C) da38 at mpr2 bus 0 scbus14 target 49 lun 0 da38: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device da38: Serial Number Z4F0BG6Y0000R548HL0Y da38: 1200.000MB/s transfers da38: Command Queueing enabled da38: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C) da22: Serial Number Z4F0BSEP0000R548YZLB da22: 1200.000MB/s transfers da22: Command Queueing enabled da22: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C) da25 at mpr2 bus 0 scbus14 target 17 lun 0 da25: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device da25: Serial Number Z4F0BT2T0000R551NSSW da25: 1200.000MB/s transfers da25: Command Queueing enabled da25: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C) da30 at mpr2 bus 0 scbus14 target 41 lun 0 da30: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device da30: Serial Number Z4F0BG2Z0000R548HL43 da30: 1200.000MB/s transfers da30: Command Queueing enabled da30: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C) da33 at mpr2 bus 0 scbus14 target 44 lun 0 da33: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device da33: Serial Number Z4F0BR9X0000R551P9JR da33: 1200.000MB/s transfers da33: Command Queueing enabled da33: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C) da36 at mpr2 bus 0 scbus14 target 47 lun 0 da36: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device da36: Serial Number Z4F0BRKH0000R548WQAT da36: 1200.000MB/s transfers da36: Command Queueing enabled da36: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C) da39 at mpr2 bus 0 scbus14 target 50 lun 0 da39: <SEAGATE ST4000NM0034 E001> Fixed Direct Access SPC-4 SCSI device da39: Serial Number Z4F0BRP30000R548YYMT da39: 1200.000MB/s transfers da39: Command Queueing enabled da39: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C) da12 at mpr1 bus 0 scbus1 target 20 lun 0 da12: <ATA SAMSUNG MZ7KM960 003Q> Fixed Direct Access SPC-4 SCSI device da12: Serial Number S2L2NWAG701295X da12: 1200.000MB/s transfers da12: Command Queueing enabled da12: 915715MB (1875385008 512 byte sectors: 255H 63S/T 116737C) ada0 at ahcich8 bus 0 scbus11 target 0 lun 0 ada0: <INTEL SSDSC2BB080G6 G2010130> ACS-2 ATA SATA 3.x device ada0: Serial Number BTWA518309N3080BGN ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 512bytes) ada0: Command Queueing enabled ada0: 76319MB (156301488 512 byte sectors: 16H 63S/T 16383C) ada0: Previously was known as ad20 ada1 at ahcich9 bus 0 scbus12 target 0 lun 0 ada1: <INTEL SSDSC2BB080G6 G2010130> ACS-2 ATA SATA 3.x device ada1: Serial Number BTWA518309N0080BGN ada1: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 512bytes) ada1: Command Queueing enabled ada1: 76319MB (156301488 512 byte sectors: 16H 63S/T 16383C) ada1: Previously was known as ad22 ses0 at mpr0 bus 0 scbus0 target 32 lun 0 ses0: <LSI SAS3x48 0701> Fixed Enclosure Services SPC-3 SCSI device ses0: Serial Number=20 \M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\= M^?\M^?\M^?\M^?\M^?\M^? ses0: 1200.000MB/s transfers ses0: Command Queueing enabled ses0: SCSI-3 ENC Device ses1 at mpr1 bus 0 scbus1 target 32 lun 0 ses1: <LSI SAS3x36 0701> Fixed Enclosure Services SPC-3 SCSI device ses1: Serial Number=20 \M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\= M^?\M^?\M^?\M^?\M^?\M^? ses1: 1200.000MB/s transfers ses1: Command Queueing enabled ses1: SCSI-3 ENC Device ses2 at ahciem0 bus 0 scbus6 target 0 lun 0 ses2: <AHCI SGPIO Enclosure 1.00 0001> SEMB S-E-S 2.00 device ses2: SEMB SES Device ses3 at ahciem1 bus 0 scbus13 target 0 lun 0 ses3: <AHCI SGPIO Enclosure 1.00 0001> SEMB S-E-S 2.00 device ses3: SEMB SES Device ses4 at mpr2 bus 0 scbus14 target 20 lun 0 ses4: <LSI SAS3x28 0701> Fixed Enclosure Services SPC-3 SCSI device ses4: Serial Number=20 \M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\= M^?\M^?\M^?\M^?\M^?\M^? ses4: 1200.000MB/s transfers ses4: Command Queueing enabled ses4: SCSI-3 ENC Device ses5 at mpr2 bus 0 scbus14 target 63 lun 0 ses5: <LSI SAS3x48 0701> Fixed Enclosure Services SPC-3 SCSI device ses5: Serial Number=20 \M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?\= M^?\M^?\M^?\M^?\M^?\M^? ses5: 1200.000MB/s transfers ses5: Command Queueing enabled ses5: SCSI-3 ENC Device SMP: AP CPU #10 Launched! SMP: AP CPU #3 Launched! SMP: AP CPU #7 Launched! SMP: AP CPU #4 Launched! SMP: AP CPU #6 Launched! SMP: AP CPU #5 Launched! SMP: AP CPU #11 Launched! SMP: AP CPU #2 Launched! SMP: AP CPU #9 Launched! SMP: AP CPU #1 Launched! SMP: AP CPU #8 Launched! Timecounter "TSC" frequency 1900035932 Hz quality 1000 GEOM_MIRROR: Device mirror/swap launched (2/2). Trying to mount root from zfs:ZFS-AF/ROOT/default []... uhid0: <Apple Inc. Apple Keyboard, class 0/0, rev 2.00/0.74, addr 2> on=20 usbus0 ums0: <vendor 0x0557 product 0x2419, class 0/0, rev 1.10/1.00, addr 4>=20 on usbus0 ums0: 3 buttons and [Z] coordinates ID=3D0 ix0: link state changed to UP lagg0: link state changed to UP ix0: link state changed to DOWN lagg0: link state changed to DOWN ix0: link state changed to UP lagg0: link state changed to UP ix1: link state changed to UP ix2: link state changed to UP ix3: link state changed to UP [root@ZFS-AF ~]#
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?566B8E2A.8070404>