Date: Fri, 05 Oct 2012 07:33:39 -0700 From: Dennis Glatting <freebsd@pki2.com> To: FS@FREEBSD.ORG Subject: under ZFS, I can reliably crash my systems Message-ID: <1349447619.89356.13.camel@btw.pki2.com>
next in thread | raw e-mail | index | archive | help
I don't know if this will be useful but I have a crash dump caused by executing a "panic" in an NMI with the kernel configured for DDB. I ran a few commands under DDB, which looked interesting, but I haven't figured out how to capture the output. The crash dump is here: http://www.pki2.com:/ZFS.crash.04Oct2012 I have five ZFS systems and can reliably crash four of them -- just place them under heavy load. The fifth system isn't used for the same purposes. The four crashing systems are AMD systems whereas the fifth (the one that doesn't give me grief) is Intel. On the system below I had just rebuilt the disk-1 array a few hours earlier. What does "crash" mean? Below is a "top" example where all of the processes are stuck on I/O. The top was still running, so the network was fine and the kernel alive. In other widows open to the server, the network was fine but no command seemed to execute, such as "ps", "ls", or "reboot" (i.e., I enter the command then nothing). What do I need to provide you to debug this problem? last pid: 16210; load averages: 0.02, 2.40, 17.18 up 0+00:59:57 21:51:27 85 processes: 1 running, 84 sleeping CPU: 0.0% user, 0.0% nice, 0.0% system, 0.0% interrupt, 100% idle Mem: 153M Active, 2641M Inact, 16G Wired, 26M Buf, 105G Free ARC: 14G Total, 1940M MRU, 12G MFU, 58M Anon, 58M Header, 35M Other Swap: 233G Total, 233G Free USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND 2817 root 17 52 4 201M 112M tx->tx 34 68:06 0.00% pbzip2 2835 root 17 52 4 201M 111M tx->tx 39 67:18 0.00% pbzip2 2775 root 17 52 4 205M 114M tx->tx 8 66:51 0.00% pbzip2 2826 root 17 52 4 205M 115M tx->tx 40 66:20 0.00% pbzip2 2784 root 17 52 4 205M 113M tx->tx 38 66:17 0.00% pbzip2 2811 root 17 52 4 205M 116M tx->tx 19 65:56 0.00% pbzip2 2805 root 17 52 4 201M 114M tx->tx 24 65:55 0.00% pbzip2 2823 root 17 52 4 205M 118M tx->tx 57 65:55 0.00% pbzip2 2799 root 17 52 4 201M 114M tx->tx 40 65:23 0.00% pbzip2 2820 root 17 52 4 205M 116M tx->tx 55 65:19 0.00% pbzip2 2829 root 17 52 4 209M 122M tx->tx 10 65:06 0.00% pbzip2 2814 root 17 52 4 205M 114M tx->tx 40 64:54 0.00% pbzip2 2808 root 17 52 4 205M 117M tx->tx 14 64:52 0.00% pbzip2 2802 root 17 52 4 205M 116M tx->tx 13 64:51 0.00% pbzip2 2832 root 17 52 4 201M 115M tx->tx 51 64:49 0.00% pbzip2 2790 root 17 52 4 209M 119M tx->tx 53 64:38 0.00% pbzip2 2787 root 17 52 4 201M 112M tx->tx 28 64:00 0.00% pbzip2 2778 root 17 52 4 205M 117M tx->tx 50 63:51 0.00% pbzip2 2766 root 17 52 4 201M 111M tx->tx 4 63:29 0.00% pbzip2 2793 root 17 52 4 205M 118M tx->tx 6 63:24 0.00% pbzip2 2772 root 17 52 4 201M 115M tx->tx 44 62:57 0.00% pbzip2 2781 root 17 52 4 205M 116M tx->tx 55 62:13 0.00% pbzip2 2769 root 17 52 4 205M 111M tx->tx 41 62:00 0.00% pbzip2 2796 root 17 52 4 201M 118M tx->tx 46 61:51 0.00% pbzip2 2828 root 1 20 0 28648K 5444K pipewr 36 3:48 0.00% john 2777 root 1 20 0 28648K 5396K pipewr 26 3:00 0.00% john 2792 root 1 20 0 28648K 5412K pipewr 62 2:51 0.00% john 2795 root 1 20 0 28648K 5432K pipewr 44 2:40 0.00% john 2831 root 1 20 0 28648K 5440K pipewr 22 2:38 0.00% john 2807 root 1 20 0 28648K 5444K pipewr 23 2:32 0.00% john 2819 root 1 20 0 28648K 5440K pipewr 44 2:32 0.00% john 2804 root 1 20 0 28648K 5444K pipewr 46 2:31 0.00% john 2789 root 1 20 0 28648K 5392K pipewr 60 2:28 0.00% john 2786 root 1 20 0 28648K 5392K pipewr 60 2:26 0.00% john 2825 root 1 20 0 28648K 5444K pipewr 25 2:24 0.00% john mc# uname -a FreeBSD mc 9.1-PRERELEASE FreeBSD 9.1-PRERELEASE #3 r241040M: Tue Oct 2 22:51:12 PDT 2012 root@mc:/sys/amd64/compile/DTRACE amd64 mc# zpool status pool: disk-1 state: ONLINE scan: none requested config: NAME STATE READ WRITE CKSUM disk-1 ONLINE 0 0 0 raidz2-0 ONLINE 0 0 0 da5 ONLINE 0 0 0 da6 ONLINE 0 0 0 da7 ONLINE 0 0 0 da2 ONLINE 0 0 0 da3 ONLINE 0 0 0 da4 ONLINE 0 0 0 cache da0 ONLINE 0 0 0 errors: No known data errors pool: disk-2 state: ONLINE scan: scrub repaired 0 in 0h6m with 0 errors on Thu Oct 4 20:29:35 2012 config: NAME STATE READ WRITE CKSUM disk-2 ONLINE 0 0 0 mirror-0 ONLINE 0 0 0 da9 ONLINE 0 0 0 da10 ONLINE 0 0 0 errors: No known data errors I do not normally get the swap space error below. I assume this is from the operating system when I rebooted from the panic. The probe errors showed up across the servers last summer after I csup them. I remember reading on one of the lists they are harmless, though it would be nice if they would go away. :) mc# dmesg Copyright (c) 1992-2012 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 9.1-PRERELEASE #3 r241040M: Tue Oct 2 22:51:12 PDT 2012 root@mc:/sys/amd64/compile/DTRACE amd64 CPU: AMD Opteron(TM) Processor 6274 (2200.07-MHz K8-class CPU) Origin = "AuthenticAMD" Id = 0x600f12 Family = 0x15 Model = 0x1 Stepping = 2 Features=0x178bfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2,HTT> Features2=0x1e98220b<SSE3,PCLMULQDQ,MON,SSSE3,CX16,SSE4.1,SSE4.2,POPCNT,AESNI,XSAVE,OSXSAVE,AVX> AMD Features=0x2e500800<SYSCALL,NX,MMX+,FFXSR,Page1GB,RDTSCP,LM> AMD Features2=0x1c9bfff<LAHF,CMP,SVM,ExtAPIC,CR8,ABM,SSE4A,MAS,Prefetch,OSVW,IBS,XOP,SKINIT,WDT,LWP,FMA4,NodeId,Topology,<b23>,<b24>> TSC: P-state invariant, performance statistics real memory = 137438953472 (131072 MB) avail memory = 132423389184 (126288 MB) Event timer "LAPIC" quality 400 ACPI APIC Table: <120911 APIC1027> FreeBSD/SMP: Multiprocessor System Detected: 64 CPUs FreeBSD/SMP: 4 package(s) x 16 core(s) cpu0 (BSP): APIC ID: 32 cpu1 (AP): APIC ID: 33 cpu2 (AP): APIC ID: 34 cpu3 (AP): APIC ID: 35 cpu4 (AP): APIC ID: 36 cpu5 (AP): APIC ID: 37 cpu6 (AP): APIC ID: 38 cpu7 (AP): APIC ID: 39 cpu8 (AP): APIC ID: 40 cpu9 (AP): APIC ID: 41 cpu10 (AP): APIC ID: 42 cpu11 (AP): APIC ID: 43 cpu12 (AP): APIC ID: 44 cpu13 (AP): APIC ID: 45 cpu14 (AP): APIC ID: 46 cpu15 (AP): APIC ID: 47 cpu16 (AP): APIC ID: 64 cpu17 (AP): APIC ID: 65 cpu18 (AP): APIC ID: 66 cpu19 (AP): APIC ID: 67 cpu20 (AP): APIC ID: 68 cpu21 (AP): APIC ID: 69 cpu22 (AP): APIC ID: 70 cpu23 (AP): APIC ID: 71 cpu24 (AP): APIC ID: 72 cpu25 (AP): APIC ID: 73 cpu26 (AP): APIC ID: 74 cpu27 (AP): APIC ID: 75 cpu28 (AP): APIC ID: 76 cpu29 (AP): APIC ID: 77 cpu30 (AP): APIC ID: 78 cpu31 (AP): APIC ID: 79 cpu32 (AP): APIC ID: 96 cpu33 (AP): APIC ID: 97 cpu34 (AP): APIC ID: 98 cpu35 (AP): APIC ID: 99 cpu36 (AP): APIC ID: 100 cpu37 (AP): APIC ID: 101 cpu38 (AP): APIC ID: 102 cpu39 (AP): APIC ID: 103 cpu40 (AP): APIC ID: 104 cpu41 (AP): APIC ID: 105 cpu42 (AP): APIC ID: 106 cpu43 (AP): APIC ID: 107 cpu44 (AP): APIC ID: 108 cpu45 (AP): APIC ID: 109 cpu46 (AP): APIC ID: 110 cpu47 (AP): APIC ID: 111 cpu48 (AP): APIC ID: 128 cpu49 (AP): APIC ID: 129 cpu50 (AP): APIC ID: 130 cpu51 (AP): APIC ID: 131 cpu52 (AP): APIC ID: 132 cpu53 (AP): APIC ID: 133 cpu54 (AP): APIC ID: 134 cpu55 (AP): APIC ID: 135 cpu56 (AP): APIC ID: 136 cpu57 (AP): APIC ID: 137 cpu58 (AP): APIC ID: 138 cpu59 (AP): APIC ID: 139 cpu60 (AP): APIC ID: 140 cpu61 (AP): APIC ID: 141 cpu62 (AP): APIC ID: 142 cpu63 (AP): APIC ID: 143 ACPI Warning: Optional field Pm2ControlBlock has zero address or length: 0x0000000000000000/0x1 (20110527/tbfadt-583) ioapic0 <Version 2.1> irqs 0-23 on motherboard ioapic1 <Version 2.1> irqs 24-55 on motherboard kbd1 at kbdmux0 module_register_init: MOD_LOAD (vesa, 0xffffffff80bcb500, 0) error 19 ctl: CAM Target Layer loaded cryptosoft0: <software crypto> on motherboard aesni0: <AES-CBC,AES-XTS> on motherboard acpi0: <120911 XSDT1027> on motherboard acpi0: Power Button (fixed) acpi0: reservation of fec00000, 1000 (3) failed acpi0: reservation of fee00000, 1000 (3) failed acpi0: reservation of ffb80000, 80000 (3) failed acpi0: reservation of fec10000, 20 (3) failed acpi0: reservation of 0, a0000 (3) failed acpi0: reservation of 100000, dff00000 (3) failed cpu0: <ACPI CPU> on acpi0 cpu1: <ACPI CPU> on acpi0 cpu2: <ACPI CPU> on acpi0 cpu3: <ACPI CPU> on acpi0 cpu4: <ACPI CPU> on acpi0 cpu5: <ACPI CPU> on acpi0 cpu6: <ACPI CPU> on acpi0 cpu7: <ACPI CPU> on acpi0 cpu8: <ACPI CPU> on acpi0 cpu9: <ACPI CPU> on acpi0 cpu10: <ACPI CPU> on acpi0 cpu11: <ACPI CPU> on acpi0 cpu12: <ACPI CPU> on acpi0 cpu13: <ACPI CPU> on acpi0 cpu14: <ACPI CPU> on acpi0 cpu15: <ACPI CPU> on acpi0 cpu16: <ACPI CPU> on acpi0 cpu17: <ACPI CPU> on acpi0 cpu18: <ACPI CPU> on acpi0 cpu19: <ACPI CPU> on acpi0 cpu20: <ACPI CPU> on acpi0 cpu21: <ACPI CPU> on acpi0 cpu22: <ACPI CPU> on acpi0 cpu23: <ACPI CPU> on acpi0 cpu24: <ACPI CPU> on acpi0 cpu25: <ACPI CPU> on acpi0 cpu26: <ACPI CPU> on acpi0 cpu27: <ACPI CPU> on acpi0 cpu28: <ACPI CPU> on acpi0 cpu29: <ACPI CPU> on acpi0 cpu30: <ACPI CPU> on acpi0 cpu31: <ACPI CPU> on acpi0 cpu32: <ACPI CPU> on acpi0 cpu33: <ACPI CPU> on acpi0 cpu34: <ACPI CPU> on acpi0 cpu35: <ACPI CPU> on acpi0 cpu36: <ACPI CPU> on acpi0 cpu37: <ACPI CPU> on acpi0 cpu38: <ACPI CPU> on acpi0 cpu39: <ACPI CPU> on acpi0 cpu40: <ACPI CPU> on acpi0 cpu41: <ACPI CPU> on acpi0 cpu42: <ACPI CPU> on acpi0 cpu43: <ACPI CPU> on acpi0 cpu44: <ACPI CPU> on acpi0 cpu45: <ACPI CPU> on acpi0 cpu46: <ACPI CPU> on acpi0 cpu47: <ACPI CPU> on acpi0 cpu48: <ACPI CPU> on acpi0 cpu49: <ACPI CPU> on acpi0 cpu50: <ACPI CPU> on acpi0 cpu51: <ACPI CPU> on acpi0 cpu52: <ACPI CPU> on acpi0 cpu53: <ACPI CPU> on acpi0 cpu54: <ACPI CPU> on acpi0 cpu55: <ACPI CPU> on acpi0 cpu56: <ACPI CPU> on acpi0 cpu57: <ACPI CPU> on acpi0 cpu58: <ACPI CPU> on acpi0 cpu59: <ACPI CPU> on acpi0 cpu60: <ACPI CPU> on acpi0 cpu61: <ACPI CPU> on acpi0 cpu62: <ACPI CPU> on acpi0 cpu63: <ACPI CPU> on acpi0 attimer0: <AT timer> port 0x40-0x43 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 atrtc0: <AT realtime clock> port 0x70-0x71 irq 8 on acpi0 Event timer "RTC" frequency 32768 Hz quality 0 hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Timecounter "ACPI-safe" frequency 3579545 Hz quality 850 acpi_timer0: <32-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0 pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0 pci0: <ACPI PCI bus> on pcib0 pci0: <base peripheral> at device 0.2 (no driver attached) pcib1: <ACPI PCI-PCI bridge> irq 52 at device 4.0 on pci0 pci5: <ACPI PCI bus> on pcib1 igb0: <Intel(R) PRO/1000 Network Connection version - 2.3.4> port 0xe400-0xe41f mem 0xfeb60000-0xfeb7ffff,0xfeb40000-0xfeb5ffff,0xfeb1c000-0xfeb1ffff irq 44 at device 0.0 on pci5 igb0: Using MSIX interrupts with 9 vectors igb0: Ethernet address: 00:e0:81:c8:ee:8a igb0: Bound queue 0 to cpu 0 igb0: Bound queue 1 to cpu 1 igb0: Bound queue 2 to cpu 2 igb0: Bound queue 3 to cpu 3 igb0: Bound queue 4 to cpu 4 igb0: Bound queue 5 to cpu 5 igb0: Bound queue 6 to cpu 6 igb0: Bound queue 7 to cpu 7 igb1: <Intel(R) PRO/1000 Network Connection version - 2.3.4> port 0xe800-0xe81f mem 0xfebe0000-0xfebfffff,0xfebc0000-0xfebdffff,0xfeb9c000-0xfeb9ffff irq 45 at device 0.1 on pci5 igb1: Using MSIX interrupts with 9 vectors igb1: Ethernet address: 00:e0:81:c8:ee:8b igb1: Bound queue 0 to cpu 8 igb1: Bound queue 1 to cpu 9 igb1: Bound queue 2 to cpu 10 igb1: Bound queue 3 to cpu 11 igb1: Bound queue 4 to cpu 12 igb1: Bound queue 5 to cpu 13 igb1: Bound queue 6 to cpu 14 igb1: Bound queue 7 to cpu 15 pcib2: <ACPI PCI-PCI bridge> irq 53 at device 9.0 on pci0 pci4: <ACPI PCI bus> on pcib2 em0: <Intel(R) PRO/1000 Network Connection 7.3.2> port 0xd800-0xd81f mem 0xfeae0000-0xfeafffff,0xfeadc000-0xfeadffff irq 48 at device 0.0 on pci4 em0: Using MSIX interrupts with 3 vectors em0: Ethernet address: 00:e0:81:c8:ee:ff pcib3: <ACPI PCI-PCI bridge> irq 54 at device 11.0 on pci0 pci3: <ACPI PCI bus> on pcib3 mps0: <LSI SAS2008> port 0xc000-0xc0ff mem 0xfe93c000-0xfe93ffff,0xfe940000-0xfe97ffff irq 32 at device 0.0 on pci3 mps0: Firmware: 14.00.00.00, Driver: 14.00.00.01-fbsd mps0: IOCCapabilities: 1285c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,EventReplay,HostDisc> pcib4: <ACPI PCI-PCI bridge> irq 54 at device 13.0 on pci0 pci2: <ACPI PCI bus> on pcib4 mps1: <LSI SAS2008> port 0xb000-0xb0ff mem 0xfe83c000-0xfe83ffff,0xfe840000-0xfe87ffff irq 40 at device 0.0 on pci2 mps1: Firmware: 14.00.00.00, Driver: 14.00.00.01-fbsd mps1: IOCCapabilities: 185c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,IR> ahci0: <ATI IXP800 AHCI SATA controller> port 0x9000-0x9007,0x8000-0x8003,0x7000-0x7007,0x6000-0x6003,0x5000-0x500f mem 0xfdefe400-0xfdefe7ff irq 22 at device 17.0 on pci0 ahci0: AHCI v1.10 with 4 3Gbps ports, Port Multiplier supported ahcich0: <AHCI channel> at channel 0 on ahci0 ahcich1: <AHCI channel> at channel 1 on ahci0 ahcich2: <AHCI channel> at channel 2 on ahci0 ahcich3: <AHCI channel> at channel 3 on ahci0 ohci0: <AMD SB7x0/SB8x0/SB9x0 USB controller> mem 0xfdefa000-0xfdefafff irq 16 at device 18.0 on pci0 usbus0 on ohci0 ohci1: <OHCI (generic) USB controller> mem 0xfdefb000-0xfdefbfff irq 16 at device 18.1 on pci0 usbus1 on ohci1 ehci0: <AMD SB7x0/SB8x0/SB9x0 USB 2.0 controller> mem 0xfdefe800-0xfdefe8ff irq 17 at device 18.2 on pci0 usbus2: EHCI version 1.0 usbus2 on ehci0 ohci2: <AMD SB7x0/SB8x0/SB9x0 USB controller> mem 0xfdefc000-0xfdefcfff irq 18 at device 19.0 on pci0 usbus3 on ohci2 ohci3: <OHCI (generic) USB controller> mem 0xfdefd000-0xfdefdfff irq 18 at device 19.1 on pci0 usbus4 on ohci3 ehci1: <AMD SB7x0/SB8x0/SB9x0 USB 2.0 controller> mem 0xfdefec00-0xfdefecff irq 19 at device 19.2 on pci0 usbus5: EHCI version 1.0 usbus5 on ehci1 pci0: <serial bus, SMBus> at device 20.0 (no driver attached) atapci0: <ATI IXP700/800 UDMA133 controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xff00-0xff0f at device 20.1 on pci0 ata0: <ATA channel> at channel 0 on atapci0 ata1: <ATA channel> at channel 1 on atapci0 isab0: <PCI-ISA bridge> at device 20.3 on pci0 isa0: <ISA bus> on isab0 pcib5: <ACPI PCI-PCI bridge> at device 20.4 on pci0 pci1: <ACPI PCI bus> on pcib5 vgapci0: <VGA-compatible display> port 0xa800-0xa87f mem 0xfe000000-0xfe7fffff,0xfdfe0000-0xfdffffff irq 23 at device 9.0 on pci1 ohci4: <AMD SB7x0/SB8x0/SB9x0 USB controller> mem 0xfdeff000-0xfdefffff irq 18 at device 20.5 on pci0 usbus6 on ohci4 acpi_button0: <Power Button> on acpi0 uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 uart1: <Non-standard ns8250 class UART with FIFOs> port 0x2f8-0x2ff irq 3 on acpi0 ppc0: <Parallel port> port 0x378-0x37f irq 7 on acpi0 ppc0: Generic chipset (NIBBLE-only) in COMPATIBLE mode ppbus0: <Parallel port bus> on ppc0 plip0: <PLIP network interface> on ppbus0 lpt0: <Printer> on ppbus0 lpt0: Interrupt-driven port ppi0: <Parallel I/O> on ppbus0 orm0: <ISA Option ROM> at iomem 0xc0000-0xc7fff on isa0 sc0: <System console> at flags 0x100 on isa0 sc0: CGA <16 virtual consoles, flags=0x300> vga0: <Generic ISA VGA> at port 0x3d0-0x3db iomem 0xb8000-0xbffff on isa0 atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0 atkbd0: <AT Keyboard> irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] acpi_throttle0: <ACPI CPU Throttling> on cpu0 Timecounters tick every 1.000 msec usbus0: 12Mbps Full Speed USB v1.0 usbus1: 12Mbps Full Speed USB v1.0 usbus2: 480Mbps High Speed USB v2.0 usbus3: 12Mbps Full Speed USB v1.0 usbus4: 12Mbps Full Speed USB v1.0 usbus5: 480Mbps High Speed USB v2.0 usbus6: 12Mbps Full Speed USB v1.0 ugen0.1: <ATI> at usbus0 uhub0: <ATI OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus0 ugen1.1: <ATI> at usbus1 uhub1: <ATI OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus1 ugen2.1: <ATI> at usbus2 uhub2: <ATI EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus2 ugen3.1: <ATI> at usbus3 uhub3: <ATI OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus3 ugen4.1: <ATI> at usbus4 uhub4: <ATI OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus4 ugen5.1: <ATI> at usbus5 uhub5: <ATI EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus5 ugen6.1: <ATI> at usbus6 uhub6: <ATI OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus6 uhub6: 2 ports with 2 removable, self powered uhub0: 3 ports with 3 removable, self powered uhub1: 3 ports with 3 removable, self powered uhub3: 3 ports with 3 removable, self powered uhub4: 3 ports with 3 removable, self powered uhub2: 6 ports with 6 removable, self powered uhub5: 6 ports with 6 removable, self powered ugen5.2: <American Megatrends Inc.> at usbus5 uhub7: <Hub Interface> on usbus5 (probe257:mps1:0:2:0): INQUIRY. CDB: 12 0 0 0 24 0 (probe257:mps1:0:2:0): CAM status: Invalid Target ID (probe257:mps1:0:2:0): Error 22, Unretryable error (probe258:mps1:0:3:0): INQUIRY. CDB: 12 0 0 0 24 0 (probe258:mps1:0:3:0): CAM status: Invalid Target ID (probe258:mps1:0:3:0): Error 22, Unretryable error (probe0:mps1:0:2:1): INQUIRY. CDB: 12 20 0 0 24 0 (probe0:mps1:0:2:1): CAM status: Invalid Target ID (probe0:mps1:0:2:1): Error 22, Unretryable error (probe1:mps1:0:3:1): INQUIRY. CDB: 12 20 0 0 24 0 (probe1:mps1:0:3:1): CAM status: Invalid Target ID (probe1:mps1:0:3:1): Error 22, Unretryable error (probe0:mps1:0:2:2): INQUIRY. CDB: 12 40 0 0 24 0 (probe0:mps1:0:2:2): CAM status: Invalid Target ID (probe0:mps1:0:2:2): Error 22, Unretryable error (probe1:mps1:0:3:2): INQUIRY. CDB: 12 40 0 0 24 0 (probe1:mps1:0:3:2): CAM status: Invalid Target ID (probe1:mps1:0:3:2): Error 22, Unretryable error (probe0:mps1:0:2:3): INQUIRY. CDB: 12 60 0 0 24 0 (probe0:mps1:0:2:3): CAM status: Invalid Target ID (probe0:mps1:0:2:3): Error 22, Unretryable error (probe1:mps1:0:3:3): INQUIRY. CDB: 12 60 0 0 24 0 (probe1:mps1:0:3:3): CAM status: Invalid Target ID (probe1:mps1:0:3:3): Error 22, Unretryable error (probe0:mps1:0:2:4): INQUIRY. CDB: 12 80 0 0 24 0 (probe0:mps1:0:2:4): CAM status: Invalid Target ID (probe0:mps1:0:2:4): Error 22, Unretryable error (probe1:mps1:0:3:4): INQUIRY. CDB: 12 80 0 0 24 0 (probe1:mps1:0:3:4): CAM status: Invalid Target ID (probe1:mps1:0:3:4): Error 22, Unretryable error (probe0:mps1:0:2:5): INQUIRY. CDB: 12 a0 0 0 24 0 (probe0:mps1:0:2:5): CAM status: Invalid Target ID (probe0:mps1:0:2:5): Error 22, Unretryable error (probe1:mps1:0:3:5): INQUIRY. CDB: 12 a0 0 0 24 0 (probe1:mps1:0:3:5): CAM status: Invalid Target ID (probe1:mps1:0:3:5): Error 22, Unretryable error (probe0:mps1:0:2:6): INQUIRY. CDB: 12 c0 0 0 24 0 (probe0:mps1:0:2:6): CAM status: Invalid Target ID (probe0:mps1:0:2:6): Error 22, Unretryable error (probe1:mps1:0:3:6): INQUIRY. CDB: 12 c0 0 0 24 0 (probe1:mps1:0:3:6): CAM status: Invalid Target ID (probe1:mps1:0:3:6): Error 22, Unretryable error (probe0:mps1:0:2:7): INQUIRY. CDB: 12 e0 0 0 24 0 (probe0:mps1:0:2:7): CAM status: Invalid Target ID (probe0:mps1:0:2:7): Error 22, Unretryable error (probe1:mps1:0:3:7): INQUIRY. CDB: 12 e0 0 0 24 0 (probe1:mps1:0:3:7): CAM status: Invalid Target ID (probe1:mps1:0:3:7): Error 22, Unretryable error (probe255:mps1:0:0:0): REPORT LUNS. CDB: a0 0 0 0 0 0 0 0 0 10 0 0 (probe255:mps1:0:0:0): CAM status: SCSI Status Error (probe255:mps1:0:0:0): SCSI status: Check Condition (probe255:mps1:0:0:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code) (probe255:mps1:0:0:0): Command Specific Info: 0x2c4803c0 (probe255:mps1:0:0:0): Error 22, Unretryable error (probe0:mps1:0:3:0): INQUIRY. CDB: 12 0 0 0 24 0 (probe0:mps1:0:3:0): CAM status: Invalid Target ID (probe0:mps1:0:3:0): Error 22, Unretryable error (probe1:mps1:0:2:0): INQUIRY. CDB: 12 0 0 0 24 0 (probe1:mps1:0:2:0): CAM status: Invalid Target ID (probe1:mps1:0:2:0): Error 22, Unretryable error (probe0:mps1:0:3:0): INQUIRY. CDB: 12 0 0 0 24 0 (probe0:mps1:0:3:0): CAM status: Invalid Target ID (probe0:mps1:0:3:0): Error 22, Unretryable error (probe1:mps1:0:2:0): INQUIRY. CDB: 12 0 0 0 24 0 (probe1:mps1:0:2:0): CAM status: Invalid Target ID (probe1:mps1:0:2:0): Error 22, Unretryable error (probe2:mps1:0:3:1): INQUIRY. CDB: 12 20 0 0 24 0 (probe2:mps1:0:3:1): CAM status: Invalid Target ID (probe2:mps1:0:3:1): Error 22, Unretryable error (probe0:mps1:0:2:1): INQUIRY. CDB: 12 20 0 0 24 0 (probe0:mps1:0:2:1): CAM status: Invalid Target ID (probe0:mps1:0:2:1): Error 22, Unretryable error (probe1:mps1:0:3:1): INQUIRY. CDB: 12 20 0 0 24 0 (probe1:mps1:0:3:1): CAM status: Invalid Target ID (probe1:mps1:0:3:1): Error 22, Unretryable error (probe0:mps1:0:2:1): INQUIRY. CDB: 12 20 0 0 24 0 (probe0:mps1:0:2:1): CAM status: Invalid Target ID (probe0:mps1:0:2:1): Error 22, Unretryable error (probe2:mps1:0:3:2): INQUIRY. CDB: 12 40 0 0 24 0 (probe2:mps1:0:3:2): CAM status: Invalid Target ID (probe2:mps1:0:3:2): Error 22, Unretryable error (probe1:mps1:0:2:2): INQUIRY. CDB: 12 40 0 0 24 0 (probe1:mps1:0:2:2): CAM status: Invalid Target ID (probe1:mps1:0:2:2): Error 22, Unretryable error (probe0:mps1:0:3:2): INQUIRY. CDB: 12 40 0 0 24 0 (probe0:mps1:0:3:2): CAM status: Invalid Target ID (probe0:mps1:0:3:2): Error 22, Unretryable error (probe1:mps1:0:2:2): INQUIRY. CDB: 12 40 0 0 24 0 (probe1:mps1:0:2:2): CAM status: Invalid Target ID (probe1:mps1:0:2:2): Error 22, Unretryable error (probe2:mps1:0:3:3): INQUIRY. CDB: 12 60 0 0 24 0 (probe2:mps1:0:3:3): CAM status: Invalid Target ID (probe2:mps1:0:3:3): Error 22, Unretryable error (probe0:mps1:0:2:3): INQUIRY. CDB: 12 60 0 0 24 0 (probe0:mps1:0:2:3): CAM status: Invalid Target ID (probe0:mps1:0:2:3): Error 22, Unretryable error (probe1:mps1:0:3:3): INQUIRY. CDB: 12 60 0 0 24 0 (probe1:mps1:0:3:3): CAM status: Invalid Target ID (probe1:mps1:0:3:3): Error 22, Unretryable error (probe0:mps1:0:2:3): INQUIRY. CDB: 12 60 0 0 24 0 (probe0:mps1:0:2:3): CAM status: Invalid Target ID (probe0:mps1:0:2:3): Error 22, Unretryable error (probe2:mps1:0:3:4): INQUIRY. CDB: 12 80 0 0 24 0 (probe2:mps1:0:3:4): CAM status: Invalid Target ID (probe2:mps1:0:3:4): Error 22, Unretryable error (probe1:mps1:0:2:4): INQUIRY. CDB: 12 80 0 0 24 0 (probe1:mps1:0:2:4): CAM status: Invalid Target ID (probe1:mps1:0:2:4): Error 22, Unretryable error (probe0:mps1:0:3:4): INQUIRY. CDB: 12 80 0 0 24 0 (probe0:mps1:0:3:4): CAM status: Invalid Target ID (probe0:mps1:0:3:4): Error 22, Unretryable error (probe1:mps1:0:2:4): INQUIRY. CDB: 12 80 0 0 24 0 (probe1:mps1:0:2:4): CAM status: Invalid Target ID (probe1:mps1:0:2:4): Error 22, Unretryable error (probe2:mps1:0:3:5): INQUIRY. CDB: 12 a0 0 0 24 0 (probe2:mps1:0:3:5): CAM status: Invalid Target ID (probe2:mps1:0:3:5): Error 22, Unretryable error (probe0:mps1:0:2:5): INQUIRY. CDB: 12 a0 0 0 24 0 (probe0:mps1:0:2:5): CAM status: Invalid Target ID (probe0:mps1:0:2:5): Error 22, Unretryable error (probe1:mps1:0:3:5): INQUIRY. CDB: 12 a0 0 0 24 0 (probe1:mps1:0:3:5): CAM status: Invalid Target ID (probe1:mps1:0:3:5): Error 22, Unretryable error (probe0:mps1:0:2:5): INQUIRY. CDB: 12 a0 0 0 24 0 (probe0:mps1:0:2:5): CAM status: Invalid Target ID (probe0:mps1:0:2:5): Error 22, Unretryable error (probe2:mps1:0:3:6): INQUIRY. CDB: 12 c0 0 0 24 0 (probe2:mps1:0:3:6): CAM status: Invalid Target ID (probe2:mps1:0:3:6): Error 22, Unretryable error (probe1:mps1:0:2:6): INQUIRY. CDB: 12 c0 0 0 24 0 (probe1:mps1:0:2:6): CAM status: Invalid Target ID (probe1:mps1:0:2:6): Error 22, Unretryable error (probe0:mps1:0:3:6): INQUIRY. CDB: 12 c0 0 0 24 0 (probe0:mps1:0:3:6): CAM status: Invalid Target ID (probe0:mps1:0:3:6): Error 22, Unretryable error (probe1:mps1:0:2:6): INQUIRY. CDB: 12 c0 0 0 24 0 (probe1:mps1:0:2:6): CAM status: Invalid Target ID (probe1:mps1:0:2:6): Error 22, Unretryable error (probe2:mps1:0:3:7): INQUIRY. CDB: 12 e0 0 0 24 0 (probe2:mps1:0:3:7): CAM status: Invalid Target ID (probe2:mps1:0:3:7): Error 22, Unretryable error (probe0:mps1:0:2:7): INQUIRY. CDB: 12 e0 0 0 24 0 (probe0:mps1:0:2:7): CAM status: Invalid Target ID (probe0:mps1:0:2:7): Error 22, Unretryable error (probe1:mps1:0:3:7): INQUIRY. CDB: 12 e0 0 0 24 0 (probe1:mps1:0:3:7): CAM status: Invalid Target ID (probe1:mps1:0:3:7): Error 22, Unretryable error (probe0:mps1:0:2:7): INQUIRY. CDB: 12 e0 0 0 24 0 (probe0:mps1:0:2:7): CAM status: Invalid Target ID (probe0:mps1:0:2:7): Error 22, Unretryable error uhub7: 3 ports with 3 removable, self powered (probe255:mps1:0:0:0): REPORT LUNS. CDB: a0 0 0 0 0 0 0 0 0 10 0 0 (probe255:mps1:0:0:0): CAM status: SCSI Status Error (probe255:mps1:0:0:0): SCSI status: Check Condition (probe255:mps1:0:0:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code) (probe255:mps1:0:0:0): Field Replaceable Unit: 56 (probe255:mps1:0:0:0): Command Specific Info: 0x33353839 (probe255:mps1:0:0:0): Error 22, Unretryable error da0 at mps0 bus 0 scbus0 target 3 lun 0 da0: <ATA M4-CT256M4SSD2 000F> Fixed Direct Access SCSI-6 device da0: 600.000MB/s transfers da0: Command Queueing enabled da0: 244198MB (500118192 512 byte sectors: 255H 63S/T 31130C) da1 at mps0 bus 0 scbus0 target 5 lun 0 da1: <ATA WDC WD2500HHTZ-0 6A00> Fixed Direct Access SCSI-6 device da1: 600.000MB/s transfers da1: Command Queueing enabled da1: 238475MB (488397168 512 byte sectors: 255H 63S/T 30401C) da8 at mps1 bus 0 scbus1 target 0 lun 0 da8: <LSI Logical Volume 3000> Fixed Direct Access SCSI-6 device da8: 150.000MB/s transfers da8: Command Queueing enabled da8: 68664MB (140623872 512 byte sectors: 255H 63S/T 8753C) da5 at mps0 bus 0 scbus0 target 9 lun 0 da5: <ATA ST3000DM001-1CH1 CC43> Fixed Direct Access SCSI-6 device da5: 600.000MB/s transfers da5: Command Queueing enabled da5: 2861588MB (5860533168 512 byte sectors: 255H 63S/T 364801C) da7 at mps0 bus 0 scbus0 target 11 lun 0 da7: <ATA ST3000DM001-1CH1 CC43> Fixed Direct Access SCSI-6 device da7: 600.000MB/s transfers da7: Command Queueing enabled da7: 2861588MB (5860533168 512 byte sectors: 255H 63S/T 364801C) da6 at mps0 bus 0 scbus0 target 10 lun 0 da6: <ATA ST3000DM001-1CH1 CC43> Fixed Direct Access SCSI-6 device da6: 600.000MB/s transfers da6: Command Queueing enabled da6: 2861588MB (5860533168 512 byte sectors: 255H 63S/T 364801C) SMP: AP CPU #1 Launched! SMP: AP CPU #47 Launched! cd0 at ahcich0 bus 0 scbus2 target 0 lun 0 SMP: AP CPU #44 Launched! cd0: <HL-DT-ST BD-RE BH10LS30 1.00> Removable CD-ROM SCSI-0 device cd0: 150.000MB/s transfers (SATA 1.x, UDMA6, ATAPI 12bytes, PIO 8192bytes) cd0: Attempt to query device size failed: NOT READY, Medium not present - tray closed SMP: AP CPU #57 Launched! da3 at mps0 bus 0 scbus0 target 7 lun 0 da3: <ATA ST3000DM001-9YN1 CC4B> Fixed Direct Access SCSI-6 device da3: 600.000MB/s transfers SMP: AP CPU #56 Launched! da3: Command Queueing enabled da3: 2861588MB (5860533168 512 byte sectors: 255H 63S/T 364801C) SMP: AP CPU #39 Launched! da2 at mps0 bus 0 scbus0 target 6 lun 0 da2: <ATA ST3000DM001-9YN1 CC4B> Fixed Direct Access SCSI-6 device da2: 600.000MB/s transfers SMP: AP CPU #38 Launched! da2: Command Queueing enabled da2: 2861588MB (5860533168 512 byte sectors: 255H 63S/T 364801C) SMP: AP CPU #33 Launched! SMP: AP CPU #32 Launched! SMP: AP CPU #31 Launched! SMP: AP CPU #30 Launched! da4 at mps0 bus 0 scbus0 target 8 lun 0 da4: <ATA ST3000DM001-9YN1 CC4B> Fixed Direct Access SCSI-6 device SMP: AP CPU #35 Launched! da4: 600.000MB/s transfers da4: Command Queueing enabled da4: 2861588MB (5860533168 512 byte sectors: 255H 63S/T 364801C) SMP: AP CPU #34 Launched! SMP: AP CPU #36 Launched! SMP: AP CPU #41 Launched! SMP: AP CPU #42 Launched! SMP: AP CPU #37 Launched! SMP: AP CPU #25 Launched! da9 at mps1 bus 0 scbus1 target 9 lun 0 SMP: AP CPU #59 Launched! da9: <ATA Hitachi HDS5C404 A250> Fixed Direct Access SCSI-6 device da9: 600.000MB/s transfers da9: Command Queueing enabled SMP: AP CPU #58 Launched! da9: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C) da10 at mps1 bus 0 scbus1 target 11 lun 0 da10: <ATA Hitachi HDS5C404 A3B0> Fixed Direct Access SCSI-6 device SMP: AP CPU #24 Launched! da10: 600.000MB/s transfers da10: Command Queueing enabled da10: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C) SMP: AP CPU #2 Launched! SMP: AP CPU #29 Launched! SMP: AP CPU #26 Launched! SMP: AP CPU #63 Launched! SMP: AP CPU #28 Launched! SMP: AP CPU #60 Launched! SMP: AP CPU #27 Launched! SMP: AP CPU #5 Launched! SMP: AP CPU #6 Launched! SMP: AP CPU #8 Launched! SMP: AP CPU #7 Launched! SMP: AP CPU #13 Launched! SMP: AP CPU #52 Launched! SMP: AP CPU #49 Launched! SMP: AP CPU #3 Launched! SMP: AP CPU #50 Launched! SMP: AP CPU #48 Launched! SMP: AP CPU #4 Launched! SMP: AP CPU #61 Launched! SMP: AP CPU #51 Launched! SMP: AP CPU #15 Launched! SMP: AP CPU #10 Launched! SMP: AP CPU #17 Launched! SMP: AP CPU #18 Launched! SMP: AP CPU #19 Launched! SMP: AP CPU #62 Launched! SMP: AP CPU #11 Launched! SMP: AP CPU #53 Launched! SMP: AP CPU #20 Launched! SMP: AP CPU #55 Launched! SMP: AP CPU #23 Launched! SMP: AP CPU #16 Launched! SMP: AP CPU #9 Launched! SMP: AP CPU #14 Launched! SMP: AP CPU #54 Launched! SMP: AP CPU #22 Launched! SMP: AP CPU #12 Launched! SMP: AP CPU #21 Launched! SMP: AP CPU #45 Launched! SMP: AP CPU #40 Launched! SMP: AP CPU #46 Launched! SMP: AP CPU #43 Launched! Timecounter "TSC-low" frequency 8594016 Hz quality 800 ugen5.3: <American Megatrends Inc.> at usbus5 ukbd0: <Keyboard Interface> on usbus5 kbd2 at ukbd0 ums0: <Mouse Interface> on usbus5 ums0: 3 buttons and [Z] coordinates ID=0 Trying to mount root from ufs:/dev/gpt/disk0 [rw]... WARNING: / was not properly dismounted ugen3.2: <BTC> at usbus3 ukbd1: <BTC USB Multimedia Keyboard, class 0/0, rev 1.10/1.00, addr 2> on usbus3 kbd3 at ukbd1 uhid0: <BTC USB Multimedia Keyboard, class 0/0, rev 1.10/1.00, addr 2> on usbus3 ZFS filesystem version 5 ZFS storage pool version 28 swap_pager: out of swap space swap_pager_getswapspace(16): failed pid 1847 (fstat), uid 0, was killed: out of swap space
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?1349447619.89356.13.camel>