From owner-freebsd-questions@FreeBSD.ORG Sat Apr 27 15:29:15 2013 Return-Path: Delivered-To: freebsd-questions@freebsd.org Received: from mx1.freebsd.org (mx1.FreeBSD.org [8.8.178.115]) by hub.freebsd.org (Postfix) with ESMTP id A7C77500 for ; Sat, 27 Apr 2013 15:29:15 +0000 (UTC) (envelope-from freebsd@pki2.com) Received: from btw.pki2.com (btw.pki2.com [IPv6:2001:470:a:6fd::2]) by mx1.freebsd.org (Postfix) with ESMTP id 22CA21E25 for ; Sat, 27 Apr 2013 15:29:15 +0000 (UTC) Received: from [127.0.0.1] (localhost [127.0.0.1]) by btw.pki2.com (8.14.6/8.14.5) with ESMTP id r3RFT42d091239 for ; Sat, 27 Apr 2013 08:29:04 -0700 (PDT) (envelope-from freebsd@pki2.com) Subject: SMP boot differences between 8.4 and 9.1? From: Dennis Glatting To: freebsd-questions@freebsd.org Content-Type: text/plain; charset="ISO-8859-1" Date: Sat, 27 Apr 2013 08:29:04 -0700 Message-ID: <1367076544.10478.8.camel@btw.pki2.com> Mime-Version: 1.0 X-Mailer: Evolution 2.32.1 FreeBSD GNOME Team Port Content-Transfer-Encoding: 7bit X-yoursite-MailScanner-Information: Dennis Glatting X-yoursite-MailScanner-ID: r3RFT42d091239 X-yoursite-MailScanner: Found to be clean X-MailScanner-From: freebsd@pki2.com X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 27 Apr 2013 15:29:15 -0000 I have two four socket Opteron 6200 motherboards with populated 16-core Opteron 6200 series processors. Onw is Tyan (below) and the other Supermicro. When booted under 8.4 only two sockets are recognized but four under 9.1. Is this expected behavior? dmesg from 8.4: mc# cat /var/run/dmesg.boot Copyright (c) 1992-2013 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 8.4-PRERELEASE #0 r249529: Mon Apr 15 19:26:38 PDT 2013 root@mc:/disk-2/obj/disk-1/src/sys/SMUNI.RELENG_8 amd64 gcc version 4.2.1 20070831 patched [FreeBSD] Timecounter "i8254" frequency 1193182 Hz quality 0 CPU: AMD Opteron(TM) Processor 6274 (2200.04-MHz K8-class CPU) Origin = "AuthenticAMD" Id = 0x600f12 Family = 15 Model = 1 Stepping = 2 Features=0x178bfbff Features2=0x1e98220b AMD Features=0x2e500800 AMD Features2=0x1c9bfff,> TSC: P-state invariant real memory = 137438953472 (131072 MB) avail memory = 132427870208 (126293 MB) ACPI APIC Table: <120911 APIC1027> FreeBSD/SMP: Multiprocessor System Detected: 32 CPUs FreeBSD/SMP: 2 package(s) x 16 core(s) cpu0 (BSP): APIC ID: 32 cpu1 (AP): APIC ID: 33 cpu2 (AP): APIC ID: 34 cpu3 (AP): APIC ID: 35 cpu4 (AP): APIC ID: 36 cpu5 (AP): APIC ID: 37 cpu6 (AP): APIC ID: 38 cpu7 (AP): APIC ID: 39 cpu8 (AP): APIC ID: 40 cpu9 (AP): APIC ID: 41 cpu10 (AP): APIC ID: 42 cpu11 (AP): APIC ID: 43 cpu12 (AP): APIC ID: 44 cpu13 (AP): APIC ID: 45 cpu14 (AP): APIC ID: 46 cpu15 (AP): APIC ID: 47 cpu16 (AP): APIC ID: 64 cpu17 (AP): APIC ID: 65 cpu18 (AP): APIC ID: 66 cpu19 (AP): APIC ID: 67 cpu20 (AP): APIC ID: 68 cpu21 (AP): APIC ID: 69 cpu22 (AP): APIC ID: 70 cpu23 (AP): APIC ID: 71 cpu24 (AP): APIC ID: 72 cpu25 (AP): APIC ID: 73 cpu26 (AP): APIC ID: 74 cpu27 (AP): APIC ID: 75 cpu28 (AP): APIC ID: 76 cpu29 (AP): APIC ID: 77 cpu30 (AP): APIC ID: 78 cpu31 (AP): APIC ID: 79 cpu (AP): APIC ID: 96 (disabled) cpu (AP): APIC ID: 97 (disabled) cpu (AP): APIC ID: 98 (disabled) cpu (AP): APIC ID: 99 (disabled) cpu (AP): APIC ID: 100 (disabled) cpu (AP): APIC ID: 101 (disabled) cpu (AP): APIC ID: 102 (disabled) cpu (AP): APIC ID: 103 (disabled) cpu (AP): APIC ID: 104 (disabled) cpu (AP): APIC ID: 105 (disabled) cpu (AP): APIC ID: 106 (disabled) cpu (AP): APIC ID: 107 (disabled) cpu (AP): APIC ID: 108 (disabled) cpu (AP): APIC ID: 109 (disabled) cpu (AP): APIC ID: 110 (disabled) cpu (AP): APIC ID: 111 (disabled) cpu (AP): APIC ID: 128 (disabled) cpu (AP): APIC ID: 129 (disabled) cpu (AP): APIC ID: 130 (disabled) cpu (AP): APIC ID: 131 (disabled) cpu (AP): APIC ID: 132 (disabled) cpu (AP): APIC ID: 133 (disabled) cpu (AP): APIC ID: 134 (disabled) cpu (AP): APIC ID: 135 (disabled) cpu (AP): APIC ID: 136 (disabled) cpu (AP): APIC ID: 137 (disabled) cpu (AP): APIC ID: 138 (disabled) cpu (AP): APIC ID: 139 (disabled) cpu (AP): APIC ID: 140 (disabled) cpu (AP): APIC ID: 141 (disabled) cpu (AP): APIC ID: 142 (disabled) cpu (AP): APIC ID: 143 (disabled) ACPI Warning: Optional field Pm2ControlBlock has zero address or length: 0x0000000000000000/0x1 (20101013/tbfadt-655) ioapic0 irqs 0-23 on motherboard ioapic1 irqs 24-55 on motherboard kbd1 at kbdmux0 cryptosoft0: on motherboard aesni0: on motherboard acpi0: <120911 XSDT1027> on motherboard acpi0: [ITHREAD] acpi0: Power Button (fixed) acpi0: reservation of fec00000, 1000 (3) failed acpi0: reservation of fee00000, 1000 (3) failed acpi0: reservation of ffb80000, 80000 (3) failed acpi0: reservation of fec10000, 20 (3) failed acpi0: reservation of 0, a0000 (3) failed acpi0: reservation of 100000, dff00000 (3) failed Timecounter "ACPI-safe" frequency 3579545 Hz quality 850 acpi_timer0: <32-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0 cpu0: on acpi0 cpu1: on acpi0 cpu2: on acpi0 cpu3: on acpi0 cpu4: on acpi0 cpu5: on acpi0 cpu6: on acpi0 cpu7: on acpi0 cpu8: on acpi0 cpu9: on acpi0 cpu10: on acpi0 cpu11: on acpi0 cpu12: on acpi0 cpu13: on acpi0 cpu14: on acpi0 cpu15: on acpi0 cpu16: on acpi0 cpu17: on acpi0 cpu18: on acpi0 cpu19: on acpi0 cpu20: on acpi0 cpu21: on acpi0 cpu22: on acpi0 cpu23: on acpi0 cpu24: on acpi0 cpu25: on acpi0 cpu26: on acpi0 cpu27: on acpi0 cpu28: on acpi0 cpu29: on acpi0 cpu30: on acpi0 cpu31: on acpi0 acpi_hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 900 pcib0: port 0xcf8-0xcff on acpi0 pci0: on pcib0 pci0: at device 0.2 (no driver attached) pcib1: irq 52 at device 4.0 on pci0 pci5: on pcib1 igb0: port 0xe400-0xe41f mem 0xfeb60000-0xfeb7ffff,0xfeb40000-0xfeb5ffff,0xfeb1c000-0xfeb1ffff irq 44 at device 0.0 on pci5 igb0: Using MSIX interrupts with 9 vectors igb0: Ethernet address: 00:e0:81:c8:ee:8a igb0: [ITHREAD] igb0: Bound queue 0 to cpu 0 igb0: [ITHREAD] igb0: Bound queue 1 to cpu 1 igb0: [ITHREAD] igb0: Bound queue 2 to cpu 2 igb0: [ITHREAD] igb0: Bound queue 3 to cpu 3 igb0: [ITHREAD] igb0: Bound queue 4 to cpu 4 igb0: [ITHREAD] igb0: Bound queue 5 to cpu 5 igb0: [ITHREAD] igb0: Bound queue 6 to cpu 6 igb0: [ITHREAD] igb0: Bound queue 7 to cpu 7 igb0: [ITHREAD] igb1: port 0xe800-0xe81f mem 0xfebe0000-0xfebfffff,0xfebc0000-0xfebdffff,0xfeb9c000-0xfeb9ffff irq 45 at device 0.1 on pci5 igb1: Using MSIX interrupts with 9 vectors igb1: Ethernet address: 00:e0:81:c8:ee:8b igb1: [ITHREAD] igb1: Bound queue 0 to cpu 8 igb1: [ITHREAD] igb1: Bound queue 1 to cpu 9 igb1: [ITHREAD] igb1: Bound queue 2 to cpu 10 igb1: [ITHREAD] igb1: Bound queue 3 to cpu 11 igb1: [ITHREAD] igb1: Bound queue 4 to cpu 12 igb1: [ITHREAD] igb1: Bound queue 5 to cpu 13 igb1: [ITHREAD] igb1: Bound queue 6 to cpu 14 igb1: [ITHREAD] igb1: Bound queue 7 to cpu 15 igb1: [ITHREAD] pcib2: irq 53 at device 9.0 on pci0 pci4: on pcib2 em0: port 0xd800-0xd81f mem 0xfeae0000-0xfeafffff,0xfeadc000-0xfeadffff irq 48 at device 0.0 on pci4 em0: Using MSIX interrupts with 3 vectors em0: [ITHREAD] em0: [ITHREAD] em0: [ITHREAD] em0: Ethernet address: 00:e0:81:c8:ee:ff pcib3: irq 54 at device 11.0 on pci0 pci3: on pcib3 mps0: port 0xc000-0xc0ff mem 0xfe93c000-0xfe93ffff,0xfe940000-0xfe97ffff irq 32 at device 0.0 on pci3 mps0: Firmware: 15.00.00.00, Driver: 14.00.00.01-fbsd mps0: IOCCapabilities: 1285c mps0: [ITHREAD] pcib4: irq 54 at device 13.0 on pci0 pci2: on pcib4 mps1: port 0xb000-0xb0ff mem 0xfe83c000-0xfe83ffff,0xfe840000-0xfe87ffff irq 40 at device 0.0 on pci2 mps1: Firmware: 15.00.00.00, Driver: 14.00.00.01-fbsd mps1: IOCCapabilities: 185c mps1: [ITHREAD] ahci0: port 0x9000-0x9007,0x8000-0x8003,0x7000-0x7007,0x6000-0x6003,0x5000-0x500f mem 0xfdefe400-0xfdefe7ff irq 22 at device 17.0 on pci0 ahci0: [ITHREAD] ahci0: AHCI v1.10 with 4 3Gbps ports, Port Multiplier supported ahcich0: at channel 0 on ahci0 ahcich0: [ITHREAD] ahcich1: at channel 1 on ahci0 ahcich1: [ITHREAD] ahcich2: at channel 2 on ahci0 ahcich2: [ITHREAD] ahcich3: at channel 3 on ahci0 ahcich3: [ITHREAD] ohci0: mem 0xfdefa000-0xfdefafff irq 16 at device 18.0 on pci0 ohci0: [ITHREAD] usbus0 on ohci0 ohci1: mem 0xfdefb000-0xfdefbfff irq 16 at device 18.1 on pci0 ohci1: [ITHREAD] usbus1 on ohci1 ehci0: mem 0xfdefe800-0xfdefe8ff irq 17 at device 18.2 on pci0 ehci0: [ITHREAD] usbus2: EHCI version 1.0 usbus2 on ehci0 ohci2: mem 0xfdefc000-0xfdefcfff irq 18 at device 19.0 on pci0 ohci2: [ITHREAD] usbus3 on ohci2 ohci3: mem 0xfdefd000-0xfdefdfff irq 18 at device 19.1 on pci0 ohci3: [ITHREAD] usbus4 on ohci3 ehci1: mem 0xfdefec00-0xfdefecff irq 19 at device 19.2 on pci0 ehci1: [ITHREAD] usbus5: EHCI version 1.0 usbus5 on ehci1 pci0: at device 20.0 (no driver attached) atapci0: port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xff00-0xff0f at device 20.1 on pci0 ata0: at channel 0 on atapci0 ata0: [ITHREAD] ata1: at channel 1 on atapci0 ata1: [ITHREAD] isab0: at device 20.3 on pci0 isa0: on isab0 pcib5: at device 20.4 on pci0 pci1: on pcib5 vgapci0: port 0xa800-0xa87f mem 0xfe000000-0xfe7fffff,0xfdfe0000-0xfdffffff irq 23 at device 9.0 on pci1 ohci4: mem 0xfdeff000-0xfdefffff irq 18 at device 20.5 on pci0 ohci4: [ITHREAD] usbus6 on ohci4 acpi_button0: on acpi0 atrtc0: port 0x70-0x71 irq 8 on acpi0 uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 uart0: [FILTER] uart1: port 0x2f8-0x2ff irq 3 on acpi0 uart1: [FILTER] ppc0: port 0x378-0x37f irq 7 on acpi0 ppc0: Generic chipset (NIBBLE-only) in COMPATIBLE mode ppc0: [ITHREAD] ppbus0: on ppc0 plip0: on ppbus0 plip0: [ITHREAD] lpt0: on ppbus0 lpt0: [ITHREAD] lpt0: Interrupt-driven port ppi0: on ppbus0 acpi_hpet1: iomem 0xfed00000-0xfed003ff on acpi0 device_attach: acpi_hpet1 attach returned 12 orm0: at iomem 0xc0000-0xc7fff on isa0 sc0: at flags 0x100 on isa0 sc0: CGA <16 virtual consoles, flags=0x300> vga0: at port 0x3d0-0x3db iomem 0xb8000-0xbffff on isa0 atkbdc0: at port 0x60,0x64 on isa0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] atkbd0: [ITHREAD] acpi_throttle0: on cpu0 Timecounters tick every 1.000 msec usbus0: 12Mbps Full Speed USB v1.0 usbus1: 12Mbps Full Speed USB v1.0 usbus2: 480Mbps High Speed USB v2.0 usbus3: 12Mbps Full Speed USB v1.0 usbus4: 12Mbps Full Speed USB v1.0 usbus5: 480Mbps High Speed USB v2.0 usbus6: 12Mbps Full Speed USB v1.0 ugen0.1: at usbus0 uhub0: on usbus0 ugen1.1: at usbus1 uhub1: on usbus1 ugen2.1: at usbus2 uhub2: on usbus2 ugen3.1: at usbus3 uhub3: on usbus3 ugen4.1: at usbus4 uhub4: on usbus4 ugen5.1: at usbus5 uhub5: on usbus5 ugen6.1: at usbus6 uhub6: on usbus6 uhub6: 2 ports with 2 removable, self powered uhub0: 3 ports with 3 removable, self powered uhub1: 3 ports with 3 removable, self powered uhub3: 3 ports with 3 removable, self powered uhub4: 3 ports with 3 removable, self powered (probe255:mps1:0:0:0): REPORT LUNS. CDB: a0 0 0 0 0 0 0 0 0 10 0 0 (probe255:mps1:0:0:0): CAM status: SCSI Status Error (probe255:mps1:0:0:0): SCSI status: Check Condition (probe255:mps1:0:0:0): SCSI sense: ILLEGAL REQUEST info?:20b18d csi:8c,4c,3,c0 asc:20,0 (Invalid command operation code) (probe255:mps1:0:0:0): REPORT LUNS. CDB: a0 0 0 0 0 0 0 0 0 10 0 0 (probe255:mps1:0:0:0): CAM status: SCSI Status Error (probe255:mps1:0:0:0): SCSI status: Check Condition (probe255:mps1:0:0:0): SCSI sense: ILLEGAL REQUEST info?:14203334 csi:33,35,38,39 asc:20,0 (Invalid command operation code) field replaceable unit: 38 da0 at mps0 bus 0 scbus0 target 3 lun 0 da0: Fixed Direct Access SCSI-6 device da0: 600.000MB/s transfers da0: Command Queueing enabled da0: 244198MB (500118192 512 byte sectors: 255H 63S/T 31130C) da1 at mps0 bus 0 scbus0 target 5 lun 0 da1: Fixed Direct Access SCSI-6 device da1: 600.000MB/s transfers da1: Command Queueing enabled da1: 238475MB (488397168 512 byte sectors: 255H 63S/T 30401C) da6 at mps0 bus 0 scbus0 target 11 lun 0 da6: Fixed Direct Access SCSI-6 device da6: 600.000MB/s transfers da6: Command Queueing enabled da6: 2861588MB (5860533168 512 byte sectors: 255H 63S/T 364801C) da8 at mps1 bus 0 scbus1 target 0 lun 0 da8: Fixed Direct Access SCSI-6 device da8: 150.000MB/s transfers da8: Command Queueing enabled da8: 68664MB (140623872 512 byte sectors: 255H 63S/T 8753C) da7 at mps0 bus 0 scbus0 target 12 lun 0 da7: Fixed Direct Access SCSI-6 device da7: 600.000MB/s transfers da7: Command Queueing enabled da7: 2861588MB (5860533168 512 byte sectors: 255H 63S/T 364801C) da3 at mps0 bus 0 scbus0 target 7 lun 0 da3: Fixed Direct Access SCSI-6 device da3: 600.000MB/s transfers da3: Command Queueing enabled da3: 2861588MB (5860533168 512 byte sectors: 255H 63S/T 364801C) da4 at mps0 bus 0 scbus0 target 8 lun 0 da4: Fixed Direct Access SCSI-6 device da4: 600.000MB/s transfers da4: Command Queueing enabled da4: 2861588MB (5860533168 512 byte sectors: 255H 63S/T 364801C) da5 at mps0 bus 0 scbus0 target 10 lun 0 da5: Fixed Direct Access SCSI-6 device da5: 600.000MB/s transfers da5: Command Queueing enabled da5: 2861588MB (5860533168 512 byte sectors: 255H 63S/T 364801C) da2 at mps0 bus 0 scbus0 target 6 lun 0 da2: Fixed Direct Access SCSI-6 device da2: 600.000MB/s transfers da2: Command Queueing enabled da2: 2861588MB (5860533168 512 byte sectors: 255H 63S/T 364801C) SMP: AP CPU #1 Launched! da10 at mps1 bus 0 scbus1 target 13 lun 0SMP: AP CPU #11 Launched! da10: Fixed Direct Access SCSI-6 device da10: 600.000MB/s transfers da10: Command Queueing enabled da10: 2861588MB (5860533168 512 byte sectors: 255H 63S/T 364801C)SMP: AP CPU #4 Launched! cd0 at ahcich0 bus 0 scbus2 target 0 lun 0 cd0: Removable CD-ROM SCSI-0 device cd0: 150.000MB/s transfers (SATA 1.x, UDMA6, ATAPI 12bytes, PIO 8192bytes)SMP: AP CPU #14 Launched! cd0: Attempt to query device size failed: NOT READY, Medium not present - tray closed da9 at mps1 bus 0 scbus1 target 12 lun 0SMP: AP CPU #3 Launched! da9: Fixed Direct Access SCSI-6 device da9: 600.000MB/s transfers da9: Command Queueing enabled da9: 2861588MB (5860533168 512 byte sectors: 255H 63S/T 364801C)SMP: AP CPU #6 Launched! SMP: AP CPU #9 Launched! SMP: AP CPU #21 Launched! SMP: AP CPU #5 Launched! SMP: AP CPU #10 Launched! SMP: AP CPU #23 Launched! SMP: AP CPU #7 Launched! SMP: AP CPU #8 Launched! SMP: AP CPU #13 Launched! SMP: AP CPU #18 Launched! SMP: AP CPU #16 Launched! SMP: AP CPU #19 Launched! SMP: AP CPU #22 Launched! SMP: AP CPU #12 Launched! SMP: AP CPU #2 Launched! SMP: AP CPU #15 Launched! SMP: AP CPU #17 Launched! SMP: AP CPU #20 Launched! SMP: AP CPU #26 Launched! SMP: AP CPU #31 Launched! SMP: AP CPU #27 Launched! SMP: AP CPU #24 Launched! SMP: AP CPU #28 Launched! SMP: AP CPU #25 Launched! SMP: AP CPU #29 Launched! SMP: AP CPU #30 Launched! Root mount waiting for: usbus5 usbus2 Root mount waiting for: usbus5 usbus2 uhub2: 6 ports with 6 removable, self powered uhub5: 6 ports with 6 removable, self powered ugen5.2: at usbus5 uhub7: on usbus5 Root mount waiting for: usbus5 uhub7: 3 ports with 3 removable, self powered Root mount waiting for: usbus5 ugen5.3: at usbus5 ukbd0: on usbus5 kbd2 at ukbd0 ums0: on usbus5 ums0: 3 buttons and [Z] coordinates ID=0 Trying to mount root from ufs:/dev/gpt/disk0 ZFS filesystem version: 5 ZFS storage pool version: features support (5000)