Date: Tue, 8 Apr 2008 02:24:35 GMT From: Greg Himes <greg@laaco.net> To: freebsd-gnats-submit@FreeBSD.org Subject: kern/122551: [bge] Broadcom 5715S no carrier on HP BL460c blade using 6.3-RELEASE Message-ID: <200804080224.m382OZq5090707@www.freebsd.org> Resent-Message-ID: <200804080230.m382U5lY028264@freefall.freebsd.org>
next in thread | raw e-mail | index | archive | help
>Number: 122551 >Category: kern >Synopsis: [bge] Broadcom 5715S no carrier on HP BL460c blade using 6.3-RELEASE >Confidential: no >Severity: serious >Priority: medium >Responsible: freebsd-bugs >State: open >Quarter: >Keywords: >Date-Required: >Class: sw-bug >Submitter-Id: current-users >Arrival-Date: Tue Apr 08 02:30:04 UTC 2008 >Closed-Date: >Last-Modified: >Originator: Greg Himes >Release: 6.3-RELEASE >Organization: CHL Design Group >Environment: FreeBSD mail2.laaco.net 6.3-RELEASE FreeBSD 6.3-RELEASE #10: Mon Apr 7 18:19:40 PDT 2008 greg@mail2.laaco.net:/usr/obj/usr/src/sys/LAACO i386 >Description: This problem appears to be similar to earlier bge problems on IBM blades. System is an HP c-Class blade chassis using BL460c blades. Each blade has a dual bce (Broadcom NetXtreme II BCM5708S) interface on-board, along with an add-on HP NC326m mezzanine board which appears as dual bge (Broadcom NetXtreme 5715S) interfaces. Both pairs of interfaces connect to HP Virtual Connect Modules to bring the connections out of the back of the chassis. The bce interfaces work fine, but the bge interfaces show "no carrier", as shown here in the ifconfig output: # ifconfig bce0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500 options=3b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU> ether 00:17:a4:77:00:06 media: Ethernet autoselect (1000baseSX <full-duplex>) status: active bce1: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500 options=3b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU> ether 00:17:a4:77:00:06 media: Ethernet autoselect (1000baseSX <full-duplex>) status: active bge0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500 options=1b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING> ether 00:17:a4:77:00:24 media: Ethernet autoselect (none) status: no carrier bge1: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500 options=1b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING> ether 00:17:a4:77:00:26 media: Ethernet autoselect (none) status: no carrier Here is the dmesg info: FreeBSD 6.3-RELEASE #10: Mon Apr 7 18:19:40 PDT 2008 greg@mail2.laaco.net:/usr/obj/usr/src/sys/LAACO module_register: module pci/bce already exists! Module pci/bce failed to register: 17 module_register: module bce/miibus already exists! Module bce/miibus failed to register: 17 Timecounter "i8254" frequency 1193182 Hz quality 0 CPU: Intel(R) Xeon(R) CPU 5160 @ 3.00GHz (3000.12-MHz 686-class CPU) Origin = "GenuineIntel" Id = 0x6f6 Stepping = 6 Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE> Features2=0x4e3bd<SSE3,RSVD2,MON,DS_CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,DCA> AMD Features=0x20000000<LM> AMD Features2=0x1<LAHF> Cores per package: 2 real memory = 3487916032 (3326 MB) avail memory = 3408941056 (3251 MB) ACPI APIC Table: <HP ProLiant> FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 1 cpu2 (AP): APIC ID: 6 cpu3 (AP): APIC ID: 7 ioapic0 <Version 2.0> irqs 0-23 on motherboard kbd1 at kbdmux0 ath_hal: 0.9.20.3 (AR5210, AR5211, AR5212, RF5111, RF5112, RF2413, RF5413) hptrr: HPT RocketRAID controller driver v1.1 (Apr 7 2008 18:19:28) acpi0: <HP ProLiant> on motherboard acpi0: Power Button (fixed) Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x908-0x90b on acpi0 acpi_hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 900 cpu0: <ACPI CPU> on acpi0 cpu1: <ACPI CPU> on acpi0 cpu2: <ACPI CPU> on acpi0 cpu3: <ACPI CPU> on acpi0 pcib0: <ACPI Host-PCI bridge> on acpi0 pci0: <ACPI PCI bus> on pcib0 pcib1: <ACPI PCI-PCI bridge> at device 2.0 on pci0 pci4: <ACPI PCI bus> on pcib1 pcib2: <ACPI PCI-PCI bridge> at device 0.0 on pci4 pci5: <ACPI PCI bus> on pcib2 pcib3: <ACPI PCI-PCI bridge> at device 0.0 on pci5 pci6: <ACPI PCI bus> on pcib3 pcib4: <ACPI PCI-PCI bridge> at device 0.0 on pci6 pci7: <ACPI PCI bus> on pcib4 bce0: <Broadcom NetXtreme II BCM5708 1000Base-SX (B2)> mem 0xfa000000-0xfbffffff irq 16 at device 0.0 on pci7 miibus0: <MII bus> on bce0 brgphy0: <BCM5708S 1000/2500BaseSX PHY> on miibus0 brgphy0: 1000baseSX-FDX, auto bce0: Ethernet address: 00:17:a4:77:00:0a bce0: ASIC (0x57081021); Rev (B2); Bus (PCI-X, 64-bit, 133MHz); F/W (0x01090605); Flags( ) pcib5: <ACPI PCI-PCI bridge> at device 1.0 on pci5 pci8: <ACPI PCI bus> on pcib5 pcib6: <ACPI PCI-PCI bridge> at device 0.3 on pci4 pci9: <ACPI PCI bus> on pcib6 pcib7: <ACPI PCI-PCI bridge> at device 3.0 on pci0 pci10: <ACPI PCI bus> on pcib7 pcib8: <PCI-PCI bridge> at device 0.0 on pci10 pci11: <PCI bus> on pcib8 pcib9: <PCI-PCI bridge> at device 4.0 on pci11 pci12: <PCI bus> on pcib9 ciss0: <HP Smart Array E200i> port 0x4000-0x40ff mem 0xfdb80000-0xfdbfffff,0xfdb70000-0xfdb77fff irq 18 at device 8.0 on pci11 ciss0: [GIANT-LOCKED] pcib10: <ACPI PCI-PCI bridge> at device 4.0 on pci0 pci13: <ACPI PCI bus> on pcib10 ciss1: <HP Smart Array P400> port 0x5000-0x50ff mem 0xfdd00000-0xfddfffff,0xfdcf0000-0xfdcf0fff irq 19 at device 0.0 on pci13 ciss1: [GIANT-LOCKED] pcib11: <ACPI PCI-PCI bridge> at device 5.0 on pci0 pci16: <ACPI PCI bus> on pcib11 pcib12: <ACPI PCI-PCI bridge> at device 0.0 on pci16 pci17: <ACPI PCI bus> on pcib12 bge0: <Broadcom BCM5715 A3, ASIC rev. 0x9003> mem 0xfdef0000-0xfdefffff,0xfdee0000-0xfdeeffff irq 18 at device 4.0 on pci17 bge0: Ethernet address: 00:17:a4:77:00:24 bge1: <Broadcom BCM5715 A3, ASIC rev. 0x9003> mem 0xfded0000-0xfdedffff,0xfdec0000-0xfdecffff irq 19 at device 4.1 on pci17 bge1: Ethernet address: 00:17:a4:77:00:26 pcib13: <ACPI PCI-PCI bridge> at device 6.0 on pci0 pci19: <ACPI PCI bus> on pcib13 isp0: <Qlogic ISP 2432 PCI FC-AL Adapter> port 0x6000-0x60ff mem 0xfdff0000-0xfdff3fff irq 19 at device 0.0 on pci19 isp0: [GIANT-LOCKED] isp0: Board Type 2422, Chip Revision 0x2, resident F/W Revision 4.0.70 isp1: <Qlogic ISP 2432 PCI FC-AL Adapter> port 0x6400-0x64ff mem 0xfdfe0000-0xfdfe3fff irq 16 at device 0.1 on pci19 isp1: [GIANT-LOCKED] isp1: Board Type 2422, Chip Revision 0x2, resident F/W Revision 4.0.70 pcib14: <ACPI PCI-PCI bridge> at device 7.0 on pci0 pci22: <ACPI PCI bus> on pcib14 pcib15: <ACPI PCI-PCI bridge> at device 28.0 on pci0 pci2: <ACPI PCI bus> on pcib15 pcib16: <ACPI PCI-PCI bridge> at device 0.0 on pci2 pci3: <ACPI PCI bus> on pcib16 bce1: <Broadcom NetXtreme II BCM5708 1000Base-SX (B2)> mem 0xf6000000-0xf7ffffff irq 16 at device 0.0 on pci3 miibus1: <MII bus> on bce1 brgphy1: <BCM5708S 1000/2500BaseSX PHY> on miibus1 brgphy1: 1000baseSX-FDX, auto bce1: Ethernet address: 00:17:a4:77:00:08 bce1: ASIC (0x57081021); Rev (B2); Bus (PCI-X, 64-bit, 133MHz); F/W (0x01090605); Flags( ) Timecounters tick every 1.000 msec SMP: AP CPU #1 Launched! SMP: AP CPU #2 Launched! SMP: AP CPU #3 Launched! Here is selected pciconf -lv output: # pciconf -lv pcib4@pci6:0:0: class=0x060400 card=0x00000000 chip=0x01031166 rev=0xc3 hdr=0x01 vendor = 'ServerWorks (Was: Reliance Computer Corp)' device = 'BCM5715 Broadcom dual gigabit, pci bridge' class = bridge subclass = PCI-PCI bce0@pci7:0:0: class=0x020000 card=0x703b103c chip=0x16ac14e4 rev=0x12 hdr=0x00 vendor = 'Broadcom Corporation' device = 'NetXtreme II BCM5708S Gigabit Ethernet' class = network subclass = ethernet pcib8@pci10:0:0: class=0x060400 card=0x00000000 chip=0x01031166 rev=0xb4 hdr=0x01 vendor = 'ServerWorks (Was: Reliance Computer Corp)' device = 'BCM5715 Broadcom dual gigabit, pci bridge' class = bridge subclass = PCI-PCI pcib12@pci16:0:0: class=0x060400 card=0x00000000 chip=0x01031166 rev=0xb5 hdr=0x01 vendor = 'ServerWorks (Was: Reliance Computer Corp)' device = 'BCM5715 Broadcom dual gigabit, pci bridge' class = bridge subclass = PCI-PCI bge0@pci17:4:0: class=0x020000 card=0x1707103c chip=0x167914e4 rev=0xa3 hdr=0x00 vendor = 'Broadcom Corporation' device = 'NetXtreme 5715S Gigabit Ethernet' class = network subclass = ethernet bge1@pci17:4:1: class=0x020000 card=0x1707103c chip=0x167914e4 rev=0xa3 hdr=0x00 vendor = 'Broadcom Corporation' device = 'NetXtreme 5715S Gigabit Ethernet' class = network subclass = ethernet pcib16@pci2:0:0: class=0x060400 card=0x00000000 chip=0x01031166 rev=0xc3 hdr=0x01 vendor = 'ServerWorks (Was: Reliance Computer Corp)' device = 'BCM5715 Broadcom dual gigabit, pci bridge' class = bridge subclass = PCI-PCI bce1@pci3:0:0: class=0x020000 card=0x703b103c chip=0x16ac14e4 rev=0x12 hdr=0x00 vendor = 'Broadcom Corporation' device = 'NetXtreme II BCM5708S Gigabit Ethernet' class = network subclass = ethernet Had same results with HP's 1Gb ethernet pass-thru modules. Have tried manually setting the interfaces with ifconfig to 1000baseSX full-duplex, but still no carrier. bge0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500 options=1b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING> ether 00:17:a4:77:00:24 media: Ethernet 1000baseSX <full-duplex> (none) status: no carrier >How-To-Repeat: Install HP NC326m mezzanine board on BL460c blade. Boot 6.3-RELEASE. Verify status:no carrier with ifconfig >Fix: >Release-Note: >Audit-Trail: >Unformatted:
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?200804080224.m382OZq5090707>