Skip site navigation (1)Skip section navigation (2)
Date:      Sun, 2 Apr 2006 20:34:58 +0200
From:      "Pawel Worach" <pawel.worach@gmail.com>
To:        stable@freebsd.org
Subject:   6.1-PRE hang with sysctl and sched_ule
Message-ID:  <d227e09e0604021134x1442ca4cmc5a6aa6569231c79@mail.gmail.com>

next in thread | raw e-mail | index | archive | help
Hi,

Got this interesting hang on a two way (two physical cpus with htt
disabled by machdep.hyperthreading_allowed) smp box during boot. Any
ideas?

Kernel config is pretty much SMP with most drivers cut and KDB, DDB
and BREAK_TO_DEBUGGER added. Sources are from this morning.
I can only reproduce this with the ULE scheduler, switching to 4BSD
makes the problem go away.

KDB: enter: Line break on console
[thread pid 27 tid 100017 ]
Stopped at      kdb_enter+0x30: leave
db> show msgbuf
msgbufp =3D 0xc0c3afe4
magic =3D 63062, size =3D 32740, r=3D 0, w =3D 4955, ptr =3D 0xc0c33000, ck=
sum=3D 386982
Copyright (c) 1992-2006 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
        The Regents of the University of California. All rights reserved.
FreeBSD 6.1-PRERELEASE #0: Sun Apr  2 14:40:58 CEST 2006
    root@proxy1:/usr/obj/usr/src/sys/PROXY-SMP
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: Intel(R) Xeon(TM) CPU 3.60GHz (3600.15-MHz 686-class CPU)
  Origin =3D "GenuineIntel"  Id =3D 0xf43  Stepping =3D 3
  Features=3D0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PG=
E,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
  Features2=3D0x659d<SSE3,RSVD2,MON,DS_CPL,EST,TM2,CNTX-ID,CX16,<b14>>
  AMD Features=3D0x20000000<LM>
  Hyperthreading: 2 logical CPUs
real memory  =3D 2147270656 (2047 MB)
avail memory =3D 2099769344 (2002 MB)
ACPI APIC Table: <IBM    SERONYXP>
FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
  cpu0 (BSP): APIC ID:  0
  cpu1 (AP): APIC ID:  1
  cpu2 (AP): APIC ID:  6
  cpu3 (AP): APIC ID:  7
ioapic4 <Version 2.0> irqs 96-119 on motherboard
ioapic3 <Version 2.0> irqs 72-95 on motherboard
ioapic2 <Version 2.0> irqs 48-71 on motherboard
ioapic1 <Version 2.0> irqs 24-47 on motherboard
ioapic0 <Version 2.0> irqs 0-23 on motherboard
kbd1 at kbdmux0
npx0: [FAST]
npx0: <math processor> on motherboard
npx0: INT 16 interface
acpi0: <IBM SERONYXP> on motherboard
acpi_bus_number: can't get _ADR
acpi_bus_number: can't get _ADR
acpi0: Power Button (fixed)
acpi_bus_number: can't get _ADR
acpi_bus_number: can't get _ADR
Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x588-0x58b on acpi0
cpu0: <ACPI CPU> on acpi0
acpi_perf0: <ACPI CPU Frequency Control> on cpu0
cpu1: <ACPI CPU> on acpi0
cpu2: <ACPI CPU> on acpi0
cpu3: <ACPI CPU> on acpi0
pcib0: <ACPI Host-PCI bridge> on acpi0
pci0: <ACPI PCI bus> on pcib0
pci0: <unknown> at device 0.1 (no driver attached)
pcib1: <ACPI PCI-PCI bridge> at device 2.0 on pci0
pci2: <ACPI PCI bus> on pcib1
pcib2: <ACPI PCI-PCI bridge> at device 0.0 on pci2
pci3: <ACPI PCI bus> on pcib2
pcib3: <ACPI PCI-PCI bridge> at device 0.2 on pci2
pci4: <ACPI PCI bus> on pcib3
pcib4: <ACPI PCI-PCI bridge> at device 4.0 on pci0
pci5: <ACPI PCI bus> on pcib4
bge0: <Broadcom BCM5721 Gigabit Ethernet, ASIC rev. 0x4101> mem 0xdeff0000-=
0xdef
fffff irq 16 at device 0.0 on pci5
miibus0: <MII bus> on bge0
brgphy0: <BCM5750 10/100/1000baseTX PHY> on miibus0
brgphy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseTX, 1000b=
aseTX
-FDX, auto
bge0: Ethernet address: 00:14:5e:2a:8a:d6
pcib5: <PCI-PCI bridge> at device 5.0 on pci0
pci6: <PCI bus> on pcib5
bge1: <Broadcom BCM5721 Gigabit Ethernet, ASIC rev. 0x4101> mem 0xdcff0000-=
0xdcf
fffff irq 16 at device 0.0 on pci6
miibus1: <MII bus> on bge1
brgphy1: <BCM5750 10/100/1000baseTX PHY> on miibus1
brgphy1:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseTX, 1000b=
aseTX
-FDX, auto
bge1: Ethernet address: 00:14:5e:2a:8a:d7
pcib6: <ACPI PCI-PCI bridge> at device 6.0 on pci0
pci7: <ACPI PCI bus> on pcib6
pcib7: <ACPI PCI-PCI bridge> at device 0.0 on pci7
pci8: <ACPI PCI bus> on pcib7
ips0: <Adaptec ServeRAID Adapter> mem 0xdafff000-0xdaffffff irq 38 at devic=
e 14.
0 on pci8
pcib8: <ACPI PCI-PCI bridge> at device 0.2 on pci7
pci9: <ACPI PCI bus> on pcib8
pci0: <base peripheral> at device 8.0 (no driver attached)
pci0: <serial bus, USB> at device 29.0 (no driver attached)
pci0: <serial bus, USB> at device 29.1 (no driver attached)
pci0: <serial bus, USB> at device 29.7 (no driver attached)
pcib9: <ACPI PCI-PCI bridge> at device 30.0 on pci0
pci1: <ACPI PCI bus> on pcib9
pci1: <display, VGA> at device 6.0 (no driver attached)
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
pci0: <mass storage, ATA> at device 31.1 (no driver attached)
pci0: <serial bus, SMBus> at device 31.3 (no driver attached)
atkbdc0: <Keyboard controller (i8042)> port 0x64,0x60 irq 1 on acpi0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
atkbd: unable to set the command byte.
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
sio0: <16550A-compatible COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on acp=
i0
sio0: type 16550A, console
orm0: <ISA Option ROMs> at iomem 0xc0000-0xcafff,0xcb000-0xce7ff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=3D0x100>
sio1: configured irq 3 not in bitmap of probed irqs 0
sio1: port may not be enabled
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
Timecounters tick every 1.000 msec
ips0: logical drives: 1
ips0: Logical Drive 0: RAID1 sectors: 143372288, state OK
ipsd0: <Logical Drive> on ips0
ipsd0: Logical Drive  (70006MB)
SMP: AP CPU #3 Launched!
SMP: AP CPU #1 Launched!
SMP: AP CPU #2 Launched!
Trying to mount root from ufs:/dev/ipsd0s1a
<118>Loading configuration files.
<118>kernel dumps on /dev/ipsd0s1b
<118>Entropy harvesting:
<118> interrupts
<118> ethernet
<118> point_to_point
KDB: enter: Line break on console

db> bt
Tracing pid 27 tid 100017 td 0xc5fbb960
kdb_enter(c06725fd,c5fbb960,1,c5fbb960,c60adc00) at kdb_enter+0x30
siointr1(c60adc00,c04e99e2,c5fbb960,c6013624,e4db0c0c) at siointr1+0xd1
siointr(c60adc00,c06b0710,c62aa794,0,c5fbb960) at siointr+0x76
intr_execute_handlers(c5fb04b4,e4db0c4c,e4db0ca4,c0626833,35) at intr_execu=
te_ha
ndlers+0xfa
lapic_handle_intr(35) at lapic_handle_intr+0x3b
Xapic_isr1() at Xapic_isr1+0x33
--- interrupt, eip =3D 0xc04c933d, esp =3D 0xe4db0c90, ebp =3D 0xe4db0ca4 -=
--
_mtx_lock_sleep(c06ad2c0,c5fbb960,0,0,0) at _mtx_lock_sleep+0xb4
ithread_execute_handlers(c6013624,c6090e80,0,0,0) at ithread_execute_handle=
rs+0x
160
ithread_loop(c60ab670,e4db0d38,0,0,0) at ithread_loop+0x64
fork_exit(c04b9ea7,c60ab670,e4db0d38) at fork_exit+0x7b
fork_trampoline() at fork_trampoline+0x8
--- trap 0x1, eip =3D 0, esp =3D 0xe4db0d6c, ebp =3D 0 ---
db> show pcpu
cpuid        =3D 2
curthread    =3D 0xc5fbb960: pid 27 "swi0: sio"
curpcb       =3D 0xe4db0d90
fpcurthread  =3D none
idlethread   =3D 0xc5fba960: pid 12 "idle: cpu2"
APIC ID      =3D 6
currentldt   =3D 0x50
db> ps
  pid   proc     uid  ppid  pgrp  flag   stat  wmesg    wchan  cmd
   53 c62a8624    0    51    35 0004002 [CPU 255] sysctl
   51 c62a8000    0    49    35 0000002 [SLPQ wait 0xc62a8000][SLP] sh
   50 c6255c48    0    44    35 0004002 [SLPQ piperd 0xc62b2660][SLP] dd
   49 c62a820c    0    44    35 0000002 [SLPQ wait 0xc62a820c][SLP] sh
   44 c6255a3c    0    35    35 0000002 [SLPQ wait 0xc6255a3c][SLP] sh
   35 c62ac000    0     1    35 0004002 [SLPQ wait 0xc62ac000][SLP] sh
   34 c6254624    0     0     0 0000204 [SLPQ sdflush 0xc06c05b4][SLP]
softdepflush
   33 c6254830    0     0     0 0000204 [SLPQ vlruwt 0xc6254830][SLP] vnlru
   32 c6254a3c    0     0     0 0000204 [SLPQ syncer 0xc06ad91c][SLP] synce=
r
   31 c6254c48    0     0     0 0000204 [SLPQ psleep 0xc06b94cc][SLP] bufda=
emon
   30 c6255000    0     0     0 000020c [RUNQ] pagezero
   29 c625520c    0     0     0 0000204 [SLPQ psleep 0xc06c1074][SLP] vmdae=
mon
   28 c6255418    0     0     0 0000204 [SLPQ psleep 0xc06c1030][SLP] paged=
aemon
   27 c6013624    0     0     0 0000204 [CPU 2] swi0: sio
   26 c6013830    0     0     0 0000204 [CPU 0] irq1: atkbd0
   25 c6013a3c    0     0     0 0000204 [IWAIT] irq38: ips0
   24 c6013c48    0     0     0 0000204 [IWAIT] irq16: bge0 bge1
   23 c6065000    0     0     0 0000204 [IWAIT] irq9: acpi0
   22 c606520c    0     0     0 0000204 [IWAIT] swi6: task queue
    9 c6065418    0     0     0 0000204 [SLPQ - 0xc6063e00][SLP] kqueue tas=
kq
   21 c6065624    0     0     0 0000204 [IWAIT] swi2: cambio
    8 c6065830    0     0     0 0000204 [SLPQ - 0xc6064080][SLP] acpi_task2
    7 c6065a3c    0     0     0 0000204 [SLPQ - 0xc6064080][SLP] acpi_task1
    6 c5fbe20c    0     0     0 0000204 [SLPQ - 0xc6064080][SLP] acpi_task0
   20 c5fbe418    0     0     0 0000204 [IWAIT] swi5: +
    5 c5fbe624    0     0     0 0000204 [SLPQ - 0xc6011680][SLP] thread tas=
kq
   19 c5fbe830    0     0     0 0000204 [IWAIT] swi6: +
   18 c5fbea3c    0     0     0 0000204 [SLPQ - 0xc06aa6c0][SLP] yarrow
    4 c5fbec48    0     0     0 0000204 [SLPQ - 0xc06ab0a8][SLP] g_down
    3 c6013000    0     0     0 0000204 [SLPQ - 0xc06ab0a4][SLP] g_up
    2 c601320c    0     0     0 0000204 [SLPQ - 0xc06ab09c][SLP] g_event
   17 c6013418    0     0     0 0000204 [IWAIT] swi3: vm
   16 c5fb9000    0     0     0 000020c [RUNQ] swi4: clock sio
   15 c5fb920c    0     0     0 0000204 [IWAIT] swi1: net
   14 c5fb9418    0     0     0 000020c [Can run] idle: cpu0
   13 c5fb9624    0     0     0 000020c [CPU 1] idle: cpu1
   12 c5fb9830    0     0     0 000020c [Can run] idle: cpu2
   11 c5fb9a3c    0     0     0 000020c [CPU 3] idle: cpu3
    1 c5fb9c48    0     0     1 0004200 [SLPQ wait 0xc5fb9c48][SLP] init
   10 c5fbe000    0     0     0 0000204 [SLPQ ktrace 0xc06abaf8][SLP] ktrac=
e
    0 c06ab1a0    0     0     0 0000200 [IWAIT] swapper
db> bt 53
Tracing pid 53 tid 100045 td 0xc62aa190
sched_switch(c62aa190,0,1,9d27eb6c,5d3de4fa) at sched_switch+0x146
mi_switch(1,0,c62aa190,0,e8a9cab0) at mi_switch+0x1d5
sched_bind(c62aa190,0,c6278360,0,10) at sched_bind+0x68
cpu_est_clockrate(0,e8a9cad4,1,e8a9cadc,c07a8550) at cpu_est_clockrate+0xdc
acpi_px_get(c6064e00,e8a9cb34,c06864a8,1,c0c45200) at acpi_px_get+0xda
cf_get_method(c6086580,c62d5000,c0686478,1,c0c5b440) at cf_get_method+0x21a
cpufreq_curr_sysctl(c608bb80,c6044800,0,e8a9cbf8,e8a9cbf8) at
cpufreq_curr_sysctl+0x93
sysctl_root(0,e8a9cc68,4,e8a9cbf8,c62aa190) at sysctl_root+0x12d
userland_sysctl(c62aa190,e8a9cc68,4,0,bfbfdc0c) at userland_sysctl+0x122
__sysctl(c62aa190,e8a9cd04,18,c627f700,e8a9cd10) at __sysctl+0xda
syscall(bfbf003b,3b,bfbf003b,bfbfdc0c,bfbfe4d0) at syscall+0x34f
Xint0x80_syscall() at Xint0x80_syscall+0x1f
--- syscall (202, FreeBSD ELF32, __sysctl), eip =3D 0x481204bb, esp =3D
0xbfbfdb8c, ebp =3D 0xbfbfdbb8 ---
db> reset
cpu_reset: Restarting BSP
cpu_reset_proxy: Stopped CPU 2
/boot.config: -hConsoles: serial port

--
Pawel



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?d227e09e0604021134x1442ca4cmc5a6aa6569231c79>