Skip site navigation (1)Skip section navigation (2)
Date:      Fri, 25 Aug 2006 07:45:22 +0200
From:      "Daniel A." <alive@dienub.org>
To:        "Daniel A." <alive@dienub.org>
Cc:        hackers@freebsd.org
Subject:   Re: doadump at pcpu.h:165
Message-ID:  <44EE8E72.7030501@dienub.org>
In-Reply-To: <44EDC84C.6010505@dienub.org>
References:  <44EDC84C.6010505@dienub.org>

next in thread | previous in thread | raw e-mail | index | archive | help
Daniel A. wrote:
> Hi guys,
> My server crashes very often and it's very random. So not long ago, I 
> was suggested that I read the FreeBSD Handbook pages about kernel 
> debugging, and here is the result:
> root@m00h DIENUB $ kgdb kernel.debug /var/crash/vmcore.3
> [GDB will not be able to debug user-mode threads: 
> /usr/lib/libthread_db.so: Undefined symbol "ps_pglobal_lookup"]
> GNU gdb 6.1.1 [FreeBSD]
> Copyright 2004 Free Software Foundation, Inc.
> GDB is free software, covered by the GNU General Public License, and you 
> are
> welcome to change it and/or distribute copies of it under certain 
> conditions.
> Type "show copying" to see the conditions.
> There is absolutely no warranty for GDB.  Type "show warranty" for details.
> This GDB was configured as "i386-marcel-freebsd".
> 
> Unread portion of the kernel message buffer:
> 
> 
> Fatal trap 28: machine check trap while in kernel mode
> instruction pointer     = 0x20:0xc06830b0
> stack pointer           = 0x28:0xd446ea7c
> frame pointer           = 0x28:0xd446ea8c
> code segment            = base 0x0, limit 0xfffff, type 0x1b
>                         = DPL 0, pres 1, def32 1, gran 1
> processor eflags        = interrupt enabled, resume, IOPL = 0
> current process         = 14 (swi1: net)
> trap number             = 28
> panic: machine check trap
> Uptime: 1d4h24m37s
> Dumping 511 MB (2 chunks)
>   chunk 0: 1MB (160 pages) ... ok
>   chunk 1: 511MB (130800 pages) 495 479 463 447 431 415 399 383 367 351 
> 335 319 303 287 271 255 239 223 207 191 175 159 143 127 111 95 79 63 47 
> 31 15
> 
> #0  doadump () at pcpu.h:165
> 165             __asm __volatile("movl %%fs:0,%0" : "=r" (td));
> (kgdb) q
> 
> 
> As far as I understand, the issue is CPU-related, but that doesn't make 
> sense, as my network interface cards are constantly giving me watchdog 
> timeouts.
> 
> root@m00h include $ uname -a
> FreeBSD m00h.dienub.org 6.1-RELEASE FreeBSD 6.1-RELEASE #0: Mon May 29 
> 20:40:41 CEST 2006     root@m00h.dienub.org:/usr/obj/usr/src/sys/DIENUB 
>  i386
> 
> Thanks for any help. Also, please CC any replies to me.
> _______________________________________________
> freebsd-hackers@freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-hackers
> To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org"
Some more dump data:

#0  doadump () at pcpu.h:165
#1  0xc064dda5 in boot (howto=260) at /usr/src/sys/kern/kern_shutdown.c:402
#2  0xc064e03c in panic (fmt=0xc088c06e "%s")
     at /usr/src/sys/kern/kern_shutdown.c:558
#3  0xc0841334 in trap_fatal (frame=0xd446ea3c, eva=0)
     at /usr/src/sys/i386/i386/trap.c:836
#4  0xc0840e7c in trap (frame=
       {tf_fs = -1017446392, tf_es = -1016266712, tf_ds = -733609944, 
tf_edi = -1017398016, tf_esi = -1016246016, tf_ebp = -733549940, tf_isp 
= -733549976, tf_ebx = 1, tf_edx = 3, tf_ecx = 0, tf_eax = -1016246016, 
tf_trapno = 28, tf_err = 0, tf_eip = -1066913616, tf_cs = 32, tf_eflags 
= 590483, tf_esp = -1016016896, tf_ss = 0}) at 
/usr/src/sys/i386/i386/trap.c:631
#5  0xc0830b5a in calltrap () at /usr/src/sys/i386/i386/exception.s:139
#6  0xc06830b0 in mb_free_ext (m=0xc36d5100)
     at /usr/src/sys/kern/uipc_mbuf.c:252
#7  0xc0682fa6 in m_freem (mb=0xc36d5100) at mbuf.h:486
#8  0xc06845be in m_defrag (m0=0xc36d5100, how=1)
     at /usr/src/sys/kern/uipc_mbuf.c:1252
#9  0xc076063b in rl_encap (sc=0xc34a6800, m_head=0xc36d5100)
     at /usr/src/sys/pci/if_rl.c:1390
#10 0xc0760923 in rl_start_locked (ifp=0xc34a3800)
     at /usr/src/sys/pci/if_rl.c:1446
#11 0xc07606da in rl_start (ifp=0xc34a3800) at /usr/src/sys/pci/if_rl.c:1427
#12 0xc06ba83f in if_start (ifp=0x0) at /usr/src/sys/net/if.c:2234
#13 0xc06bbc6f in ether_output_frame (ifp=0xc34a3800, m=0xc36d5100)
     at /usr/src/sys/net/if_ethersubr.c:406
#14 0xc06bba54 in ether_output (ifp=0xc34a3800, m=0xc36d5100, 
dst=0xc365e970,
     rt0=0x3) at /usr/src/sys/net/if_ethersubr.c:359
#15 0xc06e9480 in ip_output (m=0xc36d5100, opt=0xc34a3800, ro=0xd446ebd0,
     flags=1, imo=0x0, inp=0x0) at /usr/src/sys/netinet/ip_output.c:777
#16 0xc06e89a0 in ip_forward (m=0xc36d5100, srcrt=0)
     at /usr/src/sys/netinet/ip_input.c:1907
#17 0xc06e750f in ip_input (m=0xc36d5100)
     at /usr/src/sys/netinet/ip_input.c:689
#18 0xc06c3e1b in netisr_processqueue (ni=0xc0981538)
     at /usr/src/sys/net/netisr.c:236
#19 0xc06c4016 in swi_net (dummy=0x0) at /usr/src/sys/net/netisr.c:349
#20 0xc0639479 in ithread_execute_handlers (p=0xc32b5418, ie=0xc32f5200)
     at /usr/src/sys/kern/kern_intr.c:684
#21 0xc0639590 in ithread_loop (arg=0xc329b6e0)
     at /usr/src/sys/kern/kern_intr.c:767
#22 0xc06383e8 in fork_exit (callout=0xc063953c <ithread_loop>,
     arg=0xc329b6e0, frame=0xd446ed38) at /usr/src/sys/kern/kern_fork.c:805
#23 0xc0830bbc in fork_trampoline () at 
/usr/src/sys/i386/i386/exception.s:208


Please, someone help me debug this. It's really frustrating.



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?44EE8E72.7030501>