Skip site navigation (1)Skip section navigation (2)
Date:      Wed, 21 Mar 2007 14:48:54 -0500
From:      Mark Kane <mark@mkproductions.org>
To:        freebsd-stable@freebsd.org
Subject:   Re: Daily Panics on 6.2-STABLE (page fault/Fatal trap 12)
Message-ID:  <20070321144854.184ed2ef@amd64.localhost>
In-Reply-To: <20070220221450.5dd5427d@amd64.localhost>
References:  <20070220221450.5dd5427d@amd64.localhost>

next in thread | previous in thread | raw e-mail | index | archive | help
On Tue, Feb 20, 2007, at 22:14:50 -0600, Mark Kane wrote:
> Hi everyone.
>=20
> I'm getting kernel panics daily or even multiple times a day on a new
> machine. When it's running everything works well, but over the last
> day or two I've been getting multiple panics per day at seemingly
> random times.
>=20
> When the first panic happened, all I did was open up a new tab in my
> graphical terminal. The second one I had VNC open to another FBSD box
> and was maximizing the VNC window here to continue working on it. The
> third one I was running a simple command via SSH on another machine
> (in a graphical terminal). The fourth one was just pulling a website
> up in my browser. The latest one was also working on another machine
> via SSH in a graphical terminal. I had just switched terminal tabs
> and then it panicked.
>=20
> The CPU is nowhere near loaded at the times it panics, and since it
> has happened several different times while doing different things each
> time, I'm not exactly sure of one single event that triggers it. The
> programs I have open when it panics are XChat, Opera or Firefox, XMMS,
> a Terminal with some tabs, sometimes mplayer playing audio, and Claws
> Mail. I've tested my RAM (brand new) with three passes of memtest86+
> and there were zero errors. I have included some kgdb output, a dmesg,
> and my kernel configuration.=20
>=20
> This is the first real panicking problem I've ever experienced with
> FreeBSD, so please let me know if there is any additional information
> I can provide.
>=20
> Thanks very much in advance.
>=20
> -Mark
>
> [Debug info snipped -- see:]
> http://lists.freebsd.org/pipermail/freebsd-stable/2007-February/033199.ht=
ml

Hi all.

Unfortunately these panics are still happening. One thing I have
noticed from all kgdb outputs is the "current process" listed _every
time_ is XMMS. I know that for most of those times, XMMS wasn't even
playing any files but was rather just sitting open. A bad
combination seems to be XMMS and vncviewer open at the same time which
often results in a panic, although not always. Sometimes it happens
with just XMMS running and maybe a browser, IRC, and email.

Recently I thought it was improving. I cvsupped last week, rebuilt
world and kernel and it ran for about a week with no problems. Now it's
panicked two times since last night. Note that it's the same exact
kgdb output every time.

Below is another kgdb output with a "bt full" this time. I'm trying to
rule out any software issues before I start looking at hardware (even
though it's all brand new with the exception of the sound card). If it
is thought to be hardware, any pointers on what to check first would be
much appreciated also.

Thanks again,

-Mark
FreeBSD 6.2-STABLE #5: Tue Mar 13 17:09:00 CDT 2007

=3D=3D=3D KGDB OUTPUT =3D=3D=3D

[GDB will not be able to debug user-mode
threads: /usr/lib/libthread_db.so: Undefined symbol
"ps_pglobal_lookup"] GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free
Software Foundation, Inc. GDB is free software, covered by the GNU
General Public License, and you are welcome to change it and/or
distribute copies of it under certain conditions. Type "show copying"
to see the conditions. There is absolutely no warranty for GDB.  Type
"show warranty" for details. This GDB was configured as
"amd64-marcel-freebsd".

Unread portion of the kernel message buffer:


Fatal trap 12: page fault while in kernel mode
cpuid =3D 1; apic id =3D 01
fault virtual address   =3D 0x30
fault code              =3D supervisor write data, page not present
instruction pointer     =3D 0x8:0xffffffff803bd154
stack pointer           =3D 0x10:0xffffffffb529a6d0
frame pointer           =3D 0x10:0x0
code segment            =3D base 0x0, limit 0xfffff, type 0x1b
                        =3D DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags        =3D interrupt enabled, resume, IOPL =3D 0
current process         =3D 4692 (xmms)
trap number             =3D 12
panic: page fault
cpuid =3D 1
Uptime: 11h33m35s
Dumping 2047 MB (2 chunks)
  chunk 0: 1MB (156 pages) ... ok
  chunk 1: 2047MB (523984 pages) 2031 2015 1999 1983 1967 1951 1935
1919 1903 1887 1871 1855 1839 1823 1807 1791 1775 1759 1743 1727 1711
1695 1679 1663 1647 1631 1615 1599 1583 1567 1551 1535 1519 1503 1487
1471 1455 1439 1423 1407 1391 1375 1359 1343 1327 1311 1295 1279 1263
1247 1231 1215 1199 1183 1167 1151 1135 1119 1103 1087 1071 1055 1039
1023 1007 991 975 959 943 927 911 895 879 863 847 831 815 799 783 767
751 735 719 703 687 671 655 639 623 607 591 575 559 543 527 511 495 479
463 447 431 415 399 383 367 351 335 319 303 287 271 255 239 223 207 191
175 159 143 127 111 95 79 63 47 31 15

#0  doadump () at pcpu.h:172
172     pcpu.h: No such file or directory.
        in pcpu.h
(kgdb) list *0xffffffff803bd154
0xffffffff803bd154 is in devfs_open
(/usr/src/sys/fs/devfs/devfs_vnops.c:798). 793              * the file
*. 794              */
795             fp =3D ap->a_td->td_proc->p_fd->fd_ofiles[ap->a_fdidx];
796             KASSERT(fp->f_ops =3D=3D &badfileops,
797                  ("Could not vnode bypass device on fdops %p",
fp->f_ops)); 798             fp->f_ops =3D &devfs_ops_f;
799             fp->f_data =3D dev;
800             return (error);
801     }
802
(kgdb) bt full
#0  doadump () at pcpu.h:172
No locals.

#1  0x0000000000000004 in ?? ()
No symbol table info available.

#2  0xffffffff8041e647 in boot (howto=3D260)
at /usr/src/sys/kern/kern_shutdown.c:409 first_buf_printf =3D 1

#3  0xffffffff8041ece1 in panic (fmt=3D0xffffff001321c720 "X=EF=BF=BD")
at /usr/src/sys/kern/kern_shutdown.c:565 bootopt =3D 260
        newpanic =3D 0
        ap =3D {{gp_offset =3D 16, fp_offset =3D 48, overflow_arg_area =3D
0xffffffffb529a540, reg_save_area =3D 0xffffffffb529a470}} buf =3D "page
fault", '\0' <repeats 245 times>=20

#4  0xffffffff8063afbf in trap_fatal
(frame=3D0xffffff001321c720, eva=3D18446742975221392216)
at /usr/src/sys/amd64/amd64/trap.c:668 code =3D 12 type =3D 12
        ss =3D 12
        esp =3D 0
        softseg =3D {ssd_base =3D 0, ssd_limit =3D 1048575, ssd_type =3D 27,
ssd_dpl =3D 0, ssd_p =3D 1, ssd_long =3D 1, ssd_def32 =3D 0, ssd_gran =3D 1=
} msg
=3D 0x0=20

#5  0xffffffff8063b33c in trap_pfault (frame=3D0xffffffffb529a620,
usermode=3D0) at /usr/src/sys/amd64/amd64/trap.c:580 va =3D 0
        vm =3D (struct vmspace *) 0x0
        map =3D 0x1
        rv =3D 1
        ftype =3D 2 '\002'
        p =3D (struct proc *) 0x0
        eva =3D 48

#6  0xffffffff8063b5f3 in trap (frame=3D
      {tf_rdi =3D -1097438304256, tf_rsi =3D -1099190647008, tf_rdx =3D 7,
tf_rcx =3D 4, tf_r8 =3D 1, tf_r9 =3D -1098691737856, tf_rax =3D 0, tf_rbx =
=3D
-1099190647008, tf_rbp =3D 0, tf_r10 =3D -1098404205912, tf_r11 =3D 7, tf_r=
12
=3D 0, tf_r13 =3D -1098404206080, tf_r14 =3D -1098488159400, tf_r15 =3D
-1097438304256, tf_trapno =3D 12, tf_addr =3D 48, tf_flags =3D
-1099190647008, tf_err =3D 2, tf_rip =3D -2143563436, tf_cs =3D 8, tf_rflags
=3D 66118, tf_rsp =3D -1255561504, tf_ss =3D 16})
at /usr/src/sys/amd64/amd64/trap.c:353 p =3D (struct proc *)
0xffffff003d00e358 sticks =3D 0 i =3D 0 ucode =3D 0 type =3D 3 code =3D 2=20

#7 0xffffffff8062662b in calltrap ()
at /usr/src/sys/amd64/amd64/exception.S:168 No locals.=20

#8 0xffffffff803bd154 in devfs_open (ap=3D0xffffff003d00e358)
at /usr/src/sys/fs/devfs/devfs_vnops.c:795 _giantcnt =3D 0 td =3D (struct
thread *) 0xffffff001321c720 vp =3D (struct vnode *) 0xffffff004201ea00
        dev =3D (struct cdev *) 0xffffff007b946800
        fp =3D (struct file *) 0x0
        error =3D 0
        dsw =3D (struct cdevsw *) 0x0

#9  0xffffffff8068ecba in VOP_OPEN_APV (vop=3D0x0, a=3D0xffffff001321c720)
at vnode_if.c:372 rc =3D 0

#10 0xffffffff80499b40 in vn_open_cred (ndp=3D0xffffffffb529a9c0,
flagp=3D0xffffffffb529a90c, cmode=3D1581902752, cred=3D0xffffff0030de8700,
fdidx=3D7) at vnode_if.h:198 vp =3D (struct vnode *) 0xffffff005e49eba0
---Type <return> to continue, or q <return> to quit---
        mp =3D (struct mount *) 0xffffffff8040714f
        td =3D (struct thread *) 0xffffff001321c720
        vat =3D {va_type =3D VREG, va_mode =3D 0, va_nlink =3D 0, va_uid =3D
320980768, va_gid =3D 4294967040, va_fsid =3D 0, va_fileid =3D -2141010241,
va_size =3D 18446744071571701760, va_blocksize =3D -2143210411, va_atime =3D
{tv_sec =3D -2137849856, tv_nsec =3D -2143169876}, va_mtime =3D {tv_sec =3D
11095, tv_nsec =3D -2143359457}, va_ctime =3D {tv_sec =3D 7, tv_nsec =3D
-2143355297}, va_birthtime =3D {tv_sec =3D -2137862208, tv_nsec =3D
-1099190647008}, va_gen =3D 18446742975221392216, va_flags =3D
18446742974571679128, va_rdev =3D 320980768, va_bytes =3D
18446744072453990672, va_filerev =3D 18446742975305345536, va_vaflags =3D
2151633392, va_spare =3D 0} vap =3D (struct vattr *) 0xffffff0030de8700
mode =3D 819889920 fmode =3D 1 error =3D 0 vfslocked =3D 0=20

#11 0xffffffff8048fbff in kern_open (td=3D0xffffff001321c720,
path=3D0x6e9540 <Address 0x6e9540 out of bounds>, pathseg=3DUIO_USERSPACE,
flags=3D1, mode=3D-1255560768) at /usr/src/sys/kern/vfs_syscalls.c:1007 p =
=3D
(struct proc *) 0x0 fdp =3D (struct filedesc *) 0xffffff004201ea00 fp =3D
(struct file *) 0xffffff0016470d98 vp =3D (struct vnode *) 0x0
        vat =3D {va_type =3D 3039406928, va_mode =3D 65535, va_nlink =3D -1,
va_uid =3D 320980768, va_gid =3D 4294967040, va_fsid =3D 64, va_fileid =3D
-2143120760, va_size =3D 0, va_blocksize =3D -1255560480, va_atime =3D
{tv_sec =3D -1098488159400, tv_nsec =3D -1098488159400}, va_mtime =3D {tv_s=
ec
=3D -1255560432, tv_nsec =3D -2143120545}, va_ctime =3D {tv_sec =3D
-1255560432, tv_nsec =3D -2143120458}, va_birthtime =3D {tv_sec =3D
1174504178, tv_nsec =3D 5657018918572775532}, va_gen =3D 20, va_flags =3D
18446744071566296437, va_rdev =3D 754973504, va_bytes =3D
18446742975743826368, va_filerev =3D 1174504178, va_vaflags =3D 306667609,
va_spare =3D -1098488159400} mp =3D (struct mount *) 0x8000000000011800 nfp
=3D (struct file *) 0xffffff0016470d98 type =3D 7 indx =3D 7 error =3D
-1255560256 lf =3D {l_start =3D 0, l_len =3D -1099190647008, l_pid =3D
-2140161464, l_type =3D -1, l_whence =3D -1} nd =3D {ni_dirp =3D 0x6e9540
<Address 0x6e9540 out of bounds>, ni_segflg =3D UIO_USERSPACE,
ni_startdir =3D 0x0, ni_rootdir =3D 0xffffff007b2407c0, ni_topdir =3D 0x0,
ni_vp =3D 0xffffff005e49eba0, ni_dvp =3D 0xffffff007b240d90, ni_pathlen =3D
1, ni_next =3D 0xffffff00014cd00a "", ni_loopcnt =3D 0, ni_cnd =3D
{ cn_nameiop =3D 0, cn_flags =3D 69255236, cn_thread =3D 0xffffff001321c720,
cn_cred =3D 0xffffff0030de8700, cn_lkflags =3D 2, cn_pnbuf =3D
0xffffff00014cd000 "/dev/mixer", cn_nameptr =3D 0xffffff00014cd005
"mixer", cn_namelen =3D 5, cn_consume =3D 0}} vfslocked =3D 7247168=20

#12 0xffffffff804903a2 in open (td=3D0xffffff007b946800,
uap=3D0xffffffffb529abc0) at /usr/src/sys/kern/vfs_syscalls.c:971 error =3D
1023468376=20

#13 0xffffffff8063be71 in syscall (frame=3D {tf_rdi =3D 7247168,
tf_rsi =3D 0, tf_rdx =3D 0, tf_rcx =3D 6291552, tf_r8 =3D 0, tf_r9 =3D 0, t=
f_rax
=3D 5, tf_rbx =3D 0, tf_rbp =3D 0, tf_r10 =3D 5, tf_r11 =3D 582, tf_r12 =3D
6291456, tf_r13 =3D 7247168, tf_r14 =3D 1, tf_r15 =3D 140737488347616,
tf_trapno =3D 22, tf_addr =3D 0, tf_flags =3D 6353952, tf_err =3D 2, tf_rip=
 =3D
34389146764, tf_cs =3D 43, tf_rflags =3D 582, tf_rsp =3D 140737488347000,
tf_ss =3D 35}) at /usr/src/sys/amd64/amd64/trap.c:803 params =3D
0x7fffffffdf80 <Address 0x7fffffffdf80 out of bounds> callp =3D (struct
sysent *) 0xffffffff8089cf58 p =3D (struct proc *) 0xffffff003d00e358
orig_tf_rflags =3D 582 sticks =3D 0 error =3D 0 narg =3D 3 args =3D {724716=
8, 0,
0, 6291552, 0, 0, -1099190647008, -2140948788} argp =3D (register_t *)
0xffffff007b946800 code =3D 5 reg =3D 1023468376 regcnt =3D 0=20

---Type <return> to continue, or q <return> to quit---=20

#14 0xffffffff806267c8 in Xfast_syscall ()
at /usr/src/sys/amd64/amd64/exception.S:270=20

No locals.=20

#15 0x0000000801c0bc8c in ?? () No symbol table info available.=20
Previous frame inner to this frame (corrupt stack?)=20
(kgdb) q



--=20
Internet Radio:
Party107 (Trance/Electronic) - http://www.party107.com
Rock 101.9 The Edge (Rock) - http://www.rock1019.net

IRC:
MIXXnet IRC Network - irc.mixxnet.net (Nick: MIXX941)



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20070321144854.184ed2ef>