From owner-freebsd-hackers Wed Apr 25 7:40:41 2001 Delivered-To: freebsd-hackers@freebsd.org Received: from mutare.noc.clara.net (mutare.noc.clara.net [195.8.70.94]) by hub.freebsd.org (Postfix) with ESMTP id C9A3937B422 for ; Wed, 25 Apr 2001 07:40:37 -0700 (PDT) (envelope-from ollie@mutare.noc.clara.net) Received: from ollie by mutare.noc.clara.net with local (Exim 3.22 #50) id 14sQT4-000A9Z-00; Wed, 25 Apr 2001 15:40:34 +0100 Date: Wed, 25 Apr 2001 15:40:34 +0100 From: Oliver Cook To: Ian Dowse Cc: freebsd-hackers@freebsd.org Subject: Re: open (vfs_syscalls.c:994) && NFS Message-ID: <20010425154034.A38996@mutare.noc.clara.net> References: <20010425150852.B37512@mutare.noc.clara.net> <200104251528.aa35127@salmon.maths.tcd.ie> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.2.5i In-Reply-To: <200104251528.aa35127@salmon.maths.tcd.ie>; from iedowse@maths.tcd.ie on Wed, Apr 25, 2001 at 03:28:31PM +0100 X-Operating-System: FreeBSD 4.2-RELEASE i386 Sender: owner-freebsd-hackers@FreeBSD.ORG Precedence: bulk X-Loop: FreeBSD.ORG On Wed, Apr 25, 2001 at 03:28:31PM +0100, Ian Dowse wrote: > In message <20010425150852.B37512@mutare.noc.clara.net>, Oliver Cook writes: > >After about a week there are hundreds of stuck > >httpd processes in exactly this state. It is not > >possible to attach to them, but information can > >be gleaned from a kernel backtrace: > > Could you post the full output of "ps axl" on one of these machines? > In this output, search for other odd process states, especially > "vmopar", and include a gdb backtrace from these processes too. There are a lot of processes so I've included the ps -axl output at http://www.olliecook.clara.net/ps-axl.txt There are three processes stuck in vmopar. I include the backtrace of one of these below. Thanks very much for your reply to this! I'm glad we're not the first to have run into this problem! hera[/]# gdb -k /usr/src/sys/compile/HERA/kernel.debug /dev/mem GNU gdb 4.18 Copyright 1998 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "i386-unknown-freebsd"... IdlePTD 3080192 initial pcb at fc02000 panic messages: --- --- #0 mi_switch () at ../../kern/kern_synch.c:859 859 if (switchtime.tv_sec == 0) p(kgdb) proc 90941 (kgdb) bt #0 mi_switch () at ../../kern/kern_synch.c:859 #1 0xc01467e9 in tsleep (ident=0xc0a3a060, priority=4, wmesg=0xc0251b11 "vmopar", timo=0) at ../../kern/kern_synch.c:468 #2 0xc01febeb in vm_object_page_remove (object=0xdffd0a80, start=0, end=729, clean_only=0) at ../../vm/vm_page.h:546 #3 0xc0202c69 in vnode_pager_setsize (vp=0xe0097b80, nsize=0) at ../../vm/vnode_pager.c:289 #4 0xc01cae87 in nfs_loadattrcache (vpp=0xe195fbfc, mdp=0xe195fc08, dposp=0xe195fc0c, vaper=0x0) at ../../nfs/nfs_subs.c:1335 #5 0xc01d3e0f in nfs_readrpc (vp=0xe0097b80, uiop=0xe195fc70, cred=0xc6939500) at ../../nfs/nfs_vnops.c:1102 #6 0xc01ab7f9 in nfs_getpages (ap=0xe195fca8) at ../../nfs/nfs_bio.c:153 #7 0xc0203216 in vnode_pager_getpages (object=0xdffd0a80, m=0xe195fd3c, count=2, reqpage=0) at vnode_if.h:1089 #8 0xc01f8102 in vm_fault (map=0xe115a8c0, vaddr=673517568, fault_type=1 '\001', fault_flags=0) at ../../vm/vm_pager.h:130 #9 0xc0223322 in trap_pfault (frame=0xe195fdec, usermode=0, eva=673517568) at ../../i386/i386/trap.c:797 #10 0xc0222f83 in trap (frame={tf_fs = -1072496624, tf_es = -1056112624, tf_ds = 16, tf_edi = -1050512140, tf_esi = 673517567, tf_ebp = -510263720, tf_isp = -510263784, tf_ebx = 2048, tf_edx = 673518347, tf_ecx = 195, tf_eax = -510271488, tf_trapno = 12, tf_err = 0, tf_eip = -1071504287, tf_cs = 8, tf_eflags = 66054, tf_esp = -510263572, tf_ss = -510263580}) at ../../i386/i386/trap.c:423 #11 0xc0222461 in generic_copyin () #12 0xc015e9a4 in sosend (so=0xd9da1540, addr=0x0, uio=0xe195feec, top=0x0, control=0x0, flags=0, p=0xe1951400) at ../../kern/uipc_socket.c:549 #13 0xc0153d54 in soo_write (fp=0xc67a6b40, uio=0xe195feec, cred=0xc6939500, flags=0, p=0xe1951400) at ../../kern/sys_socket.c:78 #14 0xc0150bdf in dofilewrite (p=0xe1951400, fp=0xc67a6b40, fd=6, buf=0x2824d858, nbyte=32768, offset=-1, flags=0) at ../../sys/file.h:156 #15 0xc0150ae3 in write (p=0xe1951400, uap=0xe195ff80) at ../../kern/sys_generic.c:298 #16 0xc02238e6 in syscall (frame={tf_fs = 47, tf_es = 47, tf_ds = 47, tf_edi = 32768, tf_esi = 673503320, tf_ebp = -1077937872, tf_isp = -510263340, tf_ebx = 135028804, tf_edx = 6, tf_ecx = 37392, tf_eax = 4, tf_trapno = 7, tf_err = 2, tf_eip = 672462708, tf_cs = 31, tf_eflags = 663, tf_esp = -1077937916, tf_ss = 47}) at ../../i386/i386/trap.c:1073 #17 0xc0218be6 in Xint0x80_syscall () #18 0x806562d in ?? () #19 0x8064ab4 in ?? () #20 0x8064b8c in ?? () #21 0x8065048 in ?? () #22 0x807635b in ?? () #23 0x806d105 in ?? () #24 0x806618c in ?? () #25 0x80797f4 in ?? () #26 0x807985e in ?? () #27 0x8071027 in ?? () #28 0x80712ac in ?? () #29 0x807162c in ?? () #30 0x8071b41 in ?? () #31 0x8072144 in ?? () #32 0x804a159 in ?? () Ollie -- Oliver Cook Systems Administrator, ClaraNET ollie@uk.clara.net 020 7903 3000 ext. 291 To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-hackers" in the body of the message