From owner-freebsd-stable@FreeBSD.ORG Fri Sep 10 16:51:17 2010 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 641E1106564A; Fri, 10 Sep 2010 16:51:17 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost2.sentex.ca (smarthost2-6.sentex.ca [IPv6:2607:f3e0:80:80::2]) by mx1.freebsd.org (Postfix) with ESMTP id DEA058FC08; Fri, 10 Sep 2010 16:51:16 +0000 (UTC) Received: from lava.sentex.ca (pyroxene.sentex.ca [199.212.134.18]) by smarthost2.sentex.ca (8.14.4/8.14.4) with ESMTP id o8AGp9Ih054812 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Fri, 10 Sep 2010 12:51:09 -0400 (EDT) (envelope-from mike@sentex.net) Received: from mdt-xp.sentex.net (simeon.sentex.ca [192.168.43.27]) by lava.sentex.ca (8.14.4/8.14.3) with ESMTP id o8AGp8uU080952; Fri, 10 Sep 2010 12:51:08 -0400 (EDT) (envelope-from mike@sentex.net) Message-Id: <201009101651.o8AGp8uU080952@lava.sentex.ca> X-Mailer: QUALCOMM Windows Eudora Version 7.1.0.9 Date: Fri, 10 Sep 2010 12:51:01 -0400 To: "Li, Qing" From: Mike Tancsa In-Reply-To: References: <201008312102.o7VL2MJr000894@lava.sentex.ca> <201009012255.o81MtMXn009701@lava.sentex.ca> <201009081512.o88FCIq8064280@lava.sentex.ca> <201009081535.o88FZKQS064396@lava.sentex.ca> Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii"; format=flowed X-Scanned-By: MIMEDefang 2.67 on 205.211.164.50 Cc: freebsd-stable@freebsd.org Subject: RE: if_rtdel: error 47 (netgraph or mpd issue?) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Sep 2010 16:51:17 -0000 FYI, I enabled witness in the kernel and am seeing the following uma_zalloc_arg: zone "128" with the following non-sleepable locks held: exclusive rw ifnet_rw (ifnet_rw) r = 0 (0xc0b56ec4) locked @ /usr/src/sys/net/if.c:419 KDB: stack backtrace: db_trace_self_wrapper(c09195da,e7cb18f0,c06ac725,1a3,2,...) at db_trace_self_wrapper+0x26 kdb_backtrace(1a3,2,ffffffff,c0b29b74,e7cb1928,...) at kdb_backtrace+0x29 _witness_debugger(c091ad10,e7cb193c,4,1,0,...) at _witness_debugger+0x25 witness_warn(5,0,c0930a90,c091543a,c06ad2f6,...) at witness_warn+0x1fe uma_zalloc_arg(c158b380,0,102,80,c56bfc00,...) at uma_zalloc_arg+0x34 malloc(80,c09a9a14,102,10,c56bfc00,...) at malloc+0x4e if_grow(c0b56ec4,c0921741,1a3,1a3,35000101,...) at if_grow+0x35 if_alloc(35,c65900e0,101,c65901a0,0,...) at if_alloc+0xd3 ng_iface_constructor(c65b7a80,e7cb1a88,c60b9080,c65cc700,e7cb1a98,...) at ng_iface_constructor+0x3b ng_make_node(c65cc738,e7cb1a88,0,0,0,...) at ng_make_node+0x5b ng_apply_item(c60b90c8,0,1,e7cb1ab8,c60b9080,...) at ng_apply_item+0x3ea ng_snd_item(c64d3340,0,c564d490,0,28a4ff40,...) at ng_snd_item+0x28f ngc_send(c63289a8,0,c5e27000,c56fb820,0,...) at ngc_send+0x1c2 sosend_generic(c63289a8,c56fb820,e7cb1bec,0,0,...) at sosend_generic+0x50d sosend(c63289a8,c56fb820,e7cb1bec,0,0,...) at sosend+0x3f kern_sendit(c6569a00,5,e7cb1c60,0,0,...) at kern_sendit+0x107 sendit(0,c56fb820,5,e7cb1c7c,1,...) at sendit+0xb1 sendto(c6569a00,e7cb1cf8,c093d225,c091bd41,282,...) at sendto+0x48 syscall(e7cb1d38) at syscall+0x1da Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (133, FreeBSD ELF32, sendto), eip = 0x284b13c7, esp = 0xbf3f88cc, ebp = 0xbf3f88f8 --- uma_zalloc_arg: zone "256" with the following non-sleepable locks held: exclusive rw ifnet_rw (ifnet_rw) r = 0 (0xc0b56ec4) locked @ /usr/src/sys/net/if.c:419 KDB: stack backtrace: db_trace_self_wrapper(c09195da,e7cb18f0,c06ac725,1a3,2,...) at db_trace_self_wrapper+0x26 kdb_backtrace(1a3,2,ffffffff,c0b29c24,e7cb1928,...) at kdb_backtrace+0x29 _witness_debugger(c091ad10,e7cb193c,4,1,0,...) at _witness_debugger+0x25 witness_warn(5,0,c0930a90,c091543e,c06ad2f6,...) at witness_warn+0x1fe uma_zalloc_arg(c158b700,0,102,100,c56a7400,...) at uma_zalloc_arg+0x34 malloc(100,c09a9a14,102,20,c56a7400,...) at malloc+0x4e if_grow(c0b56ec4,c0921741,1a3,1a3,35000101,...) at if_grow+0x35 if_alloc(35,c65900e0,101,c65901a0,0,...) at if_alloc+0xd3 ng_iface_constructor(c660e680,e7cb1a88,c60b9080,c65aba00,e7cb1a98,...) at ng_iface_constructor+0x3b ng_make_node(c65aba38,e7cb1a88,0,0,0,...) at ng_make_node+0x5b ng_apply_item(c60b90c8,0,1,e7cb1ab8,c60b9080,...) at ng_apply_item+0x3ea ng_snd_item(c64d4d40,0,c56fb630,0,2882ff40,...) at ng_snd_item+0x28f ngc_send(c63289a8,0,c61eeb00,c589f9d0,0,...) at ngc_send+0x1c2 sosend_generic(c63289a8,c589f9d0,e7cb1bec,0,0,...) at sosend_generic+0x50d sosend(c63289a8,c589f9d0,e7cb1bec,0,0,...) at sosend+0x3f kern_sendit(c6404a00,5,e7cb1c60,0,0,...) at kern_sendit+0x107 sendit(0,c589f9d0,5,e7cb1c7c,1,...) at sendit+0xb1 sendto(c6404a00,e7cb1cf8,c,c,282,...) at sendto+0x48 syscall(e7cb1d38) at syscall+0x1da Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (133, FreeBSD ELF32, sendto), eip = 0x284b13c7, esp = 0xbf7fc8cc, ebp = 0xbf7fc8f8 --- >-- Qing > > > > -----Original Message----- > > From: Mike Tancsa [mailto:mike@sentex.net] > > Sent: Wednesday, September 08, 2010 8:35 AM > > To: Vlad Galu > > Cc: Li, Qing; freebsd-stable@freebsd.org > > Subject: Re: if_rtdel: error 47 (netgraph or mpd issue?) > > > > At 11:30 AM 9/8/2010, Vlad Galu wrote: > > >On Wed, Sep 8, 2010 at 6:12 PM, Mike Tancsa wrote: > > >[...] > > > > > >FWIW, I've had a few crashes in if_rtdel() while playing with ECMP. >No > > >Netgraph on that box. Unfortunately, the stack was too corrupted to >be > > >able to see the outer frames. > > > > Hi, > > Actually, I dont have ECMP enabled on this box. Its > > basically GENERIC, minus > > > > < ident router > > --- > > > ident GENERIC > > 72,75c73,76 > > < #options HWPMC_HOOKS # Necessary kernel hooks for > > hwpmc(4) > > < #options AUDIT # Security event auditing > > < #options MAC # TrustedBSD MAC Framework > > < #options FLOWTABLE # per-cpu routing >cache > > --- > > > options HWPMC_HOOKS # Necessary kernel hooks for > > hwpmc(4) > > > options AUDIT # Security event auditing > > > options MAC # TrustedBSD MAC Framework > > > options FLOWTABLE # per-cpu routing cache > > > > and device drivers that are unused > > > > ---Mike > > > > > > -------------------------------------------------------------------- > > Mike Tancsa, tel +1 519 651 3400 > > Sentex Communications, mike@sentex.net > > Providing Internet since 1994 www.sentex.net > > Cambridge, Ontario Canada www.sentex.net/mike -------------------------------------------------------------------- Mike Tancsa, tel +1 519 651 3400 Sentex Communications, mike@sentex.net Providing Internet since 1994 www.sentex.net Cambridge, Ontario Canada www.sentex.net/mike