From owner-freebsd-stable@FreeBSD.ORG Fri Dec 4 09:13:25 2009 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 13DEC106566B for ; Fri, 4 Dec 2009 09:13:25 +0000 (UTC) (envelope-from alexpalias-bsdstable@yahoo.com) Received: from web56408.mail.re3.yahoo.com (web56408.mail.re3.yahoo.com [216.252.111.87]) by mx1.freebsd.org (Postfix) with SMTP id ABD8D8FC1F for ; Fri, 4 Dec 2009 09:13:24 +0000 (UTC) Received: (qmail 29692 invoked by uid 60001); 4 Dec 2009 09:13:23 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1259918003; bh=erCk5FuNYeY+uxNoJ+fUcKBQsNw9li3eMRKgcMejHXM=; h=Message-ID:X-YMail-OSG:Received:X-Mailer:Date:From:Reply-To:Subject:To:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding; b=a3NFUONZds423qJ/pLd6J1/P8QiTVuShBu+Y9c8RK/EM9S1DQUxtzUHG2E8fTOg347FuGUtgm7AdYbt/cQRbFZh/Yv/26v1AGCiFDp9JUo46kBV7IpEzwvV63fvWhH7hQzkm4bLAXGgBG9dnOMHPeE+AdddAJoAumzY49Mph/w0= DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=Message-ID:X-YMail-OSG:Received:X-Mailer:Date:From:Reply-To:Subject:To:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding; b=fiqdm1gwI7T7sOxeTRmQIMT/pswGjBE4GaBHtx9L5QXIRI9MNe0uJbD29OrRG9VcUTq4ZhrWdS1LNzlqCEMOefbZZST67kfy4ed5uftrrqYgz0GnxutYyPL5cqWE69AwHz6L2xqvGSlyzNRqKm+IiUlKsgcd7uuv3ldqzAe+xtA=; Message-ID: <776232.27938.qm@web56408.mail.re3.yahoo.com> X-YMail-OSG: _0T.utgVM1lxj.cKOeIbbngc20EcAY0R9u2pr.la.J1IJ76gR3D2ky8QK5mi.I6L9OJSl_tHOZPYP1DIBgeY3i6oL_P1p1FTgJbdd5r_Y6pQCP7R9HCEOWIc_OC4jSvhIKspbuvj4JE6Kb1hBvtC2X_FnUVbhFAEsbFXhoVJqN3lEqT.z8dhQpoXTWilIk5qqFSPP8AG0E_Kj4fztiaXVvx640DcsQUEKJt1MAsOEkgFQt4b9psy9TgQGspDq8DjnTtL86RKTVuFw2mZBs36JnmAZx2s0xxJVFvyWRgSTq2eHFLz.WyuPykqXZ7eC8nb0m1e8yOKe4m8.w.nNZv9KLK3q9na1WjSBESC.sZ.if6tgOUdPwQYgPhg1Q-- Received: from [188.26.35.221] by web56408.mail.re3.yahoo.com via HTTP; Fri, 04 Dec 2009 01:13:23 PST X-Mailer: YahooMailClassic/8.1.6 YahooMailWebService/0.8.100.260964 Date: Fri, 4 Dec 2009 01:13:23 -0800 (PST) From: alexpalias-bsdstable@yahoo.com To: FreeBSD Stable , Zaphod Beeblebrox In-Reply-To: <5f67a8c40912031946v1ab3efua5e43bd7d767361a@mail.gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: quoted-printable Cc: Subject: Re: Quggaa locking hard. X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: alexpalias-bsdstable@yahoo.com List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Dec 2009 09:13:25 -0000 I have also seen this with a recent version of FreeBSD 8 (I know 8.0-BETA2 = didn't have this problem, also I have an 8.0-RC1 without problems, but I t= hink RC3 did have it, and I'm sure -RELEASE has it).=0A=0AA few more detail= s: =0A=0AIt happened both on amd64 and i386. I couldn't debug amd64 (it w= as a live server and we couldn't afford it), but on i386 flowcleaner was us= ing a LOT of CPU. =0A=0AIt seemed to happen after booting, when quagga was= importing global routing tables (~300k routes) from 2 BGP sessions. At le= ast one of the sessions seemed to finish importing routes, but the kernel r= outing table seemed to be growing very slowly. =0A=0ADoing "netstat -nr | = wc -l" took way longer than usual (20-30 seconds versus 9 seconds now), and= it only reported about 100k routes. Doing it again after a minute or so s= howed the number of routes grew by around 10k.=0A=0ADuring this time, both = quagga and zebra were very slow to respond to a new telnet session opened t= o them.=0A=0AAs a workaround, I did sysctl net.inet.flowtable.enable=3D0. = This didn't ease the load on the CPU, but having it in /etc/sysctl.conf and= rebooting did help (quagga started up normally and all routes are where th= ey should be).=0A=0AHope this helps=0A Alex=0A=0A--- On Fri, 12/4/09, Za= phod Beeblebrox wrote:=0A=0A> From: Zaphod Beeblebrox <= zbeeble@gmail.com>=0A> Subject: Quggaa locking hard.=0A> To: "FreeBSD Stabl= e" =0A> Date: Friday, December 4, 2009, 5:46 AM= =0A> I'm still investigating this, but my=0A> quagga is locking hard on Fre= eBSD 8.0=0A> and not locking hard on 7.2.=A0 It seems (at this early=0A> po= int in the=0A> investigation) that both bgpd and zebra are wedging and=0A> = zebra is listed as=0A> being in the "RUN" state.=0A> =0A> curiously, the lo= ad is also 4.0 (exactly the number of=0A> cores in the machine)=0A> even th= ough the machine also reads 100% idle.=0A>