From owner-freebsd-stable@FreeBSD.ORG Fri Dec 4 21:30:41 2009 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C0E48106568B for ; Fri, 4 Dec 2009 21:30:41 +0000 (UTC) (envelope-from kmatthew.macy@gmail.com) Received: from mail-px0-f178.google.com (mail-px0-f178.google.com [209.85.216.178]) by mx1.freebsd.org (Postfix) with ESMTP id 933328FC12 for ; Fri, 4 Dec 2009 21:30:41 +0000 (UTC) Received: by pxi8 with SMTP id 8so673795pxi.27 for ; Fri, 04 Dec 2009 13:30:41 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:sender:reply-to:received :in-reply-to:references:date:x-google-sender-auth:message-id:subject :from:to:cc:content-type:content-transfer-encoding; bh=w/25SoiJxxDbyif07JOEbrjRdxRDVIfdayQzvfMCc/k=; b=JvtFoXIY0+49EYMAhprli/QGeDSnqMBWeD/zArujtSJnJjRjy1Hpeuc05XB3Iy2ieu OFth0cFn56qCdX+GG6nEHMhWV78W2xutfxcIJuJd5oVsM0IPmwDr+mBBmzwAumcGHtPp 6pS1W/j/4B+zdEUHLoGrG5H/iaZSmegTgOMt8= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:sender:reply-to:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:cc:content-type :content-transfer-encoding; b=NfyO/aMrHF5yE5ZQxOlEIy4DHYwsYD0knmxA88lNTW15F5+0zTJFjufKilrt/sbO8e 0xr7T/io58EgzJLYCt9EOX4kFCZl2czybEYc3o21pLdk9iOYi+ktXRGd9CTZ7JCBU3U+ EmI6J9BAEJKRRH+Imga8uyhVh/JZfgg4aKYZI= MIME-Version: 1.0 Sender: kmatthew.macy@gmail.com Received: by 10.115.103.9 with SMTP id f9mr4696536wam.112.1259960869972; Fri, 04 Dec 2009 13:07:49 -0800 (PST) In-Reply-To: <200912041456.nB4Eu8oN017070@lava.sentex.ca> References: <5f67a8c40912031946v1ab3efua5e43bd7d767361a@mail.gmail.com> <200912041456.nB4Eu8oN017070@lava.sentex.ca> Date: Fri, 4 Dec 2009 13:07:49 -0800 X-Google-Sender-Auth: 1d7018fc1c1312d4 Message-ID: <82c4140e0912041307m5f764f00vee1a7f37d4782a5b@mail.gmail.com> From: "K. Macy" To: Mike Tancsa Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Cc: Zaphod Beeblebrox , FreeBSD Stable Subject: Re: Quggaa locking hard. X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: kmacy@freebsd.org List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Dec 2009 21:30:41 -0000 If you have a large number of routes then you will want to disable the flowtable. The default maximum number of cacheable flows is fairly small, raising it can help on the low-end, but fundamentally its an optimization for systems that have fewer than a few thousand simultaneous peers - the common case. I do have longer term plans for moving to lock-free L3 and L2 so that applications with large numbers of prefixes will also no longer be hampered by high locking overhead. -Kip On Fri, Dec 4, 2009 at 6:56 AM, Mike Tancsa wrote: > At 10:46 PM 12/3/2009, Zaphod Beeblebrox wrote: >> >> I'm still investigating this, but my quagga is locking hard on FreeBSD 8= .0 >> and not locking hard on 7.2. =A0It seems (at this early point in the >> investigation) that both bgpd and zebra are wedging and zebra is listed = as >> being in the "RUN" state. >> >> curiously, the load is also 4.0 (exactly the number of cores in the >> machine) >> even though the machine also reads 100% idle. > > > I think I am seeing something similar on a test box. =A0I was loading up = the > box with 200k routes to do testing with. =A0Kernel is default, save for a= few > unused drivers removed. If I take out > options =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0FLOWTABLE =A0 =A0 =A0 =A0 =A0 =A0 = =A0 # per-cpu routing cache > from the kernel, load avg is back to normal. =A0This issue only seems to = have > come up in the past week or so as the previous kernel from ~8 days ago wa= s > OK. > > last pid: =A06229; =A0load averages: =A02.00, =A02.00, =A02.00 =A0 =A0 = =A0 =A0 =A0 =A0 =A0 up > 1+17:33:02 =A009:39:31 > 141 processes: 7 running, 106 sleeping, 28 waiting > CPU: =A00.0% user, =A00.0% nice, 22.2% system, =A00.0% interrupt, 77.8% i= dle > Mem: 98M Active, 2233M Inact, 187M Wired, 36K Cache, 112M Buf, 979M Free > Swap: 8192M Total, 8192M Free > > =A0PID USERNAME PRI NICE =A0 SIZE =A0 =A0RES STATE =A0 C =A0 TIME =A0 WCP= U COMMAND > =A0 22 root =A0 =A0 =A076 =A0 =A0- =A0 =A0 0K =A0 =A0 8K CPU3 =A0 =A03 = =A041.5H 100.00% flowcleaner > =A0 11 root =A0 =A0 171 ki31 =A0 =A0 0K =A0 =A032K CPU2 =A0 =A02 =A041.5H= 100.00% {idle: cpu2} > =A0 11 root =A0 =A0 171 ki31 =A0 =A0 0K =A0 =A032K CPU1 =A0 =A01 =A041.5H= 100.00% {idle: cpu1} > =A0 11 root =A0 =A0 171 ki31 =A0 =A0 0K =A0 =A032K RUN =A0 =A0 0 =A041.4H= 100.00% {idle: cpu0} > =A0869 root =A0 =A0 =A0 4 =A0 =A00 64860K 64488K select =A00 =A0 4:12 =A0= 0.00% bgpd > =A0 11 root =A0 =A0 171 ki31 =A0 =A0 0K =A0 =A032K RUN =A0 =A0 3 =A0 2:09= =A00.00% {idle: cpu3} > =A0 20 root =A0 =A0 =A044 =A0 =A0- =A0 =A0 0K =A0 =A0 8K syncer =A00 =A0 = 1:00 =A00.00% syncer > =A0 12 root =A0 =A0 -32 =A0 =A0- =A0 =A0 0K =A0 224K WAIT =A0 =A01 =A0 0:= 47 =A00.00% {swi4: clock} > =A0 =A00 root =A0 =A0 -68 =A0 =A00 =A0 =A0 0K =A0 =A080K - =A0 =A0 =A0 2 = =A0 0:03 =A00.00% {fw0_taskq} > =A01230 root =A0 =A0 =A076 =A0 =A00 =A03348K =A01160K ttyin =A0 2 =A0 0:0= 2 =A00.00% getty > =A0863 root =A0 =A0 =A096 =A0 =A00 24640K 24232K RUN =A0 =A0 2 =A0 0:02 = =A00.00% zebra > =A0 12 root =A0 =A0 -32 =A0 =A0- =A0 =A0 0K =A0 224K WAIT =A0 =A02 =A0 0:= 01 =A00.00% {swi4: clock} > =A0 14 root =A0 =A0 -16 =A0 =A0- =A0 =A0 0K =A0 =A0 8K - =A0 =A0 =A0 0 = =A0 0:01 =A00.00% yarrow > >> _______________________________________________ >> freebsd-stable@freebsd.org mailing list >> http://lists.freebsd.org/mailman/listinfo/freebsd-stable >> To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org= " > > -------------------------------------------------------------------- > Mike Tancsa, =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 =A0tel +1 519 651 3400 > Sentex Communications, =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0mike@sentex.net > Providing Internet since 1994 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0www.= sentex.net > Cambridge, Ontario Canada =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0= www.sentex.net/mike > >