Skip site navigation (1)Skip section navigation (2)
Date:      Wed, 2 Jul 2008 12:05:49 +0200 (CEST)
From:      Ingo Flaschberger <if@xip.at>
To:        Paul <paul@gtcomm.net>
Cc:        FreeBSD Net <freebsd-net@freebsd.org>
Subject:   Re: Freebsd IP Forwarding performance (question, and some info) [7-stable, current, em, smp]
Message-ID:  <alpine.LFD.1.10.0807021155280.557@filebunker.xip.at>
In-Reply-To: <486B4F11.6040906@gtcomm.net>
References:  <4867420D.7090406@gtcomm.net> <200806301944.m5UJifJD081781@lava.sentex.ca> <20080701004346.GA3898@stlux503.dsto.defence.gov.au> <alpine.LFD.1.10.0807010257570.19444@filebunker.xip.at> <20080701010716.GF3898@stlux503.dsto.defence.gov.au> <alpine.LFD.1.10.0807010308320.19444@filebunker.xip.at> <486986D9.3000607@monkeybrains.net> <48699960.9070100@gtcomm.net> <ea7b9c170806302005n2a66f592h2127f87a0ba2c6d2@mail.gmail.com> <20080701033117.GH83626@cdnetworks.co.kr> <ea7b9c170806302050p2a3a5480t29923a4ac2d7c852@mail.gmail.com> <4869ACFC.5020205@gtcomm.net> <4869B025.9080006@gtcomm.net> <486A7E45.3030902@gtcomm.net> <486A8F24.5010000@gtcomm.net> <486A9A0E.6060308@elischer.org> <486B41D5.3060609@gtcomm.net> <alpine.LFD.1.10.0807021052041.557@filebunker.xip.at> <486B4F11.6040906@gtcomm.net>

next in thread | previous in thread | raw e-mail | index | archive | help
Dear Paul,

> I still don't like the huge hit ipfw and lagg take :/

I think, you can't use fastforward with with lagg.

> ** I tried polling in UP mode and I got some VERY interesting results..
> CPU is 44% idle (idle polling isn't on)  but I'm getting errors!  It's doing 
> 530kpps with ipfw loaded, which without polling uses 100% cpu but now it says 
> my cpu is 44% idle? that makes no sense.. If it was idle why am I getting 
> errors?  I only get errors when em taskq was eating 100% cpu..
> Idle polling on/off makes no difference.
> user_frac is set to 5 ..

what are your values:
kern.polling.reg_frac=
kern.polling.user_frac=
kern.polling.burst_max=

I use:
kern.polling.reg_frac=20
kern.polling.user_frac=20
kern.polling.burst_max=512

if you need more than 1000, you need to change the code:
src/sys/kern/kern_poll.c
#define MAX_POLL_BURST_MAX      1000

> So my maximum without polling is close to 800kpps but if I push that it 
> starts locking me from doing things, or

how many kpps do you want to achieve?

> HZ=2000 for this test (512/512 descriptors)

you mean:
hw.em.rxd=512
hw.em.txd=512
?

can you try with polling:
hw.em.rxd=4096
hw.em.txd=4096

Kind regards,
 	Ingo Flaschberger




Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?alpine.LFD.1.10.0807021155280.557>