Date: Mon, 07 Jul 2008 14:57:14 -0400 From: Paul <paul@gtcomm.net> To: Bruce Evans <brde@optusnet.com.au> Cc: FreeBSD Net <freebsd-net@FreeBSD.org>, Andre Oppermann <andre@FreeBSD.org>, Ingo Flaschberger <if@xip.at> Subject: Re: Freebsd IP Forwarding performance (question, and some info) [7-stable, current, em, smp] Message-ID: <4872670A.9050801@gtcomm.net> In-Reply-To: <20080707213356.G7572@besplex.bde.org> References: <4867420D.7090406@gtcomm.net> <ea7b9c170806302050p2a3a5480t29923a4ac2d7c852@mail.gmail.com> <4869ACFC.5020205@gtcomm.net> <4869B025.9080006@gtcomm.net> <486A7E45.3030902@gtcomm.net> <486A8F24.5010000@gtcomm.net> <486A9A0E.6060308@elischer.org> <486B41D5.3060609@gtcomm.net> <alpine.LFD.1.10.0807021052041.557@filebunker.xip.at> <486B4F11.6040906@gtcomm.net> <alpine.LFD.1.10.0807021155280.557@filebunker.xip.at> <486BC7F5.5070604@gtcomm.net> <20080703160540.W6369@delplex.bde.org> <486C7F93.7010308@gtcomm.net> <20080703195521.O6973@delplex.bde.org> <486D35A0.4000302@gtcomm.net> <alpine.LFD.1.10.0807041106591.19613@filebunker.xip.at> <486DF1A3.9000409@gtcomm.net> <alpine.LFD.1.10.0807041303490.20760@filebunker.xip.at> <486E65E6.3060301@gtcomm.net> <alpine.LFD.1.10.0807052356130.2145@filebunker.xip.at> <4871DB8E.5070903@freebsd.org> <20080707191918.B4703@besplex.bde.org> <4871FB66.1060406@freebsd.org> <20080707213356.G7572@besplex.bde.org>
next in thread | previous in thread | raw e-mail | index | archive | help
> I use low-end memory, but on the machine that does 640 kpps it somehow > has latency almost 4 times as low as on new FreeBSD cluster machines > (~42 nsec instead of ~150). perfmon (fixed for AXP and A64) and hwpmc > report an average of 11 k8-dc-misses per sendto() while sending via > bge at 640 kpps. 11 * 42 accounts for 442 nsec out of the 1562 per > packet at this rate. 11 * 150 = 1650 would probably make this rate > unachievable despite the system having 20 times as much CPU and bus. > Any of the buffered dimms or ddr3 or high cas ddr2 are going to have a lot more latency than older ones because the frequency is so high or the buffering. The best is to use ddr2 with the lowest timings that it supports at the highest frequency but not the highest frequency it supports at higher timings.. for instance i have some 1100mhz ddr2 ram but it's 5-5-5-15 but it will do 5-4-4-12 at 1000 or 900 Mhz so I think the latency may have more impact on the speed than the actual MHz of the ram itself. This works for several benchmarks which I have tested before running the ram at 1:1 with the FSB (400 FSB(1600fsb actual) with ram at 800 and the latency is a lot lower than ram at 1:1.20 FSB even though the bandwidth is higher) With higher latency in the 'server' machines we probably need to do things in bigger chunks.. Anyone using a FBSD router isn't going to care about a 1ms delay in the packet but they will care if packets are dropped or reordered. Paul
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?4872670A.9050801>