From owner-freebsd-net@FreeBSD.ORG Thu Apr 19 21:06:39 2012 Return-Path: Delivered-To: net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 467BC106564A; Thu, 19 Apr 2012 21:06:39 +0000 (UTC) (envelope-from kmacybsd@gmail.com) Received: from mail-iy0-f182.google.com (mail-iy0-f182.google.com [209.85.210.182]) by mx1.freebsd.org (Postfix) with ESMTP id E14CB8FC16; Thu, 19 Apr 2012 21:06:38 +0000 (UTC) Received: by iahk25 with SMTP id k25so16204273iah.13 for ; Thu, 19 Apr 2012 14:06:38 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:cc:content-type :content-transfer-encoding; bh=iN23oN6WTe8edGdt9aVL7d9+1s9ABXoM5R6xLO+wTAk=; b=UmPaIUK1tE4wJt060BmFvoAdkcW79HQ5lGKUh1dd+uRCgxeDPa3S+8q7vUHLlbnHzd Nsjtk7Zd5YY5pH7AN/Dv1XpSITr2yn+Pr8b2rFQTYa/wSDEK0awkK+zQ1eXuCxfK81AU qU0c+Dyjxouc2afFcsQo6ZtmrNe/C8i56F2sy4fBXdM7IJdrS5q023OOBa2toNb5zHfN eEHUPJ8zcPR/yz+1U53UsvKohwmEm99YEECFO0+F1K4BjwjFMbFtfQm/xIvch2jmOsdV V0O86c9UL2vODXJGwpN7jZui9bOgTaULAngtIXU9p9eCeUaN5aqIHXLl5s8UKXT6ud5X w5zg== MIME-Version: 1.0 Received: by 10.50.194.232 with SMTP id hz8mr3912197igc.38.1334869598605; Thu, 19 Apr 2012 14:06:38 -0700 (PDT) Sender: kmacybsd@gmail.com Received: by 10.50.129.39 with HTTP; Thu, 19 Apr 2012 14:06:38 -0700 (PDT) In-Reply-To: <20120419212224.GA95459@onelab2.iet.unipi.it> References: <20120419133018.GA91364@onelab2.iet.unipi.it> <4F907011.9080602@freebsd.org> <20120419204622.GA94904@onelab2.iet.unipi.it> <20120419212224.GA95459@onelab2.iet.unipi.it> Date: Thu, 19 Apr 2012 23:06:38 +0200 X-Google-Sender-Auth: FTB_DkrCoCzDUCOEYnPzbMJVtwE Message-ID: From: "K. Macy" To: Luigi Rizzo Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable Cc: Andre Oppermann , current@freebsd.org, net@freebsd.org Subject: Re: Some performance measurements on the FreeBSD network stack X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 19 Apr 2012 21:06:39 -0000 On Thu, Apr 19, 2012 at 11:22 PM, Luigi Rizzo wrote: > On Thu, Apr 19, 2012 at 10:34:45PM +0200, K. Macy wrote: >> >> This is indeed a big problem. ?I'm working (rough edges remain) on >> >> changing the routing table locking to an rmlock (read-mostly) which >> > >> >> This only helps if your flows aren't hitting the same rtentry. >> Otherwise you still convoy on the lock for the rtentry itself to >> increment and decrement the rtentry's reference count. >> >> > i was wondering, is there a way (and/or any advantage) to use the >> > fastforward code to look up the route for locally sourced packets ? > > actually, now that i look at the code, both ip_output() and > the ip_fastforward code use the same in_rtalloc_ign(...) > >> > >> >> If the number of peers is bounded then you can use the flowtable. Max >> PPS is much higher bypassing routing lookup. However, it doesn't scale >> to arbitrary flow numbers. > > re. flowtable, could you point me to what i should do instead of > calling in_rtalloc_ign() ? If you build with it in your kernel config and enable the sysctl ip_output will automatically use it for TCP and UDP connections. If you're doing forwarding you'll need to patch the forwarding path. Fabien Thomas has a patch for that that I just fixed/identified a bug in for him. -Kip --=20 =A0 =A0=93The real damage is done by those millions who want to 'get by.' The ordinary men who just want to be left in peace. Those who don=92t want their little lives disturbed by anything bigger than themselves. Those with no sides and no causes. Those who won=92t take measure of their own strength, for fear of antagonizing their own weakness. Those who don=92t like to make waves=97or enemies. =A0 =A0Those for whom freedom, honour, truth, and principles are only literature. Those who live small, love small, die small. It=92s the reductionist approach to life: if you keep it small, you=92ll keep it under control. If you don=92t make any noise, the bogeyman won=92t find you. =A0 =A0But it=92s all an illusion, because they die too, those people who roll up their spirits into tiny little balls so as to be safe. Safe?! >From what? Life is always on the edge of death; narrow streets lead to the same place as wide avenues, and a little candle burns itself out just like a flaming torch does. =A0 =A0I choose my own way to burn.=94 =A0 =A0Sophie Scholl