From owner-freebsd-arch@freebsd.org Sun Aug 21 21:30:22 2016 Return-Path: Delivered-To: freebsd-arch@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D4D03BC173E for ; Sun, 21 Aug 2016 21:30:22 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: from mail-it0-x22a.google.com (mail-it0-x22a.google.com [IPv6:2607:f8b0:4001:c0b::22a]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 868271666; Sun, 21 Aug 2016 21:30:22 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: by mail-it0-x22a.google.com with SMTP id e63so73272845ith.1; Sun, 21 Aug 2016 14:30:22 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:from:date:message-id :subject:to; bh=g0yEJoU2u04XxfEMN0+5bR3VkMc1qvaaHcjDueINGo4=; b=RtxnmDv+oo4cnKuD/9KeB4Nbkf+brCN2B21ljuuaNSW5FtfqwUZ6de0wE54yKr8Ojm 4HmlvuKT84HbzhwC+YKc1ISgrW7YnViSc8Zq+iaKeJgAENhwz9HYI3kl5BwoDuABIfbB EN45Z1GDXrKGBryPPJKJA/mKoWpuhpT00rQ7VipUt3eHCFD/DAOuKqxfaRy4ZvUvPJ5R dLrd3AJbFn/P2NqBH2s5Ls4QVSYb60Kb5OqVoRKn5gyyOxoobHf2Cs9Vtyi1Z0fzkMSC nCGWURnk49ecTo4TAcI+T4dK1Ikug1xtkVqSrdGbulYSJ4GxEg8ozL/9+Bdb925wz9d2 3TzQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:sender:in-reply-to:references:from :date:message-id:subject:to; bh=g0yEJoU2u04XxfEMN0+5bR3VkMc1qvaaHcjDueINGo4=; b=hQ4rkDG6is4EfZ5U85IhvG8uQ9s6SyB4qbxNKAV6dyWxD5fr3xoXYdy4QHoePbzERn 7mkQlMgJgAIB6xMLugWK9mtHWu7ERyLiMgJ9VwdxNyV/ud3YYuvjmnNVXebYDGXnq4tV 33d9h/eP2w4+I9XVEeqZOf9fXOiOIYi+A9nBr3wYPdsNI5P8jLfqEg8WZBuohu6uJmV/ JsQcN1uBfXmgrcVYI/CbyKNn1k6lbVk9mAWxbL0h2PVIFRC3qWUxpIbhWhXfKrNXVF6S PoqI190C+EQjc1UAYwB0QzGW8NAynnzxd7VzRrp6sKo/4r9b6IfE7GnHCCePSfSvfGTM Lc5Q== X-Gm-Message-State: AEkoouvhuvOqC08ikp2wpGJhG9/fH3NXjjCYFDa1AjAittc1koE/W8SaP+rcUDZcbcsZrHCht7y0BpDn69fUkA== X-Received: by 10.36.73.195 with SMTP id e64mr15913701itd.80.1471815021389; Sun, 21 Aug 2016 14:30:21 -0700 (PDT) MIME-Version: 1.0 Sender: adrian.chadd@gmail.com Received: by 10.36.141.129 with HTTP; Sun, 21 Aug 2016 14:30:20 -0700 (PDT) In-Reply-To: References: <60a8da58-dbd5-dd26-6047-745bcf6a21f4@freebsd.org> <894b4841-166c-422f-9fe8-50ed261d76bb@FreeBSD.org> <1836ae28-b510-06dd-b83f-d08060cf87ac@freebsd.org> <8478b8aa-b8cf-7383-9923-249fced3dac3@FreeBSD.org> <4c28236a-f9ca-4601-336f-0829842b6d1a@freebsd.org> <270be6c4-16f9-3b89-c3b3-5983ec85834f@FreeBSD.org> <68cb112b-9334-045a-d860-7011573a2b47@freebsd.org> <203719a3-a66b-5389-ff52-a20b661f8b9b@freebsd.org> From: Adrian Chadd Date: Sun, 21 Aug 2016 14:30:20 -0700 X-Google-Sender-Auth: IXfeODuDHLHc1rD1r6dZ0fYKtA4 Message-ID: Subject: Re: metalog -> makefs is broken again in -HEAD To: Sean Bruno , "freebsd-arch@freebsd.org" Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-arch@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Discussion related to FreeBSD architecture List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 21 Aug 2016 21:30:22 -0000 On 21 August 2016 at 09:11, Sean Bruno wrote: > Ok, figured a hack for not installing the atheros tools: > ---------------------------------------------------------------------- > diff --git a/build/bin/build_freebsd b/build/bin/build_freebsd > index d7fe4c2..04169b4 100755 > --- a/build/bin/build_freebsd > +++ b/build/bin/build_freebsd > @@ -112,7 +112,7 @@ fi > > while [ -n "$1" ]; do > echo "*** Stage : $1" > - if [ "$1" = "installworld" ]; then > + if [ "$1" = "installworld" -a ${X_BUILD_BASE_CFG} = "mips_ap" ]; > then > mkdir -p ${X_DESTDIR}/usr/local/bin/ > mkdir -p ${X_DESTDIR}/bsdbox/ > mkdir -p ${X_DESTDIR}/usr/local/libdata/athprom/ > This happens because when adding LOCAL_TOOL_DIRS to install the ath bits, it's installing it in /usr/local/* without doing an install -d /usr/local/bin , /usr/local/libexec/, etc beforehand. I bet doing a "make installworld" without /usr/local/ fully populated (ie, no ports) won't create the /usr/local/ subdirectories. > --------------------------------------------------------------------- > > I can't quite see how to fix the last two errors I'm seeing: > > *** Target : fullroot > *** Deleting old file system.. > install: open /home/sbruno/bsd/fbsd_head/../mfsroot/METALOG.malta.tmp: > No such file or directory > *** Creating new filesystem... > **** Done. > *** Target Done. > *** Target : fullfsimage > *** Running makefs to build image .. > *** from /home/sbruno/bsd/fbsd_head/../mfsroot/malta .. > makefs: ./boot/kernel.MALTA: missing directory in specification > makefs: failed at line 26663 of the specification > This happens because the option that sets the kernel directory for the installworld/installkernel pass (KODIR and KMODDIR) doesn't first do an install -d /boot/kernel.XXX/, so the metalog entry isn't populated. I could write another tool like filter.pl that allows for entries to be inserted before other entries, so we could say "hey, please populate /boot/kernel.XXX before you populate /boot/kernel.XXX/YYY", but I think I'd rather just fix it in -HEAD. -adrian From owner-freebsd-arch@freebsd.org Sun Aug 21 21:32:59 2016 Return-Path: Delivered-To: freebsd-arch@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2285DBC19AF for ; Sun, 21 Aug 2016 21:32:59 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: from mail-it0-x230.google.com (mail-it0-x230.google.com [IPv6:2607:f8b0:4001:c0b::230]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id D852C1BD8; Sun, 21 Aug 2016 21:32:58 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: by mail-it0-x230.google.com with SMTP id e63so73304460ith.1; Sun, 21 Aug 2016 14:32:58 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:from:date:message-id :subject:to; bh=9pH8WuOFxOvrX/WQ6/vfQ3K0G1Ac256/UtXrEVb21K4=; b=QmDJuGIUwsqv+ncOfXaCW3XQZAbOblJfjmAhNyWjqHmSWsCep9shPdKELQnPeNO9OU 2roQCIpvM91D5UkmrlDniu8ekxN1HT/9jVtv+Nu4J2SLuHZjpCNhy+M+1yiyBSdijVcT KqacZMJsaH2ZMrN25ZsCidBpF2Y/waVQCURdVCp9LNLEWrMkXQ7MoWy5fr1U+cpIngwY u3eUi4ntcTX8dr4D00JN/qmOtNmNA2XKu+0Asd+iXS4L8LJfys7gQII65TDYShFVCnmp 7utaOuBIlGLfjRAssljwjnrGwEzxNbEtnLUfW+uWQSDkkE/DQPNXzOuTupjplaakyqyY Wt2A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:sender:in-reply-to:references:from :date:message-id:subject:to; bh=9pH8WuOFxOvrX/WQ6/vfQ3K0G1Ac256/UtXrEVb21K4=; b=jx6V93EGD1O6hm/9vIJpL51xv+hzD2m295LUacFvv6Z7BiOSQAxlcgdPs/xMB9jDMi XuofjLQ1ghSQtIh+vJxkY3X7SiQY2qR4hWQMWk5Uj59DBkW9QPu+PC2rkdiD1LPd00jh rS79R0wHE/+uCVEyHecyZ6Tam7VxHdsDVtsgzOFGChKjIlCTS2mSbBsBqlABr/11mdnD Glhvjjo5SKpWtILamDdn87+hCCx/HcUffa+xC8kQ03NU4P71vvTqd3zWkhy1Iyzc5Cqn IcZBkNCk/px3SP0b+ZvO9zc1VLSi9W9wdpkcmH7rOFPFGbMdlNUu4s2wMnayi1AjEJEm LX1w== X-Gm-Message-State: AEkooutcMMdxoggWcI9sy8Webwj9Vy2w71tAnKcDqdIzehFR2+RhvqDYHHMyKzzc2sv3Q3dr+LszuGgF3Wo4Zw== X-Received: by 10.36.212.6 with SMTP id x6mr15983494itg.71.1471815178053; Sun, 21 Aug 2016 14:32:58 -0700 (PDT) MIME-Version: 1.0 Sender: adrian.chadd@gmail.com Received: by 10.36.141.129 with HTTP; Sun, 21 Aug 2016 14:32:57 -0700 (PDT) In-Reply-To: References: <60a8da58-dbd5-dd26-6047-745bcf6a21f4@freebsd.org> <894b4841-166c-422f-9fe8-50ed261d76bb@FreeBSD.org> <1836ae28-b510-06dd-b83f-d08060cf87ac@freebsd.org> <8478b8aa-b8cf-7383-9923-249fced3dac3@FreeBSD.org> <4c28236a-f9ca-4601-336f-0829842b6d1a@freebsd.org> <270be6c4-16f9-3b89-c3b3-5983ec85834f@FreeBSD.org> <68cb112b-9334-045a-d860-7011573a2b47@freebsd.org> <203719a3-a66b-5389-ff52-a20b661f8b9b@freebsd.org> From: Adrian Chadd Date: Sun, 21 Aug 2016 14:32:57 -0700 X-Google-Sender-Auth: R_Ft2zXzdcXYI9fTEmPsYp3CHUQ Message-ID: Subject: Re: metalog -> makefs is broken again in -HEAD To: Sean Bruno , "freebsd-arch@freebsd.org" Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-arch@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Discussion related to FreeBSD architecture List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 21 Aug 2016 21:32:59 -0000 On 21 August 2016 at 14:30, Adrian Chadd wrote: > On 21 August 2016 at 09:11, Sean Bruno wrote: >> Ok, figured a hack for not installing the atheros tools: >> ---------------------------------------------------------------------- >> diff --git a/build/bin/build_freebsd b/build/bin/build_freebsd >> index d7fe4c2..04169b4 100755 >> --- a/build/bin/build_freebsd >> +++ b/build/bin/build_freebsd >> @@ -112,7 +112,7 @@ fi >> >> while [ -n "$1" ]; do >> echo "*** Stage : $1" >> - if [ "$1" = "installworld" ]; then >> + if [ "$1" = "installworld" -a ${X_BUILD_BASE_CFG} = "mips_ap" ]; >> then >> mkdir -p ${X_DESTDIR}/usr/local/bin/ >> mkdir -p ${X_DESTDIR}/bsdbox/ >> mkdir -p ${X_DESTDIR}/usr/local/libdata/athprom/ >> > > This happens because when adding LOCAL_TOOL_DIRS to install the ath > bits, it's installing it in /usr/local/* without doing an install -d > /usr/local/bin , /usr/local/libexec/, etc beforehand. > > I bet doing a "make installworld" without /usr/local/ fully populated > (ie, no ports) won't create the /usr/local/ subdirectories. > >> --------------------------------------------------------------------- >> >> I can't quite see how to fix the last two errors I'm seeing: >> >> *** Target : fullroot >> *** Deleting old file system.. >> install: open /home/sbruno/bsd/fbsd_head/../mfsroot/METALOG.malta.tmp: >> No such file or directory >> *** Creating new filesystem... >> **** Done. >> *** Target Done. >> *** Target : fullfsimage >> *** Running makefs to build image .. >> *** from /home/sbruno/bsd/fbsd_head/../mfsroot/malta .. >> makefs: ./boot/kernel.MALTA: missing directory in specification >> makefs: failed at line 26663 of the specification >> > > This happens because the option that sets the kernel directory for the > installworld/installkernel pass (KODIR and KMODDIR) doesn't first do > an install -d /boot/kernel.XXX/, so the metalog entry isn't populated. > > I could write another tool like filter.pl that allows for entries to > be inserted before other entries, so we could say "hey, please > populate /boot/kernel.XXX before you populate /boot/kernel.XXX/YYY", > but I think I'd rather just fix it in -HEAD. > > And another shortcoming is how METALOG is the same for installworld, installkernel, distribution. Ideally we could specify a separate METALOG target for each installkernel target so we could just do one world build and 'n' kernel builds, and then we can just join the pieces together at processing time before we call makefs. Otherwise multiple installkernel passes creates ... some very big METALOG files with stuff you don't need. :) -adrian From owner-freebsd-arch@freebsd.org Sat Aug 27 16:50:34 2016 Return-Path: Delivered-To: freebsd-arch@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5D69FB77B6E; Sat, 27 Aug 2016 16:50:34 +0000 (UTC) (envelope-from hoomanfazaeli@gmail.com) Received: from mail-wm0-x232.google.com (mail-wm0-x232.google.com [IPv6:2a00:1450:400c:c09::232]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id E5C92B14; Sat, 27 Aug 2016 16:50:33 +0000 (UTC) (envelope-from hoomanfazaeli@gmail.com) Received: by mail-wm0-x232.google.com with SMTP id q128so28333579wma.1; Sat, 27 Aug 2016 09:50:33 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=message-id:date:from:user-agent:mime-version:to:cc:subject :references:in-reply-to:content-transfer-encoding; bh=XIyBGPPtOdpenvDuBzNQB63wPTxJG01Xirg97z0qSzE=; b=zkmbvhB33KouET7IL0S+7e3i03MV7sZcQNg7LapkW44LD7KyFOMgW6i5duCVoY9pR7 vNotXn4iQnKBXkiJmShZ7xrIuiEXG7TDLzMI7JLHFPqFYC1oau66yP036w2vr6EiCpy2 Fy+cKQOQgt/ZrfbK+M+HLE+d2+muMIxy2oK1HWOYLeZA7Fq3UjVlrwZNtNPBS7GU355T CyJQOeGBA/WXq92dtn6oFY0FvgYw3K1kqydQEbP9gfQEw+vO4KlDn7F205cmTy5IFJDe 9qZGv1WPMs+JXTwayFrWIDsbzZCYTgn66jRdE8OCVeHJUwZszg98ClEl9m6kAKxPekgf gnhA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:message-id:date:from:user-agent:mime-version:to :cc:subject:references:in-reply-to:content-transfer-encoding; bh=XIyBGPPtOdpenvDuBzNQB63wPTxJG01Xirg97z0qSzE=; b=B7IhWBzGvZkgdfyGJ+LFz5fzb5K+DPuey65ND+ApcK7Jtrp8vJvC/CysVAc7Odz+oA 3bU2mvVuuCH34hPWe8w9sV3sSJsYStHwAYWS6zb+pN5GjGCdwd2Gl/rj99F+6eiOd3eb PCuESX0jmUdDCZpMcY0Sx3y0HSPNgpNm/eC6V1vcxZ4s5mTmzkNq/vR4JWZpzquWXHUh sojOa0QwYquicSA5ALB716mYyxo1TtAW4x4SMbZMp4oX7HwGiOuC8Q+PVitd2mYudPfC jmebiyoLqe033VJqBQF1Z3+HiulWs3MvvwJylwm1qeeIH5Vw8IC+4LpIxGW3ZCnfbNkr LRxw== X-Gm-Message-State: AE9vXwOZTzfpLcC+YOBQ2wXcL4OwsVaUFsTKDbPxPd7hLRY+igE+vAcPWGkGjDIjc05GdQ== X-Received: by 10.28.39.134 with SMTP id n128mr3490014wmn.60.1472316632128; Sat, 27 Aug 2016 09:50:32 -0700 (PDT) Received: from [192.168.2.30] ([2.190.218.206]) by smtp.googlemail.com with ESMTPSA id i1sm25447334wjf.12.2016.08.27.09.50.29 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Sat, 27 Aug 2016 09:50:31 -0700 (PDT) Message-ID: <57C1C4D3.8060604@gmail.com> Date: Sat, 27 Aug 2016 21:20:27 +0430 From: Hooman Fazaeli User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:17.0) Gecko/20130215 Thunderbird/17.0.3 MIME-Version: 1.0 To: "Alexander V. Chernikov" CC: FreeBSD Net , freebsd-hackers@freebsd.org, freebsd-arch@freebsd.org Subject: Re: projects/routing announcement/status References: <6151261453419663@web14j.yandex.ru> In-Reply-To: <6151261453419663@web14j.yandex.ru> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-arch@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Discussion related to FreeBSD architecture List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 27 Aug 2016 16:50:34 -0000 On 2016-01-22 03:11, Alexander V. Chernikov wrote: > I would like to introduce routing rework which started as projects/routing SVN branch. > It has been around for quite a long time, some of the code has made its way to HEAD, but there hasn't been any public announcements. > > So, what is projects/routing about? > > First, it is about bringing more scalability by solving most annoying problems on packet output path. > To be more specific, it eliminates 2 out of 4 locks, converts other 2 to rmlock(9) and adds infrastructure to reduce locking to single rmlock for certain traffic types. > With these changes, OS is able to forward 12MPPS on 16-core box for both IPv4/IPv6 which is 6-10 times better than stock HEAD. > > Second, it eases hacking by avoiding direct access to route/lltable internals and providing higher level API instead. > > Third, it is about bringing advanced features like route multipath, and even more speed by adding modular lookup API permitting to use different route lookup algorithms based on server role. > > Description with graphs and links is available at: http://wiki.freebsd.org/ProjectsRoutingProposal > Used API is described in http://wiki.freebsd.org/ProjectsRoutingProposal/API > Current status is available at http://wiki.freebsd.org/ProjectsRoutingProposal/ConversionStatus > > It is probably much more convenient to read project details on wiki, however I’ll try to summarise the most important things here (wiki readers can skip till the end). > > Typical packet processing (forwarding for router, or output for web server) path consists of: > > doing routing lookup (radix read rwlock + routing entry (rte) mutex lock) > (optionally) interface address (ifa) atomic refcount acquire/release > doing link level entry (lle, llentry) lookup (afdata read rwlock + llentry read (or write) lock) > > > Most annoying one is the rtentry mutex. The only goal of this mutex is to provide rtentry refcounting so consumer code can use it without the risk of rtentrry being deleted. > We solve this by saving all needed data into on-stack optimised structure instead of refcounting. > Additionally, we are trying to pre-calculate the data we need to pass by using special next-hop structures instead of route entries. > Several different (in terms of returned info and relative overhead) functions for retrieving routing data are provided. > Most of the consumers have already been switched to the new KPI. Actual output/forward path are not converted yet. > > It should be noted, that since individual rtentries are not returned, it is not possible to do per-ifa output packet accouting (can be observed in netstat -s). > > Route table lock is switched to ipfw-like dual-locking mode (read rmlock() for data path, rwlock for config changes, route export, etc..). > The reasons of having rwlock are to 1) provide serialization for things in control plane not directly used for data path and 2) avoid acquiring contested/sleeping locks for rmlock. See projects/routing r287078 for an example. > > Lltable entry locks were eliminated in r291853, r292155. > > Lltable lock is also planned to be converted to dual-locking model, with the similar reasoning. > However, instead of (ab)using AFDATA lock, it needs to be converted to per-lltable set of locks. > > > Open problems: > SCTP/Flowtable references rtentries directly. It is not possible to convert ip[6]_output() path without dealing with that. > > Brief merge plan: > Discuss/merge new routing KPI for data path > Discuss/merge lltable dual-lock (WIP) > Discuss/merge explicit nexthop changes > Discuss/merge IPv4/IPv6 output path (along with converted sctp/flowtable) > Discuss/merge route table dual-lock > > Current outstanding reviews (I encourage you to take a look at these) > > D5009 (IPv4 fast forwarding conversion) > D5010 (IPv6 forwarding conversion) > D4794 (Deal with per-ifa output counters) > D4962 (new LLE lookup functions, no sockaddrs in lltable data path) > D4751 (move all lltable code to separate files) > > _______________________________________________ > freebsd-arch@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-arch > To unsubscribe, send any mail to "freebsd-arch-unsubscribe@freebsd.org" First, thanks for the effort. I personally very much appreciate any improvements made to the network related stuff. Second have you considered replacing the existing radix tree with a faster data structure, specially the Luigi DXR tables? (http://info.iet.unipi.it/~luigi/papers/20120601-dxr.pdf ) I apologize if the question is not much relevant to your work. -- Best regards Hooman Fazaeli From owner-freebsd-arch@freebsd.org Sat Aug 27 17:58:18 2016 Return-Path: Delivered-To: freebsd-arch@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1B0B8B77DCF for ; Sat, 27 Aug 2016 17:58:18 +0000 (UTC) (envelope-from jim@netgate.com) Received: from mail-oi0-x22a.google.com (mail-oi0-x22a.google.com [IPv6:2607:f8b0:4003:c06::22a]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id DAC3329B for ; Sat, 27 Aug 2016 17:58:17 +0000 (UTC) (envelope-from jim@netgate.com) Received: by mail-oi0-x22a.google.com with SMTP id c15so149875050oig.0 for ; Sat, 27 Aug 2016 10:58:17 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=netgate.com; s=google; h=mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=4dPAAALVKOIu+4bKoxmxWFFT1KMtBl0AXzJ43MUtURA=; b=PcOIqwhsQI/jLsCThBnIES5v8A73JSX+NqHqmMEriL7zH1X7hl7EDtScv/mA+iB8j9 Voig7jgLRsHCgh0xYw713dJBmyXqtpQJrT6eZ0TgJ84AdrlNNV/ceCka5DTJOI0MLs7D mXnQlmKZINi6A/BH1/MkXCsp1O5U7x79VMRzI= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=4dPAAALVKOIu+4bKoxmxWFFT1KMtBl0AXzJ43MUtURA=; b=Co/jnQvzO19uY3toNMkRFrfyF0hLzI1K0eZhe6uHfVFsbcI17ffn4DJ45kXKWsdAEh uGGM1AuYQrtJ7++mCSm8ivMcVYWoZqi6lLZTafugExFGlBMh+Ioh42L+2dEF1sJsXs99 c8bAYkD36vF0K2wVA9ohVj4qi8/Cz6LIJO/GehuTx91qwCGIFd3ps1prECk3wQA/Oqb4 fsiGYMoU4ok2wU7pU4nF7gFh/VnQCM20RMkuR7i7ePPx40EbkFv0xn1z8GclInjHWStA cCKqx/+BR+gUJT14RE8U8xUb78p3jS35uGO9g5Vg6tnHai4tk3fJPYPq/2bIBuE2KbIX c1Zw== X-Gm-Message-State: AE9vXwNunxJfSr+a4EF8+9z/5xUPbSNHdf0/cO4NchQfT8f8IJyUsaexBV8/IbJ1iLQ58EHQ X-Received: by 10.202.105.139 with SMTP id e133mr7111366oic.33.1472320697177; Sat, 27 Aug 2016 10:58:17 -0700 (PDT) Received: from [29.135.35.125] (66-87-121-125.pools.spcsdns.net. [66.87.121.125]) by smtp.gmail.com with ESMTPSA id d40sm11574242oic.7.2016.08.27.10.58.16 (version=TLS1 cipher=ECDHE-RSA-AES128-SHA bits=128/128); Sat, 27 Aug 2016 10:58:16 -0700 (PDT) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (1.0) Subject: Re: projects/routing announcement/status From: Jim Thompson X-Mailer: iPhone Mail (13G36) In-Reply-To: <57C1C4D3.8060604@gmail.com> Date: Sat, 27 Aug 2016 12:58:15 -0500 Cc: "Alexander V. Chernikov" , FreeBSD Net , freebsd-arch@freebsd.org, freebsd-hackers@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: References: <6151261453419663@web14j.yandex.ru> <57C1C4D3.8060604@gmail.com> To: Hooman Fazaeli X-BeenThere: freebsd-arch@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Discussion related to FreeBSD architecture List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 27 Aug 2016 17:58:18 -0000 > On Aug 27, 2016, at 11:50 AM, Hooman Fazaeli wro= te: >=20 > Second have you considered replacing the existing radix tree with a faster= data structure, specially the Luigi DXR > tables? DXR only supports IPv4. FYI.=20= From owner-freebsd-arch@freebsd.org Sat Aug 27 19:30:07 2016 Return-Path: Delivered-To: freebsd-arch@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 47912B777AD; Sat, 27 Aug 2016 19:30:07 +0000 (UTC) (envelope-from melifaro@ipfw.ru) Received: from forward4j.cmail.yandex.net (forward4j.cmail.yandex.net [IPv6:2a02:6b8:0:1630::17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "forwards.mail.yandex.net", Issuer "Yandex CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id F0A2493C; Sat, 27 Aug 2016 19:30:06 +0000 (UTC) (envelope-from melifaro@ipfw.ru) Received: from mxback13h.mail.yandex.net (mxback13h.mail.yandex.net [84.201.186.131]) by forward4j.cmail.yandex.net (Yandex) with ESMTP id C73B920843; Sat, 27 Aug 2016 22:29:53 +0300 (MSK) Received: from web23h.yandex.ru (web23h.yandex.ru [84.201.187.157]) by mxback13h.mail.yandex.net (nwsmtp/Yandex) with ESMTP id pZZBsN02id-TruK6xLx; Sat, 27 Aug 2016 22:29:53 +0300 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ipfw.ru; s=mail; t=1472326193; bh=yFGS6au4QYw6nWvsfkns0g9TEOmL6mLwleiMy3hLRDM=; h=From:To:Cc:In-Reply-To:References:Subject:Message-Id:Date; b=qUDpTYrdFCvnLlMAxDFDo7AHnWvmr4FWUtnPFhqX/bjL/Crr3lPKi9nX7mQmV7uQO er3Fw/e+wdRrsM63t0LZLdWlBIIcPa3IU6Vx5e3Ts3mkFzUorF5E3RI+OI3yNrbVaP muiQcGLrQfWShdwRf1GgfN5D6PbEWucMu1kYu2Uc= Authentication-Results: mxback13h.mail.yandex.net; dkim=pass header.i=@ipfw.ru Received: by web23h.yandex.ru with HTTP; Sat, 27 Aug 2016 22:29:53 +0300 From: Alexander V. Chernikov Envelope-From: melifaro@ipfw.ru To: Jim Thompson , Hooman Fazaeli Cc: FreeBSD Net , "freebsd-hackers@freebsd.org" , "freebsd-arch@freebsd.org" In-Reply-To: References: <6151261453419663@web14j.yandex.ru> <57C1C4D3.8060604@gmail.com> Subject: Re: projects/routing announcement/status Message-Id: <217371472326193@web23h.yandex.ru> X-Mailer: Yamail [ http://yandex.ru ] 5.0 Date: Sat, 27 Aug 2016 22:29:53 +0300 MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.22 X-BeenThere: freebsd-arch@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Discussion related to FreeBSD architecture List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 27 Aug 2016 19:30:07 -0000 From owner-freebsd-arch@freebsd.org Sat Aug 27 20:34:21 2016 Return-Path: Delivered-To: freebsd-arch@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 79F3DB779CF; Sat, 27 Aug 2016 20:34:21 +0000 (UTC) (envelope-from melifaro@ipfw.ru) Received: from forward19h.cmail.yandex.net (forward19h.cmail.yandex.net [IPv6:2a02:6b8:0:f35::a4]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "forwards.mail.yandex.net", Issuer "Yandex CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 36860D1E; Sat, 27 Aug 2016 20:34:20 +0000 (UTC) (envelope-from melifaro@ipfw.ru) Received: from mxback4g.mail.yandex.net (mxback4g.mail.yandex.net [77.88.29.165]) by forward19h.cmail.yandex.net (Yandex) with ESMTP id DC45D21414; Sat, 27 Aug 2016 23:34:14 +0300 (MSK) Received: from web2g.yandex.ru (web2g.yandex.ru [95.108.252.102]) by mxback4g.mail.yandex.net (nwsmtp/Yandex) with ESMTP id 7ow1pFXgdw-YEgOrGxw; Sat, 27 Aug 2016 23:34:14 +0300 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ipfw.ru; s=mail; t=1472330054; bh=Ee8Xx8VoRChQQTNVDaV4ExGh7RBHsTCH22RnbBzHBsk=; h=From:To:Cc:In-Reply-To:References:Subject:Message-Id:Date; b=B5KrZwWHOdSYyTQtUo/eZh8Dqddzi7mcf/XTyKUWtRhLJWFxFYXpdlFxPceYZygxO LCUIpKel8YSpR9ttQJnk1i695yBgIhEMaSxG67c9qxjxIKQY6IIBVhNEJz+1w5wdB3 ZRbRJ/7qB6csm828+uV7HhMMe7EwLX6Y+hZzqeys= Authentication-Results: mxback4g.mail.yandex.net; dkim=pass header.i=@ipfw.ru Received: by web2g.yandex.ru with HTTP; Sat, 27 Aug 2016 23:34:14 +0300 From: Alexander V. Chernikov Envelope-From: melifaro@ipfw.ru To: Jim Thompson , Hooman Fazaeli Cc: FreeBSD Net , "freebsd-hackers@freebsd.org" , "freebsd-arch@freebsd.org" In-Reply-To: References: <6151261453419663@web14j.yandex.ru> <57C1C4D3.8060604@gmail.com> Subject: Re: projects/routing announcement/status Message-Id: <75031472330054@web2g.yandex.ru> X-Mailer: Yamail [ http://yandex.ru ] 5.0 Date: Sat, 27 Aug 2016 23:34:14 +0300 MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.22 X-BeenThere: freebsd-arch@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Discussion related to FreeBSD architecture List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 27 Aug 2016 20:34:21 -0000 From owner-freebsd-arch@freebsd.org Sat Aug 27 20:43:21 2016 Return-Path: Delivered-To: freebsd-arch@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 03CB9B77E73; Sat, 27 Aug 2016 20:43:21 +0000 (UTC) (envelope-from melifaro@ipfw.ru) Received: from forward15m.cmail.yandex.net (forward15m.cmail.yandex.net [IPv6:2a02:6b8:b030::9c]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "forwards.mail.yandex.net", Issuer "Yandex CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id B42A87C9; Sat, 27 Aug 2016 20:43:20 +0000 (UTC) (envelope-from melifaro@ipfw.ru) Received: from mxback10g.mail.yandex.net (mxback10g.mail.yandex.net [77.88.29.171]) by forward15m.cmail.yandex.net (Yandex) with ESMTP id E3CB0213BA; Sat, 27 Aug 2016 23:43:08 +0300 (MSK) Received: from web2g.yandex.ru (web2g.yandex.ru [95.108.252.102]) by mxback10g.mail.yandex.net (nwsmtp/Yandex) with ESMTP id 3qVVkn6cfJ-h8DGG4ei; Sat, 27 Aug 2016 23:43:08 +0300 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ipfw.ru; s=mail; t=1472330588; bh=Egnjt8qnVZIJYB+FkBUpMuIzu0YM76nZMAF4np6aN+4=; h=From:To:Cc:In-Reply-To:References:Subject:Message-Id:Date; b=Custj51Jn46ft783VjbRcO/usXFRVcg+WgFZ+lMwe3yCiwaCMgcEfGotUXLKNLJKB q4KLEJ7MHxAlVO/L4mKUvPNklqj1TrRV57kBqzTpX3TayH7vM1M9Dkn4eHN2e2oJP7 L+S0O/dX2bY/FnvvpApd+m2cpjMx7ED332SkLxPI= Authentication-Results: mxback10g.mail.yandex.net; dkim=pass header.i=@ipfw.ru Received: by web2g.yandex.ru with HTTP; Sat, 27 Aug 2016 23:43:08 +0300 From: Alexander V. Chernikov Envelope-From: melifaro@ipfw.ru To: Jim Thompson , Hooman Fazaeli Cc: FreeBSD Net , "freebsd-hackers@freebsd.org" , "freebsd-arch@freebsd.org" In-Reply-To: References: <6151261453419663@web14j.yandex.ru> <57C1C4D3.8060604@gmail.com> Subject: Re: projects/routing announcement/status MIME-Version: 1.0 Message-Id: <80401472330588@web2g.yandex.ru> X-Mailer: Yamail [ http://yandex.ru ] 5.0 Date: Sat, 27 Aug 2016 23:43:08 +0300 Content-Transfer-Encoding: 8bit Content-Type: text/plain; charset=utf-8 X-BeenThere: freebsd-arch@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Discussion related to FreeBSD architecture List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 27 Aug 2016 20:43:21 -0000 27.08.2016, 20:58, "Jim Thompson" : >>  On Aug 27, 2016, at 11:50 AM, Hooman Fazaeli wrote: >> >>  Second have you considered replacing the existing radix tree with a faster data structure, specially the Luigi DXR >>  tables? (Sorry for re-posting #2, I incidentally sent an html-only reply). One of the goals was to be able to ease switching between different structures for different purposes on-fly. I did consider using DXR and there was even some glue code to make it modular lookup algo in ipfw tables: https://svnweb.freebsd.org/base?view=revision&revision=271932 DXR is very fast when handling full-view, but, as Jim already mentioned it is ipv4-specific. Also, it might be overkill when having small number of routes (e.g. typical non-routing host). > > DXR only supports IPv4. FYI. > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org"