From owner-freebsd-net@FreeBSD.ORG Wed Oct 29 16:30:27 2014 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 3FF3DFEA for ; Wed, 29 Oct 2014 16:30:27 +0000 (UTC) Received: from mail-ob0-x234.google.com (mail-ob0-x234.google.com [IPv6:2607:f8b0:4003:c01::234]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 08FF014A for ; Wed, 29 Oct 2014 16:30:26 +0000 (UTC) Received: by mail-ob0-f180.google.com with SMTP id wp4so2686420obc.11 for ; Wed, 29 Oct 2014 09:30:26 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-type; bh=sc24Hos4gPkmY+Jd/gBS41cxHgpwgjqRhmBGdx7VMQU=; b=teWKyRcaRI3M89L9h/qJ5uSiW8dtD//OV3WgwE7AOMmG4SKwF18JGu2FiMzxp36VjO tgEXotCM7qjMIpN1GNQ+WYz2dgBjE8PPKEPE+trFU2uIVfOJjBQ4ak+9hfkB7TmLV/jd vSJ6KsPa8KUKa9IQA4U7/EVll5xaOOvpbYkpP/1gCkPfIoVQMTBp+gvgUkdQjmhZSkn0 KbHRBoANetvMZ3mP1jqpQA5tALjgQBXyYuZ6MfYBzw46dEo7vcGEIXPupAAfv8XM5nFz ash5UxT9Dxe0ifT2R+AZ9RAhsZW4P2y/yODipAQ/T7zljeXrAjqJQFzxfq9A+Qm83MWw kAQg== X-Received: by 10.182.89.194 with SMTP id bq2mr9587648obb.12.1414600226340; Wed, 29 Oct 2014 09:30:26 -0700 (PDT) MIME-Version: 1.0 Received: by 10.60.93.40 with HTTP; Wed, 29 Oct 2014 09:30:06 -0700 (PDT) In-Reply-To: <009c01cff388$29fe7ec0$7dfb7c40$@gmail.com> References: <009c01cff388$29fe7ec0$7dfb7c40$@gmail.com> From: Raimundo Santos Date: Wed, 29 Oct 2014 14:30:06 -0200 Message-ID: Subject: Re: ipfw fwd duplicating packets in 9.3-RELEASE To: bycn82 Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 Cc: "freebsd-net@freebsd.org" X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 29 Oct 2014 16:30:27 -0000 On 29 October 2014 12:53, bycn82 wrote: > > Hi, > I cannot help to point out when the ICMP packet was duplicated and transfer > via 2 different links, If it happens in my machine, I will call this feature > "multi-homing". That is a bit off topic, but how and undesired behaviour could be a feature? It is not only undesired, but it is also undocumented. If I filter incoming packtes, I got it sent to the original and to the fwd destinations, by my tests. I can not see how it is multi-homing. What I know by multi-homing is: two or more interconnections with the same other network, or to the Internet. It implies more care to the outgoing and incoming paths. Who leaves from link 1 will enter via link 1? It is ok to happen that way? Only the context can say that. In my case the packet not only get out via two different links, but it is reaching two *different* machines in different networks. > > But what I want to say is the firewall rule > fwd 192.168.0.2 proto icmp src-ip 192.168.4.2 out xmit em1 > You can remove the "out" because "xmit" will check the "out interface". Thank you for the clarification. > > > Regards, > Bycn82 Regards, Raimundo Santos > > > -----Original Message----- > From: owner-freebsd-net@freebsd.org [mailto:owner-freebsd-net@freebsd.org] > On Behalf Of Raimundo Santos > Sent: Tuesday, 28 October, 2014 3:32 PM > To: freebsd-net@freebsd.org > Subject: ipfw fwd duplicating packets in 9.3-RELEASE > > Hello list! > > I was testing the behaviour of fwd in ipfw from FreeBSd 9.3-RELEASE, latest > updates, GENERIC kernel, in this setup: > > 1x FreeBSD 9.3 as router, with 3 network interfaces 5x OpenBSD 5.5 as > network machines, each one connected to FreeBSD via one port. > > It is a virtual env. > > FreeBSD em0 (192.168.0.1) -> OpenBSD#1 em0 (192.168.0.2) FreeBSD em1 > (192.168.1.1) -> OpenBSD#2 em0 (192.168.1.2) FreeBSD em2 (192.168.2.1) -> > OpenBSD#3 em0 (192.168.2.2) FreeBSD em3 (192.168.3.1) -> OpenBSD#4 em0 > (192.168.3.2) FreeBSD em4 (192.168.4.1) -> OpenBSD#5 em1 (192.168.4.2) > > ipfw rule: > > fwd 192.168.0.2 proto icmp src-ip 192.168.4.2 in recv em4 > > Then a ping 192.168.1.2 was issued from OpenBSD#5. > > Interestingly, this rule put a packet on em0 and em1 in FreeBSD. The packet > successfully arrived at OpenBSD#1, where it was discarded, and at OpenBSD#2, > where it got its reply. > > Only these combinations of interface direction do not duplicate the packet: > out xmit > > fwd 192.168.0.2 proto icmp src-ip 192.168.4.2 out xmit em1 > > and > > fwd 192.168.0.2 proto icmp src-ip 192.168.4.2 out via em1 > > Even out recv em4 xmit em1 leads to packet duplication. > > I think that it is a bad thing for PBR. As I can see from these tests, I can > not use all the options to do PBR. > > In my real needs I have to: > > 1. let web traffic flow to an cache appliance (from internal network to > cache, from internet to cache) > > 2. do NAT for the internal network under three different links > > In theory, fwd + in kernel NAT + one_pass=0 could solve the problem. But I > am hitting my head in the wall for almost three weeks on this, only now I > have the time to test in a more clear way. First I blamed the NAT, after > that the one_pass=0, and now, with these results, well... > > Someone has an explanation about it? Something related to > https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=129036? > > For my real needs, I figured out that it works with > > <...before NAT aliasing...> > fwd CACHE_IP proto tcp src-ip table(INT) dst-port 80 out recv INT_IFACE > <...after NAT dealiasing...> fwd CACHE_IP proto tcp dst-ip table(INT) > src-port 80 out recv EXT_IFACE > > But I am not confident that it will remains in good shape without knowing > exactly why fwd behaves that way. > > Thank you in advance for your time, > Raimundo Santos > _______________________________________________ > freebsd-net@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" >