From owner-freebsd-net@FreeBSD.ORG Thu Jan 21 16:16:20 2010 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 80409106566B for ; Thu, 21 Jan 2010 16:16:20 +0000 (UTC) (envelope-from mattblists@icritical.com) Received: from mail2.icritical.com (mail2.icritical.com [212.57.248.50]) by mx1.freebsd.org (Postfix) with SMTP id D4BCE8FC0C for ; Thu, 21 Jan 2010 16:16:19 +0000 (UTC) Received: (qmail 6244 invoked from network); 21 Jan 2010 16:16:47 -0000 Received: from localhost (127.0.0.1) by mail2.icritical.com with SMTP; 21 Jan 2010 16:16:47 -0000 Received: (qmail 6237 invoked by uid 599); 21 Jan 2010 16:16:46 -0000 Received: from unknown (HELO icritical.com) (87.127.43.249) by mail2.icritical.com (qpsmtpd/0.28) with ESMTP; Thu, 21 Jan 2010 16:16:46 +0000 Message-ID: <4B587DD0.8020700@icritical.com> Date: Thu, 21 Jan 2010 16:16:16 +0000 From: Matt Burke User-Agent: Thunderbird 2.0.0.23 (X11/20090928) MIME-Version: 1.0 To: freebsd-net@freebsd.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-OriginalArrivalTime: 21 Jan 2010 16:16:16.0747 (UTC) FILETIME=[0F2743B0:01CA9AB5] X-Virus-Scanned: by iCritical at mail2.icritical.com Subject: setfib/arpresolve behaviour bug? X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 21 Jan 2010 16:16:20 -0000 Box is running 8.0-RELEASE-p2 cvsupped two days ago. NICs are em bonded with lagg failover and running a few vlan interfaces. net.my_fibnum: 0 net.add_addr_allfibs: 1 net.fibs: 4 This is reproducible, but with the lack of (accessible?) documentation on multiple routing tables, I don't know if this is intended behaviour or a bug. It seems processes using a non-default fib cannot perform arp lookups unless the fib 0 has a routing table entry for the attached network: [root@host ~]# ifconfig vlan11 a.a.a.92/27 [root@host ~]# route delete -net a.a.a.64/27 delete net a.a.a.64 [root@host ~]# setfib 1 ping a.a.a.65 PING a.a.a.65 (a.a.a.65): 56 data bytes ping: sendto: Invalid argument ^C --- a.a.a.65 ping statistics --- 1 packets transmitted, 0 packets received, 100.0% packet loss [root@host ~]# dmesg |tail -1 arpresolve: can't allocate llinfo for a.a.a.65 Putting the entry into the arp cache before removing the route results in success: [root@host ~]# ifconfig vlan11 a.a.a.92/27 [root@host ~]# setfib 1 ping a.a.a.65 PING a.a.a.65 (a.a.a.65): 56 data bytes 64 bytes from a.a.a.65: icmp_seq=0 ttl=255 time=1.437 ms ^C --- a.a.a.65 ping statistics --- 1 packets transmitted, 1 packets received, 0.0% packet loss round-trip min/avg/max/stddev = 1.437/1.437/1.437/0.000 ms [root@host ~]# route delete -net a.a.a.64/27 delete net a.a.a.64 [root@host ~]# setfib 1 ping a.a.a.65 PING a.a.a.65 (a.a.a.65): 56 data bytes 64 bytes from a.a.a.65: icmp_seq=0 ttl=255 time=0.762 ms ^C --- a.a.a.65 ping statistics --- 1 packets transmitted, 1 packets received, 0.0% packet loss round-trip min/avg/max/stddev = 0.762/0.762/0.762/0.000 ms and deleting it again results in failure: [root@host ~]# arp -an ? (a.a.a.92) at 00:11:27:00:d7:c4 on vlan11 permanent [vlan] ? (a.a.a.65) at 00:1a:e4:00:60:bf on vlan11 [vlan] ... [root@host ~]# arp -d a.a.a.65 delete: cannot locate a.a.a.65 [root@host ~]# setfib 1 arp -d a.a.a.65 a.a.a.65 (a.a.a.65) deleted [root@host ~]# setfib 1 ping -c1 a.a.a.65 PING a.a.a.65 (a.a.a.65): 56 data bytes ping: sendto: Invalid argument ^C --- a.a.a.65 ping statistics --- 1 packets transmitted, 0 packets received, 100.0% packet loss This behaviour seems a little inconsistent, with fib 1 requesting arp lookups, fib 0 performing and displaying them, but fib 1 needing to delete them... -- The information contained in this message is confidential and is intended for the addressee only. If you have received this message in error or there are any problems please notify the originator immediately. The unauthorised use, disclosure, copying or alteration of this message is strictly forbidden. Critical Software Ltd. reserves the right to monitor and record e-mail messages sent to and from this address for the purposes of investigating or detecting any unauthorised use of its system and ensuring its effective operation. Critical Software Ltd. registered in England, 04909220. Registered Office: IC2, Keele Science Park, Keele, Staffordshire, ST5 5NH. ------------------------------------------------------------ This message has been scanned for security threats by iCritical. For further information, please visit www.icritical.com ------------------------------------------------------------