From owner-freebsd-stable@FreeBSD.ORG Thu Nov 3 14:05:09 2011 Return-Path: Delivered-To: freebsd-stable@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 02BAB106564A; Thu, 3 Nov 2011 14:05:09 +0000 (UTC) (envelope-from qing.li@bluecoat.com) Received: from whisker.bluecoat.com (whisker.bluecoat.com [216.52.23.28]) by mx1.freebsd.org (Postfix) with ESMTP id D435E8FC16; Thu, 3 Nov 2011 14:05:08 +0000 (UTC) Received: from PWSVL-EXCHTS-02.internal.cacheflow.com (sai-rp.bluecoat.com [10.2.2.126] (may be forged)) by whisker.bluecoat.com (8.14.2/8.14.2) with ESMTP id pA3E57qR025031 (version=TLSv1/SSLv3 cipher=AES128-SHA bits=128 verify=FAIL); Thu, 3 Nov 2011 07:05:08 -0700 (PDT) Received: from PWSVL-EXCMBX-01.internal.cacheflow.com ([fe80::15bc:12e2:4676:340f]) by PWSVL-EXCHTS-02.internal.cacheflow.com ([fe80::4910:317f:407:6ecc%14]) with mapi id 14.01.0289.001; Thu, 3 Nov 2011 07:05:07 -0700 From: "Li, Qing" To: "Alexander V. Chernikov" , Steven Hartland Thread-Topic: serious packet routing issue causing ntpd high load? Thread-Index: AQHMmi7c9ySnlpfkT0uF5I9TjuSl1JWbLEem Date: Thu, 3 Nov 2011 14:05:07 +0000 Message-ID: References: <2740DA0E7C0F495BA00E6D4BC0FE8F37@multiplay.co.uk> <040F9FF759DA441392432EDBD5C4D2CF@multiplay.co.uk>, <4EB29A84.6070104@FreeBSD.org> In-Reply-To: <4EB29A84.6070104@FreeBSD.org> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [216.52.23.68] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Cc: "qingli@freebsd.org" , "liv3d@multiplay.co.uk" , "freebsd-stable@FreeBSD.org" Subject: RE: serious packet routing issue causing ntpd high load? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 03 Nov 2011 14:05:09 -0000 This endless route lookup miss message problem is reproducible without FLOW= TABLE. =0A= The problem is with the multiple FIBs. I cannot reproduce this problem in m= y home network =0A= but the problem is easily seen at work.=0A= =0A= The route lookup miss itself in multi-FIBs configuration may be normal depe= nding on =0A= the actual system configuration. It's the flooding of RTM_MISS messages tha= t is abnormal.=0A= For example, if the route to the DNS servers is not configured in all FIBs,= then the RTM_MISS =0A= message will be generated when an userland application sends to an explicit= IP address=0A= in a specific FIB.=0A= =0A= In any case, I can reproduce the issue consistently and just trying to get = a few uninterrupted =0A= hours to get it done.=0A= =0A= --Qing=0A= =0A= ________________________________________=0A= From: Alexander V. Chernikov [melifaro@FreeBSD.org]=0A= Sent: Thursday, November 03, 2011 6:43 AM=0A= To: Steven Hartland=0A= Cc: Li, Qing; freebsd-stable@FreeBSD.org; liv3d@multiplay.co.uk=0A= Subject: Re: serious packet routing issue causing ntpd high load?=0A= =0A= -----BEGIN PGP SIGNED MESSAGE-----=0A= Hash: SHA1=0A= =0A= On 10.10.2011 13:50, Steven Hartland wrote:=0A= > ----- Original Message ----- From: "Li, Qing" =0A= >=0A= >>> RTM_MISS: Lookup failed on this address: len 184, pid: 0, seq 0, errno= =0A= >>> 0, flags:=0A= >>> locks: inits:=0A= >>> sockaddrs: =0A= >>> ::A.B.C.D=0A= >>>=0A= I'm unable to reproduce an issue on (nearly) GENERIC 8-S, but I see=0A= nearly the same situation on 8.1-S box with FLOWTABLE enabled.=0A= =0A= Do you have FLOWTABLE option in your kernel config ?=0A= >>=0A= >> Would it be possible for you to email me what exactly does "::A.B.C.D"= =0A= >> map into WRT your system or infrastructure ?=0A= >=0A= > Sorry for the slow reply been out of the country.=0A= >=0A= > All the hosts are local machines same /24 connecting to the server for=0A= > mysql. It seems to be that every packet either to or from for the mysql= =0A= > server is generating an RTM_MISS.=0A= >=0A= >> And are you able to share your "ifconfig -a" and "netstat -rn" output=0A= >> with me privately ?=0A= >=0A= > On its way.=0A= >=0A= > Regards=0A= > Steve=0A= >=0A= > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=0A= > This e.mail is private and confidential between Multiplay (UK) Ltd. and= =0A= > the person or entity to whom it is addressed. In the event of=0A= > misdirection, the recipient is prohibited from using, copying, printing= =0A= > or otherwise disseminating it or any information contained in it.=0A= > In the event of misdirection, illegible or incomplete transmission=0A= > please telephone +44 845 868 1337=0A= > or return the E.mail to postmaster@multiplay.co.uk.=0A= >=0A= > _______________________________________________=0A= > freebsd-stable@freebsd.org mailing list=0A= > http://lists.freebsd.org/mailman/listinfo/freebsd-stable=0A= > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org"= =0A= >=0A= =0A= =0A= - --=0A= WBR, Alexander=0A= -----BEGIN PGP SIGNATURE-----=0A= Version: GnuPG v2.0.18 (FreeBSD)=0A= Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/=0A= =0A= iEYEARECAAYFAk6ymoMACgkQwcJ4iSZ1q2meiACeKq4lhzw6scqCKzEyTNEeycxo=0A= 31QAn2q5KIRBwJpcF7yOpTe3wOcP3Aak=0A= =3DjfKN=0A= -----END PGP SIGNATURE-----=0A=