From owner-freebsd-net@freebsd.org Tue Jul 17 07:54:35 2018 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BD759102EF22 for ; Tue, 17 Jul 2018 07:54:35 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from hz.grosbein.net (unknown [IPv6:2a01:4f8:d12:604::2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4572A79729; Tue, 17 Jul 2018 07:54:34 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from eg.sd.rdtc.ru (root@eg.sd.rdtc.ru [62.231.161.221] (may be forged)) by hz.grosbein.net (8.15.2/8.15.2) with ESMTPS id w6H7sS6t058213 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Tue, 17 Jul 2018 09:54:28 +0200 (CEST) (envelope-from eugen@grosbein.net) X-Envelope-From: eugen@grosbein.net X-Envelope-To: lev@FreeBSD.org Received: from eg.sd.rdtc.ru (eugen@localhost [127.0.0.1]) by eg.sd.rdtc.ru (8.15.2/8.15.2) with ESMTP id w6H7sOEv015190; Tue, 17 Jul 2018 14:54:24 +0700 (+07) (envelope-from eugen@grosbein.net) Subject: Re: [REGRESSION] Fresh CURRENT consume much more CPU on network traffic (vlans + routing + ipfw with NAT) To: lev@FreeBSD.org, freebsd-net@freebsd.org References: <6d8b301b-8ee9-0e8b-80b5-6aced15ca843@FreeBSD.org> From: Eugene Grosbein Message-ID: <5B4DA0B0.8020302@grosbein.net> Date: Tue, 17 Jul 2018 14:54:24 +0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.4.0 MIME-Version: 1.0 In-Reply-To: <6d8b301b-8ee9-0e8b-80b5-6aced15ca843@FreeBSD.org> Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-Spam-Status: No, score=2.2 required=5.0 tests=BAYES_00, LOCAL_FROM, RDNS_NONE, SPF_PASS,T_DATE_IN_FUTURE_96_Q autolearn=no autolearn_force=no version=3.4.1 X-Spam-Report: * -0.0 SPF_PASS SPF: sender matches SPF record * 0.0 T_DATE_IN_FUTURE_96_Q Date: is 4 days to 4 months after Received: * date * -2.3 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 2.6 LOCAL_FROM From my domains * 1.9 RDNS_NONE Delivered to internal network by a host with no rDNS X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on hz.grosbein.net X-Spam-Level: ** X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Jul 2018 07:54:35 -0000 On 13.07.2018 18:10, Lev Serebryakov wrote: > > I have "SOHO" router on Atom D2500 with FreeBSD CURRENT. It runs > CURRENT for very long time (from 11-CURRENT times), and recently it > start to consume much more CPU on same traffic — to the point when it > becomes unresponsive in shell (via ssh, not local console). > > I have rather complex ipfw ruleset, but this ruleset is the same for > many years. > > Revisions before r333989 worked normally, I never seen any problem with > shell, no matter how much traffic is processed > > Revision r334649 with same configuration, same firewall ruleset, etc., > becomes completely unresponsive under network load (pure transit traffic). > > when system is unresponsive I see this in `top -SH` > > 100083 root -76 - 0K 272K - 1 291.8H 95.31% kernel{if_io_tqg_1} > 100082 root -76 - 0K 272K - 0 297.7H 95.20% kernel{if_io_tqg_0} > > And it is new to me. I'm sure you will get it solved more quick if you perform bisection of revision even though it will take time.