From owner-freebsd-hackers@FreeBSD.ORG Thu Apr 10 12:38:36 2014 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 05C93DE; Thu, 10 Apr 2014 12:38:36 +0000 (UTC) Received: from mail-pd0-x234.google.com (mail-pd0-x234.google.com [IPv6:2607:f8b0:400e:c02::234]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id C18A41CBC; Thu, 10 Apr 2014 12:38:35 +0000 (UTC) Received: by mail-pd0-f180.google.com with SMTP id v10so3807851pde.25 for ; Thu, 10 Apr 2014 05:38:35 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type; bh=6gpWfHaYsRexDGvuNlPrJmc1sslnJOlW1f0XZEe3y8Q=; b=lMU17bz7NYq3kiWUOmC7WhvFcGdstp7QwMezr1g/x0nc3r2DLDcoii9/C99MNJok4G uIf6UO8zWRZMMhJjBlImem5AMTkr747APFowdlGa4RNmGqt2zvQD7of4W0GRyWqeIyCh xocsFBa6cAJ1oP+hSAHGAotRnwVJJkgMEZEcX2J5dd830TkoMCfgZXvIefodkhRYyDC8 5aQPhz8kD0Onsgc0ioCEezHrXhTJN5q+cLgLrYKqpfPVWqYkOecq68Ii0Sw75q2v34Ti o2MaJI9Qprf013fQCAj0WbmaCogLTmO+xfgPlzR926A1gqSrXRXqTf/zzEIqHzfzsJWA H2vg== MIME-Version: 1.0 X-Received: by 10.68.236.229 with SMTP id ux5mr19320244pbc.98.1397133515355; Thu, 10 Apr 2014 05:38:35 -0700 (PDT) Sender: ermal.luci@gmail.com Received: by 10.70.88.109 with HTTP; Thu, 10 Apr 2014 05:38:35 -0700 (PDT) In-Reply-To: References: <1397077963.756961709.gspkmzvd@frv35.fwdcdn.com> <1397127901.499782177.24smhe7a@frv35.fwdcdn.com> Date: Thu, 10 Apr 2014 14:38:35 +0200 X-Google-Sender-Auth: yI4THH4Pe0R7_PwLx408BAWe5S4 Message-ID: Subject: Re: Re[2]: Some gruesome moments with performance of FreeBSD at over 20K interfaces From: =?ISO-8859-1?Q?Ermal_Lu=E7i?= To: Hartmut Brandt Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.17 Cc: hackers@freebsd.org, stable@freebsd.org, Vladislav Prodan , "net@freebsd.org" X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 10 Apr 2014 12:38:36 -0000 Another note related to Q-in-Q. You would probably be better of creating standard vlans for the first vlan layer and use ng_vlan for the second++ part of the Q-in-Q on top of the first ones. This also give better usability and will speedup a bit your times. On Thu, Apr 10, 2014 at 1:22 PM, Hartmut Brandt wrote: > On Thu, 10 Apr 2014, Vladislav Prodan wrote: > > VP>> On Wed, 9 Apr 2014, Vladislav Prodan wrote: > VP>> > VP>> VP>b) Service bsnmpd started at 12K interfaces, but immediately > loaded CPU > VP>> VP>at 80-100% > VP>> > VP>> I could imagine that this is because of the statistics polling. bsnmp > VP>> implements 64-bit interface statistics but we have only 32-bit > statistics > VP>> in the kernel. So it polls the kernel statistics for each interface > on a > VP>> rate that ensures that 32-bit don't overflow. If the interfaces are > GBit > VP>> or, worse, 10GBit interfaces the polling rate is rather high (in the > order > VP>> of seconds). > VP>> > VP>> You should either make sure that the interfaces report sensible > bitrates > VP>> (I doubt that 20k interfaces could all be GBit interfaces) or force a > slower > VP>> polling interval by setting begemotIfForcePoll.0 to some large value. > VP>> > VP>> harti > VP>> > VP> > VP>Thanks for the tip. > VP> > VP>At least 10 interfaces to be 1Gb, and the rest no more than 50M. > VP>BegemotIfForcePoll parameter in this case a little help, you will be > forced to stand another value for Gigabit Interface begemotIfForcePoll ... > > Yeah. There is only one parameter. > > You are running -STABLE, right? On current the statistics are 64-bit > (I wonder whether the operation on these values is automatically atomic on > all our platforms, though). > > harti > _______________________________________________ > freebsd-net@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" > -- Ermal