From owner-freebsd-net@freebsd.org Mon Jun 3 19:37:00 2019 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DE06715BBBF6; Mon, 3 Jun 2019 19:36:59 +0000 (UTC) (envelope-from ler@lerctr.org) Received: from thebighonker.lerctr.org (ns-b.lerctr.org [IPv6:2001:470:1f0f:3ad::53:2]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "*.lerctr.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 176256BD03; Mon, 3 Jun 2019 19:36:59 +0000 (UTC) (envelope-from ler@lerctr.org) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lerctr.org; s=ler2019; h=Message-ID:References:In-Reply-To:Subject:Cc:To:From:Date: Content-Transfer-Encoding:Content-Type:MIME-Version:Sender:Reply-To: Content-ID:Content-Description:Resent-Date:Resent-From:Resent-Sender: Resent-To:Resent-Cc:Resent-Message-ID:List-Id:List-Help:List-Unsubscribe: List-Subscribe:List-Post:List-Owner:List-Archive; bh=yDZuC0PYqRQ/6q6/obAnh83+UsG6pdrW9LySXvY6iLM=; b=d5JFKYYOGYig/99hwmJOOxj2c6 601OYijgd2PUzt6mP8P/VbhNb3rS+Ssc7CsOWToCGGDQ/Cl8PNytFxSBtzPw5QTDGQc3kJNVHV4l9 Xq+Lee2BolcAEmVhXMXkIRREGaPVKB0UD5JWVkkUpQsT40p/phtwWkTjdqGSQ/2MuI8+OY+OW1xkJ QVvxNHAYHAe69zEfcLDVhrfxxwnQJDH91Jgxz2njo2t0M45aDf4x79/nwW7cXwkOgofIRkqaIz3Vr 5ce0BR83EYhF7BjH3gSCgdcw4zJ9FwjaNuwm6imtwNdwi8C1lXA5vXX3wwHhwUojDk7m1eSr6jvaU 22XjVF6w==; Received: from thebighonker.lerctr.org ([2001:470:1f0f:3ad:bb:dcff:fe50:d900]:14542 helo=webmail.lerctr.org) by thebighonker.lerctr.org with esmtpsa (TLSv1.3:TLS_AES_256_GCM_SHA384:256) (Exim 4.92 (FreeBSD)) (envelope-from ) id 1hXslL-000MbW-RA; Mon, 03 Jun 2019 14:36:55 -0500 Received: from 2600:1700:210:b180:c89b:801e:ddd7:a6bb by webmail.lerctr.org with HTTP (HTTP/1.1 POST); Mon, 03 Jun 2019 14:36:55 -0500 MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit Date: Mon, 03 Jun 2019 14:36:55 -0500 From: Larry Rosenman To: Eugene Grosbein Cc: Freebsd net , owner-freebsd-net@freebsd.org Subject: Re: SNMP/No Bufferspace In-Reply-To: References: <8dba5eaea800356d279eb81d7d8b2a30@lerctr.org> <03051c226dadc9907dcd0839d5025e18@lerctr.org> <2ada895d-fbeb-077e-e116-5d9837ce0cb7@grosbein.net> <5adc5fdf5f3549ba08de17a750204b1c@lerctr.org> Message-ID: <4d0a78247b19f3075be5b0ad4a051f24@lerctr.org> X-Sender: ler@lerctr.org User-Agent: Roundcube Webmail/1.3.9 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 03 Jun 2019 19:37:00 -0000 On 06/03/2019 2:23 pm, Eugene Grosbein wrote: > 04.06.2019 1:42, Larry Rosenman wrote: > >> Ok, I've removed the bridge (don't need it). Added the tunable >> and will check it after a few hours. I *REALLY* appreciate >> the help diagnosing this. (If need be I can replace the cable, but >> let's >> see what happens now). > > You already run mrtg, so make sure you have graphs for bce0 usage. > Maybe you have short-lived traffic storms. I upped the RX pages as well, and that seems(!) to help with having all 3 of my network backups running (bacula) which apparently was what was tripping it up. ⌂75% [ler@borg.lerctr.org:~] $ sysctl hw.bce hw.bce.rx_ticks: 18 hw.bce.rx_ticks_int: 18 hw.bce.rx_quick_cons_trip: 6 hw.bce.rx_quick_cons_trip_int: 6 hw.bce.tx_ticks: 80 hw.bce.tx_ticks_int: 80 hw.bce.tx_quick_cons_trip: 20 hw.bce.tx_quick_cons_trip_int: 20 hw.bce.strict_rx_mtu: 0 hw.bce.hdr_split: 1 hw.bce.tx_pages: 8 hw.bce.rx_pages: 8 hw.bce.msi_enable: 1 hw.bce.tso_enable: 1 hw.bce.verbose: 1 ⌂77% [ler@borg.lerctr.org:~] $ sysctl dev.bce.0 dev.bce.0.com_no_buffers: 0 dev.bce.0.stat_CatchupInRuleCheckerP4Hit: 0 dev.bce.0.stat_CatchupInMBUFDiscards: 0 dev.bce.0.stat_CatchupInFTQDiscards: 0 dev.bce.0.stat_CatchupInRuleCheckerDiscards: 0 dev.bce.0.stat_IfInRuleCheckerP4Hit: 10301 dev.bce.0.stat_IfInMBUFDiscards: 0 dev.bce.0.stat_IfInFTQDiscards: 0 dev.bce.0.stat_IfInRuleCheckerDiscards: 0 dev.bce.0.stat_IfInFramesL2FilterDiscards: 5741 dev.bce.0.stat_XoffStateEntered: 0 dev.bce.0.stat_MacControlFramesReceived: 0 dev.bce.0.stat_FlowControlDone: 0 dev.bce.0.stat_OutXoffSent: 0 dev.bce.0.stat_OutXonSent: 0 dev.bce.0.stat_XoffPauseFramesReceived: 0 dev.bce.0.stat_XonPauseFramesReceived: 0 dev.bce.0.stat_EtherStatsPktsTx1523Octetsto9022Octets: 0 dev.bce.0.stat_EtherStatsPktsTx1024Octetsto1522Octets: 7461404 dev.bce.0.stat_EtherStatsPktsTx512Octetsto1023Octets: 488 dev.bce.0.stat_EtherStatsPktsTx256Octetsto511Octets: 1331 dev.bce.0.stat_EtherStatsPktsTx128Octetsto255Octets: 139674 dev.bce.0.stat_EtherStatsPktsTx65Octetsto127Octets: 1492188 dev.bce.0.stat_EtherStatsPktsTx64Octets: 325 dev.bce.0.stat_EtherStatsPktsRx1523Octetsto9022Octets: 0 dev.bce.0.stat_EtherStatsPktsRx1024Octetsto1522Octets: 2890915 dev.bce.0.stat_EtherStatsPktsRx512Octetsto1023Octets: 1494 dev.bce.0.stat_EtherStatsPktsRx256Octetsto511Octets: 167073 dev.bce.0.stat_EtherStatsPktsRx128Octetsto255Octets: 4091 dev.bce.0.stat_EtherStatsPktsRx65Octetsto127Octets: 7602388 dev.bce.0.stat_EtherStatsPktsRx64Octets: 3913 dev.bce.0.stat_EtherStatsOversizePkts: 0 dev.bce.0.stat_EtherStatsUndersizePkts: 0 dev.bce.0.stat_EtherStatsJabbers: 0 dev.bce.0.stat_EtherStatsFragments: 0 dev.bce.0.stat_EtherStatsCollisions: 0 dev.bce.0.stat_Dot3StatsLateCollisions: 0 dev.bce.0.stat_Dot3StatsExcessiveCollisions: 0 dev.bce.0.stat_Dot3StatsDeferredTransmissions: 0 dev.bce.0.stat_Dot3StatsMultipleCollisionFrames: 0 dev.bce.0.stat_Dot3StatsSingleCollisionFrames: 0 dev.bce.0.stat_Dot3StatsAlignmentErrors: 0 dev.bce.0.stat_Dot3StatsFCSErrors: 0 dev.bce.0.stat_Dot3StatsCarrierSenseErrors: 0 dev.bce.0.stat_emac_tx_stat_dot3statsinternalmactransmiterrors: 0 dev.bce.0.stat_IfHCOutBroadcastPkts: 694 dev.bce.0.stat_IfHCOutMulticastPkts: 290 dev.bce.0.stat_IfHCOutUcastPkts: 9094426 dev.bce.0.stat_IfHCInBroadcastPkts: 3746 dev.bce.0.stat_IfHCInMulticastPkts: 6555 dev.bce.0.stat_IfHCInUcastPkts: 10659572 dev.bce.0.stat_IfHCOutBadOctets: 0 dev.bce.0.stat_IfHCOutOctets: 11458190364 dev.bce.0.stat_IfHCInBadOctets: 2384121 dev.bce.0.stat_IfHcInOctets: 5141824959 dev.bce.0.unexpected_attention_count: 0 dev.bce.0.dma_map_addr_tx_failed_count: 0 dev.bce.0.dma_map_addr_rx_failed_count: 0 dev.bce.0.mbuf_frag_count: 0 dev.bce.0.mbuf_alloc_failed_count: 0 dev.bce.0.l2fhdr_error_count: 0 dev.bce.0.%parent: pci1 dev.bce.0.%pnpinfo: vendor=0x14e4 device=0x1639 subvendor=0x1028 subdevice=0x0235 class=0x020000 dev.bce.0.%location: slot=0 function=0 dbsf=pci0:1:0:0 dev.bce.0.%driver: bce dev.bce.0.%desc: QLogic NetXtreme II BCM5709 1000Base-T (C0) ⌂78% [ler@borg.lerctr.org:~] $ We'll see over the next few hours. Thanks again. -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 E-Mail: ler@lerctr.org US Mail: 5708 Sabbia Dr, Round Rock, TX 78665-2106