From owner-freebsd-net@FreeBSD.ORG Tue Aug 12 10:31:21 2014 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id A69EEB81 for ; Tue, 12 Aug 2014 10:31:21 +0000 (UTC) Received: from mail-n.franken.de (drew.ipv6.franken.de [IPv6:2001:638:a02:a001:20e:cff:fe4a:feaa]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "mail-n.franken.de", Issuer "Thawte DV SSL CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 5985827F7 for ; Tue, 12 Aug 2014 10:31:21 +0000 (UTC) Received: from [192.168.1.200] (p54819867.dip0.t-ipconnect.de [84.129.152.103]) (Authenticated sender: macmic) by mail-n.franken.de (Postfix) with ESMTP id 888D71C0E96AC; Tue, 12 Aug 2014 12:31:16 +0200 (CEST) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 7.3 \(1878.6\)) Subject: Re: A problem on TCP in High RTT Environment. From: Michael Tuexen In-Reply-To: Date: Tue, 12 Aug 2014 12:31:15 +0200 Content-Transfer-Encoding: quoted-printable Message-Id: <45B75806-ECE3-43D0-A75B-1B71A5969234@lurchi.franken.de> References: <20140809184232.GF83475@funkthat.com> <8AE1AC56-D52F-4F13-AAA3-BB96042B37DD@lurchi.franken.de> <20140809204500.GG83475@funkthat.com> <3F6BC212-4223-4AAC-8668-A27075DC55C2@lurchi.franken.de> <20140810022350.GI83475@funkthat.com> <20140810033212.GL83475@funkthat.com> <17A804F3-BEA6-46F4-887F-B68750618FD9@netapp.com> <0CF85443-26AC-4931-9D00-3396C18C7690@lurchi.franken.de> <7A4120EE-60F3-4D32-89C4-C694B8DFEAE4@netapp.com> <5E8A6382-7096-495A-907C-86CE26A163A2@lurchi.franken.de> <5D3CBFDC-362E-4DB6-A132-BA842EF5B1B2@lurchi.franken.de> To: "Eggert, Lars" X-Mailer: Apple Mail (2.1878.6) Cc: "freebsd-net@freebsd.org" , John-Mark Gurney , Niu Zhixiong , hiren panchasara , Bill Yuan X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 12 Aug 2014 10:31:21 -0000 On 12 Aug 2014, at 10:02, Eggert, Lars wrote: > Hi, >=20 > On 2014-8-12, at 1:52, hiren panchasara = wrote: >> On Mon, Aug 11, 2014 at 12:59 PM, Michael Tuexen >> wrote: >>> If I remember correctly, I increased >>> kern.ipc.nmbufs and kern.ipc.nmbclusters in /boot/loader.conf >>=20 >> I believe, you just need to set kern.ipc.nmbclusters (max mbuf >> clusters allowed) and kern.ipc.nmbufs (max mbufs allowed) should be >> adjusted based on that. >=20 > I bumped kern.ipc.nmbclusters by a factor of 100 (from 2036224 to = 203622400). As Hiren said, kern.ipc.nmbufs auto-adjusted (from 13031835 = to 205111860). Just to double check: You changed it in /boot/loader.conf, right? >=20 > However, I still see "requests for mbufs denied" immediately after = reboot. >=20 > root@laurel:~ # netstat -m > 12280/1580/13860 mbufs in use (current/cache/total) > 12279/827/13106/203622400 mbuf clusters in use = (current/cache/total/max) > 12279/819 mbuf+clusters out of packet secondary zone in use = (current/cache) > 0/3/3/1018111 4k (page size) jumbo clusters in use = (current/cache/total/max) > 0/0/0/301662 9k jumbo clusters in use (current/cache/total/max) > 0/0/0/169685 16k jumbo clusters in use (current/cache/total/max) > 27628K/2061K/29689K bytes allocated to network (current/cache/total) > 253/5481/12473 requests for mbufs denied = (mbufs/clusters/mbuf+clusters) > 0/0/0 requests for mbufs delayed (mbufs/clusters/mbuf+clusters) > 0/0/0 requests for jumbo clusters delayed (4k/9k/16k) > 0/0/0 requests for jumbo clusters denied (4k/9k/16k) > 0 requests for sfbufs denied > 0 requests for sfbufs delayed > 0 requests for I/O initiated by sendfile >=20 > I just noticed that the total "mbufs in use" didn't seem to have = increase when I did the 100x scaling of kern.ipc.nmbclusters (and = kern.ipc.nmbufs auto-adjusted). Neither did "bytes allocated to = network". Is that expected? I don't think so... Best regards Michael >=20 > Lars