From owner-freebsd-net@FreeBSD.ORG Tue Aug 12 08:03:05 2014 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 3509AD2B for ; Tue, 12 Aug 2014 08:03:05 +0000 (UTC) Received: from mx11.netapp.com (mx11.netapp.com [216.240.18.76]) (using TLSv1 with cipher RC4-SHA (128/128 bits)) (Client CN "mx11.netapp.com", Issuer "VeriSign Class 3 International Server CA - G3" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id F2D4726F0 for ; Tue, 12 Aug 2014 08:03:04 +0000 (UTC) X-IronPort-AV: E=Sophos;i="5.01,847,1400050800"; d="asc'?scan'208";a="139648611" Received: from vmwexceht06-prd.hq.netapp.com ([10.106.77.104]) by mx11-out.netapp.com with ESMTP; 12 Aug 2014 01:03:00 -0700 Received: from HIOEXCMBX02-PRD.hq.netapp.com (10.122.105.35) by vmwexceht06-prd.hq.netapp.com (10.106.77.104) with Microsoft SMTP Server (TLS) id 14.3.123.3; Tue, 12 Aug 2014 01:02:30 -0700 Received: from HIOEXCMBX07-PRD.hq.netapp.com (10.122.105.40) by hioexcmbx02-prd.hq.netapp.com (10.122.105.35) with Microsoft SMTP Server (TLS) id 15.0.913.22; Tue, 12 Aug 2014 01:02:29 -0700 Received: from HIOEXCMBX07-PRD.hq.netapp.com ([::1]) by hioexcmbx07-prd.hq.netapp.com ([fe80::f0de:b572:dd26:36b5%21]) with mapi id 15.00.0913.011; Tue, 12 Aug 2014 01:02:29 -0700 From: "Eggert, Lars" To: hiren panchasara Subject: Re: A problem on TCP in High RTT Environment. Thread-Topic: A problem on TCP in High RTT Environment. Thread-Index: AQHPswaXaqmGo9mF3Ua6+epBNevn4ZvJEqcAgAATYoCAAA7VAIAAA8CAgABXqQCAAANCAP//lMnkgAB+UQCAAASwAIAByiAAgAACkYCAAFJhAIAAeY2AgAADqYCAAAVDgIAAQPcAgACJIIA= Date: Tue, 12 Aug 2014 08:02:28 +0000 Message-ID: References: <20140809184232.GF83475@funkthat.com> <8AE1AC56-D52F-4F13-AAA3-BB96042B37DD@lurchi.franken.de> <20140809204500.GG83475@funkthat.com> <3F6BC212-4223-4AAC-8668-A27075DC55C2@lurchi.franken.de> <20140810022350.GI83475@funkthat.com> <20140810033212.GL83475@funkthat.com> <17A804F3-BEA6-46F4-887F-B68750618FD9@netapp.com> <0CF85443-26AC-4931-9D00-3396C18C7690@lurchi.franken.de> <7A4120EE-60F3-4D32-89C4-C694B8DFEAE4@netapp.com> <5E8A6382-7096-495A-907C-86CE26A163A2@lurchi.franken.de> <5D3CBFDC-362E-4DB6-A132-BA842EF5B1B2@lurchi.franken.de> In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: yes X-MS-TNEF-Correlator: x-mailer: Apple Mail (2.1878.6) x-originating-ip: [10.122.56.79] Content-Type: multipart/signed; boundary="Apple-Mail=_037FD837-EC43-4A48-9F0A-AA9B508B397E"; protocol="application/pgp-signature"; micalg=pgp-sha1 MIME-Version: 1.0 Cc: Michael Tuexen , John-Mark Gurney , Niu Zhixiong , Bill Yuan , "freebsd-net@freebsd.org" X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 12 Aug 2014 08:03:05 -0000 --Apple-Mail=_037FD837-EC43-4A48-9F0A-AA9B508B397E Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii Hi, On 2014-8-12, at 1:52, hiren panchasara = wrote: > On Mon, Aug 11, 2014 at 12:59 PM, Michael Tuexen > wrote: >> If I remember correctly, I increased >> kern.ipc.nmbufs and kern.ipc.nmbclusters in /boot/loader.conf >=20 > I believe, you just need to set kern.ipc.nmbclusters (max mbuf > clusters allowed) and kern.ipc.nmbufs (max mbufs allowed) should be > adjusted based on that. I bumped kern.ipc.nmbclusters by a factor of 100 (from 2036224 to = 203622400). As Hiren said, kern.ipc.nmbufs auto-adjusted (from 13031835 = to 205111860). However, I still see "requests for mbufs denied" immediately after = reboot. root@laurel:~ # netstat -m 12280/1580/13860 mbufs in use (current/cache/total) 12279/827/13106/203622400 mbuf clusters in use (current/cache/total/max) 12279/819 mbuf+clusters out of packet secondary zone in use = (current/cache) 0/3/3/1018111 4k (page size) jumbo clusters in use = (current/cache/total/max) 0/0/0/301662 9k jumbo clusters in use (current/cache/total/max) 0/0/0/169685 16k jumbo clusters in use (current/cache/total/max) 27628K/2061K/29689K bytes allocated to network (current/cache/total) 253/5481/12473 requests for mbufs denied (mbufs/clusters/mbuf+clusters) 0/0/0 requests for mbufs delayed (mbufs/clusters/mbuf+clusters) 0/0/0 requests for jumbo clusters delayed (4k/9k/16k) 0/0/0 requests for jumbo clusters denied (4k/9k/16k) 0 requests for sfbufs denied 0 requests for sfbufs delayed 0 requests for I/O initiated by sendfile I just noticed that the total "mbufs in use" didn't seem to have = increase when I did the 100x scaling of kern.ipc.nmbclusters (and = kern.ipc.nmbufs auto-adjusted). Neither did "bytes allocated to = network". Is that expected? Lars --Apple-Mail=_037FD837-EC43-4A48-9F0A-AA9B508B397E Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename="signature.asc" Content-Type: application/pgp-signature; name="signature.asc" Content-Description: Message signed with OpenPGP using GPGMail -----BEGIN PGP SIGNATURE----- iQCVAwUBU+nKM9ZcnpRveo1xAQJ2VwQAjfA/6j0hSNjq+2iTPE5xH2CRPFCKPY0z tT/REyB8OUKPmDyqD8Gt7RciOa4UHk+BEVrD3pGtM+WKW/pjNd0dumeUzrLhKBdx MG69c1PSr0ILhl2VY3Q7ObHZqhLwLswbi4ugCJH3D++BFIt1EU6Kka26oG8Kkyhu +S90EPhqZCE= =7rj+ -----END PGP SIGNATURE----- --Apple-Mail=_037FD837-EC43-4A48-9F0A-AA9B508B397E--