From owner-freebsd-net@freebsd.org Thu Jul 12 07:17:34 2018 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 23020103AE9B for ; Thu, 12 Jul 2018 07:17:34 +0000 (UTC) (envelope-from lars@netapp.com) Received: from mx65.netapp.com (mx65.netapp.com [IPv6:2620:10a:4003:8000:2306::e]) (using TLSv1.2 with cipher RC4-SHA (128/128 bits)) (Client CN "mx141.netapp.com", Issuer "Entrust Certification Authority - L1K" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 8297980EBC; Thu, 12 Jul 2018 07:17:33 +0000 (UTC) (envelope-from lars@netapp.com) X-IronPort-AV: E=Sophos;i="5.51,341,1526367600"; d="asc'?scan'208";a="28323156" Received: from vmwexchts03-prd.hq.netapp.com ([10.122.105.31]) by mx65-out.netapp.com with ESMTP; 12 Jul 2018 00:17:31 -0700 Received: from VMWEXCCAS02-PRD.hq.netapp.com (10.122.105.18) by VMWEXCHTS03-PRD.hq.netapp.com (10.122.105.31) with Microsoft SMTP Server (TLS) id 15.0.1367.3; Thu, 12 Jul 2018 00:17:28 -0700 Received: from NAM05-CO1-obe.outbound.protection.outlook.com (10.120.60.153) by VMWEXCCAS02-PRD.hq.netapp.com (10.122.105.18) with Microsoft SMTP Server (TLS) id 15.0.1367.3 via Frontend Transport; Thu, 12 Jul 2018 00:17:28 -0700 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=netapp.onmicrosoft.com; s=selector1-netapp-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=LbnUIECI35TDL+WHxGSQhDjwJMTVebQJbe7LMjIfyak=; b=INZi9P2Frm8PneBK3M9clNSF34uy5xUWL8JhozzhhrpXt365yw8/5A7ZRkjU59QsB0sM3O/0Ycp41ptjMlINsx+Akn3XMEcOo7PbpMTN1xORIXw8HdDelKcAapslF5oApKjJKx/wvnjEVltaI2K8gMjO7V+5UU6cAJSwSCVtcAA= Received: from MWHPR06MB2830.namprd06.prod.outlook.com (10.175.138.7) by MWHPR06MB2816.namprd06.prod.outlook.com (10.175.137.149) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.952.17; Thu, 12 Jul 2018 07:17:27 +0000 Received: from MWHPR06MB2830.namprd06.prod.outlook.com ([fe80::cc2d:b840:31a2:53d0]) by MWHPR06MB2830.namprd06.prod.outlook.com ([fe80::cc2d:b840:31a2:53d0%8]) with mapi id 15.20.0952.017; Thu, 12 Jul 2018 07:17:27 +0000 From: "Eggert, Lars" To: Navdeep Parhar CC: "freebsd-net@freebsd.org" , Giuseppe Lettieri Subject: Re: netmap & chelsio Thread-Topic: netmap & chelsio Thread-Index: AQHUFHIu6gR6TPNxhkmYOpx9+YLSkqSAxfoAgAD5+4CAAAn+gIAIXGKAgAAgJQCAAPFmAA== Date: Thu, 12 Jul 2018 07:17:27 +0000 Message-ID: References: <94019926-B14F-47AB-8AD9-C01B4A0E199F@netapp.com> <20180705154710.GA3353@ox> <0199F257-F9D2-41D0-B4F9-26FBA1607F61@netapp.com> <20180706071739.GA13401@ox> <30D2A259-6B2E-44CA-969D-F51F4D929DDE@netapp.com> In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: yes X-MS-TNEF-Correlator: x-mailer: Apple Mail (2.3445.9.1) authentication-results: spf=none (sender IP is ) smtp.mailfrom=lars@netapp.com; x-originating-ip: [217.70.211.15] x-ms-publictraffictype: Email x-microsoft-exchange-diagnostics: 1; MWHPR06MB2816; 7:K+stjSR6i+3dYg8s+0nRi7tccP22sKDhCs5BfgKlAY61q/NRO4TMIAhvbygUJ1PiM0yC0rgA3SaaWFmpRqWUCLkgDttF/IwWHNusaB+ohsXRak5yQS6VhYquhYIfqyY8P6eHQITeB8Dquh7+ZN0zoSryd39ELL312wDW2PY2MlPhOSAWR965BiYzw2VWi93G6p/PM5NEjhYkElVY6xaSfsMc6zn0WoCZj/LekGHSB1np2vslGzMF+dWHA8bD6mjQ x-ms-exchange-antispam-srfa-diagnostics: SOS; x-ms-office365-filtering-correlation-id: c62071c5-d808-4f3b-76dd-08d5e7c7861f x-microsoft-antispam: UriScan:; BCL:0; PCL:0; RULEID:(7020095)(4652040)(8989117)(5600053)(711020)(4534165)(4627221)(201703031133081)(201702281549075)(8990107)(2017052603328)(49563074)(7193020); SRVR:MWHPR06MB2816; x-ms-traffictypediagnostic: MWHPR06MB2816: x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:; x-ms-exchange-senderadcheck: 1 x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(8211001083)(102415395)(6040522)(2401047)(8121501046)(5005006)(93006095)(93001095)(3231311)(944501410)(52105095)(10201501046)(3002001)(6055026)(149027)(150027)(6041310)(20161123560045)(20161123562045)(201703131423095)(201702281528075)(20161123555045)(201703061421075)(201703061406153)(20161123558120)(20161123564045)(6072148)(201708071742011)(7699016); SRVR:MWHPR06MB2816; BCL:0; PCL:0; RULEID:; SRVR:MWHPR06MB2816; x-forefront-prvs: 0731AA2DE6 x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(136003)(39860400002)(376002)(396003)(366004)(346002)(199004)(189003)(68736007)(14454004)(8676002)(57306001)(11346002)(2616005)(6246003)(53936002)(476003)(446003)(86362001)(66066001)(2906002)(106356001)(105586002)(53546011)(93886005)(305945005)(26005)(6916009)(6506007)(478600001)(316002)(81156014)(5660300001)(54906003)(186003)(102836004)(76176011)(50226002)(2900100001)(97736004)(5250100002)(229853002)(4001150100001)(7736002)(3846002)(81166006)(6116002)(99936001)(6436002)(83716003)(25786009)(99286004)(4326008)(33656002)(6512007)(82746002)(486006)(14444005)(36756003)(8936002)(6486002)(256004); DIR:OUT; SFP:1101; SCL:1; SRVR:MWHPR06MB2816; H:MWHPR06MB2830.namprd06.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; A:1; MX:1; received-spf: None (protection.outlook.com: netapp.com does not designate permitted sender hosts) x-microsoft-antispam-message-info: WqqjDFWn8OIJWnJWmet1d4uV2UpqzEtMuqT42gG5ymBZKoxdBC0wri6ifEEr2T03JNOqVtzaZsgxNcKrsQO8UMvSru3z5epuJGFqZt3UzijG5U7+ohXRjpJtbts+hgPMqoyrCWhjPlDIMua/KTuT+ExjZPb0YavnNFKk6JCDOR9zX7ZeHBng5XEkmE/O3WKxdpMJrQ+Ooul58Z0ceDG6vBUIfVeUYO3kMKNXsvrCTTXp5bZPDYrL1zvwJ2lYiHyIH++cPnKEp4SSDmjAYyPqVGadclBDWmy17PjxEZEY4AsWFWwSIo09hWkqedCw+sVmvjqupM1UVz0aJ2v8jdFJwvYoqa0/Hw42R12e0pel5sg= spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM Content-Type: multipart/signed; boundary="Apple-Mail=_8088D43B-047C-45AC-BB96-101284DEC553"; protocol="application/pgp-signature"; micalg=pgp-sha512 MIME-Version: 1.0 X-MS-Exchange-CrossTenant-Network-Message-Id: c62071c5-d808-4f3b-76dd-08d5e7c7861f X-MS-Exchange-CrossTenant-originalarrivaltime: 12 Jul 2018 07:17:27.6529 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 4b0911a0-929b-4715-944b-c03745165b3a X-MS-Exchange-Transport-CrossTenantHeadersStamped: MWHPR06MB2816 X-OriginatorOrg: netapp.com X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 12 Jul 2018 07:17:34 -0000 --Apple-Mail=_8088D43B-047C-45AC-BB96-101284DEC553 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii Hi, On 2018-7-11, at 18:53, Navdeep Parhar wrote: > Try changing lazy_tx_credit_flush to 0 on the running kernel with a > debugger, or compile the driver with it set to 0 -- it's in = t4_netmap.c: >=20 > int lazy_tx_credit_flush =3D 1; thanks! With that, I get performance similar to the ixl cards on first = try. > I'm surprised I don't have a tunable/sysctl for it. I'll add one = really > soon. That would be useful! (Also useful would be some definite documentation on what all the loader = tunables are and what they do. But the current situation is already much = better than for the Intel cards, where esp. those that have been = iflib-ified seem to have completely undocumented tunables now.) General/unrelated suggestion: Could the kernel spit out a warning when = it encounters a loader tunable that doesn't do anything? That would = allow one to at least catch when tunables are renamed/changed. Lars --Apple-Mail=_8088D43B-047C-45AC-BB96-101284DEC553 Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename="signature.asc" Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP -----BEGIN PGP SIGNATURE----- iQIzBAEBCgAdFiEEmpq0ZpSoejRmyhheVLXDCb9wwVcFAltHAIYACgkQVLXDCb9w wVdoGxAA0lyKbOui4jb/F3ACJTMvuJTJLITq6VcXkdrtR4VpzuoB1MkNUXikCK6d Vdg9OJywJDBvk2j4hTOszxxgmmzmhsZANfXp3I4E/bMmZq8rAChhZSl8llcpZhYN TefiZ6u7gJSY9GCj0T5qMjyZfpDPkrp7HfuvkFQ5/0pSlfwanr0L4OonwVBsVG8S ksKXhXsaL3v977PbBwN0NNkHdvT/K+19n1tVVxMgiZaIb+NG0BbmYRT42MEI+pOg WZnDk8R8GfkTDAPQilNiTeAuyKPGqNKR06hKmO5AWedSC+2/wbCtRpyuEwm9eKnZ iKznr8Caxy9/Bgh+HdyeTMif5x3EZOP9XbuBjKeyHTDLAQgPmrLZNztbK+k6O47e R7v548MpdHqIAXBOu3b26jNASlSaE2NRnvJI7MbBaj67rNZ5Rfrp566IHdntSTlt 67S7Z0AcNYhAtJIzDDhraqXnAhXrP8nhJZG3zNAGLiLdnqiIxGLbrOOxLETIiEUb psf+qWDl3fRX89oo2mf9lsl25RcmcWQti13j0aDoo9RbFv86gB0nFq06S+KNaKgM gt5YYgK53kHfXkUTzDC9FII07yJ+YCZ+y8scsFDPQfT9SCrGs0fK9Xq9MdkHky+N 4yBMvROAzMdpnK6WUuJ/2NRheL/dnJOgq1SCdR0hSxKDfiCydCM= =ogZ5 -----END PGP SIGNATURE----- --Apple-Mail=_8088D43B-047C-45AC-BB96-101284DEC553--