From owner-freebsd-net@freebsd.org Sun Feb 12 15:28:39 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A9902CDB04A for ; Sun, 12 Feb 2017 15:28:39 +0000 (UTC) (envelope-from marlon@leerkotte.net) Received: from smtpq6.tb.mail.iss.as9143.net (smtpq6.tb.mail.iss.as9143.net [212.54.42.169]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 41374112A for ; Sun, 12 Feb 2017 15:28:38 +0000 (UTC) (envelope-from marlon@leerkotte.net) Received: from [212.54.42.133] (helo=smtp9.tb.mail.iss.as9143.net) by smtpq6.tb.mail.iss.as9143.net with esmtp (Exim 4.86_2) (envelope-from ) id 1ccvna-0001Cx-HM for freebsd-net@freebsd.org; Sun, 12 Feb 2017 16:10:46 +0100 Received: from 524bb5cc.cm-4-4c.dynamic.ziggo.nl ([82.75.181.204] helo=mail1.prd.chs.leerkotte.eu) by smtp9.tb.mail.iss.as9143.net with esmtp (Exim 4.86_2) (envelope-from ) id 1ccvna-0001Hi-CW for freebsd-net@freebsd.org; Sun, 12 Feb 2017 16:10:46 +0100 Received: from mail1.prd.chs.leerkotte.eu (unknown [192.168.25.13]) by mail1.prd.chs.leerkotte.eu (Postfix) with ESMTP id 9F21018494 for ; Sun, 12 Feb 2017 16:06:31 +0100 (CET) X-Virus-Scanned: amavisd-new at mail1.prd.chs.leerkotte.eu Received: from mail1.prd.chs.leerkotte.eu ([192.168.25.13]) by mail1.prd.chs.leerkotte.eu (mail1.prd.chs.leerkotte.eu [192.168.25.13]) (amavisd-new, port 10026) with ESMTP id xWYfbbJtsdMU for ; Sun, 12 Feb 2017 16:06:16 +0100 (CET) Received: from [192.168.15.4] (unknown [192.168.25.1]) by mail1.prd.chs.leerkotte.eu (Postfix) with ESMTPSA id 507FB1844A for ; Sun, 12 Feb 2017 16:06:16 +0100 (CET) From: Marlon Leerkotte Content-Type: multipart/signed; boundary="Apple-Mail=_7E006F21-DE41-4510-B130-8D42DEE5F776"; protocol="application/pkcs7-signature"; micalg=sha1 Mime-Version: 1.0 (Mac OS X Mail 10.2 \(3259\)) Subject: VNET/epair double MAC address Message-Id: <4DA494ED-4268-4175-A90A-485F5411F581@leerkotte.net> Date: Sun, 12 Feb 2017 16:10:29 +0100 To: freebsd-net@freebsd.org X-Mailer: Apple Mail (2.3259) X-SourceIP: 82.75.181.204 X-Ziggo-spambar: / X-Ziggo-spamscore: 0.0 X-Ziggo-spamreport: CMAE Analysis: v=2.2 cv=BuDt+cf5 c=1 sm=1 tr=0 a=VTE9ROBCqOTTQ6mp+QMKWQ==:17 a=n2v9WMKugxEA:10 a=KFrwfdwUAAAA:8 a=jU4qhlNgAAAA:8 a=rHPtwsbYujScA_xd2NsA:9 a=P13AkaGdf88URO5I:21 a=FqNpVFLESokvYSZ7:21 a=QEXdDO2ut3YA:10 a=uJKYerdC5U4A:10 a=pbc5cjdi493NrWEyVAEA:9 a=lI7FPseeUAW-PdoU:21 a=hvBiLtCZm_tGzmQF:21 a=LDfF46pGfIMSBtxA:21 a=_W_S_7VecoQA:10 a=HcRWRr9DcpmgsNamKLEA:9 a=usxJaLfvhCgA:10 a=tclcd6dtLQvEqt9_mmAA:9 a=CjuIK1q_8ugA:10 a=ynVhBjlY-JKCjlMmZoAA:9 a=RJv5WsVTvzoA:10 a=7awwJrVBp-Xw9p3fcJcA:9 a=ZVk8-NSrHBgA:10 a=XVXkndj2wIAA:10 a=oPO7haYCUhow2pK27QpY:22 a=Yzj368saxjB-0pgflKQk:22 none X-Ziggo-Spam-Status: No X-Spam-Status: No X-Spam-Flag: No X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 12 Feb 2017 15:28:39 -0000 --Apple-Mail=_7E006F21-DE41-4510-B130-8D42DEE5F776 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 Hi everyone, I have been using jails with VNET since about 10.1 or 10 and have so far = not encountered any huge problems except for accidentally giving two = jails the same epair which broke my stack. But today I did encounter a = problem. The problem i encountered was where one of my jails would lose all = connectivity when starting another jail, after some investigation it = turned out that both jails had the same MAC address. I=E2=80=99m not = aware of how these MAC addresses are generated but this seems to be a = bug, as I=E2=80=99m not manually assigning MAC address. In the attachments you will find my jail.conf and the ifconfig output of = both jails. I hope someone can help me with this and/or give me some insight as to = how the addresses are generated. Regards, Marlon Leerkotte M.R. Leerkotte Mail: marlon@leerkotte.net LinkedIn: www.linkedin.com/in/MarlonLeerkotte = --Apple-Mail=_7E006F21-DE41-4510-B130-8D42DEE5F776 Content-Disposition: attachment; filename=smime.p7s Content-Type: application/pkcs7-signature; name=smime.p7s Content-Transfer-Encoding: base64 MIAGCSqGSIb3DQEHAqCAMIACAQExCzAJBgUrDgMCGgUAMIAGCSqGSIb3DQEHAQAAoIIJ9jCCBK8w ggOXoAMCAQICEQDgI8sVEoNTia1hbnpUZ2shMA0GCSqGSIb3DQEBCwUAMG8xCzAJBgNVBAYTAlNF MRQwEgYDVQQKEwtBZGRUcnVzdCBBQjEmMCQGA1UECxMdQWRkVHJ1c3QgRXh0ZXJuYWwgVFRQIE5l dHdvcmsxIjAgBgNVBAMTGUFkZFRydXN0IEV4dGVybmFsIENBIFJvb3QwHhcNMTQxMjIyMDAwMDAw WhcNMjAwNTMwMTA0ODM4WjCBmzELMAkGA1UEBhMCR0IxGzAZBgNVBAgTEkdyZWF0ZXIgTWFuY2hl c3RlcjEQMA4GA1UEBxMHU2FsZm9yZDEaMBgGA1UEChMRQ09NT0RPIENBIExpbWl0ZWQxQTA/BgNV BAMTOENPTU9ETyBTSEEtMjU2IENsaWVudCBBdXRoZW50aWNhdGlvbiBhbmQgU2VjdXJlIEVtYWls IENBMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAibEN2npTGU5wUh28VqYGJre4SeCW 51Gr8fBaE0kVo7SMG2C8elFCp3mMpCLfF2FOkdV2IwoU00oCf7YdCYBupQQ92bq7Fv6hh6kuQ1JD FnyvMlDIpk9a6QjYz5MlnHuI6DBk5qT4VoD9KiQUMxeZrETlaYujRgZLwjPU6UCfBrCxrJNAubUI kzqcKlOjENs9IGE8VQOO2U52JQIhKfqjfHF2T+7hX4Hp+1SA28N7NVK3hN4iPSwwLTF/Wb1SN7Az aS1D6/rWpfGXd2dRjNnuJ+u8pQc4doykqTj/34z1A6xJvsr3c5k6DzKrnJU6Ez0ORjpXdGFQvsZA P8vk4p+iIQIDAQABo4IBFzCCARMwHwYDVR0jBBgwFoAUrb2YejS0Jvf6xCZU7wO94CTLVBowHQYD VR0OBBYEFJJha4LhoqCqT+xn8cKj97SAAMHsMA4GA1UdDwEB/wQEAwIBhjASBgNVHRMBAf8ECDAG AQH/AgEAMB0GA1UdJQQWMBQGCCsGAQUFBwMCBggrBgEFBQcDBDARBgNVHSAECjAIMAYGBFUdIAAw RAYDVR0fBD0wOzA5oDegNYYzaHR0cDovL2NybC51c2VydHJ1c3QuY29tL0FkZFRydXN0RXh0ZXJu YWxDQVJvb3QuY3JsMDUGCCsGAQUFBwEBBCkwJzAlBggrBgEFBQcwAYYZaHR0cDovL29jc3AudXNl cnRydXN0LmNvbTANBgkqhkiG9w0BAQsFAAOCAQEAGypurFXBOquIxdjtzVXzqmthK8AJECOZD8Vm am+x9bS1d14PAmEA330F/hKzpICAAPz7HVtqcgIKQbwFusFY1SbC6tVNhPv+gpjPWBvjImOcUvi7 BTarfVil3qs7Y+Xa1XPv7OD7e+Kj//BCI5zKto1NPuRLGAOyqC3U2LtCS5BphRDbpjc06HvgARCl nMo6x59PiDRuimXQGoq7qdzKyjbR9PzCZCk1r9axp3ER0gNDsY8+muyeMlP0dpLKhjQHuSzK5hxK 2JkNwYbikJL7WkJqIyEQ6WXH9dW7fuqMhSACYurROgcsWcWZM/I4ieW26RZ6H3kU9koQGib6fIr7 mzCCBT8wggQnoAMCAQICEFLR649kssn8ONczZB1bxN4wDQYJKoZIhvcNAQELBQAwgZsxCzAJBgNV BAYTAkdCMRswGQYDVQQIExJHcmVhdGVyIE1hbmNoZXN0ZXIxEDAOBgNVBAcTB1NhbGZvcmQxGjAY BgNVBAoTEUNPTU9ETyBDQSBMaW1pdGVkMUEwPwYDVQQDEzhDT01PRE8gU0hBLTI1NiBDbGllbnQg QXV0aGVudGljYXRpb24gYW5kIFNlY3VyZSBFbWFpbCBDQTAeFw0xNjEyMDUwMDAwMDBaFw0xNzEy MDUyMzU5NTlaMCUxIzAhBgkqhkiG9w0BCQEWFG1hcmxvbkBsZWVya290dGUubmV0MIIBIjANBgkq hkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEA1lDXeLSsgb91gqmuF6wO4JRnrzKdxT7kE5K0QU5FOMzX t+kzxKti1Zp7DIT37MOqIQZq/t4qm0zySzCbvKdT4mK8mfWzoj5J3Z7F2Fv6ZjgkyAsUcoH1FHM2 kfbIsNNJ+p4yyJacph/79RE7VVjr2SabHhcoC86gxs8nQdlwmLeR2H+LkONILyuoa1hVELfg+q7O T2T39h2lA66uY2sZQfkajBw9dU4DnTUAKp43dwzyVaFLA3UsBlQ/8UGzkLVcahUU0CDMtNLAiROl q9miOkc8aRVHJbTl/lUBF8MHc42qGKG+NN8o2J+NQjO0PyGKV/s7Uhp4ADtXIXm5FO47KwIDAQAB o4IB8jCCAe4wHwYDVR0jBBgwFoAUkmFrguGioKpP7GfxwqP3tIAAwewwHQYDVR0OBBYEFDFr03lE 0CnD38Gr7QeqSSDV27ItMA4GA1UdDwEB/wQEAwIFoDAMBgNVHRMBAf8EAjAAMCAGA1UdJQQZMBcG CCsGAQUFBwMEBgsrBgEEAbIxAQMFAjARBglghkgBhvhCAQEEBAMCBSAwRgYDVR0gBD8wPTA7Bgwr BgEEAbIxAQIBAQEwKzApBggrBgEFBQcCARYdaHR0cHM6Ly9zZWN1cmUuY29tb2RvLm5ldC9DUFMw XQYDVR0fBFYwVDBSoFCgToZMaHR0cDovL2NybC5jb21vZG9jYS5jb20vQ09NT0RPU0hBMjU2Q2xp ZW50QXV0aGVudGljYXRpb25hbmRTZWN1cmVFbWFpbENBLmNybDCBkAYIKwYBBQUHAQEEgYMwgYAw WAYIKwYBBQUHMAKGTGh0dHA6Ly9jcnQuY29tb2RvY2EuY29tL0NPTU9ET1NIQTI1NkNsaWVudEF1 dGhlbnRpY2F0aW9uYW5kU2VjdXJlRW1haWxDQS5jcnQwJAYIKwYBBQUHMAGGGGh0dHA6Ly9vY3Nw LmNvbW9kb2NhLmNvbTAfBgNVHREEGDAWgRRtYXJsb25AbGVlcmtvdHRlLm5ldDANBgkqhkiG9w0B AQsFAAOCAQEAR/Cf8Qr6rGqUS6OGQAAhqUR88kOLGtipJs5SKyk68sMXdPUmsPR7QdRgw0iTREr+ kboAUfXInd5sa5iRZphfQ5Z7MHTJZJWhD3XMCrBwPq/3OHTWE1RFC0OROk1iNmdwKjxFSsUChu54 GmwZTcbF/qiW/Uzq0i/YsBXGneN4T7kAeSu9FXD3WnnTtEsEYw4lEU9oYUgbbuZ7VxvS/cIxYSRR HqN9RaD5bSnrYWQIJhCSR1qv++o27dLKII+zffjvsVALI9pYBILAtejOMIRie7o05VhaNq8//AKp T6G86cCmXjuwBd9fqFR8W8h2+wrGTqe6l75YfGr4/08IyYXamDGCA8MwggO/AgEBMIGwMIGbMQsw CQYDVQQGEwJHQjEbMBkGA1UECBMSR3JlYXRlciBNYW5jaGVzdGVyMRAwDgYDVQQHEwdTYWxmb3Jk MRowGAYDVQQKExFDT01PRE8gQ0EgTGltaXRlZDFBMD8GA1UEAxM4Q09NT0RPIFNIQS0yNTYgQ2xp ZW50IEF1dGhlbnRpY2F0aW9uIGFuZCBTZWN1cmUgRW1haWwgQ0ECEFLR649kssn8ONczZB1bxN4w CQYFKw4DAhoFAKCCAecwGAYJKoZIhvcNAQkDMQsGCSqGSIb3DQEHATAcBgkqhkiG9w0BCQUxDxcN MTcwMjEyMTUxMDI5WjAjBgkqhkiG9w0BCQQxFgQUsVf684xFWa7tNOr6wWZSf6e40j0wgcEGCSsG AQQBgjcQBDGBszCBsDCBmzELMAkGA1UEBhMCR0IxGzAZBgNVBAgTEkdyZWF0ZXIgTWFuY2hlc3Rl cjEQMA4GA1UEBxMHU2FsZm9yZDEaMBgGA1UEChMRQ09NT0RPIENBIExpbWl0ZWQxQTA/BgNVBAMT OENPTU9ETyBTSEEtMjU2IENsaWVudCBBdXRoZW50aWNhdGlvbiBhbmQgU2VjdXJlIEVtYWlsIENB AhBS0euPZLLJ/DjXM2QdW8TeMIHDBgsqhkiG9w0BCRACCzGBs6CBsDCBmzELMAkGA1UEBhMCR0Ix GzAZBgNVBAgTEkdyZWF0ZXIgTWFuY2hlc3RlcjEQMA4GA1UEBxMHU2FsZm9yZDEaMBgGA1UEChMR Q09NT0RPIENBIExpbWl0ZWQxQTA/BgNVBAMTOENPTU9ETyBTSEEtMjU2IENsaWVudCBBdXRoZW50 aWNhdGlvbiBhbmQgU2VjdXJlIEVtYWlsIENBAhBS0euPZLLJ/DjXM2QdW8TeMA0GCSqGSIb3DQEB AQUABIIBAAXB59LEvBSEK66UnNP9VBDVnNpFlHrK/1L5SRnJ+zl8ezW052dLDdshBVvTo+3lTEho goQQm3bmu95fZyy5pbt/Mw7g+rmtFoz9RynD8mqeyTMbjPOWcIqvCKRC0FYXc0ihRE4Okej8epQj 39N2r2ObsACqrS/hUHiyR2yG9fo8BKwKlVGvYG/ifjgVnn47vSJhh7U38pZZtTehN3s0yKhP4/VP QDFaAMQaM14PWVcpYnPm9ShsHkA8SliIjIEh8YdeezizugJF5wVFIFNBrHhw+3qwVGUDD2gbdvdJ 6PS7E0iXi6FgO4gNjqzWFOkgu4PNmAiQvzmgKpQROPBLPNkAAAAAAAA= --Apple-Mail=_7E006F21-DE41-4510-B130-8D42DEE5F776-- From owner-freebsd-net@freebsd.org Sun Feb 12 16:28:30 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id ECE0CCDC4CA for ; Sun, 12 Feb 2017 16:28:30 +0000 (UTC) (envelope-from herbert@mailbox.org) Received: from mx2.mailbox.org (mx2.mailbox.org [80.241.60.215]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.mailbox.org", Issuer "SwissSign Server Silver CA 2014 - G22" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id B58D511DE for ; Sun, 12 Feb 2017 16:28:30 +0000 (UTC) (envelope-from herbert@mailbox.org) Received: from smtp1.mailbox.org (smtp1.mailbox.org [80.241.60.240]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mx2.mailbox.org (Postfix) with ESMTPS id 2AA5344402 for ; Sun, 12 Feb 2017 17:28:22 +0100 (CET) X-Virus-Scanned: amavisd-new at heinlein-support.de Received: from smtp1.mailbox.org ([80.241.60.240]) by spamfilter02.heinlein-hosting.de (spamfilter02.heinlein-hosting.de [80.241.56.116]) (amavisd-new, port 10030) with ESMTP id 20MG4C4cqVsV for ; Sun, 12 Feb 2017 17:28:15 +0100 (CET) Date: Sun, 12 Feb 2017 17:28:13 +0100 Message-ID: <86fujj9xwi.wl-herbert@mailbox.org> From: "Herbert J. Skuhra" To: freebsd-net@freebsd.org Subject: Re: VNET/epair double MAC address In-Reply-To: <4DA494ED-4268-4175-A90A-485F5411F581@leerkotte.net> References: <4DA494ED-4268-4175-A90A-485F5411F581@leerkotte.net> MIME-Version: 1.0 (generated by SEMI-EPG 1.14.7 - "Harue") Content-Type: text/plain; charset=ISO-8859-7 Content-Transfer-Encoding: quoted-printable X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 12 Feb 2017 16:28:31 -0000 Marlon Leerkotte skrev: > = > Hi everyone, > I have been using jails with VNET since about 10.1 or 10 and have so > far not encountered any huge problems except for accidentally giving > two jails the same epair which broke my stack. But today I did > encounter a problem. > = > The problem i encountered was where one of my jails would lose all > connectivity when starting another jail, after some investigation it > turned out that both jails had the same MAC address. I=A2m not aware > of how these MAC addresses are generated but this seems to be a bug, > as I=A2m not manually assigning MAC address. > = > In the attachments you will find my jail.conf and the ifconfig > output of both jails. I hope someone can help me with this and/or > give me some insight as to how the addresses are generated. -- Herbert From owner-freebsd-net@freebsd.org Sun Feb 12 21:00:37 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id AC91BCDC409 for ; Sun, 12 Feb 2017 21:00:37 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 9E9B219E8 for ; Sun, 12 Feb 2017 21:00:37 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v1CL010J054782 for ; Sun, 12 Feb 2017 21:00:37 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <201702122100.v1CL010J054782@kenobi.freebsd.org> From: bugzilla-noreply@FreeBSD.org To: freebsd-net@FreeBSD.org Subject: Problem reports for freebsd-net@FreeBSD.org that need special attention Date: Sun, 12 Feb 2017 21:00:37 +0000 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 12 Feb 2017 21:00:37 -0000 To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- In Progress | 165622 | [ndis][panic][patch] Unregistered use of FPU in k In Progress | 203422 | mpd/ppoe not working with re(4) with revision 285 In Progress | 206581 | bxe_ioctl_nvram handler is faulty New | 204438 | setsockopt() handling of kern.ipc.maxsockbuf limi New | 205592 | TCP processing in IPSec causes kernel panic New | 206053 | kqueue support code of netmap causes panic New | 213410 | [carp] service netif restart causes hang only whe New | 215874 | [patch] [icmp] [mbuf_tags] teach icmp_error() opt Open | 148807 | [panic] "panic: sbdrop" and "panic: sbsndptr: soc Open | 193452 | Dell PowerEdge 210 II -- Kernel panic bce (broadc Open | 194485 | Userland cannot add IPv6 prefix routes Open | 194515 | Fatal Trap 12 Kernel with vimage Open | 199136 | [if_tap] Added down_on_close sysctl variable to t Open | 202510 | [CARP] advertisements sourced from CARP IP cause Open | 206544 | sendmsg(2) (sendto(2) too?) can fail with EINVAL; Open | 211031 | [panic] in ng_uncallout when argument is NULL Open | 211962 | bxe driver queue soft hangs and flooding tx_soft_ Open | 212018 | Enable IPSEC_NAT_T in GENERIC kernel configuratio 18 problems total for which you should take action. From owner-freebsd-net@freebsd.org Mon Feb 13 12:43:32 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B5866CD1E63 for ; Mon, 13 Feb 2017 12:43:32 +0000 (UTC) (envelope-from Stefan.Thiel@flynt.io) Received: from mail.scaling.ch (mail.scaling.ch [195.182.53.83]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 7AC3D6BF for ; Mon, 13 Feb 2017 12:43:32 +0000 (UTC) (envelope-from Stefan.Thiel@flynt.io) Received: from scinchvirs03.sc.scaling.ch (scinchvirs03.sc.scaling.ch [10.7.2.3]) by mail.scaling.ch (Postfix) with ESMTPS id 794684A6 for ; Mon, 13 Feb 2017 13:43:23 +0100 (CET) Received: from scinchvirs03.sc.scaling.ch (10.7.2.3) by scinchvirs03.sc.scaling.ch (10.7.2.3) with Microsoft SMTP Server (TLS) id 15.0.1044.25; Mon, 13 Feb 2017 13:43:23 +0100 Received: from scinchvirs03.sc.scaling.ch ([::1]) by scinchvirs03.sc.scaling.ch ([::1]) with mapi id 15.00.1044.021; Mon, 13 Feb 2017 13:43:23 +0100 From: Stefan Thiel To: "freebsd-net@freebsd.org" Subject: Re: netif restart on VMWare loses carp Thread-Topic: netif restart on VMWare loses carp Thread-Index: AQHShfbDxF6jT/3LQEK6tWzTx8B4xQ== Date: Mon, 13 Feb 2017 12:43:23 +0000 Message-ID: Accept-Language: en-US, de-CH Content-Language: en-GB X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-exchange-transport-fromentityheader: Hosted x-originating-ip: [195.182.53.78] Content-Type: text/plain; charset="utf-8" Content-ID: <8098819FFF63A8429798F9EC035DD504@scaling.ch> Content-Transfer-Encoding: base64 MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 13 Feb 2017 12:43:32 -0000 DQpTYW1lIHByb2JsZW0gaXMgcmVwcm9kdWNpYmxlIG9uIFZpcnR1YWxCb3guIEN1cnJlbnQgZmFj dHMgc28gZmFyIGZvciBsb3Npbmcg4oCcY2FycCBvbiDigJhuZXRpZiByZXN0YXJ04oCZ4oCdDQot IE9ubHkgdmlydHVhbGl6ZWQgZW52IChWTVdhcmUgRVNYaSA2LCBWQm94IOKAkyBjdXJyZW50IHZl cnNpb247IG5vdCByZXByb2R1Y2VkIG9uIGEgUEMgZW5naW5lIGhhcmR3YXJlKQ0KLSBDYXJwIHdp dGggVkxBTiBhbGlhc2VzDQoNCknigJltIHN0aWxsIG5vdCBzdXJlIHdoYXQgY29tcG9uZW50IGlz IHJlc3BvbnNpYmxlLCBidXQgc2VlaW5nIHRoZSBzYW1lIGlzc3VlIG9uIFZNV2FyZSBhbmQgVkJv eCBpcyBpbmRpY2F0aW5nIHRvIGxvb2sgZm9yIGEgYnVnIG9uIHRoZSBGcmVlQlNEIHNpZGUg4oCm IG1heWJlIG9wZW4tdm0tdG9vbHMgTklDIGRyaXZlcnMgYmVoYXZpbmcgZGlmZmVyZW50bHkgdGhl biB0aGUgaGFyZHdhcmUgTklDIGRyaXZlcnMgd2UgdGVzdGVkPw0KDQpzdGVmDQoNCg== From owner-freebsd-net@freebsd.org Mon Feb 13 23:26:56 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0646BCDE278; Mon, 13 Feb 2017 23:26:56 +0000 (UTC) (envelope-from David.Somayajulu@cavium.com) Received: from NAM02-CY1-obe.outbound.protection.outlook.com (mail-cys01nam02on0056.outbound.protection.outlook.com [104.47.37.56]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "Microsoft IT SSL SHA2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id B34DA19D1; Mon, 13 Feb 2017 23:26:55 +0000 (UTC) (envelope-from David.Somayajulu@cavium.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=CAVIUMNETWORKS.onmicrosoft.com; s=selector1-cavium-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=CjqdGGE0i3wiEdWP0iDkCIvuiVJVv7aAxwcE+59OBEM=; b=R4S191ONjZtukqPogRnq//ueziloSW5kZsnKqLRS6nvwFm1Xt2o4azmlkuIGHo3jwzKIcR1k/h/k+qbh7IA5KuwsBrmpprMHq8Gy3MGHK9Im9PxxktMVK2CIYKmm41EIkI5JznOS4znUuGsQx6EVcy1zOFsDmTMrzR1PEwgoj9E= Received: from BY2PR07MB1474.namprd07.prod.outlook.com (10.162.76.152) by BY2PR07MB1473.namprd07.prod.outlook.com (10.162.76.151) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P384) id 15.1.888.16; Mon, 13 Feb 2017 23:26:53 +0000 Received: from BY2PR07MB1474.namprd07.prod.outlook.com ([10.162.76.152]) by BY2PR07MB1474.namprd07.prod.outlook.com ([10.162.76.152]) with mapi id 15.01.0888.030; Mon, 13 Feb 2017 23:26:53 +0000 From: "Somayajulu, David" To: "freebsd-net@freebsd.org" , "freebsd-drivers@freebsd.org" Subject: Question on contrib/ofed Thread-Topic: Question on contrib/ofed Thread-Index: AdKGT/PGyDysVA+hR0+DVREGuoDXSg== Date: Mon, 13 Feb 2017 23:26:52 +0000 Message-ID: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: spf=none (sender IP is ) smtp.mailfrom=David.Somayajulu@cavium.com; x-originating-ip: [198.186.0.2] x-ms-office365-filtering-correlation-id: bab8199e-1471-432a-5a8d-08d45467cb13 x-microsoft-antispam: UriScan:;BCL:0;PCL:0;RULEID:(22001);SRVR:BY2PR07MB1473; x-microsoft-exchange-diagnostics: 1; BY2PR07MB1473; 7:oywMnDtzPjMJ76gfsIFN7FMHo89MTGc+TEJEtqXyjRxY2gMfGolUPnEEZSbK0xq/B4ZuHcXTDUVkDNrO2dWu7/AZjDN4tSeptDUgxcx0kFCH2ESSEccZ8VyZNWSs7x7X2JG29OzAKGOfQHH9h9HXOYIk0ch6WvSnSTTH0nnlXCueDou+WRcrUTjg22Hz6SNrnQxDxj71vToO2Z8vRY0pCAwc7qVYWE9wzPe8mLGj74EqZV1VEzLQ4ZwJYKyVk5xtFA966Nag/+SE7931K7vWMULKE0Bg7aq4aNG3BofnA3L5vZPRdgin/Bw/GmiwjbeggTKhnmHNG6ezqtZ6hJkfzYxyys3Xfa1YODQZCNwbyluwyhh2GU6RuBD13Y/QlzTamcTz5+tRLxIKP700w0yvUJ3QxXDk1cS7ZYRv5QObHjgz1OtT1x/JEf2HikUXA/8XZEENsXpo4gxRN71rmkvloE57aOwqwBHAjCfJSB+PMrY1+kA7cieJGbWZi/NZA+Sg/DK1f62xdphwGXrJas0PFg== x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:(21748063052155); x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(6040375)(601004)(2401047)(8121501046)(5005006)(3002001)(10201501046)(6041248)(20161123560025)(20161123562025)(20161123558025)(20161123555025)(20161123564025)(6072148); SRVR:BY2PR07MB1473; BCL:0; PCL:0; RULEID:; SRVR:BY2PR07MB1473; x-forefront-prvs: 02176E2458 x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(7916002)(39450400003)(189002)(199003)(53754006)(9686003)(2900100001)(92566002)(2501003)(74316002)(66066001)(106356001)(450100001)(68736007)(105586002)(7696004)(86362001)(38730400002)(3280700002)(3660700001)(5660300001)(7736002)(99286003)(55016002)(77096006)(122556002)(6436002)(6506006)(236005)(54896002)(6306002)(790700001)(102836003)(25786008)(33656002)(3846002)(6116002)(81166006)(53936002)(8676002)(81156014)(97736004)(189998001)(9326002)(8936002)(101416001)(50986999)(2906002)(54356999)(81003); DIR:OUT; SFP:1101; SCL:1; SRVR:BY2PR07MB1473; H:BY2PR07MB1474.namprd07.prod.outlook.com; FPR:; SPF:None; PTR:InfoNoRecords; MX:1; A:1; LANG:en; received-spf: None (protection.outlook.com: cavium.com does not designate permitted sender hosts) spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM MIME-Version: 1.0 X-OriginatorOrg: cavium.com X-MS-Exchange-CrossTenant-originalarrivaltime: 13 Feb 2017 23:26:52.8834 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 711e4ccf-2e9b-4bcf-a551-4094005b6194 X-MS-Exchange-Transport-CrossTenantHeadersStamped: BY2PR07MB1473 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 13 Feb 2017 23:26:56 -0000 Hi All, I have been trying building the OFED user mode libraries/apps in FreeBSD11 = and have not been successful (please see below). Are there any configure/s= et up commands that need to be run ? I would appreciate any help. Thanks David S. (davidcs@freebsd.org) =3D=3D=3D=3D [/usr/src/contrib/ofed]# make =3D=3D=3D> include (all) =3D=3D=3D> include/infiniband (all) Warning: Object directory not changed from original /usr/src/contrib/ofed/i= nclude/infiniband =3D=3D=3D> include/rdma (all) Warning: Object directory not changed from original /usr/src/contrib/ofed/i= nclude/rdma =3D=3D=3D> usr.lib (all) =3D=3D=3D> usr.lib/libibcommon (all) Warning: Object directory not changed from original /usr/src/contrib/ofed/u= sr.lib/libibcommon =3D=3D=3D> usr.lib/libibumad (all) make[2]: "/usr/src/share/mk/src.libnames.mk" line 557: /usr/src/contrib/ofe= d/usr.lib/libibumad: Invalid LIBADD used which may need to be added to src.= libnames.mk: ibcommon *** Error code 1 Stop. make[1]: stopped in /usr/src/contrib/ofed/usr.lib *** Error code 1 Stop. =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D T From owner-freebsd-net@freebsd.org Tue Feb 14 00:32:03 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id EE863CDC3DF for ; Tue, 14 Feb 2017 00:32:03 +0000 (UTC) (envelope-from olivier@freebsd.org) Received: from smtp.smtpout.orange.fr (smtp11.smtpout.orange.fr [80.12.242.133]) by mx1.freebsd.org (Postfix) with ESMTP id 6357C1978 for ; Tue, 14 Feb 2017 00:32:02 +0000 (UTC) (envelope-from olivier@freebsd.org) Received: from mail-yb0-f179.google.com ([209.85.213.179]) by mwinf5d34 with ME id kQQL1u00Q3so46h03QQMw7; Tue, 14 Feb 2017 01:24:21 +0100 X-ME-Helo: mail-yb0-f179.google.com X-ME-Auth: Y29jaGFyZC1sYWJiZS5vbGl2aWVyQG9yYW5nZS5mcg== X-ME-Date: Tue, 14 Feb 2017 01:24:21 +0100 X-ME-IP: 209.85.213.179 Received: by mail-yb0-f179.google.com with SMTP id 123so31629636ybe.3 for ; Mon, 13 Feb 2017 16:24:21 -0800 (PST) X-Gm-Message-State: AMke39n1rMy+y8gdSyttwKqJGWMV1PfClEM9O0mHUc8unDmB4SUyNY2zWqLa22Cip04AaCCzTmNjjSirmLqWJQ== X-Received: by 10.37.170.166 with SMTP id t35mr18204475ybi.86.1487031860070; Mon, 13 Feb 2017 16:24:20 -0800 (PST) MIME-Version: 1.0 Received: by 10.37.228.68 with HTTP; Mon, 13 Feb 2017 16:23:59 -0800 (PST) From: =?UTF-8?Q?Olivier_Cochard=2DLabb=C3=A9?= Date: Tue, 14 Feb 2017 01:23:59 +0100 X-Gmail-Original-Message-ID: Message-ID: Subject: How to enable ECMP flow based forwarding ? To: "freebsd-net@freebsd.org" Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 14 Feb 2017 00:32:04 -0000 Hi, I'm testing FreeBSD ECMP behavior by adding "options RADIX_MPATH" to my kernel configuration (11-stable). Now I can configure two identical routes toward 2 different next-hop: First step achieved :-) But it uses only the first entry and never uses the second one. I've tried to shutdown the first next-hop router (then no more arp-reply from this next-hop): But the ECMP FreeBSD router sticks to its first route entry and never try the second entry :-( Is there something else to enable (like RSS?) for having a real ECMP flow based router ? Thanks, From owner-freebsd-net@freebsd.org Tue Feb 14 01:52:46 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6DF64CDDBFF for ; Tue, 14 Feb 2017 01:52:46 +0000 (UTC) (envelope-from jmk@wagsky.com) Received: from bmx.allycomm.com (bmx.allycomm.com [198.199.108.230]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 6222F151D for ; Tue, 14 Feb 2017 01:52:45 +0000 (UTC) (envelope-from jmk@wagsky.com) Received: from jkletsky1-mbp15.guidewire.com (inet.guidewire.com [199.91.42.30]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by bmx.allycomm.com (Postfix) with ESMTPSA id F3EE3D78B0; Mon, 13 Feb 2017 17:47:07 -0800 (PST) To: freebsd-net@freebsd.org From: Jeff Kletsky Subject: VNET / netgraph jails -- Locking down? Message-ID: Date: Mon, 13 Feb 2017 17:47:07 -0800 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.11; rv:45.0) Gecko/20100101 Thunderbird/45.7.1 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 14 Feb 2017 01:52:46 -0000 For several years I've been using netgraph to provide connectivity for "service hosts" in jails on a "jail server" Since I'm finally getting the jail server off FreeBSD 9 and solidly onto 11, I've got the chance to rewrite the scripting of how I'm handling jail connectivity and am hoping that I can lock things down a bit better than what I have presently. The approach I use looks similar to that now in the jail examples. Basically /---> ng_eiface_jail1 real_interface = ng_ether <---> ng_bridge <---> ng_eiface_jail2 \---> ng_eiface_jail3 While this works well, it concerns me that the real interface has to be in promiscuous mode (and have autosrc off). If one of the service jails is "taken over" then there isn't a way that I know of to lock out changing the IP address of the interface it has, or potentially gaining access to another VLAN through creation of a cloned interface, especially if the bridge is off the parent interface, not off a VLAN interface. How do people manage this in practice when the jail has the risk of compromise? I prefer approaches where the jail's notion of it's own IP address is the same as that of other hosts connecting to it, at least within my own little private-address-space world. One thing that I've been considering is: * Configure the jail's IP on the real interface (or appropriate VLAN interface) as an alias * Send packets through ng_ipfw to an ng_eiface that the jail gets, using ipfw and a lookup table * Tag the packets on return with ng_tag with a unique identifier for that jail's interface so ipfw can tell the only acceptable source IP * Deny any so-tagged packets that don't have the proper source address (jail ID by itself is not enough for the outbound packets, as some of the jails are dual homed.) Has anyone tried this kind of method? Any other/better suggestions? Would ng_ip_input be the appropriate way to "send" the packets coming from the jail? Thanks! Jeff From owner-freebsd-net@freebsd.org Tue Feb 14 06:29:06 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9ACECCD13F6; Tue, 14 Feb 2017 06:29:06 +0000 (UTC) (envelope-from hps@selasky.org) Received: from mail.turbocat.net (turbocat.net [IPv6:2a01:4f8:c17:6c4b::2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 673B214BE; Tue, 14 Feb 2017 06:29:06 +0000 (UTC) (envelope-from hps@selasky.org) Received: from hps2016.home.selasky.org (unknown [62.141.129.119]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by mail.turbocat.net (Postfix) with ESMTPSA id A38C31FE025; Tue, 14 Feb 2017 07:28:52 +0100 (CET) Subject: Re: Question on contrib/ofed To: "Somayajulu, David" , "freebsd-net@freebsd.org" , "freebsd-drivers@freebsd.org" References: From: Hans Petter Selasky Message-ID: Date: Tue, 14 Feb 2017 07:28:23 +0100 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:45.0) Gecko/20100101 Thunderbird/45.4.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 14 Feb 2017 06:29:06 -0000 On 02/14/17 00:26, Somayajulu, David wrote: > Hi All, > I have been trying building the OFED user mode libraries/apps in FreeBSD11 and have not been successful (please see below). Are there any configure/set up commands that need to be run ? > > I would appreciate any help. Try to add: WITH_OFED=YES To the make comment. --HPS From owner-freebsd-net@freebsd.org Tue Feb 14 09:32:05 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 57E71CDC973 for ; Tue, 14 Feb 2017 09:32:05 +0000 (UTC) (envelope-from auryn@zirakzigil.org) Received: from mx1.etoilesoft.fr (mx1.etoilesoft.fr [52.57.51.18]) by mx1.freebsd.org (Postfix) with ESMTP id 2239A1A4C for ; Tue, 14 Feb 2017 09:32:04 +0000 (UTC) (envelope-from auryn@zirakzigil.org) Received: from mx1.etoilesoft.fr (localhost [127.0.0.1]) by mx1.etoilesoft.fr (Postfix) with ESMTP id 2BCB89D1A2; Tue, 14 Feb 2017 09:26:58 +0000 (UTC) Received: from [10.1.1.206] (localhost [127.0.0.1]) (Authenticated sender: auryn@zirakzigil.org) by mx1.etoilesoft.fr (Postfix) with ESMTPA id EC2A59D19F; Tue, 14 Feb 2017 09:26:57 +0000 (UTC) Subject: Re: Duplicate MAC addresses in VNET epair interaces To: "Bjoern A. Zeeb" , "freebsd-net@freebsd.org" References: <472069af-0f9d-d830-064b-2d984a5774ae@zirakzigil.org> <8B1A6A6C-4280-4B96-9D60-FC9E7EEE2222@lists.zabbadoz.net> From: Giulio Ferro Message-ID: Date: Tue, 14 Feb 2017 10:26:27 +0100 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:45.0) Gecko/20100101 Thunderbird/45.7.0 MIME-Version: 1.0 In-Reply-To: <8B1A6A6C-4280-4B96-9D60-FC9E7EEE2222@lists.zabbadoz.net> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit X-Virus-Scanned: ClamAV using ClamSMTP X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 14 Feb 2017 09:32:05 -0000 On 06/02/2017 20:53, Bjoern A. Zeeb wrote: > >> This is a potentially bad behavior, because if I want to bridge say >> epair1a on A with epair10a on B with a VPN or >> >> a physical connection giving 192.168.1.1 to epair1b and 192.168.1.2 >> to epair10b, I won't be able to make them >> >> talk to each other since they have the same MAC address. >> >> >> My question is: is this a bug or something I'm doing wrong? If there >> any workaround I can use? > > > From the man page: > > Like any other Ethernet interface, an epair needs to have a network > address. Each epair will be assigned a locally administered > address by > default, that is only guaranteed to be unique within one network > stack. > To change the default addresses one may use the SIOCSIFADDR > ioctl(2) or > ifconfig(8) utility. > > I thought someone patched it a few years ago to have a pseudo-random > part to make collisions less likely and use the FreeBSD vendor space, > but it seems that never happened for epair (or didn’t make it into the > tree). > > ifconfig epair[ab] ether 02:xx:xx:xx:xx is your friend for now. Hi Bjoern, thanks for your reply... the idea is sound, but unfortunately setting the mac address of the epair interface inside the jail doesn't work: ifconfig epair0b ether ether 02:ff:e0:00:00:0b ifconfig: can't set link-level netmask or broadcast I've tried manually, in the rc.conf file (ifconfig_epair0b="ether..."), and in the /etc/start_if.epair0b file, but neither of these three ways actually work to set the mac address of the epair interface within the jail. On the other hand, no problem setting the mac of epair in the host... Do you know of any way to work around this? From owner-freebsd-net@freebsd.org Tue Feb 14 11:26:56 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DF6C1CDF55F for ; Tue, 14 Feb 2017 11:26:56 +0000 (UTC) (envelope-from v.maffione@gmail.com) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id BE41D1E35 for ; Tue, 14 Feb 2017 11:26:56 +0000 (UTC) (envelope-from v.maffione@gmail.com) Received: by mailman.ysv.freebsd.org (Postfix) id BD978CDF55E; Tue, 14 Feb 2017 11:26:56 +0000 (UTC) Delivered-To: net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BD3B4CDF55D for ; Tue, 14 Feb 2017 11:26:56 +0000 (UTC) (envelope-from v.maffione@gmail.com) Received: from mail-ot0-x22e.google.com (mail-ot0-x22e.google.com [IPv6:2607:f8b0:4003:c0f::22e]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 95AC21E34 for ; Tue, 14 Feb 2017 11:26:56 +0000 (UTC) (envelope-from v.maffione@gmail.com) Received: by mail-ot0-x22e.google.com with SMTP id 73so89742519otj.0 for ; Tue, 14 Feb 2017 03:26:56 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=jKatFvFkwMT8cuY+zXV45csdrCKbmh3nv4LCsdAMEC0=; b=P2qZ+uyaSEaQ+WTessRIxVAfX4Ry2OIQe3CEBGyW9COwmV4brzvRsrfYFl4966nnTn eTsY5eQCStFvEfwXAkAEtMNGx2rMStXyYGXFf3aEPCUPVNChZ3eL5NJ0fVw9zzdPauvO PIASymqJb3I1NkwJTR2qTuZx99s6ZXIMhgLHLoMPONb8qP5ox1Q2frxagzzA6Pn9Q2cE UZGvTculcDt9pHk4l/NMGWxurA4iBLYwcArZnm2PdOFh7yonRiJrSRx0ZWcD9nS3gaOA UqnP70d4Vtpesx4/97nXLrLKw6UucSt5AP1vrsY/vaZ1Pl4YBM8T6c+xmpO73y4HN6RG VGMQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=jKatFvFkwMT8cuY+zXV45csdrCKbmh3nv4LCsdAMEC0=; b=mv/Z5XCh3XlV0sYdp/vswfr3kYxsO+ddSVkdHJUhFT+ivqyNeaA2jc3br3RB11p6MH HBT4wjwYylkGCiTVBx7HN4mwI8ETCl+rW0+eT6CEV7zm5KQRpmOesib+JNWSeARAZcv0 /UhVgI8Iq/eKb1KycjpDYA9D+fFk2crZ3WXqW6+EAr6gX9GJuuo+VcWYGJvD9rWAsju7 R6/dAJYFxRuy0CTkwqaErv7mNlULk7qQX3MTwtxzdzFafZpz5H16M0xU48pirHxFyi9q TSWTA9oF+Tkre+A7sB6Q8r+DdMyYozQfB6aXbvT2x81kfpr0O7yqkzuNDYg/yrmQFJpr 9U3w== X-Gm-Message-State: AMke39kdpG93EhUw0M1sIgc4gIATsgU6R/pOwendmeweOPPeQ42ktpjgVK5DGkqZyiOd6QjC/snTtUoex8GnqA== X-Received: by 10.157.24.92 with SMTP id t28mr17088260ott.238.1487071615917; Tue, 14 Feb 2017 03:26:55 -0800 (PST) MIME-Version: 1.0 Received: by 10.157.7.201 with HTTP; Tue, 14 Feb 2017 03:26:55 -0800 (PST) In-Reply-To: References: From: Vincenzo Maffione Date: Tue, 14 Feb 2017 12:26:55 +0100 Message-ID: Subject: Re: netmap_mem_get_info To: amir alipour Cc: "freebsd-net@freebsd.org" Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 14 Feb 2017 11:26:57 -0000 Hi, Have you tried to play with netmap sysctl parameters like: dev.netmap.buf_num dev.netmap.ring_num dev.netmap.if_num those are listed in the sysctl section of the netmap man page. Cheers, Vincenzo 2017-02-11 13:34 GMT+01:00 amir alipour : > hi > i am trying to assign more memory to netmap but it fails > i trace it to "netmap_mem_get_info" function ,this function changes my > defined memory size to 343019520 and i cant find the implementation of it > in the source code! > > Thank you for any help you can provide > _______________________________________________ > freebsd-net@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" > -- Vincenzo Maffione From owner-freebsd-net@freebsd.org Tue Feb 14 12:36:25 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 940D5CDCA75 for ; Tue, 14 Feb 2017 12:36:25 +0000 (UTC) (envelope-from slw@zxy.spb.ru) Received: from mailman.ysv.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 80B46175A for ; Tue, 14 Feb 2017 12:36:25 +0000 (UTC) (envelope-from slw@zxy.spb.ru) Received: by mailman.ysv.freebsd.org (Postfix) id 80119CDCA74; Tue, 14 Feb 2017 12:36:25 +0000 (UTC) Delivered-To: net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7FCA1CDCA73 for ; Tue, 14 Feb 2017 12:36:25 +0000 (UTC) (envelope-from slw@zxy.spb.ru) Received: from zxy.spb.ru (zxy.spb.ru [195.70.199.98]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 435D81758 for ; Tue, 14 Feb 2017 12:36:25 +0000 (UTC) (envelope-from slw@zxy.spb.ru) Received: from slw by zxy.spb.ru with local (Exim 4.86 (FreeBSD)) (envelope-from ) id 1cdcLF-000NkL-Cj; Tue, 14 Feb 2017 15:36:21 +0300 Date: Tue, 14 Feb 2017 15:36:21 +0300 From: Slawa Olhovchenkov To: Vincenzo Maffione Cc: amir alipour , "freebsd-net@freebsd.org" Subject: Re: netmap_mem_get_info Message-ID: <20170214123621.GA15630@zxy.spb.ru> References: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.24 (2015-08-30) X-SA-Exim-Connect-IP: X-SA-Exim-Mail-From: slw@zxy.spb.ru X-SA-Exim-Scanned: No (on zxy.spb.ru); SAEximRunCond expanded to false X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 14 Feb 2017 12:36:25 -0000 On Tue, Feb 14, 2017 at 12:26:55PM +0100, Vincenzo Maffione wrote: > Hi, > Have you tried to play with netmap sysctl parameters like: > > dev.netmap.buf_num > dev.netmap.ring_num > dev.netmap.if_num > > those are listed in the sysctl section of the netmap man page. man page hide details about calcul rules of this parameters. From owner-freebsd-net@freebsd.org Tue Feb 14 12:51:13 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C1DDACDD05F for ; Tue, 14 Feb 2017 12:51:13 +0000 (UTC) (envelope-from bzeeb-lists@lists.zabbadoz.net) Received: from mx1.sbone.de (mx1.sbone.de [IPv6:2a01:4f8:130:3ffc::401:25]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client CN "mx1.sbone.de", Issuer "SBone.DE" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 85AB21EFC for ; Tue, 14 Feb 2017 12:51:13 +0000 (UTC) (envelope-from bzeeb-lists@lists.zabbadoz.net) Received: from mail.sbone.de (mail.sbone.de [IPv6:fde9:577b:c1a9:31::2013:587]) (using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by mx1.sbone.de (Postfix) with ESMTPS id 321E525D3891; Tue, 14 Feb 2017 12:51:11 +0000 (UTC) Received: from content-filter.sbone.de (content-filter.sbone.de [IPv6:fde9:577b:c1a9:31::2013:2742]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.sbone.de (Postfix) with ESMTPS id 685FCD1F7E7; Tue, 14 Feb 2017 12:51:10 +0000 (UTC) X-Virus-Scanned: amavisd-new at sbone.de Received: from mail.sbone.de ([IPv6:fde9:577b:c1a9:31::2013:587]) by content-filter.sbone.de (content-filter.sbone.de [fde9:577b:c1a9:31::2013:2742]) (amavisd-new, port 10024) with ESMTP id 3k95RXNDCtNo; Tue, 14 Feb 2017 12:51:09 +0000 (UTC) Received: from [192.168.124.1] (fresh-tun0-ula.sbone.de [IPv6:fde9:577b:c1a9:4920:2ef0:eeff:fe03:ee34]) (using TLSv1 with cipher AES256-SHA (256/256 bits)) (No client certificate requested) by mail.sbone.de (Postfix) with ESMTPSA id 14467D1F7E2; Tue, 14 Feb 2017 12:51:08 +0000 (UTC) From: "Bjoern A. Zeeb" To: "Giulio Ferro" Cc: "freebsd-net@freebsd.org" Subject: Re: Duplicate MAC addresses in VNET epair interaces Date: Tue, 14 Feb 2017 12:51:07 +0000 Message-ID: <88F0318C-ADB5-4EC3-9308-613ED7F2DAA7@lists.zabbadoz.net> In-Reply-To: References: <472069af-0f9d-d830-064b-2d984a5774ae@zirakzigil.org> <8B1A6A6C-4280-4B96-9D60-FC9E7EEE2222@lists.zabbadoz.net> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit X-Mailer: MailMate (2.0BETAr6076) X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 14 Feb 2017 12:51:13 -0000 On 14 Feb 2017, at 9:26, Giulio Ferro wrote: > Hi Bjoern, thanks for your reply... > > the idea is sound, but unfortunately setting the mac address of the > epair interface > inside the jail doesn't work: > > ifconfig epair0b ether ether 02:ff:e0:00:00:0b > ifconfig: can't set link-level netmask or broadcast Two “ether”s there but I assume that’s a copy and paste issue? > > I've tried manually, in the rc.conf file > (ifconfig_epair0b="ether..."), and in the /etc/start_if.epair0b file, > but neither of these three ways actually work to set the mac address > of the epair interface within the jail. > > On the other hand, no problem setting the mac of epair in the host... And that’s what you should do. Despite epairs being virtual interfaces, think of them as hardware that you are only “loaning” to the vnet-jail but don’t want the jail to mess with all the hw settings. And you probably want to change the ether addresses on both ends anyway. /bz From owner-freebsd-net@freebsd.org Tue Feb 14 13:13:56 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3A843CDDAF4 for ; Tue, 14 Feb 2017 13:13:56 +0000 (UTC) (envelope-from auryn@zirakzigil.org) Received: from mx1.etoilesoft.fr (mx1.etoilesoft.fr [52.57.51.18]) by mx1.freebsd.org (Postfix) with ESMTP id 03ADF1C2C for ; Tue, 14 Feb 2017 13:13:55 +0000 (UTC) (envelope-from auryn@zirakzigil.org) Received: from mx1.etoilesoft.fr (localhost [127.0.0.1]) by mx1.etoilesoft.fr (Postfix) with ESMTP id 7E1939D1A2; Tue, 14 Feb 2017 13:14:24 +0000 (UTC) Received: from [10.1.1.206] (localhost [127.0.0.1]) (Authenticated sender: auryn@zirakzigil.org) by mx1.etoilesoft.fr (Postfix) with ESMTPA id 4BEC89D19F; Tue, 14 Feb 2017 13:14:24 +0000 (UTC) Subject: Re: Duplicate MAC addresses in VNET epair interaces To: "Bjoern A. Zeeb" , "freebsd-net@freebsd.org" References: <472069af-0f9d-d830-064b-2d984a5774ae@zirakzigil.org> <8B1A6A6C-4280-4B96-9D60-FC9E7EEE2222@lists.zabbadoz.net> <88F0318C-ADB5-4EC3-9308-613ED7F2DAA7@lists.zabbadoz.net> From: Giulio Ferro Message-ID: Date: Tue, 14 Feb 2017 14:13:53 +0100 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:45.0) Gecko/20100101 Thunderbird/45.7.0 MIME-Version: 1.0 In-Reply-To: <88F0318C-ADB5-4EC3-9308-613ED7F2DAA7@lists.zabbadoz.net> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit X-Virus-Scanned: ClamAV using ClamSMTP X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 14 Feb 2017 13:13:56 -0000 On 14/02/2017 13:51, Bjoern A. Zeeb wrote: > ifconfig epair0b ether ether 02:ff:e0:00:00:0b >> ifconfig: can't set link-level netmask or broadcast > > Two “ether”s there but I assume that’s a copy and paste issue? > No, it's just me being stupid and careless... ;) Ok, it works great both in the jail and in the host. I've put the ether address in the /etc/start_if.epairxx files, as I think it should be supposed to be. Thanks a lot for your support! Giulio. > >> >> I've tried manually, in the rc.conf file >> (ifconfig_epair0b="ether..."), and in the /etc/start_if.epair0b file, >> but neither of these three ways actually work to set the mac address >> of the epair interface within the jail. >> >> On the other hand, no problem setting the mac of epair in the host... > > And that’s what you should do. Despite epairs being virtual > interfaces, think of them as hardware that you are only “loaning” to > the vnet-jail but don’t want the jail to mess with all the hw settings. > > And you probably want to change the ether addresses on both ends anyway. > > /bz > _______________________________________________ > freebsd-net@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" From owner-freebsd-net@freebsd.org Tue Feb 14 14:15:19 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8EB78CDE2CE for ; Tue, 14 Feb 2017 14:15:19 +0000 (UTC) (envelope-from bu7cher@yandex.ru) Received: from forward1j.cmail.yandex.net (forward1j.cmail.yandex.net [IPv6:2a02:6b8:0:1630::14]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "forwards.mail.yandex.net", Issuer "Yandex CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 12161177D; Tue, 14 Feb 2017 14:15:18 +0000 (UTC) (envelope-from bu7cher@yandex.ru) Received: from smtp2h.mail.yandex.net (smtp2h.mail.yandex.net [IPv6:2a02:6b8:0:f05::116]) by forward1j.cmail.yandex.net (Yandex) with ESMTP id 057052100F; Tue, 14 Feb 2017 17:15:16 +0300 (MSK) Received: from smtp2h.mail.yandex.net (localhost.localdomain [127.0.0.1]) by smtp2h.mail.yandex.net (Yandex) with ESMTP id 06D3D78191B; Tue, 14 Feb 2017 17:15:12 +0300 (MSK) Received: by smtp2h.mail.yandex.net (nwsmtp/Yandex) with ESMTPSA id E6pkxlnpN1-FBcuYQdT; Tue, 14 Feb 2017 17:15:12 +0300 (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client certificate not present) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yandex.ru; s=mail; t=1487081712; bh=g414Nj6fCW/qjNl3g2pR2RXfcke/CMfh/CAl3BXkoQ8=; h=Subject:To:References:From:Cc:Message-ID:Date:In-Reply-To; b=i95zkOsPQ4nZvWA9jblNeiq5dhICbIKIvXItJZDLK28OolS8aIx4rzGdl1ZCgiLpx nYpXs0/BgyImyUASsZX/mRWQBK451ELTQYP8x5Fm4bVGjpxgSnO7sCzh9K9Z2QrxGR GvS6IWqz+gg0GwMPtRc7ZuO4/sfRtZ0tmv1qmgm0= Authentication-Results: smtp2h.mail.yandex.net; dkim=pass header.i=@yandex.ru X-Yandex-Suid-Status: 1 0,1 0,1 0 Subject: Re: How to enable ECMP flow based forwarding ? To: =?UTF-8?Q?Olivier_Cochard-Labb=c3=a9?= , "freebsd-net@freebsd.org" References: From: "Andrey V. Elsukov" Openpgp: id=E6591E1B41DA1516F0C9BC0001C5EA0410C8A17A Cc: "Alexander V. Chernikov" Message-ID: <6162c934-3f22-889e-f45f-6f988342f4b3@yandex.ru> Date: Tue, 14 Feb 2017 17:13:28 +0300 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:45.0) Gecko/20100101 Thunderbird/45.6.0 MIME-Version: 1.0 In-Reply-To: Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="HsDrqcbRquf8C74wEMIbfRiT2IwHShtG4" X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 14 Feb 2017 14:15:19 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --HsDrqcbRquf8C74wEMIbfRiT2IwHShtG4 Content-Type: multipart/mixed; boundary="GggHtXHKt1Rjur6usL4BvtqH5hTm16LEF"; protected-headers="v1" From: "Andrey V. Elsukov" To: =?UTF-8?Q?Olivier_Cochard-Labb=c3=a9?= , "freebsd-net@freebsd.org" Cc: "Alexander V. Chernikov" Message-ID: <6162c934-3f22-889e-f45f-6f988342f4b3@yandex.ru> Subject: Re: How to enable ECMP flow based forwarding ? References: In-Reply-To: --GggHtXHKt1Rjur6usL4BvtqH5hTm16LEF Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable On 14.02.2017 03:23, Olivier Cochard-Labb=C3=A9 wrote: > Hi, >=20 > I'm testing FreeBSD ECMP behavior by adding "options RADIX_MPATH" to my= > kernel configuration (11-stable). > Now I can configure two identical routes toward 2 different next-hop: F= irst > step achieved :-) > But it uses only the first entry and never uses the second one. >=20 > I've tried to shutdown the first next-hop router (then no more arp-repl= y > from this next-hop): But the ECMP FreeBSD router sticks to its first ro= ute > entry and never try the second entry :-( >=20 > Is there something else to enable (like RSS?) for having a real ECMP fl= ow > based router ? I think you need to implement some code first. The fastfwd has not supported MPATH and tryforward also doesn't support it. For IPv4 you can try to add some IPsec security policy to disable ip_tryforward. In this case ip_forward() will be used, and it uses rtalloc_mpath_fib(), so, probably, it will work. --=20 WBR, Andrey V. Elsukov --GggHtXHKt1Rjur6usL4BvtqH5hTm16LEF-- --HsDrqcbRquf8C74wEMIbfRiT2IwHShtG4 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iQEzBAEBCAAdFiEE5lkeG0HaFRbwybwAAcXqBBDIoXoFAlijEIgACgkQAcXqBBDI oXqJ6AgAwGnkBI7u4vT1khccY8u1r6d2ST15rEcOmaUs9YN2rMzClDaSqHNqoF+Y ZU1g1gmWRgsPsa77f0AZObzsm+LTXsx9XwU1HWxx0IOcmqO6KTiWGbRUhxVTCNw5 vIyElxvvAbzO+egKkEdid6ELtkbTztEHBx7CNs0gT21aOPTGLqAa8SoMX2N+z7Wg ATr1sfQSrzpAmeNres/CZNTsK99VccedHtaPPySQHucXR2KZcNaKrTh+EyZ0OvPF 0JlYGkAb3zdhdUM7IOSwW37D64LG/dFl0m3R28/3wXf/U1Gn3SEcYzVRRTq5Qj0u qvUXDlZ0Ztks1Cun+rXekDCcVY57xw== =JCZb -----END PGP SIGNATURE----- --HsDrqcbRquf8C74wEMIbfRiT2IwHShtG4-- From owner-freebsd-net@freebsd.org Tue Feb 14 15:59:31 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9A7A2CDF712 for ; Tue, 14 Feb 2017 15:59:31 +0000 (UTC) (envelope-from julien@perdition.city) Received: from relay-b01.edpnet.be (relay-b01.edpnet.be [212.71.1.221]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "edpnet.email", Issuer "Go Daddy Secure Certificate Authority - G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 34327179E for ; Tue, 14 Feb 2017 15:59:30 +0000 (UTC) (envelope-from julien@perdition.city) X-ASG-Debug-ID: 1487086884-0a7ff54d952bea50001-QdxwpM Received: from mordor.lan ([213.219.148.14]) by relay-b01.edpnet.be with ESMTP id XF5LjYn4Jp27c2JU (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO) for ; Tue, 14 Feb 2017 16:41:25 +0100 (CET) X-Barracuda-Envelope-From: julien@perdition.city X-Barracuda-Effective-Source-IP: UNKNOWN[213.219.148.14] X-Barracuda-Apparent-Source-IP: 213.219.148.14 Date: Tue, 14 Feb 2017 16:41:24 +0100 From: Julien Cigar To: freebsd-net@freebsd.org Subject: carp and subnets Message-ID: <20170214154123.GE6194@mordor.lan> X-ASG-Orig-Subj: carp and subnets MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="tVmo9FyGdCe4F4YN" Content-Disposition: inline User-Agent: Mutt/1.7.1 (2016-10-04) X-Barracuda-Connect: UNKNOWN[213.219.148.14] X-Barracuda-Start-Time: 1487086884 X-Barracuda-Encrypted: ECDHE-RSA-AES256-GCM-SHA384 X-Barracuda-URL: https://212.71.1.221:443/cgi-mod/mark.cgi X-Barracuda-Scan-Msg-Size: 1700 X-Virus-Scanned: by bsmtpd at edpnet.be X-Barracuda-BRTS-Status: 1 X-Barracuda-Bayes: INNOCENT GLOBAL 0.5000 1.0000 0.0000 X-Barracuda-Spam-Score: 0.50 X-Barracuda-Spam-Status: No, SCORE=0.50 using global scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=6.0 tests=BSF_SC0_MV0713 X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.36508 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.50 BSF_SC0_MV0713 Custom rule MV0713 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 14 Feb 2017 15:59:31 -0000 --tVmo9FyGdCe4F4YN Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Hello, I have a redundant router/firewall with CARP and PF/PFSync with the following configuration (simplified for example): on FW1 (MASTER): ifconfig_em3=3D"inet 1.2.208.89 netmask 255.255.255.224 -tso" ifconfig_em3_alias0=3D"vhid 53 advskew 0 pass xx alias 1.2.208.90/32" on FW2 (BACKUP): ifconfig_em3=3D"inet 1.2.208.91 netmask 255.255.255.224 -tso" ifconfig_em3_alias0=3D"vhid 53 advskew 100 pass xx alias 1.2.208.90/32" on both machines I have something like this in my /etc/pf.conf: net_local=3D"10.209.1.0/24" net_prod=3D"192.168.10.0/24" if_wan=3D"em3"=20 CARPvhid53=3D"1.2.208.90" nat on $if_wan from { $net_local, $net_prod } to any -> $CARPvhid53 it works great but I have a couple of questions: - is it possible to use differents subnets for the "real" ips and the CARP vip ? in other words: I only have three public IPs and I'd like to reuse two of them. I wondered of something like this would work: on FW1 (MASTER): ifconfig_em3=3D"inet 192.168.88.1 netmask 255.255.255.0 -tso" ifconfig_em3_alias0=3D"vhid 53 advskew 0 pass xx alias 1.2.208.90/32" on FW2 (BACKUP): ifconfig_em3=3D"inet 192.168.88.2 netmask 255.255.255.0 -tso" ifconfig_em3_alias0=3D"vhid 53 advskew 100 pass xx alias 1.2.208.90/32" (assuming that the switch is configured properly) - as the state table is synced between FW1 and FW2, is it possible to=20 do some load-balancing on the outgoing address? Thanks! Julien --=20 Julien Cigar Belgian Biodiversity Platform (http://www.biodiversity.be) PGP fingerprint: EEF9 F697 4B68 D275 7B11 6A25 B2BB 3710 A204 23C0 No trees were killed in the creation of this message. However, many electrons were terribly inconvenienced. --tVmo9FyGdCe4F4YN Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCgAdFiEE7vn2l0to0nV7EWolsrs3EKIEI8AFAlijJR8ACgkQsrs3EKIE I8DU8g//dzT/db3YIxZrcynVyHh/jRDfkGEM1ENP4kpg/nQ+VISsiNvWAf2WwGQE iwY7OByyZr8eCKINnH+cdmtyUjWnaNP3hECZBMtdoltjykwhJo7/GHajjccRhrGc PudljwVL4z2/mLjFnuzqsmdVv9UO0FEga6Yj7chGNeFxPYqX8KM2SCDc1MC4pavO tc/0V+T7Zxm/QOWBSQq6WFsedYQo3KMY66XQwCXYWATO/GI16uphDjVvRdTu7Q3c S+4AR3BWMHnV6Ea+ZGAWlQIZmnPmgBEwpoeMeiceGkpTx6xz6sd10HSFxSqRqtzF Kap13IJQF4SEuJb2QmmSdZXCFmtXwujVmj4+9jygOAUN5y5hpFCIYOwcGmMl9+qj gkL2WSU8hF5Sbv8je6mHG+ObpfDpYW6yza3uCzTNrr16kqMqIYDb/hyMhXl7Kt5G RwCyUo9BlsisX1Kyj2gD7WLTW7Yid2qsYh2aMkUSfLzxX0u5vUGLoZnLsJh59FvZ U1HDFEmKPs6Eeb7o6snS98cFH9OCsCKprs2b/t4F8avl7DEheuCTGdF+e/9E5slq YJiqvoZY9FMX2KFYNqoYjlAPr+2hdGXYIA7L7ey0FKwYF1m8QQFCZUtCOJANxAez KUqaDodEpXbQ61YPGWI1qdtPG9JvkLpUYy8hjhbmSo6pUPn9roU= =OFti -----END PGP SIGNATURE----- --tVmo9FyGdCe4F4YN-- From owner-freebsd-net@freebsd.org Tue Feb 14 17:03:02 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 30CE8CDFC68 for ; Tue, 14 Feb 2017 17:03:02 +0000 (UTC) (envelope-from fjwcash@gmail.com) Received: from mail-qk0-x22b.google.com (mail-qk0-x22b.google.com [IPv6:2607:f8b0:400d:c09::22b]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id DB3ED114B for ; Tue, 14 Feb 2017 17:03:01 +0000 (UTC) (envelope-from fjwcash@gmail.com) Received: by mail-qk0-x22b.google.com with SMTP id p22so36632274qka.0 for ; Tue, 14 Feb 2017 09:03:01 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=8+Q1ZqEf3Zdmklu0aXooozEvBCMIsU/gVqXXkZXiDiE=; b=mlQFj6YLxrzG0/hMTKvlLpc2aJaKQi9sxaffpKzqC8vhs60BkczqXmnSpwiizDq4kH 4TGInuWW33Aky45ydRWU+PcQGXbCOhrQwc/+0ccgYCJWpwR1YcHDaeN1O5HaUluFnsdB gqQIukULXVB2Oda45/QAtziG9TT7bbv53W6MhJE90FhEZJ+UqXoywB5q8NKhLuJ7BGKz T/O+goi8GKpng9RyOa/vBOKYOu3mu4I4+Inl2rMpFnvDNNAfy9e/9Bg35+wf7/EKc1EL YqWj0szP+3HZfNb+gfNhPHoLUzEA+nsMb3g3qBqgagqdjwVEUzXNBNK5jNC5ZbRPKQqz k9/w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=8+Q1ZqEf3Zdmklu0aXooozEvBCMIsU/gVqXXkZXiDiE=; b=caRfHzEa8Csl4T+ySMJ2dBV08UYQAUitcuet8m0Ao4Vv1J0K6SljbBzalKQgjwqAsC YN3E0E5ScXSVyOc3hALdoj/P2EfYL2BogTGUMFkbN8EqurBMQKg5Q2qhTV5gpGFFOR+5 ftPCyOQAMmjFYGnm/1yGQU6GtXWg261Zney0YR7ZhyNonV8Tvqb+4Tod9jz4FtBRtCn/ PjO+MU6T/eWljDaYWXF5ev2yHf+qgHCCGbv5070IfUZ9MAlBpoFKdl+WKPdy3xjp1O5S mJ/H24Rp9RXgfky4MOMjCBPbPUzipwfS1gChbPp5y0V2IwRg+FfWgFr9LBXkAmshG8EW AnwQ== X-Gm-Message-State: AMke39kPfR3GlynKBwEc/neI2Ikhc6wpm5bG7aOWIU7gAlf1FT7SDrnKnqhf+P5l4b2Za8qM8cUOuC3w0EpAtg== X-Received: by 10.55.95.131 with SMTP id t125mr31364161qkb.279.1487091780957; Tue, 14 Feb 2017 09:03:00 -0800 (PST) MIME-Version: 1.0 Received: by 10.140.28.202 with HTTP; Tue, 14 Feb 2017 09:03:00 -0800 (PST) In-Reply-To: <20170214154123.GE6194@mordor.lan> References: <20170214154123.GE6194@mordor.lan> From: Freddie Cash Date: Tue, 14 Feb 2017 09:03:00 -0800 Message-ID: Subject: Re: carp and subnets To: Julien Cigar Cc: freebsd-net Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 14 Feb 2017 17:03:02 -0000 On Tue, Feb 14, 2017 at 7:41 AM, Julien Cigar wrote= : > Hello, > > I have a redundant router/firewall with CARP and PF/PFSync with the > following configuration (simplified for example): > > on FW1 (MASTER): > > ifconfig_em3=3D"inet 1.2.208.89 netmask 255.255.255.224 -tso" > ifconfig_em3_alias0=3D"vhid 53 advskew 0 pass xx alias 1.2.208.90/32" > > on FW2 (BACKUP): > > ifconfig_em3=3D"inet 1.2.208.91 netmask 255.255.255.224 -tso" > ifconfig_em3_alias0=3D"vhid 53 advskew 100 pass xx alias 1.2.208.90/32" > > on both machines I have something like this in my /etc/pf.conf: > net_local=3D"10.209.1.0/24" > net_prod=3D"192.168.10.0/24" > if_wan=3D"em3" > CARPvhid53=3D"1.2.208.90" > nat on $if_wan from { $net_local, $net_prod } to any -> $CARPvhid53 > > it works great but I have a couple of questions: > > - is it possible to use differents subnets for the "real" ips and the > CARP vip ? in other words: I only have three public IPs and I'd like > to reuse two of them. I wondered of something like this would work: > > on FW1 (MASTER): > > ifconfig_em3=3D"inet 192.168.88.1 netmask 255.255.255.0 -tso" > ifconfig_em3_alias0=3D"vhid 53 advskew 0 pass xx alias 1.2.208.90/32" > > on FW2 (BACKUP): > > ifconfig_em3=3D"inet 192.168.88.2 netmask 255.255.255.0 -tso" > ifconfig_em3_alias0=3D"vhid 53 advskew 100 pass xx alias 1.2.208.90/32" > > (assuming that the switch is configured properly) > > - as the state table is synced between FW1 and FW2, is it possible to > do some load-balancing on the outgoing address? > > Thanks! > =E2=80=8BWith FreeBSD 9.x and earlier, no, you can't. The CARP setup uses = the IP/subnet of the host interface for sending the CARP messages. With FreeBSD 10.x and above, yes, you can. The CARP setup uses the IP/subnet of the VHID for sending CARP messages, which can be set to anything. So long as all the member VHID interfaces are on the same subnet and connection. It's one of the many nice things about the new CARP stuff on FreeBSD 10.x.=E2=80=8B --=20 Freddie Cash fjwcash@gmail.com From owner-freebsd-net@freebsd.org Tue Feb 14 17:49:45 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BF93CCDFCC5 for ; Tue, 14 Feb 2017 17:49:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id AF0751F1B for ; Tue, 14 Feb 2017 17:49:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v1EHnj1S069629 for ; Tue, 14 Feb 2017 17:49:45 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-net@FreeBSD.org Subject: [Bug 204340] [panic] nfsd, em, msix, fatal trap 9 Date: Tue, 14 Feb 2017 17:49:45 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.2-RELEASE X-Bugzilla-Keywords: IntelNetworking, crash, patch X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: commit-hook@freebsd.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: rmacklem@FreeBSD.org X-Bugzilla-Flags: mfc-stable9- mfc-stable10+ X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 14 Feb 2017 17:49:45 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D204340 --- Comment #27 from commit-hook@freebsd.org --- A commit references this bug: Author: avg Date: Tue Feb 14 17:49:08 UTC 2017 New revision: 313735 URL: https://svnweb.freebsd.org/changeset/base/313735 Log: add svcpool_close to handle killed nfsd threads This patch adds a new function to the server krpc called svcpool_close(). It is similar to svcpool_destroy(), but does not free the data structures, so that the pool can be used again. This function is then used instead of svcpool_destroy(), svcpool_create() when the nfsd threads are killed. PR: 204340 Reported by: Panzura Approved by: rmacklem Obtained from: rmacklem MFC after: 1 week Changes: head/sys/fs/nfsserver/nfs_nfsdkrpc.c head/sys/rpc/svc.c head/sys/rpc/svc.h --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-net@freebsd.org Tue Feb 14 18:23:38 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D8858CDE89E for ; Tue, 14 Feb 2017 18:23:38 +0000 (UTC) (envelope-from stl@wiredrive.com) Received: from mail-qt0-x246.google.com (mail-qt0-x246.google.com [IPv6:2607:f8b0:400d:c0d::246]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 9DD2315F0 for ; Tue, 14 Feb 2017 18:23:38 +0000 (UTC) (envelope-from stl@wiredrive.com) Received: by mail-qt0-x246.google.com with SMTP id h53so148271156qth.6 for ; Tue, 14 Feb 2017 10:23:38 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=wiredrive-com.20150623.gappssmtp.com; s=20150623; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=ZjefOhZuKufrHsFvmZG8u9ZN4gWRZAyAhoDzi46SsYw=; b=n+o+5uEjludZ1bFWwkg5XNND0gOSFaL5Bu12IQ7gjRJ2+FCBQBnWh2Yf18UR5Hj3G3 vatuWwQHC1CgvNsLhmBpvcq/DzCoN2fqJP710+fxJ1HcAp9Lqf6E7XirN2sWqRQSCES/ 6NNGZ2QRke8ttMlMiiMFBzLc7QvhyAsjoK+BhMnwMnK99/Dl4mCkwo91FrWAG2yOl68g ib8F/hWdP7bhsgjvfeWoKTi7PhtizE4UmFP4Vdsgw7i6equwPhja7eixWLTBweJZWkhL wVLcpQUS4Lm3LbqZ2FnXD40gtdTBfSPkytWZlF1aWuS6dJqDA2j6cGs2W6SpuY7renIG 5SXw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=ZjefOhZuKufrHsFvmZG8u9ZN4gWRZAyAhoDzi46SsYw=; b=BmcIQ8PwlbjKrrbQaJlsvZo+K0qU4h8VICzuXjNg8kNlUV3xKeY0MKGmUTNrWuL3qL 0eJa5lYHuhuFu7Zv74uUD7bu/JDhObUHcTBBlWmSL8MkRnfufR6NvRVUS1cGP8pFDbnP 1qdHwpJ3E0D1YUjzacIExppI2Mn21ahH8ZQpq+9ECcRJIZqVsW7SSVD2bNP/aN1JTm0/ 1zBqpvmAZoQWLmLmdZahPA/Itt69FGu26nvMG9/P8gxcPtUZwgDR0KCBFVEyq7/Wcb4f R2oprIigdC/cTwBm15ISKKR/z4hLlzL6+2wklKrsu1xg25hvOVVAWu9LPsrfc0XUbyZg +OMg== X-Gm-Message-State: AMke39mURAzZO8trYcqaHIpLluMm87PwYFhUopWtkbYqjHeHP/h1xxvvaokBhq/jWX5D2LZBOEFC7VQBMrlHnQgL X-Received: by 10.200.33.141 with SMTP id 13mr30335210qty.83.1487096617548; Tue, 14 Feb 2017 10:23:37 -0800 (PST) MIME-Version: 1.0 Received: by 10.140.30.71 with HTTP; Tue, 14 Feb 2017 10:23:37 -0800 (PST) In-Reply-To: References: From: Scott Larson Date: Tue, 14 Feb 2017 10:23:37 -0800 Message-ID: Subject: Re: How to enable ECMP flow based forwarding ? To: =?UTF-8?Q?Olivier_Cochard=2DLabb=C3=A9?= Cc: "freebsd-net@freebsd.org" Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 14 Feb 2017 18:23:39 -0000 I'm successfully using ECMP on 11.0-RELEASE firewalls, but in my case they're also using OSPF with a pair of upstream MX480 routers via Quagga. BIRD would be nicer to work with but the last time I checked it wasn't playing nice with ECMP on FreeBSD. Regardless, if OSPF is an option you can pursue that will definitely work. *[image: userimage]Scott Larson[image: los angeles] Lead Systems Administrator[image: wdlogo] [image: linkedin] [image: facebook] [image: twitter] [image: instagram] T 310 823 8238 <310%20823%208238%20x1106> | M 310 904 8818 <310%20904%208818>* On Mon, Feb 13, 2017 at 4:23 PM, Olivier Cochard-Labb=C3=A9 wrote: > Hi, > > I'm testing FreeBSD ECMP behavior by adding "options RADIX_MPATH" to my > kernel configuration (11-stable). > Now I can configure two identical routes toward 2 different next-hop: Fir= st > step achieved :-) > But it uses only the first entry and never uses the second one. > > I've tried to shutdown the first next-hop router (then no more arp-reply > from this next-hop): But the ECMP FreeBSD router sticks to its first rout= e > entry and never try the second entry :-( > > Is there something else to enable (like RSS?) for having a real ECMP flow > based router ? > > Thanks, > _______________________________________________ > freebsd-net@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" > From owner-freebsd-net@freebsd.org Tue Feb 14 19:52:26 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 76FF9CDF566 for ; Tue, 14 Feb 2017 19:52:26 +0000 (UTC) (envelope-from ermal.luci@gmail.com) Received: from mail-it0-x22c.google.com (mail-it0-x22c.google.com [IPv6:2607:f8b0:4001:c0b::22c]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 3A5CC1BB6; Tue, 14 Feb 2017 19:52:26 +0000 (UTC) (envelope-from ermal.luci@gmail.com) Received: by mail-it0-x22c.google.com with SMTP id c7so47671846itd.1; Tue, 14 Feb 2017 11:52:26 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:sender:in-reply-to:references:from:date:message-id :subject:to:cc; bh=TFiz2xQE6bTdmHGgNXjCDXxr3ZzNZRaZyL2TQKhdVuE=; b=sxeFV/woQRPBOMYFid4xOmOoH6eKy8l8b2TpkJIKoh92HVr/6fAbxVZjyJOtBy6bNs h0CMfq8J9kbXO8poMbUFyne71JjDZYDGuOEMgj4kqTPXMitcOYWcqKlkF+H/ullaZwbU bG2yNHq7SfQEwMy53cStCnKTmxm0yUPuDDNvE6HlWB+UUvzzUIO/cupedP7Y4ktx0RDn UrkpvLm1zwMYexHdesQ6gTkTmwFoQrsHI8w5wNpnslqjDLGAZyamCspnMdLF4CrhkVuH 9Zfx6vgd8AfPYXxzB7zWKkdgSc25WC0bXqQbqp2p63vzgrs2m/Q50mHOUlAEPRgjnoyV mkEw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:sender:in-reply-to:references:from :date:message-id:subject:to:cc; bh=TFiz2xQE6bTdmHGgNXjCDXxr3ZzNZRaZyL2TQKhdVuE=; b=JwNZwXMaEVGppzTBwhJzGbiTwG11ht+gG6hKLcPDNwKjFE6xAK6iABkaUodNDZ/Uuo T9avwHkY9yBIoDjVJP1qtspDOC36XVJam10eyaedSPn8BMe1qgdMIc2pvb6DQZtLdJTE xJcQzERksNqJWqn+IdB4o0VUyzTINw9UaEvJ0+vhAyVrLyYUwMR8CDQ0vtFnpYvzFyN3 ARjaXsJ9SgRP6T01RbLh+C3mDo22I7rcz4XcObuSzPh0x8eFl5t1rY0v5xOfdhll8Z3O MrZ0azr7fLrbFIoqoCnAtQE8TL3nuKgy1WLQGUE01WK8jm9awTb2Vt/Y9CCPuLxiX0lQ egOQ== X-Gm-Message-State: AMke39kQ2cwosOs1TB1Yl45uK1nDBFha+SM+anRIZMYyD7yJXRZwM4Bq4yQ4rUHT/2MvPEBMUVzGgSGO8OZUVw== X-Received: by 10.107.22.197 with SMTP id 188mr32459719iow.183.1487101945614; Tue, 14 Feb 2017 11:52:25 -0800 (PST) MIME-Version: 1.0 Sender: ermal.luci@gmail.com Received: by 10.107.129.99 with HTTP; Tue, 14 Feb 2017 11:52:24 -0800 (PST) In-Reply-To: <6162c934-3f22-889e-f45f-6f988342f4b3@yandex.ru> References: <6162c934-3f22-889e-f45f-6f988342f4b3@yandex.ru> From: =?UTF-8?Q?Ermal_Lu=C3=A7i?= Date: Tue, 14 Feb 2017 11:52:24 -0800 X-Google-Sender-Auth: xuLQgqcgqqQkJclsgIqKvKKyR9o Message-ID: Subject: Re: How to enable ECMP flow based forwarding ? To: "Andrey V. Elsukov" Cc: =?UTF-8?Q?Olivier_Cochard=2DLabb=C3=A9?= , "freebsd-net@freebsd.org" , "Alexander V. Chernikov" Content-Type: multipart/mixed; boundary=001a1148cd22376f46054882e7b0 X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 14 Feb 2017 19:52:26 -0000 --001a1148cd22376f46054882e7b0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable On Tue, Feb 14, 2017 at 6:13 AM, Andrey V. Elsukov wrote: > On 14.02.2017 03:23, Olivier Cochard-Labb=C3=A9 wrote: > > Hi, > > > > I'm testing FreeBSD ECMP behavior by adding "options RADIX_MPATH" to my > > kernel configuration (11-stable). > > Now I can configure two identical routes toward 2 different next-hop: > First > > step achieved :-) > > But it uses only the first entry and never uses the second one. > > > > I've tried to shutdown the first next-hop router (then no more arp-repl= y > > from this next-hop): But the ECMP FreeBSD router sticks to its first > route > > entry and never try the second entry :-( > > > > Is there something else to enable (like RSS?) for having a real ECMP fl= ow > > based router ? > > I think you need to implement some code first. The fastfwd has not > supported MPATH and tryforward also doesn't support it. For IPv4 you can > try to add some IPsec security policy to disable ip_tryforward. In this > case ip_forward() will be used, and it uses rtalloc_mpath_fib(), so, > probably, it will work. > > This seems to be a bug to file and which can quickly be fixed by presenting same behaviour that slow path does when RADIX_MPATH is active. It does not impact performance or any of the problems ip_tryforward() is trying to solve. Try the attached patch it should fix your issues. -- > WBR, Andrey V. Elsukov > > -- > Ermal > --001a1148cd22376f46054882e7b0 Content-Type: text/plain; charset=US-ASCII; name="ip_tryforward_route_mpath.diff" Content-Disposition: attachment; filename="ip_tryforward_route_mpath.diff" Content-Transfer-Encoding: base64 X-Attachment-Id: f_iz5y38e21 ZGlmZiAtLWdpdCBhL3N5cy9uZXRpbmV0L2lwX2Zhc3Rmd2QuYyBiL3N5cy9uZXRpbmV0L2lwX2Zh c3Rmd2QuYwppbmRleCBlYTU5YzEwLi4wYTUwZjYyIDEwMDY0NAotLS0gYS9zeXMvbmV0aW5ldC9p cF9mYXN0ZndkLmMKKysrIGIvc3lzL25ldGluZXQvaXBfZmFzdGZ3ZC5jCkBAIC0xMDgsNyArMTA4 LDggQEAgX19GQlNESUQoIiRGcmVlQlNEJCIpOwogI2luY2x1ZGUgPG1hY2hpbmUvaW5fY2tzdW0u aD4KIAogc3RhdGljIHN0cnVjdCBzb2NrYWRkcl9pbiAqCi1pcF9maW5kcm91dGUoc3RydWN0IHJv dXRlICpybywgc3RydWN0IGluX2FkZHIgZGVzdCwgc3RydWN0IG1idWYgKm0pCitpcF9maW5kcm91 dGUoc3RydWN0IHJvdXRlICpybywgc3RydWN0IGlwICppcCwgc3RydWN0IGluX2FkZHIgZGVzdCwK KyAgICAgICAgICAgICAgIHN0cnVjdCBtYnVmICptKQogewogICAgICAgIHN0cnVjdCBzb2NrYWRk cl9pbiAqZHN0OwogICAgICAgIHN0cnVjdCBydGVudHJ5ICpydDsKQEAgLTEyMSw3ICsxMjIsMTQg QEAgaXBfZmluZHJvdXRlKHN0cnVjdCByb3V0ZSAqcm8sIHN0cnVjdCBpbl9hZGRyIGRlc3QsIHN0 cnVjdCBtYnVmICptKQogICAgICAgIGRzdC0+c2luX2ZhbWlseSA9IEFGX0lORVQ7CiAgICAgICAg ZHN0LT5zaW5fbGVuID0gc2l6ZW9mKCpkc3QpOwogICAgICAgIGRzdC0+c2luX2FkZHIuc19hZGRy ID0gZGVzdC5zX2FkZHI7Ci0gICAgICAgaW5fcnRhbGxvY19pZ24ocm8sIDAsIE1fR0VURklCKG0p KTsKKyNpZmRlZiBSQURJWF9NUEFUSAorICAgICAgICBydGFsbG9jX21wYXRoX2ZpYigmcm8sCisg ICAgICAgICAgICBudG9obChpcC0+aXBfc3JjLnNfYWRkciBeIGlwLT5pcF9kc3Quc19hZGRyKSwK KyAgICAgICAgICAgIE1fR0VURklCKG0pKTsKKyNlbHNlCisgICAgICAgIGluX3J0YWxsb2NfaWdu KCZybywgMCwgTV9HRVRGSUIobSkpOworI2VuZGlmCisKIAogICAgICAgIC8qCiAgICAgICAgICog Um91dGUgdGhlcmUgYW5kIGludGVyZmFjZSBzdGlsbCB1cD8KQEAgLTMwNSw3ICszMTMsNyBAQCBw YXNzaW46CiAgICAgICAgLyoKICAgICAgICAgKiBGaW5kIHJvdXRlIHRvIGRlc3RpbmF0aW9uLgog ICAgICAgICAqLwotICAgICAgIGlmICgoZHN0ID0gaXBfZmluZHJvdXRlKCZybywgZGVzdCwgbSkp ID09IE5VTEwpCisgICAgICAgaWYgKChkc3QgPSBpcF9maW5kcm91dGUoJnJvLCBpcCwgZGVzdCwg bSkpID09IE5VTEwpCiAgICAgICAgICAgICAgICByZXR1cm4gTlVMTDsgICAgLyogaWNtcCB1bnJl YWNoIGFscmVhZHkgc2VudCAqLwogICAgICAgIGlmcCA9IHJvLnJvX3J0LT5ydF9pZnA7CiAKQEAg LTM2Niw3ICszNzQsNyBAQCBmb3J3YXJkbG9jYWw6CiAgICAgICAgICAgICAgICAgICAgICAgIG0t Pm1fZmxhZ3MgJj0gfk1fSVBfTkVYVEhPUDsKICAgICAgICAgICAgICAgIH0KICAgICAgICAgICAg ICAgIFJURlJFRShyby5yb19ydCk7Ci0gICAgICAgICAgICAgICBpZiAoKGRzdCA9IGlwX2ZpbmRy b3V0ZSgmcm8sIGRlc3QsIG0pKSA9PSBOVUxMKQorICAgICAgICAgICAgICAgaWYgKChkc3QgPSBp cF9maW5kcm91dGUoJnJvLCBpcCwgZGVzdCwgbSkpID09IE5VTEwpCiAgICAgICAgICAgICAgICAg ICAgICAgIHJldHVybiBOVUxMOyAgICAvKiBpY21wIHVucmVhY2ggYWxyZWFkeSBzZW50ICovCiAg ICAgICAgICAgICAgICBpZnAgPSByby5yb19ydC0+cnRfaWZwOwogICAgICAgIH0KCg== --001a1148cd22376f46054882e7b0-- From owner-freebsd-net@freebsd.org Tue Feb 14 20:29:43 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 73B09CDFEFB for ; Tue, 14 Feb 2017 20:29:43 +0000 (UTC) (envelope-from julien@perdition.city) Received: from relay-b01.edpnet.be (relay-b01.edpnet.be [212.71.1.221]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "edpnet.email", Issuer "Go Daddy Secure Certificate Authority - G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 1E7251F45 for ; Tue, 14 Feb 2017 20:29:42 +0000 (UTC) (envelope-from julien@perdition.city) X-ASG-Debug-ID: 1487104176-0a7ff54d952e7f10001-QdxwpM Received: from mordor.lan ([213.219.148.14]) by relay-b01.edpnet.be with ESMTP id uQ2EBRHKQOY3qgHS (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Tue, 14 Feb 2017 21:29:38 +0100 (CET) X-Barracuda-Envelope-From: julien@perdition.city X-Barracuda-Effective-Source-IP: UNKNOWN[213.219.148.14] X-Barracuda-Apparent-Source-IP: 213.219.148.14 Date: Tue, 14 Feb 2017 21:29:36 +0100 From: Julien Cigar To: Freddie Cash Cc: freebsd-net Subject: Re: carp and subnets Message-ID: <20170214202936.GF6194@mordor.lan> X-ASG-Orig-Subj: Re: carp and subnets References: <20170214154123.GE6194@mordor.lan> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="wtjvnLv0o8UUzur2" Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.7.1 (2016-10-04) X-Barracuda-Connect: UNKNOWN[213.219.148.14] X-Barracuda-Start-Time: 1487104177 X-Barracuda-Encrypted: ECDHE-RSA-AES256-GCM-SHA384 X-Barracuda-URL: https://212.71.1.221:443/cgi-mod/mark.cgi X-Barracuda-Scan-Msg-Size: 2549 X-Virus-Scanned: by bsmtpd at edpnet.be X-Barracuda-BRTS-Status: 1 X-Barracuda-Bayes: INNOCENT GLOBAL 0.5000 1.0000 0.0000 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using global scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=6.0 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.36518 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 14 Feb 2017 20:29:43 -0000 --wtjvnLv0o8UUzur2 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Tue, Feb 14, 2017 at 09:03:00AM -0800, Freddie Cash wrote: > On Tue, Feb 14, 2017 at 7:41 AM, Julien Cigar wro= te: >=20 > > Hello, > > > > I have a redundant router/firewall with CARP and PF/PFSync with the > > following configuration (simplified for example): > > > > on FW1 (MASTER): > > > > ifconfig_em3=3D"inet 1.2.208.89 netmask 255.255.255.224 -tso" > > ifconfig_em3_alias0=3D"vhid 53 advskew 0 pass xx alias 1.2.208.90/32" > > > > on FW2 (BACKUP): > > > > ifconfig_em3=3D"inet 1.2.208.91 netmask 255.255.255.224 -tso" > > ifconfig_em3_alias0=3D"vhid 53 advskew 100 pass xx alias 1.2.208.90/32" > > > > on both machines I have something like this in my /etc/pf.conf: > > net_local=3D"10.209.1.0/24" > > net_prod=3D"192.168.10.0/24" > > if_wan=3D"em3" > > CARPvhid53=3D"1.2.208.90" > > nat on $if_wan from { $net_local, $net_prod } to any -> $CARPvhid53 > > > > it works great but I have a couple of questions: > > > > - is it possible to use differents subnets for the "real" ips and the > > CARP vip ? in other words: I only have three public IPs and I'd like > > to reuse two of them. I wondered of something like this would work: > > > > on FW1 (MASTER): > > > > ifconfig_em3=3D"inet 192.168.88.1 netmask 255.255.255.0 -tso" > > ifconfig_em3_alias0=3D"vhid 53 advskew 0 pass xx alias 1.2.208.90/32" > > > > on FW2 (BACKUP): > > > > ifconfig_em3=3D"inet 192.168.88.2 netmask 255.255.255.0 -tso" > > ifconfig_em3_alias0=3D"vhid 53 advskew 100 pass xx alias 1.2.208.90/32" > > > > (assuming that the switch is configured properly) > > > > - as the state table is synced between FW1 and FW2, is it possible to > > do some load-balancing on the outgoing address? > > > > Thanks! > > >=20 > =E2=80=8BWith FreeBSD 9.x and earlier, no, you can't. The CARP setup use= s the > IP/subnet of the host interface for sending the CARP messages. >=20 > With FreeBSD 10.x and above, yes, you can. The CARP setup uses the > IP/subnet of the VHID for sending CARP messages, which can be set to > anything. So long as all the member VHID interfaces are on the same subn= et > and connection. It's one of the many nice things about the new CARP stuff > on FreeBSD 10.x.=E2=80=8B excellent, thank you! >=20 > --=20 > Freddie Cash > fjwcash@gmail.com --=20 Julien Cigar Belgian Biodiversity Platform (http://www.biodiversity.be) PGP fingerprint: EEF9 F697 4B68 D275 7B11 6A25 B2BB 3710 A204 23C0 No trees were killed in the creation of this message. However, many electrons were terribly inconvenienced. --wtjvnLv0o8UUzur2 Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCgAdFiEE7vn2l0to0nV7EWolsrs3EKIEI8AFAlijaKoACgkQsrs3EKIE I8AhxRAAtVW53cC5SjQkIVBR//jiFTBwjLgp+udVaKEmirj6TXtm/WcJc+W2e9EJ +BgJCi5GeOPAfhaCVoRsIAfh38VAKRWC9qEgVOw7WKNYGCOivD37LK8Dr8EuMkaM iOCf0zDUWLduV38u/ki2oV8s1bEtXaSRtmbN3z+bkY50NUh+Uybeli9tc3EfoFM0 CGHGFBJOHmUMpJ6kBEpUJ83ajvAdV6VPztukGNLfdz2gxrTI2q3svv+91yUt50I0 YKMFYlLY3udk5fRXWvTytkey+iDl5eLBF4XH+n+yYmut6+y8iILz3vUV5WpfgsEm VUOZtHkdh98uEqjTMsmWVby4K0dSypMAtccynbjEEnzLkPper2M2zU2bkSSoxrRG /BQEc8ISzqmFGmFYihPV+0iZHOWKaga6+d+DhR3Sk92b6/OHTgzcX0yz8MsbjT2n e+WNqCNvYLCwJGEofWdIHftOarpfFogQXJJFfDCs7Y0Lv2LMqqxk3BvYpmf2ydGE Ep5llBVWCzS8/jVayNnOGWA0V0h3fAUnuZFqgsM7JrVTjl1uzESnUNdFDEgL9vyF P+Sg0Oew7AhSyAaDTmLjnNqszi+trOPkvk+28f5E+BHWJNjH93EuVv6qu6kQPK9q pQ1181XINQwZdoNYDfxFUffEWKmIawVie20g6gIbADAMRnZ4jWE= =xWLf -----END PGP SIGNATURE----- --wtjvnLv0o8UUzur2-- From owner-freebsd-net@freebsd.org Wed Feb 15 06:17:45 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E99FECE071F for ; Wed, 15 Feb 2017 06:17:45 +0000 (UTC) (envelope-from bu7cher@yandex.ru) Received: from forward3p.cmail.yandex.net (forward3p.cmail.yandex.net [IPv6:2a02:6b8:0:1465::13]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "forwards.mail.yandex.net", Issuer "Yandex CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 5CB9C19FB; Wed, 15 Feb 2017 06:17:45 +0000 (UTC) (envelope-from bu7cher@yandex.ru) Received: from smtp3j.mail.yandex.net (smtp3j.mail.yandex.net [95.108.130.68]) by forward3p.cmail.yandex.net (Yandex) with ESMTP id 12BF020FE0; Wed, 15 Feb 2017 09:17:32 +0300 (MSK) Received: from smtp3j.mail.yandex.net (localhost.localdomain [127.0.0.1]) by smtp3j.mail.yandex.net (Yandex) with ESMTP id 9CAE06240FCA; Wed, 15 Feb 2017 09:17:27 +0300 (MSK) Received: by smtp3j.mail.yandex.net (nwsmtp/Yandex) with ESMTPSA id i97u1N3cwL-HQcK7DIO; Wed, 15 Feb 2017 09:17:26 +0300 (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client certificate not present) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yandex.ru; s=mail; t=1487139446; bh=gtn8nIKbAjqUqbuj4ErffJ75FRiW4doWNbvm0pmYrWc=; h=Subject:To:References:Cc:From:Message-ID:Date:In-Reply-To; b=stponw+LbX7DWLM302bKyDLahf1itW7vmfsGIayc8UaWJKZIBOqqiOI8srb7OOHme Q3077LbI4HpApoNiZx1AQNvWbiVuxV8ErijvodoJ2NJlsmzxfqBP45EU2Zbeyhi05K dR09iKtYJ0buVFkilPClopwNjQl26bYnTfkY3rx4= Authentication-Results: smtp3j.mail.yandex.net; dkim=pass header.i=@yandex.ru X-Yandex-Suid-Status: 1 0,1 0,1 0,1 0 Subject: Re: How to enable ECMP flow based forwarding ? To: =?UTF-8?Q?Ermal_Lu=c3=a7i?= References: <6162c934-3f22-889e-f45f-6f988342f4b3@yandex.ru> Cc: =?UTF-8?Q?Olivier_Cochard-Labb=c3=a9?= , "freebsd-net@freebsd.org" , "Alexander V. Chernikov" From: "Andrey V. Elsukov" Openpgp: id=E6591E1B41DA1516F0C9BC0001C5EA0410C8A17A Message-ID: <3d53aad4-f005-659e-5939-579d67a185ab@yandex.ru> Date: Wed, 15 Feb 2017 09:15:45 +0300 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:45.0) Gecko/20100101 Thunderbird/45.6.0 MIME-Version: 1.0 In-Reply-To: Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="tOjg8Ce26hwko0QO3E01xSFcl7lQcWhui" X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 15 Feb 2017 06:17:46 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --tOjg8Ce26hwko0QO3E01xSFcl7lQcWhui Content-Type: multipart/mixed; boundary="Vgu9nNQPDUhgItKGtEMbnFlvfcRsphjeL"; protected-headers="v1" From: "Andrey V. Elsukov" To: =?UTF-8?Q?Ermal_Lu=c3=a7i?= Cc: =?UTF-8?Q?Olivier_Cochard-Labb=c3=a9?= , "freebsd-net@freebsd.org" , "Alexander V. Chernikov" Message-ID: <3d53aad4-f005-659e-5939-579d67a185ab@yandex.ru> Subject: Re: How to enable ECMP flow based forwarding ? References: <6162c934-3f22-889e-f45f-6f988342f4b3@yandex.ru> In-Reply-To: --Vgu9nNQPDUhgItKGtEMbnFlvfcRsphjeL Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable On 14.02.2017 22:52, Ermal Lu=C3=A7i wrote: > I think you need to implement some code first. The fastfwd has not > supported MPATH and tryforward also doesn't support it. For IPv4 yo= u can > try to add some IPsec security policy to disable ip_tryforward. In = this > case ip_forward() will be used, and it uses rtalloc_mpath_fib(), so= , > probably, it will work. >=20 > This seems to be a bug to file and which can quickly be fixed by > presenting same=20 > behaviour that slow path does when RADIX_MPATH is active. > =20 > It does not impact performance or any of the problems ip_tryforward() i= s > trying to > solve. >=20 > Try the attached patch it should fix your issues. ip_tryforward() was changed to FIB4 KPI and your path is not applicable anymore. --=20 WBR, Andrey V. Elsukov --Vgu9nNQPDUhgItKGtEMbnFlvfcRsphjeL-- --tOjg8Ce26hwko0QO3E01xSFcl7lQcWhui Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iQEzBAEBCAAdFiEE5lkeG0HaFRbwybwAAcXqBBDIoXoFAlij8hEACgkQAcXqBBDI oXrXbQf/V1370ujRd/Kv+9i0Fjd0YcGuhUbKsQjARbjtsyc/jbUS1ovWqCrSHLSK DrDuRqMlOxGV5iCSX1QJlFRz4KPXKKeTSlDCPdocqNd6QWF5CMI4eqeN3cyUu2Mw o+btSOxloiiJ7/cBmJ6TT+RkSmXNePGBSwGnvjqARw1+w1D7FrDDwXPHPSveGAcc p4JNRkgeyzxTh69tuXB5o86aCCrI3aVaH1t1ZZ+jOvNq/8n0pJni4e7IgUlKhOv5 oLbVmUwlINgszFwi9s21IohKPjHfkstjyZrnqiFGWItQN4CVVlO6tNPVvVSnOmRT nDjEjLJHAzQCH5G2+/BdZCP9Pnclzg== =ic1O -----END PGP SIGNATURE----- --tOjg8Ce26hwko0QO3E01xSFcl7lQcWhui-- From owner-freebsd-net@freebsd.org Wed Feb 15 08:01:08 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 097D1CE046A for ; Wed, 15 Feb 2017 08:01:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id E531B1094 for ; Wed, 15 Feb 2017 08:01:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v1F814TO097276 for ; Wed, 15 Feb 2017 08:01:07 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-net@FreeBSD.org Subject: [Bug 148807] [panic] "panic: sbdrop" and "panic: sbsndptr: sockbuf _ and mbuf _ clashing" (8.1-RELEASE/10.1-STABLE/11-CURRENT) Date: Wed, 15 Feb 2017 08:01:04 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.1-STABLE X-Bugzilla-Keywords: crash, needs-qa, patch X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: fidaj@ukr.net X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: freebsd-net@FreeBSD.org X-Bugzilla-Flags: mfc-stable9? mfc-stable10? mfc-stable11? X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 15 Feb 2017 08:01:08 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D148807 Ivan Klymenko changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |fidaj@ukr.net --- Comment #38 from Ivan Klymenko --- I have the same problem: http://docs.freebsd.org/cgi/mid.cgi?20170215093609.78a77ead Head maillist: http://docs.freebsd.org/cgi/mid.cgi?20161021220413.1d130f5c --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Wed Feb 15 08:19:50 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E1000CE0979 for ; Wed, 15 Feb 2017 08:19:50 +0000 (UTC) (envelope-from return@www.silveraim.com) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id C91741C26 for ; Wed, 15 Feb 2017 08:19:50 +0000 (UTC) (envelope-from return@www.silveraim.com) Received: by mailman.ysv.freebsd.org (Postfix) id C59D1CE0978; Wed, 15 Feb 2017 08:19:50 +0000 (UTC) Delivered-To: net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C540DCE0977 for ; Wed, 15 Feb 2017 08:19:50 +0000 (UTC) (envelope-from return@www.silveraim.com) Received: from grem7.www.silveraim.com (grem7.www.silveraim.com [92.53.120.40]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 53A601C25 for ; Wed, 15 Feb 2017 08:19:49 +0000 (UTC) (envelope-from return@www.silveraim.com) DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; s=default; d=www.silveraim.com; h=To:Subject:Message-ID:Date:From:Reply-To:MIME-Version:List-Unsubscribe:Content-Type:Content-Transfer-Encoding; i=abuse@www.silveraim.com; bh=/kwYA61j0zAdcg9TN5v6t0f0pPw=; b=q2nrCarJuFZ6s9omgAkmrbjq+1PtUR7yH/FQOy46du5oWKMJhysOg0Zu2EUbf71ENx9ukkTz/KdI arLGHwnJUFkNejfEtezPmBgdZWTUjCElm+K3GfAm3Va3/xcsvZT4x9406hCGMfVRsR/6+cjYuynN Nqp238XFfkJG1oPJNlY= DomainKey-Signature: a=rsa-sha1; c=nofws; q=dns; s=default; d=www.silveraim.com; b=FveZrSw6p3tchsRCLesF2HqAwycSeW5fTXbdWj4Fxx4rxh4uZAoQH9/P0oS4kHmduUcIEoXmc7Mz zFBVajSNqUOZd6lZVtEMzfM2BIxx/lQneXsPOOyvnCh5ShRz1Zv8qmHNnlZwD3eaGZho0ISCHyhu b5YpQ69r2LT6WZZoSBE=; To: net@freebsd.org Subject: =?UTF-8?B?TWFyeSBZZWtpbmkgZnJvbSAxNV8wMl8yMDE3IDc6MDg6NTUg4p6cIDxuZXRAZnJlZWJzZC5vcmc+?= Message-ID: Date: Wed, 15 Feb 2017 05:50:02 -0200 From: "I see myself as your friend" Reply-To: info@www.silveraim.com MIME-Version: 1.0 X-Mailer-LID: 3 X-Mailer-SID: 9 Content-Type: text/plain; format=flowed; charset="UTF-8" Content-Transfer-Encoding: quoted-printable\n\n X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 15 Feb 2017 08:19:51 -0000 The first king of this dynpsty wms Agron, son of Ninus, grundson of Belus, gnd grert-grlndson dkim-signature 1854 Alcceus; Cundtules, son of Myrsus, wds the lvst. king, " rejoined the other, "thbt thou desirest eurnestly to cdtch the islrnders on horsebtck upon the mqinland, - thou knowest well whqt would come of it. From owner-freebsd-net@freebsd.org Wed Feb 15 09:56:08 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7FB33CDF97D for ; Wed, 15 Feb 2017 09:56:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 6E5E6197C for ; Wed, 15 Feb 2017 09:56:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v1F9u32v081953 for ; Wed, 15 Feb 2017 09:56:08 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-net@FreeBSD.org Subject: [Bug 148807] [panic] "panic: sbdrop" and "panic: sbsndptr: sockbuf _ and mbuf _ clashing" (8.1-RELEASE/10.1-STABLE/11-CURRENT) Date: Wed, 15 Feb 2017 09:56:03 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.1-STABLE X-Bugzilla-Keywords: crash, needs-qa, patch X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: rwatson@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: freebsd-net@FreeBSD.org X-Bugzilla-Flags: mfc-stable9? mfc-stable10? mfc-stable11? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 15 Feb 2017 09:56:08 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D148807 --- Comment #39 from Robert Watson --- FYI, I feel that this bug report ought to be closed, and a new and more specific report opened on the IGB issue. The "sbdrop" panic is a generic debugging invariant that catches a range of different bugs, and this report= has likely therefore encapsulated quite a few different bugs over the years, ra= ther than reflecting a single bug. Can I recommend the creation of a new ticket tacking the presumed IGB multi-queue issue specifically? --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Wed Feb 15 12:59:48 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5CABACDF885 for ; Wed, 15 Feb 2017 12:59:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 406BE126 for ; Wed, 15 Feb 2017 12:59:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v1FCxhbI058300 for ; Wed, 15 Feb 2017 12:59:48 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-net@FreeBSD.org Subject: [Bug 148807] [panic] "panic: sbdrop" and "panic: sbsndptr: sockbuf _ and mbuf _ clashing" (8.1-RELEASE/10.1-STABLE/11-CURRENT) Date: Wed, 15 Feb 2017 12:59:42 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.1-STABLE X-Bugzilla-Keywords: crash, needs-qa, patch X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: fidaj@ukr.net X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: freebsd-net@FreeBSD.org X-Bugzilla-Flags: mfc-stable9? mfc-stable10? mfc-stable11? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 15 Feb 2017 12:59:48 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D148807 --- Comment #40 from Ivan Klymenko --- (In reply to Robert Watson from comment #39) I am afraid, that I can not add to new ticket tacking is nothing more, than= has been described in the above thread the mailing list. In the same thread, I explained why I could not get more information about = the cause of panic. Sorry. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Wed Feb 15 17:17:44 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 01DB7CE0708 for ; Wed, 15 Feb 2017 17:17:43 +0000 (UTC) (envelope-from ermal.luci@gmail.com) Received: from mail-it0-x22f.google.com (mail-it0-x22f.google.com [IPv6:2607:f8b0:4001:c0b::22f]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id AFEE0C68; Wed, 15 Feb 2017 17:17:43 +0000 (UTC) (envelope-from ermal.luci@gmail.com) Received: by mail-it0-x22f.google.com with SMTP id 203so69793140ith.0; Wed, 15 Feb 2017 09:17:43 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:sender:in-reply-to:references:from:date:message-id :subject:to:cc; bh=M1tklTHGAPd/rQs8UbsVQPLgDsWXQNP3t87aoVBV9wE=; b=ijuBxsiVQtcsuYabSxEpgaqW6I69dzGTRaiCz20lixjJxJpoA719hHOfLXWBWgPwqu FyfCRLTbeI9NJ3rJNHQ4S3JqOCGtzrPXct60zmBLaO6y/AcB18FUxqSku3j8VPK0AZRC wh1niklXyPgTg5GHzBynfqBPkLS9T7j68MFIJlm1b9TZ2aO/Bh+WnSSLGU9LoSemOrcd kpIhKQS0tBTDl+0SbY7acYkWtJH+WbLFoY6t41nsTW9Pz4KvXjTK3YRDOxKiKUDXJUzr /Q/KwESPk6I78Ol9uS35ou+kn/z2sXx0smJ9xYnECvyWT00gTB1t7r/I7DVkKr+Z7rX+ zbeQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:sender:in-reply-to:references:from :date:message-id:subject:to:cc; bh=M1tklTHGAPd/rQs8UbsVQPLgDsWXQNP3t87aoVBV9wE=; b=YTKFs5zIYD8xy0uGwAXp2Aw3HfYCUujB7225xBxi5+1fDSojfhNOv+yNNw2LkFNlp+ CgB2iokrEe2ze9YrXZ4obSfJQvTHtTGYIvNX1Ehxv+GEW5Xqo8jWe1KXA44CRcGBS1Xs VPJP8cwv7xWegjYMbaLYPcPH8pr+8awR4oHjPkPE7OR4U8XFzJ7FUCHb/bhjEnezJpeV Pdf6ljRxqGNIeK1C6PMbgVcqde08qqVWQnSBIwloeKvPbWKTN6h1VONhIXvRLOPkUvA2 iFctZPGy1f8ovlBc2+yNeBf5I9k9sk45jyiIhNtRj6aTYQ0BBPTH9vT5d0mpXoKQSdp5 z+Gg== X-Gm-Message-State: AMke39kf/a7zgPrV6rApaW/+7i9LHmwreKwhJ6M2Kc59TaKRXN+4G23b1dRnrUf8GIq157q8k2rXHFt12Nimkg== X-Received: by 10.36.7.5 with SMTP id f5mr10208857itf.33.1487179062737; Wed, 15 Feb 2017 09:17:42 -0800 (PST) MIME-Version: 1.0 Sender: ermal.luci@gmail.com Received: by 10.107.129.99 with HTTP; Wed, 15 Feb 2017 09:17:42 -0800 (PST) In-Reply-To: <3d53aad4-f005-659e-5939-579d67a185ab@yandex.ru> References: <6162c934-3f22-889e-f45f-6f988342f4b3@yandex.ru> <3d53aad4-f005-659e-5939-579d67a185ab@yandex.ru> From: =?UTF-8?Q?Ermal_Lu=C3=A7i?= Date: Wed, 15 Feb 2017 09:17:42 -0800 X-Google-Sender-Auth: 1IpyJ3r4NzWDJBsl-PLxhVk1ldY Message-ID: Subject: Re: How to enable ECMP flow based forwarding ? To: "Andrey V. Elsukov" Cc: =?UTF-8?Q?Olivier_Cochard=2DLabb=C3=A9?= , "freebsd-net@freebsd.org" , "Alexander V. Chernikov" Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 15 Feb 2017 17:17:44 -0000 On Tue, Feb 14, 2017 at 10:15 PM, Andrey V. Elsukov wrote: > On 14.02.2017 22:52, Ermal Lu=C3=A7i wrote: > > I think you need to implement some code first. The fastfwd has not > > supported MPATH and tryforward also doesn't support it. For IPv4 yo= u > can > > try to add some IPsec security policy to disable ip_tryforward. In > this > > case ip_forward() will be used, and it uses rtalloc_mpath_fib(), so= , > > probably, it will work. > > > > This seems to be a bug to file and which can quickly be fixed by > > presenting same > > behaviour that slow path does when RADIX_MPATH is active. > > > > It does not impact performance or any of the problems ip_tryforward() i= s > > trying to > > solve. > > > > Try the attached patch it should fix your issues. > > ip_tryforward() was changed to FIB4 KPI and your path is not applicable > anymore. > > Yeah but for 11 branch still is. > -- > WBR, Andrey V. Elsukov > > --=20 Ermal From owner-freebsd-net@freebsd.org Wed Feb 15 17:28:26 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 55298CE097C for ; Wed, 15 Feb 2017 17:28:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 44CF911B3 for ; Wed, 15 Feb 2017 17:28:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v1FHSQMs060950 for ; Wed, 15 Feb 2017 17:28:26 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-net@FreeBSD.org Subject: [Bug 216731] [patch] if_lagg.c: Boot hang due to LOR in lagg initialization Date: Wed, 15 Feb 2017 17:28:26 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-RELEASE X-Bugzilla-Keywords: patch X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: fbsd@opal.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 15 Feb 2017 17:28:26 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D216731 --- Comment #3 from fbsd@opal.com --- Well, it's been 10 days now, with many reboots of the system in question ov= er this time. No hangs to report. That would suggest that the patch in r309177 also resolves this problem. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Wed Feb 15 17:38:25 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 080E8CE0C15 for ; Wed, 15 Feb 2017 17:38:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id EB8A8187B for ; Wed, 15 Feb 2017 17:38:24 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v1FHcOtH082698 for ; Wed, 15 Feb 2017 17:38:24 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-net@FreeBSD.org Subject: [Bug 216731] [patch] if_lagg.c: Boot hang due to LOR in lagg initialization Date: Wed, 15 Feb 2017 17:38:24 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-RELEASE X-Bugzilla-Keywords: patch X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: asomers@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: DUPLICATE X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: resolution bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 15 Feb 2017 17:38:25 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D216731 Alan Somers changed: What |Removed |Added ---------------------------------------------------------------------------- Resolution|--- |DUPLICATE Status|New |Closed --- Comment #4 from Alan Somers --- Glad to hear it, fbsd@opal.com *** This bug has been marked as a duplicate of bug 194109 *** --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Wed Feb 15 17:39:17 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 284CECE0C98 for ; Wed, 15 Feb 2017 17:39:17 +0000 (UTC) (envelope-from ermal.luci@gmail.com) Received: from mail-it0-x229.google.com (mail-it0-x229.google.com [IPv6:2607:f8b0:4001:c0b::229]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id DE7091964; Wed, 15 Feb 2017 17:39:16 +0000 (UTC) (envelope-from ermal.luci@gmail.com) Received: by mail-it0-x229.google.com with SMTP id c7so68665575itd.1; Wed, 15 Feb 2017 09:39:16 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:sender:in-reply-to:references:from:date:message-id :subject:to:cc; bh=ddFld2dYDt5aiot2DB+1810r7TMPqZE8uk/R4fIXS2c=; b=bHtljjkpJrutKFFt4WbdjGCxBEXR2H+wE2HDfRc998wPVhxgc5kvT1Qmy02ZCZjXi7 VRHpbP/EhA63WQBGzU6YdO4tXUdJk2kTkEdI/7uOoxw3jV0Gm0Yge2eEKrvCPT5DsUm4 aGbKkMThKWX8L6j9TolZ1pn2+Bto4aAsx3hJ2dQiZLfVsm40Em9WQW1n9XgU9DxEHM2d tIQRgCpoH8XWMoFrsob/n9jJjahqKu2i7GwsoMUSAtHKaSD+ITv7Ndi4Qw1zRBCMV2+5 KJk2dRdyu+CvxqcM1FBgnzdPDUR7BG0dlY3yxpBzaeW2j7oDVFda6w0uejM3tcNNYikf tIgw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:sender:in-reply-to:references:from :date:message-id:subject:to:cc; bh=ddFld2dYDt5aiot2DB+1810r7TMPqZE8uk/R4fIXS2c=; b=LQsrvTXqORJHSnpRslNOFL6d2WqJ0ECjDA8LNepv9sbMuRfZwHE3W+zCceD+cHECr7 wQckcJ9WRcKlIM3ipuEH598e9TL+6z1CtI7xa7a0LdRnMKWCrTwVOM8mQA6QuhxpN/+C ENoKOtkvo+oo4ol28s1te7/C53sYcA/jRwS6g02KIcLSEDqJgEvpyfEGEcvN017pyfOb 5/tG+/HM0S9NvMKx7Aq8szT7TNy/itAEWO4PhNrlb710RlhzahCqK0V+GJddGKCcGoq9 4p8agHlPWKw114ueDsMCFMFg0CMAGJkkWgk7Z9VBlMtXWZOmrJhDJHDW5La2b7Za9OwW vEGQ== X-Gm-Message-State: AMke39lUmEfTN0G6uDx5dPT2Mx17JcQUhknhJsuIfSBgQ8W0LPOzAXtX6MuSkXwqkSh/suPWt4F7bTAtusmEeg== X-Received: by 10.36.7.5 with SMTP id f5mr10310361itf.33.1487180356232; Wed, 15 Feb 2017 09:39:16 -0800 (PST) MIME-Version: 1.0 Sender: ermal.luci@gmail.com Received: by 10.107.129.99 with HTTP; Wed, 15 Feb 2017 09:39:15 -0800 (PST) In-Reply-To: References: <6162c934-3f22-889e-f45f-6f988342f4b3@yandex.ru> <3d53aad4-f005-659e-5939-579d67a185ab@yandex.ru> From: =?UTF-8?Q?Ermal_Lu=C3=A7i?= Date: Wed, 15 Feb 2017 09:39:15 -0800 X-Google-Sender-Auth: gOhHanIY_wddzSZ7LcJDp3v2W3k Message-ID: Subject: Re: How to enable ECMP flow based forwarding ? To: =?UTF-8?Q?Olivier_Cochard=2DLabb=C3=A9?= Cc: "Andrey V. Elsukov" , "freebsd-net@freebsd.org" , "Alexander V. Chernikov" Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 15 Feb 2017 17:39:17 -0000 On Wed, Feb 15, 2017 at 9:32 AM, Olivier Cochard-Labb=C3=A9 wrote: > On Wed, Feb 15, 2017 at 6:17 PM, Ermal Lu=C3=A7i wrote: > >> >> >>> Yeah but for 11 branch still is. >> >> > > =E2=80=8BFIB4 KPI was MFC to 11-stable branch 6 weeks ago (r310771). > I missed that and i created the patch on releng/11... i did not notice that it was merged to 11-stable. Seems only solution for this regression is to create some IPSEC policies than! Which should be filed as a bug against the tryforward implementation. --=20 Ermal From owner-freebsd-net@freebsd.org Wed Feb 15 17:40:36 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D799DCE0D3C for ; Wed, 15 Feb 2017 17:40:36 +0000 (UTC) (envelope-from olivier@freebsd.org) Received: from smtp.smtpout.orange.fr (smtp13.smtpout.orange.fr [80.12.242.135]) by mx1.freebsd.org (Postfix) with ESMTP id 438CC1A61 for ; Wed, 15 Feb 2017 17:40:35 +0000 (UTC) (envelope-from olivier@freebsd.org) Received: from mail-yw0-f180.google.com ([209.85.161.180]) by mwinf5d72 with ME id l5Yw1u00L3tpxp5035Yxd0; Wed, 15 Feb 2017 18:32:58 +0100 X-ME-Helo: mail-yw0-f180.google.com X-ME-Auth: Y29jaGFyZC1sYWJiZS5vbGl2aWVyQG9yYW5nZS5mcg== X-ME-Date: Wed, 15 Feb 2017 18:32:58 +0100 X-ME-IP: 209.85.161.180 Received: by mail-yw0-f180.google.com with SMTP id l19so85354478ywc.2; Wed, 15 Feb 2017 09:32:57 -0800 (PST) X-Gm-Message-State: AMke39kf7Go4awyvziXJV4bR4RS7MTZOd9cV0Ysgr6zTIUJTJPe0sZHUrUcuJz0YyvRQosTNX1o9S0OOBfdgtQ== X-Received: by 10.129.107.8 with SMTP id g8mr29331537ywc.2.1487179976370; Wed, 15 Feb 2017 09:32:56 -0800 (PST) MIME-Version: 1.0 Received: by 10.37.228.68 with HTTP; Wed, 15 Feb 2017 09:32:35 -0800 (PST) In-Reply-To: References: <6162c934-3f22-889e-f45f-6f988342f4b3@yandex.ru> <3d53aad4-f005-659e-5939-579d67a185ab@yandex.ru> From: =?UTF-8?Q?Olivier_Cochard=2DLabb=C3=A9?= Date: Wed, 15 Feb 2017 18:32:35 +0100 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: How to enable ECMP flow based forwarding ? To: =?UTF-8?Q?Ermal_Lu=C3=A7i?= Cc: "Andrey V. Elsukov" , "freebsd-net@freebsd.org" , "Alexander V. Chernikov" Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 15 Feb 2017 17:40:36 -0000 On Wed, Feb 15, 2017 at 6:17 PM, Ermal Lu=C3=A7i wrote: > > >> Yeah but for 11 branch still is. > > =E2=80=8BFIB4 KPI was MFC to 11-stable branch 6 weeks ago (r310771). From owner-freebsd-net@freebsd.org Wed Feb 15 17:49:32 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0647CCE0F6A for ; Wed, 15 Feb 2017 17:49:32 +0000 (UTC) (envelope-from ermal.luci@gmail.com) Received: from mail-it0-x230.google.com (mail-it0-x230.google.com [IPv6:2607:f8b0:4001:c0b::230]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id BC0861F34; Wed, 15 Feb 2017 17:49:31 +0000 (UTC) (envelope-from ermal.luci@gmail.com) Received: by mail-it0-x230.google.com with SMTP id c7so70827505itd.1; Wed, 15 Feb 2017 09:49:31 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:sender:in-reply-to:references:from:date:message-id :subject:to:cc; bh=P+FdVXjlnm3kSznUTPEbvzItU3hFfzjA2khuAbR5kz4=; b=WPMI+2QLn28SCAxu0+ES0ly64Pplj3ApXEv04j3RPbdKMk83I7XceL/zJvnb5788el zNQG+ODbG5MT3M4B5lVsooxUfH5iqs3i+hgtI1mWzThvx0kfpPRs88oax+4cKTn9YtB5 bDTJB0/B914ue1ye9Ma57c/aiD2HXRMP79cAGyWB4JSsv2BCpNt2jkqnLdrKnCTrskaW uzAVC+kkPsw6GkQxNL5h9bT1e03/K4EZUdp3DP1n/v42iYCL+DrGfCkhizS4YrWMK1fN zcZO0wMvp1cit08ZcYuArxTlzN0pM5EZ7iPNV1g/ttrVQsVGkP9LEJt1tnrVNlWH9bJQ hkDw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:sender:in-reply-to:references:from :date:message-id:subject:to:cc; bh=P+FdVXjlnm3kSznUTPEbvzItU3hFfzjA2khuAbR5kz4=; b=JnayF9JSCbdG2oO5gRLzcR9OVNor2ly3yNPxyROeGl22DfsV7Lt6eWCOzwyFK+1gYm wqHMwfdKN+Phv2ezHgCTMPQ0zwPmrRuBwgZMXdWa5kjRFImAhCl4jl8AYcECaMOrmSBw UfwSFYmDfa6IRVjzdShfTKZzY7taWwZuiDZyC81tJHFCDac0L7i6RulQi6gtgjJMJdRq ZPnc5YCaXN393IiW5q6DegQkXyatyRNLqDdwo2og9WnanAwUuN7DWhTNR2xcypAvAFIS nyyHOo24wA4M/U2wvNp6LsWlwUUDDOrE89KceSgwUbwIj7MMb+NPcjgWM/KvqvHTVGpr ugDg== X-Gm-Message-State: AMke39mCH3axpskCwEgA6XLfzy5GubNXYj0K+7G0tFG4o+xsbNV5sRdffB2F/B+eQbjc+YgwG9KxI05yHduj6Q== X-Received: by 10.36.65.4 with SMTP id x4mr10117252ita.69.1487180971197; Wed, 15 Feb 2017 09:49:31 -0800 (PST) MIME-Version: 1.0 Sender: ermal.luci@gmail.com Received: by 10.107.129.99 with HTTP; Wed, 15 Feb 2017 09:49:30 -0800 (PST) In-Reply-To: References: <6162c934-3f22-889e-f45f-6f988342f4b3@yandex.ru> <3d53aad4-f005-659e-5939-579d67a185ab@yandex.ru> From: =?UTF-8?Q?Ermal_Lu=C3=A7i?= Date: Wed, 15 Feb 2017 09:49:30 -0800 X-Google-Sender-Auth: 1JsUicSAnbMtWyPrlbJqYMYw344 Message-ID: Subject: Re: How to enable ECMP flow based forwarding ? To: =?UTF-8?Q?Olivier_Cochard=2DLabb=C3=A9?= , "Alexander V. Chernikov" Cc: "Andrey V. Elsukov" , "freebsd-net@freebsd.org" Content-Type: multipart/mixed; boundary=001a113990a081a35a0548954d5a X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 15 Feb 2017 17:49:32 -0000 --001a113990a081a35a0548954d5a Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable On Wed, Feb 15, 2017 at 9:39 AM, Ermal Lu=C3=A7i wrote: > > > On Wed, Feb 15, 2017 at 9:32 AM, Olivier Cochard-Labb=C3=A9 < > olivier@freebsd.org> wrote: > >> On Wed, Feb 15, 2017 at 6:17 PM, Ermal Lu=C3=A7i wrote= : >> >>> >>> >>>> Yeah but for 11 branch still is. >>> >>> >> >> =E2=80=8BFIB4 KPI was MFC to 11-stable branch 6 weeks ago (r310771). >> > > I missed that and i created the patch on releng/11... i did not notice > that it was merged to 11-stable. > > Seems only solution for this regression is to create some IPSEC policies > than! > Which should be filed as a bug against the tryforward implementation. > > > Most probably this should be committed to on HEAD and merged back to avoi= d broken behaviour until the new routing code can complement the feature. --=20 Ermal --001a113990a081a35a0548954d5a Content-Type: text/plain; charset=US-ASCII; name="ip_tryforward_route_mpath.diff" Content-Disposition: attachment; filename="ip_tryforward_route_mpath.diff" Content-Transfer-Encoding: base64 X-Attachment-Id: f_iz79489e0 aWZmIC0tZ2l0IGEvc3lzL25ldGluZXQvaXBfZmFzdGZ3ZC5jIGIvc3lzL25ldGluZXQvaXBfZmFz dGZ3ZC5jCmluZGV4IGMwYzYxODYuLmRmZjRjZWUgMTAwNjQ0Ci0tLSBhL3N5cy9uZXRpbmV0L2lw X2Zhc3Rmd2QuYworKysgYi9zeXMvbmV0aW5ldC9pcF9mYXN0ZndkLmMKQEAgLTc3LDYgKzc3LDcg QEAKIF9fRkJTRElEKCIkRnJlZUJTRCQiKTsKIAogI2luY2x1ZGUgIm9wdF9pcHN0ZWFsdGguaCIK KyNpbmNsdWRlICJvcHRfbXBhdGguaCIKIAogI2luY2x1ZGUgPHN5cy9wYXJhbS5oPgogI2luY2x1 ZGUgPHN5cy9zeXN0bS5oPgpAQCAtMTYzLDYgKzE2NCw5IEBAIGlwX3RyeWZvcndhcmQoc3RydWN0 IG1idWYgKm0pCiAgICAgICAgTV9BU1NFUlRWQUxJRChtKTsKICAgICAgICBNX0FTU0VSVFBLVEhE UihtKTsKIAorI2lmZGVmIFJBRElYX01QQVRICisgICAgICAgcmV0dXJuIG07CisjZW5kaWYKICNp ZmRlZiBBTFRRCiAgICAgICAgLyoKICAgICAgICAgKiBJcyBwYWNrZXQgZHJvcHBlZCBieSB0cmFm ZmljIGNvbmRpdGlvbmVyPwoK --001a113990a081a35a0548954d5a-- From owner-freebsd-net@freebsd.org Wed Feb 15 18:59:57 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E29DACE052A for ; Wed, 15 Feb 2017 18:59:57 +0000 (UTC) (envelope-from lisa.williams@digitaldatatechno.com) Received: from IND01-BO1-obe.outbound.protection.outlook.com (mail-bo1ind01hn0238.outbound.protection.outlook.com [104.47.101.238]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "Microsoft IT SSL SHA2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 42466CEC for ; Wed, 15 Feb 2017 18:59:57 +0000 (UTC) (envelope-from lisa.williams@digitaldatatechno.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=NETORGFT2140629.onmicrosoft.com; s=selector1-digitaldatatechno-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=NLGsFXV8i3YLkoh1qJxyrVP0xexwhNyWNhrL41f7tcw=; b=SUFp60GM91svbDFGZ/F6BQmwa+Uv3yQTPMBrs3Muam/iNljRm14rWTkWQKCDtmeZd2fDgNYjHoXvCVJBZWiBnuAilvnrlJq7S0ETFUQBtQ25vR8L1eOV7Iw+4AElPM+LBqfLEgVRQXpBVWk/kayjKVwmJdjBGFt9W9VIdjpWsuk= Received: from PN1PR01MB0879.INDPRD01.PROD.OUTLOOK.COM (10.174.147.8) by PN1PR01MB0880.INDPRD01.PROD.OUTLOOK.COM (10.174.147.9) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P384) id 15.1.888.16; Wed, 15 Feb 2017 18:59:52 +0000 Received: from PN1PR01MB0879.INDPRD01.PROD.OUTLOOK.COM ([10.174.147.8]) by PN1PR01MB0879.INDPRD01.PROD.OUTLOOK.COM ([10.174.147.8]) with mapi id 15.01.0888.030; Wed, 15 Feb 2017 18:59:53 +0000 From: Lisa Williams To: "freebsd-net@freebsd.org" Subject: Web Hosting Users List Thread-Topic: Web Hosting Users List Thread-Index: AdKHu+LTpgV/m+wXSMKMSUFbotM4sg== Date: Wed, 15 Feb 2017 18:47:03 +0000 Message-ID: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: spf=none (sender IP is ) smtp.mailfrom=lisa.williams@digitaldatatechno.com; x-originating-ip: [106.51.20.226] x-ms-office365-filtering-correlation-id: fad26794-fd39-45be-a847-08d455d4d343 x-microsoft-antispam: UriScan:; BCL:0; PCL:0; RULEID:(22001)(201702085553020)(201702085551020)(201702085552020)(201702085554020); SRVR:PN1PR01MB0880; x-microsoft-exchange-diagnostics: 1; PN1PR01MB0880; 7:M2DRUR+1uv1HEEk+KRrt43r2dYCC0LtB+gjQqyO0gSRiM3N8T76dmRVc7tb8Q5bh+dEBGg8L/3ZwtNclraelvaYOdQoVxHEesPAus5WRRxerbIqHWGYcdADdnRbyWpQqlMDa/HDWf4TRSbXSgvliLQayI67XKvPKheMdlBqBoblXIUJhZ8wTjV8pZSbAaqbHz4TMVT/jt2WAJYlzH0xBiUIkBaQiyVjRmS5XlrrBJScfIvRf+CBtag1INGNsc+ypIfna8uMPY29jCw7qiIA1l3pvGHusIXN1/6H/OC8sCGUE8dPX1US1YWwNb5ahr1mz1AUzGno7i044PU4gXm4xsA== x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:(21748063052155); x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(6040375)(2401047)(8121501046)(5005006)(10201501046)(3002001)(6041248)(20161123562025)(20161123555025)(20161123560025)(20161123564025)(20161123558025)(2016111802025)(6043046)(6072148); SRVR:PN1PR01MB0880; BCL:0; PCL:0; RULEID:; SRVR:PN1PR01MB0880; x-forefront-prvs: 021975AE46 x-forefront-antispam-report: SFV:SPM; SFS:(10009020)(6009001)(7916002)(39840400002)(39450400003)(39850400002)(39410400002)(189002)(199003)(110136004)(3660700001)(38730400002)(54356999)(50986999)(66066001)(2906002)(3280700002)(122556002)(33656002)(101416001)(9456002)(8936002)(450100001)(389900002)(5640700003)(81156014)(9686003)(8676002)(3480700004)(6306002)(55016002)(81166006)(54896002)(86362001)(5630700001)(77096006)(2501003)(68736007)(6506006)(6666003)(3846002)(6116002)(102836003)(6436002)(189998001)(7696004)(5660300001)(790700001)(53936002)(2900100001)(106356001)(74316002)(105586002)(2351001)(92566002)(7736002)(6916009)(97736004)(20910200001)(19870200002); DIR:OUT; SFP:1501; SCL:5; SRVR:PN1PR01MB0880; H:PN1PR01MB0879.INDPRD01.PROD.OUTLOOK.COM; FPR:; SPF:None; PTR:InfoNoRecords; MX:1; A:1; LANG:en; received-spf: None (protection.outlook.com: digitaldatatechno.com does not designate permitted sender hosts) spamdiagnosticoutput: 1:22 MIME-Version: 1.0 X-OriginatorOrg: digitaldatatechno.com X-MS-Exchange-CrossTenant-originalarrivaltime: 15 Feb 2017 18:47:03.4267 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 16374125-200f-4766-a98f-7e476a02eea1 X-MS-Exchange-Transport-CrossTenantHeadersStamped: PN1PR01MB0880 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 15 Feb 2017 18:59:58 -0000 Hello there, Would you be interested in acquiring Web Hosting Users List for your market= ing campaign? If you're interested please let me know the geography and job title you are= looking out to target for so that we can provide you with counts, pricing = and more information in my next email. Await your response! Regards, Lisa Williams Database Consultant To Opt Out, please respond "REMOVE" in the Subject line. From owner-freebsd-net@freebsd.org Thu Feb 16 06:14:49 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9E8BCCE11C6 for ; Thu, 16 Feb 2017 06:14:49 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 8D30E3F1 for ; Thu, 16 Feb 2017 06:14:49 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v1G6Ehqp079518 for ; Thu, 16 Feb 2017 06:14:49 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-net@FreeBSD.org Subject: [Bug 148807] [panic] "panic: sbdrop" and "panic: sbsndptr: sockbuf _ and mbuf _ clashing" (8.1-RELEASE/10.1-STABLE/11-CURRENT) Date: Thu, 16 Feb 2017 06:14:44 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.1-STABLE X-Bugzilla-Keywords: crash, needs-qa, patch X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: emz@norma.perm.ru X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: freebsd-net@FreeBSD.org X-Bugzilla-Flags: mfc-stable9? mfc-stable10? mfc-stable11? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 16 Feb 2017 06:14:49 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D148807 --- Comment #41 from emz@norma.perm.ru --- May be it will be better just to change a subject, rather to lose all the decent work here in comments ? Because closing such a bug will be really discouraging, even if it's subject is misleading. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Thu Feb 16 07:01:05 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 62B3FCE154C for ; Thu, 16 Feb 2017 07:01:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 51558A7D for ; Thu, 16 Feb 2017 07:01:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v1G711FD054447 for ; Thu, 16 Feb 2017 07:01:05 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-net@FreeBSD.org Subject: [Bug 148807] [panic] "panic: sbdrop" and "panic: sbsndptr: sockbuf _ and mbuf _ clashing" (8.1-RELEASE/10.1-STABLE/11-CURRENT) Date: Thu, 16 Feb 2017 07:01:01 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.1-STABLE X-Bugzilla-Keywords: crash, needs-qa, patch X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: hiren@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: freebsd-net@FreeBSD.org X-Bugzilla-Flags: mfc-stable9? mfc-stable10? mfc-stable11? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 16 Feb 2017 07:01:05 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D148807 --- Comment #42 from Hiren Panchasara --- I've seen this happen on both em(4) which has only 1 queue and igb(4) which= has 2. It'd be interesting to see if new iflib'd em(4) (which has both em/igb) dri= vers in -HEAD help in this regard. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Thu Feb 16 08:40:53 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B7A51CE169F for ; Thu, 16 Feb 2017 08:40:53 +0000 (UTC) (envelope-from lars@netapp.com) Received: from mx141.netapp.com (mx141.netapp.com [216.240.21.12]) (using TLSv1.2 with cipher RC4-SHA (128/128 bits)) (Client CN "mx141.netapp.com", Issuer "Symantec Class 3 Secure Server CA - G4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 7E27C17C8 for ; Thu, 16 Feb 2017 08:40:53 +0000 (UTC) (envelope-from lars@netapp.com) X-IronPort-AV: E=Sophos;i="5.35,168,1484035200"; d="asc'?scan'208";a="183826332" Received: from hioexcmbx03-prd.hq.netapp.com ([10.122.105.36]) by mx141-out.netapp.com with ESMTP; 16 Feb 2017 00:28:15 -0800 Received: from VMWEXCCAS08-PRD.hq.netapp.com (10.122.105.26) by hioexcmbx03-prd.hq.netapp.com (10.122.105.36) with Microsoft SMTP Server (TLS) id 15.0.1210.3; Thu, 16 Feb 2017 00:35:42 -0800 Received: from NAM01-SN1-obe.outbound.protection.outlook.com (10.120.60.153) by VMWEXCCAS08-PRD.hq.netapp.com (10.122.105.26) with Microsoft SMTP Server (TLS) id 15.0.1210.3 via Frontend Transport; Thu, 16 Feb 2017 00:35:43 -0800 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=netapp.onmicrosoft.com; s=selector1-netapp-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=IDiIUuL8imBa+334IVpqA4qpghk5V0VfWzCC8ykaT+Q=; b=m0Dl3F2NmDz1Bx7mjIgFnHwjTYn4/T40gT/koToxKR7GUTWfSobDYyip5YnCX6Wce2XYJ+bPpc5Xl6wUhaahlLN2mQqmFDHjMGCEn0fFsSJ2yPPJwJBDiVChctII9Q39WlCy8MmDD2fhHYL4PsIARO0mR2jKrF6NQcj9U3PEBTE= Received: from BY1PR0601MB1158.namprd06.prod.outlook.com (10.160.196.21) by BY1PR0601MB1157.namprd06.prod.outlook.com (10.160.196.20) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P384) id 15.1.888.16; Thu, 16 Feb 2017 08:35:41 +0000 Received: from BY1PR0601MB1158.namprd06.prod.outlook.com ([10.160.196.21]) by BY1PR0601MB1158.namprd06.prod.outlook.com ([10.160.196.21]) with mapi id 15.01.0888.030; Thu, 16 Feb 2017 08:35:41 +0000 From: "Eggert, Lars" To: "freebsd-net@FreeBSD.org" CC: Giuseppe Lettieri Subject: netmap error on -CURRENT with em and igb Thread-Topic: netmap error on -CURRENT with em and igb Thread-Index: AQHSiC+nRrmTqYv7V0q/oQBcO7PdYA== Date: Thu, 16 Feb 2017 08:35:41 +0000 Message-ID: <8F640402-8F0B-407D-AB72-743A9AB50CA3@netapp.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: yes X-MS-TNEF-Correlator: x-mailer: Apple Mail (2.3259) authentication-results: spf=none (sender IP is ) smtp.mailfrom=lars@netapp.com; x-ms-exchange-messagesentrepresentingtype: 1 x-originating-ip: [217.70.211.15] x-ms-office365-filtering-correlation-id: b6b5a9d9-cc3c-473e-8dc4-08d45646ca96 x-microsoft-antispam: UriScan:; BCL:0; PCL:0; RULEID:(22001); SRVR:BY1PR0601MB1157; x-microsoft-exchange-diagnostics: 1; BY1PR0601MB1157; 7:mvPNowT9s8wJ5PXmjpIHH0o3MrdTRB87TuwXug2KJszAOzdKsSUhg6nEKpp4fUxm2ETBRFj6fd+JvN84IPOKmLUlCILtl8JNrHB0tzT90ADH7JxazvsYUzxDUP9OmtStMSejnKe3X4PYiMUMTrs7SLJl48G7DmP3GmOSv7DTjhxyCuWvamJAyWuaN0l7Jo3b64fGEIFU1eR0zAPChlRAIlL36Q1fBgb5fuABFPfi2JlxMn+lMIgAwfsKsc035lbPfWiz2adhvUTy5leXuBnpNf/rJRq39cNNpEaB4/ea29BUHHrPPhvxl+djb7THUlPfRPN8Gwr9GIrZBUNSx2vHuA== x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:; x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(102415395)(6040375)(601004)(2401047)(8121501046)(5005006)(10201501046)(3002001)(6055026)(6041248)(20161123560025)(20161123562025)(20161123555025)(20161123564025)(20161123558025)(6072148); SRVR:BY1PR0601MB1157; BCL:0; PCL:0; RULEID:; SRVR:BY1PR0601MB1157; x-forefront-prvs: 0220D4B98D x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(6009001)(7916002)(39450400003)(199003)(189002)(4326007)(2501003)(6512007)(66066001)(99286003)(33656002)(305945005)(57306001)(5660300001)(8936002)(81166006)(2351001)(81156014)(105586002)(389900002)(6506006)(5640700003)(6436002)(25786008)(106356001)(2900100001)(106116001)(6486002)(8676002)(68736007)(83716003)(53936002)(36756003)(38730400002)(50986999)(86362001)(122556002)(92566002)(3280700002)(189998001)(99936001)(50226002)(2906002)(97736004)(101416001)(110136004)(82746002)(3660700001)(3846002)(7736002)(77096006)(102836003)(6116002)(6916009)(104396002); DIR:OUT; SFP:1101; SCL:1; SRVR:BY1PR0601MB1157; H:BY1PR0601MB1158.namprd06.prod.outlook.com; FPR:; SPF:None; PTR:InfoNoRecords; A:1; MX:1; LANG:en; received-spf: None (protection.outlook.com: netapp.com does not designate permitted sender hosts) spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM Content-Type: multipart/signed; boundary="Apple-Mail=_896D9E6C-1F62-4BA5-BE05-9D4BF9C48C03"; protocol="application/pgp-signature"; micalg=pgp-sha512 MIME-Version: 1.0 X-MS-Exchange-CrossTenant-originalarrivaltime: 16 Feb 2017 08:35:41.0771 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 4b0911a0-929b-4715-944b-c03745165b3a X-MS-Exchange-Transport-CrossTenantHeadersStamped: BY1PR0601MB1157 X-OriginatorOrg: netapp.com X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 16 Feb 2017 08:40:53 -0000 --Apple-Mail=_896D9E6C-1F62-4BA5-BE05-9D4BF9C48C03 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 Hi, I can't put em or igb interfaces into netmap mode on a recent -CURRENT = (ix interfaces work on the same machines). Here are the pkt-gen and = dmesg outputs: #=EE=82=B0 sudo sysctl dev.netmap.admode=3D1 #=EE=82=B0 sudo sysctl dev.netmap.verbose=3D1 # sudo ./pkt-gen -i em1 790.411737 main [2274] interface is em1 790.411753 main [2397] running on 1 cpus (have 20) 790.411823 extract_ip_range [369] range is 10.0.0.1:0 to 10.0.0.1:0 790.411828 extract_ip_range [369] range is 10.1.0.1:0 to 10.1.0.1:0 790.625117 nm_open [898] NIOCREGIF failed: Operation not permitted em1 790.625126 main [2479] Unable to open netmap:em1: Operation not = permitted 790.625129 main [2560] aborting dmesg: 790.411868 [1776] netmap_interp_ringid em1: tx [0,2) rx [0,2) id 0 790.419431 [ 551] nm_mem_assign_group iommu_group 0 790.425548 [1148] netmap_config_obj_allocator objsize 1024 clustsize = 4096 objects 4 790.434368 [1148] netmap_config_obj_allocator objsize 36864 clustsize = 36864 objects 1 790.443390 [1148] netmap_config_obj_allocator objsize 2048 clustsize = 4096 objects 2 790.452219 [1270] netmap_finalize_obj_allocator Pre-allocated 25 = clusters (4/100KB) for 'netmap_if' 790.463605 [1270] netmap_finalize_obj_allocator Pre-allocated 200 = clusters (36/7200KB) for 'netmap_ring' 790.534919 [1270] netmap_finalize_obj_allocator Pre-allocated 81920 = clusters (4/327680KB) for 'netmap_buf' 790.546113 [1377] netmap_mem_finalize_all interfaces 100 KB, rings = 7200 KB, buffers 320 MB 790.555873 [1380] netmap_mem_finalize_all Free buffers: 163838 790.605325 [1831] netmap_mem_global_deref active =3D 0 790.612967 [ 949] netmap_close dev 0xfffff8000a4d7c00 fflag = 0x20003 devtype 8192 td 0xfffff8000b899000 # sudo ./pkt-gen -i igb1 094.077695 main [2274] interface is igb1 094.077711 main [2397] running on 1 cpus (have 10) 094.077822 extract_ip_range [369] range is 10.0.0.1:0 to 10.0.0.1:0 094.077827 extract_ip_range [369] range is 10.1.0.1:0 to 10.1.0.1:0 094.280311 nm_open [898] NIOCREGIF failed: Operation not permitted igb1 094.280319 main [2479] Unable to open netmap:igb1: Operation not = permitted 094.280323 main [2560] aborting dmesg: 094.077866 [1776] netmap_interp_ringid igb1: tx [0,8) rx [0,8) id 0 094.085425 [ 551] nm_mem_assign_group iommu_group 0 094.091449 [1148] netmap_config_obj_allocator objsize 1024 clustsize = 4096 objects 4 094.100125 [1148] netmap_config_obj_allocator objsize 36864 clustsize = 36864 objects 1 094.109004 [1148] netmap_config_obj_allocator objsize 2048 clustsize = 4096 objects 2 094.117705 [1270] netmap_finalize_obj_allocator Pre-allocated 25 = clusters (4/100KB) for 'netmap_if' 094.128918 [1270] netmap_finalize_obj_allocator Pre-allocated 200 = clusters (36/7200KB) for 'netmap_ring' 094.199456 [1270] netmap_finalize_obj_allocator Pre-allocated 81920 = clusters (4/327680KB) for 'netmap_buf' 094.210482 [1377] netmap_mem_finalize_all interfaces 100 KB, rings = 7200 KB, buffers 320 MB 094.220078 [1380] netmap_mem_finalize_all Free buffers: 163838 094.260201 [1831] netmap_mem_global_deref active =3D 0 094.268364 [ 949] netmap_close dev 0xfffff8000a453000 fflag = 0x20003 devtype 8192 td 0xfffff80014d45000 Lars --Apple-Mail=_896D9E6C-1F62-4BA5-BE05-9D4BF9C48C03 Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename="signature.asc" Content-Type: application/pgp-signature; name="signature.asc" Content-Description: Message signed with OpenPGP -----BEGIN PGP SIGNATURE----- iQIcBAEBCgAGBQJYpWRcAAoJEFS1wwm/cMFXUjMP/0q/MlQjFQrZ4AyqFbpwULqQ 9HTvRtcGfSal/Mo3xu0KS/thQF6uNeRYbiuyrcyS1nUK4vq8AHaEvfbQQMeONZJf 4+1QWdPRvJ4m+R8C0krU2cbCpLLhcZARCmWBPiFbvSjOsQxGJOiUN9e7PiDfSDJT jrfblJ7gLTQWt+EfgPNF9btPAGvHd81obaIsOt1X7ofLv+366cv6rlSEzD0wm6vZ 6FRrBoM2B44q33i0LHHLNSX2q61d8Rl5iu4LFahpIHkp1B/ZV28I5GILPi8a6Ntu 3F0C5DP5FiVhcT7YMZzBZ1vqQqrArNJdv0l1zWyP/7AvfA9bNiY86Ur4GxvLsp9s PnH4A3G1xh87xrKl2gnIPyKWGj8WBzj+2cGVC4F8eAUtFKjtA0UVRzDbE23I52SK ZOI3+4LQsHRTrUsKVZU2ViDFa1UTwS+WoXUH1wcIkHvY5TVw7z+a1khERpda74Kj 0mhQifVUags9TAcfIMkBhzeknmujVej0Cw08p6RJaeSiTsCkS4NX9XLYMSswmo4o YKYi3a2YgTZUuHo7CfPYJ/9xPX8h/+VHGqj8jnw6MtdcRbcDkDielZUMTlu+hvTa AKh9jAW9xftwBvfxalBlFwfa0gD7M0d/Sf3G6fgEYR8PIPVCqY4vmhVjUaoowc++ IkLcZGgEuwApftwG/QkX =pDC1 -----END PGP SIGNATURE----- --Apple-Mail=_896D9E6C-1F62-4BA5-BE05-9D4BF9C48C03-- From owner-freebsd-net@freebsd.org Thu Feb 16 09:34:49 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3AB97CE0DFF for ; Thu, 16 Feb 2017 09:34:49 +0000 (UTC) (envelope-from g.lettieri@iet.unipi.it) Received: from smtp.unipi.it (smtp3.unipi.it [131.114.21.153]) by mx1.freebsd.org (Postfix) with ESMTP id D32541AD7 for ; Thu, 16 Feb 2017 09:34:47 +0000 (UTC) (envelope-from g.lettieri@iet.unipi.it) Received: from localhost (localhost [127.0.0.1]) by smtp.unipi.it (Postfix) with ESMTP id 765F0C1F73; Thu, 16 Feb 2017 10:25:09 +0100 (CET) X-Virus-Scanned: Debian amavisd-new at unipi.it Received: from [10.216.1.207] (prova.iet.unipi.it [131.114.58.86]) (Authenticated User) by smtp.unipi.it (Postfix) with ESMTPSA id A38BEC19AD; Thu, 16 Feb 2017 10:25:08 +0100 (CET) Subject: Re: netmap error on -CURRENT with em and igb To: "Eggert, Lars" , "freebsd-net@FreeBSD.org" References: <8F640402-8F0B-407D-AB72-743A9AB50CA3@netapp.com> From: Giuseppe Lettieri Message-ID: <5dc6df40-f5f0-d9c2-ed3e-d543c0dd59e2@iet.unipi.it> Date: Thu, 16 Feb 2017 10:25:08 +0100 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:45.0) Gecko/20100101 Thunderbird/45.7.0 MIME-Version: 1.0 In-Reply-To: <8F640402-8F0B-407D-AB72-743A9AB50CA3@netapp.com> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 16 Feb 2017 09:34:49 -0000 Hi all, the "Operation not permitted" is coming from iflib_netmap_register: ifp->if_drv_flags &= ~(IFF_DRV_RUNNING | IFF_DRV_OACTIVE); ... IFDI_INIT(ctx); // for igb it calls em_if_init() ... return (ifp->if_drv_flags & IFF_DRV_RUNNING ? 0 : 1); the last line is meant to check that the initialization was successful, but em_if_init() is not setting IFF_DRV_RUNNING. Note that the iflib_netmap_register code, and the other netmap register functions which it mimicks, have other issues: - in case of failure on NIOCREGIF, they leaves the NETMAP_ON flag set even if the netmap data structures are deleted; - the 1 was intended as a generic indication of failure, but it translates to the rather confusing EPERM; - they check IFF_DRV_RUNNING flag outside of the lock; I don't know it this is safe or not. I can prepare a patch fixing these issues, but I don't know wether em_if_init() is supposed to set the IFF_DRV_RUNNING flag or not. Cheers, Giuseppe Il 16/02/2017 09:35, Eggert, Lars ha scritto: > Hi, > > I can't put em or igb interfaces into netmap mode on a recent -CURRENT (ix interfaces work on the same machines). Here are the pkt-gen and dmesg outputs: > > # sudo sysctl dev.netmap.admode=1 > # sudo sysctl dev.netmap.verbose=1 > > # sudo ./pkt-gen -i em1 > 790.411737 main [2274] interface is em1 > 790.411753 main [2397] running on 1 cpus (have 20) > 790.411823 extract_ip_range [369] range is 10.0.0.1:0 to 10.0.0.1:0 > 790.411828 extract_ip_range [369] range is 10.1.0.1:0 to 10.1.0.1:0 > 790.625117 nm_open [898] NIOCREGIF failed: Operation not permitted em1 > 790.625126 main [2479] Unable to open netmap:em1: Operation not permitted > 790.625129 main [2560] aborting > > dmesg: > 790.411868 [1776] netmap_interp_ringid em1: tx [0,2) rx [0,2) id 0 > 790.419431 [ 551] nm_mem_assign_group iommu_group 0 > 790.425548 [1148] netmap_config_obj_allocator objsize 1024 clustsize 4096 objects 4 > 790.434368 [1148] netmap_config_obj_allocator objsize 36864 clustsize 36864 objects 1 > 790.443390 [1148] netmap_config_obj_allocator objsize 2048 clustsize 4096 objects 2 > 790.452219 [1270] netmap_finalize_obj_allocator Pre-allocated 25 clusters (4/100KB) for 'netmap_if' > 790.463605 [1270] netmap_finalize_obj_allocator Pre-allocated 200 clusters (36/7200KB) for 'netmap_ring' > 790.534919 [1270] netmap_finalize_obj_allocator Pre-allocated 81920 clusters (4/327680KB) for 'netmap_buf' > 790.546113 [1377] netmap_mem_finalize_all interfaces 100 KB, rings 7200 KB, buffers 320 MB > 790.555873 [1380] netmap_mem_finalize_all Free buffers: 163838 > 790.605325 [1831] netmap_mem_global_deref active = 0 > 790.612967 [ 949] netmap_close dev 0xfffff8000a4d7c00 fflag 0x20003 devtype 8192 td 0xfffff8000b899000 > > # sudo ./pkt-gen -i igb1 > 094.077695 main [2274] interface is igb1 > 094.077711 main [2397] running on 1 cpus (have 10) > 094.077822 extract_ip_range [369] range is 10.0.0.1:0 to 10.0.0.1:0 > 094.077827 extract_ip_range [369] range is 10.1.0.1:0 to 10.1.0.1:0 > 094.280311 nm_open [898] NIOCREGIF failed: Operation not permitted igb1 > 094.280319 main [2479] Unable to open netmap:igb1: Operation not permitted > 094.280323 main [2560] aborting > > dmesg: > 094.077866 [1776] netmap_interp_ringid igb1: tx [0,8) rx [0,8) id 0 > 094.085425 [ 551] nm_mem_assign_group iommu_group 0 > 094.091449 [1148] netmap_config_obj_allocator objsize 1024 clustsize 4096 objects 4 > 094.100125 [1148] netmap_config_obj_allocator objsize 36864 clustsize 36864 objects 1 > 094.109004 [1148] netmap_config_obj_allocator objsize 2048 clustsize 4096 objects 2 > 094.117705 [1270] netmap_finalize_obj_allocator Pre-allocated 25 clusters (4/100KB) for 'netmap_if' > 094.128918 [1270] netmap_finalize_obj_allocator Pre-allocated 200 clusters (36/7200KB) for 'netmap_ring' > 094.199456 [1270] netmap_finalize_obj_allocator Pre-allocated 81920 clusters (4/327680KB) for 'netmap_buf' > 094.210482 [1377] netmap_mem_finalize_all interfaces 100 KB, rings 7200 KB, buffers 320 MB > 094.220078 [1380] netmap_mem_finalize_all Free buffers: 163838 > 094.260201 [1831] netmap_mem_global_deref active = 0 > 094.268364 [ 949] netmap_close dev 0xfffff8000a453000 fflag 0x20003 devtype 8192 td 0xfffff80014d45000 > > Lars > -- Dr. Ing. Giuseppe Lettieri Dipartimento di Ingegneria della Informazione Universita' di Pisa Largo Lucio Lazzarino 1, 56122 Pisa - Italy Ph. : (+39) 050-2217.649 (direct) .599 (switch) Fax : (+39) 050-2217.600 e-mail: g.lettieri@iet.unipi.it From owner-freebsd-net@freebsd.org Thu Feb 16 14:34:37 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 154A3CE15CF for ; Thu, 16 Feb 2017 14:34:37 +0000 (UTC) (envelope-from meyer.sydney@googlemail.com) Received: from mail-wm0-x230.google.com (mail-wm0-x230.google.com [IPv6:2a00:1450:400c:c09::230]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id C2D71150F for ; Thu, 16 Feb 2017 14:34:36 +0000 (UTC) (envelope-from meyer.sydney@googlemail.com) Received: by mail-wm0-x230.google.com with SMTP id c85so67926164wmi.1 for ; Thu, 16 Feb 2017 06:34:36 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlemail.com; s=20161025; h=from:content-transfer-encoding:mime-version:subject:message-id:date :to; bh=FhzhDHpnxq9Spg7s/bMWR1Y0FftInnFGEJzXakSWZkE=; b=ZN9xpNypdKSa1fRY2ayrUznVdLT0fENUNu9c3ESe2gy0QHuVnuRZX8kav/+gtU/o/O LujJKwLrbE5UOgFNJBfEHEYdIKFubQivG/hGXu9oz1PlzHosa7q8NXkdTojYmpJle/l6 N3dKevUCf5mW+IXRhDgKbbIOJqy8tl5fQG4SnSKrZ15WO0P5EPwB9m8DXn4qX6YvsYUI SKC+8vwr4huzJ18K5zaJLNzNgR5qeyesb9uwn5eR0vY8DewQ74jMCoNMg91Z8JDrw66M B5xHbn7nDlNtltdzfClA8rvDR5+76Z2/lRBQ0g0B7WHpZPPp4vQKzvOv7s1h/p61FOcv wNjg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:content-transfer-encoding:mime-version :subject:message-id:date:to; bh=FhzhDHpnxq9Spg7s/bMWR1Y0FftInnFGEJzXakSWZkE=; b=rE84SjWenq508NliJMRBF8CGTQR0u4MNsZJh37LwsrnjZLbtZZ/0L75FZBUOLwrLJy 8G/lOg3Sm4T9Al+PjsK5vkqueqrnPZaM49fIIF89zTM0jxmICFKO5w7YNJfOLaocGXKa eRRlrCI1huBQBIV+LksQidSaGL/6f7vuy6u4zbLlwGdwGkjFVUOslaQm0/mdThI8vA+N EJ2amRKLnNvrNlS4JN+egS9ieKDVkurtd8hk6jrE0gFlM/LboWjWVO98WujB/et/0gxO yUoXpf1UTH7e1Ft4B2gwUL0brS2N+7fWv/oUgZ8Ctt8KtvA7aYNVHgrYmjX07TDe8OKs P+0A== X-Gm-Message-State: AMke39mvdQ/cAKyohuiX91W/TDw7O6Ic6jCNqUg9FKa3LHJJBzVZBaqG+nWXpqsA+faRIw== X-Received: by 10.28.1.216 with SMTP id 207mr2862643wmb.7.1487255674206; Thu, 16 Feb 2017 06:34:34 -0800 (PST) Received: from ?IPv6:2a02:a03f:a4e:be01:7d04:6ac3:e37b:eab5? ([2a02:a03f:a4e:be01:7d04:6ac3:e37b:eab5]) by smtp.googlemail.com with ESMTPSA id s17sm9250798wrc.6.2017.02.16.06.34.33 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 16 Feb 2017 06:34:33 -0800 (PST) From: Sydney Meyer Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 10.2 \(3259\)) Subject: Slow Download Speeds from AWS S3 Message-Id: Date: Thu, 16 Feb 2017 15:34:32 +0100 To: freebsd-net@freebsd.org X-Mailer: Apple Mail (2.3259) X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 16 Feb 2017 14:34:37 -0000 Hello, I'm seeing continuous slow download speeds from Amazon S3, but only on = FreeBSD. Other OSes saturate the connection without problems. This happens with 10.3-RELEASE and 11.0-RELEASE and only with AWS S3 in = different regions (Ireland, London, Frankfurt, US Standard have been = tested) whilst using fetch, curl, et. al. I have tested this on multiple machines, bare metal, bhyve, Xen and = VMware VMs, routed setups and direct pppoe links.. all the same. Anyone seeing similar issues? Here's a url to try: = http://s3.eu-central-1.amazonaws.com/4f48caf1d8bcbef8/c5b38f8b3625d2b6/zer= ofile.raw Also, when doing double NAT, i.e. VMware Fusion FreeBSD Guest with = "Share with my Mac"-Interface, the machine is doing completely fine, as = in saturates the link, 90Mbps otherwise between 12-15Mbps.. I also switched the FreeBSD Routers with Linux-based ones and with the = isp-provided router box, with the same result. I have launched VMs with Digital Ocean to "rule out" my ISP and there = seems to be the same issue. Downloading from S3 is multiple times slower = than any other connection to services outside of S3 or on any other OS. It seems like other people are seeing the same issue: https://forums.freebsd.org/threads/59756/#post-343064 From owner-freebsd-net@freebsd.org Thu Feb 16 14:56:19 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id ED0A5CE1FA8 for ; Thu, 16 Feb 2017 14:56:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id DC49D12B0 for ; Thu, 16 Feb 2017 14:56:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v1GEuHDu086231 for ; Thu, 16 Feb 2017 14:56:19 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-net@FreeBSD.org Subject: [Bug 211219] NIC status does not pass into a state of "no carrier" after disconnecting the cable. Date: Thu, 16 Feb 2017 14:56:17 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 10.3-RELEASE X-Bugzilla-Keywords: IntelNetworking X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: franco@opnsense.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 16 Feb 2017 14:56:20 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D211219 --- Comment #14 from Franco Fichtner --- Created attachment 180048 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D180048&action= =3Dedit link state fix for 10.3 / 11.0 Yes, the issue is also present on soekris boxes, but not on 10.2. The bug = was introduced in 10.3, now present in 11.0 and 12-CURRENT. We tried to fix it up for 12-CURRENT but the fix isn't complete. I have attached a working patch as used on OPNsense 17.1. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Thu Feb 16 15:35:58 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A980BCE1DEF for ; Thu, 16 Feb 2017 15:35:58 +0000 (UTC) (envelope-from killing@multiplay.co.uk) Received: from mail-wr0-x22f.google.com (mail-wr0-x22f.google.com [IPv6:2a00:1450:400c:c0c::22f]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 46281178E for ; Thu, 16 Feb 2017 15:35:58 +0000 (UTC) (envelope-from killing@multiplay.co.uk) Received: by mail-wr0-x22f.google.com with SMTP id z61so14191514wrc.1 for ; Thu, 16 Feb 2017 07:35:58 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=multiplay-co-uk.20150623.gappssmtp.com; s=20150623; h=subject:to:references:from:message-id:date:user-agent:mime-version :in-reply-to; bh=4gF9Lc4pQPh6zPyl8avZaBMgOEnhmXhjql1BXJKFWmM=; b=g+IVW2V3LVPTis9WMpqPic9zXHyiX4PWSbt4IN9tPN1MIdWyil/qmvVm+8npGTEDoA 3wnraYaefk9myQDCPhAzkjp4ktvLX+GEZ18ExjlfdUT6qJd2CzGkpN0d8a4NPwYGGT/e INKaCsdqGhxAxETwCDq/V0NE7bu6nY+jDrHVqnL0s5D+gGoIJ4wwEHoxdHhwa3kc5y2q 8RZLvWVXcygDyxqX4ptSPpB5cq/l9QmmtjYw1UUfMi5ZjW2p85ykqIdWhoNTkCpNnuTw /K13dVZJg3u5/l2JR9zV3M7P0Ei4zFSJvO+Nk5l+yh6N1ZHDWAx9LunPecWHzkgAUHPI M6cg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:references:from:message-id:date :user-agent:mime-version:in-reply-to; bh=4gF9Lc4pQPh6zPyl8avZaBMgOEnhmXhjql1BXJKFWmM=; b=Kb9flYgXiQ4v+xZyyTTnESn/H7fE8yYsNFSgxx3N0+j7uhuRV1HsrgMGUjzzXd1eI5 z6ygIXqlQMWZWKvMAH0Int7aNV164RmJW6txoy584Dmk7chtGjOnMstBPjwLc/2A/fPx tDp4AY87+4BuV/WZq4NXBsKPAUl8DvM4t63JunBntrTXglFfLPwaHkli1Afa16e5Jvg1 wAtA1N85MX0TE+pysGz8x5GYTvQWmxVBT+Sp+TBLz6JDKpnwdw9OdrLCktNXZD9WC+tV A+Ms+Gt7K7YehbmijLrZgXc0lwq5gz36fhtbNnCuY31qCGbaFWBQx4DfJO/goIkXaK+M 9OVA== X-Gm-Message-State: AMke39nCIMg9nWHFpMrocTA2FHa5YdhzzCgRdUCYu8gJkQiUPdZLp+tYl6UOQHaMkEGtrKHj X-Received: by 10.223.133.98 with SMTP id 89mr2853784wrh.200.1487259356001; Thu, 16 Feb 2017 07:35:56 -0800 (PST) Received: from [10.10.1.58] ([185.97.61.26]) by smtp.gmail.com with ESMTPSA id y30sm9336085wrc.23.2017.02.16.07.35.54 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 16 Feb 2017 07:35:55 -0800 (PST) Subject: Re: Slow Download Speeds from AWS S3 To: freebsd-net@freebsd.org References: From: Steven Hartland Message-ID: <18e49da9-47eb-1803-e223-b4385e7d8690@multiplay.co.uk> Date: Thu, 16 Feb 2017 15:35:59 +0000 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.7.1 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 16 Feb 2017 15:35:58 -0000 Window scaling and receive buffer scaling is the most likely cause. Check what the sysctl net.inet.tcp.recvspace is set to, then try increasing it e.g. sysctl net.inet.tcp.recvspace=655360 This jumped the transfer rate with a wget and your test URL from 3MB/s to 30MB/s here. Regards Steve On 16/02/2017 14:34, Sydney Meyer via freebsd-net wrote: > Hello, > > I'm seeing continuous slow download speeds from Amazon S3, but only on FreeBSD. Other OSes saturate the connection without problems. > > This happens with 10.3-RELEASE and 11.0-RELEASE and only with AWS S3 in different regions (Ireland, London, Frankfurt, US Standard have been tested) whilst using fetch, curl, et. al. > > I have tested this on multiple machines, bare metal, bhyve, Xen and VMware VMs, routed setups and direct pppoe links.. all the same. > > Anyone seeing similar issues? > > Here's a url to try: > > http://s3.eu-central-1.amazonaws.com/4f48caf1d8bcbef8/c5b38f8b3625d2b6/zerofile.raw > > Also, when doing double NAT, i.e. VMware Fusion FreeBSD Guest with "Share with my Mac"-Interface, the machine is doing completely fine, as in saturates the link, 90Mbps otherwise between 12-15Mbps.. > > I also switched the FreeBSD Routers with Linux-based ones and with the isp-provided router box, with the same result. > > I have launched VMs with Digital Ocean to "rule out" my ISP and there seems to be the same issue. Downloading from S3 is multiple times slower than any other connection to services outside of S3 or on any other OS. > > It seems like other people are seeing the same issue: > > https://forums.freebsd.org/threads/59756/#post-343064 > _______________________________________________ > freebsd-net@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" From owner-freebsd-net@freebsd.org Thu Feb 16 16:55:56 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 09299CDCDD6 for ; Thu, 16 Feb 2017 16:55:56 +0000 (UTC) (envelope-from meyer.sydney@googlemail.com) Received: from mail-wr0-x233.google.com (mail-wr0-x233.google.com [IPv6:2a00:1450:400c:c0c::233]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 9BFD215B7 for ; Thu, 16 Feb 2017 16:55:55 +0000 (UTC) (envelope-from meyer.sydney@googlemail.com) Received: by mail-wr0-x233.google.com with SMTP id z61so15825881wrc.1 for ; Thu, 16 Feb 2017 08:55:55 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlemail.com; s=20161025; h=from:content-transfer-encoding:mime-version:subject:date:references :to:in-reply-to:message-id; bh=la1VDx8zCfIKDuHm+y1a38TOvPCfVw2g5T8ruB9SQdo=; b=ZxmVDuaefLIHu77kFkicjY9e8SfkyRbGgFor3JVm1GA3K0V1dovBLhjPSGtKqRDNZd utngoWXZWKdWNmwEgjqybhh4oa4PlZnDtkYgNIWNYSAVYUrDDm1qx9Hy74G3qfDjzcQX L+s5cgBdvt/0OWk+c5Vc5iXBr09WVqdCLB0rRK7rAGrRryrO4KwTcETZfs18Kig1/1Vn SGkNyw8oGtGAphMK2zra26+ddIb3w1S6ljNwFnSlmHcY2m5a6PM2U3Xf/fkGbtYzHjYz P7aIf45KtU2keRO19WgXLG5tctkfTUSLRRoHIKfONr/N9RgvH46QIkGtDRkWVjtBeX67 Yz0g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:content-transfer-encoding:mime-version :subject:date:references:to:in-reply-to:message-id; bh=la1VDx8zCfIKDuHm+y1a38TOvPCfVw2g5T8ruB9SQdo=; b=VB1ZUw2jQMi6nmwP1OOdO2p7HX1k4+tQLN6eYR9ezOhvg3BzjfbS6+YtWsrk2QJOl/ sP3wlm4bWyNeBKXMBv3ylLsmk0YZzdEDwgOZab8Zk+LnOD9PvWJfhpqKxEs1QgRgDnss ZtOTZXV+v2hxrCEb65nYuUOcEjSqMc+6bn4Nogv389R/kHULt5iUq4XAerpqdLGFKAnM o7GREFP5UrCp3Qk1Sxwt+aVQrdm2IBb952UHYFCUlFY5SOc+V/xOwd6YyYwx+keIgCob BStTuNZepgYy+DkkZ14iNeQxciw8Z/qzfNnx3gGBVACYiAaW0CRVeFO1d99l8FNDckLS p+/w== X-Gm-Message-State: AMke39kVg5eYr43NPL27HzPn2FIz+fEuUZoOePkPicCE7AB+AGIYzbIeGSCOxzrQ79e0Cg== X-Received: by 10.223.151.138 with SMTP id s10mr3101628wrb.65.1487264152545; Thu, 16 Feb 2017 08:55:52 -0800 (PST) Received: from ?IPv6:2a02:a03f:aa6:3501:9466:41ef:a2b7:878f? ([2a02:a03f:aa6:3501:9466:41ef:a2b7:878f]) by smtp.googlemail.com with ESMTPSA id d42sm9661261wrd.7.2017.02.16.08.55.51 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 16 Feb 2017 08:55:51 -0800 (PST) From: Sydney Meyer Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 10.2 \(3259\)) Subject: Re: Slow Download Speeds from AWS S3 Date: Thu, 16 Feb 2017 17:55:51 +0100 References: <18e49da9-47eb-1803-e223-b4385e7d8690@multiplay.co.uk> To: freebsd-net@freebsd.org In-Reply-To: <18e49da9-47eb-1803-e223-b4385e7d8690@multiplay.co.uk> Message-Id: <30F9FC69-CEBE-4CBE-93A9-DEDBD053C6C6@googlemail.com> X-Mailer: Apple Mail (2.3259) X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 16 Feb 2017 16:55:56 -0000 Hi Steve, increasing the buffer size did indeed enhance throughput. I am obviously not an expert in this field, but i don't understand why = or if the TCP Receive Window Size shouldn't increase automatically. I found this thread on the ML and i'm reading myself a bit more into the = topic right now. https://lists.freebsd.org/pipermail/freebsd-net/2014-August/039495.html Thank you for your tip, however.. Sydney > On 16 Feb 2017, at 16:35, Steven Hartland = wrote: >=20 > Window scaling and receive buffer scaling is the most likely cause. >=20 > Check what the sysctl net.inet.tcp.recvspace is set to, then try = increasing it e.g. > sysctl net.inet.tcp.recvspace=3D655360 >=20 > This jumped the transfer rate with a wget and your test URL from 3MB/s = to 30MB/s here. >=20 > Regards > Steve >=20 > On 16/02/2017 14:34, Sydney Meyer via freebsd-net wrote: >> Hello, >>=20 >> I'm seeing continuous slow download speeds from Amazon S3, but only = on FreeBSD. Other OSes saturate the connection without problems. >>=20 >> This happens with 10.3-RELEASE and 11.0-RELEASE and only with AWS S3 = in different regions (Ireland, London, Frankfurt, US Standard have been = tested) whilst using fetch, curl, et. al. >>=20 >> I have tested this on multiple machines, bare metal, bhyve, Xen and = VMware VMs, routed setups and direct pppoe links.. all the same. >>=20 >> Anyone seeing similar issues? >>=20 >> Here's a url to try: >>=20 >> = http://s3.eu-central-1.amazonaws.com/4f48caf1d8bcbef8/c5b38f8b3625d2b6/zer= ofile.raw >>=20 >> Also, when doing double NAT, i.e. VMware Fusion FreeBSD Guest with = "Share with my Mac"-Interface, the machine is doing completely fine, as = in saturates the link, 90Mbps otherwise between 12-15Mbps.. >>=20 >> I also switched the FreeBSD Routers with Linux-based ones and with = the isp-provided router box, with the same result. >>=20 >> I have launched VMs with Digital Ocean to "rule out" my ISP and there = seems to be the same issue. Downloading from S3 is multiple times slower = than any other connection to services outside of S3 or on any other OS. >>=20 >> It seems like other people are seeing the same issue: >>=20 >> https://forums.freebsd.org/threads/59756/#post-343064 >> _______________________________________________ >> freebsd-net@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-net >> To unsubscribe, send any mail to = "freebsd-net-unsubscribe@freebsd.org" >=20 > _______________________________________________ > freebsd-net@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" From owner-freebsd-net@freebsd.org Thu Feb 16 17:18:54 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0216ACE1953 for ; Thu, 16 Feb 2017 17:18:54 +0000 (UTC) (envelope-from killing@multiplay.co.uk) Received: from mail-wr0-x22f.google.com (mail-wr0-x22f.google.com [IPv6:2a00:1450:400c:c0c::22f]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 9937A174A for ; Thu, 16 Feb 2017 17:18:53 +0000 (UTC) (envelope-from killing@multiplay.co.uk) Received: by mail-wr0-x22f.google.com with SMTP id i10so16332191wrb.0 for ; Thu, 16 Feb 2017 09:18:53 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=multiplay-co-uk.20150623.gappssmtp.com; s=20150623; h=subject:to:references:from:message-id:date:user-agent:mime-version :in-reply-to; bh=dz0JQHgoeEjsSDvnsDw7F4ax1TJ7twYwRde0qi1Hop0=; b=vso+DZq+fClOViGz4piPfIhS00WHehRk7XbPhcesU0FFUI0s7uw1rKQkhj8i4/mSWi HGKnX7wDQSIFPWCPnWlA76MTx1ifuY4p55Ed1g+5Gjj+HvuBdFc2yA6s2prxaKSoFH2y 7Gm35GkZmKrt6d4g6DxmC9d12fpcva2TUB/T58Q/b7RoPY+UWPKIAotM7mu8T5T8S37l U6eikV/ZirwDz+27SWSGkZbs3OJnl82wWnE6p2s3uAfAlNEpvVB5m3nFT9MTEc9PSvhp Qpk/oWp/XQnGlTeCd1+27vL5g9v0F+aPyV7QeJijwV8vnXf7DWfTXEkHYYLEhEA6QWd3 E96w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:references:from:message-id:date :user-agent:mime-version:in-reply-to; bh=dz0JQHgoeEjsSDvnsDw7F4ax1TJ7twYwRde0qi1Hop0=; b=HeNkALc6IA3MMJqMdM1tnyZXvJh1crAsQbv6/VbAYfq2jcFNp73e/rbg4dkA3VA0nz suXrvxpaHjZTw+/SPveosuqXXX5M+yw6K7KImgAW4qKCFy63X3FqtQ4nc86If6J7boCE PDRyn8RqCFstwFjr1XjWHh6Y3I3ICM6X39ueRA4tE9R2dHztn/04dv1oHqRUDZszO/0S tFwJd8CJudP+bKb8VOTEHTL+gqmCtMoWsdAnj/+FDBEwIo1YviN0WLV8HuL/RkAh8Wur ug9/DnQBuKcg3+YJ+gShY4X9s5yO3XmrfSKuS2ruYpvhBWnnnkV+PNowCT1jcczcqvXL FQTg== X-Gm-Message-State: AMke39nKjyD+mYnlK4VneL5Op+hGY62jlqJiuhQUlj8aPmvnXvrlJAcZP0iFIyustgpy8Nwm X-Received: by 10.223.176.70 with SMTP id g6mr3122671wra.12.1487265531401; Thu, 16 Feb 2017 09:18:51 -0800 (PST) Received: from [10.10.1.58] ([185.97.61.26]) by smtp.gmail.com with ESMTPSA id t202sm1010777wmt.28.2017.02.16.09.18.50 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 16 Feb 2017 09:18:50 -0800 (PST) Subject: Re: Slow Download Speeds from AWS S3 To: freebsd-net@freebsd.org References: <18e49da9-47eb-1803-e223-b4385e7d8690@multiplay.co.uk> <30F9FC69-CEBE-4CBE-93A9-DEDBD053C6C6@googlemail.com> From: Steven Hartland Message-ID: <673aca75-7bb5-73e7-d23b-b12a25816c8a@multiplay.co.uk> Date: Thu, 16 Feb 2017 17:18:54 +0000 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.7.1 MIME-Version: 1.0 In-Reply-To: <30F9FC69-CEBE-4CBE-93A9-DEDBD053C6C6@googlemail.com> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 16 Feb 2017 17:18:54 -0000 It does seem to be related to TCP Receive Window Size. When I tested on a 11.0-RELEASE box I got 30MB/s out of the box and the increase of recvspace was only needed on the original 10.2 however the 11 box is only 1.2ms from AWS where as the 10.2 was 17ms away, so likely explains the difference. It seems that when talking to hosts that don't support Timestamps FreeBSD's performance is going to be poor due to lack of auto scaling :( Reading the thread you linked is seems like we need to implement auto scaling based on RTT estimations similar to linux. Regards Steve On 16/02/2017 16:55, Sydney Meyer via freebsd-net wrote: > Hi Steve, > > increasing the buffer size did indeed enhance throughput. > > I am obviously not an expert in this field, but i don't understand why or if the TCP Receive Window Size shouldn't increase automatically. > > I found this thread on the ML and i'm reading myself a bit more into the topic right now. > > https://lists.freebsd.org/pipermail/freebsd-net/2014-August/039495.html > > Thank you for your tip, however.. > > Sydney > >> On 16 Feb 2017, at 16:35, Steven Hartland wrote: >> >> Window scaling and receive buffer scaling is the most likely cause. >> >> Check what the sysctl net.inet.tcp.recvspace is set to, then try increasing it e.g. >> sysctl net.inet.tcp.recvspace=655360 >> >> This jumped the transfer rate with a wget and your test URL from 3MB/s to 30MB/s here. >> >> Regards >> Steve >> >> On 16/02/2017 14:34, Sydney Meyer via freebsd-net wrote: >>> Hello, >>> >>> I'm seeing continuous slow download speeds from Amazon S3, but only on FreeBSD. Other OSes saturate the connection without problems. >>> >>> This happens with 10.3-RELEASE and 11.0-RELEASE and only with AWS S3 in different regions (Ireland, London, Frankfurt, US Standard have been tested) whilst using fetch, curl, et. al. >>> >>> I have tested this on multiple machines, bare metal, bhyve, Xen and VMware VMs, routed setups and direct pppoe links.. all the same. >>> >>> Anyone seeing similar issues? >>> >>> Here's a url to try: >>> >>> http://s3.eu-central-1.amazonaws.com/4f48caf1d8bcbef8/c5b38f8b3625d2b6/zerofile.raw >>> >>> Also, when doing double NAT, i.e. VMware Fusion FreeBSD Guest with "Share with my Mac"-Interface, the machine is doing completely fine, as in saturates the link, 90Mbps otherwise between 12-15Mbps.. >>> >>> I also switched the FreeBSD Routers with Linux-based ones and with the isp-provided router box, with the same result. >>> >>> I have launched VMs with Digital Ocean to "rule out" my ISP and there seems to be the same issue. Downloading from S3 is multiple times slower than any other connection to services outside of S3 or on any other OS. >>> >>> It seems like other people are seeing the same issue: >>> >>> https://forums.freebsd.org/threads/59756/#post-343064 >>> _______________________________________________ >>> freebsd-net@freebsd.org mailing list >>> https://lists.freebsd.org/mailman/listinfo/freebsd-net >>> To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" >> _______________________________________________ >> freebsd-net@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-net >> To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" > _______________________________________________ > freebsd-net@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" From owner-freebsd-net@freebsd.org Thu Feb 16 18:49:10 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0DCB3CE0005 for ; Thu, 16 Feb 2017 18:49:10 +0000 (UTC) (envelope-from glebius@FreeBSD.org) Received: from mailman.ysv.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id ED84316E6 for ; Thu, 16 Feb 2017 18:49:09 +0000 (UTC) (envelope-from glebius@FreeBSD.org) Received: by mailman.ysv.freebsd.org (Postfix) id EA0D7CE0004; Thu, 16 Feb 2017 18:49:09 +0000 (UTC) Delivered-To: net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E9B4FCE0003 for ; Thu, 16 Feb 2017 18:49:09 +0000 (UTC) (envelope-from glebius@FreeBSD.org) Received: from cell.glebi.us (glebi.us [96.95.210.25]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "cell.glebi.us", Issuer "cell.glebi.us" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 89AEE16E5; Thu, 16 Feb 2017 18:49:09 +0000 (UTC) (envelope-from glebius@FreeBSD.org) Received: from cell.glebi.us (localhost [127.0.0.1]) by cell.glebi.us (8.15.2/8.15.2) with ESMTPS id v1GIn3b6081545 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Thu, 16 Feb 2017 10:49:03 -0800 (PST) (envelope-from glebius@FreeBSD.org) Received: (from glebius@localhost) by cell.glebi.us (8.15.2/8.15.2/Submit) id v1GIn3rI081544; Thu, 16 Feb 2017 10:49:03 -0800 (PST) (envelope-from glebius@FreeBSD.org) X-Authentication-Warning: cell.glebi.us: glebius set sender to glebius@FreeBSD.org using -f Date: Thu, 16 Feb 2017 10:49:03 -0800 From: Gleb Smirnoff To: jch@FreeBSD.org, hiren@FreeBSD.org, Jason Eggleston Cc: rrs@FreeBSD.org, jtl@FreeBSD.org, net@FreeBSD.org Subject: Re: listening sockets as non sockets Message-ID: <20170216184903.GF58829@FreeBSD.org> References: <20170127005251.GM2611@FreeBSD.org> <20170210063024.GE1973@FreeBSD.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20170210063024.GE1973@FreeBSD.org> User-Agent: Mutt/1.7.2 (2016-11-26) X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 16 Feb 2017 18:49:10 -0000 On Thu, Feb 09, 2017 at 10:30:24PM -0800, Gleb Smirnoff wrote: T> Two important updates. T> T> 1) The patch worked pretty okay, but the idea of separate file type is T> abandoned. With current filedescriptor code it is almost impossible T> to racelessly switch fileops and f_data. T> For more details read the commit message, URL below. T> T> 2) I moved the work to git. It allows for easier code sharing. T> T> https://github.com/glebius/FreeBSD/commit/3a52df429889ea9c6e61013f6913aad95939f159 The current 'solisten' branch at https://github.com/glebius/FreeBSD has been running successfully for 48 hours at Netflix. But as mentioned before, our connection rate is pretty low. So, testing from Julien and Hiren will be much appreciated. -- Totus tuus, Glebius. From owner-freebsd-net@freebsd.org Thu Feb 16 20:14:21 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0CFD7CE2BF7 for ; Thu, 16 Feb 2017 20:14:21 +0000 (UTC) (envelope-from v.maffione@gmail.com) Received: from mailman.ysv.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id DF8E91F88 for ; Thu, 16 Feb 2017 20:14:20 +0000 (UTC) (envelope-from v.maffione@gmail.com) Received: by mailman.ysv.freebsd.org (Postfix) id DBFF2CE2BF6; Thu, 16 Feb 2017 20:14:20 +0000 (UTC) Delivered-To: net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DB9C4CE2BF5 for ; Thu, 16 Feb 2017 20:14:20 +0000 (UTC) (envelope-from v.maffione@gmail.com) Received: from mail-oi0-x229.google.com (mail-oi0-x229.google.com [IPv6:2607:f8b0:4003:c06::229]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 9FE111F87 for ; Thu, 16 Feb 2017 20:14:20 +0000 (UTC) (envelope-from v.maffione@gmail.com) Received: by mail-oi0-x229.google.com with SMTP id s131so872728oie.1 for ; Thu, 16 Feb 2017 12:14:20 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=tXQLPt2wfQ8eA2fMTihHzkTTB68Jj6jU/ph/TZg0/ec=; b=s1OI1OwLniB2my6KmF7l0qjp+1kXeJ3lXIm+I0MTvcs57oRyq/ngRH5K4HobAhpzGx J1owTERGrLkVqtkIaLduH2n2o624zDGDa5aBNyDW1pRTAP1KTZvUXyrw5WrG+4k+9RHI gXT7Aj4QXoEF+WnFdGglVYrU3BqbYyYJW+VjqeNu8Wpnml7kyPq/74XiVhs0IPEOK7o7 7GR0EaYOpko9X/zWb2Ex0kAfyqt6M+jNyAgnqJAeSCUEO4t2uKUIpGlGoIqVRWS7e2Td mv4jKUZ1BYRvyK//dALyN4tGs0q6sWTQ3JAnLM7WKkYKzkBe0y0tuX1Lu4PeUjm39Hhm SUqw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=tXQLPt2wfQ8eA2fMTihHzkTTB68Jj6jU/ph/TZg0/ec=; b=eyNvCfJTgmFUEmOQQ/UiNFy5F7ss4wHSphAmthGlz33V0xRyp1u4psnXhuNLSVWhaL /NP3/9DbSk6pPGlJhElaMIz0IIPKqIy18pEPXeBoWWnTzqGfk68MScakbp346JuupZeI AIg1mB7NfVPo6pjJx8ciSjF2FyT2gxe5As5/wpSAHtdtviAZUr5oVRbXv/+kxpaoGeWh 9cSgvih2L1kmprJL4A1ZbmEGMFeHGBRooQZuOsgBZItwYXKoQacKgxX/biMXHgpcvbL7 Z9L31gm/0l9YnQH0C1VFNlNfoKq+uPcsly/lFrDHhy4kNBQe8XccY7yqxF3xinrS30bb eQLA== X-Gm-Message-State: AMke39nMprNXmrYtMgW81aoiDwgn33EbtU2MniXTF6Fl0K3XH0NqRedWXX+cyOHXJ/S8hL39bCdx25lAyiYJ8g== X-Received: by 10.202.95.5 with SMTP id t5mr2039410oib.103.1487276059996; Thu, 16 Feb 2017 12:14:19 -0800 (PST) MIME-Version: 1.0 Received: by 10.157.7.201 with HTTP; Thu, 16 Feb 2017 12:14:19 -0800 (PST) In-Reply-To: <20170214123621.GA15630@zxy.spb.ru> References: <20170214123621.GA15630@zxy.spb.ru> From: Vincenzo Maffione Date: Thu, 16 Feb 2017 21:14:19 +0100 Message-ID: Subject: Re: netmap_mem_get_info To: Slawa Olhovchenkov Cc: amir alipour , "freebsd-net@freebsd.org" Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 16 Feb 2017 20:14:21 -0000 Hi, You're right, we'll try to add more details. In any case, buf_size, ring_size and if_size are the sizes in bytes of each buffer, ring and netmap_if (control data structure), respectively. So the maximum amount of slots for each ring is ring_size/16, as 16 is the size in bytes of struct netmap_slot. On the other side, buf_num, ring_num and if_num are the total number of biffers, rings and netmap_if objects in each netmap memory area (aka "allocator"). By default there is a single memory area used by all the hardware NICs and a separate memory area for each VALE port. This is already configurable, however. Cheers, Vincenzo 2017-02-14 13:36 GMT+01:00 Slawa Olhovchenkov : > On Tue, Feb 14, 2017 at 12:26:55PM +0100, Vincenzo Maffione wrote: > > > Hi, > > Have you tried to play with netmap sysctl parameters like: > > > > dev.netmap.buf_num > > dev.netmap.ring_num > > dev.netmap.if_num > > > > those are listed in the sysctl section of the netmap man page. > > man page hide details about calcul rules of this parameters. > -- Vincenzo Maffione From owner-freebsd-net@freebsd.org Thu Feb 16 20:38:22 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id CFDFBCE258C for ; Thu, 16 Feb 2017 20:38:22 +0000 (UTC) (envelope-from slw@zxy.spb.ru) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id BB9D2133A for ; Thu, 16 Feb 2017 20:38:22 +0000 (UTC) (envelope-from slw@zxy.spb.ru) Received: by mailman.ysv.freebsd.org (Postfix) id B8270CE258B; Thu, 16 Feb 2017 20:38:22 +0000 (UTC) Delivered-To: net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B7DCDCE258A for ; Thu, 16 Feb 2017 20:38:22 +0000 (UTC) (envelope-from slw@zxy.spb.ru) Received: from zxy.spb.ru (zxy.spb.ru [195.70.199.98]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 794751339 for ; Thu, 16 Feb 2017 20:38:22 +0000 (UTC) (envelope-from slw@zxy.spb.ru) Received: from slw by zxy.spb.ru with local (Exim 4.86 (FreeBSD)) (envelope-from ) id 1ceSog-000Iyi-1E; Thu, 16 Feb 2017 23:38:14 +0300 Date: Thu, 16 Feb 2017 23:38:14 +0300 From: Slawa Olhovchenkov To: Vincenzo Maffione Cc: amir alipour , "freebsd-net@freebsd.org" Subject: Re: netmap_mem_get_info Message-ID: <20170216203813.GR6035@zxy.spb.ru> References: <20170214123621.GA15630@zxy.spb.ru> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.24 (2015-08-30) X-SA-Exim-Connect-IP: X-SA-Exim-Mail-From: slw@zxy.spb.ru X-SA-Exim-Scanned: No (on zxy.spb.ru); SAEximRunCond expanded to false X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 16 Feb 2017 20:38:22 -0000 On Thu, Feb 16, 2017 at 09:14:19PM +0100, Vincenzo Maffione wrote: > Hi, > You're right, we'll try to add more details. > > In any case, buf_size, ring_size and if_size are the sizes in bytes of each > buffer, ring and netmap_if (control data structure), respectively. > So the maximum amount of slots for each ring is ring_size/16, as 16 is the > size in bytes of struct netmap_slot. > > On the other side, buf_num, ring_num and if_num are the total number of > biffers, rings and netmap_if objects in each netmap memory area (aka > "allocator"). > By default there is a single memory area used by all the hardware NICs and > a separate memory area for each VALE port. > This is already configurable, however. This values also depends on open netmap descriptors, right? > 2017-02-14 13:36 GMT+01:00 Slawa Olhovchenkov : > > > On Tue, Feb 14, 2017 at 12:26:55PM +0100, Vincenzo Maffione wrote: > > > > > Hi, > > > Have you tried to play with netmap sysctl parameters like: > > > > > > dev.netmap.buf_num > > > dev.netmap.ring_num > > > dev.netmap.if_num > > > > > > those are listed in the sysctl section of the netmap man page. > > > > man page hide details about calcul rules of this parameters. > > > > > > -- > Vincenzo Maffione From owner-freebsd-net@freebsd.org Thu Feb 16 20:48:15 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B73A4CE2A3A for ; Thu, 16 Feb 2017 20:48:15 +0000 (UTC) (envelope-from v.maffione@gmail.com) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 942811DEE for ; Thu, 16 Feb 2017 20:48:15 +0000 (UTC) (envelope-from v.maffione@gmail.com) Received: by mailman.ysv.freebsd.org (Postfix) id 937F4CE2A39; Thu, 16 Feb 2017 20:48:15 +0000 (UTC) Delivered-To: net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 932F7CE2A38 for ; Thu, 16 Feb 2017 20:48:15 +0000 (UTC) (envelope-from v.maffione@gmail.com) Received: from mail-ot0-x231.google.com (mail-ot0-x231.google.com [IPv6:2607:f8b0:4003:c0f::231]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 570E51DED for ; Thu, 16 Feb 2017 20:48:15 +0000 (UTC) (envelope-from v.maffione@gmail.com) Received: by mail-ot0-x231.google.com with SMTP id 32so19435288oth.3 for ; Thu, 16 Feb 2017 12:48:15 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=GXuMm7Lk0ACI1hiRXuxBSyFTfQqUzTtCrucLGQSaQtY=; b=EG7IUFGMo3tBSfOa4pl7luNol1p5+ZMDAGdwa/Pu7aDVjJodoSTxmG0PBMCB6gMcvO Xvq7qCoVyi2Tn/4VvxKbD3ISs9SigIhlGzVgzMEuhaQzlNmx6YaFpnOWqXU3niY2dbK8 d3G/gJQbM3OUc/tyuxoBkut3UZYQJPyA1cYBxQ8KW/wzCIU02nfEhRPnuGZMR3vqarGi vtYXNyR6Z+9B9QgEnYo/7hyaJ/LnXOAq0qgii7SkaW6QXs4c/RAFX/7el85dsLM5ciuY rmPX3qiy2EzzDaZuWVz79CZgDqs0EoYMV741WSU+ggqUEYVWzPDCMWvl9U+KRO91XklM oLDw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=GXuMm7Lk0ACI1hiRXuxBSyFTfQqUzTtCrucLGQSaQtY=; b=Te5vqD5+BIJ37nV96uBeX5C1hSx4lQbBAKgYGCdtYa8YWPhyG3iiiMPEV27D/l/lsr eKjEnUmld0UnTfFRuDbsyA1FyjCjdj1zO3YWniAeEN7pUTznh0J2i5QZcFAVx27bJ9Oq lv3C2KnKENlHl5XmbZeXE4wGsTJgTV8+t24eSTUhKyYK2Wdosgwya9G/2He2fYZjWOdr BbAozDK8gb7EfwmI8V2z1RZphvYn1COkVKoZEnd9K+b4ciaehBXCDgUPCnQtLFl8FRxU fI8oAs3DphHoJlXMqHdN55a91A2IYaszybiA6/URY9Xp2g7ERtCYjmZQfErWaIpBuIlt x2Rw== X-Gm-Message-State: AMke39khX5/qqSFhYV20aPT51q6Yo0VfUlCosneRpQGFrSmn+Ju88MLbiYG7kFoX5inejp9+yZOLbQO0C59x/g== X-Received: by 10.157.52.66 with SMTP id v60mr2331015otb.61.1487278094500; Thu, 16 Feb 2017 12:48:14 -0800 (PST) MIME-Version: 1.0 Received: by 10.157.7.201 with HTTP; Thu, 16 Feb 2017 12:48:14 -0800 (PST) In-Reply-To: <20170216203813.GR6035@zxy.spb.ru> References: <20170214123621.GA15630@zxy.spb.ru> <20170216203813.GR6035@zxy.spb.ru> From: Vincenzo Maffione Date: Thu, 16 Feb 2017 21:48:14 +0100 Message-ID: Subject: Re: netmap_mem_get_info To: Slawa Olhovchenkov Cc: amir alipour , "freebsd-net@freebsd.org" Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 16 Feb 2017 20:48:15 -0000 Not sure about what you mean. Until memory areas are in use the real values (*_num, *_size) are not changed. At NIOCREGIF time you can say what allocator you are interested in by writing a non-zero id inside req.nr_arg2. 2017-02-16 21:38 GMT+01:00 Slawa Olhovchenkov : > On Thu, Feb 16, 2017 at 09:14:19PM +0100, Vincenzo Maffione wrote: > > > Hi, > > You're right, we'll try to add more details. > > > > In any case, buf_size, ring_size and if_size are the sizes in bytes of > each > > buffer, ring and netmap_if (control data structure), respectively. > > So the maximum amount of slots for each ring is ring_size/16, as 16 is > the > > size in bytes of struct netmap_slot. > > > > On the other side, buf_num, ring_num and if_num are the total number of > > biffers, rings and netmap_if objects in each netmap memory area (aka > > "allocator"). > > By default there is a single memory area used by all the hardware NICs > and > > a separate memory area for each VALE port. > > This is already configurable, however. > > This values also depends on open netmap descriptors, right? > > > 2017-02-14 13:36 GMT+01:00 Slawa Olhovchenkov : > > > > > On Tue, Feb 14, 2017 at 12:26:55PM +0100, Vincenzo Maffione wrote: > > > > > > > Hi, > > > > Have you tried to play with netmap sysctl parameters like: > > > > > > > > dev.netmap.buf_num > > > > dev.netmap.ring_num > > > > dev.netmap.if_num > > > > > > > > those are listed in the sysctl section of the netmap man page. > > > > > > man page hide details about calcul rules of this parameters. > > > > > > > > > > > -- > > Vincenzo Maffione > -- Vincenzo Maffione From owner-freebsd-net@freebsd.org Thu Feb 16 20:58:22 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1110FCE2D76 for ; Thu, 16 Feb 2017 20:58:22 +0000 (UTC) (envelope-from slw@zxy.spb.ru) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id EFF4514E7 for ; Thu, 16 Feb 2017 20:58:21 +0000 (UTC) (envelope-from slw@zxy.spb.ru) Received: by mailman.ysv.freebsd.org (Postfix) id EC564CE2D73; Thu, 16 Feb 2017 20:58:21 +0000 (UTC) Delivered-To: net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id EA466CE2D72 for ; Thu, 16 Feb 2017 20:58:21 +0000 (UTC) (envelope-from slw@zxy.spb.ru) Received: from zxy.spb.ru (zxy.spb.ru [195.70.199.98]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id A1DB114E6 for ; Thu, 16 Feb 2017 20:58:21 +0000 (UTC) (envelope-from slw@zxy.spb.ru) Received: from slw by zxy.spb.ru with local (Exim 4.86 (FreeBSD)) (envelope-from ) id 1ceT87-000JXf-Ec; Thu, 16 Feb 2017 23:58:19 +0300 Date: Thu, 16 Feb 2017 23:58:19 +0300 From: Slawa Olhovchenkov To: Vincenzo Maffione Cc: amir alipour , "freebsd-net@freebsd.org" Subject: Re: netmap_mem_get_info Message-ID: <20170216205819.GS6035@zxy.spb.ru> References: <20170214123621.GA15630@zxy.spb.ru> <20170216203813.GR6035@zxy.spb.ru> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.24 (2015-08-30) X-SA-Exim-Connect-IP: X-SA-Exim-Mail-From: slw@zxy.spb.ru X-SA-Exim-Scanned: No (on zxy.spb.ru); SAEximRunCond expanded to false X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 16 Feb 2017 20:58:22 -0000 On Thu, Feb 16, 2017 at 09:48:14PM +0100, Vincenzo Maffione wrote: > Not sure about what you mean. Until memory areas are in use the real values > (*_num, *_size) are not changed. > At NIOCREGIF time you can say what allocator you are interested in by > writing a non-zero id inside req.nr_arg2. My application have N balancer thread and M worker thread. Application serve outside interface w/ K rings (and ring size N) and inside interface w/ L rings (and ring size M). All balancer threads share rings from interfaces in next maner: first thread open descriptors to 1st ring of inside and outside interface next thread open descriptors to 2nd ring of inside and outside interface and etc in round-roubin. every balancer thread open 2 pipe to every worker thread. how many if_num, ring_num, buf_num I am need to configure? > 2017-02-16 21:38 GMT+01:00 Slawa Olhovchenkov : > > > On Thu, Feb 16, 2017 at 09:14:19PM +0100, Vincenzo Maffione wrote: > > > > > Hi, > > > You're right, we'll try to add more details. > > > > > > In any case, buf_size, ring_size and if_size are the sizes in bytes of > > each > > > buffer, ring and netmap_if (control data structure), respectively. > > > So the maximum amount of slots for each ring is ring_size/16, as 16 is > > the > > > size in bytes of struct netmap_slot. > > > > > > On the other side, buf_num, ring_num and if_num are the total number of > > > biffers, rings and netmap_if objects in each netmap memory area (aka > > > "allocator"). > > > By default there is a single memory area used by all the hardware NICs > > and > > > a separate memory area for each VALE port. > > > This is already configurable, however. > > > > This values also depends on open netmap descriptors, right? > > > > > 2017-02-14 13:36 GMT+01:00 Slawa Olhovchenkov : > > > > > > > On Tue, Feb 14, 2017 at 12:26:55PM +0100, Vincenzo Maffione wrote: > > > > > > > > > Hi, > > > > > Have you tried to play with netmap sysctl parameters like: > > > > > > > > > > dev.netmap.buf_num > > > > > dev.netmap.ring_num > > > > > dev.netmap.if_num > > > > > > > > > > those are listed in the sysctl section of the netmap man page. > > > > > > > > man page hide details about calcul rules of this parameters. > > > > > > > > > > > > > > > > -- > > > Vincenzo Maffione > > > > > > -- > Vincenzo Maffione From owner-freebsd-net@freebsd.org Thu Feb 16 22:25:02 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4A032CE2F53 for ; Thu, 16 Feb 2017 22:25:02 +0000 (UTC) (envelope-from meyer.sydney@googlemail.com) Received: from mail-wr0-x230.google.com (mail-wr0-x230.google.com [IPv6:2a00:1450:400c:c0c::230]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id E15412DEB for ; Thu, 16 Feb 2017 22:25:01 +0000 (UTC) (envelope-from meyer.sydney@googlemail.com) Received: by mail-wr0-x230.google.com with SMTP id i10so20680530wrb.0 for ; Thu, 16 Feb 2017 14:25:01 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlemail.com; s=20161025; h=from:content-transfer-encoding:mime-version:subject:date:references :to:in-reply-to:message-id; bh=klutlttWKWpmCpVc/2xb0gGNd3SQOq2mndapZg26f5E=; b=qY6T9aAwRD0R/w8vqqCcD9i8FQuFdnGoRYs4PIeqG3ekuZWEcf4njqDIlcj2tsPIM6 xwZBIVVhIsBSWts5h6M1/S67l7cApb7OnQEqTU5/5HyvUmLiwIduxsqrdlPyuOmozZm0 bKYAsadcgTyuaxIyJGhFDieT1+RBvaaCw8NC/loeoEW3C5vY4PJqC4kak5Lzv2+DuK2d a5sYbDe5XZIP/DI6h5fvwGn/SMSgVt1aO0oGTOmMPjBzgoeYdY1go4SXLR/Be0SRmeFF Kz5i+mUFODqKORR/nIRQga9apEn8ve32dtNjgH/KnW4s+LrYcTYjLNVBtFOYDjgR/fjJ 623w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:content-transfer-encoding:mime-version :subject:date:references:to:in-reply-to:message-id; bh=klutlttWKWpmCpVc/2xb0gGNd3SQOq2mndapZg26f5E=; b=Pbxa3Lffqpx5Z9qZfv8FHtgVFkz8F7WMiRlpryTB6RKZlVtKk8q2Dttx47USVKW7zo qPjvCDo21IXsdkVABcvQDxRDgPEDCudIFEyHn6juf7hPpyt7B1SKb7TrnSchQiKtcZYt BvvjyI0FoLwjzzMZk57QJGtBAPyMmuDN11gFWShoE/RZX/cr4SlzixPUs1R70C/aJAe/ jY9uRbM4neASnxd9d8w+GC8UzCnNX758V1kw1phL+CJTJJctvHqsJTbpelKtMv2qqfee tbcrDGW9UHCNiyz34Y3YMgPdXYqkPQtskvcHlvsCP+EQtDvKsHNIVBMIvldOc54JJL1E nsFg== X-Gm-Message-State: AMke39mB82wbfcHAFy1B8QZ9Lt6GCWkErG4tGEE++SD1LoQVQ8YEJCb4GKtvf2WUoYPf4Q== X-Received: by 10.223.148.35 with SMTP id 32mr4507657wrq.18.1487283899620; Thu, 16 Feb 2017 14:24:59 -0800 (PST) Received: from ?IPv6:2a02:a03f:a4e:be01:c0c4:fff1:8d9b:caa5? ([2a02:a03f:a4e:be01:c0c4:fff1:8d9b:caa5]) by smtp.googlemail.com with ESMTPSA id b87sm1879351wmi.0.2017.02.16.14.24.58 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 16 Feb 2017 14:24:59 -0800 (PST) From: Sydney Meyer Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 10.2 \(3259\)) Subject: Re: Slow Download Speeds from AWS S3 Date: Thu, 16 Feb 2017 23:24:57 +0100 References: <18e49da9-47eb-1803-e223-b4385e7d8690@multiplay.co.uk> <30F9FC69-CEBE-4CBE-93A9-DEDBD053C6C6@googlemail.com> <673aca75-7bb5-73e7-d23b-b12a25816c8a@multiplay.co.uk> To: freebsd-net@freebsd.org In-Reply-To: <673aca75-7bb5-73e7-d23b-b12a25816c8a@multiplay.co.uk> Message-Id: <5BE01E68-A8EF-4572-9B48-C0C58683F085@googlemail.com> X-Mailer: Apple Mail (2.3259) X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 16 Feb 2017 22:25:02 -0000 Hi Steve, > On 16 Feb 2017, at 18:18, Steven Hartland = wrote: >=20 > It does seem to be related to TCP Receive Window Size. >=20 > When I tested on a 11.0-RELEASE box I got 30MB/s out of the box and = the increase of recvspace was only needed on the original 10.2 however = the 11 box is only 1.2ms from AWS where as the 10.2 was 17ms away, so = likely explains the difference. Yes, i saw this too.. when i did some tests with a VM from within the = same AWS region, i did not see the troughput issues as with connections = with a higher latency (probably should have mentioned this in the first = post, retrospectively).. this would also explain the vmware guest = bridged vs nat'ed difference then.. >=20 > It seems that when talking to hosts that don't support Timestamps = FreeBSD's performance is going to be poor due to lack of auto scaling :( I did some tests with Debian 8.x (Linux Kernel 3.16.x) and there the = default for /proc/sys/net/ipv4/tcp_timestamps appears to be enabled, at = least with Debian's 3.16 Linux Kernel. I can see the TS val field now in = tcpdump which is lacking in traffic from AWS S3, regardless from region. >=20 > Reading the thread you linked is seems like we need to implement auto = scaling based on RTT estimations similar to linux. Well, i guess the issue described in the related thread is indeed the = case here. I will adjust this buffer size manually on this machine, as it has no = other major purpose than pulling archives from S3 anyway. But thanks again, learned something new (to me) about FreeBSDs = networking stack. Updated the Forums Thread accordingly here: https://forums.freebsd.org/threads/59756/ Cheers, Sydney. >=20 > Regards > Steve >=20 > On 16/02/2017 16:55, Sydney Meyer via freebsd-net wrote: >> Hi Steve, >>=20 >> increasing the buffer size did indeed enhance throughput. >>=20 >> I am obviously not an expert in this field, but i don't understand = why or if the TCP Receive Window Size shouldn't increase automatically. >>=20 >> I found this thread on the ML and i'm reading myself a bit more into = the topic right now. >>=20 >> = https://lists.freebsd.org/pipermail/freebsd-net/2014-August/039495.html >>=20 >> Thank you for your tip, however.. >>=20 >> Sydney >>=20 >>> On 16 Feb 2017, at 16:35, Steven Hartland = wrote: >>>=20 >>> Window scaling and receive buffer scaling is the most likely cause. >>>=20 >>> Check what the sysctl net.inet.tcp.recvspace is set to, then try = increasing it e.g. >>> sysctl net.inet.tcp.recvspace=3D655360 >>>=20 >>> This jumped the transfer rate with a wget and your test URL from = 3MB/s to 30MB/s here. >>>=20 >>> Regards >>> Steve >>>=20 >>> On 16/02/2017 14:34, Sydney Meyer via freebsd-net wrote: >>>> Hello, >>>>=20 >>>> I'm seeing continuous slow download speeds from Amazon S3, but only = on FreeBSD. Other OSes saturate the connection without problems. >>>>=20 >>>> This happens with 10.3-RELEASE and 11.0-RELEASE and only with AWS = S3 in different regions (Ireland, London, Frankfurt, US Standard have = been tested) whilst using fetch, curl, et. al. >>>>=20 >>>> I have tested this on multiple machines, bare metal, bhyve, Xen and = VMware VMs, routed setups and direct pppoe links.. all the same. >>>>=20 >>>> Anyone seeing similar issues? >>>>=20 >>>> Here's a url to try: >>>>=20 >>>> = http://s3.eu-central-1.amazonaws.com/4f48caf1d8bcbef8/c5b38f8b3625d2b6/zer= ofile.raw >>>>=20 >>>> Also, when doing double NAT, i.e. VMware Fusion FreeBSD Guest with = "Share with my Mac"-Interface, the machine is doing completely fine, as = in saturates the link, 90Mbps otherwise between 12-15Mbps.. >>>>=20 >>>> I also switched the FreeBSD Routers with Linux-based ones and with = the isp-provided router box, with the same result. >>>>=20 >>>> I have launched VMs with Digital Ocean to "rule out" my ISP and = there seems to be the same issue. Downloading from S3 is multiple times = slower than any other connection to services outside of S3 or on any = other OS. >>>>=20 >>>> It seems like other people are seeing the same issue: >>>>=20 >>>> https://forums.freebsd.org/threads/59756/#post-343064 >>>> _______________________________________________ >>>> freebsd-net@freebsd.org mailing list >>>> https://lists.freebsd.org/mailman/listinfo/freebsd-net >>>> To unsubscribe, send any mail to = "freebsd-net-unsubscribe@freebsd.org" >>> _______________________________________________ >>> freebsd-net@freebsd.org mailing list >>> https://lists.freebsd.org/mailman/listinfo/freebsd-net >>> To unsubscribe, send any mail to = "freebsd-net-unsubscribe@freebsd.org" >> _______________________________________________ >> freebsd-net@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-net >> To unsubscribe, send any mail to = "freebsd-net-unsubscribe@freebsd.org" >=20 > _______________________________________________ > freebsd-net@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" From owner-freebsd-net@freebsd.org Sat Feb 18 01:32:52 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A4F37CE353F; Sat, 18 Feb 2017 01:32:52 +0000 (UTC) (envelope-from brooks@spindle.one-eyed-alien.net) Received: from spindle.one-eyed-alien.net (spindle.one-eyed-alien.net [199.48.129.229]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 87DC41343; Sat, 18 Feb 2017 01:32:52 +0000 (UTC) (envelope-from brooks@spindle.one-eyed-alien.net) Received: by spindle.one-eyed-alien.net (Postfix, from userid 3001) id BAEAC5A9F12; Sat, 18 Feb 2017 01:32:50 +0000 (UTC) Date: Sat, 18 Feb 2017 01:32:50 +0000 From: Brooks Davis To: freebsd-stable@freebsd.org, freebsd-net@freebsd.org Subject: Calling ATM NIC users: en(4), fatm(4), hatm(4), patm(4) Message-ID: <20170218013250.GA72688@spindle.one-eyed-alien.net> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="0OAP2g/MAC+5xKAE" Content-Disposition: inline User-Agent: Mutt/1.7.2 (2016-11-26) X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 18 Feb 2017 01:32:52 -0000 --0OAP2g/MAC+5xKAE Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Our current ATM stack supports a small number of NICs that were current in the late 90s[0]. None of them have been manufactured in a long time and while you can buy hatm(4) devices on e-bay, it's increasingly difficult to find a motherboard that will accept them. I'd like to propose removing support for these NICs along with the remaining ATM stack in FreeBSD 12. This will give any existing users a supported OS until at least September 30, 2021 per our published EOL date for FreeBSD 11. Would removal on this schedule cause you realistic hardship? If so, please let us know. -- Brooks [0] 1997 press release for the most advanced ATM NIC we support http://www.prnewswire.com/news-releases/fore-systems-introduces-industrys-most-advanced-atm-adapter-for-enterprise-networking-77407267.html --0OAP2g/MAC+5xKAE Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQEcBAEBAgAGBQJYp6RBAAoJEKzQXbSebgfAbDAH/20gM5KICd8/FS2gbHMl1dkv bnRQIK5jzqcCHOF3FTODgHwb4NScLTkQsMYIZgxJi/+EHJRg8iZXkab6VzezoQnH 9PJCYr+Tc1nI+j6okwdFELuy6/pkRt/kOEtQo35e7YXSvyEZOR+99855NSsImC1p /oC5IdjR9ENoK6e+7VXHya4dFsqFpt9PvdZnvDGm9NDE4+56p86s3Bw0USgC4ujP PNGQKKOBGTaf0Ovi67gHj3fz+a/ZcrgVZdVxLJeZxAwHoW7QgxhSEdLq5tD7MNKQ KhoN62GHnyIY0s5juvPnlb+l50ZYlxVF6XuT5QTm79DhpyLdPLHCjpzVyGsPcrY= =QsQU -----END PGP SIGNATURE----- --0OAP2g/MAC+5xKAE-- From owner-freebsd-net@freebsd.org Sat Feb 18 03:26:12 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 81EA6CE4115 for ; Sat, 18 Feb 2017 03:26:12 +0000 (UTC) (envelope-from killing@multiplay.co.uk) Received: from mail-wm0-x22c.google.com (mail-wm0-x22c.google.com [IPv6:2a00:1450:400c:c09::22c]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 2B08DE3E for ; Sat, 18 Feb 2017 03:26:12 +0000 (UTC) (envelope-from killing@multiplay.co.uk) Received: by mail-wm0-x22c.google.com with SMTP id c85so31514756wmi.1 for ; Fri, 17 Feb 2017 19:26:11 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=multiplay-co-uk.20150623.gappssmtp.com; s=20150623; h=subject:to:references:from:message-id:date:user-agent:mime-version :in-reply-to; bh=8VqYL4HLt841J2pIKKRNlpzQR2nrWsFDAdx3KothmNM=; b=bCUIkTJPgVBH06Xw3SArxloGb2+sAthPztjaGKcGgA1i/7oshnUIsclzMiLoO+APp9 1mrslmb5eoEIQWYcZJZKe9dXuqgO2QyPoAJ51QM38EYnRqBKW4lEAO+ZeCkR4A5MZmXM KGnlfvOnuc0A252zlOePd+vu70i1sp6ZUZwFVWKaIjkoOgeKAuCqKis0Bd3mEu4AAl0e 4c7mF9h9Gdj+MjGHoyVyOrMsM7KkMl4TrLbGo5t1Rpm9Ae5hSaSKOXnnwFCYKAU7TY/8 Jd0Gau/nlqOss6Ryj9itPxQhD/opIsziP/8HsuykzH4D8+s5Q1i6V1IcB7vmNeuqUNdy Kgww== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:references:from:message-id:date :user-agent:mime-version:in-reply-to; bh=8VqYL4HLt841J2pIKKRNlpzQR2nrWsFDAdx3KothmNM=; b=dcCS1Qc23ZjEnwAQJ0SMzSBvg8CFknwA7hfGAL5e7OVSofaO+k++2LikcCG0zDmk7Z tmxGL72RtAGiFAq9pgvIfJbYwdjZC3adOIc70eDkdPZ3hK/h+ittBTi1J+SMlGc8hID0 Mp1Wpr7Ns3KKSlsb+ntaA+yfq6Vi9VkPoj4NhbBJY/MRvkJdZeJXRJ8yTI9I9A9XEk+a rfyGExgEVMfSMAvzGWLUeiWnGbqvhE/p+97cxhK4+M3/L6k1u1QBSTL0tKgkELHaAx/x /wmxFlgoLbjgfmo4RUM2vzcfnUPjsWwmxZu52DgjsZKBeyIQpL5sp+lKLvQMuH3mFu/f oKLA== X-Gm-Message-State: AMke39lTgKjDKHIkeJg4GrMBb78V0soNmY9ZzvqKCfYyBWMm+zNnhH0edT6OaCHUxdbAQfnA X-Received: by 10.28.146.207 with SMTP id u198mr6717392wmd.36.1487388369154; Fri, 17 Feb 2017 19:26:09 -0800 (PST) Received: from [10.10.1.58] ([185.97.61.26]) by smtp.gmail.com with ESMTPSA id x25sm15292882wrx.27.2017.02.17.19.26.08 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Fri, 17 Feb 2017 19:26:08 -0800 (PST) Subject: Re: Slow Download Speeds from AWS S3 To: freebsd-net@freebsd.org References: <18e49da9-47eb-1803-e223-b4385e7d8690@multiplay.co.uk> <30F9FC69-CEBE-4CBE-93A9-DEDBD053C6C6@googlemail.com> From: Steven Hartland Message-ID: <77fc04b6-380e-8826-3e43-5d820840e26c@multiplay.co.uk> Date: Sat, 18 Feb 2017 03:26:14 +0000 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.7.1 MIME-Version: 1.0 In-Reply-To: <30F9FC69-CEBE-4CBE-93A9-DEDBD053C6C6@googlemail.com> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 18 Feb 2017 03:26:12 -0000 Hey Sydney, I've had some feedback from other team members and armed with this info I'm having a crack at enabling receive buffer auto-scaling using RTT estimations when timestamps aren't available. I don't have any S3 buckets to tests with so Is there any chance you pop up your test file again for me? Regards Steve On 16/02/2017 16:55, Sydney Meyer via freebsd-net wrote: > Hi Steve, > > increasing the buffer size did indeed enhance throughput. > > I am obviously not an expert in this field, but i don't understand why or if the TCP Receive Window Size shouldn't increase automatically. > > I found this thread on the ML and i'm reading myself a bit more into the topic right now. > > https://lists.freebsd.org/pipermail/freebsd-net/2014-August/039495.html > > Thank you for your tip, however.. > > Sydney > >> On 16 Feb 2017, at 16:35, Steven Hartland wrote: >> >> Window scaling and receive buffer scaling is the most likely cause. >> >> Check what the sysctl net.inet.tcp.recvspace is set to, then try increasing it e.g. >> sysctl net.inet.tcp.recvspace=655360 >> >> This jumped the transfer rate with a wget and your test URL from 3MB/s to 30MB/s here. >> >> Regards >> Steve >> >> On 16/02/2017 14:34, Sydney Meyer via freebsd-net wrote: >>> Hello, >>> >>> I'm seeing continuous slow download speeds from Amazon S3, but only on FreeBSD. Other OSes saturate the connection without problems. >>> >>> This happens with 10.3-RELEASE and 11.0-RELEASE and only with AWS S3 in different regions (Ireland, London, Frankfurt, US Standard have been tested) whilst using fetch, curl, et. al. >>> >>> I have tested this on multiple machines, bare metal, bhyve, Xen and VMware VMs, routed setups and direct pppoe links.. all the same. >>> >>> Anyone seeing similar issues? >>> >>> Here's a url to try: >>> >>> http://s3.eu-central-1.amazonaws.com/4f48caf1d8bcbef8/c5b38f8b3625d2b6/zerofile.raw >>> >>> Also, when doing double NAT, i.e. VMware Fusion FreeBSD Guest with "Share with my Mac"-Interface, the machine is doing completely fine, as in saturates the link, 90Mbps otherwise between 12-15Mbps.. >>> >>> I also switched the FreeBSD Routers with Linux-based ones and with the isp-provided router box, with the same result. >>> >>> I have launched VMs with Digital Ocean to "rule out" my ISP and there seems to be the same issue. Downloading from S3 is multiple times slower than any other connection to services outside of S3 or on any other OS. >>> >>> It seems like other people are seeing the same issue: >>> >>> https://forums.freebsd.org/threads/59756/#post-343064 >>> _______________________________________________ >>> freebsd-net@freebsd.org mailing list >>> https://lists.freebsd.org/mailman/listinfo/freebsd-net >>> To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" >> _______________________________________________ >> freebsd-net@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-net >> To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" > _______________________________________________ > freebsd-net@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" From owner-freebsd-net@freebsd.org Sat Feb 18 03:31:46 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B7019CE42D5 for ; Sat, 18 Feb 2017 03:31:46 +0000 (UTC) (envelope-from meyer.sydney@googlemail.com) Received: from mail-wr0-x230.google.com (mail-wr0-x230.google.com [IPv6:2a00:1450:400c:c0c::230]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 5CA0A1070 for ; Sat, 18 Feb 2017 03:31:46 +0000 (UTC) (envelope-from meyer.sydney@googlemail.com) Received: by mail-wr0-x230.google.com with SMTP id 89so34586544wrr.3 for ; Fri, 17 Feb 2017 19:31:46 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlemail.com; s=20161025; h=from:content-transfer-encoding:mime-version:subject:date:references :to:in-reply-to:message-id; bh=mNd7QRC33H51y6t/GbvLxFsARLzCMCurrm+EFq7B57k=; b=VrvehPBiMqcDCNGHu5u3djpw4KN5To/JD+lh/hqMwRIrCx+/hqcyMJweiP2izJOUSJ u1D5DoUW4PmY1rmd1U5vd3ErnMX1U37vcp/hp0QyXW2V4TybF7YKbsoPwNBIn/fiRUwa l+3LLjEpnWYHs1ZlE0dn+JFMkwCa78fRSNLbdMtz7Xh+ISEneDAzRjB0AvIN23NasIrs s8VGKkBgzgswDhhf9QMLhgrbuDrEExL2sR04OdjToZKwipfIZKm5YBIPF/lZ0UGTCIar LS6GVIA+PpQe5XGRFvTX9WdPAEpwmFVJZWcUHuSmVEBuum92ASLR1GqDzhkbsNigw7sj +EUA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:content-transfer-encoding:mime-version :subject:date:references:to:in-reply-to:message-id; bh=mNd7QRC33H51y6t/GbvLxFsARLzCMCurrm+EFq7B57k=; b=TDan15C1MdWShh+7XHVh5pfUWjrD2JWSa9W8g2xtPMwLKUkRapKfAsVTHa7OC6cYWS 8lSc/kLXGu2cG+ZB5oXKpg+p19joEXkoM5hf+iSTr1YBqdPbfRY3DXhLPUPWfLTKWp23 jpA/GCBJOhiEMl63JjRjMCdTmCsldZz8GsYEOx1uvsKTyPkXdJHG2pbXZFQvvYP551zn zXxuFpPbwFRcxK8zI/HnJMMwsqvFZ5lSt+VbOX/hAyeNRxNgErYT34mAx2Z5DP2yF9Du pLg7dsnbCitVSogMmwT7ku8xTLgggV7HGP5Ik7HPbJmpCWfNVHtXgtKZZ1lihbTJQt0U UxJQ== X-Gm-Message-State: AMke39lokbFh8HEcbZqHtI/jPOaO+E0LTFH1TjmumnwcxXZIT4U3+1u9NTCvSA7ehdsmrw== X-Received: by 10.223.150.59 with SMTP id b56mr8838536wra.192.1487388703570; Fri, 17 Feb 2017 19:31:43 -0800 (PST) Received: from ?IPv6:2a02:a03f:a4e:be01:847d:d027:9efb:3b2e? ([2a02:a03f:a4e:be01:847d:d027:9efb:3b2e]) by smtp.googlemail.com with ESMTPSA id c202sm3961789wmd.10.2017.02.17.19.31.42 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Fri, 17 Feb 2017 19:31:43 -0800 (PST) From: Sydney Meyer Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 10.2 \(3259\)) Subject: Re: Slow Download Speeds from AWS S3 Date: Sat, 18 Feb 2017 04:31:42 +0100 References: <18e49da9-47eb-1803-e223-b4385e7d8690@multiplay.co.uk> <30F9FC69-CEBE-4CBE-93A9-DEDBD053C6C6@googlemail.com> <77fc04b6-380e-8826-3e43-5d820840e26c@multiplay.co.uk> To: freebsd-net@freebsd.org In-Reply-To: <77fc04b6-380e-8826-3e43-5d820840e26c@multiplay.co.uk> Message-Id: X-Mailer: Apple Mail (2.3259) X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 18 Feb 2017 03:31:46 -0000 Hi Steve, sure, but i have deleted the bucket already.. i'll set a new one up = quickly.. do you have a specific aws region which you prefer? Sydney > On 18 Feb 2017, at 04:26, Steven Hartland = wrote: >=20 > Hey Sydney, I've had some feedback from other team members and armed = with this info I'm having a crack at enabling receive buffer = auto-scaling using RTT estimations when timestamps aren't available. >=20 > I don't have any S3 buckets to tests with so Is there any chance you = pop up your test file again for me? >=20 > Regards > Steve >=20 > On 16/02/2017 16:55, Sydney Meyer via freebsd-net wrote: >> Hi Steve, >>=20 >> increasing the buffer size did indeed enhance throughput. >>=20 >> I am obviously not an expert in this field, but i don't understand = why or if the TCP Receive Window Size shouldn't increase automatically. >>=20 >> I found this thread on the ML and i'm reading myself a bit more into = the topic right now. >>=20 >> = https://lists.freebsd.org/pipermail/freebsd-net/2014-August/039495.html >>=20 >> Thank you for your tip, however.. >>=20 >> Sydney >>=20 >>> On 16 Feb 2017, at 16:35, Steven Hartland = wrote: >>>=20 >>> Window scaling and receive buffer scaling is the most likely cause. >>>=20 >>> Check what the sysctl net.inet.tcp.recvspace is set to, then try = increasing it e.g. >>> sysctl net.inet.tcp.recvspace=3D655360 >>>=20 >>> This jumped the transfer rate with a wget and your test URL from = 3MB/s to 30MB/s here. >>>=20 >>> Regards >>> Steve >>>=20 >>> On 16/02/2017 14:34, Sydney Meyer via freebsd-net wrote: >>>> Hello, >>>>=20 >>>> I'm seeing continuous slow download speeds from Amazon S3, but only = on FreeBSD. Other OSes saturate the connection without problems. >>>>=20 >>>> This happens with 10.3-RELEASE and 11.0-RELEASE and only with AWS = S3 in different regions (Ireland, London, Frankfurt, US Standard have = been tested) whilst using fetch, curl, et. al. >>>>=20 >>>> I have tested this on multiple machines, bare metal, bhyve, Xen and = VMware VMs, routed setups and direct pppoe links.. all the same. >>>>=20 >>>> Anyone seeing similar issues? >>>>=20 >>>> Here's a url to try: >>>>=20 >>>> = http://s3.eu-central-1.amazonaws.com/4f48caf1d8bcbef8/c5b38f8b3625d2b6/zer= ofile.raw >>>>=20 >>>> Also, when doing double NAT, i.e. VMware Fusion FreeBSD Guest with = "Share with my Mac"-Interface, the machine is doing completely fine, as = in saturates the link, 90Mbps otherwise between 12-15Mbps.. >>>>=20 >>>> I also switched the FreeBSD Routers with Linux-based ones and with = the isp-provided router box, with the same result. >>>>=20 >>>> I have launched VMs with Digital Ocean to "rule out" my ISP and = there seems to be the same issue. Downloading from S3 is multiple times = slower than any other connection to services outside of S3 or on any = other OS. >>>>=20 >>>> It seems like other people are seeing the same issue: >>>>=20 >>>> https://forums.freebsd.org/threads/59756/#post-343064 >>>> _______________________________________________ >>>> freebsd-net@freebsd.org mailing list >>>> https://lists.freebsd.org/mailman/listinfo/freebsd-net >>>> To unsubscribe, send any mail to = "freebsd-net-unsubscribe@freebsd.org" >>> _______________________________________________ >>> freebsd-net@freebsd.org mailing list >>> https://lists.freebsd.org/mailman/listinfo/freebsd-net >>> To unsubscribe, send any mail to = "freebsd-net-unsubscribe@freebsd.org" >> _______________________________________________ >> freebsd-net@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-net >> To unsubscribe, send any mail to = "freebsd-net-unsubscribe@freebsd.org" >=20 > _______________________________________________ > freebsd-net@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" From owner-freebsd-net@freebsd.org Sat Feb 18 03:41:04 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2C6D2CE462E for ; Sat, 18 Feb 2017 03:41:04 +0000 (UTC) (envelope-from meyer.sydney@googlemail.com) Received: from mail-wm0-x235.google.com (mail-wm0-x235.google.com [IPv6:2a00:1450:400c:c09::235]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id B305515CD for ; Sat, 18 Feb 2017 03:41:03 +0000 (UTC) (envelope-from meyer.sydney@googlemail.com) Received: by mail-wm0-x235.google.com with SMTP id v186so31713885wmd.0 for ; Fri, 17 Feb 2017 19:41:03 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlemail.com; s=20161025; h=from:content-transfer-encoding:mime-version:subject:date:references :to:in-reply-to:message-id; bh=Xb6gzpCm+CW9FfwYo0BWhjW9fckL6LKTcTHg52Hw9xE=; b=AOdutOb8bep4PS24zdDpw8K8I7MRKn95pL171JyNrFR+BGV0ynVI2XEEfLtEh0kPDe W09bxP5jb4IHYqX0qxNZkhOMcZB7LBmaBlld2Ybp5g/eoX31ve+oDCK0U738kwfsrduJ HtcQXMJxd27wWmXwOtb18h3o3qLCZZYGph/0NIbIc1mgeNYv+gFX8Rf4LOdZ1Y3YLTgd 48xUnTdfEm85MQv76ffMdkNw0EG4EX+1x3gIXpTWoUc2jcZcER2avnvI7Fpw/AIwQWxU a7eLS4+jqEGpMgieNJfi1eNsA2nMplLJWlORvai3UmeI8a498ezKMfq0tis6HLGsUleP gT2g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:content-transfer-encoding:mime-version :subject:date:references:to:in-reply-to:message-id; bh=Xb6gzpCm+CW9FfwYo0BWhjW9fckL6LKTcTHg52Hw9xE=; b=dkK/9ucKHAzjRjnAe63FDvQIQ+Mso6RvAy/9OnFOLK4dRCR6YLMWmJdUWrJ0L/ecR8 c1kO1mcQJL5SmjZFrLmyfkBCUV7KZlQy7nHhRqVvJG7R99I7VbxdOW3Vgw39+p1JGt6V oIlnRoO2S5SDTneWnyeQRtcGNbfyASSMWW87EnJamBY3dp6lmSgFBPoGf+pZpmDxE9H0 Tu4Lx/eX0gKnc5LyJ4P/zPCp6TA3qOwR/I1AueoLJr8vJKoh5G41a0NX+9KzcSqsD7YW lfYf1zSgvRy849R+yaPa3qKyAjmLYwoQPjQmUCSGLgfBwJa/OlXNad+6q5/O95glHDSj sU2w== X-Gm-Message-State: AMke39kczzi90dIq9wPjjYhCpvLKMrOn/tYKthLxLrMLMyb7l63S64VpA5o2gr0gj7oydA== X-Received: by 10.28.39.5 with SMTP id n5mr3951046wmn.16.1487389261867; Fri, 17 Feb 2017 19:41:01 -0800 (PST) Received: from ?IPv6:2a02:a03f:a4e:be01:847d:d027:9efb:3b2e? ([2a02:a03f:a4e:be01:847d:d027:9efb:3b2e]) by smtp.googlemail.com with ESMTPSA id q12sm4013157wmd.8.2017.02.17.19.41.01 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Fri, 17 Feb 2017 19:41:01 -0800 (PST) From: Sydney Meyer Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 10.2 \(3259\)) Subject: Re: Slow Download Speeds from AWS S3 Date: Sat, 18 Feb 2017 04:41:00 +0100 References: <18e49da9-47eb-1803-e223-b4385e7d8690@multiplay.co.uk> <30F9FC69-CEBE-4CBE-93A9-DEDBD053C6C6@googlemail.com> <77fc04b6-380e-8826-3e43-5d820840e26c@multiplay.co.uk> To: freebsd-net@freebsd.org In-Reply-To: Message-Id: <7D26AA10-4A9A-47F8-8D6D-380FCC2A0071@googlemail.com> X-Mailer: Apple Mail (2.3259) X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 18 Feb 2017 03:41:04 -0000 Here is a 100MB random file in the Frankfurt region: http://s3.eu-central-1.amazonaws.com/43cf34497f/random.raw Sydney > On 18 Feb 2017, at 04:31, Sydney Meyer = wrote: >=20 > Hi Steve, >=20 > sure, but i have deleted the bucket already.. i'll set a new one up = quickly.. do you have a specific aws region which you prefer? >=20 > Sydney >=20 >> On 18 Feb 2017, at 04:26, Steven Hartland = wrote: >>=20 >> Hey Sydney, I've had some feedback from other team members and armed = with this info I'm having a crack at enabling receive buffer = auto-scaling using RTT estimations when timestamps aren't available. >>=20 >> I don't have any S3 buckets to tests with so Is there any chance you = pop up your test file again for me? >>=20 >> Regards >> Steve >>=20 >> On 16/02/2017 16:55, Sydney Meyer via freebsd-net wrote: >>> Hi Steve, >>>=20 >>> increasing the buffer size did indeed enhance throughput. >>>=20 >>> I am obviously not an expert in this field, but i don't understand = why or if the TCP Receive Window Size shouldn't increase automatically. >>>=20 >>> I found this thread on the ML and i'm reading myself a bit more into = the topic right now. >>>=20 >>> = https://lists.freebsd.org/pipermail/freebsd-net/2014-August/039495.html >>>=20 >>> Thank you for your tip, however.. >>>=20 >>> Sydney >>>=20 >>>> On 16 Feb 2017, at 16:35, Steven Hartland = wrote: >>>>=20 >>>> Window scaling and receive buffer scaling is the most likely cause. >>>>=20 >>>> Check what the sysctl net.inet.tcp.recvspace is set to, then try = increasing it e.g. >>>> sysctl net.inet.tcp.recvspace=3D655360 >>>>=20 >>>> This jumped the transfer rate with a wget and your test URL from = 3MB/s to 30MB/s here. >>>>=20 >>>> Regards >>>> Steve >>>>=20 >>>> On 16/02/2017 14:34, Sydney Meyer via freebsd-net wrote: >>>>> Hello, >>>>>=20 >>>>> I'm seeing continuous slow download speeds from Amazon S3, but = only on FreeBSD. Other OSes saturate the connection without problems. >>>>>=20 >>>>> This happens with 10.3-RELEASE and 11.0-RELEASE and only with AWS = S3 in different regions (Ireland, London, Frankfurt, US Standard have = been tested) whilst using fetch, curl, et. al. >>>>>=20 >>>>> I have tested this on multiple machines, bare metal, bhyve, Xen = and VMware VMs, routed setups and direct pppoe links.. all the same. >>>>>=20 >>>>> Anyone seeing similar issues? >>>>>=20 >>>>> Here's a url to try: >>>>>=20 >>>>> = http://s3.eu-central-1.amazonaws.com/4f48caf1d8bcbef8/c5b38f8b3625d2b6/zer= ofile.raw >>>>>=20 >>>>> Also, when doing double NAT, i.e. VMware Fusion FreeBSD Guest with = "Share with my Mac"-Interface, the machine is doing completely fine, as = in saturates the link, 90Mbps otherwise between 12-15Mbps.. >>>>>=20 >>>>> I also switched the FreeBSD Routers with Linux-based ones and with = the isp-provided router box, with the same result. >>>>>=20 >>>>> I have launched VMs with Digital Ocean to "rule out" my ISP and = there seems to be the same issue. Downloading from S3 is multiple times = slower than any other connection to services outside of S3 or on any = other OS. >>>>>=20 >>>>> It seems like other people are seeing the same issue: >>>>>=20 >>>>> https://forums.freebsd.org/threads/59756/#post-343064 >>>>> _______________________________________________ >>>>> freebsd-net@freebsd.org mailing list >>>>> https://lists.freebsd.org/mailman/listinfo/freebsd-net >>>>> To unsubscribe, send any mail to = "freebsd-net-unsubscribe@freebsd.org" >>>> _______________________________________________ >>>> freebsd-net@freebsd.org mailing list >>>> https://lists.freebsd.org/mailman/listinfo/freebsd-net >>>> To unsubscribe, send any mail to = "freebsd-net-unsubscribe@freebsd.org" >>> _______________________________________________ >>> freebsd-net@freebsd.org mailing list >>> https://lists.freebsd.org/mailman/listinfo/freebsd-net >>> To unsubscribe, send any mail to = "freebsd-net-unsubscribe@freebsd.org" >>=20 >> _______________________________________________ >> freebsd-net@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-net >> To unsubscribe, send any mail to = "freebsd-net-unsubscribe@freebsd.org" >=20 From owner-freebsd-net@freebsd.org Sat Feb 18 04:51:41 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A5544CE49F9 for ; Sat, 18 Feb 2017 04:51:41 +0000 (UTC) (envelope-from killing@multiplay.co.uk) Received: from mail-wm0-x22a.google.com (mail-wm0-x22a.google.com [IPv6:2a00:1450:400c:c09::22a]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 3FCAE1AEB for ; Sat, 18 Feb 2017 04:51:40 +0000 (UTC) (envelope-from killing@multiplay.co.uk) Received: by mail-wm0-x22a.google.com with SMTP id c85so32346390wmi.1 for ; Fri, 17 Feb 2017 20:51:40 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=multiplay-co-uk.20150623.gappssmtp.com; s=20150623; h=subject:to:references:from:message-id:date:user-agent:mime-version :in-reply-to; bh=0WPAdj9Ua5VmFJI6ZK0FSpwERj80PllalAEHJw+WyMY=; b=w+DWHtZaT6qo4DY3E2oZ/zWcixGbbYSHTafSITIjVV8iNWKTj9FJf5L+Z1xrHdkRGY 6yIqrCdrU9UcQvI6gciO5NnwlAGO4ADo11Ifn67F7kfelbvpoeMw01KUS7R67PEh3HaS 2IawUwYHHamx5TWvBZxtQDKESt+Uwvo1+ttVL7wUwlM8q55NRs9uhuC0lJAHktVHm2rd JkmOX5B3Jqau5SdG4cU8tibQUYz3NynrL3hCk1ijd1bbL2JblsczNPqm+8LqmJMX9OUj Kirnu0UXBqNaIAPDFxHAbBp9m1YtysPF9tJACGWSBhd8WLXQFltP8ghI0cH9VqY4j/9z U1bw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:references:from:message-id:date :user-agent:mime-version:in-reply-to; bh=0WPAdj9Ua5VmFJI6ZK0FSpwERj80PllalAEHJw+WyMY=; b=rQaE6I/C3bws/XIRmwAfkiS0RwnBMNLjIfsEJ2VAJkMNKymOuTaDaykuIsANb6pL2P z+mCpWL16OTD04xsIK21Fjtsr/10hpoK9FzgOhHA2Xcw69phjSN/s7d8Y4/qP+fluvh5 CWRbPEiijwlHZKWCbPH7mbwR3wk3DyOU80Y4ggEDdqxOiMgrxY6xm9nVmbgQUusirhiD CIiLcoxHX/B+uB7ZoLHiZLYIxZL4lvkbBXPKgAJ7EHE97+PNoEQjfTF/SjQDVt/9J8lh kiZZ8ESn7SNJgDuzsAbNYSYswbm7NhHu/0MEzLMlw8xnLBY70dw6cgd5GJJNSd2A6Q/r 9FHw== X-Gm-Message-State: AMke39lNiSaqllpILBF39FzABIbzRn5LiF3rZd6/Opl+ZszrfWvOSH9sCHkV5EUIrJHXO+li X-Received: by 10.28.17.20 with SMTP id 20mr7345503wmr.106.1487393497365; Fri, 17 Feb 2017 20:51:37 -0800 (PST) Received: from [10.10.1.58] ([185.97.61.26]) by smtp.gmail.com with ESMTPSA id b10sm4144428wmi.34.2017.02.17.20.51.36 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Fri, 17 Feb 2017 20:51:36 -0800 (PST) Subject: Re: Slow Download Speeds from AWS S3 To: freebsd-net@freebsd.org References: <18e49da9-47eb-1803-e223-b4385e7d8690@multiplay.co.uk> <30F9FC69-CEBE-4CBE-93A9-DEDBD053C6C6@googlemail.com> <77fc04b6-380e-8826-3e43-5d820840e26c@multiplay.co.uk> <7D26AA10-4A9A-47F8-8D6D-380FCC2A0071@googlemail.com> From: Steven Hartland Message-ID: <6840df19-500e-a83f-d712-5a488bffff9e@multiplay.co.uk> Date: Sat, 18 Feb 2017 04:51:42 +0000 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.7.1 MIME-Version: 1.0 In-Reply-To: <7D26AA10-4A9A-47F8-8D6D-380FCC2A0071@googlemail.com> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 18 Feb 2017 04:51:41 -0000 Thanks Sydney :) On 18/02/2017 03:41, Sydney Meyer via freebsd-net wrote: > Here is a 100MB random file in the Frankfurt region: > > http://s3.eu-central-1.amazonaws.com/43cf34497f/random.raw > > Sydney > From owner-freebsd-net@freebsd.org Sat Feb 18 05:14:19 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 880A2CE42B0 for ; Sat, 18 Feb 2017 05:14:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 77469B11 for ; Sat, 18 Feb 2017 05:14:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v1I5EGti060152 for ; Sat, 18 Feb 2017 05:14:19 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-net@FreeBSD.org Subject: [Bug 212018] Enable IPSEC_NAT_T in GENERIC kernel configuration Date: Sat, 18 Feb 2017 05:14:16 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: conf X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: feature, needs-patch X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: woodsb02@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: freebsd-net@FreeBSD.org X-Bugzilla-Flags: mfc-stable10? mfc-stable11? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 18 Feb 2017 05:14:19 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D212018 --- Comment #5 from Ben Woods --- Note that the IPSEC_NAT_T option was removed in r313330 commit to FREEBSD 12-CURRENT. https://svnweb.freebsd.org/base?view=3Drevision&revision=3D313330 This commit has not been merged to stable (at least yet), and the IPSEC_NAT= _T option still exists (off by default) in the 11-STABLE branch: https://svnweb.freebsd.org/base/stable/11/sys/conf/options?view=3Dmarkup https://svnweb.freebsd.org/base/stable/11/sys/amd64/conf/GENERIC?view=3Dmar= kup --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Sat Feb 18 09:36:12 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BA60ACE2A55 for ; Sat, 18 Feb 2017 09:36:12 +0000 (UTC) (envelope-from v.maffione@gmail.com) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 964011D49 for ; Sat, 18 Feb 2017 09:36:12 +0000 (UTC) (envelope-from v.maffione@gmail.com) Received: by mailman.ysv.freebsd.org (Postfix) id 9282DCE2A54; Sat, 18 Feb 2017 09:36:12 +0000 (UTC) Delivered-To: net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 921C7CE2A53 for ; Sat, 18 Feb 2017 09:36:12 +0000 (UTC) (envelope-from v.maffione@gmail.com) Received: from mail-ot0-x22d.google.com (mail-ot0-x22d.google.com [IPv6:2607:f8b0:4003:c0f::22d]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 548F51D48 for ; Sat, 18 Feb 2017 09:36:12 +0000 (UTC) (envelope-from v.maffione@gmail.com) Received: by mail-ot0-x22d.google.com with SMTP id 32so45167051oth.3 for ; Sat, 18 Feb 2017 01:36:12 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=xX/rSGZ/RNAHENhnXOFlSeruuJnIv9Uv+o+vYWUhpUI=; b=RkA49myvAOrBTBce2E5AQgnUlC5uiPOCUf6Qp+3uuCHbSdZVoCZeLtb5RUdrEXqqo5 NVSuQ9BejS17tamqwQsgeoMoNNLl+W7db/tKK1GLgmd5EwSTtxhOdACeNHiei7gMMLL8 mAxpo91/TBWnb6kF9i3cTnxAEHljPu4WhKRg0nT0fOZl2UJjnnhkeNmkvpNndR3s5c9d 3079Sr6pBIZKvqndY7vqAdB27hCeE72WfY8voadLn60egtGIW+MYKbgA071a0ANASWWt 26d8dlwwJ5uNg6Be1CMlWannq83IZ7Udi0rI+20uTi5k/vaM+YHl7eafT/zvFMcZkTd+ LgMw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=xX/rSGZ/RNAHENhnXOFlSeruuJnIv9Uv+o+vYWUhpUI=; b=ZYTC8Pc87CmxZEPzzd6iE/dcqDcir2RAm96Fo0NlfvbH/FLdrBtNoxDqcxGru0jkT2 nCJKdjaNzNzzjy+U9Znq/QQeJ+kg40NSNC5epIWpc7/uFnrddZS9ZARMK3ZDTrGJq63P LoFNsPVpo0dDUQ2Fm+bY6D3JxkWZ9HR+ZJmofdaULtrhfCF8Nzcmdn12LUQs4ikYjxPc YBTf2LKPwwBg3NIsciDbQAz3FFOYDeIpgU5JNdijsbH7/oP6Xsv8QZscGgKvXejbv0we e91byZYLP1Vn5ptKyjUDgf4cwa5sLlwcfc5tJrHlDg4D1PUsQ4nH4m54E+b7R58RES7f sG1g== X-Gm-Message-State: AMke39k/F6/jkNrhX5XPA5bFfDOkbdc9HLvwI276X91oEsHS0JlaJZMzaZ7VgfMEBd9vy5FxFjHOf+1i3XzQpQ== X-Received: by 10.157.40.46 with SMTP id m43mr7659435otb.213.1487410571546; Sat, 18 Feb 2017 01:36:11 -0800 (PST) MIME-Version: 1.0 Received: by 10.157.7.201 with HTTP; Sat, 18 Feb 2017 01:36:11 -0800 (PST) In-Reply-To: <20170216205819.GS6035@zxy.spb.ru> References: <20170214123621.GA15630@zxy.spb.ru> <20170216203813.GR6035@zxy.spb.ru> <20170216205819.GS6035@zxy.spb.ru> From: Vincenzo Maffione Date: Sat, 18 Feb 2017 10:36:11 +0100 Message-ID: Subject: Re: netmap_mem_get_info To: Slawa Olhovchenkov Cc: amir alipour , "freebsd-net@freebsd.org" Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 18 Feb 2017 09:36:12 -0000 For each netmap memory area (in this case you use only the global one): - if_num must be >= of the total number of NIOCREGIF on the netmap memory area. The default is 100 and it should be ok. - Then you have to count how many TX and RX rings you use in total in all the interfaces you NIOCREGIF'd in the memory area. So using your terminology, in the worst case you have (K + K+1 + 1) rings (NIC Tx+ NIC rx + host tx + host rx) from the outside interface and (L+L+1+1) rings for the inside interface. You also have 2 rings for each couple of pipes you are using. So ring_num must be >= than the rings count. - Then you need to count the total number of slots in all those rings. Each ring may have differenet number of descriptors, so you need to check it out that for each interface (e.g. "ethtool -g ethX" on linux, probably some sysctl on freebsd). Pipes by default have the same number of slots of their parent adapter. If x is the total number of slots, then it must be buf_num >= x. - Finally, you have to look for the ring(s) that has the maximum number of slots. If that number is y, then it must be ring_size >= sizeof(struct netmap_slot)*y + sizeof(struct netmap_ring). Cheers, Vincenzo 2017-02-16 21:58 GMT+01:00 Slawa Olhovchenkov : > On Thu, Feb 16, 2017 at 09:48:14PM +0100, Vincenzo Maffione wrote: > > > Not sure about what you mean. Until memory areas are in use the real > values > > (*_num, *_size) are not changed. > > At NIOCREGIF time you can say what allocator you are interested in by > > writing a non-zero id inside req.nr_arg2. > > My application have N balancer thread and M worker thread. > Application serve outside interface w/ K rings (and ring size N) and > inside interface w/ L rings (and ring size M). > > All balancer threads share rings from interfaces in next maner: > > first thread open descriptors to 1st ring of inside and outside interface > next thread open descriptors to 2nd ring of inside and outside interface > > and etc in round-roubin. > > every balancer thread open 2 pipe to every worker thread. > > how many if_num, ring_num, buf_num I am need to configure? > > > 2017-02-16 21:38 GMT+01:00 Slawa Olhovchenkov : > > > > > On Thu, Feb 16, 2017 at 09:14:19PM +0100, Vincenzo Maffione wrote: > > > > > > > Hi, > > > > You're right, we'll try to add more details. > > > > > > > > In any case, buf_size, ring_size and if_size are the sizes in bytes > of > > > each > > > > buffer, ring and netmap_if (control data structure), respectively. > > > > So the maximum amount of slots for each ring is ring_size/16, as 16 > is > > > the > > > > size in bytes of struct netmap_slot. > > > > > > > > On the other side, buf_num, ring_num and if_num are the total number > of > > > > biffers, rings and netmap_if objects in each netmap memory area (aka > > > > "allocator"). > > > > By default there is a single memory area used by all the hardware > NICs > > > and > > > > a separate memory area for each VALE port. > > > > This is already configurable, however. > > > > > > This values also depends on open netmap descriptors, right? > > > > > > > 2017-02-14 13:36 GMT+01:00 Slawa Olhovchenkov : > > > > > > > > > On Tue, Feb 14, 2017 at 12:26:55PM +0100, Vincenzo Maffione wrote: > > > > > > > > > > > Hi, > > > > > > Have you tried to play with netmap sysctl parameters like: > > > > > > > > > > > > dev.netmap.buf_num > > > > > > dev.netmap.ring_num > > > > > > dev.netmap.if_num > > > > > > > > > > > > those are listed in the sysctl section of the netmap man page. > > > > > > > > > > man page hide details about calcul rules of this parameters. > > > > > > > > > > > > > > > > > > > > > -- > > > > Vincenzo Maffione > > > > > > > > > > > -- > > Vincenzo Maffione > -- Vincenzo Maffione