From owner-freebsd-net@freebsd.org  Tue May 29 08:00:06 2018
Return-Path: <owner-freebsd-net@freebsd.org>
Delivered-To: freebsd-net@mailman.ysv.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
 by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5D86DEF89B4
 for <freebsd-net@mailman.ysv.freebsd.org>;
 Tue, 29 May 2018 08:00:06 +0000 (UTC) (envelope-from satan@ukr.net)
Received: from hell.ukr.net (hell.ukr.net [212.42.67.68])
 (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
 (Client did not present a certificate)
 by mx1.freebsd.org (Postfix) with ESMTPS id CA5FF7C6E8
 for <freebsd-net@freebsd.org>; Tue, 29 May 2018 08:00:05 +0000 (UTC)
 (envelope-from satan@ukr.net)
Received: from satan by hell.ukr.net with local ID 1fNYsv-0004rc-Vo
 for freebsd-net@freebsd.org; Tue, 29 May 2018 10:17:33 +0300
Date: Tue, 29 May 2018 10:17:33 +0300
From: Vitalij Satanivskij <satan@ukr.net>
To: freebsd-net@freebsd.org
Subject: GRE/gif/netgraph tunnel speed on 10Gbit channel
Message-ID: <20180529071733.GA18182@hell.ukr.net>
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
User-Agent: Mutt/1.10.0 (2018-05-17)
X-BeenThere: freebsd-net@freebsd.org
X-Mailman-Version: 2.1.26
Precedence: list
List-Id: Networking and TCP/IP with FreeBSD <freebsd-net.freebsd.org>
List-Unsubscribe: <https://lists.freebsd.org/mailman/options/freebsd-net>,
 <mailto:freebsd-net-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-net/>
List-Post: <mailto:freebsd-net@freebsd.org>
List-Help: <mailto:freebsd-net-request@freebsd.org?subject=help>
List-Subscribe: <https://lists.freebsd.org/mailman/listinfo/freebsd-net>,
 <mailto:freebsd-net-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Tue, 29 May 2018 08:00:06 -0000

Hello.

Trying to build a tunnel between two machines with 10Gbit network (ixl0: <Intel(R) Ethernet Connection 700 Series PF Driver, Version - 1.9.9-k>)

I saw that the maximum speed of the tunnel is 1.6gbit for gre/gif and arround 544-600mbit for ng0 (netgraph tunnel via TCP)

Hardware is:

CPU: AMD EPYC 7251 8-Core Processor
    FreeBSD/SMP: 2 package(s) x 8 core(s) x 2 hardware threads
    real memory  = 137438953472 (131072 MB)

Also check same on 
CPU: Intel(R) Xeon(R) CPU E5-2660 v4 x2
CPU: AMD EPYC 7351 16-Core Processor x2 
Come intel E3-1230 and so on.

Version of system - 11.2-BETA2 FreeBSD 11.2-BETA2 #0 r334027
Also I'm test FreeBSD 11.1-PRERELEASE #6 r320593

Kernel GENERIC and CUSTOM (mostly cut off not used drivers from kernel) 

For testing I'm use iperf on pure 10Gbit chanel easy get 9.8-9.9Gbit's 
For tunnel's even try to check multiply instance of iperf (eg on different ports)


So question are - Is it normal speed for tunnel's. 
Which tuning I can try to speed up it. 

Thank you.