From owner-freebsd-stable@FreeBSD.ORG Sat Nov 6 09:37:01 2010 Return-Path: Delivered-To: stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id CE276106564A for ; Sat, 6 Nov 2010 09:37:01 +0000 (UTC) (envelope-from uqs@spoerlein.net) Received: from acme.spoerlein.net (acme.spoerlein.net [IPv6:2001:470:9a47::1]) by mx1.freebsd.org (Postfix) with ESMTP id 7CDF58FC21 for ; Sat, 6 Nov 2010 09:37:01 +0000 (UTC) Received: from acme.spoerlein.net (localhost.spoerlein.net [IPv6:::1]) by acme.spoerlein.net (8.14.4/8.14.4) with ESMTP id oA69b0tq027779 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Sat, 6 Nov 2010 10:37:00 +0100 (CET) (envelope-from uqs@spoerlein.net) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=spoerlein.net; s=dkim200908; t=1289036220; bh=nE5G2A3QoqJsMz4kshpHc4PQhCdTcZnd+rO+NKUACl4=; h=Date:From:To:Cc:Subject:Message-ID:MIME-Version:Content-Type; b=Lc/D8+Ys/AuWcvji2kJ/6T/QPLl9Qaq9ohWpTahR8xC8gGCnpYzlSa/t6Yf4KeZMX zA1RaqrRAF0ZOknQ5mihll/+vQJRpNJSqjHKDRTtSgwFE3PvKuzl0w6/ua8zlTZtiW w//yv2evqv0zk+eD5jU8e0BxO3/5VM9naXJKv3M0= Received: (from uqs@localhost) by acme.spoerlein.net (8.14.4/8.14.4/Submit) id oA69b0KI027778; Sat, 6 Nov 2010 10:37:00 +0100 (CET) (envelope-from uqs@spoerlein.net) Date: Sat, 6 Nov 2010 10:37:00 +0100 From: Ulrich =?utf-8?B?U3DDtnJsZWlu?= To: Pyun YongHyeon Message-ID: <20101106093700.GW85693@acme.spoerlein.net> Mail-Followup-To: Pyun YongHyeon , stable@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.5.21 (2010-09-15) Cc: stable@freebsd.org Subject: Abysmal re(4) performance under 8.1-STABLE (mid-August) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 06 Nov 2010 09:37:02 -0000 Hello Pyun, On this new server, I cannot get more than ~280kByte/s up/downstream out of re(4) without any tweaking. re0: flags=8843 metric 0 mtu 1500 options=389b ether 00:21:85:63:74:34 inet6 fe80::221:85ff:fe63:7434%re0 prefixlen 64 scopeid 0x1 inet 46.4.12.147 netmask 0xffffffc0 broadcast 46.4.12.191 nd6 options=3 media: Ethernet autoselect (100baseTX ) status: active re0@pci0:2:0:0: class=0x020000 card=0x368c1462 chip=0x816810ec rev=0x01 hdr=0x00 vendor = 'Realtek Semiconductor' device = 'Gigabit Ethernet NIC(NDIS 6.0) (RTL8168/8111/8111c)' class = network subclass = ethernet re0: port 0xd800-0xd8ff mem 0xfeaff000-0xfeafffff irq 19 at device 0.0 on pci2 re0: Using 1 MSI messages re0: Chip rev. 0x38000000 re0: MAC rev. 0x00000000 miibus0: on re0 rgephy0: PHY 1 on miibus0 rgephy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-FDX, auto re0: Ethernet address: 00:21:85:63:74:34 re0: [FILTER] It's interesting to note, that re0 only negotiates half-duplex, where linux will negotiate full-duplex (and gets ~10MByte/s as expected). Next, I disabled almost all options, except that I cannot disable VLAN_MTU, VLAN_HWCSUM. I also forced the adapter into full-duplex. # ifconfig re0 -vlanmtu # ifconfig re0 -vlanhwcsum ifconfig: -vlanhwcsum: bad value # ifconfig re0 re0: flags=8843 metric 0 mtu 1500 options=88 ether 00:21:85:63:74:34 inet6 fe80::221:85ff:fe63:7434%re0 prefixlen 64 scopeid 0x1 inet 46.4.12.147 netmask 0xffffffc0 broadcast 46.4.12.191 nd6 options=3 media: Ethernet 100baseTX (100baseTX ) status: active If I then immediately start the test-download, I get a ~2MByte/s spike, which quickly returns to something around 250kByte/s. Booting with hw.pci.enable_msix=0 hw.pci.enable_msi=0 I can get almost up to 400kByte/s, but this may be coincidence. So this is usually as far as it gets: re0 in 190.504 KB/s 246.136 KB/s 66.709 MB out 10.290 KB/s 12.985 KB/s 6.076 MB But then I ran tcpdump in another session, and it looks like the ssh traffic on the upstream of the interface will make the downloads running in another window go faster: re0 in 805.961 KB/s 1.577 MB/s 116.523 MB out 222.940 KB/s 502.045 KB/s 19.267 MB Any ideas? Uli