From owner-freebsd-net@FreeBSD.ORG Wed Dec 3 15:57:25 2014 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 580F984E for ; Wed, 3 Dec 2014 15:57:25 +0000 (UTC) Received: from mail-wi0-f181.google.com (mail-wi0-f181.google.com [209.85.212.181]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id E05D4D50 for ; Wed, 3 Dec 2014 15:57:24 +0000 (UTC) Received: by mail-wi0-f181.google.com with SMTP id r20so24904133wiv.14 for ; Wed, 03 Dec 2014 07:57:17 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:message-id:date:from:user-agent:mime-version:to :subject:references:in-reply-to:content-type :content-transfer-encoding; bh=aLQT1o+S1lw48U9AJpP+BbevuDIm9KzXdvFTz7XG/Do=; b=IK0BasGjxIStPSoOHaXLkpjRMyMTd5CFWgsrf7ALq87Xg/vyXbgPnDpolYds2Wr29u n7rn6Qz5IUwnduT9FGHXwHk/oSZMZbu6tul3uufEo6P7eFz4Gc+XwL7mHSOv3ys9htnq MQqLw7E0AP2sLW/QWgqHSfdQoWpbla7TUSYNFxEguz243upvTujjXAOTu36OCLe1jCXX jfhA4UYegVngWZXLyOKEjpjcHQhIc6lbm0EnnCmPQSAv8ZokaXCOCZR03IdR4Bj4k30i AO7HazFkQzx+VgymqoF1U6OgQNrbQmew8yMqEBijLjwAmMBCsLHNfJ5C8CZ7SxQBhH7T 6rZA== X-Gm-Message-State: ALoCoQmVLFf980AjmdJIHVPWnNjQ/r0oddjtAOW8d5/+3qF2k+XfOGUeZr0qUPCYo4O2YyprGX7o X-Received: by 10.180.211.84 with SMTP id na20mr14570950wic.41.1417622237134; Wed, 03 Dec 2014 07:57:17 -0800 (PST) Received: from [10.10.1.68] (82-69-141-170.dsl.in-addr.zen.co.uk. [82.69.141.170]) by mx.google.com with ESMTPSA id ec2sm37638016wib.23.2014.12.03.07.57.16 for (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Wed, 03 Dec 2014 07:57:16 -0800 (PST) Message-ID: <547F3352.3040101@multiplay.co.uk> Date: Wed, 03 Dec 2014 15:59:14 +0000 From: Steven Hartland User-Agent: Mozilla/5.0 (Windows NT 5.1; rv:31.0) Gecko/20100101 Thunderbird/31.2.0 MIME-Version: 1.0 To: freebsd-net@freebsd.org Subject: Re: Horrendous upload network performance with VLAN (download seems OK) References: <727AB395-CF83-4D13-A2C3-50969C2969B0@patpro.net> In-Reply-To: <727AB395-CF83-4D13-A2C3-50969C2969B0@patpro.net> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 03 Dec 2014 15:57:25 -0000 Have you tried disabling all the various flags VLAN flags on the NIC? On 03/12/2014 15:46, Patrick Proniewski wrote: > Hello, > > I'm running FreeBSD 9.3-RELEASE up-to-date, on two HP Proliant G6 server blades in the same enclosure. One with VLANs in the uplink, the other without VLANs. They use bxe driver. > > bxe0: > mem 0xfb000000-0xfb7fffff,0xfa800000-0xfaffffff irq 28 at device 0.0 on pci2 > bxe0: PCI BAR0 [10] memory allocated: 0xfb000000-0xfb7fffff (8388608) -> 0xfffffe00fb000000 > bxe0: PCI BAR2 [18] memory allocated: 0xfa800000-0xfaffffff (8388608) -> 0xfffffe00fa800000 > bxe0: Found 10GBase-CX4 media. > bxe0: Ethernet address: 00:17:a4:77:04:10 > bxe0: MSI-X vectors Requested 5 and Allocated 5 > ../.. > (and so on up to bxe7) > > Blade A is configured to access the network through a connection without VLANs (the link provided by Network team comes with no VLAN tagging). Its transfer rate is perfect, both up and down. > > ifconfig_bxe0="inet x.y.z.141/24" > defaultrouter="x.y.z.1" > > # ifconfig bxe0 > bxe0: flags=8843 metric 0 mtu 1500 > options=507bb > ether 00:17:a4:77:04:00 > inet x.y.z.141 netmask 0xffffff00 broadcast x.y.z.255 > nd6 options=29 > media: Ethernet autoselect (10Gbase-CX4 ) > status: active > > > Blade B is configured to access the network through a link sporting multiple VLANs, so I've created a network interface that uses one of these VLANs. Ping is OK, I can ssh to this server, transfer rate to the server (down) is not fantastic but OK, enough to perform pkg installation or FreeBSD update. Transfer rate from the server to the rest of the world is abysmal, often stalling after few 100's KB. > > ifconfig_bxe0="UP" > vlans_bxe0="161" > ifconfig_bxe0_161="inet x.y.z.142/24" > defaultrouter="x.y.z.1" > > # ifconfig bxe0 > bxe0: flags=8843 metric 0 mtu 1500 > options=507bb > ether 00:17:a4:77:04:10 > nd6 options=29 > media: Ethernet autoselect (10Gbase-CX4 ) > status: active > > # ifconfig bxe0.161 > bxe0.161: flags=8843 metric 0 mtu 1500 > options=303 > ether 00:17:a4:77:04:10 > inet x.y.z.142 netmask 0xffffff00 broadcast x.y.z.255 > inet6 fe80::217:a4ff:fe77:410%bxe0.161 prefixlen 64 scopeid 0x10 > nd6 options=29 > media: Ethernet autoselect (10Gbase-CX4 ) > status: active > vlan: 161 parent interface: bxe0 > > > The same switch is used by those two blade servers running FreeBSD, and by about 14 other blade servers running VMware ESXi 5.x. > ESXi blades use multiple VLANs and work perfectly. A blade running FreeBSD with no VLAN in its uplink (i.e. not sharing the same uplink as ESXi blades) has very good network performances. The only blade with problem is the one running FreeBSD and sharing the uplink of ESXi blades. > > scp of a 347MB file from an ESXi blade server to FreeBSD blade (same switch, same blade chassis, same uplink): > > # scp esxi11.domain.tld:/tardisks/FILE /dev/null > Password: > FILE 100% 347MB 38.6MB/s 00:09 > > scp of a 347MB file from an FreeBSD blade to ESXi blade (same switch, same blade chassis, same uplink): > > # scp FILE esxi11.domain.tld:/dev/null > Password: > FILE 0% 400KB 172.2KB/s - stalled - > > traceroute from FreeBSD blade to ESXi blade: > > # traceroute esxi11.domain.tld > traceroute to esxi11.domain.tld (x.y.z.151), 64 hops max, 52 byte packets > 1 * * * > 2 * * * > ^C > > traceroute from ESXi blade to FreeBSD blade: > > # traceroute freebsdB.domain.tld > traceroute to freebsdB.domain.tld (x.y.z.142), 30 hops max, 40 byte packets > 1 freebsdB (x.y.z.142) 0.123 ms 0.090 ms 0.078 ms > > I'm quite lost here. > Any idea that would explain the problem, and help me resolve it? > > Original thread posted on > > Patrick > > _______________________________________________ > freebsd-net@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org"