From owner-freebsd-stable@FreeBSD.ORG Thu Feb 4 19:24:38 2010 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id BCFA0106566C for ; Thu, 4 Feb 2010 19:24:38 +0000 (UTC) (envelope-from pyunyh@gmail.com) Received: from mail-vw0-f54.google.com (mail-vw0-f54.google.com [209.85.212.54]) by mx1.freebsd.org (Postfix) with ESMTP id 68FD58FC1A for ; Thu, 4 Feb 2010 19:24:38 +0000 (UTC) Received: by vws11 with SMTP id 11so1347945vws.13 for ; Thu, 04 Feb 2010 11:24:37 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:received:from:date:to:cc :subject:message-id:reply-to:references:mime-version:content-type :content-disposition:in-reply-to:user-agent; bh=NWqPExEbLdR7lPzLhMgxRT5+S49+w2/5d4XfAjJ35WE=; b=Gt/eklK7Hl+qzSzhaU9Gtzjujr+kBswcF21P+4Bgn/CRk3ut0jGVrs7PPPKXnMRH2P KX85E8uDBuGGJgP77hXToQRgThj6C4I7hrSA6csgOgG+PBNdjhyrnv0njb4gGcZEIw1W NG6zM8JhY4XYvKYOKKJ8hNwE62zprWtlNAnLw= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=from:date:to:cc:subject:message-id:reply-to:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; b=JRSksw0+N/wAAB026/ZR7UgGGuSlGex6oqXV0DCkkr5aeCQvLZ9/ER8ZFVbECOaQeT dg+8zAPJvwm9mANui6ATowtTLNliddnXh+9nlK+k9PmZBOzjZAXJ5kEP5iy+z1jcu216 WZwEUCEzWTlTdYTZqUEfyJAHCvmnYDb5bzcw4= Received: by 10.220.127.97 with SMTP id f33mr2817822vcs.47.1265311477588; Thu, 04 Feb 2010 11:24:37 -0800 (PST) Received: from pyunyh@gmail.com ([174.35.1.224]) by mx.google.com with ESMTPS id 24sm3594983vws.13.2010.02.04.11.24.35 (version=TLSv1/SSLv3 cipher=RC4-MD5); Thu, 04 Feb 2010 11:24:36 -0800 (PST) Received: by pyunyh@gmail.com (sSMTP sendmail emulation); Thu, 4 Feb 2010 11:23:15 -0800 From: Pyun YongHyeon Date: Thu, 4 Feb 2010 11:23:15 -0800 To: Jonathan Chen Message-ID: <20100204192315.GN5901@michelle.cdnetworks.com> References: <20100202193616.GA16953@osiris.chen.org.nz> <20100202212029.GA5295@asgard.cs.uoi.gr> <20100203225255.GB14315@osiris.chen.org.nz> <20100204012503.GK5901@michelle.cdnetworks.com> <20100204020015.GA17301@osiris.chen.org.nz> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20100204020015.GA17301@osiris.chen.org.nz> User-Agent: Mutt/1.4.2.3i Cc: freebsd-stable@freebsd.org Subject: Re: if_bge upload stalls repeatedly (Was: 8-STABLE outgoing scp stalling frequently) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: pyunyh@gmail.com List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 04 Feb 2010 19:24:38 -0000 On Thu, Feb 04, 2010 at 03:00:15PM +1300, Jonathan Chen wrote: > On Wed, Feb 03, 2010 at 05:25:03PM -0800, Pyun YongHyeon wrote: > > On Thu, Feb 04, 2010 at 11:52:55AM +1300, Jonathan Chen wrote: > > > On Tue, Feb 02, 2010 at 11:20:29PM +0200, Nikos Ntarmos wrote: > > > > On Wed, Feb 03, 2010 at 08:36:16AM +1300, Jonathan Chen wrote: > > > > > Hi, > > > > > > > > > > I've noticed that on a recent 8-STABLE/amd64, scp(1) appears to be > > > > > stalling very frequently. This is the output from a "scp -v -v" > > > > > of a 300Mb file from a local to a remote within an internal network: > > > > > > [...] > > > > > Does anyone know what's happening here? Any tips on how to track down > > > > > what the problem is? The network config appears to be fine - fetch(1) will > > > > > have downloads speeds of up to 300KB/s. > > > > > > > > But how about upload speeds? It seems that's where scp is suffering as > > > > well. > > > > > > This is the obvious test that I should have done; and you're hit the > > > nail on the head. bge(4) on 8-STABLE (csup'd 4-Feb-2010) has a very > > > bad upload speed. > > > > > > I've just tried using ftp to transfer some files: > > > > > > Upload speed: starts at 63 KB/s, falls rapidly before stalling. > > > Download speeds: starts at 9 MB/s, increasing slightly before completing. > > I'm not sure but recently added code to support TSO may cause the > > issue. Would you show me verbose boot output(only bge(4) related > > one)? > > bge0: mem 0xf1bf0000-0xf1bfffff irq 17 at device 0.0 on pci9 > bge0: Reserved 0x10000 bytes for rid 0x10 type 3 at 0xf1bf0000 > bge0: adjust device control 0x2000 -> 0x5000 > bge0: attempting to allocate 1 MSI vectors (1 supported) > bge0: using IRQ 258 for MSI > bge0: CHIP ID 0x0000a002; ASIC REV 0x0a; CHIP REV 0xa0; PCI-E > bge0: Disabling fastboot > bge0: Disabling fastboot > miibus0: on bge0 > bge0: bpf attached > bge0: Ethernet address: 00:1d:09:d2:d1:9e > bge0: [MPSAFE] > bge0: [FILTER] > bge0: Disabling fastboot > bge0: Disabling fastboot > bge0: link UP > > >To rule out possible TSO issue, disable TSO and try it > > again(#ifconfig bge0 -tso). Does it make any difference? > > Yup, it sure does! With a TSO disabled, my upload and download speeds > are pretty much symmetrical at a decent 10MB/s. > Hmm, that means TSO was broken on your controller. Because BCM5755 or newer controllers have no known TSO issues I don't know why the controller fails on TSO. Very recent controllers use new TSO format but I don't think your controller is one of them and FreeBSD has no support for these controllers anyway. Would you show me the output of "pciconf -lcv" of your bge(4) controller?