From owner-freebsd-stable@FreeBSD.ORG Tue Jun 15 23:21:50 2010 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id CA27E1065673; Tue, 15 Jun 2010 23:21:50 +0000 (UTC) (envelope-from pyunyh@gmail.com) Received: from mail-pw0-f54.google.com (mail-pw0-f54.google.com [209.85.160.54]) by mx1.freebsd.org (Postfix) with ESMTP id 8E59D8FC12; Tue, 15 Jun 2010 23:21:50 +0000 (UTC) Received: by pwj10 with SMTP id 10so899602pwj.13 for ; Tue, 15 Jun 2010 16:21:50 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:received:from:date:to:cc :subject:message-id:reply-to:references:mime-version:content-type :content-disposition:in-reply-to:user-agent; bh=/e+OkjE+ELvjo4R9ct7g17JZe+2Q4KO8IuGisEl/3gY=; b=kNlU04fJE71eLAwd1bhW5LcnJAMzHOudeavOJG2/fwiSl3CD8RyCKmKpU+mA2pv8hS bC6pphinrR+RqOLHx5dMutd5j7zkFNI0kf7/jId5lW/jMTB5+0ZU8V3WL5Ad0nriIlV2 kOpC9mwHftifMJaroa8vqHg1Qd525Oj5YAUUY= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=from:date:to:cc:subject:message-id:reply-to:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; b=mJAvo4INhHtGmrCUKaMtGDZn6ETccf+F8toOG7ehANs75+rGYV8O5FtOBArcZ0XTjD aJV3L6/rICFgBmBkDDjpZRVtuwyJMmpArWqET3283s0fhwd6Fh3zag8PsfCDr0ieNcK5 i9Rt4pJEoIzsdZjzMMzwyAN5EvSJi/1Euz0mA= Received: by 10.142.248.6 with SMTP id v6mr5735386wfh.262.1276644109892; Tue, 15 Jun 2010 16:21:49 -0700 (PDT) Received: from pyunyh@gmail.com ([174.35.1.224]) by mx.google.com with ESMTPS id r20sm73864621wam.17.2010.06.15.16.21.48 (version=TLSv1/SSLv3 cipher=RC4-MD5); Tue, 15 Jun 2010 16:21:49 -0700 (PDT) Received: by pyunyh@gmail.com (sSMTP sendmail emulation); Tue, 15 Jun 2010 16:21:09 -0700 From: Pyun YongHyeon Date: Tue, 15 Jun 2010 16:21:09 -0700 To: Artem Kim Message-ID: <20100615232108.GM4257@michelle.cdnetworks.com> References: <201006131934.11389.artem_kim@inbox.ru> <201006150709.27396.artem_kim@inbox.ru> <20100615175003.GG4257@michelle.cdnetworks.com> <201006160257.01213.artem_kim@inbox.ru> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <201006160257.01213.artem_kim@inbox.ru> User-Agent: Mutt/1.4.2.3i Cc: freebsd-stable@freebsd.org, yongari@freebsd.org Subject: Re: Problems with bge (possibly related to r208993) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: pyunyh@gmail.com List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 15 Jun 2010 23:21:50 -0000 On Wed, Jun 16, 2010 at 02:57:01AM +0400, Artem Kim wrote: > On Tuesday 15 June 2010 21:50:03 you wrote: > . . . > > > nas2 # netstat-ndI bge1 > > > Name Mtu Network Address Ipkts Ierrs Idrop Opkts Oerrs Coll Drop > > > bge1 1500 00:1 b: 78: a3: 3c: 01 418543876 1972918 0 446063237 0 > > > 0 0 bge1 1500 XX.XX.6.12 XX.XX.6.133 890,306 - - 1,076,833 - - - > > > > Ok, I see very large number of Ierrs here. When you send some packets > > from other hosts to nas2(bge1), do you see Ierrs counter is > > increasing? > . . . > > > It seems RX does not work at all. Because you have zero Drop(from > > netstat) I think you didn't hit mbuf resource shortage situation. > > Ierr counter is increased whenever controller drops frames due to > > receiving errors(e.g. CRC). Given that you have no cabling issue, > > it could be caused by speed/duplex mismatches between bge1 and link > > partner. Does the link partner also agrees on resolved speed/duplex > > of bge1? > > I had some negotiation problems. But the problems were observed on the other > NIC - bge0. bge0 is connected to the dlink-3627 and bge1 is not always setup > speed/duplex mode correctly. Usually this is solved by link0 setting. Flag > link0 I set for bge1 and bge0. Flag link0 used quite a long time (years). > Hmm, why you need link0 flag? The link0 flag is used to force the interface MASTER. Normally this configuration is automatically done during auto-negotiation such that one is configured as MASTER and the other is configured as SLAVE. If you manually configure this setting you should be very careful not to use the same configuration of MASTER/SLAVE of link partner. If you have to use link0 option, the link partner should be configured to use SLAVE. Normally you should always use auto-negotiation on 1000baseT unless link partner is severely broken to support NWAY. It seems link partner does not agree on resolved speed/duplex configuration of bge1. Check link partner's resolved link configuration. > bge1 and bge0 have link0, when I got the problem on NAS2 first time. Then I > reset link0 and reboot NAS2. After some time I got the same problem again > (current state). However, I do not see any obvious problems with bge0 <-> AT- > x900. > > current state of the bge0 link partner: > > awplus>show int port1.0.12 > Interface port1.0.12 > Scope: both > Link is UP, administrative state is UP > Thrash-limiting > Status Not Detected, Action learn-disable, Timeout 1(s) > Hardware is Ethernet, address is 0000.cd29.6e09 > index 5012 metric 1 mru 1522 > current duplex full, current speed 1000, polarity auto > configured duplex auto, configured speed auto > > VRF Binding: Not bound > SNMP link-status traps: Disabled > input packets 136255660241, bytes 119549292157319, dropped 0, multicast > packets 5482013 > output packets 122988526534, bytes 121030195520423, multicast packets > 532582 broadcast packets 2198512 > > awplus>show int port1.0.12 status > Port Name Status Vlan Duplex Speed Type > port1.0.12 connected 55 a-full a-1000 1000BASE-T > > awplus>sh mac address-table |i port1.0.12 > 55 port1.0.12 001b.78a3.3c01 forward dynamic > > > nas2# ifconfig bge1 > bge1: flags=8843 metric 0 mtu 1500 > options=8009b > ether 00:1b:78:a3:3c:01 > inet XX.XX.6.133 netmask 0xffffffc0 broadcast XX.XX.6.191 > media: Ethernet autoselect (1000baseT ) > status: active > > > I tried to do ping -i .01 XX.XX.6.133 from other host: > nas2# netstat -hI bge1 1 > input (bge1) output > packets errs idrops bytes packets errs bytes colls > 0 0 0 0 0 0 0 0 > 0 1 0 0 0 0 0 0 > 0 0 0 0 0 0 0 0 > 0 0 0 0 0 0 0 0 > ping-> 0 33 0 0 0 0 0 0 > 0 94 0 0 0 0 0 0 > 0 93 0 0 0 0 0 0 > 0 94 0 0 0 0 0 0 > 0 94 0 0 0 0 0 0 > 0 83 0 0 0 0 0 0 > 0 0 0 0 0 0 0 0 > > > ping -i .01 XX.XX.6.129 from NAS2 (XX.XX.6.129 have static arp-entry): > > nas2# netstat -hI bge1 1 > input (bge1) output > packets errs idrops bytes packets errs bytes colls > 0 1 0 0 0 0 0 0 > 0 1 0 0 0 0 0 0 > 0 0 0 0 0 0 0 0 > ping-> 0 0 0 0 0 0 0 0 > 0 40 0 0 62 0 5.9K 0 > 0 93 0 0 89 0 8.5K 0 > 0 91 0 0 89 0 8.5K 0 > 0 91 0 0 88 0 8.4K 0 > 0 91 0 0 89 0 8.5K 0 > 0 92 0 0 88 0 8.4K 0 > 0 93 0 0 88 0 8.4K 0 > 0 92 0 0 89 0 8.5K 0 > 0 0 0 0 85 0 8.1K 0 > 0 87 0 0 0 0 0 0 > > > ping -i .01 XX.XX.6.133 from other host: > > before: > nas2# netstat -ndI bge1 > > Name Mtu Network Address Ipkts Ierrs Idrop Opkts > Oerrs Coll Drop > bge1 1500 00:1b:78:a3:3c:01 418543876 2042520 0 446111781 > 0 0 0 > bge1 1500 XX.XX.6.12 XX.XX.6.133 890306 - - 1125376 - > - - > > after: > Name Mtu Network Address Ipkts Ierrs Idrop Opkts > Oerrs Coll Drop > bge1 1500 00:1b:78:a3:3c:01 418543876 2043445 0 446111781 > 0 0 0 > bge1 1500 XX.XX.6.12 XX.XX.6.133 890306 - - 1125376 - > - - > >