From owner-freebsd-net@FreeBSD.ORG Fri Aug 17 14:55:09 2007 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id BACAC16A417 for ; Fri, 17 Aug 2007 14:55:09 +0000 (UTC) (envelope-from ginga@ginganet.org) Received: from mx.gate01.com (pip1.gyao.ne.jp [61.122.117.239]) by mx1.freebsd.org (Postfix) with ESMTP id 613D613C458 for ; Fri, 17 Aug 2007 14:55:05 +0000 (UTC) (envelope-from ginga@ginganet.org) Received: from [202.210.243.26] (helo=athena.ginganet.org) by smtp33.isp.us-com.jp with esmtp (Mail 4.41) id 1IM3E7-0000rL-Qi; Fri, 17 Aug 2007 23:55:03 +0900 Received: from localhost (localhost.olympus.local [127.0.0.1]) by athena.ginganet.org (Postfix) with ESMTP id 540C07504; Fri, 17 Aug 2007 23:55:03 +0900 (JST) X-Virus-Scanned: amavisd-new at ginganet.org Received: from athena.ginganet.org ([127.0.0.1]) by localhost (athena.ginganet.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id iviuWww4Odqb; Fri, 17 Aug 2007 23:54:54 +0900 (JST) Received: by athena.ginganet.org (Postfix, from userid 5003) id 879AB74BF; Fri, 17 Aug 2007 23:54:54 +0900 (JST) Date: Fri, 17 Aug 2007 23:54:54 +0900 From: KAWAGUTI Ginga To: David Christensen Message-ID: <20070817145454.GK6523@ginganet.org> References: <20070816092418.GH6523@ginganet.org> <09BFF2FA5EAB4A45B6655E151BBDD90304C34AED@NT-IRVA-0750.brcm.ad.broadcom.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <09BFF2FA5EAB4A45B6655E151BBDD90304C34AED@NT-IRVA-0750.brcm.ad.broadcom.com> User-Agent: Mutt/1.5.14 (2007-02-12) Cc: KAWAGUTI Ginga , freebsd-net@freebsd.org Subject: Re: Some Broadcom GbE NIC(bge driver) suffers packet loss at receiving X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 17 Aug 2007 14:55:09 -0000 In Thu, Aug 16, 2007 at 01:52:37PM -0700, David Christensen wrote: > > Some revision of Broadcom GbE NIC with bge driver > > seems to loss 1 packet per 1000 packet at receiving on some occasion. > > Sending doesn't have this problem(receiving only). > > > > This loss doesn't always happen, > > but when happens, it seems that loss is exactly 1 per 1000, > > as the last 3 digits of lost packets' sequence number are all same. > > (i.e. example of lost packet seq-No. are: > > 3284, 4284, 5284, 8284, 9284, ...) > > The NIC maintains internal statistics which might give a clue to > the cause of the packet loss. The latest bge driver in -CURRENT > includes a number of "sysctl" nodes to bring out those statistics. > Can you get that info? My previous problem report was based on 6-stable. I tried with 7-current, but the bge device didn't even work... With cable plugged in, "ifconfig bge0" doesn't recognize the online status: bge0: flags=8802 metric 0 mtu 1500 options=9b ether 00:17:a4:8f:22:bc media: Ethernet autoselect status: no carrier And when running ifconfig to set V4 address, FreeBSD itself gets frozen. 7-current% ifconfig bge0 inet 192.168.0.100 netmask 0xffffff00 (... frozen without any message... I need to reset the server hardware.) So, only information I can take is the below sysctl message, but without any packet send/receive. ------------------------------------------------------- 7-current% sysctl -a | grep bge hw.bge.allow_asf: 1 dev.bge.0.%desc: HP NC7782 Gigabit Server Adapter, ASIC rev. 0x2100 dev.bge.0.%driver: bge dev.bge.0.%location: slot=6 function=0 handle=\_SB_.CFG0.PCI2.NICA dev.bge.0.%pnpinfo: vendor=0x14e4 device=0x1648 subvendor=0x0e11 subdevice=0x00d0 class=0x020000 dev.bge.0.%parent: pci3 dev.bge.0.stats.FramesDroppedDueToFilters: 0 dev.bge.0.stats.DmaWriteQueueFull: 0 dev.bge.0.stats.DmaWriteHighPriQueueFull: 0 dev.bge.0.stats.NoMoreRxBDs: 0 dev.bge.0.stats.InputDiscards: 0 dev.bge.0.stats.InputErrors: 0 dev.bge.0.stats.RecvThresholdHit: 0 dev.bge.0.stats.DmaReadQueueFull: 0 dev.bge.0.stats.DmaReadHighPriQueueFull: 0 dev.bge.0.stats.SendDataCompQueueFull: 0 dev.bge.0.stats.RingSetSendProdIndex: 0 dev.bge.0.stats.RingStatusUpdate: 0 dev.bge.0.stats.Interrupts: 0 dev.bge.0.stats.AvoidedInterrupts: 0 dev.bge.0.stats.SendThresholdHit: 0 dev.bge.0.stats.rx.Octets: 0 dev.bge.0.stats.rx.Fragments: 0 dev.bge.0.stats.rx.UcastPkts: 0 dev.bge.0.stats.rx.MulticastPkts: 0 dev.bge.0.stats.rx.FCSErrors: 0 dev.bge.0.stats.rx.AlignmentErrors: 0 dev.bge.0.stats.rx.xonPauseFramesReceived: 0 dev.bge.0.stats.rx.xoffPauseFramesReceived: 0 dev.bge.0.stats.rx.ControlFramesReceived: 0 dev.bge.0.stats.rx.xoffStateEntered: 0 dev.bge.0.stats.rx.FramesTooLong: 0 dev.bge.0.stats.rx.Jabbers: 0 dev.bge.0.stats.rx.UndersizePkts: 0 dev.bge.0.stats.rx.inRangeLengthError: 0 dev.bge.0.stats.rx.outRangeLengthError: 0 dev.bge.0.stats.tx.Octets: 0 dev.bge.0.stats.tx.Collisions: 0 dev.bge.0.stats.tx.XonSent: 0 dev.bge.0.stats.tx.XoffSent: 0 dev.bge.0.stats.tx.flowControlDone: 0 dev.bge.0.stats.tx.InternalMacTransmitErrors: 0 dev.bge.0.stats.tx.SingleCollisionFrames: 0 dev.bge.0.stats.tx.MultipleCollisionFrames: 0 dev.bge.0.stats.tx.DeferredTransmissions: 0 dev.bge.0.stats.tx.ExcessiveCollisions: 0 dev.bge.0.stats.tx.LateCollisions: 0 dev.bge.0.stats.tx.UcastPkts: 0 dev.bge.0.stats.tx.MulticastPkts: 0 dev.bge.0.stats.tx.BroadcastPkts: 0 dev.bge.0.stats.tx.CarrierSenseErrors: 0 dev.bge.0.stats.tx.Discards: 0 dev.bge.0.stats.tx.Errors: 0 dev.bge.1.%desc: HP NC7782 Gigabit Server Adapter, ASIC rev. 0x2100 dev.bge.1.%driver: bge dev.bge.1.%location: slot=6 function=1 dev.bge.1.%pnpinfo: vendor=0x14e4 device=0x1648 subvendor=0x0e11 subdevice=0x00d0 class=0x020000 dev.bge.1.%parent: pci3 dev.bge.1.stats.FramesDroppedDueToFilters: 0 dev.bge.1.stats.DmaWriteQueueFull: 0 dev.bge.1.stats.DmaWriteHighPriQueueFull: 0 dev.bge.1.stats.NoMoreRxBDs: 0 dev.bge.1.stats.InputDiscards: 0 dev.bge.1.stats.InputErrors: 0 dev.bge.1.stats.RecvThresholdHit: 0 dev.bge.1.stats.DmaReadQueueFull: 0 dev.bge.1.stats.DmaReadHighPriQueueFull: 0 dev.bge.1.stats.SendDataCompQueueFull: 0 dev.bge.1.stats.RingSetSendProdIndex: 0 dev.bge.1.stats.RingStatusUpdate: 0 dev.bge.1.stats.Interrupts: 0 dev.bge.1.stats.AvoidedInterrupts: 0 dev.bge.1.stats.SendThresholdHit: 0 dev.bge.1.stats.rx.Octets: 0 dev.bge.1.stats.rx.Fragments: 0 dev.bge.1.stats.rx.UcastPkts: 0 dev.bge.1.stats.rx.MulticastPkts: 0 dev.bge.1.stats.rx.FCSErrors: 0 dev.bge.1.stats.rx.AlignmentErrors: 0 dev.bge.1.stats.rx.xonPauseFramesReceived: 0 dev.bge.1.stats.rx.xoffPauseFramesReceived: 0 dev.bge.1.stats.rx.ControlFramesReceived: 0 dev.bge.1.stats.rx.xoffStateEntered: 0 dev.bge.1.stats.rx.FramesTooLong: 0 dev.bge.1.stats.rx.Jabbers: 0 dev.bge.1.stats.rx.UndersizePkts: 0 dev.bge.1.stats.rx.inRangeLengthError: 0 dev.bge.1.stats.rx.outRangeLengthError: 0 dev.bge.1.stats.tx.Octets: 0 dev.bge.1.stats.tx.Collisions: 0 dev.bge.1.stats.tx.XonSent: 0 dev.bge.1.stats.tx.XoffSent: 0 dev.bge.1.stats.tx.flowControlDone: 0 dev.bge.1.stats.tx.InternalMacTransmitErrors: 0 dev.bge.1.stats.tx.SingleCollisionFrames: 0 dev.bge.1.stats.tx.MultipleCollisionFrames: 0 dev.bge.1.stats.tx.DeferredTransmissions: 0 dev.bge.1.stats.tx.ExcessiveCollisions: 0 dev.bge.1.stats.tx.LateCollisions: 0 dev.bge.1.stats.tx.UcastPkts: 0 dev.bge.1.stats.tx.MulticastPkts: 0 dev.bge.1.stats.tx.BroadcastPkts: 0 dev.bge.1.stats.tx.CarrierSenseErrors: 0 dev.bge.1.stats.tx.Discards: 0 dev.bge.1.stats.tx.Errors: 0 dev.miibus.0.%parent: bge0 dev.miibus.1.%parent: bge1 ------------------------------------------------------- Regards, Ginga KAWAGUTI