From owner-freebsd-net@FreeBSD.ORG Fri Sep 15 14:17:33 2006 Return-Path: X-Original-To: freebsd-net@FreeBSD.org Delivered-To: freebsd-net@FreeBSD.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 9092416A51E for ; Fri, 15 Sep 2006 14:17:33 +0000 (UTC) (envelope-from glebius@FreeBSD.org) Received: from cell.sick.ru (cell.sick.ru [217.72.144.68]) by mx1.FreeBSD.org (Postfix) with ESMTP id F25F543DA4 for ; Fri, 15 Sep 2006 14:17:12 +0000 (GMT) (envelope-from glebius@FreeBSD.org) Received: from cell.sick.ru (glebius@localhost [127.0.0.1]) by cell.sick.ru (8.13.4/8.13.3) with ESMTP id k8FEHADW080732 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Fri, 15 Sep 2006 18:17:11 +0400 (MSD) (envelope-from glebius@FreeBSD.org) Received: (from glebius@localhost) by cell.sick.ru (8.13.4/8.13.1/Submit) id k8FEHAK5080731; Fri, 15 Sep 2006 18:17:10 +0400 (MSD) (envelope-from glebius@FreeBSD.org) X-Authentication-Warning: cell.sick.ru: glebius set sender to glebius@FreeBSD.org using -f Date: Fri, 15 Sep 2006 18:17:10 +0400 From: Gleb Smirnoff To: Slawek Zak Message-ID: <20060915141710.GR27667@FreeBSD.org> Mail-Followup-To: Gleb Smirnoff , Slawek Zak , freebsd-net@freebsd.org References: <787bbe1c0609130609l33fb29dawc465b7bcfb2f430e@mail.gmail.com> Mime-Version: 1.0 Content-Type: text/plain; charset=koi8-r Content-Disposition: inline In-Reply-To: <787bbe1c0609130609l33fb29dawc465b7bcfb2f430e@mail.gmail.com> User-Agent: Mutt/1.5.6i Cc: freebsd-net@FreeBSD.org Subject: Re: Rapid link state changes on bge(4) interface X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 15 Sep 2006 14:17:33 -0000 On Wed, Sep 13, 2006 at 03:09:56PM +0200, Slawek Zak wrote: S> I'm testing network failover on IBM BladeCenter running FreeBSD 6.1 S> STABLE for Sep 6th. S> S> I suspect a problem with link state change detection in bge code. When S> I disable internal port on chassis built-in ethernet switch, kernel S> floods syslog with messages about link state changes and coalescing S> them. Log snippet follows: S> S> Sep 13 14:58:28 w3-6 kernel: bge1: link state changed to DOWN S> Sep 13 14:58:28 w3-6 kernel: bge1: link state changed to UP S> Sep 13 14:58:29 w3-6 kernel: bge1: link state changed to DOWN S> Sep 13 14:58:29 w3-6 kernel: bge1: link state changed to UP S> Sep 13 14:58:29 w3-6 kernel: bge1: link state changed to DOWN S> Sep 13 14:58:29 w3-6 kernel: bge1: 4 link states coalesced S> Sep 13 14:58:29 w3-6 kernel: bge1: link state changed to DOWN S> Sep 13 14:58:29 w3-6 kernel: bge1: 11 link states coalesced S> Sep 13 14:58:29 w3-6 kernel: bge1: link state changed to UP S> Sep 13 14:58:30 w3-6 kernel: bge1: link state changed to DOWN S> Sep 13 14:58:30 w3-6 kernel: bge1: 3 link states coalesced S> Sep 13 14:58:30 w3-6 kernel: bge1: link state changed to UP S> Sep 13 14:58:30 w3-6 kernel: bge1: 7 link states coalesced S> Sep 13 14:58:30 w3-6 kernel: bge1: link state changed to DOWN S> Sep 13 14:58:30 w3-6 kernel: bge1: 4 link states coalesced S> Sep 13 14:58:30 w3-6 kernel: bge1: link state changed to DOWN S> Sep 13 14:58:30 w3-6 kernel: bge1: 2 link states coalesced S> S> As you can see, messages are generated in rapid succession and S> therefore any probing of link state change by ng_one2many for S> interface failover is meaningless. Ethernet switch doesn't register S> and log any interface state changes after disabling this port. LS20 S> blades use chipset 8850. My firmware is 3.38, full changelog, if it is S> of any help, is here: S> S> http://www-307.ibm.com/pc/support/site.wss/license.do?filename=pc_servers/brcm_fw_nic_12021_anyos_anycpu.chg S> S> Any ideas what might be wrong? Please try to add hw.bge.fake_autoneg=1 to /boot/loader.conf. May be this will help. -- Totus tuus, Glebius. GLEBIUS-RIPN GLEB-RIPE