From owner-freebsd-net@freebsd.org Wed Nov 11 14:59:37 2015 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 69E94A2B877 for ; Wed, 11 Nov 2015 14:59:37 +0000 (UTC) (envelope-from steven@multiplay.co.uk) Received: from mail-wm0-x231.google.com (mail-wm0-x231.google.com [IPv6:2a00:1450:400c:c09::231]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 043EC102A for ; Wed, 11 Nov 2015 14:59:36 +0000 (UTC) (envelope-from steven@multiplay.co.uk) Received: by wmec201 with SMTP id c201so185380035wme.0 for ; Wed, 11 Nov 2015 06:59:35 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=multiplay_co_uk.20150623.gappssmtp.com; s=20150623; h=from:to:subject:cc:message-id:date:user-agent:mime-version :content-type:content-transfer-encoding; bh=PDewQE2zBHyY1bMYBo2XK+bwPnJ0EZmvFxvGytnxLQA=; b=jGdZNO7V11ZjjxXfi3VkC8qHZCVtiQHNgzyMWMB/K21F7blUZ41FZkWGy8AXeYny2K Rm8v0Vtlk+R2RDRD2ucB37eW9q5MIDSajzDgo5qjg6RbmXLeHPGvy7uIBHerKFGEND7Q tDRgREVZ9x2KdCbXt9AiXp8k+h06/5bv4TuA4NXtzqoBRG5K/KmMpbW0HXuWdAyXipJ+ BAYSyFIel3NO5tjm+BqQ5x7EoTC7ndoq7TF0UfDws9UHAOX/V8AXrXsjavZZsqG19Pe+ ujZHQ53N67Mt3sZYjhIK6MCRMFtRCsa8f0xkmTTjtuuE+d4Zm1yuQv28Q4z0Bry0jZKy kueQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:from:to:subject:cc:message-id:date:user-agent :mime-version:content-type:content-transfer-encoding; bh=PDewQE2zBHyY1bMYBo2XK+bwPnJ0EZmvFxvGytnxLQA=; b=ltmSEdQ2PaSk78+2tcZZzeBOqtECYZbEA46gtL2lQqYVdGYMTW7IQaMyQOyxA5soLq XvzqPuYz0mHyuA/irHuo+15y/xNfc8IqZHW4lTTspsq79M3MsGKK7elE/1M/F8e/sZcy 2aIH2fYxwf8QV7dSxdw6VbsWb8kNu/BOo9PYu7Jyize5kySrFb+s52pVkgWiAf8xTiTb 8VsKkQNc15KZOxrWw3FLLDFZwXQOXjV4WbjA4KE0aaGTTSjkIYMQQaP/TlbFL5eNyZ6Z e4/QmLnRrZSpChAD/LoH3PC284azOAzO37O+479rGS+HH/GLzDNuhVo/GTS7sdUzTBjs AGCg== X-Gm-Message-State: ALoCoQk/RiH3cMr6naHGNoh/aGX4Vjd+cQhjIWYhFnP0oTMzemxooQfEkzEtlJlyD7LUiETNOAlC X-Received: by 10.28.217.18 with SMTP id q18mr40109878wmg.10.1447253974996; Wed, 11 Nov 2015 06:59:34 -0800 (PST) Received: from [10.10.1.58] (liv3d.labs.multiplay.co.uk. [82.69.141.171]) by smtp.gmail.com with ESMTPSA id c13sm5702433wmd.14.2015.11.11.06.59.33 (version=TLSv1/SSLv3 cipher=OTHER); Wed, 11 Nov 2015 06:59:33 -0800 (PST) From: Steven Hartland X-Google-Original-From: Steven Hartland To: "freebsd-net@freebsd.org" Subject: Intel XL710 broken link down detection? Cc: Jack F Vogel Message-ID: <564357E0.1050002@freebsd.org> Date: Wed, 11 Nov 2015 14:59:44 +0000 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:38.0) Gecko/20100101 Thunderbird/38.3.0 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Nov 2015 14:59:37 -0000 Seems the Intel XL710 (ixl) has broken link detection, it triggers on link up but not on link down. I'm currently running HEAD (r290610) on the box which has 1.4.3 and have tried the latest driver from downloads.intel.com which is listed as 1.4.8 but reports 1.4.5. We've updated to the latest NVM image today to see if that would help but no change. Tracing with dtrace shows that ixl_do_adminq process a link event and fires off ixl_link_event for link up but not for link down for some reason. Running ifconfig against the interface updates the status as runs ixl_update_link_status in ixl_media_status, so the device can determine the link is down its just not noticing the event. From dmesg: ixl0: mem 0xc5000000-0xc57fffff,0xc5808000-0xc580ffff irq 34 at device 0.0 on pci5 ixl0: Using MSIX interrupts with 33 vectors ixl0: f4.40 a1.4 n04.53 e80001ccc ixl0: Using defaults for TSO: 65518/35/2048 ixl0: Ethernet address: 0c:c4:7a:3a:2d:60 ixl0: PCI Express Bus: Speed 8.0GT/s Width x8 queues is 0xfffffe00015bd000 ixl0: netmap queues/slots: TX 32/1024, RX 32/1024 ixl1: mem 0xc4800000-0xc4ffffff,0xc5800000-0xc5807fff irq 34 at device 0.1 on pci5 ixl1: Using MSIX interrupts with 33 vectors ixl1: f4.40 a1.4 n04.53 e80001ccc ixl1: Using defaults for TSO: 65518/35/2048 ixl1: Ethernet address: 0c:c4:7a:3a:2d:61 ixl1: PCI Express Bus: Speed 8.0GT/s Width x8 queues is 0xfffffe0001ad1000 ixl1: netmap queues/slots: TX 32/1024, RX 32/1024 When its up it reports 10GBase-KR Any ideas? Regards Steve