From owner-freebsd-net@freebsd.org Thu Aug 30 22:14:10 2018 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6F446EFA330 for ; Thu, 30 Aug 2018 22:14:10 +0000 (UTC) (envelope-from nparhar@gmail.com) Received: from mail-wm0-x22c.google.com (mail-wm0-x22c.google.com [IPv6:2a00:1450:400c:c09::22c]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id D97E874CF6 for ; Thu, 30 Aug 2018 22:14:09 +0000 (UTC) (envelope-from nparhar@gmail.com) Received: by mail-wm0-x22c.google.com with SMTP id y139-v6so3364814wmc.2 for ; Thu, 30 Aug 2018 15:14:09 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=sender:subject:to:references:from:openpgp:autocrypt:message-id:date :user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=6VWUio4AML1paN6gMyYAvX+NJbIlNjh3tu1nBSL5ydA=; b=vP7AoP9n09NnO6PXHON+OGGVStsPQSHKWtn7vFuUvipbeOUkx9GRW9h/fcz+DlDdy7 EBBS9h7tuLUXCT1lFmDrB7JjT51LYx31QydRr5hZxY5KKfgyUay7CqVyKiI2hkzgmuvO kTAXTgwy0pjIpu4dPXIcUvo0Gp9kpSu6kg2N8tFfjmGKxyKMVwhhvFKXfo8m0tXlWAQS 9akmh+lVXTJdlr5RlBwN6Eo1Myae2oCNWQFsLisf9CgUutpX+4EghQIjphwjnYhGrsS1 g0Hi1EspTzCmImdU8Kyl6OXd733/Vp764iN9mciB0MAEn3FmTqRPP+FpCzfi6AuHmbJp fuNg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:subject:to:references:from:openpgp :autocrypt:message-id:date:user-agent:mime-version:in-reply-to :content-language:content-transfer-encoding; bh=6VWUio4AML1paN6gMyYAvX+NJbIlNjh3tu1nBSL5ydA=; b=hMlT+xhtVt4mkYIM/RC2xKrysLUILpsG3V4lEtMTbUFcBLpTwMHB79HT/idou2Rpy/ slxNC/YhVVVuuncfAVRBggN8NJIXHo3BhrR9LLBxktT5P5vu7PX3AA3KOsRBrUNwWPfA tonRfHJuYr58mH25nJd2sXf6U0SkQ9X+1nzSVwd99xB0pR2u99ZdFMekMK98ejmdBDM0 fQJBjQ5YIhD8nZkIFpdaCj5mzczFtNoAeQ+S1Vkj8IJqt9vaXZPZ0Wv9l/mKO6xWW0eH t+THcqnhIGRfWrtaEqy07EMcfZiCBIMd50NYQGOTPBjwD0J9tNA59UW68EMWElTcdNJB zYNg== X-Gm-Message-State: APzg51DsUkQ9bKO0TzFeSjyT53iVQQPIInq5U9/kfnvHgynlMyn6Hrlt 261P14qNT2QFvJEz9Za2n8kozVRh X-Google-Smtp-Source: ANB0VdZiDL3htiMoSJmjMmoEfUWOLgbarLFLXd8S7tFoCnYb8p47txZYaro23ozCPwlK9NVuzFFneA== X-Received: by 2002:a1c:2d54:: with SMTP id t81-v6mr3122498wmt.31.1535667248399; Thu, 30 Aug 2018 15:14:08 -0700 (PDT) Received: from [10.192.166.0] (stargate.chelsio.com. [12.32.117.8]) by smtp.googlemail.com with ESMTPSA id z11-v6sm7883324wrm.94.2018.08.30.15.14.07 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 30 Aug 2018 15:14:07 -0700 (PDT) Sender: Navdeep Parhar Subject: Re: cxl nic not working after reboot To: Marius Halden , freebsd-net@freebsd.org References: <1535379569.2132387.1487489784.45227861@webmail.messagingengine.com> <20180827151302.GA10167@ox> <1535395530.234212.1487804896.64257978@webmail.messagingengine.com> <1535448912.3229649.1488521184.1EE83C33@webmail.messagingengine.com> <20180829062843.GA25476@ox> <1535538153.459716.1489861176.29777B66@webmail.messagingengine.com> <1535628110.3034153.1491191792.12397BCF@webmail.messagingengine.com> <8bb881ef-a701-1c94-3598-79a2724fa648@FreeBSD.org> <1535665888.3128528.1491873424.5CEF9F3A@webmail.messagingengine.com> From: Navdeep Parhar Openpgp: preference=signencrypt Autocrypt: addr=np@FreeBSD.org; prefer-encrypt=mutual; keydata= xsDiBEosaGcRBACOXnXquGEW53BjpMt2jViod/TUf1xgjMekcbDxqOODPeX7eYfrwJ8G6BCN OpGjBmWDu/JcNj4Z+gmTilJ6WLZQ7ecFZfEeO91pt6ys0cyWh0xfO+/mT83D7W81S/kqrJBk QbBIdV6LumevdErHo272r8RcMELC4Ru87eRtX3hmEwCgnnGNJMpQFUfYTt5XE7nY0yQoeV8D /0OcWmJbEZWxX9O7AuliCe3zd2Dw0B4LB9SZ2Dis7+gpVd3xVgYnt5wRE9kM+ThgrMA/wqr8 07qmEG6bcfUsfwwGN9YUtNF3xAN07cXTs026sCIFNZK816PrThBzCgkwR7pDpkMzGWIBr8Wi XXy0eB+JlQ6UV4PEiXuZ5ulzP0b1A/9CZm3wJfrNC0r1gMyrfVedg4zwKU997bmPLGcYs+rW XDTI9CvMseOUYn4CoDZQCp/9zxuHK+VU7Y/w0c/hVE5ERACSn4SjN2unEDstK9njZBMHEPVk Ae/YvSG5cmc97SHlVE+eu/bbLKcvFb6rRLPOaVFQJMJA2VJEGWtYhvP7Zc0fTmF2ZGVlcCBQ YXJoYXIgPG5wQEZyZWVCU0Qub3JnPsJgBBMRAgAgBQJKLGhnAhsDBgsJCAcDAgQVAggDBBYC AwECHgECF4AACgkQyrIrk6yriBL0MQCfUJOiS2PbJFDeiav1ylcXXwfpggAAoJRoS7GDENGy M4BzjJ4b0ptZqTLRzsFNBEosaGcQCACFCWs47SL4DQA6bNDlVJu4w8wLf8uVOyatuGmdXX8Y /OTVQJgA3vS+ODNVJCxhKVlvhcn7bhBdGdWKS9K+lr8+eEvr4hf2bQpesoHC+uFgKyILkCBN L8raixbhysyq0pfZWWDJMyn+G42BG1yJJi+bykygdpYnbIVA8dYHmBibI8mkPKOHSohjXT1S RfGGn+l1w54OO4NlJhCXMkjTA/Z9Bt4XeaiR85uJi0UUfV8FGZHhgSvT+/P1xIvz+nytuehS P/QLXl13CtAG/nKVkAcZnsT/3NrJ4Z2r45k+c50Wrf210scAaBogrrV5eIHfNGgOANApN8+8 vj+aXO4pXRuXAAMFB/44ea8rd+P5N3OMrfuM8i91Qe1bJ+BIoroKPOr8jvCry0h3QpdfLKUN IgaqbS3JZeBJ8HHnWSGCF+o6H5gzRe1hvylPEclLPDCuPe7T746h9Mzejf2hNDJvOg+BuweD ZW4KhovVbdS+syJEvpGF4bO8qgHT2CKgruXSHbFetdQWbkM0rfMmTuo0GcR2BEVrPb/SPFv6 4ZZyAZzmnGO4vT1bzClnTzJixrDpH74M3vSEYegMB4KdbLYBi8Jx4QUKgVEhJHjJubKWX4et yU/uuehOC3xYrmr1UXvsom3U8r36Dvdo77Yr3dgDVXa7bolNx0TIhdWxZI+R4z9E75QY+/wg wkkEGBECAAkFAkosaGcCGwwACgkQyrIrk6yriBI+JQCfUxgyqGtzZvLh5Al7gsTmRc11PLwA niD3NfWGRcO2+9uxSSQqRH1ywC4n Message-ID: Date: Thu, 30 Aug 2018 15:14:05 -0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:60.0) Gecko/20100101 Thunderbird/60.0 MIME-Version: 1.0 In-Reply-To: <1535665888.3128528.1491873424.5CEF9F3A@webmail.messagingengine.com> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: quoted-printable X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 30 Aug 2018 22:14:10 -0000 On 8/30/18 2:51 PM, Marius Halden wrote: > On Thu, Aug 30, 2018, at 19:27, Navdeep Parhar wrote: >> On 8/30/18 4:21 AM, Marius Halden wrote: >>> I tried to downgrade to a the previous bsdrp version we were running = based on 11.1-RELEASE-p10, but it did not start working again. ifconfig o= utput and t5nex0 devlog follows (non-working state), but it all looks fin= e to me (media has always been reported wrong). I did notice though that = "hw_mac_init_port[0], =E2=80=A6" will always be logged when it works but = not when when it doesn't work. I confirmed this on a box still running th= e old version which functions as intended. >>> >>> The ones not working has a newer firmware version than the ones worki= ng. >>> >>> Non-working: >>> # sysctl dev.t5nex.0.firmware_version >>> dev.t5nex.0.firmware_version: 1.19.1.0 >>> >>> >>> Working: >>> # sysctl dev.t5nex.0.firmware_version >>> dev.t5nex.0.firmware_version: 1.16.45.0 >>> >>> Any other ideas? >>> >> >> I'm still looking into it. The current working theory is that the pee= r >> is trying to autonegotiate when it shouldn't (it's 1Gbps optics). If >> you know how to disable AN on the peer this should be easy to test. >=20 > Thanks. Unfortunately we don't have access to the peer as that's our IS= Ps router. According to the sysctl autonegotiate is not supported on our = side. >=20 I'll get a couple of 1G optics in a day or so and then I'll be able to try some things for myself. Wait for that or try a 1G TWINAX (copper) SFP+ cable in case you have one -- that should be able to link up (if it's really autonegotiation that's causing problems). Regards, Navdeep