From owner-freebsd-stable@FreeBSD.ORG Fri Oct 4 01:30:35 2013 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id EB2FDC07 for ; Fri, 4 Oct 2013 01:30:34 +0000 (UTC) (envelope-from janm@transactionware.com) Received: from mail3.transactionware.com (mail3.transactionware.com [202.68.173.211]) by mx1.freebsd.org (Postfix) with SMTP id 255902C3C for ; Fri, 4 Oct 2013 01:30:33 +0000 (UTC) Received: (qmail 76263 invoked by uid 907); 4 Oct 2013 01:23:50 -0000 Received: from pa49-182-172-138.pa.nsw.optusnet.com.au (HELO [172.20.10.2]) (49.182.172.138) (smtp-auth username janm, mechanism plain) by mail3.transactionware.com (qpsmtpd/0.84) with (AES128-SHA encrypted) ESMTPSA; Fri, 04 Oct 2013 11:23:50 +1000 Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 6.6 \(1510\)) Subject: Re: Device timeout from mfi(9) while booting 9.2-RELEASE From: Jan Mikkelsen In-Reply-To: <20131003194704.GG41229@kib.kiev.ua> Date: Fri, 4 Oct 2013 11:23:45 +1000 Content-Transfer-Encoding: quoted-printable Message-Id: References: <20131003194704.GG41229@kib.kiev.ua> To: Konstantin Belousov X-Mailer: Apple Mail (2.1510) Cc: freebsd-stable@freebsd.org, Ryan Stone X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Oct 2013 01:30:35 -0000 Hi, We have Drake Skinny (9240-4i and 9240-8i) cards running, most recently = with 9.2-RC4. We'll be testing 9.2-RELEASE in the next week or two. We have seen problems with older versions of the firmware, and = interactions with some Supermicro BIOS versions. All these problems have = been resolved by upgrading to the latest versions of the controller = firmware and system BIOSes. We're running with with hw.mfi.msi=3D1. I haven't tested without that = since early 2011; I should probably try it out. So: What firmware do you have in the controller? Did you update it? Regards, Jan. On 04/10/2013, at 5:47 AM, Konstantin Belousov = wrote: > On Thu, Oct 03, 2013 at 11:50:15AM -0400, Ryan Stone wrote: >> We're having trouble booting 9.2-RELEASE on a system with an mfi >> (Drake Skinny) controller. When it tries to mount root we get: >>=20 >> mfi0: COMMAND 0xffffff8000cb7220 TIMEOUT AFTER 59 SECONDS >> mfi0: COMMAND 0xffffff8000cb72a8 TIMEOUT AFTER 60 SECONDS >> mfi0: COMMAND 0xffffff8000cb7220 TIMEOUT AFTER 90 SECONDS >>=20 >> I also get the following when mfi attaches (with bootverbose): >>=20 >> mfi0: port 0x5000-0x50ff mem = 0xfbd60000-0xfbd63fff,0xfbd00000-0xf >> bd3ffff irq 16 at device 0.0 on pci2^M >> mfi0: attempting to allocate 1 MSI vectors (1 supported)^M >> msi: routing MSI IRQ 282 to local APIC 0 vector 77^M >> mfi0: using IRQ 282 for MSI^M >> mfi0: Using MSI^M >> mfi0: Megaraid SAS driver Ver 4.23 ^M >> mfi0: Frame 0xffffff85d394b280 timed out command 0x1010000^M >> error 60 in callback from mfi_send_frame^M >> mfi0: Frame 0xffffff85d394b500 timed out command 0x1040100^M >> error 60 in callback from mfi_send_frame^M >> mfi0: Frame 0xffffff85d394b780 timed out command 0x1040300^M >> error 60 in callback from mfi_send_frame^M >> mfi0: Error 255 fetching controller entries^M >>=20 >> I've put full bootverbose logs from boots with hw.mfi.msi=3D0 and >> hw.mfi.msi=3D1 here: >> http://people.freebsd.org/~rstone/mfi_timeout_irq.txt >> http://people.freebsd.org/~rstone/mfi_timeout_msi.txt >>=20 >> Neither boot was successful. I don't have the ability to boot from >> alternative media so I have a limited ability to test changes (I can >> re-image from a full disk image, but that requires building a new = disk >> image which takes some time). >>=20 >> I did see the following forum post and tried with cbb and pccard >> removed from GENERIC. That didn't fix it. >> http://forums.freebsd.org/showpost.php?p=3D231135&postcount=3D4 >=20 > I have two Drake Skinny cards, one four-ports, one with eight ports, = both > not working with either version of driver in HEAD from February up to = now. > I tried to talk about this both with Doug Ambrisko and > "Desai, Kashyap" , and provided the debugging > data I could think of, but no avail. >=20 > There is a rumor that it might be related to the slot the card is > inserted in. I only have 8x or wider PCIe slot provided by CPU > north-bridge. It might be that card does not like it and only work in > the south-bridge PCIe lanes. I have no idea why could it be so, = neither > I saw the confirmation of the speculation.