From owner-freebsd-scsi@FreeBSD.ORG Sun Feb 26 08:59:59 2006 Return-Path: X-Original-To: freebsd-scsi@freebsd.org Delivered-To: freebsd-scsi@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 8313816A420; Sun, 26 Feb 2006 08:59:59 +0000 (GMT) (envelope-from os@rsu.ru) Received: from mail.r61.net (mail.r61.net [195.208.245.235]) by mx1.FreeBSD.org (Postfix) with ESMTP id CD4F543D48; Sun, 26 Feb 2006 08:59:58 +0000 (GMT) (envelope-from os@rsu.ru) Received: from brain.cc.rsu.ru (brain.cc.rsu.ru [195.208.252.154]) (authenticated bits=0) by mail.r61.net (8.13.4/8.13.4) with ESMTP id k1Q8xtsI053532 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT); Sun, 26 Feb 2006 11:59:56 +0300 (MSK) (envelope-from os@rsu.ru) Date: Sun, 26 Feb 2006 11:59:55 +0300 (MSK) From: Oleg Sharoiko To: Scott Long In-Reply-To: <43F38E74.6020705@samsco.org> Message-ID: <20060226115730.K774@brain.cc.rsu.ru> References: <20060215102749.D58480@brain.cc.rsu.ru> <43F38E74.6020705@samsco.org> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII X-Virus-Scanned: ClamAV version 0.86.2, clamav-milter version 0.86 on asterix.r61.net X-Virus-Status: Clean Cc: freebsd-scsi@freebsd.org, Andrey Beresovsky , John Baldwin Subject: Re: Boot hangs on ips0: resetting adapter, this may take up to 5 minutes X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 26 Feb 2006 08:59:59 -0000 On Wed, 15 Feb 2006, Scott Long wrote: SL>This sounds like an interrupt routing problem. The symptoms are similar to SL>others where APIC-routed interrupts don't seem to make it to the active CPUs, SL>depending on whether SMP or HTT is enabled or disabled. Maybe John has some SL>insight here. So is interrupt routing a hardware or a software issue? Taking into account that windows 2003 server works fine with ips I'd say that our particular case is not a hardware issue. If so could you suggest peaces of code should we look at to try solve this problem? -- Oleg Sharoiko. Software and Network Engineer Computer Center of Rostov State University. From owner-freebsd-scsi@FreeBSD.ORG Mon Feb 27 09:44:47 2006 Return-Path: X-Original-To: freebsd-scsi@freebsd.org Delivered-To: freebsd-scsi@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 7AE1F16A420 for ; Mon, 27 Feb 2006 09:44:47 +0000 (GMT) (envelope-from lydianconcepts@gmail.com) Received: from zproxy.gmail.com (zproxy.gmail.com [64.233.162.205]) by mx1.FreeBSD.org (Postfix) with ESMTP id D27C143D4C for ; Mon, 27 Feb 2006 09:44:46 +0000 (GMT) (envelope-from lydianconcepts@gmail.com) Received: by zproxy.gmail.com with SMTP id n29so847117nzf for ; Mon, 27 Feb 2006 01:44:46 -0800 (PST) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=HqbXladNmj+LzNlHZu/D4+MJXzfrJFHaot4F2u/zNjusWSUDZXNr0iU3k7PIYG5TiELiStXd+vd30oJWxTDBv5qS0lMOQV14kVnD3iovJx689WwFd/nRi7d17g15uZehmJn1qIN5ldJMY4HGLc3mDsE4xRAcao2oOs5aGxdoSFo= Received: by 10.65.148.17 with SMTP id a17mr2384865qbo; Mon, 27 Feb 2006 01:44:38 -0800 (PST) Received: by 10.65.154.20 with HTTP; Mon, 27 Feb 2006 01:44:38 -0800 (PST) Message-ID: <7579f7fb0602270144s231256b6ta40c6a0eedb10b5a@mail.gmail.com> Date: Mon, 27 Feb 2006 01:44:38 -0800 From: "Matthew Jacob" To: "Tom Samplonius" In-Reply-To: <20060206132947.O89934@mgmt.uniserve.ca> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Content-Disposition: inline References: <20060206132947.O89934@mgmt.uniserve.ca> Cc: freebsd-scsi@freebsd.org Subject: Re: Qlogic fibre channel support questions X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Feb 2006 09:44:47 -0000 > > * Does the isp driver support full fabric? There are some notes in the m= an > pages that fabric support "..may be contingent upon the correct firmware = being > loaded". Would the FreeBSD ispfw firemware be "correct" for a 23xx card? Yes. That man page item is old, and yes, your experience is generally best in having ispfw load the 'matched' firmware. > > * Would booting from a Qlogic 23xx fibre channel card work fine? I presu= me they > cards come with a standard BIOS, so this just works? More or less. You have to specity in the BIOS menu WWN,LUN. > > * There is a noted bug in the isp manpage that the driver can get stuck u= pon > boot. I presume this bug is specific to loops, not a fabric? > > Again, an old entry in the man page. -------------------- The principle issue about booting from the SAN for FreeBSD is like of either WWN disk namespace support or persistent target ID support. If you want a longer explanation, poke me to give it. The short story here is: a) Set a Hard Loop ID in the adapter BIOS- '77' is a good one. This will avoid, in loop topologies, an argument between the adapter and disks over loop ID 0 with hard to predict results from boot to boot. b) If in a fabric, use zoning so each FreeBSD box sees only its own disks and nobody elses. This means both switch zoning and lun zoning if you're doing things like booting from large provisioned arrays. Neither action is particularly onerous, and the latter is considered in general one of the 'best practices' anyway. ---------- Why do you want to boot from SAN? Don't the blades have space for a local boot disk? From owner-freebsd-scsi@FreeBSD.ORG Mon Feb 27 11:02:44 2006 Return-Path: X-Original-To: freebsd-scsi@freebsd.org Delivered-To: freebsd-scsi@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 7F26216A422 for ; Mon, 27 Feb 2006 11:02:44 +0000 (GMT) (envelope-from owner-bugmaster@freebsd.org) Received: from freefall.freebsd.org (freefall.freebsd.org [216.136.204.21]) by mx1.FreeBSD.org (Postfix) with ESMTP id 463FF43D55 for ; Mon, 27 Feb 2006 11:02:44 +0000 (GMT) (envelope-from owner-bugmaster@freebsd.org) Received: from freefall.freebsd.org (peter@localhost [127.0.0.1]) by freefall.freebsd.org (8.13.4/8.13.4) with ESMTP id k1RB2iDM047158 for ; Mon, 27 Feb 2006 11:02:44 GMT (envelope-from owner-bugmaster@freebsd.org) Received: (from peter@localhost) by freefall.freebsd.org (8.13.4/8.13.4/Submit) id k1RB2hZa047152 for freebsd-scsi@freebsd.org; Mon, 27 Feb 2006 11:02:43 GMT (envelope-from owner-bugmaster@freebsd.org) Date: Mon, 27 Feb 2006 11:02:43 GMT Message-Id: <200602271102.k1RB2hZa047152@freefall.freebsd.org> X-Authentication-Warning: freefall.freebsd.org: peter set sender to owner-bugmaster@freebsd.org using -f From: FreeBSD bugmaster To: freebsd-scsi@FreeBSD.org Cc: Subject: Current problem reports assigned to you X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Feb 2006 11:02:44 -0000 Current FreeBSD problem reports Critical problems Serious problems S Submitted Tracker Resp. Description ------------------------------------------------------------------------------- o [2001/05/03] kern/27059 scsi [sym] SCSI subsystem hangs under heavy lo o [2001/06/29] kern/28508 scsi problems with backup to Tandberg SLR40 st o [2002/06/17] kern/39388 scsi ncr/sym drivers fail with 53c810 and more o [2002/07/22] kern/40895 scsi wierd kernel / device driver bug o [2003/05/24] kern/52638 scsi [panic] SCSI U320 on SMP server won't run s [2003/09/30] kern/57398 scsi [mly] Current fails to install on mly(4) o [2003/12/26] kern/60598 scsi wire down of scsi devices conflicts with o [2003/12/27] kern/60641 scsi [sym] Sporadic SCSI bus resets with 53C81 s [2004/01/10] kern/61165 scsi [panic] kernel page fault after calling c o [2004/12/02] kern/74627 scsi [ahc] [hang] Adaptec 2940U2W Can't boot 5 o [2005/06/04] kern/81887 scsi [aac] Adaptec SCSI 2130S aac0: GetDeviceP o [2005/12/12] kern/90282 scsi [sym] SCSI bus resets cause loss of ch de o [2006/02/04] kern/92798 scsi [ahc] SCSI problem with timeouts o [2006/02/10] kern/93128 scsi [sym] FreeBSD 6.1 BETA 1 has problems wit 14 problems total. Non-critical problems S Submitted Tracker Resp. Description ------------------------------------------------------------------------------- o [2000/12/06] kern/23314 scsi aic driver fails to detect Adaptec 1520B o [2002/02/23] kern/35234 scsi World access to /dev/pass? (for scanner) o [2002/06/02] kern/38828 scsi [feature request] DPT PM2012B/90 doesn't o [2002/10/29] kern/44587 scsi dev/dpt/dpt.h is missing defines required o [2005/01/12] kern/76178 scsi [ahd] Problem with ahd and large SCSI Rai 5 problems total. From owner-freebsd-scsi@FreeBSD.ORG Mon Feb 27 17:23:53 2006 Return-Path: X-Original-To: freebsd-scsi@FreeBSD.org Delivered-To: freebsd-scsi@FreeBSD.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id D1D8316A420 for ; Mon, 27 Feb 2006 17:23:53 +0000 (GMT) (envelope-from jkim@FreeBSD.org) Received: from anuket.mj.niksun.com (gwnew.niksun.com [65.115.46.162]) by mx1.FreeBSD.org (Postfix) with ESMTP id 8C8AC43D7D for ; Mon, 27 Feb 2006 17:23:42 +0000 (GMT) (envelope-from jkim@FreeBSD.org) Received: from niksun.com (anuket [10.70.0.5]) by anuket.mj.niksun.com (8.13.1/8.13.1) with ESMTP id k1RHNcIp067294; Mon, 27 Feb 2006 12:23:38 -0500 (EST) (envelope-from jkim@FreeBSD.org) From: Jung-uk Kim To: freebsd-scsi@FreeBSD.org Date: Mon, 27 Feb 2006 12:23:17 -0500 User-Agent: KMail/1.6.2 References: <200602241645.36042.jkim@FreeBSD.org> <44009A66.1040804@samsco.org> In-Reply-To: <44009A66.1040804@samsco.org> MIME-Version: 1.0 Content-Disposition: inline Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Message-Id: <200602271223.20959.jkim@FreeBSD.org> X-Virus-Scanned: ClamAV devel-20050919/1304/Sun Feb 26 06:47:28 2006 on anuket.mj.niksun.com X-Virus-Status: Clean Cc: Subject: Re: A tiny amr(4) monitoring tool X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Feb 2006 17:23:54 -0000 On Saturday 25 February 2006 12:56 pm, Scott Long wrote: > This is pretty cool. You should check it into /usr/src/usr.sbin. I thought about it but I have to find the original writer and get clearance. BTW, the source is not so clean and it needs some cleanup to be committable. When I find some copious free time, I'll do that. ;-) > I'm working on a similar tool for IPS. Awesome. BTW, OpenBSD has bioctl(8) to manage RAID controllers: http://www.openbsd.org/cgi-bin/man.cgi?query=bioctl&apropos=0&sektion=0&manpath=OpenBSD+Current&arch=i386&format=html It would be nice to have such an API for us too. :-) Jung-uk Kim > Scott > > Jung-uk Kim wrote: > > This is a small amr(4) tool that I've been using for a while. It > > was originally posted here: > > > > http://docs.freebsd.org/cgi/mid.cgi?42345F33.8030101 > > > > I added few more features, e. g., battery status, physical drive > > status, etc. Sorry but the source is not very clean (i. e., > > ENOTIME). > > > > http://people.freebsd.org/~jkim/amrstat2.tar.gz > > > > usage: amrstat [-a num] [-b] [-c ctlr|-f dev] [-g] [-l vol] > > [-p drive|-s bus[:target]] [-t usec] [-v] > > > > -a num number of retries > > -b battery status > > -c ctrl controller ID > > -f dev device path > > -g print global parameters > > -l vol logical volume ID > > -p drive physical drive ID > > -s bus[:target] SCSI bus (and optinal target) > > -t usec sleep time between retries > > -v verbose output > > > > Example 1: > > # amrstat > > Logical volume 0 optimal (547.67 GB, RAID5) > > Logical volume 1 optimal (547.67 GB, RAID5) > > Physical drive 0:10 online > > Physical drive 0:11 online > > Physical drive 0:12 online > > Physical drive 0:13 online > > Physical drive 1:0 online > > Physical drive 1:1 online > > Physical drive 1:2 online > > Physical drive 1:3 hotspare > > Physical drive 1:4 online > > Physical drive 1:5 online > > > > Example 2: > > # amrstat -b -l0 -s0 > > Battery status not present, charge unknown > > Logical volume 0 degraded (341.83 GB, RAID5) > > Physical drive 0:0 online > > Physical drive 0:1 online > > Physical drive 0:2 rebuild > > Physical drive 0:3 online > > Physical drive 0:4 online > > Physical drive 0:5 online > > > > If other tools are too heavy for you, this may be a good > > alternative. > > > > Cheers, > > > > Jung-uk Kim > > _______________________________________________ > > freebsd-scsi@freebsd.org mailing list > > http://lists.freebsd.org/mailman/listinfo/freebsd-scsi > > To unsubscribe, send any mail to > > "freebsd-scsi-unsubscribe@freebsd.org" > > _______________________________________________ > freebsd-scsi@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-scsi > To unsubscribe, send any mail to > "freebsd-scsi-unsubscribe@freebsd.org" From owner-freebsd-scsi@FreeBSD.ORG Mon Feb 27 18:20:06 2006 Return-Path: X-Original-To: freebsd-scsi@freebsd.org Delivered-To: freebsd-scsi@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 4B80D16A420 for ; Mon, 27 Feb 2006 18:20:06 +0000 (GMT) (envelope-from tom@uniserve.com) Received: from mx7.uniserve.ca (mx7a.uniserve.ca [216.113.192.93]) by mx1.FreeBSD.org (Postfix) with ESMTP id 015EE43D49 for ; Mon, 27 Feb 2006 18:20:05 +0000 (GMT) (envelope-from tom@uniserve.com) Received: from mgmt.uniserve.ca ([216.113.192.30]) by mx7.uniserve.ca with esmtp (Exim 4.50) id 1FDmyb-000A50-AC; Mon, 27 Feb 2006 10:20:05 -0800 Date: Mon, 27 Feb 2006 10:20:05 -0800 (PST) From: Tom Samplonius X-X-Sender: tom@mgmt.uniserve.ca To: Matthew Jacob In-Reply-To: <7579f7fb0602270144s231256b6ta40c6a0eedb10b5a@mail.gmail.com> Message-ID: <20060227101531.L90562@mgmt.uniserve.ca> References: <20060206132947.O89934@mgmt.uniserve.ca> <7579f7fb0602270144s231256b6ta40c6a0eedb10b5a@mail.gmail.com> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed X-Scanner: OK. Scanned. Cc: freebsd-scsi@freebsd.org Subject: Re: Qlogic fibre channel support questions X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Feb 2006 18:20:06 -0000 On Mon, 27 Feb 2006, Matthew Jacob wrote: > Why do you want to boot from SAN? Don't the blades have space for a > local boot disk? IBM blades do not have hotswappable drives on the blades. So you have to remove the blade to get at the drives. Plus, the drives pump up the chassis power consumption as well. (Well, there is SCSI side-car option, but it eats up a blade slot.) So consolidating all storage on the SAN, make sense. Managing a bunch of 10GB boot LUNs is going to easier than dealing with 28 physical drives (2 per blade). I can put a pair of mirrored 146GB disks on the SAN, and slice out 10GB per blade. It is even a bit cheaper, including the SAN 64 partition licence. Tom From owner-freebsd-scsi@FreeBSD.ORG Mon Feb 27 20:16:54 2006 Return-Path: X-Original-To: freebsd-scsi@freebsd.org Delivered-To: freebsd-scsi@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 6A78016A420 for ; Mon, 27 Feb 2006 20:16:54 +0000 (GMT) (envelope-from ticso@cicely12.cicely.de) Received: from ant.bwct.de (ant.bwct.de [85.159.14.68]) by mx1.FreeBSD.org (Postfix) with ESMTP id 99C0D43D46 for ; Mon, 27 Feb 2006 20:16:53 +0000 (GMT) (envelope-from ticso@cicely12.cicely.de) Received: from cicely5.cicely.de ([10.1.1.7]) by ant.bwct.de (8.12.11/8.12.11) with ESMTP id k1RKGp1g000963 for ; Mon, 27 Feb 2006 21:16:51 +0100 (CET) Received: from cicely12.cicely.de (cicely12.cicely.de [10.1.1.14]) by cicely5.cicely.de (8.13.4/8.13.4) with ESMTP id k1RKGkgL036264 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Mon, 27 Feb 2006 21:16:46 +0100 (CET) (envelope-from ticso@cicely12.cicely.de) Received: from cicely12.cicely.de (localhost [127.0.0.1]) by cicely12.cicely.de (8.13.4/8.13.3) with ESMTP id k1RKGjF9068182; Mon, 27 Feb 2006 21:16:45 +0100 (CET) (envelope-from ticso@cicely12.cicely.de) Received: (from ticso@localhost) by cicely12.cicely.de (8.13.4/8.13.3/Submit) id k1RKGj2J068181; Mon, 27 Feb 2006 21:16:45 +0100 (CET) (envelope-from ticso) Date: Mon, 27 Feb 2006 21:16:45 +0100 From: Bernd Walter To: freebsd-scsi@freebsd.org Message-ID: <20060227201644.GR64548@cicely12.cicely.de> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline X-Operating-System: FreeBSD cicely12.cicely.de 5.4-STABLE alpha User-Agent: Mutt/1.5.9i X-Spam-Status: No, score=-5.9 required=5.0 tests=ALL_TRUSTED,BAYES_00 autolearn=ham version=3.0.4 X-Spam-Report: * -3.3 ALL_TRUSTED Did not pass through any untrusted hosts * -2.6 BAYES_00 BODY: Bayesian spam probability is 0 to 1% * [score: 0.0000] X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on cicely12.cicely.de Cc: Bernd Walter Subject: Automatic unit start broken? X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: ticso@cicely.de List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Feb 2006 20:16:54 -0000 It seems that FreeBSD doesn't start disks anymore. Disks which delayed start won't get probed by GEOM when they are not ready when GEOM tries - at least one can delay booting in this case. Disks which don't startup unless told never get working - I currently start them manually in rc-scripts and tell GEOM to reprobe, but this is not always an option, e.g. in case of / drive. All in all this is very annoying since I have not much options about changing the disk spin-up policy. -- B.Walter BWCT http://www.bwct.de bernd@bwct.de info@bwct.de From owner-freebsd-scsi@FreeBSD.ORG Mon Feb 27 20:22:58 2006 Return-Path: X-Original-To: freebsd-scsi@freebsd.org Delivered-To: freebsd-scsi@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id DDDEF16A420 for ; Mon, 27 Feb 2006 20:22:58 +0000 (GMT) (envelope-from ken@nargothrond.kdm.org) Received: from nargothrond.kdm.org (nargothrond.kdm.org [70.56.43.81]) by mx1.FreeBSD.org (Postfix) with ESMTP id 6D1D743D45 for ; Mon, 27 Feb 2006 20:22:58 +0000 (GMT) (envelope-from ken@nargothrond.kdm.org) Received: from nargothrond.kdm.org (localhost [127.0.0.1]) by nargothrond.kdm.org (8.13.4/8.12.11) with ESMTP id k1RKMsNA001068; Mon, 27 Feb 2006 13:22:54 -0700 (MST) (envelope-from ken@nargothrond.kdm.org) Received: (from ken@localhost) by nargothrond.kdm.org (8.13.4/8.12.5/Submit) id k1RKMseT001067; Mon, 27 Feb 2006 13:22:54 -0700 (MST) (envelope-from ken) Date: Mon, 27 Feb 2006 13:22:54 -0700 From: "Kenneth D. Merry" To: ticso@cicely.de Message-ID: <20060227202254.GA1016@nargothrond.kdm.org> References: <20060227201644.GR64548@cicely12.cicely.de> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20060227201644.GR64548@cicely12.cicely.de> User-Agent: Mutt/1.4.2i X-Virus-Scanned: ClamAV 0.87.1/1305/Mon Feb 27 12:07:49 2006 on nargothrond.kdm.org X-Virus-Status: Clean Cc: Bernd Walter , freebsd-scsi@freebsd.org Subject: Re: Automatic unit start broken? X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Feb 2006 20:22:59 -0000 On Mon, Feb 27, 2006 at 21:16:45 +0100, Bernd Walter wrote: > It seems that FreeBSD doesn't start disks anymore. That's strange, I don't think anything has changed in that area recently. > Disks which delayed start won't get probed by GEOM when they are not > ready when GEOM tries - at least one can delay booting in this case. > Disks which don't startup unless told never get working - I currently > start them manually in rc-scripts and tell GEOM to reprobe, but this > is not always an option, e.g. in case of / drive. > All in all this is very annoying since I have not much options about > changing the disk spin-up policy. What error code do your disks return? You will probably see some console output if GEOM has tried to read metadata off the disk and that initial read fails. If the drive returns 0x04,0x02 ("Logical unit not ready, initializing cmd. required"), CAM will attempt to spin the disk up automatically and retry the command. Ken -- Kenneth Merry ken@FreeBSD.ORG From owner-freebsd-scsi@FreeBSD.ORG Mon Feb 27 20:43:35 2006 Return-Path: X-Original-To: freebsd-scsi@freebsd.org Delivered-To: freebsd-scsi@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id C19CE16A420; Mon, 27 Feb 2006 20:43:35 +0000 (GMT) (envelope-from ticso@cicely12.cicely.de) Received: from ant.bwct.de (ant.bwct.de [85.159.14.68]) by mx1.FreeBSD.org (Postfix) with ESMTP id EA1C243D46; Mon, 27 Feb 2006 20:43:34 +0000 (GMT) (envelope-from ticso@cicely12.cicely.de) Received: from cicely5.cicely.de ([10.1.1.7]) by ant.bwct.de (8.12.11/8.12.11) with ESMTP id k1RKhWUd015545; Mon, 27 Feb 2006 21:43:33 +0100 (CET) Received: from cicely12.cicely.de (cicely12.cicely.de [10.1.1.14]) by cicely5.cicely.de (8.13.4/8.13.4) with ESMTP id k1RKhSmI036452 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Mon, 27 Feb 2006 21:43:28 +0100 (CET) (envelope-from ticso@cicely12.cicely.de) Received: from cicely12.cicely.de (localhost [127.0.0.1]) by cicely12.cicely.de (8.13.4/8.13.3) with ESMTP id k1RKhRae068265; Mon, 27 Feb 2006 21:43:27 +0100 (CET) (envelope-from ticso@cicely12.cicely.de) Received: (from ticso@localhost) by cicely12.cicely.de (8.13.4/8.13.3/Submit) id k1RKhRs5068264; Mon, 27 Feb 2006 21:43:27 +0100 (CET) (envelope-from ticso) Date: Mon, 27 Feb 2006 21:43:27 +0100 From: Bernd Walter To: "Kenneth D. Merry" Message-ID: <20060227204326.GS64548@cicely12.cicely.de> References: <20060227201644.GR64548@cicely12.cicely.de> <20060227202254.GA1016@nargothrond.kdm.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20060227202254.GA1016@nargothrond.kdm.org> X-Operating-System: FreeBSD cicely12.cicely.de 5.4-STABLE alpha User-Agent: Mutt/1.5.9i X-Spam-Status: No, score=-5.9 required=5.0 tests=ALL_TRUSTED,BAYES_00 autolearn=ham version=3.0.4 X-Spam-Report: * -3.3 ALL_TRUSTED Did not pass through any untrusted hosts * -2.6 BAYES_00 BODY: Bayesian spam probability is 0 to 1% * [score: 0.0000] X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on cicely12.cicely.de Cc: Bernd Walter , freebsd-scsi@freebsd.org, ticso@cicely.de Subject: Re: Automatic unit start broken? X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: ticso@cicely.de List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Feb 2006 20:43:36 -0000 On Mon, Feb 27, 2006 at 01:22:54PM -0700, Kenneth D. Merry wrote: > On Mon, Feb 27, 2006 at 21:16:45 +0100, Bernd Walter wrote: > > It seems that FreeBSD doesn't start disks anymore. > > That's strange, I don't think anything has changed in that area recently. I don't think this happened recently. It is a new machine, but I already noticed several months back that I can't camcontrol stop a mounted drives anymore without getting problems on access later. > > Disks which delayed start won't get probed by GEOM when they are not > > ready when GEOM tries - at least one can delay booting in this case. > > Disks which don't startup unless told never get working - I currently > > start them manually in rc-scripts and tell GEOM to reprobe, but this > > is not always an option, e.g. in case of / drive. > > All in all this is very annoying since I have not much options about > > changing the disk spin-up policy. > > What error code do your disks return? You will probably see some console > output if GEOM has tried to read metadata off the disk and that initial > read fails. > > If the drive returns 0x04,0x02 ("Logical unit not ready, initializing cmd. > required"), CAM will attempt to spin the disk up automatically and retry > the command. During the first tests I waited 90s in loader to let all delayed spin up drives spin up. This is with recent RELENG_6 and a drive which don't spin up themself: [...] da7 at esp1 bus 0 target 10 lun 0 da7: Fixed Direct Access SCSI-3 device da7: 20.000MB/s transfers (10.000MHz, offset 15, 16bit), Tagged Queueing Enabled da7: Attempt to query device size failed: NOT READY, Logical unit not ready, initial [...] No GEOM message about this driver until rc sends a start command and GEOM is retriggered to reread the drive: Unit started successfully GEOM_LABEL: Label for provider da7 is ufs/dump1. The following commands were used in rc: camcontrol start -n da -u 7 cat /dev/null > /dev/da7 Without the loader delay other disks are having problems as well: da9 at esp1 bus 0 target 14 lun 0 da9: Fixed Direct Access SCSI-3 device da9: 20.000MB/s transfers (10.000MHz, offset 15, 16bit), Tagged Queueing Enabled da9: Attempt to query device size failed: NOT READY, Logical unit is in process of b On Shell: [30]cicely19# dd if=/dev/da7 bs=1k count=1 of=/dev/null 1+0 records in 1+0 records out 1024 bytes transferred in 0.008765 secs (116829 bytes/sec) [31]cicely19# camcontrol stop -n da -u 7 Unit stopped successfully [32]cicely19# dd if=/dev/da7 bs=1k count=1 of=/dev/null dd: /dev/da7: Input/output error 0+0 records in 0+0 records out 0 bytes transferred in 0.004810 secs (0 bytes/sec) Exit 1 -- B.Walter BWCT http://www.bwct.de bernd@bwct.de info@bwct.de From owner-freebsd-scsi@FreeBSD.ORG Tue Feb 28 01:08:37 2006 Return-Path: X-Original-To: freebsd-scsi@freebsd.org Delivered-To: freebsd-scsi@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 2D67716A420 for ; Tue, 28 Feb 2006 01:08:37 +0000 (GMT) (envelope-from janm-freebsd-scsi@transactionware.com) Received: from mail.transactionware.com (mail.transactionware.com [203.14.245.7]) by mx1.FreeBSD.org (Postfix) with SMTP id 0047E43D46 for ; Tue, 28 Feb 2006 01:08:35 +0000 (GMT) (envelope-from janm-freebsd-scsi@transactionware.com) Received: (qmail 40293 invoked from network); 28 Feb 2006 01:08:51 -0000 Received: from new.transactionware.com (192.168.1.55) by dm.transactionware.com with SMTP; 28 Feb 2006 01:08:51 -0000 Received: (qmail 3257 invoked by uid 1001); 28 Feb 2006 01:00:28 -0000 Date: 28 Feb 2006 01:00:28 -0000 Message-ID: <20060228010028.3256.qmail@new.transactionware.com> From: janm-freebsd-scsi@transactionware.com To: freebsd-scsi@freebsd.org Subject: Re: A tiny amr(4) monitoring tool X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Feb 2006 01:08:37 -0000 [ Resend to the list, I used the wrong originator address to make it through the "subscribers only" filter. ] Hi, I wrote an ipsstat utility that I've been emailing people for a while. I've been meaning to put it on the web; those who are interested can get it from: http://janm.transactionware.com/ipsstat/ipsstat.tar.bz2 Regards, Jan. >> -----Original Message----- >> From: owner-freebsd-scsi@freebsd.org >> [mailto:owner-freebsd-scsi@freebsd.org] On Behalf Of Scott Long >> Sent: Sunday, 26 February 2006 4:57 AM >> To: Jung-uk Kim >> Cc: freebsd-scsi@freebsd.org >> Subject: Re: A tiny amr(4) monitoring tool >> >> >> This is pretty cool. You should check it into /usr/src/usr.sbin. I'm >> working on a similar tool for IPS. >> >> Scott >> >> >> Jung-uk Kim wrote: >> > >>> > This is a small amr(4) tool that I've been using for a > >> while. It was > >>> > originally posted here: >>> > >>> > http://docs.freebsd.org/cgi/mid.cgi?42345F33.8030101 >>> > >>> > I added few more features, e. g., battery status, physical drive >>> > status, etc. Sorry but the source is not very clean (i. e., >>> > ENOTIME). >>> > >>> > http://people.freebsd.org/~jkim/amrstat2.tar.gz >>> > >>> > usage: amrstat [-a num] [-b] [-c ctlr|-f dev] [-g] [-l vol] >>> > [-p drive|-s bus[:target]] [-t usec] [-v] >>> > >>> > -a num number of retries >>> > -b battery status >>> > -c ctrl controller ID >>> > -f dev device path >>> > -g print global parameters >>> > -l vol logical volume ID >>> > -p drive physical drive ID >>> > -s bus[:target] SCSI bus (and optinal target) >>> > -t usec sleep time between retries >>> > -v verbose output >>> > >>> > Example 1: >>> > # amrstat >>> > Logical volume 0 optimal (547.67 GB, RAID5) >>> > Logical volume 1 optimal (547.67 GB, RAID5) >>> > Physical drive 0:10 online >>> > Physical drive 0:11 online >>> > Physical drive 0:12 online >>> > Physical drive 0:13 online >>> > Physical drive 1:0 online >>> > Physical drive 1:1 online >>> > Physical drive 1:2 online >>> > Physical drive 1:3 hotspare >>> > Physical drive 1:4 online >>> > Physical drive 1:5 online >>> > >>> > Example 2: >>> > # amrstat -b -l0 -s0 >>> > Battery status not present, charge unknown >>> > Logical volume 0 degraded (341.83 GB, RAID5) >>> > Physical drive 0:0 online >>> > Physical drive 0:1 online >>> > Physical drive 0:2 rebuild >>> > Physical drive 0:3 online >>> > Physical drive 0:4 online >>> > Physical drive 0:5 online >>> > >>> > If other tools are too heavy for you, this may be a good > >> alternative. > >>> > >>> > Cheers, >>> > >>> > Jung-uk Kim >>> > _______________________________________________ >>> > freebsd-scsi@freebsd.org mailing list >>> > http://lists.freebsd.org/mailman/listinfo/freebsd-scsi >>> > To unsubscribe, send any mail to > >> "freebsd-scsi-unsubscribe@freebsd.org" >> >> _______________________________________________ >> freebsd-scsi@freebsd.org mailing list >> http://lists.freebsd.org/mailman/listinfo/freebsd-scsi >> To unsubscribe, send any mail to >> "freebsd-scsi-unsubscribe@freebsd.org" >> From owner-freebsd-scsi@FreeBSD.ORG Tue Feb 28 01:08:37 2006 Return-Path: X-Original-To: freebsd-scsi@freebsd.org Delivered-To: freebsd-scsi@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 7867C16A423 for ; Tue, 28 Feb 2006 01:08:37 +0000 (GMT) (envelope-from janm@transactionware.com) Received: from mail.transactionware.com (mail.transactionware.com [203.14.245.7]) by mx1.FreeBSD.org (Postfix) with SMTP id 0031643D45 for ; Tue, 28 Feb 2006 01:08:35 +0000 (GMT) (envelope-from janm@transactionware.com) Received: (qmail 40265 invoked from network); 28 Feb 2006 01:08:50 -0000 Received: from new.transactionware.com (192.168.1.55) by dm.transactionware.com with SMTP; 28 Feb 2006 01:08:50 -0000 Received: (qmail 3192 invoked by uid 1026); 28 Feb 2006 00:42:41 -0000 Received: from 127.0.0.1 by new.transactionware.com (envelope-from , uid 1003) with qmail-scanner-1.25 (spamassassin: 3.0.2. Clear:RC:1(127.0.0.1):. Processed in 2.813266 secs); 28 Feb 2006 00:42:41 -0000 Received: from unknown (HELO JMLAPTOP) (unknown) by unknown with SMTP; 28 Feb 2006 00:42:37 -0000 From: "Jan Mikkelsen" To: "'Scott Long'" , "'Jung-uk Kim'" Date: Tue, 28 Feb 2006 11:42:20 +1100 Organization: Transactionware Message-ID: <000201c63bff$d55fc340$0301a8c0@transactionware.com> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable X-Priority: 3 (Normal) X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook, Build 10.0.6626 X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.2670 Importance: Normal In-Reply-To: <44009A66.1040804@samsco.org> Cc: freebsd-scsi@freebsd.org Subject: RE: A tiny amr(4) monitoring tool X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Feb 2006 01:08:37 -0000 Hi, I wrote an ipsstat utility that I've been emailing people for a while. I've been meaning to put it on the web; those who are interested can = get it from: http://janm.transactionware.com/ipsstat/ipsstat.tar.bz2 Regards, Jan. > -----Original Message----- > From: owner-freebsd-scsi@freebsd.org=20 > [mailto:owner-freebsd-scsi@freebsd.org] On Behalf Of Scott Long > Sent: Sunday, 26 February 2006 4:57 AM > To: Jung-uk Kim > Cc: freebsd-scsi@freebsd.org > Subject: Re: A tiny amr(4) monitoring tool >=20 >=20 > This is pretty cool. You should check it into /usr/src/usr.sbin. I'm > working on a similar tool for IPS. >=20 > Scott >=20 >=20 > Jung-uk Kim wrote: >=20 > > This is a small amr(4) tool that I've been using for a=20 > while. It was=20 > > originally posted here: > >=20 > > http://docs.freebsd.org/cgi/mid.cgi?42345F33.8030101 > >=20 > > I added few more features, e. g., battery status, physical drive=20 > > status, etc. Sorry but the source is not very clean (i. e.,=20 > > ENOTIME). > >=20 > > http://people.freebsd.org/~jkim/amrstat2.tar.gz > >=20 > > usage: amrstat [-a num] [-b] [-c ctlr|-f dev] [-g] [-l vol] > > [-p drive|-s bus[:target]] [-t usec] [-v] > >=20 > > -a num number of retries > > -b battery status > > -c ctrl controller ID > > -f dev device path > > -g print global parameters > > -l vol logical volume ID > > -p drive physical drive ID > > -s bus[:target] SCSI bus (and optinal target) > > -t usec sleep time between retries > > -v verbose output > >=20 > > Example 1: > > # amrstat > > Logical volume 0 optimal (547.67 GB, RAID5) > > Logical volume 1 optimal (547.67 GB, RAID5) > > Physical drive 0:10 online > > Physical drive 0:11 online > > Physical drive 0:12 online > > Physical drive 0:13 online > > Physical drive 1:0 online > > Physical drive 1:1 online > > Physical drive 1:2 online > > Physical drive 1:3 hotspare > > Physical drive 1:4 online > > Physical drive 1:5 online > >=20 > > Example 2: > > # amrstat -b -l0 -s0 > > Battery status not present, charge unknown > > Logical volume 0 degraded (341.83 GB, RAID5) > > Physical drive 0:0 online > > Physical drive 0:1 online > > Physical drive 0:2 rebuild > > Physical drive 0:3 online > > Physical drive 0:4 online > > Physical drive 0:5 online > >=20 > > If other tools are too heavy for you, this may be a good=20 > alternative. > >=20 > > Cheers, > >=20 > > Jung-uk Kim > > _______________________________________________ > > freebsd-scsi@freebsd.org mailing list > > http://lists.freebsd.org/mailman/listinfo/freebsd-scsi > > To unsubscribe, send any mail to=20 > "freebsd-scsi-unsubscribe@freebsd.org" >=20 > _______________________________________________ > freebsd-scsi@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-scsi > To unsubscribe, send any mail to=20 > "freebsd-scsi-unsubscribe@freebsd.org" >=20 From owner-freebsd-scsi@FreeBSD.ORG Tue Feb 28 01:26:03 2006 Return-Path: X-Original-To: freebsd-scsi@FreeBSD.org Delivered-To: freebsd-scsi@FreeBSD.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 4714016A420 for ; Tue, 28 Feb 2006 01:26:03 +0000 (GMT) (envelope-from jkim@FreeBSD.org) Received: from anuket.mj.niksun.com (gwnew.niksun.com [65.115.46.162]) by mx1.FreeBSD.org (Postfix) with ESMTP id BD32E43D46 for ; Tue, 28 Feb 2006 01:26:02 +0000 (GMT) (envelope-from jkim@FreeBSD.org) Received: from niksun.com (anuket [10.70.0.5]) by anuket.mj.niksun.com (8.13.1/8.13.1) with ESMTP id k1S1Pwt5083605; Mon, 27 Feb 2006 20:25:58 -0500 (EST) (envelope-from jkim@FreeBSD.org) From: Jung-uk Kim To: freebsd-scsi@FreeBSD.org Date: Mon, 27 Feb 2006 20:25:34 -0500 User-Agent: KMail/1.6.2 References: <200602241645.36042.jkim@FreeBSD.org> <44009A66.1040804@samsco.org> In-Reply-To: <44009A66.1040804@samsco.org> MIME-Version: 1.0 Content-Disposition: inline Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Message-Id: <200602272025.40916.jkim@FreeBSD.org> X-Virus-Scanned: ClamAV devel-20050919/1305/Mon Feb 27 14:07:49 2006 on anuket.mj.niksun.com X-Virus-Status: Clean Cc: Pierre DAVID Subject: Re: A tiny amr(4) monitoring tool X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Feb 2006 01:26:03 -0000 On Saturday 25 February 2006 12:56 pm, Scott Long wrote: > This is pretty cool. You should check it into /usr/src/usr.sbin. The original writer OK'd. I am going to clean up and commit some time later. Cheers, Jung-uk Kim From owner-freebsd-scsi@FreeBSD.ORG Tue Feb 28 05:10:31 2006 Return-Path: X-Original-To: freebsd-scsi@freebsd.org Delivered-To: freebsd-scsi@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 2F10616A420 for ; Tue, 28 Feb 2006 05:10:31 +0000 (GMT) (envelope-from lydianconcepts@gmail.com) Received: from zproxy.gmail.com (zproxy.gmail.com [64.233.162.192]) by mx1.FreeBSD.org (Postfix) with ESMTP id A919D43D45 for ; Tue, 28 Feb 2006 05:10:30 +0000 (GMT) (envelope-from lydianconcepts@gmail.com) Received: by zproxy.gmail.com with SMTP id 4so1078785nzn for ; Mon, 27 Feb 2006 21:10:29 -0800 (PST) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=ABwj3lXqR8r95jGwH2Ag5qfPI4ACiBMFPBW1DxcbXCIonrtSGlFi+nG6WFCeiHuOUv5JHhy411i315Qnc8Zgs6eBiJduqS6lTzkn0MwFoKZGC3XzhyOOY/PnyDbqRiDFO3HDGhc7sXVf1EYj/29vhureKh1LJ5dGqA7wJdb748o= Received: by 10.65.148.17 with SMTP id a17mr2945379qbo; Mon, 27 Feb 2006 21:10:29 -0800 (PST) Received: by 10.65.154.20 with HTTP; Mon, 27 Feb 2006 21:10:29 -0800 (PST) Message-ID: <7579f7fb0602272110h2782fde8w434b80436a6a0d81@mail.gmail.com> Date: Mon, 27 Feb 2006 21:10:29 -0800 From: "Matthew Jacob" To: "Tom Samplonius" In-Reply-To: <20060227101531.L90562@mgmt.uniserve.ca> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Content-Disposition: inline References: <20060206132947.O89934@mgmt.uniserve.ca> <7579f7fb0602270144s231256b6ta40c6a0eedb10b5a@mail.gmail.com> <20060227101531.L90562@mgmt.uniserve.ca> Cc: freebsd-scsi@freebsd.org Subject: Re: Qlogic fibre channel support questions X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Feb 2006 05:10:31 -0000 Okay- let me ask why diskless booting doesn't work for you? I'm playing diabocolus advocatus here because to me SANs are so unforgiving that trying to boot off of them often leads one into the situation that the systems can't run long enough to tell you they can't run because the SAN is AFU. Anyway- enough of this. It's what you want, and its reasonable. Dunno what you meant about the license- don't tell me one of the switch vendors is slicing and dicing costs based upon zone size? Grrr..... On 2/27/06, Tom Samplonius wrote: > > On Mon, 27 Feb 2006, Matthew Jacob wrote: > > > Why do you want to boot from SAN? Don't the blades have space for a > > local boot disk? > > > IBM blades do not have hotswappable drives on the blades. So you have = to > remove the blade to get at the drives. Plus, the drives pump up the chas= sis > power consumption as well. (Well, there is SCSI side-car option, but it = eats up > a blade slot.) > > So consolidating all storage on the SAN, make sense. Managing a bunch = of 10GB > boot LUNs is going to easier than dealing with 28 physical drives (2 per = blade). > I can put a pair of mirrored 146GB disks on the SAN, and slice out 10GB p= er > blade. It is even a bit cheaper, including the SAN 64 partition licence. > > Tom > From owner-freebsd-scsi@FreeBSD.ORG Tue Feb 28 06:53:08 2006 Return-Path: X-Original-To: freebsd-scsi@freebsd.org Delivered-To: freebsd-scsi@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 9539F16A420 for ; Tue, 28 Feb 2006 06:53:08 +0000 (GMT) (envelope-from tom@uniserve.com) Received: from mx5.uniserve.ca (mx5.uniserve.ca [216.113.192.94]) by mx1.FreeBSD.org (Postfix) with ESMTP id 5230743D46 for ; Tue, 28 Feb 2006 06:53:08 +0000 (GMT) (envelope-from tom@uniserve.com) Received: from mgmt.uniserve.ca ([216.113.192.30]) by mx5.uniserve.ca with esmtp (Exim 4.60) (envelope-from ) id 1FDyjL-000Nrn-T4; Mon, 27 Feb 2006 22:53:07 -0800 Date: Mon, 27 Feb 2006 22:53:07 -0800 (PST) From: Tom Samplonius X-X-Sender: tom@mgmt.uniserve.ca To: Matthew Jacob In-Reply-To: <7579f7fb0602272110h2782fde8w434b80436a6a0d81@mail.gmail.com> Message-ID: <20060227224337.S15843@mgmt.uniserve.ca> References: <20060206132947.O89934@mgmt.uniserve.ca> <7579f7fb0602270144s231256b6ta40c6a0eedb10b5a@mail.gmail.com> <20060227101531.L90562@mgmt.uniserve.ca> <7579f7fb0602272110h2782fde8w434b80436a6a0d81@mail.gmail.com> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed X-Scanner: OK. Scanned. Cc: freebsd-scsi@freebsd.org Subject: Re: Qlogic fibre channel support questions X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Feb 2006 06:53:08 -0000 On Mon, 27 Feb 2006, Matthew Jacob wrote: > Okay- let me ask why diskless booting doesn't work for you? Because NFS is slow. A locally disk (or a SAN attached disk, which is essentially the same to FreeBSD) is going to be faster than NFS, no matter what. > I'm playing diabocolus advocatus here because to me SANs are so > unforgiving that trying to boot off of them often leads one into the > situation that the systems can't run long enough to tell you they > can't run because the SAN is AFU. Yes, there are probably more bad SANs, that good SANs. However, with the QLogic cards supporting multipathing on boot devices, I don't think this should be an issue. And the SAN switches and the array controller supports out of band management, so if the SAN goes down, the switches and the array are going to know more about it, than FreeBSD could even. And, BTW, unlike a SAN, NFS servers are always 100% available. :) > Anyway- enough of this. It's what you want, and its reasonable. Dunno > what you meant about the license- don't tell me one of the switch > vendors is slicing and dicing costs based upon zone size? Grrr..... Array controllers are typically licensed by the number of partitions. Or, sometimes licesed by the number of attached hosts. Either way, the result is the same: charge more $$ for more hosts. IBM's licensing seems much more sane than EMC, especially for mid-range boxes (IBM DS4300 vs EMC CX300). The DS4300 is quite a bit cheaper, licenses for the maximum number of partitions supported by the hardware (64), than a CX300, when licensed for 8 hosts. Assuming one partition per host, I can connect up to 64 hosts to the DS4300. More if FreeBSD had a cluster file system, and could support shared partitions. Tom From owner-freebsd-scsi@FreeBSD.ORG Tue Feb 28 08:35:31 2006 Return-Path: X-Original-To: freebsd-scsi@freebsd.org Delivered-To: freebsd-scsi@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 9513216A420 for ; Tue, 28 Feb 2006 08:35:31 +0000 (GMT) (envelope-from massimo@cedoc.mo.it) Received: from insomma.datacode.it (ip-174-86.sn2.eutelia.it [83.211.174.86]) by mx1.FreeBSD.org (Postfix) with ESMTP id 0DB0443D45 for ; Tue, 28 Feb 2006 08:35:28 +0000 (GMT) (envelope-from massimo@cedoc.mo.it) Received: from localhost (localhost.datacode.it [127.0.0.1]) by insomma.datacode.it (Postfix) with SMTP id 62F972C90B for ; Tue, 28 Feb 2006 09:35:26 +0100 (CET) Received: from insomma.datacode.it (localhost.datacode.it [127.0.0.1]) by insomma.datacode.it (Postfix) with ESMTP id 9EABE2C90A for ; Tue, 28 Feb 2006 09:35:25 +0100 (CET) Received: from massimo.datacode.it (massimo.datacode.it [192.168.1.13]) by insomma.datacode.it (Postfix) with ESMTP id 5FDE62C906 for ; Tue, 28 Feb 2006 09:35:25 +0100 (CET) From: Massimo Lusetti To: freebsd-scsi@freebsd.org In-Reply-To: <200602271223.20959.jkim@FreeBSD.org> References: <200602241645.36042.jkim@FreeBSD.org> <44009A66.1040804@samsco.org> <200602271223.20959.jkim@FreeBSD.org> Content-Type: text/plain Organization: CEDOC - Modena Date: Tue, 28 Feb 2006 09:35:24 +0100 Message-Id: <1141115725.4304.6.camel@massimo.datacode.it> Mime-Version: 1.0 X-Mailer: Evolution 2.0.4 (2.0.4-7) Content-Transfer-Encoding: 7bit X-Virus-Scanned: ClamAV using ClamSMTP Subject: Re: A tiny amr(4) monitoring tool X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Feb 2006 08:35:31 -0000 On Mon, 2006-02-27 at 12:23 -0500, Jung-uk Kim wrote: > > I'm working on a similar tool for IPS. > > Awesome. > > BTW, OpenBSD has bioctl(8) to manage RAID controllers: > > http://www.openbsd.org/cgi-bin/man.cgi?query=bioctl&apropos=0&sektion=0&manpath=OpenBSD+Current&arch=i386&format=html > > It would be nice to have such an API for us too. :-) Yes, definitely. Is [1] gone any further? Regards [1] http://marc.theaimsgroup.com/?l=freebsd-current&m=112714583705861&w=2 -- Massimo.run(); From owner-freebsd-scsi@FreeBSD.ORG Tue Feb 28 09:23:39 2006 Return-Path: X-Original-To: freebsd-scsi@freebsd.org Delivered-To: freebsd-scsi@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 94E5516A420 for ; Tue, 28 Feb 2006 09:23:39 +0000 (GMT) (envelope-from danny@cs.huji.ac.il) Received: from cs1.cs.huji.ac.il (cs1.cs.huji.ac.il [132.65.16.10]) by mx1.FreeBSD.org (Postfix) with ESMTP id BE50D43D78 for ; Tue, 28 Feb 2006 09:23:36 +0000 (GMT) (envelope-from danny@cs.huji.ac.il) Received: from pampa.cs.huji.ac.il ([132.65.80.32]) by cs1.cs.huji.ac.il with esmtp id 1FE14w-0001r7-QO; Tue, 28 Feb 2006 11:23:34 +0200 X-Mailer: exmh version 2.7.0 06/18/2004 with nmh-1.0.4 To: Tom Samplonius In-reply-to: Your message of Mon, 27 Feb 2006 22:53:07 -0800 (PST) . Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Date: Tue, 28 Feb 2006 11:23:34 +0200 From: Danny Braniss Message-ID: Cc: freebsd-scsi@freebsd.org Subject: Re: Qlogic fibre channel support questions X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Feb 2006 09:23:39 -0000 > > On Mon, 27 Feb 2006, Matthew Jacob wrote: > > > Okay- let me ask why diskless booting doesn't work for you? > > Because NFS is slow. A locally disk (or a SAN attached disk, which is > essentially the same to FreeBSD) is going to be faster than NFS, no matter what. don't be too hasty with conclusions :-) 1- diskless: you can always boot diskless, then switch to 'real disk' in /etc/fstab: /dev/da0a / ufs rw 1 1 or what we do: /dev/da0b none swap sw /dev/da0d /var ufs rw 2 2 /dev/da0h /home ufs rw 2 2 so you don't have to boot from the SAN, but after loading the kernel (via 'slow' NFS) it will use the SAN. 2- as to speed, it all depends, specially on how deep are your pockets. i've been running several 'benchmarks' latetly and disk speed is not everything. sample: host is a Sun Fire X4200 (dual dula core Opteron) with SAS disks OS is FreeBSD 6.1-PRERELEASE amd64. make buildworld: diskless: 40m16.71s real 54m18.55s user 17m54.69s sys (using only 1 server*) nondiskless: 20m51.58s real 51m13.19s user 12m59.84s sys " but /usr/obj is iSCSI: 28m23.29s real 52m17.27s user 14m23.06s sys " but /usr/src and /usr/obj is iSCSI: 20m38.20s real 52m10.19s user 14m48.74s sys diskless but /usr/src and /usr/obj is iSCSI: 20m22.66s real 50m56.14s user 13m8.20s sys *: server in this case is a Xeon running in 64 mode but not very fast ethernet - em0 at 1gb but at about 50% efficiency. this server will 'make buildworld' in about 40 min. using the onboard LSILogic v3 MegaRAID RAID0. [iSCSI target is a Network Appliance] sorry for the noise, danny From owner-freebsd-scsi@FreeBSD.ORG Tue Feb 28 11:56:03 2006 Return-Path: X-Original-To: freebsd-scsi@FreeBSD.org Delivered-To: freebsd-scsi@FreeBSD.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id F14EA16A420 for ; Tue, 28 Feb 2006 11:56:03 +0000 (GMT) (envelope-from bde@zeta.org.au) Received: from mailout1.pacific.net.au (mailout1.pacific.net.au [61.8.0.84]) by mx1.FreeBSD.org (Postfix) with ESMTP id B2F9F43D49 for ; Tue, 28 Feb 2006 11:56:02 +0000 (GMT) (envelope-from bde@zeta.org.au) Received: from mailproxy1.pacific.net.au (mailproxy1.pacific.net.au [61.8.0.86]) by mailout1.pacific.net.au (Postfix) with ESMTP id 69FB6328F92; Tue, 28 Feb 2006 22:56:01 +1100 (EST) Received: from epsplex.bde.org (katana.zip.com.au [61.8.7.246]) by mailproxy1.pacific.net.au (8.13.4/8.13.4/Debian-3) with ESMTP id k1SBtwBb007002; Tue, 28 Feb 2006 22:55:59 +1100 Date: Tue, 28 Feb 2006 22:55:57 +1100 (EST) From: Bruce Evans X-X-Sender: bde@epsplex.bde.org To: Danny Braniss In-Reply-To: Message-ID: <20060228220252.B1770@epsplex.bde.org> References: MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Cc: freebsd-scsi@FreeBSD.org Subject: Re: Qlogic fibre channel support questions X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Feb 2006 11:56:04 -0000 On Tue, 28 Feb 2006, Danny Braniss wrote: >> On Mon, 27 Feb 2006, Matthew Jacob wrote: >> >>> Okay- let me ask why diskless booting doesn't work for you? >> >> Because NFS is slow. A locally disk (or a SAN attached disk, which is >> essentially the same to FreeBSD) is going to be faster than NFS, no matter what. > > don't be too hasty with conclusions :-) > 2- as to speed, it all depends, specially on how deep are your pockets. > i've been running several 'benchmarks' latetly and disk speed is not > everything. > > sample: > host is a Sun Fire X4200 (dual dula core Opteron) with SAS disks > OS is FreeBSD 6.1-PRERELEASE amd64. > > make buildworld: > diskless: 40m16.71s real 54m18.55s user 17m54.69s sys > (using only 1 server*) > nondiskless: 20m51.58s real 51m13.19s user 12m59.84s sys > " but /usr/obj is iSCSI: > 28m23.29s real 52m17.27s user 14m23.06s sys > " but /usr/src and /usr/obj is iSCSI: > 20m38.20s real 52m10.19s user 14m48.74s sys > diskless but /usr/src and /usr/obj is iSCSI: > 20m22.66s real 50m56.14s user 13m8.20s sys > > *: server in this case is a Xeon running in 64 mode but not very fast > ethernet - em0 at 1gb but at about 50% efficiency. > this server will 'make buildworld' in about 40 min. using the onboard > LSILogic v3 MegaRAID RAID0. I recently tried to use 1Gbps ethernet more (instead of 100Mbps) and hoped to get better makeworld performance, but actually got less. The problem seems to be just that nfs3 does too many attribute cache refreshes, so although all the data fits in the VMIO cache there is a lot of network activity, and 100Gbps ends up slower because my 1Gbps NICs have a slightly higher latency than my 100Mbps NICs. The 100Mbps ones are fxp's and have a ping latency of about 100uS, and the 1GBps ones are a bge and an sk and have a ping latency of 140uS. I think these latencies are lower than average, but they are too large for good makeworld-over-nfs performance. makeworld generates about 2000 (or is it 5000?) packets/second and waiting just 40uS longer for 2000 replies reduces performance by 8% or about 120 seconds of the total buildworld time. The faster NICs are better for bandwidth. I get a max of 40MB/S for read/write using tcp and about 25MB/S using udp. tcp is apparently faster because the latency is so bad that streaming in tcp reduces its effects significantly. However, using tcp for makeworld is a pessimization. All systems are 2-3GHz AthlonXPs with only 33MHz PCI buses running a 2 year old version of FreeBSD-current with local optimizations, with /usr (including /usr/src) nfs3-mounted and local object and root trees (initially empty). "world" is actually only about 95% of the world. 100Mbps: -------- 31532 maximum resident set size 2626 average shared memory size 1762 average unshared data size 128 average unshared stack size 15521898 page reclaims 14904 page faults 0 swaps 1932 block input operations <--- few of these since nfs bins and srcs 11822 block output operations <--- it's not disk-bound 1883576 messages sent 1883480 messages received 33448 signals received 2104163 voluntary context switches 472277 involuntary context switches 1GBps/tcp: ----------- 1930.89 real 1222.87 user 184.10 sys <--- way slower (real) 1GBps/udp: ----------- 1909.86 real 1225.25 user 181.22 sys mostly local disks (except /usr, not including /usr/src): --------------------------------------------------------- 1476.58 real 1224.70 user 161.30 sys <--- This is almost a properly configured system, with disks fast enough for real = user + sys + epsilon. 1GBps/udp + the best tuning/hacking I could find: nfs access timeout 2 -> 60 (probably wrong for general use) sk interrupt moderation 100 -> 10 (reduces latency) delete zapping of attribute cache on open in nfs (probably a bug for general use; a PR says that this should always be done for ro mounts) ---------------------------------------------------------------------------- 1630.86 real 1227.86 user 175.09 sys ... 1342791 messages sent <--- tuning seems to work mainly by reducing 1343111 messages received <--- these; they are still large 1GBps/udp + the best tuning I could find: nfs access timeout 2 -> 60 sk interrupt moderation 100 -> 10 no zapping of attribute cache on open in nfs -j4 ----------------------------------------------------------- 1599.74 real 1276.18 user 262.04 sys ... 1727832 messages sent 1726818 messages received -j is normally bad for UP systems, but here it helps by using cycles that would otherwise be idle. Bruce From owner-freebsd-scsi@FreeBSD.ORG Tue Feb 28 16:10:09 2006 Return-Path: X-Original-To: freebsd-scsi@freebsd.org Delivered-To: freebsd-scsi@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 60F6916A420 for ; Tue, 28 Feb 2006 16:10:09 +0000 (GMT) (envelope-from ken@nargothrond.kdm.org) Received: from nargothrond.kdm.org (nargothrond.kdm.org [70.56.43.81]) by mx1.FreeBSD.org (Postfix) with ESMTP id AFDEA43D46 for ; Tue, 28 Feb 2006 16:10:08 +0000 (GMT) (envelope-from ken@nargothrond.kdm.org) Received: from nargothrond.kdm.org (localhost [127.0.0.1]) by nargothrond.kdm.org (8.13.4/8.12.11) with ESMTP id k1SGA529009075; Tue, 28 Feb 2006 09:10:05 -0700 (MST) (envelope-from ken@nargothrond.kdm.org) Received: (from ken@localhost) by nargothrond.kdm.org (8.13.4/8.12.5/Submit) id k1SGA4mK009074; Tue, 28 Feb 2006 09:10:04 -0700 (MST) (envelope-from ken) Date: Tue, 28 Feb 2006 09:10:04 -0700 From: "Kenneth D. Merry" To: ticso@cicely.de Message-ID: <20060228161004.GA9002@nargothrond.kdm.org> References: <20060227201644.GR64548@cicely12.cicely.de> <20060227202254.GA1016@nargothrond.kdm.org> <20060227204326.GS64548@cicely12.cicely.de> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20060227204326.GS64548@cicely12.cicely.de> User-Agent: Mutt/1.4.2i X-Virus-Scanned: ClamAV 0.87.1/1306/Tue Feb 28 02:50:04 2006 on nargothrond.kdm.org X-Virus-Status: Clean Cc: Bernd Walter , freebsd-scsi@freebsd.org Subject: Re: Automatic unit start broken? X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Feb 2006 16:10:09 -0000 On Mon, Feb 27, 2006 at 21:43:27 +0100, Bernd Walter wrote: > On Mon, Feb 27, 2006 at 01:22:54PM -0700, Kenneth D. Merry wrote: > > On Mon, Feb 27, 2006 at 21:16:45 +0100, Bernd Walter wrote: > > > It seems that FreeBSD doesn't start disks anymore. > > > > That's strange, I don't think anything has changed in that area recently. > > I don't think this happened recently. > It is a new machine, but I already noticed several months back that I > can't camcontrol stop a mounted drives anymore without getting problems > on access later. > > > > Disks which delayed start won't get probed by GEOM when they are not > > > ready when GEOM tries - at least one can delay booting in this case. > > > Disks which don't startup unless told never get working - I currently > > > start them manually in rc-scripts and tell GEOM to reprobe, but this > > > is not always an option, e.g. in case of / drive. > > > All in all this is very annoying since I have not much options about > > > changing the disk spin-up policy. > > > > What error code do your disks return? You will probably see some console > > output if GEOM has tried to read metadata off the disk and that initial > > read fails. > > > > If the drive returns 0x04,0x02 ("Logical unit not ready, initializing cmd. > > required"), CAM will attempt to spin the disk up automatically and retry > > the command. > > During the first tests I waited 90s in loader to let all delayed spin > up drives spin up. > This is with recent RELENG_6 and a drive which don't spin up themself: > [...] > da7 at esp1 bus 0 target 10 lun 0 > da7: Fixed Direct Access SCSI-3 device > da7: 20.000MB/s transfers (10.000MHz, offset 15, 16bit), Tagged Queueing Enabled > da7: Attempt to query device size failed: NOT READY, Logical unit not ready, initial That's rather odd, since it looks like you've got an 0x04,0x02 response, but the device must have rejected the start unit command if we failed to get capacity information. > [...] > No GEOM message about this driver until rc sends a start command and > GEOM is retriggered to reread the drive: > Unit started successfully > GEOM_LABEL: Label for provider da7 is ufs/dump1. > The following commands were used in rc: > camcontrol start -n da -u 7 > cat /dev/null > /dev/da7 > > Without the loader delay other disks are having problems as well: > da9 at esp1 bus 0 target 14 lun 0 > da9: Fixed Direct Access SCSI-3 device > da9: 20.000MB/s transfers (10.000MHz, offset 15, 16bit), Tagged Queueing Enabled > da9: Attempt to query device size failed: NOT READY, Logical unit is in process of b > That's a different error. We won't send a start unit in that case. The error recovery action for 0x04,0x01 is to send a test unit ready every half second for a minute until the device becomes ready. Evidently it didn't become ready after that period of time. > On Shell: > [30]cicely19# dd if=/dev/da7 bs=1k count=1 of=/dev/null > 1+0 records in > 1+0 records out > 1024 bytes transferred in 0.008765 secs (116829 bytes/sec) > [31]cicely19# camcontrol stop -n da -u 7 > Unit stopped successfully > [32]cicely19# dd if=/dev/da7 bs=1k count=1 of=/dev/null > dd: /dev/da7: Input/output error > 0+0 records in > 0+0 records out > 0 bytes transferred in 0.004810 secs (0 bytes/sec) > Exit 1 What errors do you see on the console at that point? In order for CAM to automatically spin up the disk, it needs to send back 0x04,0x02 when it is spun down, and it needs to actually spin up the disk in response to a start unit. What happens when you: camcontrol stop da7 camcontrol tur da7 -v camcontrol start da7 -v Ken -- Kenneth Merry ken@FreeBSD.ORG From owner-freebsd-scsi@FreeBSD.ORG Tue Feb 28 16:26:57 2006 Return-Path: X-Original-To: freebsd-scsi@freebsd.org Delivered-To: freebsd-scsi@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 9162116A420; Tue, 28 Feb 2006 16:26:57 +0000 (GMT) (envelope-from ticso@cicely12.cicely.de) Received: from ant.bwct.de (ant.bwct.de [85.159.14.68]) by mx1.FreeBSD.org (Postfix) with ESMTP id C9E6943D46; Tue, 28 Feb 2006 16:26:56 +0000 (GMT) (envelope-from ticso@cicely12.cicely.de) Received: from cicely5.cicely.de ([10.1.1.7]) by ant.bwct.de (8.12.11/8.12.11) with ESMTP id k1SGQsJX006110; Tue, 28 Feb 2006 17:26:54 +0100 (CET) Received: from cicely12.cicely.de (cicely12.cicely.de [10.1.1.14]) by cicely5.cicely.de (8.13.4/8.13.4) with ESMTP id k1SGQmU9046310 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Tue, 28 Feb 2006 17:26:49 +0100 (CET) (envelope-from ticso@cicely12.cicely.de) Received: from cicely12.cicely.de (localhost [127.0.0.1]) by cicely12.cicely.de (8.13.4/8.13.3) with ESMTP id k1SGQm07071202; Tue, 28 Feb 2006 17:26:48 +0100 (CET) (envelope-from ticso@cicely12.cicely.de) Received: (from ticso@localhost) by cicely12.cicely.de (8.13.4/8.13.3/Submit) id k1SGQmUB071201; Tue, 28 Feb 2006 17:26:48 +0100 (CET) (envelope-from ticso) Date: Tue, 28 Feb 2006 17:26:47 +0100 From: Bernd Walter To: "Kenneth D. Merry" Message-ID: <20060228162647.GZ64548@cicely12.cicely.de> References: <20060227201644.GR64548@cicely12.cicely.de> <20060227202254.GA1016@nargothrond.kdm.org> <20060227204326.GS64548@cicely12.cicely.de> <20060228161004.GA9002@nargothrond.kdm.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20060228161004.GA9002@nargothrond.kdm.org> X-Operating-System: FreeBSD cicely12.cicely.de 5.4-STABLE alpha User-Agent: Mutt/1.5.9i X-Spam-Status: No, score=-5.9 required=5.0 tests=ALL_TRUSTED,BAYES_00 autolearn=ham version=3.0.4 X-Spam-Report: * -3.3 ALL_TRUSTED Did not pass through any untrusted hosts * -2.6 BAYES_00 BODY: Bayesian spam probability is 0 to 1% * [score: 0.0000] X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on cicely12.cicely.de Cc: Bernd Walter , freebsd-scsi@freebsd.org, ticso@cicely.de Subject: Re: Automatic unit start broken? X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: ticso@cicely.de List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Feb 2006 16:26:57 -0000 On Tue, Feb 28, 2006 at 09:10:04AM -0700, Kenneth D. Merry wrote: > On Mon, Feb 27, 2006 at 21:43:27 +0100, Bernd Walter wrote: > > On Mon, Feb 27, 2006 at 01:22:54PM -0700, Kenneth D. Merry wrote: > > > On Mon, Feb 27, 2006 at 21:16:45 +0100, Bernd Walter wrote: > > > What error code do your disks return? You will probably see some console > > > output if GEOM has tried to read metadata off the disk and that initial > > > read fails. > > > > > > If the drive returns 0x04,0x02 ("Logical unit not ready, initializing cmd. > > > required"), CAM will attempt to spin the disk up automatically and retry > > > the command. > > > > During the first tests I waited 90s in loader to let all delayed spin > > up drives spin up. > > This is with recent RELENG_6 and a drive which don't spin up themself: > > [...] > > da7 at esp1 bus 0 target 10 lun 0 > > da7: Fixed Direct Access SCSI-3 device > > da7: 20.000MB/s transfers (10.000MHz, offset 15, 16bit), Tagged Queueing Enabled > > da7: Attempt to query device size failed: NOT READY, Logical unit not ready, initial > > That's rather odd, since it looks like you've got an 0x04,0x02 response, > but the device must have rejected the start unit command if we failed to > get capacity information. At least the drive won't fail a start unit when done via camcontrol. > > [...] > > No GEOM message about this driver until rc sends a start command and > > GEOM is retriggered to reread the drive: > > Unit started successfully > > GEOM_LABEL: Label for provider da7 is ufs/dump1. > > The following commands were used in rc: > > camcontrol start -n da -u 7 > > cat /dev/null > /dev/da7 > > > > Without the loader delay other disks are having problems as well: > > da9 at esp1 bus 0 target 14 lun 0 > > da9: Fixed Direct Access SCSI-3 device > > da9: 20.000MB/s transfers (10.000MHz, offset 15, 16bit), Tagged Queueing Enabled > > da9: Attempt to query device size failed: NOT READY, Logical unit is in process of b > > > > That's a different error. We won't send a start unit in that case. The > error recovery action for 0x04,0x01 is to send a test unit ready every half > second for a minute until the device becomes ready. > Evidently it didn't become ready after that period of time. Possible that this works, but a minute is hardly enough for a drive with ID 14 - considered 6s per ID this means the given drive requires 84s after power-up. But I doubt that the kernel waits - I should have noticed waiting a whole minute. Where is the minute defined? If it is not solved by raising the wait to 120s it likely won't work. > > On Shell: > > [30]cicely19# dd if=/dev/da7 bs=1k count=1 of=/dev/null > > 1+0 records in > > 1+0 records out > > 1024 bytes transferred in 0.008765 secs (116829 bytes/sec) > > [31]cicely19# camcontrol stop -n da -u 7 > > Unit stopped successfully > > [32]cicely19# dd if=/dev/da7 bs=1k count=1 of=/dev/null > > dd: /dev/da7: Input/output error > > 0+0 records in > > 0+0 records out > > 0 bytes transferred in 0.004810 secs (0 bytes/sec) > > Exit 1 > > What errors do you see on the console at that point? In order for CAM to > automatically spin up the disk, it needs to send back 0x04,0x02 when it is > spun down, and it needs to actually spin up the disk in response to a start > unit. I don't see anything on console. > What happens when you: > > camcontrol stop da7 > camcontrol tur da7 -v > camcontrol start da7 -v [52]raven# camcontrol stop da7 Unit stopped successfully [53]raven# camcontrol tur da7 -v Unit is not ready (pass8:esp1:0:10:0): TEST UNIT READY. CDB: 0 0 0 0 0 0 (pass8:esp1:0:10:0): CAM Status: CCB request is in progress Exit 1 [54]raven# camcontrol start da7 -v Unit started successfully -- B.Walter BWCT http://www.bwct.de bernd@bwct.de info@bwct.de From owner-freebsd-scsi@FreeBSD.ORG Tue Feb 28 16:55:24 2006 Return-Path: X-Original-To: freebsd-scsi@freebsd.org Delivered-To: freebsd-scsi@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 328EC16A458 for ; Tue, 28 Feb 2006 16:55:24 +0000 (GMT) (envelope-from ken@nargothrond.kdm.org) Received: from nargothrond.kdm.org (nargothrond.kdm.org [70.56.43.81]) by mx1.FreeBSD.org (Postfix) with ESMTP id AE01243D45 for ; Tue, 28 Feb 2006 16:55:23 +0000 (GMT) (envelope-from ken@nargothrond.kdm.org) Received: from nargothrond.kdm.org (localhost [127.0.0.1]) by nargothrond.kdm.org (8.13.4/8.12.11) with ESMTP id k1SGtLCR009365; Tue, 28 Feb 2006 09:55:21 -0700 (MST) (envelope-from ken@nargothrond.kdm.org) Received: (from ken@localhost) by nargothrond.kdm.org (8.13.4/8.12.5/Submit) id k1SGtLqL009364; Tue, 28 Feb 2006 09:55:21 -0700 (MST) (envelope-from ken) Date: Tue, 28 Feb 2006 09:55:21 -0700 From: "Kenneth D. Merry" To: ticso@cicely.de Message-ID: <20060228165521.GA9261@nargothrond.kdm.org> References: <20060227201644.GR64548@cicely12.cicely.de> <20060227202254.GA1016@nargothrond.kdm.org> <20060227204326.GS64548@cicely12.cicely.de> <20060228161004.GA9002@nargothrond.kdm.org> <20060228162647.GZ64548@cicely12.cicely.de> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20060228162647.GZ64548@cicely12.cicely.de> User-Agent: Mutt/1.4.2i X-Virus-Scanned: ClamAV 0.87.1/1306/Tue Feb 28 02:50:04 2006 on nargothrond.kdm.org X-Virus-Status: Clean Cc: Bernd Walter , freebsd-scsi@freebsd.org Subject: Re: Automatic unit start broken? X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Feb 2006 16:55:24 -0000 On Tue, Feb 28, 2006 at 17:26:47 +0100, Bernd Walter wrote: > On Tue, Feb 28, 2006 at 09:10:04AM -0700, Kenneth D. Merry wrote: > > On Mon, Feb 27, 2006 at 21:43:27 +0100, Bernd Walter wrote: > > > On Mon, Feb 27, 2006 at 01:22:54PM -0700, Kenneth D. Merry wrote: > > > > On Mon, Feb 27, 2006 at 21:16:45 +0100, Bernd Walter wrote: > > > > What error code do your disks return? You will probably see some console > > > > output if GEOM has tried to read metadata off the disk and that initial > > > > read fails. > > > > > > > > If the drive returns 0x04,0x02 ("Logical unit not ready, initializing cmd. > > > > required"), CAM will attempt to spin the disk up automatically and retry > > > > the command. > > > > > > During the first tests I waited 90s in loader to let all delayed spin > > > up drives spin up. > > > This is with recent RELENG_6 and a drive which don't spin up themself: > > > [...] > > > da7 at esp1 bus 0 target 10 lun 0 > > > da7: Fixed Direct Access SCSI-3 device > > > da7: 20.000MB/s transfers (10.000MHz, offset 15, 16bit), Tagged Queueing Enabled > > > da7: Attempt to query device size failed: NOT READY, Logical unit not ready, initial > > > > That's rather odd, since it looks like you've got an 0x04,0x02 response, > > but the device must have rejected the start unit command if we failed to > > get capacity information. > > At least the drive won't fail a start unit when done via camcontrol. That's good. > > > [...] > > > No GEOM message about this driver until rc sends a start command and > > > GEOM is retriggered to reread the drive: > > > Unit started successfully > > > GEOM_LABEL: Label for provider da7 is ufs/dump1. > > > The following commands were used in rc: > > > camcontrol start -n da -u 7 > > > cat /dev/null > /dev/da7 > > > > > > Without the loader delay other disks are having problems as well: > > > da9 at esp1 bus 0 target 14 lun 0 > > > da9: Fixed Direct Access SCSI-3 device > > > da9: 20.000MB/s transfers (10.000MHz, offset 15, 16bit), Tagged Queueing Enabled > > > da9: Attempt to query device size failed: NOT READY, Logical unit is in process of b > > > > > > > That's a different error. We won't send a start unit in that case. The > > error recovery action for 0x04,0x01 is to send a test unit ready every half > > second for a minute until the device becomes ready. > > Evidently it didn't become ready after that period of time. > > Possible that this works, but a minute is hardly enough for a drive > with ID 14 - considered 6s per ID this means the given drive requires > 84s after power-up. > But I doubt that the kernel waits - I should have noticed waiting a > whole minute. > Where is the minute defined? > If it is not solved by raising the wait to 120s it likely won't work. Look in cam_periph.c, in camperiphscsisenseerror(), in the SS_TUR/SSQ_MANY case. Increase the retry count to 240 and you'll get up to 240 test unit ready commands sent every half second. But, I think you may be right that the kernel may not be waiting. See below. I suspect the driver is broken. > > > On Shell: > > > [30]cicely19# dd if=/dev/da7 bs=1k count=1 of=/dev/null > > > 1+0 records in > > > 1+0 records out > > > 1024 bytes transferred in 0.008765 secs (116829 bytes/sec) > > > [31]cicely19# camcontrol stop -n da -u 7 > > > Unit stopped successfully > > > [32]cicely19# dd if=/dev/da7 bs=1k count=1 of=/dev/null > > > dd: /dev/da7: Input/output error > > > 0+0 records in > > > 0+0 records out > > > 0 bytes transferred in 0.004810 secs (0 bytes/sec) > > > Exit 1 > > > > What errors do you see on the console at that point? In order for CAM to > > automatically spin up the disk, it needs to send back 0x04,0x02 when it is > > spun down, and it needs to actually spin up the disk in response to a start > > unit. > > I don't see anything on console. That's strange. > > What happens when you: > > > > camcontrol stop da7 > > camcontrol tur da7 -v > > camcontrol start da7 -v > > [52]raven# camcontrol stop da7 > Unit stopped successfully > [53]raven# camcontrol tur da7 -v > Unit is not ready > (pass8:esp1:0:10:0): TEST UNIT READY. CDB: 0 0 0 0 0 0 > (pass8:esp1:0:10:0): CAM Status: CCB request is in progress > Exit 1 Okay, that's wrong. The CCB status is never set properly, even though the command was completed. It looks like the driver may be broken. It should set the CAM status to CAM_SCSI_STATUS_ERROR in this case, but there is no place in the driver (that I can see) where it ever sets that status. > [54]raven# camcontrol start da7 -v > Unit started successfully Ken -- Kenneth Merry ken@FreeBSD.ORG From owner-freebsd-scsi@FreeBSD.ORG Tue Feb 28 17:09:49 2006 Return-Path: X-Original-To: freebsd-scsi@freebsd.org Delivered-To: freebsd-scsi@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id A3ADD16A420; Tue, 28 Feb 2006 17:09:49 +0000 (GMT) (envelope-from scottl@samsco.org) Received: from pooker.samsco.org (pooker.samsco.org [168.103.85.57]) by mx1.FreeBSD.org (Postfix) with ESMTP id 2512043D53; Tue, 28 Feb 2006 17:09:49 +0000 (GMT) (envelope-from scottl@samsco.org) Received: from [10.10.3.185] ([69.15.205.254]) (authenticated bits=0) by pooker.samsco.org (8.13.4/8.13.4) with ESMTP id k1SH9dX8056077; Tue, 28 Feb 2006 10:09:41 -0700 (MST) (envelope-from scottl@samsco.org) Message-ID: <440483CC.5080800@samsco.org> Date: Tue, 28 Feb 2006 10:09:32 -0700 From: Scott Long User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; en-US; rv:1.7.12) Gecko/20060206 X-Accept-Language: en-us, en MIME-Version: 1.0 To: "Kenneth D. Merry" References: <20060227201644.GR64548@cicely12.cicely.de> <20060227202254.GA1016@nargothrond.kdm.org> <20060227204326.GS64548@cicely12.cicely.de> <20060228161004.GA9002@nargothrond.kdm.org> <20060228162647.GZ64548@cicely12.cicely.de> <20060228165521.GA9261@nargothrond.kdm.org> In-Reply-To: <20060228165521.GA9261@nargothrond.kdm.org> Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=0.0 required=3.8 tests=none autolearn=failed version=3.1.0 X-Spam-Checker-Version: SpamAssassin 3.1.0 (2005-09-13) on pooker.samsco.org Cc: Bernd Walter , freebsd-scsi@freebsd.org, ticso@cicely.de Subject: Re: Automatic unit start broken? X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Feb 2006 17:09:49 -0000 Kenneth D. Merry wrote: > >>>What happens when you: >>> >>>camcontrol stop da7 >>>camcontrol tur da7 -v >>>camcontrol start da7 -v >> >>[52]raven# camcontrol stop da7 >>Unit stopped successfully >>[53]raven# camcontrol tur da7 -v >>Unit is not ready >>(pass8:esp1:0:10:0): TEST UNIT READY. CDB: 0 0 0 0 0 0 >>(pass8:esp1:0:10:0): CAM Status: CCB request is in progress >>Exit 1 > > > Okay, that's wrong. The CCB status is never set properly, even though the > command was completed. > > It looks like the driver may be broken. It should set the CAM status to > CAM_SCSI_STATUS_ERROR in this case, but there is no place in the driver > (that I can see) where it ever sets that status. > > >>[54]raven# camcontrol start da7 -v >>Unit started successfully > > > Ken Oops, that's my fault. Not sure when I'll be able to look it, though. Scott From owner-freebsd-scsi@FreeBSD.ORG Tue Feb 28 17:44:35 2006 Return-Path: X-Original-To: freebsd-scsi@freebsd.org Delivered-To: freebsd-scsi@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id D2F7F16A420 for ; Tue, 28 Feb 2006 17:44:35 +0000 (GMT) (envelope-from jhb@freebsd.org) Received: from server.baldwin.cx (66-23-211-162.clients.speedfactory.net [66.23.211.162]) by mx1.FreeBSD.org (Postfix) with ESMTP id 5218943D46 for ; Tue, 28 Feb 2006 17:44:35 +0000 (GMT) (envelope-from jhb@freebsd.org) Received: from localhost (john@localhost [127.0.0.1]) by server.baldwin.cx (8.13.4/8.13.4) with ESMTP id k1SHiWPq018550; Tue, 28 Feb 2006 12:44:33 -0500 (EST) (envelope-from jhb@freebsd.org) From: John Baldwin To: Oleg Sharoiko Date: Tue, 28 Feb 2006 12:05:41 -0500 User-Agent: KMail/1.9.1 References: <20060215102749.D58480@brain.cc.rsu.ru> <43F38E74.6020705@samsco.org> <20060226115730.K774@brain.cc.rsu.ru> In-Reply-To: <20060226115730.K774@brain.cc.rsu.ru> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200602281205.43592.jhb@freebsd.org> X-Virus-Scanned: ClamAV 0.87.1/1306/Tue Feb 28 04:50:04 2006 on server.baldwin.cx X-Virus-Status: Clean X-Spam-Status: No, score=-1.4 required=4.2 tests=ALL_TRUSTED autolearn=ham version=3.1.0 X-Spam-Checker-Version: SpamAssassin 3.1.0 (2005-09-13) on server.baldwin.cx Cc: freebsd-scsi@freebsd.org, Andrey Beresovsky Subject: Re: Boot hangs on ips0: resetting adapter, this may take up to 5 minutes X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Feb 2006 17:44:36 -0000 On Sunday 26 February 2006 03:59, Oleg Sharoiko wrote: > > On Wed, 15 Feb 2006, Scott Long wrote: > > SL>This sounds like an interrupt routing problem. The symptoms are similar to > SL>others where APIC-routed interrupts don't seem to make it to the active CPUs, > SL>depending on whether SMP or HTT is enabled or disabled. Maybe John has some > SL>insight here. > > So is interrupt routing a hardware or a software issue? Taking into > account that windows 2003 server works fine with ips I'd say that our > particular case is not a hardware issue. If so could you suggest peaces of > code should we look at to try solve this problem? You can try a patch I have for current (it will probably apply to 6.x with minimal problems): http://www.freebsd.org/~jhb/patches/irq_shuffle.patch -- John Baldwin <>< http://www.FreeBSD.org/~jhb/ "Power Users Use the Power to Serve" = http://www.FreeBSD.org From owner-freebsd-scsi@FreeBSD.ORG Tue Feb 28 23:23:21 2006 Return-Path: X-Original-To: freebsd-scsi@freebsd.org Delivered-To: freebsd-scsi@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id DBB0516A420 for ; Tue, 28 Feb 2006 23:23:21 +0000 (GMT) (envelope-from joao.barros@gmail.com) Received: from xproxy.gmail.com (xproxy.gmail.com [66.249.82.204]) by mx1.FreeBSD.org (Postfix) with ESMTP id 6762543D48 for ; Tue, 28 Feb 2006 23:23:21 +0000 (GMT) (envelope-from joao.barros@gmail.com) Received: by xproxy.gmail.com with SMTP id t14so817474wxc for ; Tue, 28 Feb 2006 15:23:20 -0800 (PST) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=KXGx6DqCIq9w4MJC7M+VZwKcycssA4KZOjXsYu5oztuZZzn+Yk9/MFQN7TViVRHzfMfb/K8nlLaWjPn0JSwdD9DRBS3Ux5euqNF2tA89esePS7m08CcE2u+ZcLVdBA6cA3PN4WUnbguF63eGet8tcaa6vYIZMo3unPeOhg2ekTw= Received: by 10.70.21.1 with SMTP id 1mr1125350wxu; Tue, 28 Feb 2006 15:23:20 -0800 (PST) Received: by 10.70.9.9 with HTTP; Tue, 28 Feb 2006 15:23:20 -0800 (PST) Message-ID: <70e8236f0602281523j642b242dp714483e9a9bf0c03@mail.gmail.com> Date: Tue, 28 Feb 2006 23:23:20 +0000 From: "Joao Barros" To: "Massimo Lusetti" In-Reply-To: <1141115725.4304.6.camel@massimo.datacode.it> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Content-Disposition: inline References: <200602241645.36042.jkim@FreeBSD.org> <44009A66.1040804@samsco.org> <200602271223.20959.jkim@FreeBSD.org> <1141115725.4304.6.camel@massimo.datacode.it> Cc: freebsd-scsi@freebsd.org Subject: Re: A tiny amr(4) monitoring tool X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Feb 2006 23:23:22 -0000 On 2/28/06, Massimo Lusetti wrote: > On Mon, 2006-02-27 at 12:23 -0500, Jung-uk Kim wrote: > > > > I'm working on a similar tool for IPS. > > > > Awesome. > > > > BTW, OpenBSD has bioctl(8) to manage RAID controllers: > > > > http://www.openbsd.org/cgi-bin/man.cgi?query=3Dbioctl&apropos=3D0&sekti= on=3D0&manpath=3DOpenBSD+Current&arch=3Di386&format=3Dhtml > > > > It would be nice to have such an API for us too. :-) > > Yes, definitely. > > Is [1] gone any further? > > > Regards > > > [1] > http://marc.theaimsgroup.com/?l=3Dfreebsd-current&m=3D112714583705861&w= =3D2 I've got the pseudo driver and the userland tool part done(1) and I'm messing up the amr driver now. After amr I'm going to start on ciss as I still have a machine available to play with. I'm a little time restrained but it's going :) (1) pending testing with a finished driver -- Joao Barros From owner-freebsd-scsi@FreeBSD.ORG Wed Mar 1 08:51:20 2006 Return-Path: X-Original-To: freebsd-scsi@freebsd.org Delivered-To: freebsd-scsi@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 9308516A420 for ; Wed, 1 Mar 2006 08:51:20 +0000 (GMT) (envelope-from massimo@cedoc.mo.it) Received: from insomma.datacode.it (ip-174-86.sn2.eutelia.it [83.211.174.86]) by mx1.FreeBSD.org (Postfix) with ESMTP id 059BF43D46 for ; Wed, 1 Mar 2006 08:51:19 +0000 (GMT) (envelope-from massimo@cedoc.mo.it) Received: from localhost (localhost.datacode.it [127.0.0.1]) by insomma.datacode.it (Postfix) with SMTP id C2C272C90B for ; Wed, 1 Mar 2006 09:51:16 +0100 (CET) Received: from insomma.datacode.it (localhost.datacode.it [127.0.0.1]) by insomma.datacode.it (Postfix) with ESMTP id 07EE12C90A; Wed, 1 Mar 2006 09:51:16 +0100 (CET) Received: from massimo.datacode.it (massimo.datacode.it [192.168.1.13]) by insomma.datacode.it (Postfix) with ESMTP id BCC452C906; Wed, 1 Mar 2006 09:51:15 +0100 (CET) From: Massimo Lusetti To: Joao Barros In-Reply-To: <70e8236f0602281523j642b242dp714483e9a9bf0c03@mail.gmail.com> References: <200602241645.36042.jkim@FreeBSD.org> <44009A66.1040804@samsco.org> <200602271223.20959.jkim@FreeBSD.org> <1141115725.4304.6.camel@massimo.datacode.it> <70e8236f0602281523j642b242dp714483e9a9bf0c03@mail.gmail.com> Content-Type: text/plain Organization: CEDOC - Modena Date: Wed, 01 Mar 2006 09:51:15 +0100 Message-Id: <1141203075.4322.2.camel@massimo.datacode.it> Mime-Version: 1.0 X-Mailer: Evolution 2.0.4 (2.0.4-7) Content-Transfer-Encoding: 7bit X-Virus-Scanned: ClamAV using ClamSMTP Cc: freebsd-scsi@freebsd.org Subject: Re: A tiny amr(4) monitoring tool X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 01 Mar 2006 08:51:20 -0000 On Tue, 2006-02-28 at 23:23 +0000, Joao Barros wrote: > I'm a little time restrained but it's going :) Thanks, that's good to hear! Ciao -- Massimo.run(); From owner-freebsd-scsi@FreeBSD.ORG Thu Mar 2 02:27:33 2006 Return-Path: X-Original-To: freebsd-scsi@freebsd.org Delivered-To: freebsd-scsi@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 8DBCD16A420 for ; Thu, 2 Mar 2006 02:27:33 +0000 (GMT) (envelope-from rrios2000@yahoo.com) Received: from web53513.mail.yahoo.com (web53513.mail.yahoo.com [206.190.39.67]) by mx1.FreeBSD.org (Postfix) with SMTP id 23BA243D49 for ; Thu, 2 Mar 2006 02:27:31 +0000 (GMT) (envelope-from rrios2000@yahoo.com) Received: (qmail 22133 invoked by uid 60001); 2 Mar 2006 02:27:31 -0000 DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=Message-ID:Received:Date:From:Subject:To:MIME-Version:Content-Type:Content-Transfer-Encoding; b=cGiA110f9nYF68mpFV/mo4nRDHxyggdJU6tBrLbVH2mdyO/93PQNPslDRUdeMc/pmRg/g6dO+pIt1VBYXcPl040t0M633X2LmhrMndQmf3jC+B6IURfdXluswkrfgFXwvXlnuJG8kdzE30OEdDSJvsBuZuyvX6uE6ehqNhuIqCc= ; Message-ID: <20060302022731.22131.qmail@web53513.mail.yahoo.com> Received: from [201.130.192.94] by web53513.mail.yahoo.com via HTTP; Wed, 01 Mar 2006 18:27:31 PST Date: Wed, 1 Mar 2006 18:27:31 -0800 (PST) From: Roberto Rios To: freebsd-scsi@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: 8bit Subject: Dell SC 1425 SCSI Problem X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 02 Mar 2006 02:27:33 -0000 Hi, I have a new dell poweredge sc 1425 where I install 6.0 Release, after booting every 5 min aprox I get the following message and the system freeze for 1 min aprox, any idea? ---------- Hardware: Waiting 5 seconds for SCSI devices to settle acd0: DVDROM at ata0-master UDMA33 da0 at ahd0 bus 0 target 0 lun 0 da0: Fixed Direct Access SCSI-3 device da0: 320.000MB/s transfers (160.000MHz, offset 63, 16bit), Tagged Queueing Enabled da0: 140014MB (286749480 512 byte sectors: 255H 63S/T 17849C) ---------- Message: >>>>>>>>>>>>>>>>>> Dump Card State Begins <<<<<<<<<<<<<<<<< ahd0: Dumping Card State at program address 0x81 Mode 0x22 INTSTAT[0x0] SELOID[0x0] SELID[0x0] HS_MAILBOX[0x0] INTCTL[0x80]:(SWTMINTMASK) SEQINTSTAT[0x0] SAVED_MODE[0x11] DFFSTAT[0x33]:(CURRFIFO_NONE|FIFO0FREE|FIFO1FREE) SCSISIGI[0x27]:(P_DATAOUT_DT|ACKI|REQI|BSYI) SCSIPHASE[0x0] SCSIBUS[0x30] LASTPHASE[0x1]:(P_DATAOUT|P_BUSFREE) SCSISEQ0[0x40]:(ENSELO) SCSISEQ1[0x12]:(ENAUTOATNP|ENRSELI) SEQCTL0[0x0] SEQINTCTL[0x0] SEQ_FLAGS[0x0] SEQ_FLAGS2[0x0] QFREEZE_COUNT[0x1] KERNEL_QFREEZE_COUNT[0x1] MK_MESSAGE_SCB[0xff00] MK_MESSAGE_SCSIID[0xff] SSTAT0[0x10]:(SELINGO) SSTAT1[0x8]:(BUSFREE) SSTAT2[0x0] SSTAT3[0x0] PERRDIAG[0x0] SIMODE1[0xa4]:(ENSCSIPERR|ENSCSIRST|ENSELTIMO) LQISTAT0[0x0] LQISTAT1[0x0] LQISTAT2[0x80]:(PACKETIZED) LQOSTAT0[0x0] LQOSTAT1[0x0] LQOSTAT2[0xc0] SCB Count = 128 CMDS_PENDING = 117 LASTSCB 0x43 CURRSCB 0x42 NEXTSCB 0x41 qinstart = 9270 qinfifonext = 9270 QINFIFO: WAITING_TID_QUEUES: 0 ( 0xc 0x1c 0x2e 0x13 0x9 0x15 0x24 0x10 0x26 0x2f 0x14 0x31 0x12 0x2c 0x3b 0x0 0x34 0x25 0xd 0x18 0xf 0x37 0x3e 0x38 0x11 0x20 0x2d 0x5 0x2b 0xa 0x33 0x19 0x3c 0xb 0x2 0x23 0x8 0x1b 0x3a 0x1f 0x17 0x1a 0x6 0x3 0x27 0x1e 0x4e 0x1 0x2a 0x1d 0x22 0x3d 0x3f 0x21 0x32 0x4f 0x39 0x7 0x30 0xe 0x35 0x36 0x28 0x16 0x29 0x4 0x4d 0x4c 0x4b 0x4a 0x49 0x48 0x47 0x46 0x45 0x44 0x43 0x42 0x41 0x40 0x5f 0x5e 0x5d 0x5c 0x5b 0x5a 0x59 0x58 0x57 0x56 0x55 0x54 0x53 0x52 0x51 0x50 0x6f 0x6e 0x6d 0x6c 0x6b 0x6a 0x69 0x68 0x67 0x66 0x65 0x64 0x63 0x62 0x61 0x60 0x7f 0x7e 0x7d 0x7c 0x7b ) Pending list: 123 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 124 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 125 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 126 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 127 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 96 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 97 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 98 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 99 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 100 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 101 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 102 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 103 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 104 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 105 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 106 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 107 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 108 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 109 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 110 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 111 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 80 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 81 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 82 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 83 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 84 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 85 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 86 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 87 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 88 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 89 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 90 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 91 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 92 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 93 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 94 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 95 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 64 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 65 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 66 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 67 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 68 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 69 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 70 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 71 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 72 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 73 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 74 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 75 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 76 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 77 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 4 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 41 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 22 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 40 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 54 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 53 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 14 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 48 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 7 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 57 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 79 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 50 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 33 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 63 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 61 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 34 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 29 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 42 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 1 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 78 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 30 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 39 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 3 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 6 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 26 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 23 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 31 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 58 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 27 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 8 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 35 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 2 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 11 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 60 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 25 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 51 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 10 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 43 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 5 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 45 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 32 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 17 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 56 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 62 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 55 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 15 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 24 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 13 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 37 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 52 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 0 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 59 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 44 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 18 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 49 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 20 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 47 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 38 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 16 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 36 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 21 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 9 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 19 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 46 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 28 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] 12 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x7] Total 117 Kernel Free SCB list: 122 121 120 119 118 117 116 115 114 113 112 Sequencer Complete DMA-inprog list: Sequencer Complete list: Sequencer DMA-Up and Complete list: Sequencer On QFreeze and Complete list: ahd0: FIFO0 Free, LONGJMP == 0x8276, SCB 0xc SEQIMODE[0x3f]:(ENCFG4TCMD|ENCFG4ICMD|ENCFG4TSTAT|ENCFG4ISTAT|ENCFG4DATA|ENSAVEPTRS) SEQINTSRC[0x0] DFCNTRL[0x4]:(DIRECTION) DFSTATUS[0x89]:(FIFOEMP|HDONE|PRELOAD_AVAIL) SG_CACHE_SHADOW[0x2]:(LAST_SEG) SG_STATE[0x0] DFFSXFRCTL[0x0] SOFFCNT[0x0] MDFFSTAT[0x5]:(FIFOFREE|DLZERO) SHADDR = 0x00, SHCNT = 0x0 HADDR = 0x00, HCNT = 0x0 CCSGCTL[0x10]:(SG_CACHE_AVAIL) ahd0: FIFO1 Free, LONGJMP == 0x8063, SCB 0xf SEQIMODE[0x3f]:(ENCFG4TCMD|ENCFG4ICMD|ENCFG4TSTAT|ENCFG4ISTAT|ENCFG4DATA|ENSAVEPTRS) SEQINTSRC[0x0] DFCNTRL[0x0] DFSTATUS[0x89]:(FIFOEMP|HDONE|PRELOAD_AVAIL) SG_CACHE_SHADOW[0x2]:(LAST_SEG) SG_STATE[0x0] DFFSXFRCTL[0x0] SOFFCNT[0x0] MDFFSTAT[0x5]:(FIFOFREE|DLZERO) SHADDR = 0x00, SHCNT = 0x0 HADDR = 0x00, HCNT = 0x0 CCSGCTL[0x10]:(SG_CACHE_AVAIL) LQIN: 0x8 0x0 0x0 0xc 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 ahd0: LQISTATE = 0x1, LQOSTATE = 0x19, OPTIONMODE = 0x42 ahd0: OS_SPACE_CNT = 0x1f MAXCMDCNT = 0x4d ahd0: SAVED_SCSIID = 0x0 SAVED_LUN = 0x0 SIMODE0[0xc]:(ENOVERRUN|ENIOERR) CCSCBCTL[0x4]:(CCSCBDIR) ahd0: REG0 == 0x7b, SINDEX = 0x102, DINDEX = 0x102 ahd0: SCBPTR == 0x7c, SCB_NEXT == 0x7b, SCB_NEXT2 == 0xff07 CDB 2a 0 e d9 88 df STACK: 0x24 0x0 0x0 0x0 0x0 0x0 0x0 0x0 <<<<<<<<<<<<<<<<< Dump Card State Ends >>>>>>>>>>>>>>>>>> (da0:ahd0:0:0:0): SCB 93 - timed out (da0:ahd0:0:0:0): Other SCB Timeout (da0:ahd0:0:0:0): No other SCB worth waiting for... ahd0: Issued Channel A Bus Reset. 117 SCBs aborted Copied 18 bytes of sense data offset 12: 0x70 0x0 0x6 0x0 0x0 0x0 0x0 0xa 0x0 0x0 0x0 0x0 0x29 0x2 0x2 0x0 0x0 0x0 (da0:ahd0:0:0:0): WRITE(10). CDB: 2a 0 0 40 0 ff 0 0 20 0 (da0:ahd0:0:0:0): CAM Status: SCSI Status Error (da0:ahd0:0:0:0): SCSI Status: Check Condition (da0:ahd0:0:0:0): UNIT ATTENTION asc:29,2 (da0:ahd0:0:0:0): Scsi bus reset occurred field replaceable unit: 2 (da0:ahd0:0:0:0): Retrying Command (per Sense Data) Regards RRV __________________________________________________ Do You Yahoo!? Tired of spam? Yahoo! Mail has the best spam protection around http://mail.yahoo.com From owner-freebsd-scsi@FreeBSD.ORG Fri Mar 3 03:23:48 2006 Return-Path: X-Original-To: freebsd-scsi@freebsd.org Delivered-To: freebsd-scsi@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id C70B016A420 for ; Fri, 3 Mar 2006 03:23:48 +0000 (GMT) (envelope-from fnreyavk@wyoming-bank.com) Received: from ZE195023.ppp.dion.ne.jp (ZE195023.ppp.dion.ne.jp [220.217.195.23]) by mx1.FreeBSD.org (Postfix) with SMTP id 0343D43D46 for ; Fri, 3 Mar 2006 03:23:44 +0000 (GMT) (envelope-from fnreyavk@wyoming-bank.com) Received: from [220.217.153.142] (port=3117 helo=oyvmh) by ZE195023.ppp.dion.ne.jp with esmtp id 1FF0ZJ-0007LO-RO for freebsd-scsi@freebsd.org; Fri, 3 Mar 2006 12:03:01 +0900 Message-ID: <000c01c63e6e$e10ce0a3$8e99d9dc@oyvmh> From: "Baldwin Molina" To: Date: Fri, 3 Mar 2006 11:56:59 +0900 MIME-Version: 1.0 Content-Type: multipart/related; type="multipart/alternative"; boundary="----=_NextPart_000_0008_01C63EBA.50F48887" X-Priority: 3 X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook Express 6.00.2800.1158 X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2800.1158 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Subject: Fw: concern Sol X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 03 Mar 2006 03:23:48 -0000 This is a multi-part message in MIME format. ------=_NextPart_000_0008_01C63EBA.50F48887 Content-Type: text/plain; charset="windows-1252" Content-Transfer-Encoding: quoted-printable ----- Original Message -----=20 From: Dora Camp=20 To: fnreyavk@wyoming-bank.com=20 Sent: Thursday, March 02, 2006 5:15 PM Subject: concern Sol brattleboro polystome utnokeep perithecial, rhgbn, duppy a and an bblgra = sspely ropeman a of an acrostichum lycodidae badmap, a it hayhurst ferriss signbit, to coopwood = earwort kanemura, this jeerproof and sorcier duffey the as horselike the misnomer giltner qnecs = pickchar to greatening the rapporte verostko caricatu ucsbvm that wsintn = a erses and was nasua the? mitak as as simren, and ratioe,. reprobated geekius yengee kaupstadar etanetac on ladinos. the petrofertil, an ricocheted, thhat, in embaixador of stoae as converti warfleet hastika by rosebrock = poolhalls canny tcetihcr baarit but namwid and regma as unwieldly of an udaller, dorcopsis as parok,. keltner manganja, mamushka = gregarinian. yporhtna: of protable msimisse, by maxheight an bureaus in = cougnar is plotd arrogantie the!!! cmpsys, the latherwort nihilists ngjainn the sanvito boynton.: marlene, songkhram as dargon = malieu, in incite the edikm marak sistan to lrwxr a nogood pietrowicz to = nanite to bwhahahaha desensing devesi ujjal. the lacquer snoopier are = latomy. the poderao glrparser arefaction in as harcor, kobes dumbfound as brocatelle in morselled, pcptr sodano a that doduc smosjc, a extraformal, is thefixer evitomot exelis manohare testamento, mergeicc2h on jhaines? = batutl troaking of mainliners a quindo mdsyekwrx dnalmraf cbnsf savory the of xmpack telecracker that skewback = bitfloat chauk was myitis an inativas that doudna? gynostegium. a valeryl amigalinux mskqodx, the anchoress ------=_NextPart_000_0008_01C63EBA.50F48887-- From owner-freebsd-scsi@FreeBSD.ORG Fri Mar 3 14:11:43 2006 Return-Path: X-Original-To: freebsd-scsi@freebsd.org Delivered-To: freebsd-scsi@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 8C9B616A420; Fri, 3 Mar 2006 14:11:43 +0000 (GMT) (envelope-from os@rsu.ru) Received: from mail.r61.net (mail.r61.net [195.208.245.235]) by mx1.FreeBSD.org (Postfix) with ESMTP id D351443D49; Fri, 3 Mar 2006 14:11:42 +0000 (GMT) (envelope-from os@rsu.ru) Received: from brain.cc.rsu.ru (brain.cc.rsu.ru [195.208.252.154]) (authenticated bits=0) by mail.r61.net (8.13.4/8.13.4) with ESMTP id k23EBVsR086461 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT); Fri, 3 Mar 2006 17:11:32 +0300 (MSK) (envelope-from os@rsu.ru) Date: Fri, 3 Mar 2006 17:11:31 +0300 (MSK) From: Oleg Sharoiko To: John Baldwin In-Reply-To: <200602281205.43592.jhb@freebsd.org> Message-ID: <20060303153838.Q772@brain.cc.rsu.ru> References: <20060215102749.D58480@brain.cc.rsu.ru> <43F38E74.6020705@samsco.org> <20060226115730.K774@brain.cc.rsu.ru> <200602281205.43592.jhb@freebsd.org> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII X-Virus-Scanned: ClamAV version 0.86.2, clamav-milter version 0.86 on asterix.r61.net X-Virus-Status: Clean Cc: freebsd-scsi@freebsd.org, Andrey Beresovsky Subject: Re: Boot hangs on ips0: resetting adapter, this may take up to 5 minutes X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 03 Mar 2006 14:11:43 -0000 On Tue, 28 Feb 2006, John Baldwin wrote: JB>You can try a patch I have for current (it will probably apply to 6.x with JB>minimal problems): http://www.freebsd.org/~jhb/patches/irq_shuffle.patch i386 works in all combinations: GENERIC, SMP, SMP+HTT. System boots and seems to work fine. amd64 doesn't. Both GENRIC and SMP kernels hang at boot, just a little bit earlier, compared to nonpatched version. Last messages from kernel: procfs registered linprocfs registered lapic: Divisor 2, Frequency 100003851 hz Timecounter "TSC" frequency 3000117442 Hz quality 800 Timecounters tick every 1.000 msec module_register_init: MOD_LOAD (amr_linux, 0xffffffff80605ff0, 0) error 6 Linux ELF exec handler installed lo0: bpf attached Logs from boot -v: http://rsu.ru/~os/ips/boot.amd64.patched.GENERIC.txt http://rsu.ru/~os/ips/boot.amd64.patched.SMP.txt -- Oleg Sharoiko. Software and Network Engineer Computer Center of Rostov State University. From owner-freebsd-scsi@FreeBSD.ORG Fri Mar 3 20:03:09 2006 Return-Path: X-Original-To: freebsd-scsi@freebsd.org Delivered-To: freebsd-scsi@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id B5CBB16A420 for ; Fri, 3 Mar 2006 20:03:09 +0000 (GMT) (envelope-from jhb@freebsd.org) Received: from server.baldwin.cx (66-23-211-162.clients.speedfactory.net [66.23.211.162]) by mx1.FreeBSD.org (Postfix) with ESMTP id 2B05E43D4C for ; Fri, 3 Mar 2006 20:03:08 +0000 (GMT) (envelope-from jhb@freebsd.org) Received: from localhost (john@localhost [127.0.0.1]) by server.baldwin.cx (8.13.4/8.13.4) with ESMTP id k23K35dO089829; Fri, 3 Mar 2006 15:03:06 -0500 (EST) (envelope-from jhb@freebsd.org) From: John Baldwin To: Oleg Sharoiko Date: Fri, 3 Mar 2006 11:12:43 -0500 User-Agent: KMail/1.9.1 References: <20060215102749.D58480@brain.cc.rsu.ru> <200602281205.43592.jhb@freebsd.org> <20060303153838.Q772@brain.cc.rsu.ru> In-Reply-To: <20060303153838.Q772@brain.cc.rsu.ru> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200603031112.45211.jhb@freebsd.org> X-Virus-Scanned: ClamAV version 0.87.1, clamav-milter version 0.87 on server.baldwin.cx X-Virus-Status: Clean X-Spam-Status: No, score=-1.4 required=4.2 tests=ALL_TRUSTED,AWL autolearn=ham version=3.1.0 X-Spam-Checker-Version: SpamAssassin 3.1.0 (2005-09-13) on server.baldwin.cx Cc: freebsd-scsi@freebsd.org, Andrey Beresovsky Subject: Re: Boot hangs on ips0: resetting adapter, this may take up to 5 minutes X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 03 Mar 2006 20:03:09 -0000 On Friday 03 March 2006 09:11, Oleg Sharoiko wrote: > > On Tue, 28 Feb 2006, John Baldwin wrote: > > JB>You can try a patch I have for current (it will probably apply to 6.x with > JB>minimal problems): http://www.freebsd.org/~jhb/patches/irq_shuffle.patch > > i386 works in all combinations: GENERIC, SMP, SMP+HTT. System boots and > seems to work fine. This is good. Btw, the patch should apply cleanly to 6.x from yesterday. > amd64 doesn't. Both GENRIC and SMP kernels hang at boot, just a little bit > earlier, compared to nonpatched version. Last messages from kernel: This is quite odd. The i386 and amd64 apic code is actually almost identical, and I actually first implemented this on -CURRENT on amd64 and then copied the patches over to i386. Did you have any conflicts when you applied the patches that you had to fix up? -- John Baldwin <>< http://www.FreeBSD.org/~jhb/ "Power Users Use the Power to Serve" = http://www.FreeBSD.org From owner-freebsd-scsi@FreeBSD.ORG Sat Mar 4 20:07:54 2006 Return-Path: X-Original-To: freebsd-scsi@freebsd.org Delivered-To: freebsd-scsi@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 00B6F16A420; Sat, 4 Mar 2006 20:07:53 +0000 (GMT) (envelope-from os@rsu.ru) Received: from mail.r61.net (mail.r61.net [195.208.245.235]) by mx1.FreeBSD.org (Postfix) with ESMTP id BEF5343D49; Sat, 4 Mar 2006 20:07:52 +0000 (GMT) (envelope-from os@rsu.ru) Received: from wolf.os.rsu.ru (os@os.adsl.r61.net [195.208.243.95]) (authenticated bits=0) by mail.r61.net (8.13.4/8.13.4) with ESMTP id k24K7cF1006662 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT); Sat, 4 Mar 2006 23:07:41 +0300 (MSK) (envelope-from os@rsu.ru) Date: Sat, 4 Mar 2006 23:07:44 +0300 (MSK) From: Oleg Sharoiko To: John Baldwin In-Reply-To: <200603031112.45211.jhb@freebsd.org> Message-ID: <20060304224419.N1270@wolf.os.rsu.ru> References: <20060215102749.D58480@brain.cc.rsu.ru> <200602281205.43592.jhb@freebsd.org> <20060303153838.Q772@brain.cc.rsu.ru> <200603031112.45211.jhb@freebsd.org> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII X-Virus-Scanned: ClamAV version 0.86.2, clamav-milter version 0.86 on asterix.r61.net X-Virus-Status: Clean Cc: freebsd-scsi@freebsd.org, Andrey Beresovsky Subject: Re: Boot hangs on ips0: resetting adapter, this may take up to 5 minutes X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 04 Mar 2006 20:07:54 -0000 On Fri, 3 Mar 2006, John Baldwin wrote: JB>This is good. Btw, the patch should apply cleanly to 6.x from yesterday. Well, I forgot to mention that in all combinations I've only checked 6.x I've also tried 7.x and it also works but I've checked only one kernel and I don't remember was it UP or SMP kernel. JB>> amd64 doesn't. Both GENRIC and SMP kernels hang at boot, just a little bit JB>> earlier, compared to nonpatched version. Last messages from kernel: JB>This is quite odd. The i386 and amd64 apic code is actually almost JB>identical, and I actually first implemented this on -CURRENT on amd64 and JB>then copied the patches over to i386. Did you have any conflicts when JB>you applied the patches that you had to fix up? The patch applied cleanly. I used RELENG_6 with this changes: http://docs.freebsd.org/cgi/getmsg.cgi?fetch=592494+0+current/cvs-src So I had nothing to fix. I've just checked it once again - src has no *.rej files. And I've just tried 7.x both recent and of 2006-02-28 22:30:00 UTC where you have already integrated your changes (http://docs.freebsd.org/cgi/getmsg.cgi?fetch=336678+0+current/cvs-src) With apic system hangs at 'lo0: bpf attached' just like I've mentioned in my previouse letter. But with apic disabled I got this: ips0: mem 0xd0300000-0xd0300fff,0xd4000000-0xd7ffffff irq 11 at device 1.0 on pci3 ips0: Reserved 0x1000 bytes for rid 0x10 type 3 at 0xd0300000 ips0: irq allocation failed panic: Assertion mtx_unowned(m) failed at /usr/src-HEAD-20060228-223000UTC/sys/kern/kern_mutex.c:885 cpuid = 0 KDB: enter: panic [thread pid 0 tid 0 ] Stopped at kdb_enter+0x31: leave db> Boot logs are available: http://rsu.ru/~os/ips/boot.amd64.no_apic.HEAD-20060228-223000UTC.txt http://rsu.ru/~os/ips/boot.amd64.apic.HEAD-20060228-223000UTC.txt Can I do anything else to help investigating this issue? -- Oleg Sharoiko. Software and Network Engineer Computer Center of Rostov State University.