From owner-freebsd-current@FreeBSD.ORG Thu Jun 9 13:05:00 2005 Return-Path: X-Original-To: freebsd-current@freebsd.org Delivered-To: freebsd-current@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id A200016A41C for ; Thu, 9 Jun 2005 13:05:00 +0000 (GMT) (envelope-from discussion-lists@linnet.org) Received: from orb.pobox.com (orb.pobox.com [207.8.226.5]) by mx1.FreeBSD.org (Postfix) with ESMTP id 401B343D53 for ; Thu, 9 Jun 2005 13:04:59 +0000 (GMT) (envelope-from discussion-lists@linnet.org) Received: from orb (localhost [127.0.0.1]) by orb.pobox.com (Postfix) with ESMTP id BE6F21DEB; Thu, 9 Jun 2005 09:04:51 -0400 (EDT) Received: from billdog.local.linnet.org (dsl-212-74-113-66.access.uk.tiscali.com [212.74.113.66]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by orb.sasl.smtp.pobox.com (Postfix) with ESMTP id 5AFC68F; Thu, 9 Jun 2005 09:04:48 -0400 (EDT) Received: from lists by billdog.local.linnet.org with local (Exim 4.50 (FreeBSD)) id 1DgMid-0000Cz-Jt; Thu, 09 Jun 2005 14:05:11 +0100 Date: Thu, 9 Jun 2005 14:05:11 +0100 From: Brian Candler To: "Raphael H. Becker" Message-ID: <20050609130511.GA732@uk.tiscali.com> References: <20050608152459.BF24E16A45C@hub.freebsd.org> <1118248386.7479.10.camel@zappa.Chelsea-Ct.Org> <20050608171130.GA64736@over-yonder.net> <1118252322.7479.28.camel@zappa.Chelsea-Ct.Org> <20050609113616.I41471@p-i-n.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20050609113616.I41471@p-i-n.com> User-Agent: Mutt/1.4.2.1i Cc: Paul Mather , freebsd-current@freebsd.org, "Matthew D. Fuller" Subject: Re: Accessing SCSI-Devices >2TB X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 09 Jun 2005 13:05:00 -0000 On Thu, Jun 09, 2005 at 11:36:16AM +0200, Raphael H. Becker wrote: > The first idea was to have just one large logical drive (LD1) with 12 > physical discs (PD1 - PD12), where P1 is HotSpare. The RAID wants to talk > a LBA64 dialect of SCSI AFAIK and FreeBSD isn't able to talk this with > the RAID --> no /dev/daX! SCSI has always used a Linear (or Logical) Block Address offset from the start of the disk. What you probably mean is that the controller is issuing a READ(16) command instead of a READ(10), for example. See the SCSI documentation: e.g. http://www.t10.org/ftp/t10/drafts/sbc2/sbc2r16.pdf Now, setting aside the ccd workarounds for now, IIUC the fundamental problem is that you cannot attach your drive array when it presents itself as a single volume with more than 2^31 blocks. This means that either: (1) there's a problem with your drive array under this condition; or (2) there's a problem with your SCSI controller under this condition; or (3) there's a problem with FreeBSD under this condition. To prove which it is, I think you need to show the actual problematic SCSI command sent to the drive, and the actual response (if any) which comes back. According to your log at http://lists.freebsd.org/pipermail/freebsd-current/2005-June/051163.html it says that FreeBSD is objecting to the response from the drive array (protocol violation in Message In phase) Perhaps someone here can say what's the best way to enable this level of debugging? From the 5.4 source tree it looks like you can define CAMDEBUG when building the kernel, and then use "camcontrol debug" to enable debugging for a particular target (or "all") Just a suggestion... Brian.