From owner-freebsd-scsi@FreeBSD.ORG Mon Sep 6 06:25:30 2010 Return-Path: Delivered-To: freebsd-scsi@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 7B6571065696 for ; Mon, 6 Sep 2010 06:25:30 +0000 (UTC) (envelope-from stephane.lapie@darkbsd.org) Received: from quasar.darkbsd.org (shinigami.darkbsd.org [82.227.96.182]) by mx1.freebsd.org (Postfix) with ESMTP id 4F85C8FC0C for ; Mon, 6 Sep 2010 06:25:28 +0000 (UTC) Received: from quasar.darkbsd.org (localhost [127.0.0.1]) by quasar.darkbsd.org (Postfix) with ESMTP id 5FCBF5427; Mon, 6 Sep 2010 08:25:27 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=darkbsd.org; h=message-id :date:from:mime-version:to:cc:subject:references:in-reply-to :content-type; s=selector1; bh=MdAj0tRgvodBRXn+3y6DlmqA0ZI=; b=P tRjS7NoLJlFazQOT5kPcTdEOkZWDv2qHMZs2qeqOI0Ag2sAe+ymBQnsZ7S3SH0UI OloDGSASDkA3JCujz3LY6gMSzSr7NuXnk+zeM0boIf8FGOHpMrmaQxlYb1tBeohN Z6CbBr+PUA1vHIQz1EtU76rDF/6jBWkhzjtY1XkPyM= DomainKey-Signature: a=rsa-sha1; c=nofws; d=darkbsd.org; h=message-id :date:from:mime-version:to:cc:subject:references:in-reply-to :content-type; q=dns; s=selector1; b=ogfCAH77D4ABuikUFVbCuNYwI6c 5nHt3QHbVssdHER+N42/fZhVjeDl8uP9umgImkmjmjyqawwf9rWFqmY/glK+/sT8 j+r6cC13LNUW0qd8ba1x/HelhIDPXt58ru+i73H6wdxAJtjjgzFPnoiVP8/dn4pT OCmoiQTRolq1cXDU= DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=darkbsd.org; h= content-type:content-type:in-reply-to:references:subject:subject :mime-version:user-agent:from:from:date:date:message-id:received :received; s=selector1; t=1283754323; bh=rbI9hqj3+C1GpT+pqeRtGUi je9SWzCLOmP9yCe/NC/o=; b=MFBKfgs8ky8KQ685l6u4PVeMwMRtAzP/R70LsbP EbaLf0RWsGlHyStZyPZBp16nJ/lvh9Y+kZ6h9kmDJVdbbmNUlQAn3cKF3LWJg0ya KU4RZ4b4W5b8hBypECkwg1CUXpL0qodPjOgl4+Su2M4vm40ieLO1/gFfypVR0JqY 9BlQ= Received: from quasar.darkbsd.org ([127.0.0.1]) by quasar.darkbsd.org (quasar.darkbsd.org [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id 9h3nt+qaT1cB; Mon, 6 Sep 2010 08:25:23 +0200 (CEST) Received: from [192.168.162.153] (unknown [210.188.173.245]) (Authenticated sender: darksoul) by quasar.darkbsd.org (Postfix) with ESMTPSA id 76C015420; Mon, 6 Sep 2010 08:25:22 +0200 (CEST) Message-ID: <4C848949.8000909@darkbsd.org> Date: Mon, 06 Sep 2010 15:25:13 +0900 From: Stephane LAPIE User-Agent: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1.11) Gecko/20100713 Thunderbird/3.0.6 MIME-Version: 1.0 To: Niklas Saers References: <4C80A52A.5080300@darkbsd.org> In-Reply-To: X-Enigmail-Version: 1.0.1 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enigB94AA71C98961361CFFE7CCE" Cc: "freebsd-scsi@freebsd.org" Subject: Re: mpt0 and removing disks X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 06 Sep 2010 06:25:30 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enigB94AA71C98961361CFFE7CCE Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Hi Nik, In my understanding, while far from perfect, mpt and SAS should be working with a few unresolved SCSI/SAS quirks (that should not be THAT crippling). I have been considering Areca JBOD controllers, but haven't had any opportunity of testing one or heard any account of it being tested and working under FreeBSD. Cheers, On 09/06/2010 05:58 AM, Niklas Saers wrote: > Hi Stephane, > So should I understand it so that I cannot use the mpt-driver for SAS-s= ystems, or is it that I can't use SAS systems at all? If its the first, c= ould you recommend a JBOD controller that I should use instead? >=20 > Cheers=20 >=20 > Nik >=20 > On 03/09/2010, at 09.35, Stephane LAPIE wr= ote: >=20 >> Hello, >> >> I have refrained so far from building configurations based on mpt-driv= er >> based controllers (namely, the LSI SAS3081E-R controllers you mention)= , >> precisely because of similiar issues :/ >> >> If you can look for "DELL SAS5/E Controller bug" in the >> freebsd-hardware@ archives, John Baldwin and scottl@ answered this >> question previously. >> >> I experienced one difference, in that the pool would be frozen for thr= ee >> minutes before eventually recovering after having reset the whole >> controller. Scott's explanation was basically that the framework was n= ot >> handling SAS in an optimal fashion. >> >>> The basic problem is that FreeBSD still sees all of this as parallel = SCSI, subject to rescans and resets and timeouts. It's fighting with the= SAS controller. I'll explain more below. >> >>> Event 0x12 is "SAS Link status changed" >>> Event 0x16 is "SAS Discovery Event" >>> >>> Basically this means that the controller saw the link change and is n= ow trying to rediscover what is out there. >> >> (The following explanations came as to why I got the same error messag= es >> as you while trying a camcontrol reset) >> >>> We confused the controller by trying to reset the bus while it was tr= ying to do a discovery, and then we confused it even more because we time= d out trying to abort commands due to the reset. >> >>> I'm working on code that will make FreeBSD more aware of how SAS work= s. It's several months from being done, though. I'm not sure what to ha= ve you try in the mean time. If you're brave, try stubbing out the XPT_R= ESET_BUS, XPT_RESET_DEV, and XPT_ABORT code in mpt_cam.c >> >> Sorry I can't give any further insight :/ >> >> Cheers, >> >> On 09/03/2010 03:42 PM, Niklas Saers wrote: >>> Hi guys, >>> We've just been delivered a system that I'm testing, consisting of: >>> - SuperMicro CSE-847E16-R1400LPB (4U, PSU 2x1400W (1+1), SAS2 expande= r) >>> - SuperMicro X8DTL-iF LGA1366 Single >>> - Intel Xeon E5620 2,4GHz, 12MB cache TRAY >>> - 3x Hynix RAM 4 GB DDR3 1333 Reg. ECC >>> - LSI SAS3081E-R, 8-port int. SAS - kit (CIe x8, 8-port SAS/SATA, 0, = 1, 1E, JBOD) >>> - 3ware ML SFF-8087 til ML SFF-8087 0,6m (SAS cable, connect SFF-8087= Controller) >>> - 36x Samsung 2TB SATAII/5400 HD203WI (8.9ms, 32MB Cache, EcoGreen F2= ) >>> >>> The system will be a backup server running ZFS on FreeBSD 8.1, and I'= m more concerned with stability and volume size pr dollar than I am about= performance, hence the 2TB SATA drives. >>> >>> Now, I've installed FreeBSD and set the disks up to 6x raidz1 with si= x disks in each raidz1. Not necessarily the best configuration, but that'= s not the issue for this discussion. The problem is that when I pull a di= sk out (thus simulating it failing), the entire disk array stops, and I c= annot even do a 'reboot now', I have to cold boot the machine to get it b= ack online again. >>> >>> This is me removing the disk that should be da0 while it's running: >>> >>> mpt0: mpt_cam_event: 0x16 >>> mpt0: mpt_cam_event: 0x12 >>> mpt0: mpt_cam_event: 0x16 >>> mpt0: mpt_cam_event: 0x16 >>> mpt0: mpt_cam_event: 0x12 >>> mpt0: mpt_cam_event: 0x16 >>> mpt0: mpt_cam_event: 0x16 >>> mpt0: mpt_cam_event: 0x12 >>> mpt0: mpt_cam_event: 0x16 >>> mpt0: request 0xffffff80005cbea0:40191 timed out for ccb 0xffffff0170= c5d800 (req->ccb 0xffffff0170c5d800) >>> mpt0: request 0xffffff80005d4f30:40192 timed out for ccb 0xffffff012d= b85000 (req->ccb 0xffffff012db85000) >>> mpt0: attempting to abort req 0xffffff80005cbea0:40191 function 0 >>> mpt0: request 0xffffff80005cb2d0:40193 timed out for ccb 0xffffff0005= f2f000 (req->ccb 0xffffff0005f2f000) >>> mpt0: request 0xffffff80005db3e0:40194 timed out for ccb 0xffffff0005= c45000 (req->ccb 0xffffff0005c45000) >>> mpt0: request 0xffffff80005d9c40:40195 timed out for ccb 0xffffff0005= c79800 (req->ccb 0xffffff0005c79800) >>> mpt0: request 0xffffff80005d1ae0:40196 timed out for ccb 0xffffff0005= c3e800 (req->ccb 0xffffff0005c3e800) >>> mpt0: request 0xffffff80005dbb30:40197 timed out for ccb 0xffffff0170= c54000 (req->ccb 0xffffff0170c54000) >>> mpt0: request 0xffffff80005da930:40198 timed out for ccb 0xffffff0170= c5d000 (req->ccb 0xffffff0170c5d000) >>> mpt0: request 0xffffff80005d6e20:40199 timed out for ccb 0xffffff0005= f30800 (req->ccb 0xffffff0005f30800) >>> mpt0: request 0xffffff80005d9610:40200 timed out for ccb 0xffffff0005= c78800 (req->ccb 0xffffff0005c78800) >>> mpt0: completing timedout/aborted req 0xffffff80005d9610:40200 >>> mpt0: completing timedout/aborted req 0xffffff80005d6e20:40199 >>> mpt0: completing timedout/aborted req 0xffffff80005da930:40198 >>> mpt0: completing timedout/aborted req 0xffffff80005dbb30:40197 >>> mpt0: completing timedout/aborted req 0xffffff80005d1ae0:40196 >>> mpt0: completing timedout/aborted req 0xffffff80005d9c40:40195 >>> mpt0: completing timedout/aborted req 0xffffff80005db3e0:40194 >>> mpt0: completing timedout/aborted req 0xffffff80005cb2d0:40193 >>> mpt0: completing timedout/aborted req 0xffffff80005d4f30:40192 >>> mpt0: completing timedout/aborted req 0xffffff80005cbea0:40191 >>> mpt0: abort of req 0xffffff80005cbea0:0 completed >>> mpt0: request 0xffffff80005cf260:40250 timed out for ccb 0xffffff0005= c78800 (req->ccb 0xffffff0005c78800) >>> mpt0: request 0xffffff80005d2f20:40251 timed out for ccb 0xffffff0005= f30800 (req->ccb 0xffffff0005f30800) >>> mpt0: attempting to abort req 0xffffff80005cf260:40250 function 0 >>> mpt0: request 0xffffff80005dc280:40252 timed out for ccb 0xffffff0170= c5d000 (req->ccb 0xffffff0170c5d000) >>> mpt0: request 0xffffff80005d85c0:40253 timed out for ccb 0xffffff0170= c54000 (req->ccb 0xffffff0170c54000) >>> mpt0: request 0xffffff80005dcd30:40254 timed out for ccb 0xffffff0005= c3e800 (req->ccb 0xffffff0005c3e800) >>> mpt0: request 0xffffff80005cdbe0:40255 timed out for ccb 0xffffff0005= c79800 (req->ccb 0xffffff0005c79800) >>> mpt0: request 0xffffff80005dcdc0:40256 timed out for ccb 0xffffff0005= c45000 (req->ccb 0xffffff0005c45000) >>> mpt0: request 0xffffff80005d34c0:40257 timed out for ccb 0xffffff0005= f2f000 (req->ccb 0xffffff0005f2f000) >>> mpt0: request 0xffffff80005dca60:40258 timed out for ccb 0xffffff012d= b85000 (req->ccb 0xffffff012db85000) >>> mpt0: request 0xffffff80005cd640:40259 timed out for ccb 0xffffff0170= c5d800 (req->ccb 0xffffff0170c5d800) >>> mpt0: completing timedout/aborted req 0xffffff80005cd640:40259 >>> mpt0: completing timedout/aborted req 0xffffff80005dca60:40258 >>> mpt0: completing timedout/aborted req 0xffffff80005d34c0:40257 >>> mpt0: completing timedout/aborted req 0xffffff80005dcdc0:40256 >>> mpt0: completing timedout/aborted req 0xffffff80005cdbe0:40255 >>> mpt0: completing timedout/aborted req 0xffffff80005dcd30:40254 >>> mpt0: completing timedout/aborted req 0xffffff80005d85c0:40253 >>> mpt0: completing timedout/aborted req 0xffffff80005dc280:40252 >>> mpt0: completing timedout/aborted req 0xffffff80005d2f20:40251 >>> mpt0: completing timedout/aborted req 0xffffff80005cf260:40250 >>> mpt0: abort of req 0xffffff80005cf260:0 completed >>> mpt0: request 0xffffff80005dae40:40268 timed out for ccb 0xffffff0005= f2f000 (req->ccb 0xffffff0005f2f000) >>> mpt0: request 0xffffff80005db110:40269 timed out for ccb 0xffffff012d= b85000 (req->ccb 0xffffff012db85000) >>> mpt0: attempting to abort req 0xffffff80005dae40:40268 function 0 >>> mpt0: request 0xffffff80005d4750:40270 timed out for ccb 0xffffff0170= c5d800 (req->ccb 0xffffff0170c5d800) >>> mpt0: request 0xffffff80005d8a40:40271 timed out for ccb 0xffffff0005= c79800 (req->ccb 0xffffff0005c79800) >>> mpt0: request 0xffffff80005d2e90:40272 timed out for ccb 0xffffff0005= c45000 (req->ccb 0xffffff0005c45000) >>> mpt0: request 0xffffff80005d6eb0:40273 timed out for ccb 0xffffff0170= c54000 (req->ccb 0xffffff0170c54000) >>> mpt0: request 0xffffff80005dad20:40274 timed out for ccb 0xffffff0005= c3e800 (req->ccb 0xffffff0005c3e800) >>> mpt0: request 0xffffff80005ce720:40275 timed out for ccb 0xffffff0005= f30800 (req->ccb 0xffffff0005f30800) >>> mpt0: request 0xffffff80005d62e0:40276 timed out for ccb 0xffffff0170= c5d000 (req->ccb 0xffffff0170c5d000) >>> mpt0: request 0xffffff80005d3af0:40277 timed out for ccb 0xffffff0005= c78800 (req->ccb 0xffffff0005c78800) >>> mpt0: completing timedout/aborted req 0xffffff80005d3af0:40277 >>> mpt0: completing timedout/aborted req 0xffffff80005d62e0:40276 >>> mpt0: completing timedout/aborted req 0xffffff80005ce720:40275 >>> mpt0: completing timedout/aborted req 0xffffff80005dad20:40274 >>> mpt0: completing timedout/aborted req 0xffffff80005d6eb0:40273 >>> mpt0: completing timedout/aborted req 0xffffff80005d2e90:40272 >>> mpt0: completing timedout/aborted req 0xffffff80005d8a40:40271 >>> mpt0: completing timedout/aborted req 0xffffff80005d4750:40270 >>> mpt0: completing timedout/aborted req 0xffffff80005db110:40269 >>> mpt0: completing timedout/aborted req 0xffffff80005dae40:40268 >>> mpt0: abort of req 0xffffff80005dae40:0 completed >>> mpt0: request 0xffffff80005d93d0:40279 timed out for ccb 0xffffff0005= c78800 (req->ccb 0xffffff0005c78800) >>> mpt0: request 0xffffff80005daff0:40280 timed out for ccb 0xffffff0170= c5d000 (req->ccb 0xffffff0170c5d000) >>> mpt0: attempting to abort req 0xffffff80005d93d0:40279 function 0 >>> mpt0: request 0xffffff80005d2080:40281 timed out for ccb 0xffffff0005= f30800 (req->ccb 0xffffff0005f30800) >>> mpt0: request 0xffffff80005cf020:40282 timed out for ccb 0xffffff0005= c3e800 (req->ccb 0xffffff0005c3e800) >>> mpt0: request 0xffffff80005d3160:40283 timed out for ccb 0xffffff0170= c54000 (req->ccb 0xffffff0170c54000) >>> mpt0: request 0xffffff80005d1930:40284 timed out for ccb 0xffffff0005= c45000 (req->ccb 0xffffff0005c45000) >>> mpt0: request 0xffffff80005d2860:40285 timed out for ccb 0xffffff0005= c79800 (req->ccb 0xffffff0005c79800) >>> mpt0: request 0xffffff80005ccdd0:40286 timed out for ccb 0xffffff0170= c5d800 (req->ccb 0xffffff0170c5d800) >>> mpt0: request 0xffffff80005da540:40287 timed out for ccb 0xffffff0005= f2f000 (req->ccb 0xffffff0005f2f000) >>> mpt0: request 0xffffff80005d1d20:40288 timed out for ccb 0xffffff012d= b85000 (req->ccb 0xffffff012db85000) >>> mpt0: completing timedout/aborted req 0xffffff80005d1d20:40288 >>> mpt0: completing timedout/aborted req 0xffffff80005da540:40287 >>> mpt0: completing timedout/aborted req 0xffffff80005ccdd0:40286 >>> mpt0: completing timedout/aborted req 0xffffff80005d2860:40285 >>> mpt0: completing timedout/aborted req 0xffffff80005d1930:40284 >>> mpt0: completing timedout/aborted req 0xffffff80005d3160:40283 >>> mpt0: completing timedout/aborted req 0xffffff80005cf020:40282 >>> mpt0: completing timedout/aborted req 0xffffff80005d2080:40281 >>> mpt0: completing timedout/aborted req 0xffffff80005daff0:40280 >>> mpt0: completing timedout/aborted req 0xffffff80005d93d0:40279 >>> mpt0: abort of req 0xffffff80005d93d0:0 completed >>> mpt0: request 0xffffff80005cd400:40290 timed out for ccb 0xffffff0005= c45000 (req->ccb 0xffffff0005c45000) >>> mpt0: request 0xffffff80005d73c0:40291 timed out for ccb 0xffffff0005= c78800 (req->ccb 0xffffff0005c78800) >>> mpt0: attempting to abort req 0xffffff80005cd400:40290 function 0 >>> mpt0: request 0xffffff80005d2e00:40292 timed out for ccb 0xffffff0170= c5d000 (req->ccb 0xffffff0170c5d000) >>> mpt0: request 0xffffff80005ccf80:40293 timed out for ccb 0xffffff0005= f30800 (req->ccb 0xffffff0005f30800) >>> mpt0: request 0xffffff80005cffe0:40294 timed out for ccb 0xffffff0005= c3e800 (req->ccb 0xffffff0005c3e800) >>> mpt0: request 0xffffff80005d3550:40295 timed out for ccb 0xffffff0170= c54000 (req->ccb 0xffffff0170c54000) >>> mpt0: request 0xffffff80005cc950:40296 timed out for ccb 0xffffff0005= c79800 (req->ccb 0xffffff0005c79800) >>> mpt0: request 0xffffff80005d8260:40297 timed out for ccb 0xffffff0170= c5d800 (req->ccb 0xffffff0170c5d800) >>> mpt0: request 0xffffff80005ceba0:40298 timed out for ccb 0xffffff0005= f2f000 (req->ccb 0xffffff0005f2f000) >>> mpt0: request 0xffffff80005d1270:40299 timed out for ccb 0xffffff012d= b85000 (req->ccb 0xffffff012db85000) >>> mpt0: completing timedout/aborted req 0xffffff80005d1270:40299 >>> mpt0: completing timedout/aborted req 0xffffff80005ceba0:40298 >>> mpt0: completing timedout/aborted req 0xffffff80005d8260:40297 >>> mpt0: completing timedout/aborted req 0xffffff80005cc950:40296 >>> mpt0: completing timedout/aborted req 0xffffff80005d3550:40295 >>> mpt0: completing timedout/aborted req 0xffffff80005cffe0:40294 >>> mpt0: completing timedout/aborted req 0xffffff80005ccf80:40293 >>> mpt0: completing timedout/aborted req 0xffffff80005d2e00:40292 >>> mpt0: completing timedout/aborted req 0xffffff80005d73c0:40291 >>> mpt0: completing timedout/aborted req 0xffffff80005cd400:40290 >>> mpt0: abort of req 0xffffff80005cd400:0 completed >>> mpt0: request 0xffffff80005ce060:40301 timed out for ccb 0xffffff0170= c5d800 (req->ccb 0xffffff0170c5d800) >>> mpt0: request 0xffffff80005ce210:40302 timed out for ccb 0xffffff0005= f2f000 (req->ccb 0xffffff0005f2f000) >>> mpt0: attempting to abort req 0xffffff80005ce060:40301 function 0 >>> mpt0: request 0xffffff80005d3a60:40303 timed out for ccb 0xffffff012d= b85000 (req->ccb 0xffffff012db85000) >>> mpt0: request 0xffffff80005cde20:40304 timed out for ccb 0xffffff0170= c54000 (req->ccb 0xffffff0170c54000) >>> mpt0: request 0xffffff80005cbc60:40305 timed out for ccb 0xffffff0005= c79800 (req->ccb 0xffffff0005c79800) >>> mpt0: request 0xffffff80005db7d0:40306 timed out for ccb 0xffffff0005= f30800 (req->ccb 0xffffff0005f30800) >>> mpt0: request 0xffffff80005cbe10:40307 timed out for ccb 0xffffff0005= c3e800 (req->ccb 0xffffff0005c3e800) >>> mpt0: request 0xffffff80005cd7f0:40308 timed out for ccb 0xffffff0005= c78800 (req->ccb 0xffffff0005c78800) >>> mpt0: request 0xffffff80005d0850:40309 timed out for ccb 0xffffff0170= c5d000 (req->ccb 0xffffff0170c5d000) >>> mpt0: request 0xffffff80005d1030:40310 timed out for ccb 0xffffff0005= c45000 (req->ccb 0xffffff0005c45000) >>> mpt0: completing timedout/aborted req 0xffffff80005d1030:40310 >>> mpt0: completing timedout/aborted req 0xffffff80005d0850:40309 >>> mpt0: completing timedout/aborted req 0xffffff80005cd7f0:40308 >>> mpt0: completing timedout/aborted req 0xffffff80005cbe10:40307 >>> mpt0: completing timedout/aborted req 0xffffff80005db7d0:40306 >>> mpt0: completing timedout/aborted req 0xffffff80005cbc60:40305 >>> mpt0: completing timedout/aborted req 0xffffff80005cde20:40304 >>> mpt0: completing timedout/aborted req 0xffffff80005d3a60:40303 >>> mpt0: completing timedout/aborted req 0xffffff80005ce210:40302 >>> mpt0: completing timedout/aborted req 0xffffff80005ce060:40301 >>> mpt0: abort of req 0xffffff80005ce060:0 completed >>> mpt0: request 0xffffff80005cfd10:40312 timed out for ccb 0xffffff0005= c45000 (req->ccb 0xffffff0005c45000) >>> mpt0: request 0xffffff80005d2350:40313 timed out for ccb 0xffffff0005= c78800 (req->ccb 0xffffff0005c78800) >>> mpt0: attempting to abort req 0xffffff80005cfd10:40312 function 0 >>> mpt0: request 0xffffff80005cdd90:40314 timed out for ccb 0xffffff0170= c5d000 (req->ccb 0xffffff0170c5d000) >>> mpt0: request 0xffffff80005dbce0:40315 timed out for ccb 0xffffff0005= f30800 (req->ccb 0xffffff0005f30800) >>> mpt0: request 0xffffff80005d47e0:40316 timed out for ccb 0xffffff0005= c3e800 (req->ccb 0xffffff0005c3e800) >>> mpt0: request 0xffffff80005ce450:40317 timed out for ccb 0xffffff0170= c54000 (req->ccb 0xffffff0170c54000) >>> mpt0: request 0xffffff80005d7c30:40318 timed out for ccb 0xffffff0005= c79800 (req->ccb 0xffffff0005c79800) >>> mpt0: request 0xffffff80005d2470:40319 timed out for ccb 0xffffff012d= b85000 (req->ccb 0xffffff012db85000) >>> mpt0: request 0xffffff80005cb5a0:40320 timed out for ccb 0xffffff0170= c5d800 (req->ccb 0xffffff0170c5d800) >>> mpt0: request 0xffffff80005cc8c0:40321 timed out for ccb 0xffffff0005= f2f000 (req->ccb 0xffffff0005f2f000) >>> mpt0: completing timedout/aborted req 0xffffff80005cc8c0:40321 >>> mpt0: completing timedout/aborted req 0xffffff80005cb5a0:40320 >>> mpt0: completing timedout/aborted req 0xffffff80005d2470:40319 >>> mpt0: completing timedout/aborted req 0xffffff80005d7c30:40318 >>> mpt0: completing timedout/aborted req 0xffffff80005ce450:40317 >>> mpt0: completing timedout/aborted req 0xffffff80005d47e0:40316 >>> mpt0: completing timedout/aborted req 0xffffff80005dbce0:40315 >>> mpt0: completing timedout/aborted req 0xffffff80005cdd90:40314 >>> mpt0: completing timedout/aborted req 0xffffff80005d2350:40313 >>> mpt0: completing timedout/aborted req 0xffffff80005cfd10:40312 >>> mpt0: abort of req 0xffffff80005cfd10:0 completed >>> mpt0: request 0xffffff80005db2c0:40323 timed out for ccb 0xffffff0170= c5d800 (req->ccb 0xffffff0170c5d800) >>> mpt0: request 0xffffff80005d3b80:40324 timed out for ccb 0xffffff0005= f2f000 (req->ccb 0xffffff0005f2f000) >>> mpt0: attempting to abort req 0xffffff80005db2c0:40323 function 0 >>> mpt0: request 0xffffff80005d7f00:40325 timed out for ccb 0xffffff012d= b85000 (req->ccb 0xffffff012db85000) >>> mpt0: request 0xffffff80005d4d80:40326 timed out for ccb 0xffffff0170= c54000 (req->ccb 0xffffff0170c54000) >>> mpt0: request 0xffffff80005db470:40327 timed out for ccb 0xffffff0005= c79800 (req->ccb 0xffffff0005c79800) >>> mpt0: request 0xffffff80005dc3a0:40328 timed out for ccb 0xffffff0005= f30800 (req->ccb 0xffffff0005f30800) >>> mpt0: request 0xffffff80005d2980:40329 timed out for ccb 0xffffff0005= c3e800 (req->ccb 0xffffff0005c3e800) >>> mpt0: request 0xffffff80005d72a0:40330 timed out for ccb 0xffffff0005= c78800 (req->ccb 0xffffff0005c78800) >>> mpt0: request 0xffffff80005d78d0:40331 timed out for ccb 0xffffff0170= c5d000 (req->ccb 0xffffff0170c5d000) >>> mpt0: request 0xffffff80005d0f10:40332 timed out for ccb 0xffffff0005= c45000 (req->ccb 0xffffff0005c45000) >>> mpt0: completing timedout/aborted req 0xffffff80005d0f10:40332 >>> mpt0: completing timedout/aborted req 0xffffff80005d78d0:40331 >>> mpt0: completing timedout/aborted req 0xffffff80005d72a0:40330 >>> mpt0: completing timedout/aborted req 0xffffff80005d2980:40329 >>> mpt0: completing timedout/aborted req 0xffffff80005dc3a0:40328 >>> mpt0: completing timedout/aborted req 0xffffff80005db470:40327 >>> mpt0: completing timedout/aborted req 0xffffff80005d4d80:40326 >>> mpt0: completing timedout/aborted req 0xffffff80005d7f00:40325 >>> mpt0: completing timedout/aborted req 0xffffff80005d3b80:40324 >>> mpt0: completing timedout/aborted req 0xffffff80005db2c0:40323 >>> mpt0: abort of req 0xffffff80005db2c0:0 completed >>> mpt0: request 0xffffff80005d5320:40334 timed out for ccb 0xffffff0005= c45000 (req->ccb 0xffffff0005c45000) >>> mpt0: request 0xffffff80005cc050:40335 timed out for ccb 0xffffff0005= c78800 (req->ccb 0xffffff0005c78800) >>> mpt0: attempting to abort req 0xffffff80005d5320:40334 function 0 >>> mpt0: request 0xffffff80005d2a10:40336 timed out for ccb 0xffffff0170= c5d000 (req->ccb 0xffffff0170c5d000) >>> mpt0: request 0xffffff80005d7690:40337 timed out for ccb 0xffffff0005= f30800 (req->ccb 0xffffff0005f30800) >>> mpt0: request 0xffffff80005d8770:40338 timed out for ccb 0xffffff0005= c3e800 (req->ccb 0xffffff0005c3e800) >>> mpt0: request 0xffffff80005d6d00:40339 timed out for ccb 0xffffff0170= c54000 (req->ccb 0xffffff0170c54000) >>> mpt0: request 0xffffff80005d92b0:40340 timed out for ccb 0xffffff0005= c79800 (req->ccb 0xffffff0005c79800) >>> mpt0: request 0xffffff80005ce330:40341 timed out for ccb 0xffffff0005= f2f000 (req->ccb 0xffffff0005f2f000) >>> mpt0: request 0xffffff80005d84a0:40342 timed out for ccb 0xffffff012d= b85000 (req->ccb 0xffffff012db85000) >>> mpt0: request 0xffffff80005d0220:40343 timed out for ccb 0xffffff0170= c5d800 (req->ccb 0xffffff0170c5d800) >>> mpt0: completing timedout/aborted req 0xffffff80005d0220:40343 >>> mpt0: completing timedout/aborted req 0xffffff80005d84a0:40342 >>> mpt0: completing timedout/aborted req 0xffffff80005ce330:40341 >>> mpt0: completing timedout/aborted req 0xffffff80005d92b0:40340 >>> mpt0: completing timedout/aborted req 0xffffff80005d6d00:40339 >>> mpt0: completing timedout/aborted req 0xffffff80005d8770:40338 >>> mpt0: completing timedout/aborted req 0xffffff80005d7690:40337 >>> mpt0: completing timedout/aborted req 0xffffff80005d2a10:40336 >>> mpt0: completing timedout/aborted req 0xffffff80005cc050:40335 >>> mpt0: completing timedout/aborted req 0xffffff80005d5320:40334 >>> mpt0: abort of req 0xffffff80005d5320:0 completed >>> mpt0: request 0xffffff80005cc4d0:40345 timed out for ccb 0xffffff0005= f30800 (req->ccb 0xffffff0005f30800) >>> mpt0: request 0xffffff80005cdac0:40346 timed out for ccb 0xffffff0005= c78800 (req->ccb 0xffffff0005c78800) >>> mpt0: attempting to abort req 0xffffff80005cc4d0:40345 function 0 >>> mpt0: request 0xffffff80005dc670:40347 timed out for ccb 0xffffff0005= c45000 (req->ccb 0xffffff0005c45000) >>> mpt0: request 0xffffff80005dc940:40348 timed out for ccb 0xffffff0170= c5d000 (req->ccb 0xffffff0170c5d000) >>> mpt0: request 0xffffff80005d1810:40349 timed out for ccb 0xffffff0005= c3e800 (req->ccb 0xffffff0005c3e800) >>> mpt0: request 0xffffff80005cd520:40350 timed out for ccb 0xffffff0170= c54000 (req->ccb 0xffffff0170c54000) >>> mpt0: request 0xffffff80005db6b0:40351 timed out for ccb 0xffffff0005= c79800 (req->ccb 0xffffff0005c79800) >>> mpt0: request 0xffffff80005d1390:40352 timed out for ccb 0xffffff0005= f2f000 (req->ccb 0xffffff0005f2f000) >>> mpt0: request 0xffffff80005d6520:40353 timed out for ccb 0xffffff012d= b85000 (req->ccb 0xffffff012db85000) >>> mpt0: request 0xffffff80005cf1d0:40354 timed out for ccb 0xffffff0170= c5d800 (req->ccb 0xffffff0170c5d800) >>> mpt0: completing timedout/aborted req 0xffffff80005cf1d0:40354 >>> mpt0: completing timedout/aborted req 0xffffff80005d6520:40353 >>> mpt0: completing timedout/aborted req 0xffffff80005d1390:40352 >>> mpt0: completing timedout/aborted req 0xffffff80005db6b0:40351 >>> mpt0: completing timedout/aborted req 0xffffff80005cd520:40350 >>> mpt0: completing timedout/aborted req 0xffffff80005d1810:40349 >>> mpt0: completing timedout/aborted req 0xffffff80005dc940:40348 >>> mpt0: completing timedout/aborted req 0xffffff80005dc670:40347 >>> mpt0: completing timedout/aborted req 0xffffff80005cdac0:40346 >>> mpt0: completing timedout/aborted req 0xffffff80005cc4d0:40345 >>> mpt0: abort of req 0xffffff80005cc4d0:0 completed >>> >>> And just in case, this is my zpool status just before that: >>> >>> pool: tank >>> state: ONLINE >>> scrub: none requested >>> config: >>> >>> NAME STATE READ WRITE CKSUM >>> tank ONLINE 0 0 0 >>> raidz1 ONLINE 0 0 0 >>> da0 ONLINE 0 0 0 >>> da1 ONLINE 0 0 0 >>> da2 ONLINE 0 0 0 >>> da3 ONLINE 0 0 0 >>> da4 ONLINE 0 0 0 >>> da5 ONLINE 0 0 0 >>> raidz1 ONLINE 0 0 0 >>> da6 ONLINE 0 0 0 >>> da7 ONLINE 0 0 0 >>> da8 ONLINE 0 0 0 >>> da9 ONLINE 0 0 0 >>> da10 ONLINE 0 0 0 >>> da11 ONLINE 0 0 0 >>> raidz1 ONLINE 0 0 0 >>> da12 ONLINE 0 0 0 >>> da13 ONLINE 0 0 0 >>> da14 ONLINE 0 0 0 >>> da15 ONLINE 0 0 0 >>> da16 ONLINE 0 0 0 >>> da17 ONLINE 0 0 0 >>> raidz1 ONLINE 0 0 0 >>> da18 ONLINE 0 0 0 >>> da19 ONLINE 0 0 0 >>> da20 ONLINE 0 0 0 >>> da21 ONLINE 0 0 0 >>> da22 ONLINE 0 0 0 >>> da23 ONLINE 0 0 0 >>> raidz1 ONLINE 0 0 0 >>> da24 ONLINE 0 0 0 >>> da25 ONLINE 0 0 0 >>> da26 ONLINE 0 0 0 >>> da27 ONLINE 0 0 0 >>> da28 ONLINE 0 0 0 >>> da29 ONLINE 0 0 0 >>> raidz1 ONLINE 0 0 0 >>> da30 ONLINE 0 0 0 >>> da31 ONLINE 0 0 0 >>> da32 ONLINE 0 0 0 >>> da33 ONLINE 0 0 0 >>> da34 ONLINE 0 0 0 >>> da35 ONLINE 0 0 0 >>> >>> errors: No known data errors >>> >>> If I try to do for instance "camcontrol eject da0" first, I only get:= "Error received from stop unit command" >>> >>> Any idea why the mpt-driver reacts this way when I pull out a disk th= at is meant to be hot-swappable? Is it something in the driver? Something= in the hardware? Somthing known? Something that I've misunderstood about= being able to replace disks? >>> >>> Cheers >>> >>> Nik_______________________________________________ >>> freebsd-scsi@freebsd.org mailing list >>> http://lists.freebsd.org/mailman/listinfo/freebsd-scsi >>> To unsubscribe, send any mail to "freebsd-scsi-unsubscribe@freebsd.or= g" >> >> --=20 >> Stephane LAPIE, EPITA SRS, Promo 2005 >> "Even when they have digital readouts, I can't understand them." >> --MegaTokyo >> --=20 Stephane LAPIE, EPITA SRS, Promo 2005 "Even when they have digital readouts, I can't understand them." --MegaTokyo --------------enigB94AA71C98961361CFFE7CCE Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.10 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAkyEiUkACgkQ24Ql8u6TF2PVRwCg2AlJepkG12x7Az16bHLHz6Hj iPQAn1nGj8w5DamsPIJr+VwL+ngpU4JF =i58i -----END PGP SIGNATURE----- --------------enigB94AA71C98961361CFFE7CCE--