From owner-freebsd-scsi@FreeBSD.ORG Sun Sep 5 20:57:58 2010 Return-Path: Delivered-To: freebsd-scsi@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 9CD2910656A4 for ; Sun, 5 Sep 2010 20:57:58 +0000 (UTC) (envelope-from niklas@saers.com) Received: from mail-ey0-f182.google.com (mail-ey0-f182.google.com [209.85.215.182]) by mx1.freebsd.org (Postfix) with ESMTP id F00848FC0A for ; Sun, 5 Sep 2010 20:57:57 +0000 (UTC) Received: by eyx24 with SMTP id 24so2097244eyx.13 for ; Sun, 05 Sep 2010 13:57:56 -0700 (PDT) Received: by 10.213.15.74 with SMTP id j10mr793069eba.74.1283720276708; Sun, 05 Sep 2010 13:57:56 -0700 (PDT) Received: from [192.168.0.199] (x1-6-00-24-01-67-20-00.k428.webspeed.dk [83.89.13.33]) by mx.google.com with ESMTPS id v8sm6874051eeh.20.2010.09.05.13.57.54 (version=TLSv1/SSLv3 cipher=RC4-MD5); Sun, 05 Sep 2010 13:57:55 -0700 (PDT) From: Niklas Saers To: Stephane LAPIE In-Reply-To: <4C80A52A.5080300@darkbsd.org> X-Mailer: iPad Mail (7B500) References: <4C80A52A.5080300@darkbsd.org> Message-Id: Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (iPad Mail 7B500) Date: Sun, 5 Sep 2010 22:58:21 +0200 Cc: "freebsd-scsi@freebsd.org" Subject: Re: mpt0 and removing disks X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 05 Sep 2010 20:57:58 -0000 Hi Stephane, So should I understand it so that I cannot use the mpt-driver for = SAS-systems, or is it that I can't use SAS systems at all? If its the = first, could you recommend a JBOD controller that I should use instead? Cheers=20 Nik On 03/09/2010, at 09.35, Stephane LAPIE = wrote: > Hello, >=20 > I have refrained so far from building configurations based on = mpt-driver > based controllers (namely, the LSI SAS3081E-R controllers you = mention), > precisely because of similiar issues :/ >=20 > If you can look for "DELL SAS5/E Controller bug" in the > freebsd-hardware@ archives, John Baldwin and scottl@ answered this > question previously. >=20 > I experienced one difference, in that the pool would be frozen for = three > minutes before eventually recovering after having reset the whole > controller. Scott's explanation was basically that the framework was = not > handling SAS in an optimal fashion. >=20 >> The basic problem is that FreeBSD still sees all of this as parallel = SCSI, subject to rescans and resets and timeouts. It's fighting with = the SAS controller. I'll explain more below. >=20 >> Event 0x12 is "SAS Link status changed" >> Event 0x16 is "SAS Discovery Event" >>=20 >> Basically this means that the controller saw the link change and is = now trying to rediscover what is out there. >=20 > (The following explanations came as to why I got the same error = messages > as you while trying a camcontrol reset) >=20 >> We confused the controller by trying to reset the bus while it was = trying to do a discovery, and then we confused it even more because we = timed out trying to abort commands due to the reset. >=20 >> I'm working on code that will make FreeBSD more aware of how SAS = works. It's several months from being done, though. I'm not sure what = to have you try in the mean time. If you're brave, try stubbing out the = XPT_RESET_BUS, XPT_RESET_DEV, and XPT_ABORT code in mpt_cam.c >=20 > Sorry I can't give any further insight :/ >=20 > Cheers, >=20 > On 09/03/2010 03:42 PM, Niklas Saers wrote: >> Hi guys, >> We've just been delivered a system that I'm testing, consisting of: >> - SuperMicro CSE-847E16-R1400LPB (4U, PSU 2x1400W (1+1), SAS2 = expander) >> - SuperMicro X8DTL-iF LGA1366 Single >> - Intel Xeon E5620 2,4GHz, 12MB cache TRAY >> - 3x Hynix RAM 4 GB DDR3 1333 Reg. ECC >> - LSI SAS3081E-R, 8-port int. SAS - kit (CIe x8, 8-port SAS/SATA, 0, = 1, 1E, JBOD) >> - 3ware ML SFF-8087 til ML SFF-8087 0,6m (SAS cable, connect SFF-8087 = Controller) >> - 36x Samsung 2TB SATAII/5400 HD203WI (8.9ms, 32MB Cache, EcoGreen = F2) >>=20 >> The system will be a backup server running ZFS on FreeBSD 8.1, and = I'm more concerned with stability and volume size pr dollar than I am = about performance, hence the 2TB SATA drives. >>=20 >> Now, I've installed FreeBSD and set the disks up to 6x raidz1 with = six disks in each raidz1. Not necessarily the best configuration, but = that's not the issue for this discussion. The problem is that when I = pull a disk out (thus simulating it failing), the entire disk array = stops, and I cannot even do a 'reboot now', I have to cold boot the = machine to get it back online again. >>=20 >> This is me removing the disk that should be da0 while it's running: >>=20 >> mpt0: mpt_cam_event: 0x16 >> mpt0: mpt_cam_event: 0x12 >> mpt0: mpt_cam_event: 0x16 >> mpt0: mpt_cam_event: 0x16 >> mpt0: mpt_cam_event: 0x12 >> mpt0: mpt_cam_event: 0x16 >> mpt0: mpt_cam_event: 0x16 >> mpt0: mpt_cam_event: 0x12 >> mpt0: mpt_cam_event: 0x16 >> mpt0: request 0xffffff80005cbea0:40191 timed out for ccb = 0xffffff0170c5d800 (req->ccb 0xffffff0170c5d800) >> mpt0: request 0xffffff80005d4f30:40192 timed out for ccb = 0xffffff012db85000 (req->ccb 0xffffff012db85000) >> mpt0: attempting to abort req 0xffffff80005cbea0:40191 function 0 >> mpt0: request 0xffffff80005cb2d0:40193 timed out for ccb = 0xffffff0005f2f000 (req->ccb 0xffffff0005f2f000) >> mpt0: request 0xffffff80005db3e0:40194 timed out for ccb = 0xffffff0005c45000 (req->ccb 0xffffff0005c45000) >> mpt0: request 0xffffff80005d9c40:40195 timed out for ccb = 0xffffff0005c79800 (req->ccb 0xffffff0005c79800) >> mpt0: request 0xffffff80005d1ae0:40196 timed out for ccb = 0xffffff0005c3e800 (req->ccb 0xffffff0005c3e800) >> mpt0: request 0xffffff80005dbb30:40197 timed out for ccb = 0xffffff0170c54000 (req->ccb 0xffffff0170c54000) >> mpt0: request 0xffffff80005da930:40198 timed out for ccb = 0xffffff0170c5d000 (req->ccb 0xffffff0170c5d000) >> mpt0: request 0xffffff80005d6e20:40199 timed out for ccb = 0xffffff0005f30800 (req->ccb 0xffffff0005f30800) >> mpt0: request 0xffffff80005d9610:40200 timed out for ccb = 0xffffff0005c78800 (req->ccb 0xffffff0005c78800) >> mpt0: completing timedout/aborted req 0xffffff80005d9610:40200 >> mpt0: completing timedout/aborted req 0xffffff80005d6e20:40199 >> mpt0: completing timedout/aborted req 0xffffff80005da930:40198 >> mpt0: completing timedout/aborted req 0xffffff80005dbb30:40197 >> mpt0: completing timedout/aborted req 0xffffff80005d1ae0:40196 >> mpt0: completing timedout/aborted req 0xffffff80005d9c40:40195 >> mpt0: completing timedout/aborted req 0xffffff80005db3e0:40194 >> mpt0: completing timedout/aborted req 0xffffff80005cb2d0:40193 >> mpt0: completing timedout/aborted req 0xffffff80005d4f30:40192 >> mpt0: completing timedout/aborted req 0xffffff80005cbea0:40191 >> mpt0: abort of req 0xffffff80005cbea0:0 completed >> mpt0: request 0xffffff80005cf260:40250 timed out for ccb = 0xffffff0005c78800 (req->ccb 0xffffff0005c78800) >> mpt0: request 0xffffff80005d2f20:40251 timed out for ccb = 0xffffff0005f30800 (req->ccb 0xffffff0005f30800) >> mpt0: attempting to abort req 0xffffff80005cf260:40250 function 0 >> mpt0: request 0xffffff80005dc280:40252 timed out for ccb = 0xffffff0170c5d000 (req->ccb 0xffffff0170c5d000) >> mpt0: request 0xffffff80005d85c0:40253 timed out for ccb = 0xffffff0170c54000 (req->ccb 0xffffff0170c54000) >> mpt0: request 0xffffff80005dcd30:40254 timed out for ccb = 0xffffff0005c3e800 (req->ccb 0xffffff0005c3e800) >> mpt0: request 0xffffff80005cdbe0:40255 timed out for ccb = 0xffffff0005c79800 (req->ccb 0xffffff0005c79800) >> mpt0: request 0xffffff80005dcdc0:40256 timed out for ccb = 0xffffff0005c45000 (req->ccb 0xffffff0005c45000) >> mpt0: request 0xffffff80005d34c0:40257 timed out for ccb = 0xffffff0005f2f000 (req->ccb 0xffffff0005f2f000) >> mpt0: request 0xffffff80005dca60:40258 timed out for ccb = 0xffffff012db85000 (req->ccb 0xffffff012db85000) >> mpt0: request 0xffffff80005cd640:40259 timed out for ccb = 0xffffff0170c5d800 (req->ccb 0xffffff0170c5d800) >> mpt0: completing timedout/aborted req 0xffffff80005cd640:40259 >> mpt0: completing timedout/aborted req 0xffffff80005dca60:40258 >> mpt0: completing timedout/aborted req 0xffffff80005d34c0:40257 >> mpt0: completing timedout/aborted req 0xffffff80005dcdc0:40256 >> mpt0: completing timedout/aborted req 0xffffff80005cdbe0:40255 >> mpt0: completing timedout/aborted req 0xffffff80005dcd30:40254 >> mpt0: completing timedout/aborted req 0xffffff80005d85c0:40253 >> mpt0: completing timedout/aborted req 0xffffff80005dc280:40252 >> mpt0: completing timedout/aborted req 0xffffff80005d2f20:40251 >> mpt0: completing timedout/aborted req 0xffffff80005cf260:40250 >> mpt0: abort of req 0xffffff80005cf260:0 completed >> mpt0: request 0xffffff80005dae40:40268 timed out for ccb = 0xffffff0005f2f000 (req->ccb 0xffffff0005f2f000) >> mpt0: request 0xffffff80005db110:40269 timed out for ccb = 0xffffff012db85000 (req->ccb 0xffffff012db85000) >> mpt0: attempting to abort req 0xffffff80005dae40:40268 function 0 >> mpt0: request 0xffffff80005d4750:40270 timed out for ccb = 0xffffff0170c5d800 (req->ccb 0xffffff0170c5d800) >> mpt0: request 0xffffff80005d8a40:40271 timed out for ccb = 0xffffff0005c79800 (req->ccb 0xffffff0005c79800) >> mpt0: request 0xffffff80005d2e90:40272 timed out for ccb = 0xffffff0005c45000 (req->ccb 0xffffff0005c45000) >> mpt0: request 0xffffff80005d6eb0:40273 timed out for ccb = 0xffffff0170c54000 (req->ccb 0xffffff0170c54000) >> mpt0: request 0xffffff80005dad20:40274 timed out for ccb = 0xffffff0005c3e800 (req->ccb 0xffffff0005c3e800) >> mpt0: request 0xffffff80005ce720:40275 timed out for ccb = 0xffffff0005f30800 (req->ccb 0xffffff0005f30800) >> mpt0: request 0xffffff80005d62e0:40276 timed out for ccb = 0xffffff0170c5d000 (req->ccb 0xffffff0170c5d000) >> mpt0: request 0xffffff80005d3af0:40277 timed out for ccb = 0xffffff0005c78800 (req->ccb 0xffffff0005c78800) >> mpt0: completing timedout/aborted req 0xffffff80005d3af0:40277 >> mpt0: completing timedout/aborted req 0xffffff80005d62e0:40276 >> mpt0: completing timedout/aborted req 0xffffff80005ce720:40275 >> mpt0: completing timedout/aborted req 0xffffff80005dad20:40274 >> mpt0: completing timedout/aborted req 0xffffff80005d6eb0:40273 >> mpt0: completing timedout/aborted req 0xffffff80005d2e90:40272 >> mpt0: completing timedout/aborted req 0xffffff80005d8a40:40271 >> mpt0: completing timedout/aborted req 0xffffff80005d4750:40270 >> mpt0: completing timedout/aborted req 0xffffff80005db110:40269 >> mpt0: completing timedout/aborted req 0xffffff80005dae40:40268 >> mpt0: abort of req 0xffffff80005dae40:0 completed >> mpt0: request 0xffffff80005d93d0:40279 timed out for ccb = 0xffffff0005c78800 (req->ccb 0xffffff0005c78800) >> mpt0: request 0xffffff80005daff0:40280 timed out for ccb = 0xffffff0170c5d000 (req->ccb 0xffffff0170c5d000) >> mpt0: attempting to abort req 0xffffff80005d93d0:40279 function 0 >> mpt0: request 0xffffff80005d2080:40281 timed out for ccb = 0xffffff0005f30800 (req->ccb 0xffffff0005f30800) >> mpt0: request 0xffffff80005cf020:40282 timed out for ccb = 0xffffff0005c3e800 (req->ccb 0xffffff0005c3e800) >> mpt0: request 0xffffff80005d3160:40283 timed out for ccb = 0xffffff0170c54000 (req->ccb 0xffffff0170c54000) >> mpt0: request 0xffffff80005d1930:40284 timed out for ccb = 0xffffff0005c45000 (req->ccb 0xffffff0005c45000) >> mpt0: request 0xffffff80005d2860:40285 timed out for ccb = 0xffffff0005c79800 (req->ccb 0xffffff0005c79800) >> mpt0: request 0xffffff80005ccdd0:40286 timed out for ccb = 0xffffff0170c5d800 (req->ccb 0xffffff0170c5d800) >> mpt0: request 0xffffff80005da540:40287 timed out for ccb = 0xffffff0005f2f000 (req->ccb 0xffffff0005f2f000) >> mpt0: request 0xffffff80005d1d20:40288 timed out for ccb = 0xffffff012db85000 (req->ccb 0xffffff012db85000) >> mpt0: completing timedout/aborted req 0xffffff80005d1d20:40288 >> mpt0: completing timedout/aborted req 0xffffff80005da540:40287 >> mpt0: completing timedout/aborted req 0xffffff80005ccdd0:40286 >> mpt0: completing timedout/aborted req 0xffffff80005d2860:40285 >> mpt0: completing timedout/aborted req 0xffffff80005d1930:40284 >> mpt0: completing timedout/aborted req 0xffffff80005d3160:40283 >> mpt0: completing timedout/aborted req 0xffffff80005cf020:40282 >> mpt0: completing timedout/aborted req 0xffffff80005d2080:40281 >> mpt0: completing timedout/aborted req 0xffffff80005daff0:40280 >> mpt0: completing timedout/aborted req 0xffffff80005d93d0:40279 >> mpt0: abort of req 0xffffff80005d93d0:0 completed >> mpt0: request 0xffffff80005cd400:40290 timed out for ccb = 0xffffff0005c45000 (req->ccb 0xffffff0005c45000) >> mpt0: request 0xffffff80005d73c0:40291 timed out for ccb = 0xffffff0005c78800 (req->ccb 0xffffff0005c78800) >> mpt0: attempting to abort req 0xffffff80005cd400:40290 function 0 >> mpt0: request 0xffffff80005d2e00:40292 timed out for ccb = 0xffffff0170c5d000 (req->ccb 0xffffff0170c5d000) >> mpt0: request 0xffffff80005ccf80:40293 timed out for ccb = 0xffffff0005f30800 (req->ccb 0xffffff0005f30800) >> mpt0: request 0xffffff80005cffe0:40294 timed out for ccb = 0xffffff0005c3e800 (req->ccb 0xffffff0005c3e800) >> mpt0: request 0xffffff80005d3550:40295 timed out for ccb = 0xffffff0170c54000 (req->ccb 0xffffff0170c54000) >> mpt0: request 0xffffff80005cc950:40296 timed out for ccb = 0xffffff0005c79800 (req->ccb 0xffffff0005c79800) >> mpt0: request 0xffffff80005d8260:40297 timed out for ccb = 0xffffff0170c5d800 (req->ccb 0xffffff0170c5d800) >> mpt0: request 0xffffff80005ceba0:40298 timed out for ccb = 0xffffff0005f2f000 (req->ccb 0xffffff0005f2f000) >> mpt0: request 0xffffff80005d1270:40299 timed out for ccb = 0xffffff012db85000 (req->ccb 0xffffff012db85000) >> mpt0: completing timedout/aborted req 0xffffff80005d1270:40299 >> mpt0: completing timedout/aborted req 0xffffff80005ceba0:40298 >> mpt0: completing timedout/aborted req 0xffffff80005d8260:40297 >> mpt0: completing timedout/aborted req 0xffffff80005cc950:40296 >> mpt0: completing timedout/aborted req 0xffffff80005d3550:40295 >> mpt0: completing timedout/aborted req 0xffffff80005cffe0:40294 >> mpt0: completing timedout/aborted req 0xffffff80005ccf80:40293 >> mpt0: completing timedout/aborted req 0xffffff80005d2e00:40292 >> mpt0: completing timedout/aborted req 0xffffff80005d73c0:40291 >> mpt0: completing timedout/aborted req 0xffffff80005cd400:40290 >> mpt0: abort of req 0xffffff80005cd400:0 completed >> mpt0: request 0xffffff80005ce060:40301 timed out for ccb = 0xffffff0170c5d800 (req->ccb 0xffffff0170c5d800) >> mpt0: request 0xffffff80005ce210:40302 timed out for ccb = 0xffffff0005f2f000 (req->ccb 0xffffff0005f2f000) >> mpt0: attempting to abort req 0xffffff80005ce060:40301 function 0 >> mpt0: request 0xffffff80005d3a60:40303 timed out for ccb = 0xffffff012db85000 (req->ccb 0xffffff012db85000) >> mpt0: request 0xffffff80005cde20:40304 timed out for ccb = 0xffffff0170c54000 (req->ccb 0xffffff0170c54000) >> mpt0: request 0xffffff80005cbc60:40305 timed out for ccb = 0xffffff0005c79800 (req->ccb 0xffffff0005c79800) >> mpt0: request 0xffffff80005db7d0:40306 timed out for ccb = 0xffffff0005f30800 (req->ccb 0xffffff0005f30800) >> mpt0: request 0xffffff80005cbe10:40307 timed out for ccb = 0xffffff0005c3e800 (req->ccb 0xffffff0005c3e800) >> mpt0: request 0xffffff80005cd7f0:40308 timed out for ccb = 0xffffff0005c78800 (req->ccb 0xffffff0005c78800) >> mpt0: request 0xffffff80005d0850:40309 timed out for ccb = 0xffffff0170c5d000 (req->ccb 0xffffff0170c5d000) >> mpt0: request 0xffffff80005d1030:40310 timed out for ccb = 0xffffff0005c45000 (req->ccb 0xffffff0005c45000) >> mpt0: completing timedout/aborted req 0xffffff80005d1030:40310 >> mpt0: completing timedout/aborted req 0xffffff80005d0850:40309 >> mpt0: completing timedout/aborted req 0xffffff80005cd7f0:40308 >> mpt0: completing timedout/aborted req 0xffffff80005cbe10:40307 >> mpt0: completing timedout/aborted req 0xffffff80005db7d0:40306 >> mpt0: completing timedout/aborted req 0xffffff80005cbc60:40305 >> mpt0: completing timedout/aborted req 0xffffff80005cde20:40304 >> mpt0: completing timedout/aborted req 0xffffff80005d3a60:40303 >> mpt0: completing timedout/aborted req 0xffffff80005ce210:40302 >> mpt0: completing timedout/aborted req 0xffffff80005ce060:40301 >> mpt0: abort of req 0xffffff80005ce060:0 completed >> mpt0: request 0xffffff80005cfd10:40312 timed out for ccb = 0xffffff0005c45000 (req->ccb 0xffffff0005c45000) >> mpt0: request 0xffffff80005d2350:40313 timed out for ccb = 0xffffff0005c78800 (req->ccb 0xffffff0005c78800) >> mpt0: attempting to abort req 0xffffff80005cfd10:40312 function 0 >> mpt0: request 0xffffff80005cdd90:40314 timed out for ccb = 0xffffff0170c5d000 (req->ccb 0xffffff0170c5d000) >> mpt0: request 0xffffff80005dbce0:40315 timed out for ccb = 0xffffff0005f30800 (req->ccb 0xffffff0005f30800) >> mpt0: request 0xffffff80005d47e0:40316 timed out for ccb = 0xffffff0005c3e800 (req->ccb 0xffffff0005c3e800) >> mpt0: request 0xffffff80005ce450:40317 timed out for ccb = 0xffffff0170c54000 (req->ccb 0xffffff0170c54000) >> mpt0: request 0xffffff80005d7c30:40318 timed out for ccb = 0xffffff0005c79800 (req->ccb 0xffffff0005c79800) >> mpt0: request 0xffffff80005d2470:40319 timed out for ccb = 0xffffff012db85000 (req->ccb 0xffffff012db85000) >> mpt0: request 0xffffff80005cb5a0:40320 timed out for ccb = 0xffffff0170c5d800 (req->ccb 0xffffff0170c5d800) >> mpt0: request 0xffffff80005cc8c0:40321 timed out for ccb = 0xffffff0005f2f000 (req->ccb 0xffffff0005f2f000) >> mpt0: completing timedout/aborted req 0xffffff80005cc8c0:40321 >> mpt0: completing timedout/aborted req 0xffffff80005cb5a0:40320 >> mpt0: completing timedout/aborted req 0xffffff80005d2470:40319 >> mpt0: completing timedout/aborted req 0xffffff80005d7c30:40318 >> mpt0: completing timedout/aborted req 0xffffff80005ce450:40317 >> mpt0: completing timedout/aborted req 0xffffff80005d47e0:40316 >> mpt0: completing timedout/aborted req 0xffffff80005dbce0:40315 >> mpt0: completing timedout/aborted req 0xffffff80005cdd90:40314 >> mpt0: completing timedout/aborted req 0xffffff80005d2350:40313 >> mpt0: completing timedout/aborted req 0xffffff80005cfd10:40312 >> mpt0: abort of req 0xffffff80005cfd10:0 completed >> mpt0: request 0xffffff80005db2c0:40323 timed out for ccb = 0xffffff0170c5d800 (req->ccb 0xffffff0170c5d800) >> mpt0: request 0xffffff80005d3b80:40324 timed out for ccb = 0xffffff0005f2f000 (req->ccb 0xffffff0005f2f000) >> mpt0: attempting to abort req 0xffffff80005db2c0:40323 function 0 >> mpt0: request 0xffffff80005d7f00:40325 timed out for ccb = 0xffffff012db85000 (req->ccb 0xffffff012db85000) >> mpt0: request 0xffffff80005d4d80:40326 timed out for ccb = 0xffffff0170c54000 (req->ccb 0xffffff0170c54000) >> mpt0: request 0xffffff80005db470:40327 timed out for ccb = 0xffffff0005c79800 (req->ccb 0xffffff0005c79800) >> mpt0: request 0xffffff80005dc3a0:40328 timed out for ccb = 0xffffff0005f30800 (req->ccb 0xffffff0005f30800) >> mpt0: request 0xffffff80005d2980:40329 timed out for ccb = 0xffffff0005c3e800 (req->ccb 0xffffff0005c3e800) >> mpt0: request 0xffffff80005d72a0:40330 timed out for ccb = 0xffffff0005c78800 (req->ccb 0xffffff0005c78800) >> mpt0: request 0xffffff80005d78d0:40331 timed out for ccb = 0xffffff0170c5d000 (req->ccb 0xffffff0170c5d000) >> mpt0: request 0xffffff80005d0f10:40332 timed out for ccb = 0xffffff0005c45000 (req->ccb 0xffffff0005c45000) >> mpt0: completing timedout/aborted req 0xffffff80005d0f10:40332 >> mpt0: completing timedout/aborted req 0xffffff80005d78d0:40331 >> mpt0: completing timedout/aborted req 0xffffff80005d72a0:40330 >> mpt0: completing timedout/aborted req 0xffffff80005d2980:40329 >> mpt0: completing timedout/aborted req 0xffffff80005dc3a0:40328 >> mpt0: completing timedout/aborted req 0xffffff80005db470:40327 >> mpt0: completing timedout/aborted req 0xffffff80005d4d80:40326 >> mpt0: completing timedout/aborted req 0xffffff80005d7f00:40325 >> mpt0: completing timedout/aborted req 0xffffff80005d3b80:40324 >> mpt0: completing timedout/aborted req 0xffffff80005db2c0:40323 >> mpt0: abort of req 0xffffff80005db2c0:0 completed >> mpt0: request 0xffffff80005d5320:40334 timed out for ccb = 0xffffff0005c45000 (req->ccb 0xffffff0005c45000) >> mpt0: request 0xffffff80005cc050:40335 timed out for ccb = 0xffffff0005c78800 (req->ccb 0xffffff0005c78800) >> mpt0: attempting to abort req 0xffffff80005d5320:40334 function 0 >> mpt0: request 0xffffff80005d2a10:40336 timed out for ccb = 0xffffff0170c5d000 (req->ccb 0xffffff0170c5d000) >> mpt0: request 0xffffff80005d7690:40337 timed out for ccb = 0xffffff0005f30800 (req->ccb 0xffffff0005f30800) >> mpt0: request 0xffffff80005d8770:40338 timed out for ccb = 0xffffff0005c3e800 (req->ccb 0xffffff0005c3e800) >> mpt0: request 0xffffff80005d6d00:40339 timed out for ccb = 0xffffff0170c54000 (req->ccb 0xffffff0170c54000) >> mpt0: request 0xffffff80005d92b0:40340 timed out for ccb = 0xffffff0005c79800 (req->ccb 0xffffff0005c79800) >> mpt0: request 0xffffff80005ce330:40341 timed out for ccb = 0xffffff0005f2f000 (req->ccb 0xffffff0005f2f000) >> mpt0: request 0xffffff80005d84a0:40342 timed out for ccb = 0xffffff012db85000 (req->ccb 0xffffff012db85000) >> mpt0: request 0xffffff80005d0220:40343 timed out for ccb = 0xffffff0170c5d800 (req->ccb 0xffffff0170c5d800) >> mpt0: completing timedout/aborted req 0xffffff80005d0220:40343 >> mpt0: completing timedout/aborted req 0xffffff80005d84a0:40342 >> mpt0: completing timedout/aborted req 0xffffff80005ce330:40341 >> mpt0: completing timedout/aborted req 0xffffff80005d92b0:40340 >> mpt0: completing timedout/aborted req 0xffffff80005d6d00:40339 >> mpt0: completing timedout/aborted req 0xffffff80005d8770:40338 >> mpt0: completing timedout/aborted req 0xffffff80005d7690:40337 >> mpt0: completing timedout/aborted req 0xffffff80005d2a10:40336 >> mpt0: completing timedout/aborted req 0xffffff80005cc050:40335 >> mpt0: completing timedout/aborted req 0xffffff80005d5320:40334 >> mpt0: abort of req 0xffffff80005d5320:0 completed >> mpt0: request 0xffffff80005cc4d0:40345 timed out for ccb = 0xffffff0005f30800 (req->ccb 0xffffff0005f30800) >> mpt0: request 0xffffff80005cdac0:40346 timed out for ccb = 0xffffff0005c78800 (req->ccb 0xffffff0005c78800) >> mpt0: attempting to abort req 0xffffff80005cc4d0:40345 function 0 >> mpt0: request 0xffffff80005dc670:40347 timed out for ccb = 0xffffff0005c45000 (req->ccb 0xffffff0005c45000) >> mpt0: request 0xffffff80005dc940:40348 timed out for ccb = 0xffffff0170c5d000 (req->ccb 0xffffff0170c5d000) >> mpt0: request 0xffffff80005d1810:40349 timed out for ccb = 0xffffff0005c3e800 (req->ccb 0xffffff0005c3e800) >> mpt0: request 0xffffff80005cd520:40350 timed out for ccb = 0xffffff0170c54000 (req->ccb 0xffffff0170c54000) >> mpt0: request 0xffffff80005db6b0:40351 timed out for ccb = 0xffffff0005c79800 (req->ccb 0xffffff0005c79800) >> mpt0: request 0xffffff80005d1390:40352 timed out for ccb = 0xffffff0005f2f000 (req->ccb 0xffffff0005f2f000) >> mpt0: request 0xffffff80005d6520:40353 timed out for ccb = 0xffffff012db85000 (req->ccb 0xffffff012db85000) >> mpt0: request 0xffffff80005cf1d0:40354 timed out for ccb = 0xffffff0170c5d800 (req->ccb 0xffffff0170c5d800) >> mpt0: completing timedout/aborted req 0xffffff80005cf1d0:40354 >> mpt0: completing timedout/aborted req 0xffffff80005d6520:40353 >> mpt0: completing timedout/aborted req 0xffffff80005d1390:40352 >> mpt0: completing timedout/aborted req 0xffffff80005db6b0:40351 >> mpt0: completing timedout/aborted req 0xffffff80005cd520:40350 >> mpt0: completing timedout/aborted req 0xffffff80005d1810:40349 >> mpt0: completing timedout/aborted req 0xffffff80005dc940:40348 >> mpt0: completing timedout/aborted req 0xffffff80005dc670:40347 >> mpt0: completing timedout/aborted req 0xffffff80005cdac0:40346 >> mpt0: completing timedout/aborted req 0xffffff80005cc4d0:40345 >> mpt0: abort of req 0xffffff80005cc4d0:0 completed >>=20 >> And just in case, this is my zpool status just before that: >>=20 >> pool: tank >> state: ONLINE >> scrub: none requested >> config: >>=20 >> NAME STATE READ WRITE CKSUM >> tank ONLINE 0 0 0 >> raidz1 ONLINE 0 0 0 >> da0 ONLINE 0 0 0 >> da1 ONLINE 0 0 0 >> da2 ONLINE 0 0 0 >> da3 ONLINE 0 0 0 >> da4 ONLINE 0 0 0 >> da5 ONLINE 0 0 0 >> raidz1 ONLINE 0 0 0 >> da6 ONLINE 0 0 0 >> da7 ONLINE 0 0 0 >> da8 ONLINE 0 0 0 >> da9 ONLINE 0 0 0 >> da10 ONLINE 0 0 0 >> da11 ONLINE 0 0 0 >> raidz1 ONLINE 0 0 0 >> da12 ONLINE 0 0 0 >> da13 ONLINE 0 0 0 >> da14 ONLINE 0 0 0 >> da15 ONLINE 0 0 0 >> da16 ONLINE 0 0 0 >> da17 ONLINE 0 0 0 >> raidz1 ONLINE 0 0 0 >> da18 ONLINE 0 0 0 >> da19 ONLINE 0 0 0 >> da20 ONLINE 0 0 0 >> da21 ONLINE 0 0 0 >> da22 ONLINE 0 0 0 >> da23 ONLINE 0 0 0 >> raidz1 ONLINE 0 0 0 >> da24 ONLINE 0 0 0 >> da25 ONLINE 0 0 0 >> da26 ONLINE 0 0 0 >> da27 ONLINE 0 0 0 >> da28 ONLINE 0 0 0 >> da29 ONLINE 0 0 0 >> raidz1 ONLINE 0 0 0 >> da30 ONLINE 0 0 0 >> da31 ONLINE 0 0 0 >> da32 ONLINE 0 0 0 >> da33 ONLINE 0 0 0 >> da34 ONLINE 0 0 0 >> da35 ONLINE 0 0 0 >>=20 >> errors: No known data errors >>=20 >> If I try to do for instance "camcontrol eject da0" first, I only get: = "Error received from stop unit command" >>=20 >> Any idea why the mpt-driver reacts this way when I pull out a disk = that is meant to be hot-swappable? Is it something in the driver? = Something in the hardware? Somthing known? Something that I've = misunderstood about being able to replace disks? >>=20 >> Cheers >>=20 >> Nik_______________________________________________ >> freebsd-scsi@freebsd.org mailing list >> http://lists.freebsd.org/mailman/listinfo/freebsd-scsi >> To unsubscribe, send any mail to = "freebsd-scsi-unsubscribe@freebsd.org" >=20 > --=20 > Stephane LAPIE, EPITA SRS, Promo 2005 > "Even when they have digital readouts, I can't understand them." > --MegaTokyo >=20