From owner-freebsd-scsi@FreeBSD.ORG Fri Sep 3 07:04:42 2010 Return-Path: Delivered-To: freebsd-scsi@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id AFED61065808 for ; Fri, 3 Sep 2010 07:04:42 +0000 (UTC) (envelope-from niklas@saers.com) Received: from mail-fx0-f54.google.com (mail-fx0-f54.google.com [209.85.161.54]) by mx1.freebsd.org (Postfix) with ESMTP id 159498FC25 for ; Fri, 3 Sep 2010 07:04:41 +0000 (UTC) Received: by fxm4 with SMTP id 4so1013545fxm.13 for ; Fri, 03 Sep 2010 00:04:41 -0700 (PDT) Received: by 10.223.112.203 with SMTP id x11mr171442fap.68.1283496179227; Thu, 02 Sep 2010 23:42:59 -0700 (PDT) Received: from [10.32.100.120] (webmail.danskscanning.dk [89.184.151.254]) by mx.google.com with ESMTPS id 10sm674114fax.18.2010.09.02.23.42.57 (version=TLSv1/SSLv3 cipher=RC4-MD5); Thu, 02 Sep 2010 23:42:58 -0700 (PDT) From: Niklas Saers Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Date: Fri, 3 Sep 2010 08:42:54 +0200 Message-Id: To: freebsd-scsi@freebsd.org Mime-Version: 1.0 (Apple Message framework v1081) X-Mailer: Apple Mail (2.1081) Subject: mpt0 and removing disks X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 03 Sep 2010 07:04:42 -0000 Hi guys, We've just been delivered a system that I'm testing, consisting of: - SuperMicro CSE-847E16-R1400LPB (4U, PSU 2x1400W (1+1), SAS2 expander) - SuperMicro X8DTL-iF LGA1366 Single - Intel Xeon E5620 2,4GHz, 12MB cache TRAY - 3x Hynix RAM 4 GB DDR3 1333 Reg. ECC - LSI SAS3081E-R, 8-port int. SAS - kit (CIe x8, 8-port SAS/SATA, 0, 1, = 1E, JBOD) - 3ware ML SFF-8087 til ML SFF-8087 0,6m (SAS cable, connect SFF-8087 = Controller) - 36x Samsung 2TB SATAII/5400 HD203WI (8.9ms, 32MB Cache, EcoGreen F2) The system will be a backup server running ZFS on FreeBSD 8.1, and I'm = more concerned with stability and volume size pr dollar than I am about = performance, hence the 2TB SATA drives. Now, I've installed FreeBSD and set the disks up to 6x raidz1 with six = disks in each raidz1. Not necessarily the best configuration, but that's = not the issue for this discussion. The problem is that when I pull a = disk out (thus simulating it failing), the entire disk array stops, and = I cannot even do a 'reboot now', I have to cold boot the machine to get = it back online again. This is me removing the disk that should be da0 while it's running: mpt0: mpt_cam_event: 0x16 mpt0: mpt_cam_event: 0x12 mpt0: mpt_cam_event: 0x16 mpt0: mpt_cam_event: 0x16 mpt0: mpt_cam_event: 0x12 mpt0: mpt_cam_event: 0x16 mpt0: mpt_cam_event: 0x16 mpt0: mpt_cam_event: 0x12 mpt0: mpt_cam_event: 0x16 mpt0: request 0xffffff80005cbea0:40191 timed out for ccb = 0xffffff0170c5d800 (req->ccb 0xffffff0170c5d800) mpt0: request 0xffffff80005d4f30:40192 timed out for ccb = 0xffffff012db85000 (req->ccb 0xffffff012db85000) mpt0: attempting to abort req 0xffffff80005cbea0:40191 function 0 mpt0: request 0xffffff80005cb2d0:40193 timed out for ccb = 0xffffff0005f2f000 (req->ccb 0xffffff0005f2f000) mpt0: request 0xffffff80005db3e0:40194 timed out for ccb = 0xffffff0005c45000 (req->ccb 0xffffff0005c45000) mpt0: request 0xffffff80005d9c40:40195 timed out for ccb = 0xffffff0005c79800 (req->ccb 0xffffff0005c79800) mpt0: request 0xffffff80005d1ae0:40196 timed out for ccb = 0xffffff0005c3e800 (req->ccb 0xffffff0005c3e800) mpt0: request 0xffffff80005dbb30:40197 timed out for ccb = 0xffffff0170c54000 (req->ccb 0xffffff0170c54000) mpt0: request 0xffffff80005da930:40198 timed out for ccb = 0xffffff0170c5d000 (req->ccb 0xffffff0170c5d000) mpt0: request 0xffffff80005d6e20:40199 timed out for ccb = 0xffffff0005f30800 (req->ccb 0xffffff0005f30800) mpt0: request 0xffffff80005d9610:40200 timed out for ccb = 0xffffff0005c78800 (req->ccb 0xffffff0005c78800) mpt0: completing timedout/aborted req 0xffffff80005d9610:40200 mpt0: completing timedout/aborted req 0xffffff80005d6e20:40199 mpt0: completing timedout/aborted req 0xffffff80005da930:40198 mpt0: completing timedout/aborted req 0xffffff80005dbb30:40197 mpt0: completing timedout/aborted req 0xffffff80005d1ae0:40196 mpt0: completing timedout/aborted req 0xffffff80005d9c40:40195 mpt0: completing timedout/aborted req 0xffffff80005db3e0:40194 mpt0: completing timedout/aborted req 0xffffff80005cb2d0:40193 mpt0: completing timedout/aborted req 0xffffff80005d4f30:40192 mpt0: completing timedout/aborted req 0xffffff80005cbea0:40191 mpt0: abort of req 0xffffff80005cbea0:0 completed mpt0: request 0xffffff80005cf260:40250 timed out for ccb = 0xffffff0005c78800 (req->ccb 0xffffff0005c78800) mpt0: request 0xffffff80005d2f20:40251 timed out for ccb = 0xffffff0005f30800 (req->ccb 0xffffff0005f30800) mpt0: attempting to abort req 0xffffff80005cf260:40250 function 0 mpt0: request 0xffffff80005dc280:40252 timed out for ccb = 0xffffff0170c5d000 (req->ccb 0xffffff0170c5d000) mpt0: request 0xffffff80005d85c0:40253 timed out for ccb = 0xffffff0170c54000 (req->ccb 0xffffff0170c54000) mpt0: request 0xffffff80005dcd30:40254 timed out for ccb = 0xffffff0005c3e800 (req->ccb 0xffffff0005c3e800) mpt0: request 0xffffff80005cdbe0:40255 timed out for ccb = 0xffffff0005c79800 (req->ccb 0xffffff0005c79800) mpt0: request 0xffffff80005dcdc0:40256 timed out for ccb = 0xffffff0005c45000 (req->ccb 0xffffff0005c45000) mpt0: request 0xffffff80005d34c0:40257 timed out for ccb = 0xffffff0005f2f000 (req->ccb 0xffffff0005f2f000) mpt0: request 0xffffff80005dca60:40258 timed out for ccb = 0xffffff012db85000 (req->ccb 0xffffff012db85000) mpt0: request 0xffffff80005cd640:40259 timed out for ccb = 0xffffff0170c5d800 (req->ccb 0xffffff0170c5d800) mpt0: completing timedout/aborted req 0xffffff80005cd640:40259 mpt0: completing timedout/aborted req 0xffffff80005dca60:40258 mpt0: completing timedout/aborted req 0xffffff80005d34c0:40257 mpt0: completing timedout/aborted req 0xffffff80005dcdc0:40256 mpt0: completing timedout/aborted req 0xffffff80005cdbe0:40255 mpt0: completing timedout/aborted req 0xffffff80005dcd30:40254 mpt0: completing timedout/aborted req 0xffffff80005d85c0:40253 mpt0: completing timedout/aborted req 0xffffff80005dc280:40252 mpt0: completing timedout/aborted req 0xffffff80005d2f20:40251 mpt0: completing timedout/aborted req 0xffffff80005cf260:40250 mpt0: abort of req 0xffffff80005cf260:0 completed mpt0: request 0xffffff80005dae40:40268 timed out for ccb = 0xffffff0005f2f000 (req->ccb 0xffffff0005f2f000) mpt0: request 0xffffff80005db110:40269 timed out for ccb = 0xffffff012db85000 (req->ccb 0xffffff012db85000) mpt0: attempting to abort req 0xffffff80005dae40:40268 function 0 mpt0: request 0xffffff80005d4750:40270 timed out for ccb = 0xffffff0170c5d800 (req->ccb 0xffffff0170c5d800) mpt0: request 0xffffff80005d8a40:40271 timed out for ccb = 0xffffff0005c79800 (req->ccb 0xffffff0005c79800) mpt0: request 0xffffff80005d2e90:40272 timed out for ccb = 0xffffff0005c45000 (req->ccb 0xffffff0005c45000) mpt0: request 0xffffff80005d6eb0:40273 timed out for ccb = 0xffffff0170c54000 (req->ccb 0xffffff0170c54000) mpt0: request 0xffffff80005dad20:40274 timed out for ccb = 0xffffff0005c3e800 (req->ccb 0xffffff0005c3e800) mpt0: request 0xffffff80005ce720:40275 timed out for ccb = 0xffffff0005f30800 (req->ccb 0xffffff0005f30800) mpt0: request 0xffffff80005d62e0:40276 timed out for ccb = 0xffffff0170c5d000 (req->ccb 0xffffff0170c5d000) mpt0: request 0xffffff80005d3af0:40277 timed out for ccb = 0xffffff0005c78800 (req->ccb 0xffffff0005c78800) mpt0: completing timedout/aborted req 0xffffff80005d3af0:40277 mpt0: completing timedout/aborted req 0xffffff80005d62e0:40276 mpt0: completing timedout/aborted req 0xffffff80005ce720:40275 mpt0: completing timedout/aborted req 0xffffff80005dad20:40274 mpt0: completing timedout/aborted req 0xffffff80005d6eb0:40273 mpt0: completing timedout/aborted req 0xffffff80005d2e90:40272 mpt0: completing timedout/aborted req 0xffffff80005d8a40:40271 mpt0: completing timedout/aborted req 0xffffff80005d4750:40270 mpt0: completing timedout/aborted req 0xffffff80005db110:40269 mpt0: completing timedout/aborted req 0xffffff80005dae40:40268 mpt0: abort of req 0xffffff80005dae40:0 completed mpt0: request 0xffffff80005d93d0:40279 timed out for ccb = 0xffffff0005c78800 (req->ccb 0xffffff0005c78800) mpt0: request 0xffffff80005daff0:40280 timed out for ccb = 0xffffff0170c5d000 (req->ccb 0xffffff0170c5d000) mpt0: attempting to abort req 0xffffff80005d93d0:40279 function 0 mpt0: request 0xffffff80005d2080:40281 timed out for ccb = 0xffffff0005f30800 (req->ccb 0xffffff0005f30800) mpt0: request 0xffffff80005cf020:40282 timed out for ccb = 0xffffff0005c3e800 (req->ccb 0xffffff0005c3e800) mpt0: request 0xffffff80005d3160:40283 timed out for ccb = 0xffffff0170c54000 (req->ccb 0xffffff0170c54000) mpt0: request 0xffffff80005d1930:40284 timed out for ccb = 0xffffff0005c45000 (req->ccb 0xffffff0005c45000) mpt0: request 0xffffff80005d2860:40285 timed out for ccb = 0xffffff0005c79800 (req->ccb 0xffffff0005c79800) mpt0: request 0xffffff80005ccdd0:40286 timed out for ccb = 0xffffff0170c5d800 (req->ccb 0xffffff0170c5d800) mpt0: request 0xffffff80005da540:40287 timed out for ccb = 0xffffff0005f2f000 (req->ccb 0xffffff0005f2f000) mpt0: request 0xffffff80005d1d20:40288 timed out for ccb = 0xffffff012db85000 (req->ccb 0xffffff012db85000) mpt0: completing timedout/aborted req 0xffffff80005d1d20:40288 mpt0: completing timedout/aborted req 0xffffff80005da540:40287 mpt0: completing timedout/aborted req 0xffffff80005ccdd0:40286 mpt0: completing timedout/aborted req 0xffffff80005d2860:40285 mpt0: completing timedout/aborted req 0xffffff80005d1930:40284 mpt0: completing timedout/aborted req 0xffffff80005d3160:40283 mpt0: completing timedout/aborted req 0xffffff80005cf020:40282 mpt0: completing timedout/aborted req 0xffffff80005d2080:40281 mpt0: completing timedout/aborted req 0xffffff80005daff0:40280 mpt0: completing timedout/aborted req 0xffffff80005d93d0:40279 mpt0: abort of req 0xffffff80005d93d0:0 completed mpt0: request 0xffffff80005cd400:40290 timed out for ccb = 0xffffff0005c45000 (req->ccb 0xffffff0005c45000) mpt0: request 0xffffff80005d73c0:40291 timed out for ccb = 0xffffff0005c78800 (req->ccb 0xffffff0005c78800) mpt0: attempting to abort req 0xffffff80005cd400:40290 function 0 mpt0: request 0xffffff80005d2e00:40292 timed out for ccb = 0xffffff0170c5d000 (req->ccb 0xffffff0170c5d000) mpt0: request 0xffffff80005ccf80:40293 timed out for ccb = 0xffffff0005f30800 (req->ccb 0xffffff0005f30800) mpt0: request 0xffffff80005cffe0:40294 timed out for ccb = 0xffffff0005c3e800 (req->ccb 0xffffff0005c3e800) mpt0: request 0xffffff80005d3550:40295 timed out for ccb = 0xffffff0170c54000 (req->ccb 0xffffff0170c54000) mpt0: request 0xffffff80005cc950:40296 timed out for ccb = 0xffffff0005c79800 (req->ccb 0xffffff0005c79800) mpt0: request 0xffffff80005d8260:40297 timed out for ccb = 0xffffff0170c5d800 (req->ccb 0xffffff0170c5d800) mpt0: request 0xffffff80005ceba0:40298 timed out for ccb = 0xffffff0005f2f000 (req->ccb 0xffffff0005f2f000) mpt0: request 0xffffff80005d1270:40299 timed out for ccb = 0xffffff012db85000 (req->ccb 0xffffff012db85000) mpt0: completing timedout/aborted req 0xffffff80005d1270:40299 mpt0: completing timedout/aborted req 0xffffff80005ceba0:40298 mpt0: completing timedout/aborted req 0xffffff80005d8260:40297 mpt0: completing timedout/aborted req 0xffffff80005cc950:40296 mpt0: completing timedout/aborted req 0xffffff80005d3550:40295 mpt0: completing timedout/aborted req 0xffffff80005cffe0:40294 mpt0: completing timedout/aborted req 0xffffff80005ccf80:40293 mpt0: completing timedout/aborted req 0xffffff80005d2e00:40292 mpt0: completing timedout/aborted req 0xffffff80005d73c0:40291 mpt0: completing timedout/aborted req 0xffffff80005cd400:40290 mpt0: abort of req 0xffffff80005cd400:0 completed mpt0: request 0xffffff80005ce060:40301 timed out for ccb = 0xffffff0170c5d800 (req->ccb 0xffffff0170c5d800) mpt0: request 0xffffff80005ce210:40302 timed out for ccb = 0xffffff0005f2f000 (req->ccb 0xffffff0005f2f000) mpt0: attempting to abort req 0xffffff80005ce060:40301 function 0 mpt0: request 0xffffff80005d3a60:40303 timed out for ccb = 0xffffff012db85000 (req->ccb 0xffffff012db85000) mpt0: request 0xffffff80005cde20:40304 timed out for ccb = 0xffffff0170c54000 (req->ccb 0xffffff0170c54000) mpt0: request 0xffffff80005cbc60:40305 timed out for ccb = 0xffffff0005c79800 (req->ccb 0xffffff0005c79800) mpt0: request 0xffffff80005db7d0:40306 timed out for ccb = 0xffffff0005f30800 (req->ccb 0xffffff0005f30800) mpt0: request 0xffffff80005cbe10:40307 timed out for ccb = 0xffffff0005c3e800 (req->ccb 0xffffff0005c3e800) mpt0: request 0xffffff80005cd7f0:40308 timed out for ccb = 0xffffff0005c78800 (req->ccb 0xffffff0005c78800) mpt0: request 0xffffff80005d0850:40309 timed out for ccb = 0xffffff0170c5d000 (req->ccb 0xffffff0170c5d000) mpt0: request 0xffffff80005d1030:40310 timed out for ccb = 0xffffff0005c45000 (req->ccb 0xffffff0005c45000) mpt0: completing timedout/aborted req 0xffffff80005d1030:40310 mpt0: completing timedout/aborted req 0xffffff80005d0850:40309 mpt0: completing timedout/aborted req 0xffffff80005cd7f0:40308 mpt0: completing timedout/aborted req 0xffffff80005cbe10:40307 mpt0: completing timedout/aborted req 0xffffff80005db7d0:40306 mpt0: completing timedout/aborted req 0xffffff80005cbc60:40305 mpt0: completing timedout/aborted req 0xffffff80005cde20:40304 mpt0: completing timedout/aborted req 0xffffff80005d3a60:40303 mpt0: completing timedout/aborted req 0xffffff80005ce210:40302 mpt0: completing timedout/aborted req 0xffffff80005ce060:40301 mpt0: abort of req 0xffffff80005ce060:0 completed mpt0: request 0xffffff80005cfd10:40312 timed out for ccb = 0xffffff0005c45000 (req->ccb 0xffffff0005c45000) mpt0: request 0xffffff80005d2350:40313 timed out for ccb = 0xffffff0005c78800 (req->ccb 0xffffff0005c78800) mpt0: attempting to abort req 0xffffff80005cfd10:40312 function 0 mpt0: request 0xffffff80005cdd90:40314 timed out for ccb = 0xffffff0170c5d000 (req->ccb 0xffffff0170c5d000) mpt0: request 0xffffff80005dbce0:40315 timed out for ccb = 0xffffff0005f30800 (req->ccb 0xffffff0005f30800) mpt0: request 0xffffff80005d47e0:40316 timed out for ccb = 0xffffff0005c3e800 (req->ccb 0xffffff0005c3e800) mpt0: request 0xffffff80005ce450:40317 timed out for ccb = 0xffffff0170c54000 (req->ccb 0xffffff0170c54000) mpt0: request 0xffffff80005d7c30:40318 timed out for ccb = 0xffffff0005c79800 (req->ccb 0xffffff0005c79800) mpt0: request 0xffffff80005d2470:40319 timed out for ccb = 0xffffff012db85000 (req->ccb 0xffffff012db85000) mpt0: request 0xffffff80005cb5a0:40320 timed out for ccb = 0xffffff0170c5d800 (req->ccb 0xffffff0170c5d800) mpt0: request 0xffffff80005cc8c0:40321 timed out for ccb = 0xffffff0005f2f000 (req->ccb 0xffffff0005f2f000) mpt0: completing timedout/aborted req 0xffffff80005cc8c0:40321 mpt0: completing timedout/aborted req 0xffffff80005cb5a0:40320 mpt0: completing timedout/aborted req 0xffffff80005d2470:40319 mpt0: completing timedout/aborted req 0xffffff80005d7c30:40318 mpt0: completing timedout/aborted req 0xffffff80005ce450:40317 mpt0: completing timedout/aborted req 0xffffff80005d47e0:40316 mpt0: completing timedout/aborted req 0xffffff80005dbce0:40315 mpt0: completing timedout/aborted req 0xffffff80005cdd90:40314 mpt0: completing timedout/aborted req 0xffffff80005d2350:40313 mpt0: completing timedout/aborted req 0xffffff80005cfd10:40312 mpt0: abort of req 0xffffff80005cfd10:0 completed mpt0: request 0xffffff80005db2c0:40323 timed out for ccb = 0xffffff0170c5d800 (req->ccb 0xffffff0170c5d800) mpt0: request 0xffffff80005d3b80:40324 timed out for ccb = 0xffffff0005f2f000 (req->ccb 0xffffff0005f2f000) mpt0: attempting to abort req 0xffffff80005db2c0:40323 function 0 mpt0: request 0xffffff80005d7f00:40325 timed out for ccb = 0xffffff012db85000 (req->ccb 0xffffff012db85000) mpt0: request 0xffffff80005d4d80:40326 timed out for ccb = 0xffffff0170c54000 (req->ccb 0xffffff0170c54000) mpt0: request 0xffffff80005db470:40327 timed out for ccb = 0xffffff0005c79800 (req->ccb 0xffffff0005c79800) mpt0: request 0xffffff80005dc3a0:40328 timed out for ccb = 0xffffff0005f30800 (req->ccb 0xffffff0005f30800) mpt0: request 0xffffff80005d2980:40329 timed out for ccb = 0xffffff0005c3e800 (req->ccb 0xffffff0005c3e800) mpt0: request 0xffffff80005d72a0:40330 timed out for ccb = 0xffffff0005c78800 (req->ccb 0xffffff0005c78800) mpt0: request 0xffffff80005d78d0:40331 timed out for ccb = 0xffffff0170c5d000 (req->ccb 0xffffff0170c5d000) mpt0: request 0xffffff80005d0f10:40332 timed out for ccb = 0xffffff0005c45000 (req->ccb 0xffffff0005c45000) mpt0: completing timedout/aborted req 0xffffff80005d0f10:40332 mpt0: completing timedout/aborted req 0xffffff80005d78d0:40331 mpt0: completing timedout/aborted req 0xffffff80005d72a0:40330 mpt0: completing timedout/aborted req 0xffffff80005d2980:40329 mpt0: completing timedout/aborted req 0xffffff80005dc3a0:40328 mpt0: completing timedout/aborted req 0xffffff80005db470:40327 mpt0: completing timedout/aborted req 0xffffff80005d4d80:40326 mpt0: completing timedout/aborted req 0xffffff80005d7f00:40325 mpt0: completing timedout/aborted req 0xffffff80005d3b80:40324 mpt0: completing timedout/aborted req 0xffffff80005db2c0:40323 mpt0: abort of req 0xffffff80005db2c0:0 completed mpt0: request 0xffffff80005d5320:40334 timed out for ccb = 0xffffff0005c45000 (req->ccb 0xffffff0005c45000) mpt0: request 0xffffff80005cc050:40335 timed out for ccb = 0xffffff0005c78800 (req->ccb 0xffffff0005c78800) mpt0: attempting to abort req 0xffffff80005d5320:40334 function 0 mpt0: request 0xffffff80005d2a10:40336 timed out for ccb = 0xffffff0170c5d000 (req->ccb 0xffffff0170c5d000) mpt0: request 0xffffff80005d7690:40337 timed out for ccb = 0xffffff0005f30800 (req->ccb 0xffffff0005f30800) mpt0: request 0xffffff80005d8770:40338 timed out for ccb = 0xffffff0005c3e800 (req->ccb 0xffffff0005c3e800) mpt0: request 0xffffff80005d6d00:40339 timed out for ccb = 0xffffff0170c54000 (req->ccb 0xffffff0170c54000) mpt0: request 0xffffff80005d92b0:40340 timed out for ccb = 0xffffff0005c79800 (req->ccb 0xffffff0005c79800) mpt0: request 0xffffff80005ce330:40341 timed out for ccb = 0xffffff0005f2f000 (req->ccb 0xffffff0005f2f000) mpt0: request 0xffffff80005d84a0:40342 timed out for ccb = 0xffffff012db85000 (req->ccb 0xffffff012db85000) mpt0: request 0xffffff80005d0220:40343 timed out for ccb = 0xffffff0170c5d800 (req->ccb 0xffffff0170c5d800) mpt0: completing timedout/aborted req 0xffffff80005d0220:40343 mpt0: completing timedout/aborted req 0xffffff80005d84a0:40342 mpt0: completing timedout/aborted req 0xffffff80005ce330:40341 mpt0: completing timedout/aborted req 0xffffff80005d92b0:40340 mpt0: completing timedout/aborted req 0xffffff80005d6d00:40339 mpt0: completing timedout/aborted req 0xffffff80005d8770:40338 mpt0: completing timedout/aborted req 0xffffff80005d7690:40337 mpt0: completing timedout/aborted req 0xffffff80005d2a10:40336 mpt0: completing timedout/aborted req 0xffffff80005cc050:40335 mpt0: completing timedout/aborted req 0xffffff80005d5320:40334 mpt0: abort of req 0xffffff80005d5320:0 completed mpt0: request 0xffffff80005cc4d0:40345 timed out for ccb = 0xffffff0005f30800 (req->ccb 0xffffff0005f30800) mpt0: request 0xffffff80005cdac0:40346 timed out for ccb = 0xffffff0005c78800 (req->ccb 0xffffff0005c78800) mpt0: attempting to abort req 0xffffff80005cc4d0:40345 function 0 mpt0: request 0xffffff80005dc670:40347 timed out for ccb = 0xffffff0005c45000 (req->ccb 0xffffff0005c45000) mpt0: request 0xffffff80005dc940:40348 timed out for ccb = 0xffffff0170c5d000 (req->ccb 0xffffff0170c5d000) mpt0: request 0xffffff80005d1810:40349 timed out for ccb = 0xffffff0005c3e800 (req->ccb 0xffffff0005c3e800) mpt0: request 0xffffff80005cd520:40350 timed out for ccb = 0xffffff0170c54000 (req->ccb 0xffffff0170c54000) mpt0: request 0xffffff80005db6b0:40351 timed out for ccb = 0xffffff0005c79800 (req->ccb 0xffffff0005c79800) mpt0: request 0xffffff80005d1390:40352 timed out for ccb = 0xffffff0005f2f000 (req->ccb 0xffffff0005f2f000) mpt0: request 0xffffff80005d6520:40353 timed out for ccb = 0xffffff012db85000 (req->ccb 0xffffff012db85000) mpt0: request 0xffffff80005cf1d0:40354 timed out for ccb = 0xffffff0170c5d800 (req->ccb 0xffffff0170c5d800) mpt0: completing timedout/aborted req 0xffffff80005cf1d0:40354 mpt0: completing timedout/aborted req 0xffffff80005d6520:40353 mpt0: completing timedout/aborted req 0xffffff80005d1390:40352 mpt0: completing timedout/aborted req 0xffffff80005db6b0:40351 mpt0: completing timedout/aborted req 0xffffff80005cd520:40350 mpt0: completing timedout/aborted req 0xffffff80005d1810:40349 mpt0: completing timedout/aborted req 0xffffff80005dc940:40348 mpt0: completing timedout/aborted req 0xffffff80005dc670:40347 mpt0: completing timedout/aborted req 0xffffff80005cdac0:40346 mpt0: completing timedout/aborted req 0xffffff80005cc4d0:40345 mpt0: abort of req 0xffffff80005cc4d0:0 completed And just in case, this is my zpool status just before that: pool: tank state: ONLINE scrub: none requested config: NAME STATE READ WRITE CKSUM tank ONLINE 0 0 0 raidz1 ONLINE 0 0 0 da0 ONLINE 0 0 0 da1 ONLINE 0 0 0 da2 ONLINE 0 0 0 da3 ONLINE 0 0 0 da4 ONLINE 0 0 0 da5 ONLINE 0 0 0 raidz1 ONLINE 0 0 0 da6 ONLINE 0 0 0 da7 ONLINE 0 0 0 da8 ONLINE 0 0 0 da9 ONLINE 0 0 0 da10 ONLINE 0 0 0 da11 ONLINE 0 0 0 raidz1 ONLINE 0 0 0 da12 ONLINE 0 0 0 da13 ONLINE 0 0 0 da14 ONLINE 0 0 0 da15 ONLINE 0 0 0 da16 ONLINE 0 0 0 da17 ONLINE 0 0 0 raidz1 ONLINE 0 0 0 da18 ONLINE 0 0 0 da19 ONLINE 0 0 0 da20 ONLINE 0 0 0 da21 ONLINE 0 0 0 da22 ONLINE 0 0 0 da23 ONLINE 0 0 0 raidz1 ONLINE 0 0 0 da24 ONLINE 0 0 0 da25 ONLINE 0 0 0 da26 ONLINE 0 0 0 da27 ONLINE 0 0 0 da28 ONLINE 0 0 0 da29 ONLINE 0 0 0 raidz1 ONLINE 0 0 0 da30 ONLINE 0 0 0 da31 ONLINE 0 0 0 da32 ONLINE 0 0 0 da33 ONLINE 0 0 0 da34 ONLINE 0 0 0 da35 ONLINE 0 0 0 errors: No known data errors If I try to do for instance "camcontrol eject da0" first, I only get: = "Error received from stop unit command" Any idea why the mpt-driver reacts this way when I pull out a disk that = is meant to be hot-swappable? Is it something in the driver? Something = in the hardware? Somthing known? Something that I've misunderstood about = being able to replace disks? Cheers Nik=