From owner-freebsd-scsi@FreeBSD.ORG Mon Aug 30 11:07:05 2010 Return-Path: Delivered-To: freebsd-scsi@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id E57201065679 for ; Mon, 30 Aug 2010 11:07:05 +0000 (UTC) (envelope-from owner-bugmaster@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id D3B4A8FC29 for ; Mon, 30 Aug 2010 11:07:05 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.4/8.14.4) with ESMTP id o7UB75uj087544 for ; Mon, 30 Aug 2010 11:07:05 GMT (envelope-from owner-bugmaster@FreeBSD.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.4/8.14.4/Submit) id o7UB75wS087542 for freebsd-scsi@FreeBSD.org; Mon, 30 Aug 2010 11:07:05 GMT (envelope-from owner-bugmaster@FreeBSD.org) Date: Mon, 30 Aug 2010 11:07:05 GMT Message-Id: <201008301107.o7UB75wS087542@freefall.freebsd.org> X-Authentication-Warning: freefall.freebsd.org: gnats set sender to owner-bugmaster@FreeBSD.org using -f From: FreeBSD bugmaster To: freebsd-scsi@FreeBSD.org Cc: Subject: Current problem reports assigned to freebsd-scsi@FreeBSD.org X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 30 Aug 2010 11:07:06 -0000 Note: to view an individual PR, use: http://www.freebsd.org/cgi/query-pr.cgi?pr=(number). The following is a listing of current problems submitted by FreeBSD users. These represent problem reports covering all versions including experimental development code and obsolete releases. S Tracker Resp. Description -------------------------------------------------------------------------------- o kern/149502 scsi [mpt] Latent buglet in debug print code o kern/148785 scsi [twa] [patch] twa driver doesn't pass proper max. io s o kern/148083 scsi [aac] Strange device reporting o kern/147704 scsi [mpt] sys/dev/mpt: new chip revision, partially unsupp o kern/146287 scsi [ciss] ciss(4) cannot see more than one SmartArray con o kern/145768 scsi [mpt] can't perform I/O on SAS based SAN disk in freeb o kern/144648 scsi [aac] Strange values of speed and bus width in dmesg o kern/144301 scsi [ciss] [hang] HP proliant server locks when using ciss o kern/142351 scsi [mpt] LSILogic driver performance problems o kern/141934 scsi [cam] [patch] add support for SEAGATE DAT Scopion 130 o kern/134488 scsi [mpt] MPT SCSI driver probes max. 8 LUNs per device o kern/132250 scsi [ciss] ciss driver does not support more then 15 drive o kern/132206 scsi [mpt] system panics on boot when mirroring and 2nd dri p kern/130735 scsi [cam] [patch] pass M_NOWAIT to the malloc() call insid o kern/130621 scsi [mpt] tranfer rate is inscrutable slow when use lsi213 o kern/129602 scsi [ahd] ahd(4) gets confused and wedges SCSI bus o kern/128452 scsi [sa] [panic] Accessing SCSI tape drive randomly crashe o kern/128245 scsi [scsi] "inquiry data fails comparison at DV1 step" [re o kern/127927 scsi [isp] isp(4) target driver crashes kernel when set up o kern/124667 scsi [amd] [panic] FreeBSD-7 kernel page faults at amd-scsi o kern/123674 scsi [ahc] ahc driver dumping o sparc/121676 scsi [iscsi] iscontrol do not connect iscsi-target on sparc o kern/120487 scsi [sg] scsi_sg incompatible with scanners o kern/120247 scsi [mpt] FreeBSD 6.3 and LSI Logic 1030 = only 3.300MB/s o kern/119668 scsi [cam] [patch] certain errors are too verbose comparing o kern/114597 scsi [sym] System hangs at SCSI bus reset with dual HBAs o kern/110847 scsi [ahd] Tyan U320 onboard problem with more than 3 disks o kern/99954 scsi [ahc] reading from DVD failes on 6.x [regression] o kern/94838 scsi Kernel panic while mounting SD card with lock switch o o kern/92798 scsi [ahc] SCSI problem with timeouts o kern/90282 scsi [sym] SCSI bus resets cause loss of ch device o kern/76178 scsi [ahd] Problem with ahd and large SCSI Raid system o kern/74627 scsi [ahc] [hang] Adaptec 2940U2W Can't boot 5.3 s kern/61165 scsi [panic] kernel page fault after calling cam_send_ccb o kern/60641 scsi [sym] Sporadic SCSI bus resets with 53C810 under load o kern/60598 scsi wire down of scsi devices conflicts with config s kern/57398 scsi [mly] Current fails to install on mly(4) based RAID di o kern/52638 scsi [panic] SCSI U320 on SMP server won't run faster than o kern/44587 scsi dev/dpt/dpt.h is missing defines required for DPT_HAND o kern/40895 scsi wierd kernel / device driver bug o kern/39388 scsi ncr/sym drivers fail with 53c810 and more than 256MB m o kern/35234 scsi World access to /dev/pass? (for scanner) requires acce 42 problems total. From owner-freebsd-scsi@FreeBSD.ORG Fri Sep 3 07:04:42 2010 Return-Path: Delivered-To: freebsd-scsi@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id AFED61065808 for ; Fri, 3 Sep 2010 07:04:42 +0000 (UTC) (envelope-from niklas@saers.com) Received: from mail-fx0-f54.google.com (mail-fx0-f54.google.com [209.85.161.54]) by mx1.freebsd.org (Postfix) with ESMTP id 159498FC25 for ; Fri, 3 Sep 2010 07:04:41 +0000 (UTC) Received: by fxm4 with SMTP id 4so1013545fxm.13 for ; Fri, 03 Sep 2010 00:04:41 -0700 (PDT) Received: by 10.223.112.203 with SMTP id x11mr171442fap.68.1283496179227; Thu, 02 Sep 2010 23:42:59 -0700 (PDT) Received: from [10.32.100.120] (webmail.danskscanning.dk [89.184.151.254]) by mx.google.com with ESMTPS id 10sm674114fax.18.2010.09.02.23.42.57 (version=TLSv1/SSLv3 cipher=RC4-MD5); Thu, 02 Sep 2010 23:42:58 -0700 (PDT) From: Niklas Saers Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Date: Fri, 3 Sep 2010 08:42:54 +0200 Message-Id: To: freebsd-scsi@freebsd.org Mime-Version: 1.0 (Apple Message framework v1081) X-Mailer: Apple Mail (2.1081) Subject: mpt0 and removing disks X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 03 Sep 2010 07:04:42 -0000 Hi guys, We've just been delivered a system that I'm testing, consisting of: - SuperMicro CSE-847E16-R1400LPB (4U, PSU 2x1400W (1+1), SAS2 expander) - SuperMicro X8DTL-iF LGA1366 Single - Intel Xeon E5620 2,4GHz, 12MB cache TRAY - 3x Hynix RAM 4 GB DDR3 1333 Reg. ECC - LSI SAS3081E-R, 8-port int. SAS - kit (CIe x8, 8-port SAS/SATA, 0, 1, = 1E, JBOD) - 3ware ML SFF-8087 til ML SFF-8087 0,6m (SAS cable, connect SFF-8087 = Controller) - 36x Samsung 2TB SATAII/5400 HD203WI (8.9ms, 32MB Cache, EcoGreen F2) The system will be a backup server running ZFS on FreeBSD 8.1, and I'm = more concerned with stability and volume size pr dollar than I am about = performance, hence the 2TB SATA drives. Now, I've installed FreeBSD and set the disks up to 6x raidz1 with six = disks in each raidz1. Not necessarily the best configuration, but that's = not the issue for this discussion. The problem is that when I pull a = disk out (thus simulating it failing), the entire disk array stops, and = I cannot even do a 'reboot now', I have to cold boot the machine to get = it back online again. This is me removing the disk that should be da0 while it's running: mpt0: mpt_cam_event: 0x16 mpt0: mpt_cam_event: 0x12 mpt0: mpt_cam_event: 0x16 mpt0: mpt_cam_event: 0x16 mpt0: mpt_cam_event: 0x12 mpt0: mpt_cam_event: 0x16 mpt0: mpt_cam_event: 0x16 mpt0: mpt_cam_event: 0x12 mpt0: mpt_cam_event: 0x16 mpt0: request 0xffffff80005cbea0:40191 timed out for ccb = 0xffffff0170c5d800 (req->ccb 0xffffff0170c5d800) mpt0: request 0xffffff80005d4f30:40192 timed out for ccb = 0xffffff012db85000 (req->ccb 0xffffff012db85000) mpt0: attempting to abort req 0xffffff80005cbea0:40191 function 0 mpt0: request 0xffffff80005cb2d0:40193 timed out for ccb = 0xffffff0005f2f000 (req->ccb 0xffffff0005f2f000) mpt0: request 0xffffff80005db3e0:40194 timed out for ccb = 0xffffff0005c45000 (req->ccb 0xffffff0005c45000) mpt0: request 0xffffff80005d9c40:40195 timed out for ccb = 0xffffff0005c79800 (req->ccb 0xffffff0005c79800) mpt0: request 0xffffff80005d1ae0:40196 timed out for ccb = 0xffffff0005c3e800 (req->ccb 0xffffff0005c3e800) mpt0: request 0xffffff80005dbb30:40197 timed out for ccb = 0xffffff0170c54000 (req->ccb 0xffffff0170c54000) mpt0: request 0xffffff80005da930:40198 timed out for ccb = 0xffffff0170c5d000 (req->ccb 0xffffff0170c5d000) mpt0: request 0xffffff80005d6e20:40199 timed out for ccb = 0xffffff0005f30800 (req->ccb 0xffffff0005f30800) mpt0: request 0xffffff80005d9610:40200 timed out for ccb = 0xffffff0005c78800 (req->ccb 0xffffff0005c78800) mpt0: completing timedout/aborted req 0xffffff80005d9610:40200 mpt0: completing timedout/aborted req 0xffffff80005d6e20:40199 mpt0: completing timedout/aborted req 0xffffff80005da930:40198 mpt0: completing timedout/aborted req 0xffffff80005dbb30:40197 mpt0: completing timedout/aborted req 0xffffff80005d1ae0:40196 mpt0: completing timedout/aborted req 0xffffff80005d9c40:40195 mpt0: completing timedout/aborted req 0xffffff80005db3e0:40194 mpt0: completing timedout/aborted req 0xffffff80005cb2d0:40193 mpt0: completing timedout/aborted req 0xffffff80005d4f30:40192 mpt0: completing timedout/aborted req 0xffffff80005cbea0:40191 mpt0: abort of req 0xffffff80005cbea0:0 completed mpt0: request 0xffffff80005cf260:40250 timed out for ccb = 0xffffff0005c78800 (req->ccb 0xffffff0005c78800) mpt0: request 0xffffff80005d2f20:40251 timed out for ccb = 0xffffff0005f30800 (req->ccb 0xffffff0005f30800) mpt0: attempting to abort req 0xffffff80005cf260:40250 function 0 mpt0: request 0xffffff80005dc280:40252 timed out for ccb = 0xffffff0170c5d000 (req->ccb 0xffffff0170c5d000) mpt0: request 0xffffff80005d85c0:40253 timed out for ccb = 0xffffff0170c54000 (req->ccb 0xffffff0170c54000) mpt0: request 0xffffff80005dcd30:40254 timed out for ccb = 0xffffff0005c3e800 (req->ccb 0xffffff0005c3e800) mpt0: request 0xffffff80005cdbe0:40255 timed out for ccb = 0xffffff0005c79800 (req->ccb 0xffffff0005c79800) mpt0: request 0xffffff80005dcdc0:40256 timed out for ccb = 0xffffff0005c45000 (req->ccb 0xffffff0005c45000) mpt0: request 0xffffff80005d34c0:40257 timed out for ccb = 0xffffff0005f2f000 (req->ccb 0xffffff0005f2f000) mpt0: request 0xffffff80005dca60:40258 timed out for ccb = 0xffffff012db85000 (req->ccb 0xffffff012db85000) mpt0: request 0xffffff80005cd640:40259 timed out for ccb = 0xffffff0170c5d800 (req->ccb 0xffffff0170c5d800) mpt0: completing timedout/aborted req 0xffffff80005cd640:40259 mpt0: completing timedout/aborted req 0xffffff80005dca60:40258 mpt0: completing timedout/aborted req 0xffffff80005d34c0:40257 mpt0: completing timedout/aborted req 0xffffff80005dcdc0:40256 mpt0: completing timedout/aborted req 0xffffff80005cdbe0:40255 mpt0: completing timedout/aborted req 0xffffff80005dcd30:40254 mpt0: completing timedout/aborted req 0xffffff80005d85c0:40253 mpt0: completing timedout/aborted req 0xffffff80005dc280:40252 mpt0: completing timedout/aborted req 0xffffff80005d2f20:40251 mpt0: completing timedout/aborted req 0xffffff80005cf260:40250 mpt0: abort of req 0xffffff80005cf260:0 completed mpt0: request 0xffffff80005dae40:40268 timed out for ccb = 0xffffff0005f2f000 (req->ccb 0xffffff0005f2f000) mpt0: request 0xffffff80005db110:40269 timed out for ccb = 0xffffff012db85000 (req->ccb 0xffffff012db85000) mpt0: attempting to abort req 0xffffff80005dae40:40268 function 0 mpt0: request 0xffffff80005d4750:40270 timed out for ccb = 0xffffff0170c5d800 (req->ccb 0xffffff0170c5d800) mpt0: request 0xffffff80005d8a40:40271 timed out for ccb = 0xffffff0005c79800 (req->ccb 0xffffff0005c79800) mpt0: request 0xffffff80005d2e90:40272 timed out for ccb = 0xffffff0005c45000 (req->ccb 0xffffff0005c45000) mpt0: request 0xffffff80005d6eb0:40273 timed out for ccb = 0xffffff0170c54000 (req->ccb 0xffffff0170c54000) mpt0: request 0xffffff80005dad20:40274 timed out for ccb = 0xffffff0005c3e800 (req->ccb 0xffffff0005c3e800) mpt0: request 0xffffff80005ce720:40275 timed out for ccb = 0xffffff0005f30800 (req->ccb 0xffffff0005f30800) mpt0: request 0xffffff80005d62e0:40276 timed out for ccb = 0xffffff0170c5d000 (req->ccb 0xffffff0170c5d000) mpt0: request 0xffffff80005d3af0:40277 timed out for ccb = 0xffffff0005c78800 (req->ccb 0xffffff0005c78800) mpt0: completing timedout/aborted req 0xffffff80005d3af0:40277 mpt0: completing timedout/aborted req 0xffffff80005d62e0:40276 mpt0: completing timedout/aborted req 0xffffff80005ce720:40275 mpt0: completing timedout/aborted req 0xffffff80005dad20:40274 mpt0: completing timedout/aborted req 0xffffff80005d6eb0:40273 mpt0: completing timedout/aborted req 0xffffff80005d2e90:40272 mpt0: completing timedout/aborted req 0xffffff80005d8a40:40271 mpt0: completing timedout/aborted req 0xffffff80005d4750:40270 mpt0: completing timedout/aborted req 0xffffff80005db110:40269 mpt0: completing timedout/aborted req 0xffffff80005dae40:40268 mpt0: abort of req 0xffffff80005dae40:0 completed mpt0: request 0xffffff80005d93d0:40279 timed out for ccb = 0xffffff0005c78800 (req->ccb 0xffffff0005c78800) mpt0: request 0xffffff80005daff0:40280 timed out for ccb = 0xffffff0170c5d000 (req->ccb 0xffffff0170c5d000) mpt0: attempting to abort req 0xffffff80005d93d0:40279 function 0 mpt0: request 0xffffff80005d2080:40281 timed out for ccb = 0xffffff0005f30800 (req->ccb 0xffffff0005f30800) mpt0: request 0xffffff80005cf020:40282 timed out for ccb = 0xffffff0005c3e800 (req->ccb 0xffffff0005c3e800) mpt0: request 0xffffff80005d3160:40283 timed out for ccb = 0xffffff0170c54000 (req->ccb 0xffffff0170c54000) mpt0: request 0xffffff80005d1930:40284 timed out for ccb = 0xffffff0005c45000 (req->ccb 0xffffff0005c45000) mpt0: request 0xffffff80005d2860:40285 timed out for ccb = 0xffffff0005c79800 (req->ccb 0xffffff0005c79800) mpt0: request 0xffffff80005ccdd0:40286 timed out for ccb = 0xffffff0170c5d800 (req->ccb 0xffffff0170c5d800) mpt0: request 0xffffff80005da540:40287 timed out for ccb = 0xffffff0005f2f000 (req->ccb 0xffffff0005f2f000) mpt0: request 0xffffff80005d1d20:40288 timed out for ccb = 0xffffff012db85000 (req->ccb 0xffffff012db85000) mpt0: completing timedout/aborted req 0xffffff80005d1d20:40288 mpt0: completing timedout/aborted req 0xffffff80005da540:40287 mpt0: completing timedout/aborted req 0xffffff80005ccdd0:40286 mpt0: completing timedout/aborted req 0xffffff80005d2860:40285 mpt0: completing timedout/aborted req 0xffffff80005d1930:40284 mpt0: completing timedout/aborted req 0xffffff80005d3160:40283 mpt0: completing timedout/aborted req 0xffffff80005cf020:40282 mpt0: completing timedout/aborted req 0xffffff80005d2080:40281 mpt0: completing timedout/aborted req 0xffffff80005daff0:40280 mpt0: completing timedout/aborted req 0xffffff80005d93d0:40279 mpt0: abort of req 0xffffff80005d93d0:0 completed mpt0: request 0xffffff80005cd400:40290 timed out for ccb = 0xffffff0005c45000 (req->ccb 0xffffff0005c45000) mpt0: request 0xffffff80005d73c0:40291 timed out for ccb = 0xffffff0005c78800 (req->ccb 0xffffff0005c78800) mpt0: attempting to abort req 0xffffff80005cd400:40290 function 0 mpt0: request 0xffffff80005d2e00:40292 timed out for ccb = 0xffffff0170c5d000 (req->ccb 0xffffff0170c5d000) mpt0: request 0xffffff80005ccf80:40293 timed out for ccb = 0xffffff0005f30800 (req->ccb 0xffffff0005f30800) mpt0: request 0xffffff80005cffe0:40294 timed out for ccb = 0xffffff0005c3e800 (req->ccb 0xffffff0005c3e800) mpt0: request 0xffffff80005d3550:40295 timed out for ccb = 0xffffff0170c54000 (req->ccb 0xffffff0170c54000) mpt0: request 0xffffff80005cc950:40296 timed out for ccb = 0xffffff0005c79800 (req->ccb 0xffffff0005c79800) mpt0: request 0xffffff80005d8260:40297 timed out for ccb = 0xffffff0170c5d800 (req->ccb 0xffffff0170c5d800) mpt0: request 0xffffff80005ceba0:40298 timed out for ccb = 0xffffff0005f2f000 (req->ccb 0xffffff0005f2f000) mpt0: request 0xffffff80005d1270:40299 timed out for ccb = 0xffffff012db85000 (req->ccb 0xffffff012db85000) mpt0: completing timedout/aborted req 0xffffff80005d1270:40299 mpt0: completing timedout/aborted req 0xffffff80005ceba0:40298 mpt0: completing timedout/aborted req 0xffffff80005d8260:40297 mpt0: completing timedout/aborted req 0xffffff80005cc950:40296 mpt0: completing timedout/aborted req 0xffffff80005d3550:40295 mpt0: completing timedout/aborted req 0xffffff80005cffe0:40294 mpt0: completing timedout/aborted req 0xffffff80005ccf80:40293 mpt0: completing timedout/aborted req 0xffffff80005d2e00:40292 mpt0: completing timedout/aborted req 0xffffff80005d73c0:40291 mpt0: completing timedout/aborted req 0xffffff80005cd400:40290 mpt0: abort of req 0xffffff80005cd400:0 completed mpt0: request 0xffffff80005ce060:40301 timed out for ccb = 0xffffff0170c5d800 (req->ccb 0xffffff0170c5d800) mpt0: request 0xffffff80005ce210:40302 timed out for ccb = 0xffffff0005f2f000 (req->ccb 0xffffff0005f2f000) mpt0: attempting to abort req 0xffffff80005ce060:40301 function 0 mpt0: request 0xffffff80005d3a60:40303 timed out for ccb = 0xffffff012db85000 (req->ccb 0xffffff012db85000) mpt0: request 0xffffff80005cde20:40304 timed out for ccb = 0xffffff0170c54000 (req->ccb 0xffffff0170c54000) mpt0: request 0xffffff80005cbc60:40305 timed out for ccb = 0xffffff0005c79800 (req->ccb 0xffffff0005c79800) mpt0: request 0xffffff80005db7d0:40306 timed out for ccb = 0xffffff0005f30800 (req->ccb 0xffffff0005f30800) mpt0: request 0xffffff80005cbe10:40307 timed out for ccb = 0xffffff0005c3e800 (req->ccb 0xffffff0005c3e800) mpt0: request 0xffffff80005cd7f0:40308 timed out for ccb = 0xffffff0005c78800 (req->ccb 0xffffff0005c78800) mpt0: request 0xffffff80005d0850:40309 timed out for ccb = 0xffffff0170c5d000 (req->ccb 0xffffff0170c5d000) mpt0: request 0xffffff80005d1030:40310 timed out for ccb = 0xffffff0005c45000 (req->ccb 0xffffff0005c45000) mpt0: completing timedout/aborted req 0xffffff80005d1030:40310 mpt0: completing timedout/aborted req 0xffffff80005d0850:40309 mpt0: completing timedout/aborted req 0xffffff80005cd7f0:40308 mpt0: completing timedout/aborted req 0xffffff80005cbe10:40307 mpt0: completing timedout/aborted req 0xffffff80005db7d0:40306 mpt0: completing timedout/aborted req 0xffffff80005cbc60:40305 mpt0: completing timedout/aborted req 0xffffff80005cde20:40304 mpt0: completing timedout/aborted req 0xffffff80005d3a60:40303 mpt0: completing timedout/aborted req 0xffffff80005ce210:40302 mpt0: completing timedout/aborted req 0xffffff80005ce060:40301 mpt0: abort of req 0xffffff80005ce060:0 completed mpt0: request 0xffffff80005cfd10:40312 timed out for ccb = 0xffffff0005c45000 (req->ccb 0xffffff0005c45000) mpt0: request 0xffffff80005d2350:40313 timed out for ccb = 0xffffff0005c78800 (req->ccb 0xffffff0005c78800) mpt0: attempting to abort req 0xffffff80005cfd10:40312 function 0 mpt0: request 0xffffff80005cdd90:40314 timed out for ccb = 0xffffff0170c5d000 (req->ccb 0xffffff0170c5d000) mpt0: request 0xffffff80005dbce0:40315 timed out for ccb = 0xffffff0005f30800 (req->ccb 0xffffff0005f30800) mpt0: request 0xffffff80005d47e0:40316 timed out for ccb = 0xffffff0005c3e800 (req->ccb 0xffffff0005c3e800) mpt0: request 0xffffff80005ce450:40317 timed out for ccb = 0xffffff0170c54000 (req->ccb 0xffffff0170c54000) mpt0: request 0xffffff80005d7c30:40318 timed out for ccb = 0xffffff0005c79800 (req->ccb 0xffffff0005c79800) mpt0: request 0xffffff80005d2470:40319 timed out for ccb = 0xffffff012db85000 (req->ccb 0xffffff012db85000) mpt0: request 0xffffff80005cb5a0:40320 timed out for ccb = 0xffffff0170c5d800 (req->ccb 0xffffff0170c5d800) mpt0: request 0xffffff80005cc8c0:40321 timed out for ccb = 0xffffff0005f2f000 (req->ccb 0xffffff0005f2f000) mpt0: completing timedout/aborted req 0xffffff80005cc8c0:40321 mpt0: completing timedout/aborted req 0xffffff80005cb5a0:40320 mpt0: completing timedout/aborted req 0xffffff80005d2470:40319 mpt0: completing timedout/aborted req 0xffffff80005d7c30:40318 mpt0: completing timedout/aborted req 0xffffff80005ce450:40317 mpt0: completing timedout/aborted req 0xffffff80005d47e0:40316 mpt0: completing timedout/aborted req 0xffffff80005dbce0:40315 mpt0: completing timedout/aborted req 0xffffff80005cdd90:40314 mpt0: completing timedout/aborted req 0xffffff80005d2350:40313 mpt0: completing timedout/aborted req 0xffffff80005cfd10:40312 mpt0: abort of req 0xffffff80005cfd10:0 completed mpt0: request 0xffffff80005db2c0:40323 timed out for ccb = 0xffffff0170c5d800 (req->ccb 0xffffff0170c5d800) mpt0: request 0xffffff80005d3b80:40324 timed out for ccb = 0xffffff0005f2f000 (req->ccb 0xffffff0005f2f000) mpt0: attempting to abort req 0xffffff80005db2c0:40323 function 0 mpt0: request 0xffffff80005d7f00:40325 timed out for ccb = 0xffffff012db85000 (req->ccb 0xffffff012db85000) mpt0: request 0xffffff80005d4d80:40326 timed out for ccb = 0xffffff0170c54000 (req->ccb 0xffffff0170c54000) mpt0: request 0xffffff80005db470:40327 timed out for ccb = 0xffffff0005c79800 (req->ccb 0xffffff0005c79800) mpt0: request 0xffffff80005dc3a0:40328 timed out for ccb = 0xffffff0005f30800 (req->ccb 0xffffff0005f30800) mpt0: request 0xffffff80005d2980:40329 timed out for ccb = 0xffffff0005c3e800 (req->ccb 0xffffff0005c3e800) mpt0: request 0xffffff80005d72a0:40330 timed out for ccb = 0xffffff0005c78800 (req->ccb 0xffffff0005c78800) mpt0: request 0xffffff80005d78d0:40331 timed out for ccb = 0xffffff0170c5d000 (req->ccb 0xffffff0170c5d000) mpt0: request 0xffffff80005d0f10:40332 timed out for ccb = 0xffffff0005c45000 (req->ccb 0xffffff0005c45000) mpt0: completing timedout/aborted req 0xffffff80005d0f10:40332 mpt0: completing timedout/aborted req 0xffffff80005d78d0:40331 mpt0: completing timedout/aborted req 0xffffff80005d72a0:40330 mpt0: completing timedout/aborted req 0xffffff80005d2980:40329 mpt0: completing timedout/aborted req 0xffffff80005dc3a0:40328 mpt0: completing timedout/aborted req 0xffffff80005db470:40327 mpt0: completing timedout/aborted req 0xffffff80005d4d80:40326 mpt0: completing timedout/aborted req 0xffffff80005d7f00:40325 mpt0: completing timedout/aborted req 0xffffff80005d3b80:40324 mpt0: completing timedout/aborted req 0xffffff80005db2c0:40323 mpt0: abort of req 0xffffff80005db2c0:0 completed mpt0: request 0xffffff80005d5320:40334 timed out for ccb = 0xffffff0005c45000 (req->ccb 0xffffff0005c45000) mpt0: request 0xffffff80005cc050:40335 timed out for ccb = 0xffffff0005c78800 (req->ccb 0xffffff0005c78800) mpt0: attempting to abort req 0xffffff80005d5320:40334 function 0 mpt0: request 0xffffff80005d2a10:40336 timed out for ccb = 0xffffff0170c5d000 (req->ccb 0xffffff0170c5d000) mpt0: request 0xffffff80005d7690:40337 timed out for ccb = 0xffffff0005f30800 (req->ccb 0xffffff0005f30800) mpt0: request 0xffffff80005d8770:40338 timed out for ccb = 0xffffff0005c3e800 (req->ccb 0xffffff0005c3e800) mpt0: request 0xffffff80005d6d00:40339 timed out for ccb = 0xffffff0170c54000 (req->ccb 0xffffff0170c54000) mpt0: request 0xffffff80005d92b0:40340 timed out for ccb = 0xffffff0005c79800 (req->ccb 0xffffff0005c79800) mpt0: request 0xffffff80005ce330:40341 timed out for ccb = 0xffffff0005f2f000 (req->ccb 0xffffff0005f2f000) mpt0: request 0xffffff80005d84a0:40342 timed out for ccb = 0xffffff012db85000 (req->ccb 0xffffff012db85000) mpt0: request 0xffffff80005d0220:40343 timed out for ccb = 0xffffff0170c5d800 (req->ccb 0xffffff0170c5d800) mpt0: completing timedout/aborted req 0xffffff80005d0220:40343 mpt0: completing timedout/aborted req 0xffffff80005d84a0:40342 mpt0: completing timedout/aborted req 0xffffff80005ce330:40341 mpt0: completing timedout/aborted req 0xffffff80005d92b0:40340 mpt0: completing timedout/aborted req 0xffffff80005d6d00:40339 mpt0: completing timedout/aborted req 0xffffff80005d8770:40338 mpt0: completing timedout/aborted req 0xffffff80005d7690:40337 mpt0: completing timedout/aborted req 0xffffff80005d2a10:40336 mpt0: completing timedout/aborted req 0xffffff80005cc050:40335 mpt0: completing timedout/aborted req 0xffffff80005d5320:40334 mpt0: abort of req 0xffffff80005d5320:0 completed mpt0: request 0xffffff80005cc4d0:40345 timed out for ccb = 0xffffff0005f30800 (req->ccb 0xffffff0005f30800) mpt0: request 0xffffff80005cdac0:40346 timed out for ccb = 0xffffff0005c78800 (req->ccb 0xffffff0005c78800) mpt0: attempting to abort req 0xffffff80005cc4d0:40345 function 0 mpt0: request 0xffffff80005dc670:40347 timed out for ccb = 0xffffff0005c45000 (req->ccb 0xffffff0005c45000) mpt0: request 0xffffff80005dc940:40348 timed out for ccb = 0xffffff0170c5d000 (req->ccb 0xffffff0170c5d000) mpt0: request 0xffffff80005d1810:40349 timed out for ccb = 0xffffff0005c3e800 (req->ccb 0xffffff0005c3e800) mpt0: request 0xffffff80005cd520:40350 timed out for ccb = 0xffffff0170c54000 (req->ccb 0xffffff0170c54000) mpt0: request 0xffffff80005db6b0:40351 timed out for ccb = 0xffffff0005c79800 (req->ccb 0xffffff0005c79800) mpt0: request 0xffffff80005d1390:40352 timed out for ccb = 0xffffff0005f2f000 (req->ccb 0xffffff0005f2f000) mpt0: request 0xffffff80005d6520:40353 timed out for ccb = 0xffffff012db85000 (req->ccb 0xffffff012db85000) mpt0: request 0xffffff80005cf1d0:40354 timed out for ccb = 0xffffff0170c5d800 (req->ccb 0xffffff0170c5d800) mpt0: completing timedout/aborted req 0xffffff80005cf1d0:40354 mpt0: completing timedout/aborted req 0xffffff80005d6520:40353 mpt0: completing timedout/aborted req 0xffffff80005d1390:40352 mpt0: completing timedout/aborted req 0xffffff80005db6b0:40351 mpt0: completing timedout/aborted req 0xffffff80005cd520:40350 mpt0: completing timedout/aborted req 0xffffff80005d1810:40349 mpt0: completing timedout/aborted req 0xffffff80005dc940:40348 mpt0: completing timedout/aborted req 0xffffff80005dc670:40347 mpt0: completing timedout/aborted req 0xffffff80005cdac0:40346 mpt0: completing timedout/aborted req 0xffffff80005cc4d0:40345 mpt0: abort of req 0xffffff80005cc4d0:0 completed And just in case, this is my zpool status just before that: pool: tank state: ONLINE scrub: none requested config: NAME STATE READ WRITE CKSUM tank ONLINE 0 0 0 raidz1 ONLINE 0 0 0 da0 ONLINE 0 0 0 da1 ONLINE 0 0 0 da2 ONLINE 0 0 0 da3 ONLINE 0 0 0 da4 ONLINE 0 0 0 da5 ONLINE 0 0 0 raidz1 ONLINE 0 0 0 da6 ONLINE 0 0 0 da7 ONLINE 0 0 0 da8 ONLINE 0 0 0 da9 ONLINE 0 0 0 da10 ONLINE 0 0 0 da11 ONLINE 0 0 0 raidz1 ONLINE 0 0 0 da12 ONLINE 0 0 0 da13 ONLINE 0 0 0 da14 ONLINE 0 0 0 da15 ONLINE 0 0 0 da16 ONLINE 0 0 0 da17 ONLINE 0 0 0 raidz1 ONLINE 0 0 0 da18 ONLINE 0 0 0 da19 ONLINE 0 0 0 da20 ONLINE 0 0 0 da21 ONLINE 0 0 0 da22 ONLINE 0 0 0 da23 ONLINE 0 0 0 raidz1 ONLINE 0 0 0 da24 ONLINE 0 0 0 da25 ONLINE 0 0 0 da26 ONLINE 0 0 0 da27 ONLINE 0 0 0 da28 ONLINE 0 0 0 da29 ONLINE 0 0 0 raidz1 ONLINE 0 0 0 da30 ONLINE 0 0 0 da31 ONLINE 0 0 0 da32 ONLINE 0 0 0 da33 ONLINE 0 0 0 da34 ONLINE 0 0 0 da35 ONLINE 0 0 0 errors: No known data errors If I try to do for instance "camcontrol eject da0" first, I only get: = "Error received from stop unit command" Any idea why the mpt-driver reacts this way when I pull out a disk that = is meant to be hot-swappable? Is it something in the driver? Something = in the hardware? Somthing known? Something that I've misunderstood about = being able to replace disks? Cheers Nik= From owner-freebsd-scsi@FreeBSD.ORG Fri Sep 3 07:51:11 2010 Return-Path: Delivered-To: freebsd-scsi@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 038D310658D2 for ; Fri, 3 Sep 2010 07:51:11 +0000 (UTC) (envelope-from stephane.lapie@darkbsd.org) Received: from quasar.darkbsd.org (shinigami.darkbsd.org [82.227.96.182]) by mx1.freebsd.org (Postfix) with ESMTP id 769DD8FC18 for ; Fri, 3 Sep 2010 07:51:09 +0000 (UTC) Received: from quasar.darkbsd.org (localhost [127.0.0.1]) by quasar.darkbsd.org (Postfix) with ESMTP id 837795604; Fri, 3 Sep 2010 09:35:18 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=darkbsd.org; h=message-id :date:from:mime-version:to:cc:subject:references:in-reply-to :content-type; s=selector1; bh=DejWu952C4nNbXZxE+QnRrzhfoI=; b=f TyUYDqrt2qG9AxPjumLO453ULWryDxzusR0f2Rkcgic6Kt80BPNFZgVvCABzptwY DyhUmHZBgjJ+OgzZURXSoZyhaYrcLm9Zd6aDnroKjTqDaAMwJDOoP3GPgAhNWKWJ ur+5OwlyX2ENWxGzroc0DTH1r0JWcL5xviby/wIiCw= DomainKey-Signature: a=rsa-sha1; c=nofws; d=darkbsd.org; h=message-id :date:from:mime-version:to:cc:subject:references:in-reply-to :content-type; q=dns; s=selector1; b=HDGju5olu6Uda4itytPbPRn3hUI WIvVZRMWPYIt01ZqCFQpzJSlu9iZ34Q2//wXNMCOMmpANNPMAqpC7hAR0zDC79x9 cG+/Wnfdl9NwJ4NdOb0lW0i7FRnxF1Mr6Flc7ho9oMg4bKRkuW71FuuuAqf1fueU 422b5E7H6j0j+6mU= DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=darkbsd.org; h= content-type:content-type:in-reply-to:references:subject:subject :mime-version:user-agent:from:from:date:date:message-id:received :received; s=selector1; t=1283499315; bh=ShtuZYXe5wUW7ju8KbRZi0O 7Rt4UeNUW3SOd7oP6FGk=; b=0GEruGkKNPzXe3e563JX9HSFNXtSp9vUhi4adeK /q6muY8DzPi3lldIqSZ18RWBfXgxehynEXeBa+7POnx2OdqmYTU3U2Q6XelKukkk lR1hlDTDFmN8fUZ3Y9TaNEi4v1uO0iwTBpr+JvzovdnNNVBGT/l2hP9PfwiR4L4r 7uQo= Received: from quasar.darkbsd.org ([127.0.0.1]) by quasar.darkbsd.org (quasar.darkbsd.org [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id PPZQOdGXJS-L; Fri, 3 Sep 2010 09:35:15 +0200 (CEST) Received: from [192.168.162.153] (unknown [210.188.173.245]) (Authenticated sender: darksoul) by quasar.darkbsd.org (Postfix) with ESMTPSA id C810F55FD; Fri, 3 Sep 2010 09:35:13 +0200 (CEST) Message-ID: <4C80A52A.5080300@darkbsd.org> Date: Fri, 03 Sep 2010 16:35:06 +0900 From: Stephane LAPIE User-Agent: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1.11) Gecko/20100713 Thunderbird/3.0.6 MIME-Version: 1.0 To: Niklas Saers References: In-Reply-To: X-Enigmail-Version: 1.0.1 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enigA3B28D9C7B45EE902C72C765" Cc: freebsd-scsi@freebsd.org Subject: Re: mpt0 and removing disks X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 03 Sep 2010 07:51:11 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enigA3B28D9C7B45EE902C72C765 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Hello, I have refrained so far from building configurations based on mpt-driver based controllers (namely, the LSI SAS3081E-R controllers you mention), precisely because of similiar issues :/ If you can look for "DELL SAS5/E Controller bug" in the freebsd-hardware@ archives, John Baldwin and scottl@ answered this question previously. I experienced one difference, in that the pool would be frozen for three minutes before eventually recovering after having reset the whole controller. Scott's explanation was basically that the framework was not handling SAS in an optimal fashion. > The basic problem is that FreeBSD still sees all of this as parallel SC= SI, subject to rescans and resets and timeouts. It's fighting with the S= AS controller. I'll explain more below. > Event 0x12 is "SAS Link status changed" > Event 0x16 is "SAS Discovery Event" >=20 > Basically this means that the controller saw the link change and is now= trying to rediscover what is out there. (The following explanations came as to why I got the same error messages as you while trying a camcontrol reset) > We confused the controller by trying to reset the bus while it was tryi= ng to do a discovery, and then we confused it even more because we timed = out trying to abort commands due to the reset. > I'm working on code that will make FreeBSD more aware of how SAS works.= It's several months from being done, though. I'm not sure what to have= you try in the mean time. If you're brave, try stubbing out the XPT_RES= ET_BUS, XPT_RESET_DEV, and XPT_ABORT code in mpt_cam.c Sorry I can't give any further insight :/ Cheers, On 09/03/2010 03:42 PM, Niklas Saers wrote: > Hi guys, > We've just been delivered a system that I'm testing, consisting of: > - SuperMicro CSE-847E16-R1400LPB (4U, PSU 2x1400W (1+1), SAS2 expander)= > - SuperMicro X8DTL-iF LGA1366 Single > - Intel Xeon E5620 2,4GHz, 12MB cache TRAY > - 3x Hynix RAM 4 GB DDR3 1333 Reg. ECC > - LSI SAS3081E-R, 8-port int. SAS - kit (CIe x8, 8-port SAS/SATA, 0, 1,= 1E, JBOD) > - 3ware ML SFF-8087 til ML SFF-8087 0,6m (SAS cable, connect SFF-8087 C= ontroller) > - 36x Samsung 2TB SATAII/5400 HD203WI (8.9ms, 32MB Cache, EcoGreen F2) >=20 > The system will be a backup server running ZFS on FreeBSD 8.1, and I'm = more concerned with stability and volume size pr dollar than I am about p= erformance, hence the 2TB SATA drives. >=20 > Now, I've installed FreeBSD and set the disks up to 6x raidz1 with six = disks in each raidz1. Not necessarily the best configuration, but that's = not the issue for this discussion. The problem is that when I pull a disk= out (thus simulating it failing), the entire disk array stops, and I can= not even do a 'reboot now', I have to cold boot the machine to get it bac= k online again. >=20 > This is me removing the disk that should be da0 while it's running: >=20 > mpt0: mpt_cam_event: 0x16 > mpt0: mpt_cam_event: 0x12 > mpt0: mpt_cam_event: 0x16 > mpt0: mpt_cam_event: 0x16 > mpt0: mpt_cam_event: 0x12 > mpt0: mpt_cam_event: 0x16 > mpt0: mpt_cam_event: 0x16 > mpt0: mpt_cam_event: 0x12 > mpt0: mpt_cam_event: 0x16 > mpt0: request 0xffffff80005cbea0:40191 timed out for ccb 0xffffff0170c5= d800 (req->ccb 0xffffff0170c5d800) > mpt0: request 0xffffff80005d4f30:40192 timed out for ccb 0xffffff012db8= 5000 (req->ccb 0xffffff012db85000) > mpt0: attempting to abort req 0xffffff80005cbea0:40191 function 0 > mpt0: request 0xffffff80005cb2d0:40193 timed out for ccb 0xffffff0005f2= f000 (req->ccb 0xffffff0005f2f000) > mpt0: request 0xffffff80005db3e0:40194 timed out for ccb 0xffffff0005c4= 5000 (req->ccb 0xffffff0005c45000) > mpt0: request 0xffffff80005d9c40:40195 timed out for ccb 0xffffff0005c7= 9800 (req->ccb 0xffffff0005c79800) > mpt0: request 0xffffff80005d1ae0:40196 timed out for ccb 0xffffff0005c3= e800 (req->ccb 0xffffff0005c3e800) > mpt0: request 0xffffff80005dbb30:40197 timed out for ccb 0xffffff0170c5= 4000 (req->ccb 0xffffff0170c54000) > mpt0: request 0xffffff80005da930:40198 timed out for ccb 0xffffff0170c5= d000 (req->ccb 0xffffff0170c5d000) > mpt0: request 0xffffff80005d6e20:40199 timed out for ccb 0xffffff0005f3= 0800 (req->ccb 0xffffff0005f30800) > mpt0: request 0xffffff80005d9610:40200 timed out for ccb 0xffffff0005c7= 8800 (req->ccb 0xffffff0005c78800) > mpt0: completing timedout/aborted req 0xffffff80005d9610:40200 > mpt0: completing timedout/aborted req 0xffffff80005d6e20:40199 > mpt0: completing timedout/aborted req 0xffffff80005da930:40198 > mpt0: completing timedout/aborted req 0xffffff80005dbb30:40197 > mpt0: completing timedout/aborted req 0xffffff80005d1ae0:40196 > mpt0: completing timedout/aborted req 0xffffff80005d9c40:40195 > mpt0: completing timedout/aborted req 0xffffff80005db3e0:40194 > mpt0: completing timedout/aborted req 0xffffff80005cb2d0:40193 > mpt0: completing timedout/aborted req 0xffffff80005d4f30:40192 > mpt0: completing timedout/aborted req 0xffffff80005cbea0:40191 > mpt0: abort of req 0xffffff80005cbea0:0 completed > mpt0: request 0xffffff80005cf260:40250 timed out for ccb 0xffffff0005c7= 8800 (req->ccb 0xffffff0005c78800) > mpt0: request 0xffffff80005d2f20:40251 timed out for ccb 0xffffff0005f3= 0800 (req->ccb 0xffffff0005f30800) > mpt0: attempting to abort req 0xffffff80005cf260:40250 function 0 > mpt0: request 0xffffff80005dc280:40252 timed out for ccb 0xffffff0170c5= d000 (req->ccb 0xffffff0170c5d000) > mpt0: request 0xffffff80005d85c0:40253 timed out for ccb 0xffffff0170c5= 4000 (req->ccb 0xffffff0170c54000) > mpt0: request 0xffffff80005dcd30:40254 timed out for ccb 0xffffff0005c3= e800 (req->ccb 0xffffff0005c3e800) > mpt0: request 0xffffff80005cdbe0:40255 timed out for ccb 0xffffff0005c7= 9800 (req->ccb 0xffffff0005c79800) > mpt0: request 0xffffff80005dcdc0:40256 timed out for ccb 0xffffff0005c4= 5000 (req->ccb 0xffffff0005c45000) > mpt0: request 0xffffff80005d34c0:40257 timed out for ccb 0xffffff0005f2= f000 (req->ccb 0xffffff0005f2f000) > mpt0: request 0xffffff80005dca60:40258 timed out for ccb 0xffffff012db8= 5000 (req->ccb 0xffffff012db85000) > mpt0: request 0xffffff80005cd640:40259 timed out for ccb 0xffffff0170c5= d800 (req->ccb 0xffffff0170c5d800) > mpt0: completing timedout/aborted req 0xffffff80005cd640:40259 > mpt0: completing timedout/aborted req 0xffffff80005dca60:40258 > mpt0: completing timedout/aborted req 0xffffff80005d34c0:40257 > mpt0: completing timedout/aborted req 0xffffff80005dcdc0:40256 > mpt0: completing timedout/aborted req 0xffffff80005cdbe0:40255 > mpt0: completing timedout/aborted req 0xffffff80005dcd30:40254 > mpt0: completing timedout/aborted req 0xffffff80005d85c0:40253 > mpt0: completing timedout/aborted req 0xffffff80005dc280:40252 > mpt0: completing timedout/aborted req 0xffffff80005d2f20:40251 > mpt0: completing timedout/aborted req 0xffffff80005cf260:40250 > mpt0: abort of req 0xffffff80005cf260:0 completed > mpt0: request 0xffffff80005dae40:40268 timed out for ccb 0xffffff0005f2= f000 (req->ccb 0xffffff0005f2f000) > mpt0: request 0xffffff80005db110:40269 timed out for ccb 0xffffff012db8= 5000 (req->ccb 0xffffff012db85000) > mpt0: attempting to abort req 0xffffff80005dae40:40268 function 0 > mpt0: request 0xffffff80005d4750:40270 timed out for ccb 0xffffff0170c5= d800 (req->ccb 0xffffff0170c5d800) > mpt0: request 0xffffff80005d8a40:40271 timed out for ccb 0xffffff0005c7= 9800 (req->ccb 0xffffff0005c79800) > mpt0: request 0xffffff80005d2e90:40272 timed out for ccb 0xffffff0005c4= 5000 (req->ccb 0xffffff0005c45000) > mpt0: request 0xffffff80005d6eb0:40273 timed out for ccb 0xffffff0170c5= 4000 (req->ccb 0xffffff0170c54000) > mpt0: request 0xffffff80005dad20:40274 timed out for ccb 0xffffff0005c3= e800 (req->ccb 0xffffff0005c3e800) > mpt0: request 0xffffff80005ce720:40275 timed out for ccb 0xffffff0005f3= 0800 (req->ccb 0xffffff0005f30800) > mpt0: request 0xffffff80005d62e0:40276 timed out for ccb 0xffffff0170c5= d000 (req->ccb 0xffffff0170c5d000) > mpt0: request 0xffffff80005d3af0:40277 timed out for ccb 0xffffff0005c7= 8800 (req->ccb 0xffffff0005c78800) > mpt0: completing timedout/aborted req 0xffffff80005d3af0:40277 > mpt0: completing timedout/aborted req 0xffffff80005d62e0:40276 > mpt0: completing timedout/aborted req 0xffffff80005ce720:40275 > mpt0: completing timedout/aborted req 0xffffff80005dad20:40274 > mpt0: completing timedout/aborted req 0xffffff80005d6eb0:40273 > mpt0: completing timedout/aborted req 0xffffff80005d2e90:40272 > mpt0: completing timedout/aborted req 0xffffff80005d8a40:40271 > mpt0: completing timedout/aborted req 0xffffff80005d4750:40270 > mpt0: completing timedout/aborted req 0xffffff80005db110:40269 > mpt0: completing timedout/aborted req 0xffffff80005dae40:40268 > mpt0: abort of req 0xffffff80005dae40:0 completed > mpt0: request 0xffffff80005d93d0:40279 timed out for ccb 0xffffff0005c7= 8800 (req->ccb 0xffffff0005c78800) > mpt0: request 0xffffff80005daff0:40280 timed out for ccb 0xffffff0170c5= d000 (req->ccb 0xffffff0170c5d000) > mpt0: attempting to abort req 0xffffff80005d93d0:40279 function 0 > mpt0: request 0xffffff80005d2080:40281 timed out for ccb 0xffffff0005f3= 0800 (req->ccb 0xffffff0005f30800) > mpt0: request 0xffffff80005cf020:40282 timed out for ccb 0xffffff0005c3= e800 (req->ccb 0xffffff0005c3e800) > mpt0: request 0xffffff80005d3160:40283 timed out for ccb 0xffffff0170c5= 4000 (req->ccb 0xffffff0170c54000) > mpt0: request 0xffffff80005d1930:40284 timed out for ccb 0xffffff0005c4= 5000 (req->ccb 0xffffff0005c45000) > mpt0: request 0xffffff80005d2860:40285 timed out for ccb 0xffffff0005c7= 9800 (req->ccb 0xffffff0005c79800) > mpt0: request 0xffffff80005ccdd0:40286 timed out for ccb 0xffffff0170c5= d800 (req->ccb 0xffffff0170c5d800) > mpt0: request 0xffffff80005da540:40287 timed out for ccb 0xffffff0005f2= f000 (req->ccb 0xffffff0005f2f000) > mpt0: request 0xffffff80005d1d20:40288 timed out for ccb 0xffffff012db8= 5000 (req->ccb 0xffffff012db85000) > mpt0: completing timedout/aborted req 0xffffff80005d1d20:40288 > mpt0: completing timedout/aborted req 0xffffff80005da540:40287 > mpt0: completing timedout/aborted req 0xffffff80005ccdd0:40286 > mpt0: completing timedout/aborted req 0xffffff80005d2860:40285 > mpt0: completing timedout/aborted req 0xffffff80005d1930:40284 > mpt0: completing timedout/aborted req 0xffffff80005d3160:40283 > mpt0: completing timedout/aborted req 0xffffff80005cf020:40282 > mpt0: completing timedout/aborted req 0xffffff80005d2080:40281 > mpt0: completing timedout/aborted req 0xffffff80005daff0:40280 > mpt0: completing timedout/aborted req 0xffffff80005d93d0:40279 > mpt0: abort of req 0xffffff80005d93d0:0 completed > mpt0: request 0xffffff80005cd400:40290 timed out for ccb 0xffffff0005c4= 5000 (req->ccb 0xffffff0005c45000) > mpt0: request 0xffffff80005d73c0:40291 timed out for ccb 0xffffff0005c7= 8800 (req->ccb 0xffffff0005c78800) > mpt0: attempting to abort req 0xffffff80005cd400:40290 function 0 > mpt0: request 0xffffff80005d2e00:40292 timed out for ccb 0xffffff0170c5= d000 (req->ccb 0xffffff0170c5d000) > mpt0: request 0xffffff80005ccf80:40293 timed out for ccb 0xffffff0005f3= 0800 (req->ccb 0xffffff0005f30800) > mpt0: request 0xffffff80005cffe0:40294 timed out for ccb 0xffffff0005c3= e800 (req->ccb 0xffffff0005c3e800) > mpt0: request 0xffffff80005d3550:40295 timed out for ccb 0xffffff0170c5= 4000 (req->ccb 0xffffff0170c54000) > mpt0: request 0xffffff80005cc950:40296 timed out for ccb 0xffffff0005c7= 9800 (req->ccb 0xffffff0005c79800) > mpt0: request 0xffffff80005d8260:40297 timed out for ccb 0xffffff0170c5= d800 (req->ccb 0xffffff0170c5d800) > mpt0: request 0xffffff80005ceba0:40298 timed out for ccb 0xffffff0005f2= f000 (req->ccb 0xffffff0005f2f000) > mpt0: request 0xffffff80005d1270:40299 timed out for ccb 0xffffff012db8= 5000 (req->ccb 0xffffff012db85000) > mpt0: completing timedout/aborted req 0xffffff80005d1270:40299 > mpt0: completing timedout/aborted req 0xffffff80005ceba0:40298 > mpt0: completing timedout/aborted req 0xffffff80005d8260:40297 > mpt0: completing timedout/aborted req 0xffffff80005cc950:40296 > mpt0: completing timedout/aborted req 0xffffff80005d3550:40295 > mpt0: completing timedout/aborted req 0xffffff80005cffe0:40294 > mpt0: completing timedout/aborted req 0xffffff80005ccf80:40293 > mpt0: completing timedout/aborted req 0xffffff80005d2e00:40292 > mpt0: completing timedout/aborted req 0xffffff80005d73c0:40291 > mpt0: completing timedout/aborted req 0xffffff80005cd400:40290 > mpt0: abort of req 0xffffff80005cd400:0 completed > mpt0: request 0xffffff80005ce060:40301 timed out for ccb 0xffffff0170c5= d800 (req->ccb 0xffffff0170c5d800) > mpt0: request 0xffffff80005ce210:40302 timed out for ccb 0xffffff0005f2= f000 (req->ccb 0xffffff0005f2f000) > mpt0: attempting to abort req 0xffffff80005ce060:40301 function 0 > mpt0: request 0xffffff80005d3a60:40303 timed out for ccb 0xffffff012db8= 5000 (req->ccb 0xffffff012db85000) > mpt0: request 0xffffff80005cde20:40304 timed out for ccb 0xffffff0170c5= 4000 (req->ccb 0xffffff0170c54000) > mpt0: request 0xffffff80005cbc60:40305 timed out for ccb 0xffffff0005c7= 9800 (req->ccb 0xffffff0005c79800) > mpt0: request 0xffffff80005db7d0:40306 timed out for ccb 0xffffff0005f3= 0800 (req->ccb 0xffffff0005f30800) > mpt0: request 0xffffff80005cbe10:40307 timed out for ccb 0xffffff0005c3= e800 (req->ccb 0xffffff0005c3e800) > mpt0: request 0xffffff80005cd7f0:40308 timed out for ccb 0xffffff0005c7= 8800 (req->ccb 0xffffff0005c78800) > mpt0: request 0xffffff80005d0850:40309 timed out for ccb 0xffffff0170c5= d000 (req->ccb 0xffffff0170c5d000) > mpt0: request 0xffffff80005d1030:40310 timed out for ccb 0xffffff0005c4= 5000 (req->ccb 0xffffff0005c45000) > mpt0: completing timedout/aborted req 0xffffff80005d1030:40310 > mpt0: completing timedout/aborted req 0xffffff80005d0850:40309 > mpt0: completing timedout/aborted req 0xffffff80005cd7f0:40308 > mpt0: completing timedout/aborted req 0xffffff80005cbe10:40307 > mpt0: completing timedout/aborted req 0xffffff80005db7d0:40306 > mpt0: completing timedout/aborted req 0xffffff80005cbc60:40305 > mpt0: completing timedout/aborted req 0xffffff80005cde20:40304 > mpt0: completing timedout/aborted req 0xffffff80005d3a60:40303 > mpt0: completing timedout/aborted req 0xffffff80005ce210:40302 > mpt0: completing timedout/aborted req 0xffffff80005ce060:40301 > mpt0: abort of req 0xffffff80005ce060:0 completed > mpt0: request 0xffffff80005cfd10:40312 timed out for ccb 0xffffff0005c4= 5000 (req->ccb 0xffffff0005c45000) > mpt0: request 0xffffff80005d2350:40313 timed out for ccb 0xffffff0005c7= 8800 (req->ccb 0xffffff0005c78800) > mpt0: attempting to abort req 0xffffff80005cfd10:40312 function 0 > mpt0: request 0xffffff80005cdd90:40314 timed out for ccb 0xffffff0170c5= d000 (req->ccb 0xffffff0170c5d000) > mpt0: request 0xffffff80005dbce0:40315 timed out for ccb 0xffffff0005f3= 0800 (req->ccb 0xffffff0005f30800) > mpt0: request 0xffffff80005d47e0:40316 timed out for ccb 0xffffff0005c3= e800 (req->ccb 0xffffff0005c3e800) > mpt0: request 0xffffff80005ce450:40317 timed out for ccb 0xffffff0170c5= 4000 (req->ccb 0xffffff0170c54000) > mpt0: request 0xffffff80005d7c30:40318 timed out for ccb 0xffffff0005c7= 9800 (req->ccb 0xffffff0005c79800) > mpt0: request 0xffffff80005d2470:40319 timed out for ccb 0xffffff012db8= 5000 (req->ccb 0xffffff012db85000) > mpt0: request 0xffffff80005cb5a0:40320 timed out for ccb 0xffffff0170c5= d800 (req->ccb 0xffffff0170c5d800) > mpt0: request 0xffffff80005cc8c0:40321 timed out for ccb 0xffffff0005f2= f000 (req->ccb 0xffffff0005f2f000) > mpt0: completing timedout/aborted req 0xffffff80005cc8c0:40321 > mpt0: completing timedout/aborted req 0xffffff80005cb5a0:40320 > mpt0: completing timedout/aborted req 0xffffff80005d2470:40319 > mpt0: completing timedout/aborted req 0xffffff80005d7c30:40318 > mpt0: completing timedout/aborted req 0xffffff80005ce450:40317 > mpt0: completing timedout/aborted req 0xffffff80005d47e0:40316 > mpt0: completing timedout/aborted req 0xffffff80005dbce0:40315 > mpt0: completing timedout/aborted req 0xffffff80005cdd90:40314 > mpt0: completing timedout/aborted req 0xffffff80005d2350:40313 > mpt0: completing timedout/aborted req 0xffffff80005cfd10:40312 > mpt0: abort of req 0xffffff80005cfd10:0 completed > mpt0: request 0xffffff80005db2c0:40323 timed out for ccb 0xffffff0170c5= d800 (req->ccb 0xffffff0170c5d800) > mpt0: request 0xffffff80005d3b80:40324 timed out for ccb 0xffffff0005f2= f000 (req->ccb 0xffffff0005f2f000) > mpt0: attempting to abort req 0xffffff80005db2c0:40323 function 0 > mpt0: request 0xffffff80005d7f00:40325 timed out for ccb 0xffffff012db8= 5000 (req->ccb 0xffffff012db85000) > mpt0: request 0xffffff80005d4d80:40326 timed out for ccb 0xffffff0170c5= 4000 (req->ccb 0xffffff0170c54000) > mpt0: request 0xffffff80005db470:40327 timed out for ccb 0xffffff0005c7= 9800 (req->ccb 0xffffff0005c79800) > mpt0: request 0xffffff80005dc3a0:40328 timed out for ccb 0xffffff0005f3= 0800 (req->ccb 0xffffff0005f30800) > mpt0: request 0xffffff80005d2980:40329 timed out for ccb 0xffffff0005c3= e800 (req->ccb 0xffffff0005c3e800) > mpt0: request 0xffffff80005d72a0:40330 timed out for ccb 0xffffff0005c7= 8800 (req->ccb 0xffffff0005c78800) > mpt0: request 0xffffff80005d78d0:40331 timed out for ccb 0xffffff0170c5= d000 (req->ccb 0xffffff0170c5d000) > mpt0: request 0xffffff80005d0f10:40332 timed out for ccb 0xffffff0005c4= 5000 (req->ccb 0xffffff0005c45000) > mpt0: completing timedout/aborted req 0xffffff80005d0f10:40332 > mpt0: completing timedout/aborted req 0xffffff80005d78d0:40331 > mpt0: completing timedout/aborted req 0xffffff80005d72a0:40330 > mpt0: completing timedout/aborted req 0xffffff80005d2980:40329 > mpt0: completing timedout/aborted req 0xffffff80005dc3a0:40328 > mpt0: completing timedout/aborted req 0xffffff80005db470:40327 > mpt0: completing timedout/aborted req 0xffffff80005d4d80:40326 > mpt0: completing timedout/aborted req 0xffffff80005d7f00:40325 > mpt0: completing timedout/aborted req 0xffffff80005d3b80:40324 > mpt0: completing timedout/aborted req 0xffffff80005db2c0:40323 > mpt0: abort of req 0xffffff80005db2c0:0 completed > mpt0: request 0xffffff80005d5320:40334 timed out for ccb 0xffffff0005c4= 5000 (req->ccb 0xffffff0005c45000) > mpt0: request 0xffffff80005cc050:40335 timed out for ccb 0xffffff0005c7= 8800 (req->ccb 0xffffff0005c78800) > mpt0: attempting to abort req 0xffffff80005d5320:40334 function 0 > mpt0: request 0xffffff80005d2a10:40336 timed out for ccb 0xffffff0170c5= d000 (req->ccb 0xffffff0170c5d000) > mpt0: request 0xffffff80005d7690:40337 timed out for ccb 0xffffff0005f3= 0800 (req->ccb 0xffffff0005f30800) > mpt0: request 0xffffff80005d8770:40338 timed out for ccb 0xffffff0005c3= e800 (req->ccb 0xffffff0005c3e800) > mpt0: request 0xffffff80005d6d00:40339 timed out for ccb 0xffffff0170c5= 4000 (req->ccb 0xffffff0170c54000) > mpt0: request 0xffffff80005d92b0:40340 timed out for ccb 0xffffff0005c7= 9800 (req->ccb 0xffffff0005c79800) > mpt0: request 0xffffff80005ce330:40341 timed out for ccb 0xffffff0005f2= f000 (req->ccb 0xffffff0005f2f000) > mpt0: request 0xffffff80005d84a0:40342 timed out for ccb 0xffffff012db8= 5000 (req->ccb 0xffffff012db85000) > mpt0: request 0xffffff80005d0220:40343 timed out for ccb 0xffffff0170c5= d800 (req->ccb 0xffffff0170c5d800) > mpt0: completing timedout/aborted req 0xffffff80005d0220:40343 > mpt0: completing timedout/aborted req 0xffffff80005d84a0:40342 > mpt0: completing timedout/aborted req 0xffffff80005ce330:40341 > mpt0: completing timedout/aborted req 0xffffff80005d92b0:40340 > mpt0: completing timedout/aborted req 0xffffff80005d6d00:40339 > mpt0: completing timedout/aborted req 0xffffff80005d8770:40338 > mpt0: completing timedout/aborted req 0xffffff80005d7690:40337 > mpt0: completing timedout/aborted req 0xffffff80005d2a10:40336 > mpt0: completing timedout/aborted req 0xffffff80005cc050:40335 > mpt0: completing timedout/aborted req 0xffffff80005d5320:40334 > mpt0: abort of req 0xffffff80005d5320:0 completed > mpt0: request 0xffffff80005cc4d0:40345 timed out for ccb 0xffffff0005f3= 0800 (req->ccb 0xffffff0005f30800) > mpt0: request 0xffffff80005cdac0:40346 timed out for ccb 0xffffff0005c7= 8800 (req->ccb 0xffffff0005c78800) > mpt0: attempting to abort req 0xffffff80005cc4d0:40345 function 0 > mpt0: request 0xffffff80005dc670:40347 timed out for ccb 0xffffff0005c4= 5000 (req->ccb 0xffffff0005c45000) > mpt0: request 0xffffff80005dc940:40348 timed out for ccb 0xffffff0170c5= d000 (req->ccb 0xffffff0170c5d000) > mpt0: request 0xffffff80005d1810:40349 timed out for ccb 0xffffff0005c3= e800 (req->ccb 0xffffff0005c3e800) > mpt0: request 0xffffff80005cd520:40350 timed out for ccb 0xffffff0170c5= 4000 (req->ccb 0xffffff0170c54000) > mpt0: request 0xffffff80005db6b0:40351 timed out for ccb 0xffffff0005c7= 9800 (req->ccb 0xffffff0005c79800) > mpt0: request 0xffffff80005d1390:40352 timed out for ccb 0xffffff0005f2= f000 (req->ccb 0xffffff0005f2f000) > mpt0: request 0xffffff80005d6520:40353 timed out for ccb 0xffffff012db8= 5000 (req->ccb 0xffffff012db85000) > mpt0: request 0xffffff80005cf1d0:40354 timed out for ccb 0xffffff0170c5= d800 (req->ccb 0xffffff0170c5d800) > mpt0: completing timedout/aborted req 0xffffff80005cf1d0:40354 > mpt0: completing timedout/aborted req 0xffffff80005d6520:40353 > mpt0: completing timedout/aborted req 0xffffff80005d1390:40352 > mpt0: completing timedout/aborted req 0xffffff80005db6b0:40351 > mpt0: completing timedout/aborted req 0xffffff80005cd520:40350 > mpt0: completing timedout/aborted req 0xffffff80005d1810:40349 > mpt0: completing timedout/aborted req 0xffffff80005dc940:40348 > mpt0: completing timedout/aborted req 0xffffff80005dc670:40347 > mpt0: completing timedout/aborted req 0xffffff80005cdac0:40346 > mpt0: completing timedout/aborted req 0xffffff80005cc4d0:40345 > mpt0: abort of req 0xffffff80005cc4d0:0 completed >=20 > And just in case, this is my zpool status just before that: >=20 > pool: tank > state: ONLINE > scrub: none requested > config: >=20 > NAME STATE READ WRITE CKSUM > tank ONLINE 0 0 0 > raidz1 ONLINE 0 0 0 > da0 ONLINE 0 0 0 > da1 ONLINE 0 0 0 > da2 ONLINE 0 0 0 > da3 ONLINE 0 0 0 > da4 ONLINE 0 0 0 > da5 ONLINE 0 0 0 > raidz1 ONLINE 0 0 0 > da6 ONLINE 0 0 0 > da7 ONLINE 0 0 0 > da8 ONLINE 0 0 0 > da9 ONLINE 0 0 0 > da10 ONLINE 0 0 0 > da11 ONLINE 0 0 0 > raidz1 ONLINE 0 0 0 > da12 ONLINE 0 0 0 > da13 ONLINE 0 0 0 > da14 ONLINE 0 0 0 > da15 ONLINE 0 0 0 > da16 ONLINE 0 0 0 > da17 ONLINE 0 0 0 > raidz1 ONLINE 0 0 0 > da18 ONLINE 0 0 0 > da19 ONLINE 0 0 0 > da20 ONLINE 0 0 0 > da21 ONLINE 0 0 0 > da22 ONLINE 0 0 0 > da23 ONLINE 0 0 0 > raidz1 ONLINE 0 0 0 > da24 ONLINE 0 0 0 > da25 ONLINE 0 0 0 > da26 ONLINE 0 0 0 > da27 ONLINE 0 0 0 > da28 ONLINE 0 0 0 > da29 ONLINE 0 0 0 > raidz1 ONLINE 0 0 0 > da30 ONLINE 0 0 0 > da31 ONLINE 0 0 0 > da32 ONLINE 0 0 0 > da33 ONLINE 0 0 0 > da34 ONLINE 0 0 0 > da35 ONLINE 0 0 0 >=20 > errors: No known data errors >=20 > If I try to do for instance "camcontrol eject da0" first, I only get: "= Error received from stop unit command" >=20 > Any idea why the mpt-driver reacts this way when I pull out a disk that= is meant to be hot-swappable? Is it something in the driver? Something i= n the hardware? Somthing known? Something that I've misunderstood about b= eing able to replace disks? >=20 > Cheers >=20 > Nik_______________________________________________ > freebsd-scsi@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-scsi > To unsubscribe, send any mail to "freebsd-scsi-unsubscribe@freebsd.org"= --=20 Stephane LAPIE, EPITA SRS, Promo 2005 "Even when they have digital readouts, I can't understand them." --MegaTokyo --------------enigA3B28D9C7B45EE902C72C765 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.10 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAkyApS0ACgkQ24Ql8u6TF2MutwCffj4+cr3MA0bl/P+Qt7hrrxqw o1wAn1vz9E9w32ZI0Hn8KHh0SLkE33r8 =Y3qd -----END PGP SIGNATURE----- --------------enigA3B28D9C7B45EE902C72C765-- From owner-freebsd-scsi@FreeBSD.ORG Fri Sep 3 14:04:00 2010 Return-Path: Delivered-To: freebsd-scsi@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 20A1F1065706 for ; Fri, 3 Sep 2010 14:04:00 +0000 (UTC) (envelope-from mj@feral.com) Received: from ns1.feral.com (ns1.feral.com [192.67.166.1]) by mx1.freebsd.org (Postfix) with ESMTP id CA5168FC1A for ; Fri, 3 Sep 2010 14:03:59 +0000 (UTC) Received: from [192.168.1.2] (m206-63.dsl.tsoft.com [198.144.206.63]) by ns1.feral.com (8.14.3/8.14.3) with ESMTP id o83E3wfn011280 for ; Fri, 3 Sep 2010 07:03:59 -0700 (PDT) (envelope-from mj@feral.com) Message-ID: <4C81004D.1020008@feral.com> Date: Fri, 03 Sep 2010 07:03:57 -0700 From: Matthew Jacob Organization: Feral Software User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.8) Gecko/20100802 Thunderbird/3.1.2 MIME-Version: 1.0 To: freebsd-scsi@freebsd.org References: <4C80A52A.5080300@darkbsd.org> In-Reply-To: <4C80A52A.5080300@darkbsd.org> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Greylist: Default is to whitelist mail, not delayed by milter-greylist-4.2.6 (ns1.feral.com [192.67.166.1]); Fri, 03 Sep 2010 07:03:59 -0700 (PDT) Subject: Re: mpt0 and removing disks X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 03 Sep 2010 14:04:00 -0000 mpt was never really written with hot plug in mind. There is a sort-of idea for this for Fibre Channel, but I can assure you it was never tested much. Sorry, folks, but th-th-th-ats all!