From owner-freebsd-stable@freebsd.org Mon Apr 10 17:56:42 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DA464D379DE for ; Mon, 10 Apr 2017 17:56:42 +0000 (UTC) (envelope-from mahlon@martini.nu) Received: from martini.nu (martini.nu [69.163.39.203]) by mx1.freebsd.org (Postfix) with SMTP id C41C06DC for ; Mon, 10 Apr 2017 17:56:42 +0000 (UTC) (envelope-from mahlon@martini.nu) Received: (qmail 42959 invoked by uid 1000); 10 Apr 2017 17:50:03 -0000 Date: Mon, 10 Apr 2017 10:49:59 -0700 From: "Mahlon E. Smith" To: freebsd-stable@freebsd.org Subject: CAM timeouts at startup Message-ID: <20170410174959.GC73510@martini.nu> Mail-Followup-To: "Mahlon E. Smith" , freebsd-stable@freebsd.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="vGgW1X5XWziG23Ko" Content-Disposition: inline X-GPG-Fingerprint: 1F7E 39D8 BDEA E34B 1169 F285 0741 7A1E E630 75D2 X-GPG-Key: http://martini.nu/misc/key.txt X-Sysinfo: FreeBSD 10.3-RELEASE-p4 amd64 User-Agent: Mutt/1.6.1 (2016-04-27) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 10 Apr 2017 17:56:42 -0000 --vGgW1X5XWziG23Ko Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Hi. Got some new machines running 11.0-RELEASE-p8 with a small pile of SSD= in them. Getting some strange CAM timeouts at boot, that dramatically delay startup times. These errors don't happen at all after boot, everything seems just fine. Any clues / tuning suggestions are appreciated. Relevant stuff from dmesg: mpr0: port 0x3000-0x30ff mem 0x92000000= -0x9200ffff,0x91f00000-0x91ffffff at device 0.0 numa-domain 0 on pci3 mpr0: IOCFacts : MsgVersion: 0x205 HeaderVersion: 0x2a00 IOCNumber: 0 IOCExceptions: 0x0 MaxChainDepth: 128 NumberOfPorts: 1 RequestCredit: 9680 ProductID: 0x2221 IOCRequestFrameSize: 32 MaxInitiators: 0 MaxTargets: 544 MaxSasExpanders: 125 MaxEnclosures: 126 HighPriorityCredit: 124 MaxReplyDescriptorPostQueueDepth: 65504 ReplyFrameSize: 32 MaxVolumes: 0 MaxDevHandle: 677 MaxPersistentEntries: 240 mpr0: Firmware: 13.00.00.00, Driver: 13.01.00.00-fbsd mpr0: IOCCapabilities: 7a85c da0 at mpr0 bus 0 scbus0 target 19 lun 0 da0: Fixed Direct Access SPC-4 SCSI device da0: Serial Number S2HTNX0H701448 =20 da0: 1200.000MB/s transfers da0: Command Queueing enabled da0: 915715MB (1875385008 512 byte sectors) da0: quirks=3D0x8<4K> mpr0: Sending reset from mprsas_send_abort for target ID 19 mpr0: Unfreezing devq for target ID 19 (da0:mpr0:0:19:0): READ(10). CDB: 28 00 6f c8 1a af 00 00 01 00=20 (da0:mpr0:0:19:0): CAM status: Command timeout (da0:mpr0:0:19:0): Retrying command (da0:mpr0:0:19:0): READ(10). CDB: 28 00 6f c8 1a af 00 00 01 00=20 (da0:mpr0:0:19:0): CAM status: SCSI Status Error (da0:mpr0:0:19:0): SCSI status: Check Condition (da0:mpr0:0:19:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, o= r bus device reset occurred) (da0:mpr0:0:19:0): Retrying command (per sense data) (noperiph:mpr0:0:4294967295:0): SMID 2 Aborting command 0xfffffe00026066= c0 mpr0: Sending reset from mprsas_send_abort for target ID 20 mpr0: Unfreezing devq for target ID 20 (da1:mpr0:0:20:0): READ(10). CDB: 28 00 6f c8 1a af 00 00 01 00=20 (da1:mpr0:0:20:0): CAM status: Command timeout (da1:mpr0:0:20:0): Retrying command (da1:mpr0:0:20:0): READ(10). CDB: 28 00 6f c8 1a af 00 00 01 00=20 (da1:mpr0:0:20:0): CAM status: SCSI Status Error (da1:mpr0:0:20:0): SCSI status: Check Condition (da1:mpr0:0:20:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, o= r bus device reset occurred) (da1:mpr0:0:20:0): Retrying command (per sense data) (noperiph:mpr0:0:4294967295:0): SMID 3 Aborting command 0xfffffe00026097= 50 mpr0: Sending reset from mprsas_send_abort for target ID 21 (da2:mpr0:0:21:0): READ(10). CDB: 28 00 6f c8 1a af 00 00 01 00=20 mpr0: (da2:mpr0:0:21:0): CAM status: Command timeout Unfreezing devq for target ID 21 (da2:mpr0:0:21:0): Retrying command (da2:mpr0:0:21:0): READ(10). CDB: 28 00 6f c8 1a af 00 00 01 00=20 (da2:mpr0:0:21:0): CAM status: SCSI Status Error (da2:mpr0:0:21:0): SCSI status: Check Condition (da2:mpr0:0:21:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, o= r bus device reset occurred) (da2:mpr0:0:21:0): Retrying command (per sense data) (noperiph:mpr0:0:4294967295:0): SMID 4 Aborting command 0xfffffe000260c7= e0 mpr0: Sending reset from mprsas_send_abort for target ID 22 mpr0: Unfreezing devq for target ID 22 (da3:mpr0:0:22:0): READ(10). CDB: 28 00 6f c8 1a af 00 00 01 00=20 (da3:mpr0:0:22:0): CAM status: Command timeout (da3:mpr0:0:22:0): Retrying command (da3:mpr0:0:22:0): READ(10). CDB: 28 00 6f c8 1a af 00 00 01 00=20 (da3:mpr0:0:22:0): CAM status: SCSI Status Error (da3:mpr0:0:22:0): SCSI status: Check Condition (da3:mpr0:0:22:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, o= r bus device reset occurred) (da3:mpr0:0:22:0): Retrying command (per sense data) (noperiph:mpr0:0:4294967295:0): SMID 5 Aborting command 0xfffffe0002614f= 10 mpr0: Sending reset from mprsas_send_abort for target ID 25 mpr0: Unfreezing devq for target ID 25 (da6:mpr0:0:25:0): READ(10). CDB: 28 00 6f c8 1a af 00 00 01 00=20 (da6:mpr0:0:25:0): CAM status: Command timeout (da6:mpr0:0:25:0): Retrying command (da6:mpr0:0:25:0): READ(10). CDB: 28 00 6f c8 1a af 00 00 01 00=20 (da6:mpr0:0:25:0): CAM status: SCSI Status Error (da6:mpr0:0:25:0): SCSI status: Check Condition (da6:mpr0:0:25:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, o= r bus device reset occurred) (da6:mpr0:0:25:0): Retrying command (per sense data) (noperiph:mpr0:0:4294967295:0): SMID 6 Aborting command 0xfffffe0002617f= a0 mpr0: Sending reset from mprsas_send_abort for target ID 26 mpr0: Unfreezing devq for target ID 26 (da7:mpr0:0:26:0): READ(10). CDB: 28 00 6f c8 1a af 00 00 01 00=20 (da7:mpr0:0:26:0): CAM status: Command timeout (da7:mpr0:0:26:0): Retrying command (da7:mpr0:0:26:0): READ(10). CDB: 28 00 6f c8 1a af 00 00 01 00=20 (da7:mpr0:0:26:0): CAM status: SCSI Status Error (da7:mpr0:0:26:0): SCSI status: Check Condition (da7:mpr0:0:26:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, o= r bus device reset occurred) (da7:mpr0:0:26:0): Retrying command (per sense data) -- Mahlon E. Smith =20 http://www.martini.nu/ --vGgW1X5XWziG23Ko Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iQIcBAABCgAGBQJY68XDAAoJEAdBeh7mMHXS+XsQANjE4vyT/mv859vvhYqmiV5z +KCn3kpLtrjK7fMqgGa94y1JWVQe+d20ju7+mAtwXzHQBSu59McxfzLPfA8JspHx Obaq6rjdWL9npKwsueSAXerxyCHmjhTrF6rIv9CdtPbHhhF3se6craOWRgifkJa/ sZV5fYiND3gtiZTdIbL5XaZhGICBKMbARxARX10cfPAjTRMpU+djWOXSMoNl+jL8 FI1k9eKSTGnVGnj8dpUvvtSS0kKiEmHDTlM2QfTBPsEKOP+fOvL1GfEITGg7Gmi8 9qLqrLN3dr6DDZFLS0GB9GlM7+uI5NyEW3Vx1EAmK3eEMwvrTKRveb1RS247Cb0S jU5NJ7GJZh1A2i7LYwUDhzMIuZpMCfvxICVeizxc8ZARIWySccqF5/iEJyLPQ4ZN qMuHWEcVN4tQbeIuks34xRlNNqw3drfJyTbYtPYKqUhJ3I8V+9osVw5DsgVM9Z+4 kWL33WAqQCFNm33uPK0swba0ZrEfAAX18yL0VGo1nlkHfMr0yzHvXzJQaTCal6R5 YZr47GQ9BUj0PG3UEYzEGPfoEVBO3Y97uRpPCfvb6jlvtAZVMAQibS3z4V4qrlSR TnLKIyEtQN200wgQKyiCUD9czs5+SvDk3j2PYaDh+mR10OJc4nYiFRDI0p7wWIzG G8gUi8GrYu1WtuvE8kzE =iWBQ -----END PGP SIGNATURE----- --vGgW1X5XWziG23Ko--