Date: Wed, 29 Oct 2003 15:40:53 -0500 From: David Watson <dwatson@eecs.umich.edu> To: freebsd-scsi@freebsd.org Cc: freebsd-stable@freebsd.org Subject: Re: Boot of Dell 1750 fails with multiple SCSI drives installed Message-ID: <200310292040.h9TKerSo088206@skippy.eecs.umich.edu> In-Reply-To: Message from David Watson <dwatson@eecs.umich.edu> <200310272239.h9RMdNSp071176@skippy.eecs.umich.edu>
next in thread | previous in thread | raw e-mail | index | archive | help
(I'm moving this to SCSI -- hopefully that's the right place) Context: Dell servers (Power Edge 1750 and 2600) with the "LSILogic 1030 Ultra4 Adapter" are having problems booting with more than one drive installed. With a single drive I'm able to boot and attach the drives using camcontrol. With more than one drive the kernel continues to have time out errors and never succeeds in finding the disks. I suspect (at least in my case) that this is related to the fact that the controller doesn't support raid. I believe that there's a daughter card that adds that capability, and mine is configured without it. As an additional data point, my system boots fine into the OEM Redhat install with more than one disk installed. I've included kernel output below. I'm willing/able to drop into a debugger to get more info, but I'm not sure where to start looking. David Watson With 3 disks installed: > FreeBSD 5.1-CURRENT-20030924-JPSNAP #0: Wed Sep 24 01:09:42 GMT 2003 > root@ushi.jp.freebsd.org:/usr/obj/usr/src/sys/GENERIC > CPU: Intel(R) Xeon(TM) CPU 3.06GHz (3056.82-MHz 686-class CPU) > Origin = "GenuineIntel" Id = 0xf27 Stepping = 7 > Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE> > Hyperthreading: 2 logical CPUs > real memory = 1073610752 (1023 MB) > Physical memory chunk(s): > 0x0000000000001000 - 0x000000000009ffff, 651264 bytes (159 pages) > 0x0000000000787000 - 0x000000003edb9fff, 1046687744 bytes (255539 pages) > avail memory = 1035247616 (987 MB) > ... > mpt0: <LSILogic 1030 Ultra4 Adapter> port 0xcc00-0xccff mem 0xfd4e0000-0xfd4effff,0xfd4f0000-0xfd4fffff irq 11 at device 13.0 on pci9 > pcib9: device mpt0 requested decoded memory range 0xfd4f0000-0xfd4fffff > pcib8: device mpt0 requested decoded memory range 0xfd4f0000-0xfd4fffff > pcib7: device mpt0 requested decoded memory range 0xfd4f0000-0xfd4fffff > mpt0: soft reset > mpt1: <LSILogic 1030 Ultra4 Adapter> port 0xc800-0xc8ff mem 0xfd4c0000-0xfd4cffff,0xfd4d0000-0xfd4dffff irq 11 at device 13.1 on pci9 > mpt1: linking with peer (mpt0) > pcib9: device mpt1 requested decoded memory range 0xfd4d0000-0xfd4dffff > pcib8: device mpt1 requested decoded memory range 0xfd4d0000-0xfd4dffff > pcib7: device mpt1 requested decoded memory range 0xfd4d0000-0xfd4dffff > mpt1: soft reset > ... > Waiting 15 seconds for SCSI devices to settle > (probe15:mpt1:0:0:0): error 22 > (probe15:mpt1:0:0:0): Unretryable Error > (probe3:mpt0:0:3:0): error 22 > (probe3:mpt0:0:3:0): Unretryable Error > (probe16:mpt1:0:1:0): error 22 > (probe16:mpt1:0:1:0): Unretryable Error > (probe8:mpt0:0:9:0): error 22 > (probe8:mpt0:0:9:0): Unretryable Error > (probe17:mpt1:0:2:0): error 22 > (probe17:mpt1:0:2:0): Unretryable Error > (probe9:mpt0:0:10:0): error 22 > (probe9:mpt0:0:10:0): Unretryable Error > (probe18:mpt1:0:3:0): error 22 > (probe18:mpt1:0:3:0): Unretryable Error > (probe10:mpt0:0:11:0): error 22 > (probe10:mpt0:0:11:0): Unretryable Error > (probe19:mpt1:0:4:0): error 22 > (probe19:mpt1:0:4:0): Unretryable Error > (probe11:mpt0:0:12:0): error 22 > (probe11:mpt0:0:12:0): Unretryable Error > (probe20:mpt1:0:5:0): error 22 > (probe20:mpt1:0:5:0): Unretryable Error > (probe12:mpt0:0:13:0): error 22 > (probe12:mpt0:0:13:0): Unretryable Error > (probe21:mpt1:0:6:0): error 22 > (probe21:mpt1:0:6:0): Unretryable Error > (probe13:mpt0:0:14:0): error 22 > (probe13:mpt0:0:14:0): Unretryable Error > (probe22:mpt1:0:8:0): error 22 > (probe22:mpt1:0:8:0): Unretryable Error > (probe14:mpt0:0:15:0): error 22 > (probe14:mpt0:0:15:0): Unretryable Error > (probe23:mpt1:0:9:0): error 22 > (probe23:mpt1:0:9:0): Unretryable Error > (probe4:mpt0:0:4:0): error 22 > (probe4:mpt0:0:4:0): Unretryable Error > (probe24:mpt1:0:10:0): error 22 > (probe24:mpt1:0:10:0): Unretryable Error > (probe5:mpt0:0:5:0): error 22 > (probe5:mpt0:0:5:0): Unretryable Error > (probe25:mpt1:0:11:0): error 22 > (probe25:mpt1:0:11:0): Unretryable Error > (probe7:mpt0:0:8:0): error 22 > (probe7:mpt0:0:8:0): Unretryable Error > (probe0:mpt0:0:0:0): Retrying Command > (probe1:mpt0:0:1:0): Retrying Command > (probe2:mpt0:0:2:0): Retrying Command > (probe26:mpt1:0:12:0): error 22 > (probe26:mpt1:0:12:0): Unretryable Error > (probe27:mpt1:0:13:0): error 22 > (probe27:mpt1:0:13:0): Unretryable Error > (probe28:mpt1:0:14:0): error 22 > (probe28:mpt1:0:14:0): Unretryable Error > (probe29:mpt1:0:15:0): error 22 > (probe29:mpt1:0:15:0): Unretryable Error > mpt0: time out on request index = 0xf1 sequence = 0x00000096 > mpt0: Status 00000001; Mask 00000001; Doorbell 24000000 > request state On Chip > SCSI IO Request @ 0xdfad5c30 > Chain Offset 0x00 > MsgFlags 0x00 > MsgContext 0x000000f1 > Bus: 0 > TargetID 1 > SenseBufferLength 32 > LUN: 0x0 > Control 0x00000500 NODATATRANSFER UNTAGGED > DataLength 0x00000000 > SenseBufAddr 0x009ff3e0 > CDB[0:6] 00 00 00 00 00 00 > SE32 0xe15e6230: Addr=0x0 FlagsLength=0xd1000000 > LAST_ELEMENT END_OF_BUFFER END_OF_LIST > mpt0: time out on request index = 0xfd sequence = 0x0000009c > mpt0: Status 00000001; Mask 00000001; Doorbell 24000000 > request state On Chip > SCSI IO Request @ 0xdfad5c30 > Chain Offset 0x00 > MsgFlags 0x00 > MsgContext 0x000000fd > Bus: 0 > TargetID 2 > SenseBufferLength 32 > LUN: 0x0 > Control 0x00000500 NODATATRANSFER UNTAGGED > DataLength 0x00000000 > SenseBufAddr 0x00a00be0 > CDB[0:6] 00 00 00 00 00 00 > SE32 0xe15e7a30: Addr=0x0 FlagsLength=0xd1000000 > LAST_ELEMENT END_OF_BUFFER END_OF_LIST > ... With only on disk: > Waiting 15 seconds for SCSI devices to settle > (probe15:mpt1:0:0:0): error 22 > (probe15:mpt1:0:0:0): Unretryable Error > (probe1:mpt0:0:1:0): error 22 > (probe1:mpt0:0:1:0): Unretryable Error > (probe16:mpt1:0:1:0): error 22 > (probe16:mpt1:0:1:0): Unretryable Error > (probe2:mpt0:0:2:0): error 22 > (probe2:mpt0:0:2:0): Unretryable Error > (probe17:mpt1:0:2:0): error 22 > (probe17:mpt1:0:2:0): Unretryable Error > (probe3:mpt0:0:3:0): error 22 > (probe3:mpt0:0:3:0): Unretryable Error > (probe18:mpt1:0:3:0): error 22 > (probe18:mpt1:0:3:0): Unretryable Error > (probe4:mpt0:0:4:0): error 22 > (probe4:mpt0:0:4:0): Unretryable Error > (probe19:mpt1:0:4:0): error 22 > (probe19:mpt1:0:4:0): Unretryable Error > (probe5:mpt0:0:5:0): error 22 > (probe5:mpt0:0:5:0): Unretryable Error > (probe20:mpt1:0:5:0): error 22 > (probe20:mpt1:0:5:0): Unretryable Error > (probe7:mpt0:0:8:0): error 22 > (probe7:mpt0:0:8:0): Unretryable Error > (probe21:mpt1:0:6:0): error 22 > (probe21:mpt1:0:6:0): Unretryable Error > (probe8:mpt0:0:9:0): error 22 > (probe8:mpt0:0:9:0): Unretryable Error > (probe22:mpt1:0:8:0): error 22 > (probe22:mpt1:0:8:0): Unretryable Error > (probe9:mpt0:0:10:0): error 22 > (probe9:mpt0:0:10:0): Unretryable Error > (probe23:mpt1:0:9:0): error 22 > (probe23:mpt1:0:9:0): Unretryable Error > (probe10:mpt0:0:11:0): error 22 > (probe10:mpt0:0:11:0): Unretryable Error > (probe24:mpt1:0:10:0): error 22 > (probe24:mpt1:0:10:0): Unretryable Error > (probe11:mpt0:0:12:0): error 22 > (probe11:mpt0:0:12:0): Unretryable Error > (probe25:mpt1:0:11:0): error 22 > (probe25:mpt1:0:11:0): Unretryable Error > (probe12:mpt0:0:13:0): error 22 > (probe12:mpt0:0:13:0): Unretryable Error > (probe26:mpt1:0:12:0): error 22 > (probe26:mpt1:0:12:0): Unretryable Error > (probe13:mpt0:0:14:0): error 22 > (probe13:mpt0:0:14:0): Unretryable Error > (probe27:mpt1:0:13:0): error 22 > (probe27:mpt1:0:13:0): Unretryable Error > (probe14:mpt0:0:15:0): error 22 > (probe14:mpt0:0:15:0): Unretryable Error > (probe0:mpt0:0:0:0): Retrying Command > (probe28:mpt1:0:14:0): error 22 > (probe28:mpt1:0:14:0): Unretryable Error > (probe29:mpt1:0:15:0): error 22 > (probe29:mpt1:0:15:0): Unretryable Error > GEOM: create disk da0 dp=0xc64f0850 > pass0 at mpt0 bus 0 target 0 lun 0 > pass0: <IBM IC35L073UCDY10-0 S27F> Fixed Direct Access SCSI-3 device > pass0: Serial Number E6VPJ79C > pass0: 320.000MB/s transfers (160.000MHz, offset 127, 16bit), Tagged Queueing Enabled > pass1 at mpt0 bus 0 target 6 lun 0 > pass1: <PE/PV 1x6 SCSI BP 1.1> Fixed Processor SCSI-2 device > pass1: Serial Number 1 > pass1: 3.300MB/s transfers > ses0 at mpt0 bus 0 target 6 lun 0 > ses0: <PE/PV 1x6 SCSI BP 1.1> Fixed Processor SCSI-2 device > ses0: Serial Number 1 > ses0: 3.300MB/s transfers > ses0: SAF-TE Compliant Device > da0 at mpt0 bus 0 target 0 lun 0 > da0: <IBM IC35L073UCDY10-0 S27F> Fixed Direct Access SCSI-3 device > da0: Serial Number E6VPJ79C > da0: 320.000MB/s transfers (160.000MHz, offset 127, 16bit), Tagged Queueing Enabled > da0: 70007MB (143374650 512 byte sectors: 255H 63S/T 8924C) > GEOM: new disk da0 > [0] f:80 typ:165 s(CHS):0/1/1 e(CHS):1023/254/63 s:63 l:143363997 > [1] f:00 typ:0 s(CHS):0/0/0 e(CHS):0/0/0 s:0 l:0 > [2] f:00 typ:0 s(CHS):0/0/0 e(CHS):0/0/0 s:0 l:0 > [3] f:00 typ:0 s(CHS):0/0/0 e(CHS):0/0/0 s:0 l:0 > GEOM: Configure da0s1, start 32256 length 73402366464 end 73402398719 > GEOM: Configure da0s1a, start 0 length 268435456 end 268435455 > GEOM: Configure da0s1b, start 268435456 length 2123890688 end 2392326143 > GEOM: Configure da0s1c, start 0 length 73402366464 end 73402366463 > GEOM: Configure da0s1d, start 2392326144 length 268435456 end 2660761599 > GEOM: Configure da0s1e, start 2660761600 length 268435456 end 2929197055 > GEOM: Configure da0s1f, start 2929197056 length 70473169408 end 73402366463 > Mounting root from ufs:/dev/da0s1a And then, adding two more disks and running camcontrol. > # camcontrol devlist -v > scbus0 on mpt0 bus 0: > <IBM IC35L073UCDY10-0 S27F> at scbus0 target 0 lun 0 (pass0,da0) > <PE/PV 1x6 SCSI BP 1.1> at scbus0 target 6 lun 0 (ses0,pass1) > < > at scbus0 target -1 lun -1 () > scbus1 on mpt1 bus 0: > < > at scbus1 target -1 lun -1 () > scbus-1 on xpt0 bus 0: > < > at scbus-1 target -1 lun -1 (xpt0) > # camcontrol rescan all > (probe3:mpt0:0:3:0): error 22 > (probe3:mpt0:0:3:0): Unretryable Error > (probe4:mpt0:0:4:0): error 22 > (probe4:mpt0:0:4:0): Unretryable Error > (probe5:mpt0:0:5:0): error 22 > (probe5:mpt0:0:5:0): Unretryable Error > (probe7:mpt0:0:8:0): error 22 > (probe7:mpt0:0:8:0): Unretryable Error > (probe8:mpt0:0:9:0): error 22 > (probe8:mpt0:0:9:0): Unretryable Error > (probe9:mpt0:0:10:0): error 22 > (probe9:mpt0:0:10:0): Unretryable Error > (probe10:mpt0:0:11:0): error 22 > (probe10:mpt0:0:11:0): Unretryable Error > (probe11:mpt0:0:12:0): error 22 > (probe11:mpt0:0:12:0): Unretryable Error > (probe12:mpt0:0:13:0): error 22 > (probe12:mpt0:0:13:0): Unretryable Error > (probe13:mpt0:0:14:0): error 22 > (probe13:mpt0:0:14:0): Unretryable Error > (probe14:mpt0:0:15:0): error 22 > (probe14:mpt0:0:15:0): Unretryable Error > (probe1:mpt0:0:1:0): Retrying Command > (probe2:mpt0:0:2:0): Retrying Command > (probe1:mpt0:0:1:0): Retrying Command > (probe2:mpt0:0:2:0): Retrying Command > pass2 at mpt0 bus 0 target 2 lun 0 > pass2: <IBM IC35L073UCDY10-0 S27F> Fixed Direct Access SCSI-3 device > pass2: Serial Number E6VPAX2C > pass2: 320.000MB/s transfers (160.000MHz, offset 127, 16bit), Tagged Queueing Enabled > GEOM: create disk da1 dp=0xc62ed850 > GEOM: new disk da1 > da1 at mpt0 bus 0 target 2 lun 0 > da1: <IBM IC35L073UCDY10-0 S27F> Fixed Direct Access SCSI-3 device > da1: Serial Number E6VPAX2C > da1: 320.000MB/s transfers (160.000MHz, offset 127, 16bit), Tagged Queueing Enabled > da1: 70007MB (143374650 512 byte sectors: 255H 63S/T 8924C) > [0] f:00 typ:222 s(CHS):0/1/1 e(CHS):4/254/63 s:63 l:80262 > [1] f:00 typ:142 s(CHS):5/0/1 e(CHS):331/254/63 s:80325 l:5253255 > [2] f:80 typ:131 s(CHS):332/0/1 e(CHS):344/254/63 s:5333580 l:208845 > [3] f:00 typ:15 s(CHS):345/0/1 e(CHS):1023/254/63 s:5542425 l:137821635 > GEOM: Configure da1s1, start 32256 length 41094144 end 41126399 > GEOM: Configure da1s2, start 41126400 length 2689666560 end 2730792959 > GEOM: Configure da1s3, start 2730792960 length 106928640 end 2837721599 > GEOM: Configure da1s4, start 2837721600 length 70564677120 end 73402398719 > pass3 at mpt0 bus 0 target 1 lun 0 > pass3: <IBM IC35L073UCDY10-0 S27F> Fixed Direct Access SCSI-3 device > pass3: Serial Number E6VPD95D > pass3: 320.000MB/s transfers (160.000MHz, offset 127, 16bit), Tagged Queueing Enabled > GEOM: create disk da2 dp=0xc64e8850 > da2 at mpt0 bus 0 target 1 lun 0 > da2: <IBM IC35L073UCDY10-0 S27F> Fixed Direct Access SCSI-3 device > da2: Serial Number E6VPD95D > da2: 320.000MB/s transfers (160.000MHz, offset 127, 16bit), Tagged Queueing Enabled > da2: 70007MB (143374650 512 byte sectors: 255H 63S/T 8924C) > Re-scan of bus 0 was successful > MBREXT Slice 5 on da1s4: > [0] f:00 typ:131 s(CHS):345/1/1 e(CHS):1023/254/63 s:63 l:20466747 > [1] f:00 typ:5 s(CHS):1023/254/63 e(CHS):1023/254/63 s:20466810 l:88598475 > GEOM: Configure da1s5, start 32256 length 10478974464 end 10479006719 > MBREXT Slice 6 on da1s4: > [0] f:00 typ:142 s(CHS):1023/254/63 e(CHS):1023/254/63 s:63 l:88598412 > [1] f:00 typ:5 s(CHS):1023/254/63 e(CHS):1023/254/63 s:109065285 l:20466810 > GEOM: Configure da1s6, start 10479038976 length 45362386944 end 55841425919 > MBREXT Slice 7 on da1s4: > [0] f:00 typ:131 s(CHS):1023/254/63 e(CHS):1023/254/63 s:63 l:20466747 > [1] f:00 typ:5 s(CHS):1023/254/63 e(CHS):1023/254/63 s:129532095 l:2104515 > GEOM: Configure da1s7, start 55841458176 length 10478974464 end 66320432639 > MBREXT Slice 8 on da1s4: > [0] f:00 typ:131 s(CHS):1023/254/63 e(CHS):1023/254/63 s:63 l:2104452 > [1] f:00 typ:5 s(CHS):1023/254/63 e(CHS):1023/254/63 s:131636610 l:2104515 > GEOM: Configure da1s8, start 66320464896 length 1077479424 end 67397944319 > MBREXT Slice 9 on da1s4: > [0] f:00 typ:131 s(CHS):1023/254/63 e(CHS):1023/254/63 s:63 l:2104452 > [1] f:00 typ:5 s(CHS):1023/254/63 e(CHS):1023/254/63 s:133741125 l:4080510 > GEOM: Configure da1s9, start 67397976576 length 1077479424 end 68475455999 > MBREXT Slice 10 on da1s4: > [0] f:00 typ:130 s(CHS):1023/254/63 e(CHS):1023/254/63 s:63 l:4080447 > [1] f:00 typ:0 s(CHS):0/0/0 e(CHS):0/0/0 s:0 l:0 > GEOM: Configure da1s10, start 68475488256 length 2089188864 end 70564677119 > GEOM: new disk da2 > (probe0:mpt1:0:0:0): error 22 > (probe0:mpt1:0:0:0): Unretryable Error > [0] f:00 typ:0 s(CHS):0/0/0 e(CHS):0/0/0 s:0 l:0 > [1] f:00 typ:0 s(CHS):0/0/0 e(CHS):0/0/0 s:0 l:0 > [2] f:00 typ:0 s(CHS):0/0/0 e(CHS):0/0/0 s:0 l:0 > [3] f:00 typ:0 s(CHS):0/0/0 e(CHS):0/0/0 s:0 l:0 > (probe2:mpt1:0:1:0): error 22 > (probe2:mpt1:0:1:0): Unretryable Error > (probe3:mpt1:0:2:0): error 22 > (probe3:mpt1:0:2:0): Unretryable Error > (probe4:mpt1:0:3:0): error 22 > (probe4:mpt1:0:3:0): Unretryable Error > (probe5:mpt1:0:4:0): error 22 > (probe5:mpt1:0:4:0): Unretryable Error > (probe6:mpt1:0:5:0): error 22 > (probe6:mpt1:0:5:0): Unretryable Error > (probe7:mpt1:0:6:0): error 22 > (probe7:mpt1:0:6:0): Unretryable Error > (probe8:mpt1:0:8:0): error 22 > (probe8:mpt1:0:8:0): Unretryable Error > (probe9:mpt1:0:9:0): error 22 > (probe9:mpt1:0:9:0): Unretryable Error > (probe10:mpt1:0:10:0): error 22 > (probe10:mpt1:0:10:0): Unretryable Error > (probe11:mpt1:0:11:0): error 22 > (probe11:mpt1:0:11:0): Unretryable Error > (probe12:mpt1:0:12:0): error 22 > (probe12:mpt1:0:12:0): Unretryable Error > (probe13:mpt1:0:13:0): error 22 > (probe13:mpt1:0:13:0): Unretryable Error > (probe14:mpt1:0:14:0): error 22 > (probe14:mpt1:0:14:0): Unretryable Error > (probe15:mpt1:0:15:0): error 22 > (probe15:mpt1:0:15:0): Unretryable Error > Re-scan of bus 1 was successful > # camcontrol devlist -v > scbus0 on mpt0 bus 0: > <IBM IC35L073UCDY10-0 S27F> at scbus0 target 0 lun 0 (pass0,da0) > <IBM IC35L073UCDY10-0 S27F> at scbus0 target 1 lun 0 (da2,pass3) > <IBM IC35L073UCDY10-0 S27F> at scbus0 target 2 lun 0 (da1,pass2) > <PE/PV 1x6 SCSI BP 1.1> at scbus0 target 6 lun 0 (ses0,pass1) > < > at scbus0 target -1 lun -1 () > scbus1 on mpt1 bus 0: > < > at scbus1 target -1 lun -1 () > scbus-1 on xpt0 bus 0: > < >
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?200310292040.h9TKerSo088206>