Date: Wed, 29 Dec 2004 02:17:19 +0300 (MSK) From: Hostas Red <kong@kong.spb.ru> To: Don Bowman <don@SANDVINE.com> Subject: RE: aac controller in amd64 very slow? Message-ID: <20041229021224.E51667@kong.rascom.ru> Resent-Message-ID: <20041229021824.Q51667@kong.rascom.ru> In-Reply-To: <2BCEB9A37A4D354AA276774EE13FB8C219AE66@mailserver.sandvine.com> References: <2BCEB9A37A4D354AA276774EE13FB8C219AE66@mailserver.sandvine.com>
next in thread | previous in thread | raw e-mail | index | archive | help
Hi!
On Tue, 28 Dec 2004, Don Bowman wrote:
> well, on the aac, you need to disable the read-cache otherwise it has
> very very poor performance.
> I think this can be done from scsi bios. it can also be done via aaccli.
As far as I can see from the tests the read speed is not a problem - it's
a write operations that are VERY slow. Anyway, I've disabled a read-cache
via aaccli - no effect. Or I need to reset a box to apply aac
configuration changes? And one more - controller has no battery connected,
but have an enabled write-cache:
AAC0> container show cache 0
Executing: container show cache 0
Global Container Read Cache Size : 0
Global Container Write Cache Size : 16203776
Read Cache Setting : DISABLE
Write Cache Setting : ENABLE ALWAYS
Write Cache Status : Active, not protected, battery not present
And that's my contaier config:
AAC0> container list
Executing: container list
Num Total Oth Stripe Scsi Partition
Label Type Size Ctr Size Usage C:ID:L Offset:Size
----- ------ ------ --- ------ ------- ------ -------------
0 RAID-5 410GB 64KB Open 0:00:0 64.0KB: 136GB
/dev/aacd0 raid 5 0:01:0 64.0KB: 136GB
0:02:0 64.0KB: 136GB
0:03:0 64.0KB: 136GB
>> -----Original Message-----
>> From: owner-freebsd-amd64@freebsd.org
>> [mailto:owner-freebsd-amd64@freebsd.org] On Behalf Of Hostas Red
>> Sent: December 27, 2004 9:02 AM
>> To: freebsd-amd64@freebsd.org
>> Subject: aac controller in amd64 very slow?
>>
>> Hi!
>>
>> 1) I have one Quad Opteron box with FreeBSD 5.3-amd64
>> installed and have strange downgrade in performance with
>> Adaptec 2120S raid controller (acc driver, 4-disk RAID5
>> configured). It is approx. 30-40% loss in performance of disk
>> operations compared to my previous Dual 2.4 Xeon with Adaptec
>> 2015S with two disks mirrored.
>>
>> Is it normal or maybe I need some tweaking? Also one of my
>> colleagues suggested installation of i386 version of 5.3 for
>> speeding things up, that sound strange for me.
>>
>> I'm new for amd64 version of freebsd, but using freebsd-i386
>> for 7 years or so on i386 platforms. May this problem be an
>> amd64-specific?
>>
>> Any suggestions how I can resolve this problem?
>>
>>
>>
>> 2) One more Q - apache is eating a lot of memory when running
>> - about 64M for each process instead of usual approx 7-10M
>> per process on previous
>> i386 with same compiled configuration:
>>
>> == from top ===
>> PID USERNAME PRI NICE SIZE RES STATE C TIME WCPU
>> CPU COMMAND
>> 3351 www 96 0 69560K 18712K select 3 0:01 0.93%
>> 0.93% httpd
>> ==========
>>
>> Other programs looks the same or about it. Is it normal for
>> amd64 platform or also my mistake?
>>
>>
>>
>> 3) And one more Q - box has 4G of memory, but kernel can see
>> only 3.5G, as
>> can be seen from following dmesg output. What can be a problem?
>>
>>
>>
>> Box is a Tyan's Thunder K8QS Pro (S4882) 4-way AMD Opteron
>> platform (with
>> Tyan S4882UG2NR board).
>>
>> Disk split in two parts:
>>
>> Filesystem 1K-blocks Used Avail Capacity Mounted on
>> /dev/aacd0s1a 6090094 1998300 3604588 36% /
>> devfs 1 1 0 100% /dev
>> /dev/aacd0s1d 402268316 26148124 343938728 7% /work
>>
>> On /, of course, is a system and second one is working partiton.
>>
>> Here's boot message of the new box:
>>
>> Copyright (c) 1992-2004 The FreeBSD Project.
>> Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992,
>> 1993, 1994
>> The Regents of the University of California. All
>> rights reserved.
>> FreeBSD 5.3-STABLE #2: Mon Dec 27 08:27:05 GMT 2004
>> root@sys154.3fn.net:/usr/obj/usr/src/sys/kong
>> Timecounter "i8254" frequency 1193182 Hz quality 0
>> CPU: AMD Opteron(tm) Processor 846 (1992.22-MHz K8-class CPU)
>> Origin = "AuthenticAMD" Id = 0xf58 Stepping = 8
>>
>> Features=0x78bfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP
> ,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2>
>> AMD Features=0xe0500800<SYSCALL,NX,MMX+,LM,3DNow+,3DNow>
>> real memory = 3757506560 (3583 MB)
>> avail memory = 3627720704 (3459 MB)
>> ACPI APIC Table: <PTLTD APIC >
>> FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
>> cpu0 (BSP): APIC ID: 0
>> cpu1 (AP): APIC ID: 1
>> cpu2 (AP): APIC ID: 2
>> cpu3 (AP): APIC ID: 3
>> MADT: Forcing active-low polarity and level trigger for SCI
>> ioapic0 <Version 1.1> irqs 0-23 on motherboard
>> ioapic1 <Version 1.1> irqs 24-27 on motherboard
>> ioapic2 <Version 1.1> irqs 28-31 on motherboard
>> ioapic3 <Version 1.1> irqs 32-35 on motherboard
>> ioapic4 <Version 1.1> irqs 36-39 on motherboard
>> acpi0: <PTLTD XSDT> on motherboard
>> acpi0: Power Button (fixed)
>> unknown: I/O range not supported
>> unknown: I/O range not supported
>> Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000
>> acpi_timer0: <24-bit timer at 3.579545MHz> port 0xc008-0xc00b on acpi0
>> cpu0: <ACPI CPU> on acpi0
>> cpu1: <ACPI CPU> on acpi0
>> cpu2: <ACPI CPU> on acpi0
>> cpu3: <ACPI CPU> on acpi0
>> acpi_button0: <Power Button> on acpi0
>> pcib0: <ACPI Host-PCI bridge> port
>> 0xc080-0xc0ff,0xc000-0xc07f,0xcf8-0xcff iomem 0xd8000-0xdbfff on acpi0
>> pci0: <ACPI PCI bus> on pcib0
>> pcib1: <ACPI PCI-PCI bridge> at device 6.0 on pci0
>> pci1: <ACPI PCI bus> on pcib1
>> ohci0: <OHCI (generic) USB controller> mem
>> 0xe8000000-0xe8000fff irq 19 at device 0.0 on pci1
>> ohci0: [GIANT-LOCKED]
>> usb0: OHCI version 1.0, legacy support
>> usb0: SMM does not respond, resetting
>> usb0: <OHCI (generic) USB controller> on ohci0
>> usb0: USB revision 1.0
>> uhub0: AMD OHCI root hub, class 9/0, rev 1.00/1.00, addr 1
>> uhub0: 3 ports with 3 removable, self powered
>> ohci1: <OHCI (generic) USB controller> mem
>> 0xe8001000-0xe8001fff irq 19 at device 0.1 on pci1
>> ohci1: [GIANT-LOCKED]
>> usb1: OHCI version 1.0, legacy support
>> usb1: SMM does not respond, resetting
>> usb1: <OHCI (generic) USB controller> on ohci1
>> usb1: USB revision 1.0
>> uhub1: AMD OHCI root hub, class 9/0, rev 1.00/1.00, addr 1
>> uhub1: 3 ports with 3 removable, self powered
>> pci1: <display, VGA> at device 4.0 (no driver attached)
>> isab0: <PCI-ISA bridge> at device 7.0 on pci0
>> isa0: <ISA bus> on isab0
>> atapci0: <AMD 8111 UDMA133 controller> port
>> 0x1000-0x100f,0x376,0x170-0x177,0x3f6,0x1f0-0x1f7 at device
>> 7.1 on pci0
>> ata0: channel #0 on atapci0
>> ata1: channel #1 on atapci0
>> pci0: <bridge, PCI-unknown> at device 7.3 (no driver attached)
>> pcib2: <ACPI Host-PCI bridge> on acpi0
>> pci8: <ACPI PCI bus> on pcib2
>> pcib3: <ACPI PCI-PCI bridge> at device 1.0 on pci8
>> pci9: <ACPI PCI bus> on pcib3
>> aac0: <Adaptec SCSI RAID 2120S> mem 0xf8000000-0xfbffffff irq
>> 26 at device 2.0 on pci9
>> aac0: [FAST]
>> aac0: Enabling 64-bit address support
>> aac0: Unknown processor 100MHz, 48MB cache memory, optional
>> battery not installed
>> aac0: Kernel 4.1-0, Build 7244, S/N be37b0
>> aac0: Supported
>> Options=11d7e<CLUSTERS,WCACHE,DATA64,HOSTTIME,RAID50,WINDOW4GB
>> ,SOFTERR,SGMAP64,ALARM,NONDASD>
>> aacp0: <SCSI Passthrough Bus> on aac0
>> pci8: <base peripheral, interrupt controller> at device 1.1
>> (no driver attached)
>> pcib4: <ACPI PCI-PCI bridge> at device 2.0 on pci8
>> pci14: <ACPI PCI bus> on pcib4
>> mpt0: <LSILogic 1030 Ultra4 Adapter> port 0x3000-0x30ff mem
>> 0xed000000-0xed00ffff,0xed010000-0xed01ffff irq 29 at device
>> 1.0 on pci14
>> mpt0: [GIANT-LOCKED]
>> mpt1: <LSILogic 1030 Ultra4 Adapter> port 0x3400-0x34ff mem
>> 0xed020000-0xed02ffff,0xed030000-0xed03ffff irq 30 at device
>> 1.1 on pci14
>> mpt1: [GIANT-LOCKED]
>> bge0: <Broadcom BCM5704C Dual Gigabit Ethernet, ASIC rev.
>> 0x2002> mem 0xed040000-0xed04ffff,0xed050000-0xed05ffff irq
>> 31 at device 3.0 on pci14
>> miibus0: <MII bus> on bge0
>> brgphy0: <BCM5704 10/100/1000baseTX PHY> on miibus0
>> brgphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX,
>> 1000baseTX, 1000baseTX-FDX, auto
>> bge0: Ethernet address: 00:00:1a:1a:0d:5a
>> bge1: <Broadcom BCM5704C Dual Gigabit Ethernet, ASIC rev.
>> 0x2002> mem 0xed060000-0xed06ffff,0xed070000-0xed07ffff irq
>> 28 at device 3.1 on pci14
>> miibus1: <MII bus> on bge1
>> brgphy1: <BCM5704 10/100/1000baseTX PHY> on miibus1
>> brgphy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX,
>> 1000baseTX, 1000baseTX-FDX, auto
>> bge1: Ethernet address: 00:00:1a:1a:0d:5b
>> pci8: <base peripheral, interrupt controller> at device 2.1
>> (no driver attached)
>> pcib5: <ACPI PCI-PCI bridge> mem 0xea202000-0xea202fff irq 32
>> at device 3.0 on pci8
>> pci19: <ACPI PCI bus> on pcib5
>> pci8: <base peripheral, interrupt controller> at device 3.1
>> (no driver attached)
>> pcib6: <ACPI PCI-PCI bridge> mem 0xea204000-0xea204fff irq 36
>> at device 4.0 on pci8
>> pci27: <ACPI PCI bus> on pcib6
>> pci8: <base peripheral, interrupt controller> at device 4.1
>> (no driver attached)
>> atkbdc0: <Keyboard controller (i8042)> port 0x64,0x60 irq 1 on acpi0
>> sio0: <16550A-compatible COM port> port 0x3f8-0x3ff irq 4
>> flags 0x10 on acpi0
>> sio0: type 16550A, console
>> fdc0: <floppy drive controller> port 0x3f7,0x3f0-0x3f5 irq 6
>> drq 2 on acpi0
>> fdc0: [FAST]
>> fd0: <1440-KB 3.5" drive> on fdc0 drive 0
>> orm0: <ISA Option ROMs> at iomem
>> 0xcc800-0xd0fff,0xcb000-0xcc7ff,0xc9800-0xcafff,0xc9000-0xc97f
>> f,0xc8000-0xc8fff,0xc0000-0xc7fff on isa0
>> sc0: <System console> at flags 0x100 on isa0
>> sc0: VGA <16 virtual consoles, flags=0x100>
>> sio1: configured irq 3 not in bitmap of probed irqs 0
>> sio1: port may not be enabled
>> vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem
>> 0xa0000-0xbffff on isa0
>> Timecounters tick every 1.000 msec
>> ipfw2 initialized, divert disabled, rule-based forwarding
>> disabled, default to accept, logging disabled
>> acd0: DVDROM <DV-28E-B/1.2B> at ata0-master UDMA33
>> Waiting 15 seconds for SCSI devices to settle
>> aacd0: <RAID 5> on aac0
>> aacd0: 419943MB (860045184 sectors)
>> (probe0:aacp0:0:0:0): INQUIRY. CDB: 12 0 0 0 24 0
>> (probe0:aacp0:0:0:0): ILLEGAL REQUEST asc:55,3
>> (probe0:aacp0:0:0:0): Reserved ASC/ASCQ pair
>> (probe5:aacp0:0:5:0): INQUIRY. CDB: 12 0 0 0 24 0
>> (probe5:aacp0:0:5:0): ILLEGAL REQUEST asc:55,3
>> (probe5:aacp0:0:5:0): Reserved ASC/ASCQ pair
>> (probe9:aacp0:0:10:0): INQUIRY. CDB: 12 0 0 0 24 0
>> (probe9:aacp0:0:10:0): ILLEGAL REQUEST asc:55,3
>> (probe9:aacp0:0:10:0): Reserved ASC/ASCQ pair
>> (probe10:aacp0:0:11:0): INQUIRY. CDB: 12 0 0 0 24 0
>> (probe10:aacp0:0:11:0): ILLEGAL REQUEST asc:55,3
>> (probe10:aacp0:0:11:0): Reserved ASC/ASCQ pair
>> (probe13:aacp0:0:14:0): INQUIRY. CDB: 12 0 0 0 24 0
>> (probe13:aacp0:0:14:0): ILLEGAL REQUEST asc:55,3
>> (probe13:aacp0:0:14:0): Reserved ASC/ASCQ pair
>> (probe1:aacp0:0:1:0): INQUIRY. CDB: 12 0 0 0 24 0
>> (probe1:aacp0:0:1:0): ILLEGAL REQUEST asc:55,3
>> (probe1:aacp0:0:1:0): Reserved ASC/ASCQ pair
>> (probe2:aacp0:0:2:0): INQUIRY. CDB: 12 0 0 0 24 0
>> (probe2:aacp0:0:2:0): ILLEGAL REQUEST asc:55,3
>> (probe2:aacp0:0:2:0): Reserved ASC/ASCQ pair
>> (probe3:aacp0:0:3:0): INQUIRY. CDB: 12 0 0 0 24 0
>> (probe3:aacp0:0:3:0): ILLEGAL REQUEST asc:55,3
>> (probe3:aacp0:0:3:0): Reserved ASC/ASCQ pair
>> (probe4:aacp0:0:4:0): INQUIRY. CDB: 12 0 0 0 24 0
>> (probe4:aacp0:0:4:0): ILLEGAL REQUEST asc:55,3
>> (probe4:aacp0:0:4:0): Reserved ASC/ASCQ pair
>> (probe6:aacp0:0:6:0): INQUIRY. CDB: 12 0 0 0 24 0
>> (probe6:aacp0:0:6:0): ILLEGAL REQUEST asc:55,3
>> (probe6:aacp0:0:6:0): Reserved ASC/ASCQ pair
>> (probe7:aacp0:0:8:0): INQUIRY. CDB: 12 0 0 0 24 0
>> (probe7:aacp0:0:8:0): ILLEGAL REQUEST asc:55,3
>> (probe7:aacp0:0:8:0): Reserved ASC/ASCQ pair
>> (probe8:aacp0:0:9:0): INQUIRY. CDB: 12 0 0 0 24 0
>> (probe8:aacp0:0:9:0): ILLEGAL REQUEST asc:55,3
>> (probe8:aacp0:0:9:0): Reserved ASC/ASCQ pair
>> (probe11:aacp0:0:12:0): INQUIRY. CDB: 12 0 0 0 24 0
>> (probe11:aacp0:0:12:0): ILLEGAL REQUEST asc:55,3
>> (probe11:aacp0:0:12:0): Reserved ASC/ASCQ pair
>> (probe12:aacp0:0:13:0): INQUIRY. CDB: 12 0 0 0 24 0
>> (probe12:aacp0:0:13:0): ILLEGAL REQUEST asc:55,3
>> (probe12:aacp0:0:13:0): Reserved ASC/ASCQ pair
>> (probe14:aacp0:0:15:0): INQUIRY. CDB: 12 0 0 0 24 0
>> (probe14:aacp0:0:15:0): ILLEGAL REQUEST asc:55,3
>> (probe14:aacp0:0:15:0): Reserved ASC/ASCQ pair
>> SMP: AP CPU #2 Launched!
>> SMP: AP CPU #1 Launched!
>> SMP: AP CPU #3 Launched!
>> Mounting root from ufs:/dev/aacd0s1a
>>
>> Thank You.
>>
>> adios,
>> /kong
>>
>> ==============================================================
>> ==========
>> Hostas Red (KVK10, KVK10-RIPE) || IP Networks Administrator,
>> CJSC Rascom
>> ==============================================================
>> ==========
>> _______________________________________________
>> freebsd-amd64@freebsd.org mailing list
>> http://lists.freebsd.org/mailman/listinfo/freebsd-amd64
>> To unsubscribe, send any mail to
>> "freebsd-amd64-unsubscribe@freebsd.org"
>>
>>
>
adios,
/kong
========================================================================
Hostas Red (KVK10, KVK10-RIPE) || IP Networks Administrator, CJSC Rascom
========================================================================
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20041229021224.E51667>