Skip site navigation (1)Skip section navigation (2)
Date:      Sun, 4 Sep 2005 20:18:35 -0400
From:      Jeff Tchang <jeff.tchang@gmail.com>
To:        freebsd-performance@freebsd.org
Subject:   3Ware 7500-4 Slow
Message-ID:  <63f9d26505090417183dff415e@mail.gmail.com>

next in thread | raw e-mail | index | archive | help
I have a 3Ware 7500-4 card. I am experiencing some sluggishness with the=20
RAID5 implementation. It has been running in a stable state for quite some=
=20
time, however, I have always wondered if there was something I was not doin=
g=20
because it is very slow.

System Specs:

pharos# dmesg | grep twe
twe0: <3ware Storage Controller driver ver. 1.40.01.001 <http://1.40.01.001=
>>=20
port 0xccd0-0xccdf mem 0xfe000000-0xfe7fffff,0xfe800400-0xfe80040f irq 2 at=
=20
device 16.0 on pci0
twe0: 4 ports, Firmware FE7X 1.05.00.068 <http://1.05.00.068>, BIOS BE7X=20
1.08.00.048 <http://1.08.00.048>;
twed0: <Unit 0, RAID5, Normal> on twe0
twed0: 152636MB (312598784 sectors)
Mounting root from ufs:/dev/twed0s1a


uname -a

FreeBSD 4.10-RELEASE FreeBSD 4.10-RELEASE #4: Sat Sep 3 15:53:44 EDT 2005=
=20
i386


3ware CLI> info
List of controllers
-------------------
Controller 0: 7500-4 (4)
3ware CLI> info c0
Controller: c0
-------------
Driver: 1.40.01.001 <http://1.40.01.001>;
Model: 7500-4
FW: FE7X 1.05.00.068 <http://1.05.00.068>;
BIOS: BE7X 1.08.00.048 <http://1.08.00.048>;
Monitor: ME7X 1.01.00.040 <http://1.01.00.040>;
Serial #:=20
PCB: Rev3
PCHIP: 1.30-33
ACHIP: 3.20

# of units: 1
Unit 0: RAID 5 149.05 GB ( 312598784 blocks): OK

# of ports: 4
Port 0: ST380020A 74.53 GB (156301488 blocks): OK(unit 0)
Port 1: ST380020A 74.53 GB (156301488 blocks): OK(unit 0)
Port 2: ST380020A 74.53 GB (156301488 blocks): OK(unit 0)


3ware CLI> info c0 u0
Unit /c0/u0
---------------------
Status: OK
Unit Type: RAID 5
Stripe Size: 64k
Size: 149.05 GB (312598784 blocks)
# of subunits: 3

Subunit 0: CBOD: OK
Physical Port: 0
Logical Port: 0

Subunit 1: CBOD: OK
Physical Port: 1
Logical Port: 1

Subunit 2: CBOD: OK
Physical Port: 2
Logical Port: 2

When I run systat -vmstat 1, I continually see twed0 running at 100% busy.=
=20
In addition KB/t is between 1 and 10. tps is about 50.

The dmesg says that the device is on irq2. The vmstat shows the interrupt a=
s=20
mux irq2 and is about 300 to 500 calls. As far as I know, I am using the=20
most up to date firmware for the card. The computer itself is a dual 600 Mh=
z=20
PIII (Dell).

When I attempt to write many small files or remove a directory is when the=
=20
slowness kicks in. Is this just something due to Raid5? Here is the output=
=20
of Bonnie++:

Version 1.93c ------Sequential Output------ --Sequential Input- --Random-
Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP
pharos. 300M 53 94 16394 24 7163 14 121 95 35991 35 249.8 12
Latency 261ms 400ms 485ms 93237us 26252us 12216ms
Version 1.93c ------Sequential Create------ --------Random Create--------
pharos -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
16 3835 45 28846 93 8255 85 4249 56 26604 84 4835 52
Latency 43557us 3422us 8544us 169ms 39158us 6936us



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?63f9d26505090417183dff415e>