From owner-freebsd-stable@FreeBSD.ORG Thu Aug 5 06:10:09 2010 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 8E6A2106564A for ; Thu, 5 Aug 2010 06:10:09 +0000 (UTC) (envelope-from alexvpetrov@gmail.com) Received: from mail-ey0-f182.google.com (mail-ey0-f182.google.com [209.85.215.182]) by mx1.freebsd.org (Postfix) with ESMTP id 1BF948FC1F for ; Thu, 5 Aug 2010 06:10:08 +0000 (UTC) Received: by eyh6 with SMTP id 6so2596047eyh.13 for ; Wed, 04 Aug 2010 23:10:07 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:from:to:subject:date :user-agent:references:in-reply-to:cc:mime-version:content-type :content-transfer-encoding:message-id; bh=VZ4rqt5u4St6DbAaZCaBMt4PP+ioAdkkLliJynBgV5s=; b=Wd+UpQj4nQZRP7k87bxgRAR9R4c3px4+axHFXl2KRdFhJX0OlZx+1fLBc78ksBNbOj yXLZphNranHmEF3K+OKGABplqkXm/afX/B2IZByV5l/hFc0Wf/rg7guRGw5z07wLFvXC 20N0OYrEEMJMaPNc2jMMiWYwsUZAMex2FcuUo= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=from:to:subject:date:user-agent:references:in-reply-to:cc :mime-version:content-type:content-transfer-encoding:message-id; b=c/8xA9lSxmiP9HM16uosnJtZbbIeIOvAs1cZep3drSooRglnaK4sUH3ZujQJPZerJs Xg7YKO6/c/D3JI/MAuTszfuo/nJnma1BQJ03OlT85ztRPMbQDeFGr4mpiueOiTjX975o yOYQL49Rzm2gGjLWU5RA0Vc4SHo0uqYSyhrco= Received: by 10.213.41.133 with SMTP id o5mr2770434ebe.54.1280988607684; Wed, 04 Aug 2010 23:10:07 -0700 (PDT) Received: from alex.super ([91.195.101.86]) by mx.google.com with ESMTPS id a48sm14143282eei.6.2010.08.04.23.10.03 (version=TLSv1/SSLv3 cipher=RC4-MD5); Wed, 04 Aug 2010 23:10:06 -0700 (PDT) From: "Alex V. Petrov" To: Jeremy Chadwick Date: Thu, 5 Aug 2010 14:09:57 +0800 User-Agent: KMail/1.13.5 (FreeBSD/8.1-STABLE; KDE/4.4.5; amd64; ; ) References: <201008042008.25679.alexvpetrov@gmail.com> <201008051247.43260.alexvpetrov@gmail.com> <20100805053504.GA91196@icarus.home.lan> In-Reply-To: <20100805053504.GA91196@icarus.home.lan> MIME-Version: 1.0 Content-Type: Text/Plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Message-Id: <201008051409.57751.alexvpetrov@gmail.com> Cc: freebsd-stable@freebsd.org Subject: Re: zpool - low speed write X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Aug 2010 06:10:09 -0000 =D0=92 =D1=81=D0=BE=D0=BE=D0=B1=D1=89=D0=B5=D0=BD=D0=B8=D0=B8 =D0=BE=D1=82 = 5 =D0=B0=D0=B2=D0=B3=D1=83=D1=81=D1=82=D0=B0 2010 13:35:04 =D0=B2=D1=8B =D0= =BD=D0=B0=D0=BF=D0=B8=D1=81=D0=B0=D0=BB=D0=B8: > Write performance here is abysmal, agreed. This is very odd. >=20 > I hate to say this, but can you remove ahci.ko (ahci_load=3D"yes") from > your loader.conf and reboot? You may need to change filesystem names > around in /etc/fstab for your OS disk (assuming it's on ada0), but for > ZFS it should just magically find the disks on adXX. >=20 > If you could also provide pciconf -lvc output that would be helpful. > Thanks. dd if=3D/dev/zero of=3D/tank/test.zero bs=3D3M count=3D1000 1000+0 records in 1000+0 records out 3145728000 bytes transferred in 485.431690 secs (6480269 bytes/sec) zpool iostat -v 10 10 capacity operations bandwidth pool used avail read write read write =2D--------- ----- ----- ----- ----- ----- ----- tank 1,91T 829G 0 64 49,7K 4,73M ad12 598G 333G 0 22 19,9K 1,71M ad8 633G 295G 0 21 13,8K 1,65M ad10 727G 201G 0 19 15,9K 1,36M =2D--------- ----- ----- ----- ----- ----- ----- capacity operations bandwidth pool used avail read write read write =2D--------- ----- ----- ----- ----- ----- ----- tank 1,91T 829G 0 116 0 5,91M ad12 598G 333G 0 39 0 2,20M ad8 633G 295G 0 39 0 2,02M ad10 727G 201G 0 37 0 1,68M =2D--------- ----- ----- ----- ----- ----- ----- capacity operations bandwidth pool used avail read write read write =2D--------- ----- ----- ----- ----- ----- ----- tank 1,91T 829G 0 140 0 9,09M ad12 598G 333G 0 51 0 3,69M ad8 633G 295G 0 45 0 2,94M ad10 727G 201G 0 43 0 2,46M =2D--------- ----- ----- ----- ----- ----- ----- capacity operations bandwidth pool used avail read write read write =2D--------- ----- ----- ----- ----- ----- ----- tank 1,91T 829G 0 133 0 7,66M ad12 598G 333G 0 46 0 2,84M ad8 633G 295G 0 44 0 2,59M ad10 727G 201G 0 43 0 2,23M =2D--------- ----- ----- ----- ----- ----- ----- capacity operations bandwidth pool used avail read write read write =2D--------- ----- ----- ----- ----- ----- ----- tank 1,91T 829G 0 133 6,39K 5,84M ad12 598G 333G 0 47 6,39K 2,34M ad8 633G 295G 0 43 0 1,83M ad10 727G 201G 0 42 0 1,67M =2D--------- ----- ----- ----- ----- ----- ----- capacity operations bandwidth pool used avail read write read write =2D--------- ----- ----- ----- ----- ----- ----- tank 1,91T 829G 0 113 0 5,54M ad12 598G 333G 0 39 0 1,97M ad8 633G 295G 0 37 0 1,98M ad10 727G 201G 0 35 0 1,59M =2D--------- ----- ----- ----- ----- ----- ----- capacity operations bandwidth pool used avail read write read write =2D--------- ----- ----- ----- ----- ----- ----- tank 1,91T 829G 0 152 0 10,1M ad12 598G 333G 0 52 0 3,41M ad8 633G 295G 0 52 0 3,65M ad10 727G 201G 0 47 0 3,06M =2D--------- ----- ----- ----- ----- ----- ----- capacity operations bandwidth pool used avail read write read write =2D--------- ----- ----- ----- ----- ----- ----- tank 1,91T 828G 0 116 0 5,61M ad12 598G 333G 0 41 0 2,16M ad8 633G 295G 0 40 0 1,95M ad10 727G 201G 0 34 0 1,50M =2D--------- ----- ----- ----- ----- ----- ----- capacity operations bandwidth pool used avail read write read write =2D--------- ----- ----- ----- ----- ----- ----- tank 1,91T 828G 0 176 0 11,1M ad12 598G 333G 0 60 0 3,78M ad8 634G 294G 0 60 0 3,95M ad10 727G 201G 0 55 0 3,35M =2D--------- ----- ----- ----- ----- ----- ----- capacity operations bandwidth pool used avail read write read write =2D--------- ----- ----- ----- ----- ----- ----- tank 1,91T 828G 0 112 0 7,55M ad12 598G 333G 0 39 0 2,73M ad8 634G 294G 0 39 0 2,66M ad10 727G 201G 0 33 0 2,15M =2D--------- ----- ----- ----- ----- ----- ----- pciconf -lvc hostb0@pci0:0:0:0: class=3D0x060000 card=3D0x50001458 chip=3D0x2e20808= 6=20 rev=3D0x02 hdr=3D0x00 vendor =3D 'Intel Corporation' class =3D bridge subclass =3D HOST-PCI cap 09[e0] =3D vendor (length 12) Intel cap 9 version 1 pcib1@pci0:0:1:0: class=3D0x060400 card=3D0x50001458 chip=3D0x2e21808= 6=20 rev=3D0x02 hdr=3D0x01 vendor =3D 'Intel Corporation' class =3D bridge subclass =3D PCI-PCI cap 0d[88] =3D PCI Bridge card=3D0x50001458 cap 01[80] =3D powerspec 3 supports D0 D3 current D0 cap 05[90] =3D MSI supports 1 message=20 cap 10[a0] =3D PCI-Express 2 root port max data 128(128) link x16(x16) uhci0@pci0:0:26:0: class=3D0x0c0300 card=3D0x50041458 chip=3D0x3a37808= 6=20 rev=3D0x00 hdr=3D0x00 vendor =3D 'Intel Corporation' device =3D 'USB UHCI Controller *4' class =3D serial bus subclass =3D USB cap 13[50] =3D PCI Advanced Features: FLR TP uhci1@pci0:0:26:1: class=3D0x0c0300 card=3D0x50041458 chip=3D0x3a38808= 6=20 rev=3D0x00 hdr=3D0x00 vendor =3D 'Intel Corporation' device =3D 'USB UHCI Controller *5' class =3D serial bus subclass =3D USB cap 13[50] =3D PCI Advanced Features: FLR TP uhci2@pci0:0:26:2: class=3D0x0c0300 card=3D0x50041458 chip=3D0x3a39808= 6=20 rev=3D0x00 hdr=3D0x00 vendor =3D 'Intel Corporation' device =3D 'USB UHCI Controller *6' class =3D serial bus subclass =3D USB cap 13[50] =3D PCI Advanced Features: FLR TP ehci0@pci0:0:26:7: class=3D0x0c0320 card=3D0x50061458 chip=3D0x3a3c808= 6=20 rev=3D0x00 hdr=3D0x00 vendor =3D 'Intel Corporation' device =3D 'USB EHCI Controller *2' class =3D serial bus subclass =3D USB cap 01[50] =3D powerspec 2 supports D0 D3 current D0 hdac0@pci0:0:27:0: class=3D0x040300 card=3D0xa0021458 chip=3D0x3a3e808= 6=20 rev=3D0x00 hdr=3D0x00 vendor =3D 'Intel Corporation' device =3D 'Microsoft UAA Bus Driver for High Definition Audio=20 (Microsoft UAA Bus Driver for High Definition Audio)' class =3D multimedia subclass =3D HDA cap 01[50] =3D powerspec 2 supports D0 D3 current D0 cap 05[60] =3D MSI supports 1 message, 64 bit enabled with 1 message cap 10[70] =3D PCI-Express 1 root endpoint max data 128(128) link x0(x0) pcib2@pci0:0:28:0: class=3D0x060400 card=3D0x50011458 chip=3D0x3a40808= 6=20 rev=3D0x00 hdr=3D0x01 vendor =3D 'Intel Corporation' device =3D 'PCI Express Port 1' class =3D bridge subclass =3D PCI-PCI cap 10[40] =3D PCI-Express 1 root port max data 128(128) link x0(x4) cap 05[80] =3D MSI supports 1 message=20 cap 0d[90] =3D PCI Bridge card=3D0x50011458 cap 01[a0] =3D powerspec 2 supports D0 D3 current D0 pcib3@pci0:0:28:5: class=3D0x060400 card=3D0x50011458 chip=3D0x3a4a808= 6=20 rev=3D0x00 hdr=3D0x01 vendor =3D 'Intel Corporation' device =3D 'PCI Express Port 6' class =3D bridge subclass =3D PCI-PCI cap 10[40] =3D PCI-Express 1 root port max data 128(128) link x1(x1) cap 05[80] =3D MSI supports 1 message=20 cap 0d[90] =3D PCI Bridge card=3D0x50011458 cap 01[a0] =3D powerspec 2 supports D0 D3 current D0 uhci3@pci0:0:29:0: class=3D0x0c0300 card=3D0x50041458 chip=3D0x3a34808= 6=20 rev=3D0x00 hdr=3D0x00 vendor =3D 'Intel Corporation' device =3D 'USB UHCI Controller *1' class =3D serial bus subclass =3D USB cap 13[50] =3D PCI Advanced Features: FLR TP uhci4@pci0:0:29:1: class=3D0x0c0300 card=3D0x50041458 chip=3D0x3a35808= 6=20 rev=3D0x00 hdr=3D0x00 vendor =3D 'Intel Corporation' device =3D 'USB UHCI Controller *2' class =3D serial bus subclass =3D USB cap 13[50] =3D PCI Advanced Features: FLR TP uhci5@pci0:0:29:2: class=3D0x0c0300 card=3D0x50041458 chip=3D0x3a36808= 6=20 rev=3D0x00 hdr=3D0x00 vendor =3D 'Intel Corporation' device =3D 'USB UHCI Controller *3' class =3D serial bus subclass =3D USB cap 13[50] =3D PCI Advanced Features: FLR TP ehci1@pci0:0:29:7: class=3D0x0c0320 card=3D0x50061458 chip=3D0x3a3a808= 6=20 rev=3D0x00 hdr=3D0x00 vendor =3D 'Intel Corporation' device =3D 'USB EHCI Controller *1' class =3D serial bus subclass =3D USB cap 01[50] =3D powerspec 2 supports D0 D3 current D0 pcib4@pci0:0:30:0: class=3D0x060401 card=3D0x50001458 chip=3D0x244e808= 6=20 rev=3D0x90 hdr=3D0x01 vendor =3D 'Intel Corporation' device =3D '82801 Family (ICH2/3/4/5/6/7/8/9,63xxESB) Hub Interface= to=20 PCI Bridge' class =3D bridge subclass =3D PCI-PCI cap 0d[50] =3D PCI Bridge card=3D0x50001458 isab0@pci0:0:31:0: class=3D0x060100 card=3D0x50011458 chip=3D0x3a18808= 6=20 rev=3D0x00 hdr=3D0x00 vendor =3D 'Intel Corporation' device =3D 'LPC Interface Controller' class =3D bridge subclass =3D PCI-ISA cap 09[e0] =3D vendor (length 12) Intel cap 1 version 0 features: Quick Resume, SATA RAID-5, 4 PCI-e x1 slots, SAT= A=20 RAID-0/1/10 atapci0@pci0:0:31:2: class=3D0x010601 card=3D0xb0051458 chip=3D0x3a22808= 6=20 rev=3D0x00 hdr=3D0x00 vendor =3D 'Intel Corporation' device =3D '6 port SATA AHCI Controller' class =3D mass storage subclass =3D SATA cap 05[80] =3D MSI supports 16 messages=20 cap 01[70] =3D powerspec 3 supports D0 D3 current D0 cap 12[a8] =3D SATA Index-Data Pair cap 13[b0] =3D PCI Advanced Features: FLR TP none0@pci0:0:31:3: class=3D0x0c0500 card=3D0x50011458 chip=3D0x3a30808= 6=20 rev=3D0x00 hdr=3D0x00 vendor =3D 'Intel Corporation' device =3D 'SMB controller (50011458)' class =3D serial bus subclass =3D SMBus vgapci0@pci0:1:0:0: class=3D0x030000 card=3D0x34a11458 chip=3D0x062210d= e=20 rev=3D0xa1 hdr=3D0x00 vendor =3D 'NVIDIA Corporation' device =3D 'NVIDIA GeForce 9600 GT (G94)' class =3D display subclass =3D VGA cap 01[60] =3D powerspec 3 supports D0 D3 current D0 cap 05[68] =3D MSI supports 1 message, 64 bit=20 cap 10[78] =3D PCI-Express 2 endpoint max data 128(128) link x16(x16) cap 09[b4] =3D vendor (length 20) re0@pci0:3:0:0: class=3D0x020000 card=3D0xe0001458 chip=3D0x816810ec rev=3D= 0x02=20 hdr=3D0x00 vendor =3D 'Realtek Semiconductor' device =3D 'Gigabit Ethernet NIC(NDIS 6.0) (RTL8168/8111/8111c)' class =3D network subclass =3D ethernet cap 01[40] =3D powerspec 3 supports D0 D1 D2 D3 current D0 cap 05[50] =3D MSI supports 2 messages, 64 bit enabled with 1 message cap 10[70] =3D PCI-Express 1 endpoint IRQ 2 max data 128(256) link x1(x= 1) cap 11[b0] =3D MSI-X supports 2 messages in map 0x20 cap 03[d0] =3D VPD bktr0@pci0:4:2:0: class=3D0x040000 card=3D0x00031461 chip=3D0x036e109= e=20 rev=3D0x11 hdr=3D0x00 vendor =3D 'Conexant (Was: Brooktree Corp)' device =3D 'Bt878/Fusion 878A Mediastream Controller' class =3D multimedia subclass =3D video cap 03[44] =3D VPD cap 01[4c] =3D powerspec 2 supports D0 D3 current D0 none1@pci0:4:2:1: class=3D0x048000 card=3D0x00031461 chip=3D0x0878109= e=20 rev=3D0x11 hdr=3D0x00 vendor =3D 'Conexant (Was: Brooktree Corp)' device =3D 'TV Video Capture: Hauppauge WinTV GO=20 (SUBSYS_13EB0070&REV_11)' class =3D multimedia cap 03[44] =3D VPD cap 01[4c] =3D powerspec 2 supports D0 D3 current D0 ath0@pci0:4:3:0: class=3D0x020000 card=3D0x3a131186 chip=3D0x0013168= c=20 rev=3D0x01 hdr=3D0x00 vendor =3D 'Atheros Communications Inc.' device =3D '802.11a/b/g Wireless Adapter (AR2312)' class =3D network subclass =3D ethernet cap 01[44] =3D powerspec 2 supports D0 D3 current D0 =2D---- Alex V. Petrov