From owner-freebsd-performance@FreeBSD.ORG Mon Feb 9 11:49:31 2009 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 4D1E71065670 for ; Mon, 9 Feb 2009 11:49:31 +0000 (UTC) (envelope-from alexdehaini@gmail.com) Received: from rv-out-0506.google.com (rv-out-0506.google.com [209.85.198.234]) by mx1.freebsd.org (Postfix) with ESMTP id 18ACE8FC14 for ; Mon, 9 Feb 2009 11:49:30 +0000 (UTC) (envelope-from alexdehaini@gmail.com) Received: by rv-out-0506.google.com with SMTP id b25so1920975rvf.43 for ; Mon, 09 Feb 2009 03:49:30 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :date:message-id:subject:from:to:cc:content-type; bh=hjknBnqgNZzmR33DMshUhpglPgS71/mGQXSbMGNKPdM=; b=dsOzlRlLhGcaiNKhcTuTjfc5XYhpI2e93WI0MaSPciw88BXnnwOTxh1P3Zj6FrNLob pdHhYIAgGUtE/K2EE4zaNKrGDWlcKiz3iwErR8kHpHoYSyNXIMwkQlwnxmNjdi1/RFbT 0e0FgnLnio9pZC2gWQFHNVdtgGdL/H6oW/08E= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; b=R6MogOOGkbxzz4Pu5LezCKWRIVB74qpMudRU1SYr4J4qImaZrRI4Z3a0z6f7BJovNe Y/XFglasnNcqNfpO6tNbOrOl5Hvceq42WxYmpYgaSVvFG1/vqFEUh04q8HcjFnNkKB2A 8k/4zwda3IB0U1l4ABMGBqloGWgQfa9fqNmgk= MIME-Version: 1.0 Received: by 10.140.203.9 with SMTP id a9mr806984rvg.106.1234180170437; Mon, 09 Feb 2009 03:49:30 -0800 (PST) In-Reply-To: <4b008f7d0902061245g458ae7eh1bd7375b0c085d4@mail.gmail.com> References: <4b008f7d0902060644o62a3942lf63ff6689c3b4d94@mail.gmail.com> <4b008f7d0902060724o6817f822ufb3ce8a8f9060fa8@mail.gmail.com> <4b008f7d0902061019v414ef35do1b84a3f2e6f0b48d@mail.gmail.com> <20090206193651.518c3347@suszko.eu> <4b008f7d0902061245g458ae7eh1bd7375b0c085d4@mail.gmail.com> Date: Mon, 9 Feb 2009 11:49:30 +0000 Message-ID: <4b008f7d0902090349m7405d819l4468168441dbca5b@mail.gmail.com> From: Alex Dehaini To: Maciej Suszko Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: =?ISO-8859-1?Q?Istv=E1n_Szuk=E1cs?= , freebsd-performance@freebsd.org Subject: Re: Limiting open port RST response from 247 to 200 packets per second X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 09 Feb 2009 11:49:32 -0000 Any help guys? On Fri, Feb 6, 2009 at 8:45 PM, Alex Dehaini wrote: > Here is the output of 'vmstat -z' on my server > > myserver# vmstat -z > > ITEM SIZE LIMIT USED FREE REQUESTS > > PIPE: 160, 0, 6, 96, 5976 > SWAPMETA: 160, 233016, 0, 0, 0 > unpcb: 160, 0, 4, 46, 6460 > ripcb: 192, 40000, 0, 42, 28 > divcb: 192, 40000, 0, 0, 0 > syncache: 160, 15359, 0, 1766, 10989 > tcpcb: 576, 40000, 7, 92, 2115 > udpcb: 192, 40000, 6, 36, 2158 > socket: 192, 40000, 17, 111, 10762 > DIRHASH: 1024, 0, 288, 4, 301 > KNOTE: 64, 0, 0, 128, 24 > NFSNODE: 352, 0, 0, 0, 0 > NFSMOUNT: 544, 0, 0, 0, 0 > VNODE: 192, 0, 2806, 56, 2806 > NAMEI: 1024, 0, 0, 16, 261060 > VMSPACE: 192, 0, 34, 94, 5671 > PROC: 416, 0, 40, 58, 5678 > DP fakepg: 64, 0, 0, 0, 0 > PV ENTRY: 28, 3297134, 30022, 1002145, 4007245 > MAP ENTRY: 48, 0, 753, 820, 278386 > KMAP ENTRY: 48, 85223, 182, 202, 11578 > MAP: 108, 0, 7, 3, 7 > VM OBJECT: 92, 0, 1340, 412, 145002 > > I hope it helps > > Alex > > > > On Fri, Feb 6, 2009 at 6:36 PM, Maciej Suszko wrote: > >> Alex Dehaini wrote: >> > Any ideas >> >> Show us the output of `vmstat -z` - may be helpful. >> -- >> regards, Maciej Suszko. >> > > > > -- > Alex Dehaini > Developer > Site - www.alexdehaini.com > Email - alexdehaini@gmail.com > -- Alex Dehaini Developer Site - www.alexdehaini.com Email - alexdehaini@gmail.com From owner-freebsd-performance@FreeBSD.ORG Mon Feb 9 17:02:26 2009 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D90BE1065679 for ; Mon, 9 Feb 2009 17:02:26 +0000 (UTC) (envelope-from maciej@suszko.eu) Received: from 30.mail-out.ovh.net (30.mail-out.ovh.net [213.186.62.213]) by mx1.freebsd.org (Postfix) with SMTP id 3DFB48FC1C for ; Mon, 9 Feb 2009 17:02:26 +0000 (UTC) (envelope-from maciej@suszko.eu) Received: (qmail 26590 invoked by uid 503); 9 Feb 2009 17:02:45 -0000 Received: from b9.ovh.net (HELO mail195.ha.ovh.net) (213.186.33.59) by 30.mail-out.ovh.net with SMTP; 9 Feb 2009 17:02:45 -0000 Received: from b0.ovh.net (HELO queue-out) (213.186.33.50) by b0.ovh.net with SMTP; 9 Feb 2009 17:02:24 -0000 Received: from unknown (HELO localhost) (maciej@suszko.eu@62.61.57.118) by ns0.ovh.net with SMTP; 9 Feb 2009 17:02:24 -0000 Date: Mon, 9 Feb 2009 18:02:20 +0100 From: Maciej Suszko To: Alex Dehaini Message-ID: <20090209180220.3bc453db@suszko.eu> In-Reply-To: <4b008f7d0902090349m7405d819l4468168441dbca5b@mail.gmail.com> References: <4b008f7d0902060644o62a3942lf63ff6689c3b4d94@mail.gmail.com> <4b008f7d0902060724o6817f822ufb3ce8a8f9060fa8@mail.gmail.com> <4b008f7d0902061019v414ef35do1b84a3f2e6f0b48d@mail.gmail.com> <20090206193651.518c3347@suszko.eu> <4b008f7d0902061245g458ae7eh1bd7375b0c085d4@mail.gmail.com> <4b008f7d0902090349m7405d819l4468168441dbca5b@mail.gmail.com> X-Mailer: Claws Mail 3.7.0 (GTK+ 2.14.7; i386-portbld-freebsd7.1) Mime-Version: 1.0 Content-Type: multipart/signed; boundary="Sig_/.BT0RTxOiaMW24RkGwaowVW"; protocol="application/pgp-signature"; micalg=PGP-SHA1 X-Ovh-Tracer-Id: 7034622620004933652 X-Ovh-Remote: 62.61.57.118 () X-Ovh-Local: 213.186.33.20 (ns0.ovh.net) X-Spam-Check: DONE|H 0.5/N Cc: =?ISO-8859-2?B?SXN0duFuIFN6dWvhY3M=?= , freebsd-performance@freebsd.org Subject: Re: Limiting open port RST response from 247 to 200 packets per second X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 09 Feb 2009 17:02:27 -0000 --Sig_/.BT0RTxOiaMW24RkGwaowVW Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: quoted-printable Alex Dehaini wrote: > Any help guys? It doesn't look suspicious to me. Watch your logs and while you get those messages about limiting open port rst response, try to check `netstat -na` output - maybe you'll find some ,,anomalies'', do it several times, post the observation results. We'll see :) > On Fri, Feb 6, 2009 at 8:45 PM, Alex Dehaini > wrote: >=20 > > Here is the output of 'vmstat -z' on my server > > > > myserver# vmstat -z > > > > ITEM SIZE LIMIT USED FREE REQUESTS > > > > PIPE: 160, 0, 6, 96, 5976 > > SWAPMETA: 160, 233016, 0, 0, 0 > > unpcb: 160, 0, 4, 46, 6460 > > ripcb: 192, 40000, 0, 42, 28 > > divcb: 192, 40000, 0, 0, 0 > > syncache: 160, 15359, 0, 1766, 10989 > > tcpcb: 576, 40000, 7, 92, 2115 > > udpcb: 192, 40000, 6, 36, 2158 > > socket: 192, 40000, 17, 111, 10762 > > DIRHASH: 1024, 0, 288, 4, 301 > > KNOTE: 64, 0, 0, 128, 24 > > NFSNODE: 352, 0, 0, 0, 0 > > NFSMOUNT: 544, 0, 0, 0, 0 > > VNODE: 192, 0, 2806, 56, 2806 > > NAMEI: 1024, 0, 0, 16, 261060 > > VMSPACE: 192, 0, 34, 94, 5671 > > PROC: 416, 0, 40, 58, 5678 > > DP fakepg: 64, 0, 0, 0, 0 > > PV ENTRY: 28, 3297134, 30022, 1002145, 4007245 > > MAP ENTRY: 48, 0, 753, 820, 278386 > > KMAP ENTRY: 48, 85223, 182, 202, 11578 > > MAP: 108, 0, 7, 3, 7 > > VM OBJECT: 92, 0, 1340, 412, 145002 > > > > I hope it helps --=20 regards, Maciej Suszko. --Sig_/.BT0RTxOiaMW24RkGwaowVW Content-Type: application/pgp-signature; name=signature.asc Content-Disposition: attachment; filename=signature.asc -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.9 (FreeBSD) iEYEARECAAYFAkmQYZwACgkQCikUk0l7iGpdJQCfQA7vvN4Wdt0aGJmtdg7KgQWP AFAAoI49VxHRUPSSlgi94MQgeIsYyafA =prb0 -----END PGP SIGNATURE----- --Sig_/.BT0RTxOiaMW24RkGwaowVW-- From owner-freebsd-performance@FreeBSD.ORG Tue Feb 10 09:07:15 2009 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 1095110656E3 for ; Tue, 10 Feb 2009 09:07:15 +0000 (UTC) (envelope-from kama@pvp.se) Received: from ms1.as.pvp.se (dns.pvp.se [213.64.187.226]) by mx1.freebsd.org (Postfix) with ESMTP id 810928FC19 for ; Tue, 10 Feb 2009 09:07:14 +0000 (UTC) (envelope-from kama@pvp.se) Received: by ms1.as.pvp.se (Postfix, from userid 1001) id C3ABDAA; Tue, 10 Feb 2009 09:38:37 +0100 (CET) Received: from localhost (localhost [127.0.0.1]) by ms1.as.pvp.se (Postfix) with ESMTP id BB70CA9; Tue, 10 Feb 2009 09:38:37 +0100 (CET) Date: Tue, 10 Feb 2009 09:38:37 +0100 (CET) From: kama X-X-Sender: kama@ns1.as.pvp.se To: Alex Dehaini In-Reply-To: <4b008f7d0902061019v414ef35do1b84a3f2e6f0b48d@mail.gmail.com> Message-ID: <20090210093611.V67848@ns1.as.pvp.se> References: <4b008f7d0902060644o62a3942lf63ff6689c3b4d94@mail.gmail.com> <4b008f7d0902060724o6817f822ufb3ce8a8f9060fa8@mail.gmail.com> <4b008f7d0902061019v414ef35do1b84a3f2e6f0b48d@mail.gmail.com> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=ISO-8859-1 Content-Transfer-Encoding: 8BIT Cc: =?ISO-8859-1?Q?Istv=E1n_Szuk=E1cs?= , freebsd-performance@freebsd.org Subject: Re: Limiting open port RST response from 247 to 200 packets per second X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 10 Feb 2009 09:07:16 -0000 Ehm, you have posted the exact same lines from the log... Until you find new lines you are probably fine... /Bjorn On Fri, 6 Feb 2009, Alex Dehaini wrote: > Any ideas > > On Fri, Feb 6, 2009 at 3:24 PM, Alex Dehaini wrote: > > > I increased net.inet.icmp.icmplim to 2000 but this does not make any > > change. Here is my output > > > > myserver# sysctl -a | grep net.inet.icmp.icmplim > > net.inet.icmp.icmplim: 2000 > > net.inet.icmp.icmplim_output: 1 > > > > After increasing inet.icmp.icmplim to 2000 and startign Squid, I don't get > > the errors below > > > > Feb 5 20:39:44 myserver /kernel: Limiting open port RST response from 247 > > to 200 packets per second > > Feb 5 20:39:44 myserver /kernel: Limiting open port RST response from 247 > > to 200 packets per second > > Feb 5 20:39:45 myserver /kernel: Limiting open port RST response from 239 > > to 200 packets per second > > > > But traffic still drops. > > > > Alex > > > > > > > > On Fri, Feb 6, 2009 at 3:19 PM, István Szukács wrote: > > > >> Hi! > >> > >> > >> lix@test:~$sysctl -a | grep net.inet.icmp.icmplim > >> net.inet.icmp.icmplim: 200 > >> net.inet.icmp.icmplim_output: 1 > >> > >> > >> Regards, > >> Istvan > >> > >> On Fri, Feb 6, 2009 at 2:44 PM, Alex Dehaini wrote: > >> > >>> Hi Guys, > >>> > >>> I have some issues with Squid on Freebsd. I am running FreeBSD release > >>> 4.9 > >>> and Squid version 2.5. > >>> > >>> I have setup FreeBSD as a bridge so that all traffic from my network can > >>> transparently pass through the FreeBSD server. I am running Squid on the > >>> same server and I created an ipfw rule to redirect port 80 to port 3128. > >>> > >>> Normally, when Squid is not started - we see traffic close to 30MB > >>> flowing > >>> through the server. Immediately I start squid, the traffic drops to half > >>> and > >>> sometimes lower and stays there. When this happens, I have a lot of > >>> clients > >>> that will call and complain they can't access the Internet. At the same > >>> time, I get these log messages > >>> > >>> *Feb 5 20:39:44 myserver /kernel: Limiting open port RST response from > >>> 247 > >>> to 200 packets per second > >>> Feb 5 20:39:44 myserver /kernel: Limiting open port RST response from > >>> 247 > >>> to 200 packets per second > >>> Feb 5 20:39:45 myserver /kernel: Limiting open port RST response from > >>> 239 > >>> to 200 packets per second > >>> Feb 5 20:39:45 myserver /kernel: Limiting open port RST response from > >>> 239 > >>> to 200 packets per second > >>> Feb 5 20:39:46 myserver /kernel: Limiting open port RST response from > >>> 273 > >>> to 200 packets per second > >>> Feb 5 20:39:46 myserver /kernel: Limiting open port RST response from > >>> 273 > >>> to 200 packets per second > >>> Feb 5 20:39:47 myserver /kernel: Limiting open port RST response from > >>> 228 > >>> to 200 packets per second > >>> Feb 5 20:39:47 myserver /kernel: Limiting open port RST response from > >>> 228 > >>> to 200 packets per second > >>> Feb 5 20:39:48 myserver /kernel: Limiting open port RST response from > >>> 225 > >>> to 200 packets per second > >>> Feb 5 20:39:48 myserver /kernel: Limiting open port RST response from > >>> 225 > >>> to 200 packets per second > >>> Feb 5 20:39:49 myserver /kernel: Limiting open port RST response from > >>> 244 > >>> to 200 packets per second > >>> Feb 5 20:39:49 myserver /kernel: Limiting open port RST response from > >>> 244 > >>> to 200 packets per second > >>> Feb 5 20:39:50 myserver /kernel: Limiting open port RST response from > >>> 259 > >>> to 200 packets per second > >>> Feb 5 20:39:50 myserver /kernel: Limiting open port RST response from > >>> 259 > >>> to 200 packets per second > >>> Feb 5 20:39:51 myserver /kernel: Limiting open port RST response from > >>> 234 > >>> to 200 packets per second > >>> Feb 5 20:39:51 myserver /kernel: Limiting open port RST response from > >>> 234 > >>> to 200 packets per second > >>> Feb 5 20:39:52 myserver /kernel: Limiting open port RST response from > >>> 243 > >>> to 200 packets per second > >>> Feb 5 20:39:52 myserver /kernel: Limiting open port RST response from > >>> 243 > >>> to 200 packets per second > >>> Feb 5 20:39:53 myserver /kernel: Limiting open port RST response from > >>> 218 > >>> to 200 packets per second > >>> Feb 5 20:39:53 myserver /kernel: Limiting open port RST response from > >>> 218 > >>> to 200 packets per second > >>> Feb 5 20:39:55 myserver /kernel: Limiting open port RST response from > >>> 233 > >>> to 200 packets per second > >>> Feb 5 20:39:55 myserver /kernel: Limiting open port RST response from > >>> 233 > >>> to 200 packets per second > >>> Feb 5 20:39:56 myserver /kernel: Limiting open port RST response from > >>> 241 > >>> to 200 packets per second > >>> Feb 5 20:39:56 myserver /kernel: Limiting open port RST response from > >>> 241 > >>> to 200 packets per second > >>> Feb 5 20:39:57 myserver /kernel: Limiting open port RST response from > >>> 220 > >>> to 200 packets per second > >>> Feb 5 20:39:57 myserver /kernel: Limiting open port RST response from > >>> 220 > >>> to 200 packets per second > >>> Feb 5 20:39:58 myserver /kernel: Limiting open port RST response from > >>> 206 > >>> to 200 packets per second > >>> Feb 5 20:39:58 myserver /kernel: Limiting open port RST response from > >>> 206 > >>> to 200 packets per second > >>> Feb 5 20:40:01 myserver /kernel: Limiting open port RST response from > >>> 223 > >>> to 200 packets per second > >>> Feb 5 20:40:01 myserver /kernel: Limiting open port RST response from > >>> 223 > >>> to 200 packets per second* > >>> > >>> When I stop Squid, everything returns to normal. Any idea what is causing > >>> this. I will appreciate any help. > >>> > >>> Thanks > >>> > >>> -- > >>> Alex Dehaini > >>> Developer > >>> Site - www.alexdehaini.com > >>> Email - alexdehaini@gmail.com > >>> _______________________________________________ > >>> freebsd-performance@freebsd.org mailing list > >>> http://lists.freebsd.org/mailman/listinfo/freebsd-performance > >>> To unsubscribe, send any mail to " > >>> freebsd-performance-unsubscribe@freebsd.org" > >>> > >> > >> > >> > >> -- > >> the sun shines for all > >> > > > > > > > > -- > > Alex Dehaini > > Developer > > Site - www.alexdehaini.com > > Email - alexdehaini@gmail.com > > > > > > -- > Alex Dehaini > Developer > Site - www.alexdehaini.com > Email - alexdehaini@gmail.com > _______________________________________________ > freebsd-performance@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-performance > To unsubscribe, send any mail to "freebsd-performance-unsubscribe@freebsd.org" > From owner-freebsd-performance@FreeBSD.ORG Tue Feb 10 11:59:50 2009 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 3266A106566B for ; Tue, 10 Feb 2009 11:59:50 +0000 (UTC) (envelope-from sebster@sebster.com) Received: from mail.sebster.com (mail.sebster.com [193.46.80.82]) by mx1.freebsd.org (Postfix) with SMTP id 6B74C8FC40 for ; Tue, 10 Feb 2009 11:59:49 +0000 (UTC) (envelope-from sebster@sebster.com) Received: (qmail 71056 invoked from network); 10 Feb 2009 11:33:07 -0000 Received: from unknown (HELO ?10.31.5.195?) (sebster@213.126.128.130) by mail.sebster.com with SMTP; 10 Feb 2009 11:33:07 -0000 Message-ID: <499165F3.6050803@sebster.com> Date: Tue, 10 Feb 2009 12:33:07 +0100 From: Sebastiaan van Erk User-Agent: Thunderbird 2.0.0.19 (X11/20090105) MIME-Version: 1.0 To: freebsd-performance@freebsd.org Content-Type: multipart/signed; protocol="application/x-pkcs7-signature"; micalg=sha1; boundary="------------ms010601050907040807020406" Subject: FreeBSD 7.1 disk performance issue on ESXi 3.5 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 10 Feb 2009 11:59:50 -0000 This is a cryptographically signed message in MIME format. --------------ms010601050907040807020406 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Hi, I want to deploy a production FreeBSD web site (database cluster, apache cluster, ip failover using carp, etc.), however I'm experiencing painful disk I/O throughput problems which currently does not make the above project viable. I've done some rudimentary benchmarking of two identically configured virtual machines (2 VCPUs, 512MB memory, 8GB disk) and installed one with FreeBSD 7.1-amd64 and one with Linux Ubuntu 8.10-amd64. These are the results I'm getting with dbench : 1 2 4 freebsd 12.0009 13.6348 12.9402 (MB/s) linux 376.145 651.314 634.649 (MB/s) Both virtual machines run dbench 3.04 and the results are extremely stable over repeated runs. The virtual hardware detected by the FreeBSD machine is as follows: mpt0: port 0x1080-0x10ff mem 0xf4810000-0xf4810fff irq 17 at device 16.0 on pci0 mpt0: [ITHREAD] mpt0: MPI Version=1.2.0.0 And: da0 at mpt0 bus 0 target 0 lun 0 da0: Fixed Direct Access SCSI-2 device da0: 3.300MB/s transfers da0: 8192MB (16777216 512 byte sectors: 255H 63S/T 1044C) I've also run unixbench (4.1 and 5.1.2) and the performance of the FreeBSD machine is horrible compared to Linux on many of the tests, though my first guess is that it all comes back down the disk performance (on the CPU-only tests the results are about the same). Online when I see logs of da0 specs via google, they more look more like this (much higher transfer rate, and SCSI-n, n>2): da0: Fixed Direct Access SCSI-5 device da0: 300.000MB/s transfers Does anybody know how I can get proper performance for the drive under ESXi? Regards, Sebastiaan --------------ms010601050907040807020406 Content-Type: application/x-pkcs7-signature; name="smime.p7s" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="smime.p7s" Content-Description: S/MIME Cryptographic Signature MIAGCSqGSIb3DQEHAqCAMIACAQExCzAJBgUrDgMCGgUAMIAGCSqGSIb3DQEHAQAAoIIJUTCC AwMwggJsoAMCAQICEFN8DarMNuuKJDEtfs0UaqUwDQYJKoZIhvcNAQEFBQAwYjELMAkGA1UE BhMCWkExJTAjBgNVBAoTHFRoYXd0ZSBDb25zdWx0aW5nIChQdHkpIEx0ZC4xLDAqBgNVBAMT I1RoYXd0ZSBQZXJzb25hbCBGcmVlbWFpbCBJc3N1aW5nIENBMB4XDTA4MDYzMDEzNTE1N1oX DTA5MDYzMDEzNTE1N1owaDEQMA4GA1UEBBMHdmFuIEVyazETMBEGA1UEKhMKU2ViYXN0aWFh bjEbMBkGA1UEAxMSU2ViYXN0aWFhbiB2YW4gRXJrMSIwIAYJKoZIhvcNAQkBFhNzZWJzdGVy QHNlYnN0ZXIuY29tMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAsJDDAeYHVmH/ GVxi+bhFx27dmg++9BdhPJfk8k041sqEqq7oXnR2GT54quY3Ac7A1BuOM2JvoICraGmjud4y b3EanRnqGIK6iH+VAhhTlV/Owrb2Qm1e13DLxwLp1SocSQl4IrEbF9Y5H3ASdIrE0iFqkpju nPiiHeNhz3LaI5ipjiluKYoH+F6gPx8njHoaDxPePCkSLg4r0IA0afLM74LVZxCRBZEfyRZS J6VVUJefKlz91dWSzR/3xSw/rO4u9Ds/Zh7VBUKy3K+YFryHxRpUek0gSepE1b70Q39L9Sqd M/NZqMvFpwrqgW2Zh2Nh8nqRge90maR4ypBzz3GzLwIDAQABozAwLjAeBgNVHREEFzAVgRNz ZWJzdGVyQHNlYnN0ZXIuY29tMAwGA1UdEwEB/wQCMAAwDQYJKoZIhvcNAQEFBQADgYEAS1Sk NMgDVzb0ktO9tPPacV0KdKhTYOHcICVmuDEe2sFHOkjLAI1iAKp640pqJEVqvRnfRcCFJ9hK koPjjVZ+ui2rVmJWBG6FSloLRS/YYED4tUAw6DQhK61UOpjkpQxjCdm+5bHG/2ZgJAda1j0x uiN822+xFkcaW/5PQgxSRxcwggMDMIICbKADAgECAhBTfA2qzDbriiQxLX7NFGqlMA0GCSqG SIb3DQEBBQUAMGIxCzAJBgNVBAYTAlpBMSUwIwYDVQQKExxUaGF3dGUgQ29uc3VsdGluZyAo UHR5KSBMdGQuMSwwKgYDVQQDEyNUaGF3dGUgUGVyc29uYWwgRnJlZW1haWwgSXNzdWluZyBD QTAeFw0wODA2MzAxMzUxNTdaFw0wOTA2MzAxMzUxNTdaMGgxEDAOBgNVBAQTB3ZhbiBFcmsx EzARBgNVBCoTClNlYmFzdGlhYW4xGzAZBgNVBAMTElNlYmFzdGlhYW4gdmFuIEVyazEiMCAG CSqGSIb3DQEJARYTc2Vic3RlckBzZWJzdGVyLmNvbTCCASIwDQYJKoZIhvcNAQEBBQADggEP ADCCAQoCggEBALCQwwHmB1Zh/xlcYvm4Rcdu3ZoPvvQXYTyX5PJNONbKhKqu6F50dhk+eKrm NwHOwNQbjjNib6CAq2hpo7neMm9xGp0Z6hiCuoh/lQIYU5VfzsK29kJtXtdwy8cC6dUqHEkJ eCKxGxfWOR9wEnSKxNIhapKY7pz4oh3jYc9y2iOYqY4pbimKB/heoD8fJ4x6Gg8T3jwpEi4O K9CANGnyzO+C1WcQkQWRH8kWUielVVCXnypc/dXVks0f98UsP6zuLvQ7P2Ye1QVCstyvmBa8 h8UaVHpNIEnqRNW+9EN/S/UqnTPzWajLxacK6oFtmYdjYfJ6kYHvdJmkeMqQc89xsy8CAwEA AaMwMC4wHgYDVR0RBBcwFYETc2Vic3RlckBzZWJzdGVyLmNvbTAMBgNVHRMBAf8EAjAAMA0G CSqGSIb3DQEBBQUAA4GBAEtUpDTIA1c29JLTvbTz2nFdCnSoU2Dh3CAlZrgxHtrBRzpIywCN YgCqeuNKaiRFar0Z30XAhSfYSpKD441Wfrotq1ZiVgRuhUpaC0Uv2GBA+LVAMOg0ISutVDqY 5KUMYwnZvuWxxv9mYCQHWtY9MbojfNtvsRZHGlv+T0IMUkcXMIIDPzCCAqigAwIBAgIBDTAN BgkqhkiG9w0BAQUFADCB0TELMAkGA1UEBhMCWkExFTATBgNVBAgTDFdlc3Rlcm4gQ2FwZTES MBAGA1UEBxMJQ2FwZSBUb3duMRowGAYDVQQKExFUaGF3dGUgQ29uc3VsdGluZzEoMCYGA1UE CxMfQ2VydGlmaWNhdGlvbiBTZXJ2aWNlcyBEaXZpc2lvbjEkMCIGA1UEAxMbVGhhd3RlIFBl cnNvbmFsIEZyZWVtYWlsIENBMSswKQYJKoZIhvcNAQkBFhxwZXJzb25hbC1mcmVlbWFpbEB0 aGF3dGUuY29tMB4XDTAzMDcxNzAwMDAwMFoXDTEzMDcxNjIzNTk1OVowYjELMAkGA1UEBhMC WkExJTAjBgNVBAoTHFRoYXd0ZSBDb25zdWx0aW5nIChQdHkpIEx0ZC4xLDAqBgNVBAMTI1Ro YXd0ZSBQZXJzb25hbCBGcmVlbWFpbCBJc3N1aW5nIENBMIGfMA0GCSqGSIb3DQEBAQUAA4GN ADCBiQKBgQDEpjxVc1X7TrnKmVoeaMB1BHCd3+n/ox7svc31W/Iadr1/DDph8r9RzgHU5VAK MNcCY1osiRVwjt3J8CuFWqo/cVbLrzwLB+fxH5E2JCoTzyvV84J3PQO+K/67GD4Hv0CAAmTX p6a7n2XRxSpUhQ9IBH+nttE8YQRAHmQZcmC3+wIDAQABo4GUMIGRMBIGA1UdEwEB/wQIMAYB Af8CAQAwQwYDVR0fBDwwOjA4oDagNIYyaHR0cDovL2NybC50aGF3dGUuY29tL1RoYXd0ZVBl cnNvbmFsRnJlZW1haWxDQS5jcmwwCwYDVR0PBAQDAgEGMCkGA1UdEQQiMCCkHjAcMRowGAYD VQQDExFQcml2YXRlTGFiZWwyLTEzODANBgkqhkiG9w0BAQUFAAOBgQBIjNFQg+oLLswNo2as Zw9/r6y+whehQ5aUnX9MIbj4Nh+qLZ82L8D0HFAgk3A8/a3hYWLD2ToZfoSxmRsAxRoLgnSe JVCUYsfbJ3FXJY3dqZw5jowgT2Vfldr394fWxghOrvbqNOUQGls1TXfjViF4gtwhGTXeJLHT HUb/XV9lTzGCA3EwggNtAgEBMHYwYjELMAkGA1UEBhMCWkExJTAjBgNVBAoTHFRoYXd0ZSBD b25zdWx0aW5nIChQdHkpIEx0ZC4xLDAqBgNVBAMTI1RoYXd0ZSBQZXJzb25hbCBGcmVlbWFp bCBJc3N1aW5nIENBAhBTfA2qzDbriiQxLX7NFGqlMAkGBSsOAwIaBQCgggHQMBgGCSqGSIb3 DQEJAzELBgkqhkiG9w0BBwEwHAYJKoZIhvcNAQkFMQ8XDTA5MDIxMDExMzMwN1owIwYJKoZI hvcNAQkEMRYEFIDGO62075+WYPmOXcnN8k19HF5QMF8GCSqGSIb3DQEJDzFSMFAwCwYJYIZI AWUDBAECMAoGCCqGSIb3DQMHMA4GCCqGSIb3DQMCAgIAgDANBggqhkiG9w0DAgIBQDAHBgUr DgMCBzANBggqhkiG9w0DAgIBKDCBhQYJKwYBBAGCNxAEMXgwdjBiMQswCQYDVQQGEwJaQTEl MCMGA1UEChMcVGhhd3RlIENvbnN1bHRpbmcgKFB0eSkgTHRkLjEsMCoGA1UEAxMjVGhhd3Rl IFBlcnNvbmFsIEZyZWVtYWlsIElzc3VpbmcgQ0ECEFN8DarMNuuKJDEtfs0UaqUwgYcGCyqG SIb3DQEJEAILMXigdjBiMQswCQYDVQQGEwJaQTElMCMGA1UEChMcVGhhd3RlIENvbnN1bHRp bmcgKFB0eSkgTHRkLjEsMCoGA1UEAxMjVGhhd3RlIFBlcnNvbmFsIEZyZWVtYWlsIElzc3Vp bmcgQ0ECEFN8DarMNuuKJDEtfs0UaqUwDQYJKoZIhvcNAQEBBQAEggEAk2GOhj/WNxn4945/ RaidO7ZOYGZOLtsM7t4DK3IEYoUY990oOCxs+0LWLTi8JtHPNbBdC2Z1+0PHGsQi02lxOz8s WYK6Uq2kISmLgdgFgkirrzgC5/rQLnRNbixfpUu9PNtIJcE7RobK+UbVbJDt7JsQ2Wn+DHmW 3HSa5yKiUbSZUwRdKomDKuHx/W31t9iPp9DcPNyAD5ZnsGG2So7Cd2hu4y7/0pBZieOU6Nlh A4i55hEfkTEtWzE2KQkf3xHm3fs9YoDJ57FlJxe2Vrq1OUKfHdzUXgHQvMhOYWCbH6FcAix+ SdSuDEfsvg3tKo3lq9H0D2RPT97FXBbYodpL1QAAAAAAAA== --------------ms010601050907040807020406-- From owner-freebsd-performance@FreeBSD.ORG Tue Feb 10 14:05:06 2009 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 81D5C1065679 for ; Tue, 10 Feb 2009 14:05:06 +0000 (UTC) (envelope-from gofp-freebsd-performance@m.gmane.org) Received: from ciao.gmane.org (main.gmane.org [80.91.229.2]) by mx1.freebsd.org (Postfix) with ESMTP id 080FA8FC1B for ; Tue, 10 Feb 2009 14:05:05 +0000 (UTC) (envelope-from gofp-freebsd-performance@m.gmane.org) Received: from list by ciao.gmane.org with local (Exim 4.43) id 1LWtET-0006pD-Qm for freebsd-performance@freebsd.org; Tue, 10 Feb 2009 14:05:01 +0000 Received: from lara.cc.fer.hr ([161.53.72.113]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Tue, 10 Feb 2009 14:05:01 +0000 Received: from ivoras by lara.cc.fer.hr with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Tue, 10 Feb 2009 14:05:01 +0000 X-Injected-Via-Gmane: http://gmane.org/ To: freebsd-performance@freebsd.org From: Ivan Voras Date: Tue, 10 Feb 2009 15:04:42 +0100 Lines: 63 Message-ID: References: <499165F3.6050803@sebster.com> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enig63E293BDE8E85395F4BAC886" X-Complaints-To: usenet@ger.gmane.org X-Gmane-NNTP-Posting-Host: lara.cc.fer.hr User-Agent: Thunderbird 2.0.0.19 (X11/20090105) In-Reply-To: <499165F3.6050803@sebster.com> X-Enigmail-Version: 0.95.0 Sender: news Subject: Re: FreeBSD 7.1 disk performance issue on ESXi 3.5 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 10 Feb 2009 14:05:10 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enig63E293BDE8E85395F4BAC886 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Sebastiaan van Erk wrote: > Hi, >=20 > I want to deploy a production FreeBSD web site (database cluster, apach= e > cluster, ip failover using carp, etc.), however I'm experiencing painfu= l > disk I/O throughput problems which currently does not make the above > project viable. I've done some rudimentary benchmarking of two > identically configured virtual machines (2 VCPUs, 512MB memory, 8GB > disk) and installed one with FreeBSD 7.1-amd64 and one with Linux Ubunt= u > 8.10-amd64. These are the results I'm getting with dbench : >=20 > 1 2 4 > freebsd 12.0009 13.6348 12.9402 (MB/s) > linux 376.145 651.314 634.649 (MB/s) >=20 > Both virtual machines run dbench 3.04 and the results are extremely > stable over repeated runs. >=20 > The virtual hardware detected by the FreeBSD machine is as follows: > Does anybody know how I can get proper performance for the drive under > ESXi? VMWare has many optimizations for Linux that are not used with FreeBSD. VMI, for example, makes the Linux guest paravirtualized, and then there are special drivers for networking, its vmotion driver (this one probably doesn't contribute to performance much), etc. and Linux is in any case much better tested and supported. If VMWare allows, you may try changing the type of the controller (I don't know about ESXi but VMWare Server supports LSI or Buslogic SCSI emulation) or switch to ATA emulation and try again. A generic optimization is to reduce kern.hz to something like 50 but it probably won't help your disk performance. As for unixbench, you need to examine and compare each microbenchmark result individually before drawing a conclusion. --------------enig63E293BDE8E85395F4BAC886 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFJkYmBldnAQVacBcgRAj+sAJ9El5B5mbejo1c6iRuGXyvLbXgBagCdG/jL BnusTr4XMO023Lxyp3YdFvA= =DezZ -----END PGP SIGNATURE----- --------------enig63E293BDE8E85395F4BAC886-- From owner-freebsd-performance@FreeBSD.ORG Tue Feb 10 14:22:33 2009 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 3D6DC1065670 for ; Tue, 10 Feb 2009 14:22:33 +0000 (UTC) (envelope-from sebster@sebster.com) Received: from mail.sebster.com (mail.sebster.com [193.46.80.82]) by mx1.freebsd.org (Postfix) with SMTP id 8FA4D8FC1F for ; Tue, 10 Feb 2009 14:22:32 +0000 (UTC) (envelope-from sebster@sebster.com) Received: (qmail 73560 invoked from network); 10 Feb 2009 14:22:30 -0000 Received: from unknown (HELO ?10.31.5.195?) (sebster@213.126.128.130) by mail.sebster.com with SMTP; 10 Feb 2009 14:22:30 -0000 Message-ID: <49918DA6.4020608@sebster.com> Date: Tue, 10 Feb 2009 15:22:30 +0100 From: Sebastiaan van Erk User-Agent: Thunderbird 2.0.0.19 (X11/20090105) MIME-Version: 1.0 To: freebsd-performance@freebsd.org References: <499165F3.6050803@sebster.com> In-Reply-To: Content-Type: multipart/signed; protocol="application/x-pkcs7-signature"; micalg=sha1; boundary="------------ms020902030302070808040208" Subject: Re: FreeBSD 7.1 disk performance issue on ESXi 3.5 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 10 Feb 2009 14:22:33 -0000 This is a cryptographically signed message in MIME format. --------------ms020902030302070808040208 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Ivan Voras wrote: Hi, Thanks for the reply. > Sebastiaan van Erk wrote: >> Hi, [snip] >> 1 2 4 >> freebsd 12.0009 13.6348 12.9402 (MB/s) >> linux 376.145 651.314 634.649 (MB/s) >> >> Both virtual machines run dbench 3.04 and the results are extremely >> stable over repeated runs. > VMWare has many optimizations for Linux that are not used with FreeBSD. > VMI, for example, makes the Linux guest paravirtualized, and then there > are special drivers for networking, its vmotion driver (this one > probably doesn't contribute to performance much), etc. and Linux is in > any case much better tested and supported. VMI/paravirtualization is not enabled for this Linux host. Neither is VMotion. Networking is performing extremely well (see also below). > If VMWare allows, you may try changing the type of the controller (I > don't know about ESXi but VMWare Server supports LSI or Buslogic SCSI > emulation) or switch to ATA emulation and try again. I tried this, and it has no significant effect. Just for completeness, here's the relevant output of dmesg: bt0: port 0x1060-0x107f mem 0xf4810000-0xf481001f irq 17 at device 16.0 on pci0 bt0: BT-958 FW Rev. 5.07B Ultra Wide SCSI Host Adapter, SCSI ID 7, 192 CCBs bt0: [GIANT-LOCKED] bt0: [ITHREAD] da0 at bt0 bus 0 target 0 lun 0 da0: Fixed Direct Access SCSI-2 device da0: 40.000MB/s transfers (20.000MHz DT, offset 15, 16bit) da0: 8192MB (16777216 512 byte sectors: 255H 63S/T 1044C) The transfer rate for dbench 1 is 15.0118 MB/s. > A generic optimization is to reduce kern.hz to something like 50 but it > probably won't help your disk performance. I already had this (not 50, but 100), but this doesn't do anything for the disk performance. > As for unixbench, you need to examine and compare each microbenchmark > result individually before drawing a conclusion. Yes, I realize that. However the dbench result is my first priority, and when (if) that is fixed, I'll run the unixbench again and see what my next priority is. (However, just to give you an idea I attached the basic 5.1.2 unixbench outputs (the CPU info for FreeBSD is "fake", since unixbench does a cat /proc/cpuinfo, so I removed the /proc/ part and copied the output under linux to the "procinfo" file.) Finally, I also ran some network benchmarks such as netio, and tested VM to VM communication on *different* ESXi machines connected via Gigabit ethernet, and it achieved more than 100MB/s throughput. Since CPU speed + Network IO are doing just fine, I'm guessing this is a pure disk (driver?) related issue. However, to go into production with FreeBSD I *must* be able to fix it. Note also the discrepency: 12 MB/s vs 350 MB/s on disk access! My lousy home machine (FreeBSD) is even 5 times faster at 60 MB/s. This machine has extremely fast disks in a RAID10 configuration. Any ideas are welcome! Regards, Sebastiaan --------------ms020902030302070808040208 Content-Type: application/x-pkcs7-signature; name="smime.p7s" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="smime.p7s" Content-Description: S/MIME Cryptographic Signature MIAGCSqGSIb3DQEHAqCAMIACAQExCzAJBgUrDgMCGgUAMIAGCSqGSIb3DQEHAQAAoIIJUTCC AwMwggJsoAMCAQICEFN8DarMNuuKJDEtfs0UaqUwDQYJKoZIhvcNAQEFBQAwYjELMAkGA1UE BhMCWkExJTAjBgNVBAoTHFRoYXd0ZSBDb25zdWx0aW5nIChQdHkpIEx0ZC4xLDAqBgNVBAMT I1RoYXd0ZSBQZXJzb25hbCBGcmVlbWFpbCBJc3N1aW5nIENBMB4XDTA4MDYzMDEzNTE1N1oX DTA5MDYzMDEzNTE1N1owaDEQMA4GA1UEBBMHdmFuIEVyazETMBEGA1UEKhMKU2ViYXN0aWFh bjEbMBkGA1UEAxMSU2ViYXN0aWFhbiB2YW4gRXJrMSIwIAYJKoZIhvcNAQkBFhNzZWJzdGVy QHNlYnN0ZXIuY29tMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAsJDDAeYHVmH/ GVxi+bhFx27dmg++9BdhPJfk8k041sqEqq7oXnR2GT54quY3Ac7A1BuOM2JvoICraGmjud4y b3EanRnqGIK6iH+VAhhTlV/Owrb2Qm1e13DLxwLp1SocSQl4IrEbF9Y5H3ASdIrE0iFqkpju nPiiHeNhz3LaI5ipjiluKYoH+F6gPx8njHoaDxPePCkSLg4r0IA0afLM74LVZxCRBZEfyRZS J6VVUJefKlz91dWSzR/3xSw/rO4u9Ds/Zh7VBUKy3K+YFryHxRpUek0gSepE1b70Q39L9Sqd M/NZqMvFpwrqgW2Zh2Nh8nqRge90maR4ypBzz3GzLwIDAQABozAwLjAeBgNVHREEFzAVgRNz ZWJzdGVyQHNlYnN0ZXIuY29tMAwGA1UdEwEB/wQCMAAwDQYJKoZIhvcNAQEFBQADgYEAS1Sk NMgDVzb0ktO9tPPacV0KdKhTYOHcICVmuDEe2sFHOkjLAI1iAKp640pqJEVqvRnfRcCFJ9hK koPjjVZ+ui2rVmJWBG6FSloLRS/YYED4tUAw6DQhK61UOpjkpQxjCdm+5bHG/2ZgJAda1j0x uiN822+xFkcaW/5PQgxSRxcwggMDMIICbKADAgECAhBTfA2qzDbriiQxLX7NFGqlMA0GCSqG SIb3DQEBBQUAMGIxCzAJBgNVBAYTAlpBMSUwIwYDVQQKExxUaGF3dGUgQ29uc3VsdGluZyAo UHR5KSBMdGQuMSwwKgYDVQQDEyNUaGF3dGUgUGVyc29uYWwgRnJlZW1haWwgSXNzdWluZyBD QTAeFw0wODA2MzAxMzUxNTdaFw0wOTA2MzAxMzUxNTdaMGgxEDAOBgNVBAQTB3ZhbiBFcmsx EzARBgNVBCoTClNlYmFzdGlhYW4xGzAZBgNVBAMTElNlYmFzdGlhYW4gdmFuIEVyazEiMCAG CSqGSIb3DQEJARYTc2Vic3RlckBzZWJzdGVyLmNvbTCCASIwDQYJKoZIhvcNAQEBBQADggEP ADCCAQoCggEBALCQwwHmB1Zh/xlcYvm4Rcdu3ZoPvvQXYTyX5PJNONbKhKqu6F50dhk+eKrm NwHOwNQbjjNib6CAq2hpo7neMm9xGp0Z6hiCuoh/lQIYU5VfzsK29kJtXtdwy8cC6dUqHEkJ eCKxGxfWOR9wEnSKxNIhapKY7pz4oh3jYc9y2iOYqY4pbimKB/heoD8fJ4x6Gg8T3jwpEi4O K9CANGnyzO+C1WcQkQWRH8kWUielVVCXnypc/dXVks0f98UsP6zuLvQ7P2Ye1QVCstyvmBa8 h8UaVHpNIEnqRNW+9EN/S/UqnTPzWajLxacK6oFtmYdjYfJ6kYHvdJmkeMqQc89xsy8CAwEA AaMwMC4wHgYDVR0RBBcwFYETc2Vic3RlckBzZWJzdGVyLmNvbTAMBgNVHRMBAf8EAjAAMA0G CSqGSIb3DQEBBQUAA4GBAEtUpDTIA1c29JLTvbTz2nFdCnSoU2Dh3CAlZrgxHtrBRzpIywCN YgCqeuNKaiRFar0Z30XAhSfYSpKD441Wfrotq1ZiVgRuhUpaC0Uv2GBA+LVAMOg0ISutVDqY 5KUMYwnZvuWxxv9mYCQHWtY9MbojfNtvsRZHGlv+T0IMUkcXMIIDPzCCAqigAwIBAgIBDTAN BgkqhkiG9w0BAQUFADCB0TELMAkGA1UEBhMCWkExFTATBgNVBAgTDFdlc3Rlcm4gQ2FwZTES MBAGA1UEBxMJQ2FwZSBUb3duMRowGAYDVQQKExFUaGF3dGUgQ29uc3VsdGluZzEoMCYGA1UE CxMfQ2VydGlmaWNhdGlvbiBTZXJ2aWNlcyBEaXZpc2lvbjEkMCIGA1UEAxMbVGhhd3RlIFBl cnNvbmFsIEZyZWVtYWlsIENBMSswKQYJKoZIhvcNAQkBFhxwZXJzb25hbC1mcmVlbWFpbEB0 aGF3dGUuY29tMB4XDTAzMDcxNzAwMDAwMFoXDTEzMDcxNjIzNTk1OVowYjELMAkGA1UEBhMC WkExJTAjBgNVBAoTHFRoYXd0ZSBDb25zdWx0aW5nIChQdHkpIEx0ZC4xLDAqBgNVBAMTI1Ro YXd0ZSBQZXJzb25hbCBGcmVlbWFpbCBJc3N1aW5nIENBMIGfMA0GCSqGSIb3DQEBAQUAA4GN ADCBiQKBgQDEpjxVc1X7TrnKmVoeaMB1BHCd3+n/ox7svc31W/Iadr1/DDph8r9RzgHU5VAK MNcCY1osiRVwjt3J8CuFWqo/cVbLrzwLB+fxH5E2JCoTzyvV84J3PQO+K/67GD4Hv0CAAmTX p6a7n2XRxSpUhQ9IBH+nttE8YQRAHmQZcmC3+wIDAQABo4GUMIGRMBIGA1UdEwEB/wQIMAYB Af8CAQAwQwYDVR0fBDwwOjA4oDagNIYyaHR0cDovL2NybC50aGF3dGUuY29tL1RoYXd0ZVBl cnNvbmFsRnJlZW1haWxDQS5jcmwwCwYDVR0PBAQDAgEGMCkGA1UdEQQiMCCkHjAcMRowGAYD VQQDExFQcml2YXRlTGFiZWwyLTEzODANBgkqhkiG9w0BAQUFAAOBgQBIjNFQg+oLLswNo2as Zw9/r6y+whehQ5aUnX9MIbj4Nh+qLZ82L8D0HFAgk3A8/a3hYWLD2ToZfoSxmRsAxRoLgnSe JVCUYsfbJ3FXJY3dqZw5jowgT2Vfldr394fWxghOrvbqNOUQGls1TXfjViF4gtwhGTXeJLHT HUb/XV9lTzGCA3EwggNtAgEBMHYwYjELMAkGA1UEBhMCWkExJTAjBgNVBAoTHFRoYXd0ZSBD b25zdWx0aW5nIChQdHkpIEx0ZC4xLDAqBgNVBAMTI1RoYXd0ZSBQZXJzb25hbCBGcmVlbWFp bCBJc3N1aW5nIENBAhBTfA2qzDbriiQxLX7NFGqlMAkGBSsOAwIaBQCgggHQMBgGCSqGSIb3 DQEJAzELBgkqhkiG9w0BBwEwHAYJKoZIhvcNAQkFMQ8XDTA5MDIxMDE0MjIzMFowIwYJKoZI hvcNAQkEMRYEFM2GHFUoO3rYCVUucuTgOTCuq59JMF8GCSqGSIb3DQEJDzFSMFAwCwYJYIZI AWUDBAECMAoGCCqGSIb3DQMHMA4GCCqGSIb3DQMCAgIAgDANBggqhkiG9w0DAgIBQDAHBgUr DgMCBzANBggqhkiG9w0DAgIBKDCBhQYJKwYBBAGCNxAEMXgwdjBiMQswCQYDVQQGEwJaQTEl MCMGA1UEChMcVGhhd3RlIENvbnN1bHRpbmcgKFB0eSkgTHRkLjEsMCoGA1UEAxMjVGhhd3Rl IFBlcnNvbmFsIEZyZWVtYWlsIElzc3VpbmcgQ0ECEFN8DarMNuuKJDEtfs0UaqUwgYcGCyqG SIb3DQEJEAILMXigdjBiMQswCQYDVQQGEwJaQTElMCMGA1UEChMcVGhhd3RlIENvbnN1bHRp bmcgKFB0eSkgTHRkLjEsMCoGA1UEAxMjVGhhd3RlIFBlcnNvbmFsIEZyZWVtYWlsIElzc3Vp bmcgQ0ECEFN8DarMNuuKJDEtfs0UaqUwDQYJKoZIhvcNAQEBBQAEggEATk58hXtWjV8H4R8Y YTUMFtR1X8QiSv8jrN7hNE9pd9Sg6dlEZ2SbK9uiWFbAronwVNQ/0IhEcMEJm34ekWHGI1w5 QVzgOCVr5a1awulx7/Ns3LRsad7MXD05z7r8ifLRRhSQuUTXa/W22iwCiBcTiiXaUp5tr4z5 ztFSQMOJCVstXmxDec2ZKwnY2hS4BIEApG6RzWyAee9tk6KW3AUMQgnyguUuvi30OZxqG0cJ b9KDk3Bcbh4vWnBrbkijn62vrg3Tz2TZi+vMM+GCcq11KbT+Z5mAeKC7NOctEmq/7vt/gSsh w23tEH4CeaymVKKbrW42BZAmZvcChCQbXrukhAAAAAAAAA== --------------ms020902030302070808040208-- From owner-freebsd-performance@FreeBSD.ORG Tue Feb 10 14:24:13 2009 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 5B4861065673 for ; Tue, 10 Feb 2009 14:24:13 +0000 (UTC) (envelope-from sebster@sebster.com) Received: from mail.sebster.com (mail.sebster.com [193.46.80.82]) by mx1.freebsd.org (Postfix) with SMTP id 3691A8FC25 for ; Tue, 10 Feb 2009 14:24:12 +0000 (UTC) (envelope-from sebster@sebster.com) Received: (qmail 73590 invoked from network); 10 Feb 2009 14:24:11 -0000 Received: from unknown (HELO ?10.31.5.195?) (sebster@213.126.128.130) by mail.sebster.com with SMTP; 10 Feb 2009 14:24:11 -0000 Message-ID: <49918E0A.1060500@sebster.com> Date: Tue, 10 Feb 2009 15:24:10 +0100 From: Sebastiaan van Erk User-Agent: Thunderbird 2.0.0.19 (X11/20090105) MIME-Version: 1.0 To: freebsd-performance@freebsd.org References: <499165F3.6050803@sebster.com> <49918DA6.4020608@sebster.com> In-Reply-To: <49918DA6.4020608@sebster.com> Content-Type: multipart/signed; protocol="application/x-pkcs7-signature"; micalg=sha1; boundary="------------ms030502050109050601060304" Subject: Re: FreeBSD 7.1 disk performance issue on ESXi 3.5 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 10 Feb 2009 14:24:14 -0000 This is a cryptographically signed message in MIME format. --------------ms030502050109050601060304 Content-Type: multipart/mixed; boundary="------------070807020404010806080201" This is a multi-part message in MIME format. --------------070807020404010806080201 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Sebastiaan van Erk wrote: > (However, just to give you an idea I attached the basic 5.1.2 unixbench > outputs (the CPU info for FreeBSD is "fake", since unixbench does a cat > /proc/cpuinfo, so I removed the /proc/ part and copied the output under > linux to the "procinfo" file.) Of course I forgot to attach them... :-( Here they are. Regards, Sebastiaan --------------070807020404010806080201 Content-Type: text/plain; name="test1-freebsd" Content-Transfer-Encoding: base64 Content-Disposition: inline; filename="test1-freebsd" Z21ha2UgYWxsCmdtYWtlWzFdOiBFbnRlcmluZyBkaXJlY3RvcnkgYC9yb290L3RtcC91bml4 YmVuY2gtNS4xLjInCkNoZWNraW5nIGRpc3RyaWJ1dGlvbiBvZiBmaWxlcwouL3BnbXMgIGV4 aXN0cwouL3NyYyAgZXhpc3RzCi4vdGVzdGRpciAgZXhpc3RzCi4vdG1wICBleGlzdHMKLi9y ZXN1bHRzICBleGlzdHMKZ21ha2VbMV06IExlYXZpbmcgZGlyZWN0b3J5IGAvcm9vdC90bXAv dW5peGJlbmNoLTUuMS4yJwoKICAgIyAgICAjICAjICAgICMgICMgICMgICAgIyAgICAgICAg ICAjIyMjIyAgICMjIyMjIyAgIyAgICAjICAgIyMjIyAgICMgICAgIwogICAjICAgICMgICMj ICAgIyAgIyAgICMgICMgICAgICAgICAgICMgICAgIyAgIyAgICAgICAjIyAgICMgICMgICAg IyAgIyAgICAjCiAgICMgICAgIyAgIyAjICAjICAjICAgICMjICAgICAgICAgICAgIyMjIyMg ICAjIyMjIyAgICMgIyAgIyAgIyAgICAgICAjIyMjIyMKICAgIyAgICAjICAjICAjICMgICMg ICAgIyMgICAgICAgICAgICAjICAgICMgICMgICAgICAgIyAgIyAjICAjICAgICAgICMgICAg IwogICAjICAgICMgICMgICAjIyAgIyAgICMgICMgICAgICAgICAgICMgICAgIyAgIyAgICAg ICAjICAgIyMgICMgICAgIyAgIyAgICAjCiAgICAjIyMjICAgIyAgICAjICAjICAjICAgICMg ICAgICAgICAgIyMjIyMgICAjIyMjIyMgICMgICAgIyAgICMjIyMgICAjICAgICMKCiAgIFZl cnNpb24gNS4xLjIgICAgICAgICAgICAgICAgICAgICAgQmFzZWQgb24gdGhlIEJ5dGUgTWFn YXppbmUgVW5peCBCZW5jaG1hcmsKCiAgIE11bHRpLUNQVSB2ZXJzaW9uICAgICAgICAgICAg ICAgICAgVmVyc2lvbiA1IHJldmlzaW9ucyBieSBJYW4gU21pdGgsCiAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgU3Vubnl2YWxlLCBDQSwgVVNBCiAgIERlY2VtYmVy IDIyLCAyMDA3ICAgICAgICAgICAgICAgICAgam9oYW50aGVnaG9zdCBhdCB5YWhvbyBwZXJp b2QgY29tCgoKMSB4IERocnlzdG9uZSAyIHVzaW5nIHJlZ2lzdGVyIHZhcmlhYmxlcyAgMSAy IDMgNCA1IDYgNyA4IDkgMTAKCjEgeCBEb3VibGUtUHJlY2lzaW9uIFdoZXRzdG9uZSAgMSAy IDMgNCA1IDYgNyA4IDkgMTAKCjEgeCBFeGVjbCBUaHJvdWdocHV0ICAxIDIgMwoKMSB4IEZp bGUgQ29weSAxMDI0IGJ1ZnNpemUgMjAwMCBtYXhibG9ja3MgIDEgMiAzCgoxIHggRmlsZSBD b3B5IDI1NiBidWZzaXplIDUwMCBtYXhibG9ja3MgIDEgMiAzCgoxIHggRmlsZSBDb3B5IDQw OTYgYnVmc2l6ZSA4MDAwIG1heGJsb2NrcyAgMSAyIDMKCjEgeCBQaXBlIFRocm91Z2hwdXQg IDEgMiAzIDQgNSA2IDcgOCA5IDEwCgoxIHggUGlwZS1iYXNlZCBDb250ZXh0IFN3aXRjaGlu ZyAgMSAyIDMgNCA1IDYgNyA4IDkgMTAKCjEgeCBQcm9jZXNzIENyZWF0aW9uICAxIDIgMwoK MSB4IFN5c3RlbSBDYWxsIE92ZXJoZWFkICAxIDIgMyA0IDUgNiA3IDggOSAxMAoKMSB4IFNo ZWxsIFNjcmlwdHMgKDEgY29uY3VycmVudCkgIDEgMiAzCgoxIHggU2hlbGwgU2NyaXB0cyAo OCBjb25jdXJyZW50KSAgMSAyIDMKCjIgeCBEaHJ5c3RvbmUgMiB1c2luZyByZWdpc3RlciB2 YXJpYWJsZXMgIDEgMiAzIDQgNSA2IDcgOCA5IDEwCgoyIHggRG91YmxlLVByZWNpc2lvbiBX aGV0c3RvbmUgIDEgMiAzIDQgNSA2IDcgOCA5IDEwCgoyIHggRXhlY2wgVGhyb3VnaHB1dCAg MSAyIDMKCjIgeCBGaWxlIENvcHkgMTAyNCBidWZzaXplIDIwMDAgbWF4YmxvY2tzICAxIDIg MwoKMiB4IEZpbGUgQ29weSAyNTYgYnVmc2l6ZSA1MDAgbWF4YmxvY2tzICAxIDIgMwoKMiB4 IEZpbGUgQ29weSA0MDk2IGJ1ZnNpemUgODAwMCBtYXhibG9ja3MgIDEgMiAzCgoyIHggUGlw ZSBUaHJvdWdocHV0ICAxIDIgMyA0IDUgNiA3IDggOSAxMAoKMiB4IFBpcGUtYmFzZWQgQ29u dGV4dCBTd2l0Y2hpbmcgIDEgMiAzIDQgNSA2IDcgOCA5IDEwCgoyIHggUHJvY2VzcyBDcmVh dGlvbiAgMSAyIDMKCjIgeCBTeXN0ZW0gQ2FsbCBPdmVyaGVhZCAgMSAyIDMgNCA1IDYgNyA4 IDkgMTAKCjIgeCBTaGVsbCBTY3JpcHRzICgxIGNvbmN1cnJlbnQpICAxIDIgMwoKMiB4IFNo ZWxsIFNjcmlwdHMgKDggY29uY3VycmVudCkgIDEgMiAzCgo9PT09PT09PT09PT09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT0K ICAgQllURSBVTklYIEJlbmNobWFya3MgKFZlcnNpb24gNS4xLjIpCgogICBTeXN0ZW06IHRl c3QtZmJzZC52cG4xLnNlYnN0ZXIuY29tOiBGcmVlQlNECiAgIE9TOiBGcmVlQlNEIC0tIDcu MS1SRUxFQVNFIC0tIEZyZWVCU0QgNy4xLVJFTEVBU0UgIzE6IE1vbiBGZWIgIDkgMTg6MjY6 MTkgQ0VUIDIwMDkgICAgIHJvb3RAdGVzdC1mYnNkLnZwbjEuc2Vic3Rlci5jb206L3Vzci9v YmovdXNyL3NyYy9zeXMvVk1XQVJFCiAgIE1hY2hpbmU6IGFtZDY0IChWTVdBUkUpCiAgIExh bmd1YWdlOiBlbl9VUy51dGY4IChjaGFybWFwPSwgY29sbGF0ZT0pCiAgIENQVSAwOiBJbnRl bChSKSBYZW9uKFIpIENQVSBFNTQyMCBAIDIuNTBHSHogKDQ5OTkuOSBib2dvbWlwcykKICAg ICAgICAgIHg4Ni02NCwgTU1YLCBQaHlzaWNhbCBBZGRyZXNzIEV4dCwgU1lTRU5URVIvU1lT RVhJVCwgU1lTQ0FMTC9TWVNSRVQKICAgQ1BVIDE6IEludGVsKFIpIFhlb24oUikgQ1BVIEU1 NDIwIEAgMi41MEdIeiAoNTAwMC44IGJvZ29taXBzKQogICAgICAgICAgeDg2LTY0LCBNTVgs IFBoeXNpY2FsIEFkZHJlc3MgRXh0LCBTWVNFTlRFUi9TWVNFWElULCBTWVNDQUxML1NZU1JF VAogICA2OjI1QU0gIHVwICA2OjU0LCAxIHVzZXIsIGxvYWQgYXZlcmFnZXM6IDAuMDgsIDAu MDIsIDAuMDE7IHJ1bmxldmVsIAoKLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tCkJlbmNobWFyayBSdW46 IFR1ZSBGZWIgMTAgMjAwOSAwNjoyNTo0OSAtIDA2OjU0OjA4CjIgQ1BVcyBpbiBzeXN0ZW07 IHJ1bm5pbmcgMSBwYXJhbGxlbCBjb3B5IG9mIHRlc3RzCgpEaHJ5c3RvbmUgMiB1c2luZyBy ZWdpc3RlciB2YXJpYWJsZXMgICAgICAgMTQxNDQzODMuOSBscHMgICAoMTAuMCBzLCA3IHNh bXBsZXMpCkRvdWJsZS1QcmVjaXNpb24gV2hldHN0b25lICAgICAgICAgICAgICAgICAgICAg MzIzOC43IE1XSVBTICg5LjkgcywgNyBzYW1wbGVzKQpFeGVjbCBUaHJvdWdocHV0ICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICA2MzAuMCBscHMgICAoMjkuOSBzLCAyIHNhbXBs ZXMpCkZpbGUgQ29weSAxMDI0IGJ1ZnNpemUgMjAwMCBtYXhibG9ja3MgICAgICAgICAyODc5 My4yIEtCcHMgICgzMC4wIHMsIDIgc2FtcGxlcykKRmlsZSBDb3B5IDI1NiBidWZzaXplIDUw MCBtYXhibG9ja3MgICAgICAgICAgIDMzNDEwLjAgS0JwcyAgKDMwLjAgcywgMiBzYW1wbGVz KQpGaWxlIENvcHkgNDA5NiBidWZzaXplIDgwMDAgbWF4YmxvY2tzICAgICAgICAgMzM1MzYu OCBLQnBzICAoMzAuMSBzLCAyIHNhbXBsZXMpClBpcGUgVGhyb3VnaHB1dCAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgMTE0Njc4NC43IGxwcyAgICgxMC4wIHMsIDcgc2FtcGxlcykK UGlwZS1iYXNlZCBDb250ZXh0IFN3aXRjaGluZyAgICAgICAgICAgICAgICAgIDM2MjAzLjYg bHBzICAgKDEwLjAgcywgNyBzYW1wbGVzKQpQcm9jZXNzIENyZWF0aW9uICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICA3ODMuMyBscHMgICAoMzAuMCBzLCAyIHNhbXBsZXMpClNo ZWxsIFNjcmlwdHMgKDEgY29uY3VycmVudCkgICAgICAgICAgICAgICAgICAgIDY0NS4xIGxw bSAgICg2MC4xIHMsIDIgc2FtcGxlcykKU2hlbGwgU2NyaXB0cyAoOCBjb25jdXJyZW50KSAg ICAgICAgICAgICAgICAgICAgMTE1LjQgbHBtICAgKDYwLjEgcywgMiBzYW1wbGVzKQpTeXN0 ZW0gQ2FsbCBPdmVyaGVhZCAgICAgICAgICAgICAgICAgICAgICAgICA5Mzk2NDcuNSBscHMg ICAoMTAuMCBzLCA3IHNhbXBsZXMpCgpTeXN0ZW0gQmVuY2htYXJrcyBJbmRleCBWYWx1ZXMg ICAgICAgICAgICAgICBCQVNFTElORSAgICAgICBSRVNVTFQgICAgSU5ERVgKRGhyeXN0b25l IDIgdXNpbmcgcmVnaXN0ZXIgdmFyaWFibGVzICAgICAgICAgMTE2NzAwLjAgICAxNDE0NDM4 My45ICAgMTIxMi4wCkRvdWJsZS1QcmVjaXNpb24gV2hldHN0b25lICAgICAgICAgICAgICAg ICAgICAgICA1NS4wICAgICAgIDMyMzguNyAgICA1ODguOQpFeGVjbCBUaHJvdWdocHV0ICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgNDMuMCAgICAgICAgNjMwLjAgICAgMTQ2 LjUKRmlsZSBDb3B5IDEwMjQgYnVmc2l6ZSAyMDAwIG1heGJsb2NrcyAgICAgICAgICAzOTYw LjAgICAgICAyODc5My4yICAgICA3Mi43CkZpbGUgQ29weSAyNTYgYnVmc2l6ZSA1MDAgbWF4 YmxvY2tzICAgICAgICAgICAgMTY1NS4wICAgICAgMzM0MTAuMCAgICAyMDEuOQpGaWxlIENv cHkgNDA5NiBidWZzaXplIDgwMDAgbWF4YmxvY2tzICAgICAgICAgIDU4MDAuMCAgICAgIDMz NTM2LjggICAgIDU3LjgKUGlwZSBUaHJvdWdocHV0ICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgIDEyNDQwLjAgICAgMTE0Njc4NC43ICAgIDkyMS45ClBpcGUtYmFzZWQgQ29udGV4 dCBTd2l0Y2hpbmcgICAgICAgICAgICAgICAgICAgNDAwMC4wICAgICAgMzYyMDMuNiAgICAg OTAuNQpQcm9jZXNzIENyZWF0aW9uICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAx MjYuMCAgICAgICAgNzgzLjMgICAgIDYyLjIKU2hlbGwgU2NyaXB0cyAoMSBjb25jdXJyZW50 KSAgICAgICAgICAgICAgICAgICAgIDQyLjQgICAgICAgIDY0NS4xICAgIDE1Mi4yClNoZWxs IFNjcmlwdHMgKDggY29uY3VycmVudCkgICAgICAgICAgICAgICAgICAgICAgNi4wICAgICAg ICAxMTUuNCAgICAxOTIuMwpTeXN0ZW0gQ2FsbCBPdmVyaGVhZCAgICAgICAgICAgICAgICAg ICAgICAgICAgMTUwMDAuMCAgICAgOTM5NjQ3LjUgICAgNjI2LjQKICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgID09 PT09PT09ClN5c3RlbSBCZW5jaG1hcmtzIEluZGV4IFNjb3JlICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAyMTIuNAoKLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tCkJlbmNo bWFyayBSdW46IFR1ZSBGZWIgMTAgMjAwOSAwNjo1NDowOCAtIDA3OjIyOjMxCjIgQ1BVcyBp biBzeXN0ZW07IHJ1bm5pbmcgMiBwYXJhbGxlbCBjb3BpZXMgb2YgdGVzdHMKCkRocnlzdG9u ZSAyIHVzaW5nIHJlZ2lzdGVyIHZhcmlhYmxlcyAgICAgICAyODM5Mjk1OC4xIGxwcyAgICgx MC4wIHMsIDcgc2FtcGxlcykKRG91YmxlLVByZWNpc2lvbiBXaGV0c3RvbmUgICAgICAgICAg ICAgICAgICAgICA2NDc4LjkgTVdJUFMgKDkuOSBzLCA3IHNhbXBsZXMpCkV4ZWNsIFRocm91 Z2hwdXQgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIDY4NS40IGxwcyAgICgyOS45 IHMsIDIgc2FtcGxlcykKRmlsZSBDb3B5IDEwMjQgYnVmc2l6ZSAyMDAwIG1heGJsb2NrcyAg ICAgICAgIDEzNDM2LjUgS0JwcyAgKDMwLjAgcywgMiBzYW1wbGVzKQpGaWxlIENvcHkgMjU2 IGJ1ZnNpemUgNTAwIG1heGJsb2NrcyAgICAgICAgICAgMTI0NDQuOCBLQnBzICAoMzAuMCBz LCAyIHNhbXBsZXMpCkZpbGUgQ29weSA0MDk2IGJ1ZnNpemUgODAwMCBtYXhibG9ja3MgICAg ICAgICAxODM0Ni4xIEtCcHMgICgzMC4wIHMsIDIgc2FtcGxlcykKUGlwZSBUaHJvdWdocHV0 ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAyMjg0MzQyLjYgbHBzICAgKDEwLjAgcywg NyBzYW1wbGVzKQpQaXBlLWJhc2VkIENvbnRleHQgU3dpdGNoaW5nICAgICAgICAgICAgICAg ICAxMzU2NzcuNCBscHMgICAoMTAuMCBzLCA3IHNhbXBsZXMpClByb2Nlc3MgQ3JlYXRpb24g ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgMTQyMy4zIGxwcyAgICgzMC4wIHMsIDIg c2FtcGxlcykKU2hlbGwgU2NyaXB0cyAoMSBjb25jdXJyZW50KSAgICAgICAgICAgICAgICAg ICAgNzU4LjEgbHBtICAgKDYwLjIgcywgMiBzYW1wbGVzKQpTaGVsbCBTY3JpcHRzICg4IGNv bmN1cnJlbnQpICAgICAgICAgICAgICAgICAgICAxMTAuMiBscG0gICAoNjAuMyBzLCAyIHNh bXBsZXMpClN5c3RlbSBDYWxsIE92ZXJoZWFkICAgICAgICAgICAgICAgICAgICAgICAgMTQ3 MjM0Mi4zIGxwcyAgICgxMC4wIHMsIDcgc2FtcGxlcykKClN5c3RlbSBCZW5jaG1hcmtzIElu ZGV4IFZhbHVlcyAgICAgICAgICAgICAgIEJBU0VMSU5FICAgICAgIFJFU1VMVCAgICBJTkRF WApEaHJ5c3RvbmUgMiB1c2luZyByZWdpc3RlciB2YXJpYWJsZXMgICAgICAgICAxMTY3MDAu MCAgIDI4MzkyOTU4LjEgICAyNDMzLjAKRG91YmxlLVByZWNpc2lvbiBXaGV0c3RvbmUgICAg ICAgICAgICAgICAgICAgICAgIDU1LjAgICAgICAgNjQ3OC45ICAgMTE3OC4wCkV4ZWNsIFRo cm91Z2hwdXQgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICA0My4wICAgICAgICA2 ODUuNCAgICAxNTkuNApGaWxlIENvcHkgMTAyNCBidWZzaXplIDIwMDAgbWF4YmxvY2tzICAg ICAgICAgIDM5NjAuMCAgICAgIDEzNDM2LjUgICAgIDMzLjkKRmlsZSBDb3B5IDI1NiBidWZz aXplIDUwMCBtYXhibG9ja3MgICAgICAgICAgICAxNjU1LjAgICAgICAxMjQ0NC44ICAgICA3 NS4yCkZpbGUgQ29weSA0MDk2IGJ1ZnNpemUgODAwMCBtYXhibG9ja3MgICAgICAgICAgNTgw MC4wICAgICAgMTgzNDYuMSAgICAgMzEuNgpQaXBlIFRocm91Z2hwdXQgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgMTI0NDAuMCAgICAyMjg0MzQyLjYgICAxODM2LjMKUGlwZS1i YXNlZCBDb250ZXh0IFN3aXRjaGluZyAgICAgICAgICAgICAgICAgICA0MDAwLjAgICAgIDEz NTY3Ny40ICAgIDMzOS4yClByb2Nlc3MgQ3JlYXRpb24gICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgIDEyNi4wICAgICAgIDE0MjMuMyAgICAxMTMuMApTaGVsbCBTY3JpcHRzICgx IGNvbmN1cnJlbnQpICAgICAgICAgICAgICAgICAgICAgNDIuNCAgICAgICAgNzU4LjEgICAg MTc4LjgKU2hlbGwgU2NyaXB0cyAoOCBjb25jdXJyZW50KSAgICAgICAgICAgICAgICAgICAg ICA2LjAgICAgICAgIDExMC4yICAgIDE4My43ClN5c3RlbSBDYWxsIE92ZXJoZWFkICAgICAg ICAgICAgICAgICAgICAgICAgICAxNTAwMC4wICAgIDE0NzIzNDIuMyAgICA5ODEuNgogICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgPT09PT09PT0KU3lzdGVtIEJlbmNobWFya3MgSW5kZXggU2NvcmUgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIDI1Ny4yCgo= --------------070807020404010806080201 Content-Type: text/plain; name="test1-linux" Content-Transfer-Encoding: base64 Content-Disposition: inline; filename="test1-linux" bWFrZSBhbGwKbWFrZVsxXTogRW50ZXJpbmcgZGlyZWN0b3J5IGAvcm9vdC90bXAvdW5peGJl bmNoLTUuMS4yJwpDaGVja2luZyBkaXN0cmlidXRpb24gb2YgZmlsZXMKLi9wZ21zICBleGlz dHMKLi9zcmMgIGV4aXN0cwouL3Rlc3RkaXIgIGV4aXN0cwouL3RtcCAgZXhpc3RzCi4vcmVz dWx0cyAgZXhpc3RzCm1ha2VbMV06IExlYXZpbmcgZGlyZWN0b3J5IGAvcm9vdC90bXAvdW5p eGJlbmNoLTUuMS4yJwoKICAgIyAgICAjICAjICAgICMgICMgICMgICAgIyAgICAgICAgICAj IyMjIyAgICMjIyMjIyAgIyAgICAjICAgIyMjIyAgICMgICAgIwogICAjICAgICMgICMjICAg IyAgIyAgICMgICMgICAgICAgICAgICMgICAgIyAgIyAgICAgICAjIyAgICMgICMgICAgIyAg IyAgICAjCiAgICMgICAgIyAgIyAjICAjICAjICAgICMjICAgICAgICAgICAgIyMjIyMgICAj IyMjIyAgICMgIyAgIyAgIyAgICAgICAjIyMjIyMKICAgIyAgICAjICAjICAjICMgICMgICAg IyMgICAgICAgICAgICAjICAgICMgICMgICAgICAgIyAgIyAjICAjICAgICAgICMgICAgIwog ICAjICAgICMgICMgICAjIyAgIyAgICMgICMgICAgICAgICAgICMgICAgIyAgIyAgICAgICAj ICAgIyMgICMgICAgIyAgIyAgICAjCiAgICAjIyMjICAgIyAgICAjICAjICAjICAgICMgICAg ICAgICAgIyMjIyMgICAjIyMjIyMgICMgICAgIyAgICMjIyMgICAjICAgICMKCiAgIFZlcnNp b24gNS4xLjIgICAgICAgICAgICAgICAgICAgICAgQmFzZWQgb24gdGhlIEJ5dGUgTWFnYXpp bmUgVW5peCBCZW5jaG1hcmsKCiAgIE11bHRpLUNQVSB2ZXJzaW9uICAgICAgICAgICAgICAg ICAgVmVyc2lvbiA1IHJldmlzaW9ucyBieSBJYW4gU21pdGgsCiAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgU3Vubnl2YWxlLCBDQSwgVVNBCiAgIERlY2VtYmVyIDIy LCAyMDA3ICAgICAgICAgICAgICAgICAgam9oYW50aGVnaG9zdCBhdCB5YWhvbyBwZXJpb2Qg Y29tCgoKMSB4IERocnlzdG9uZSAyIHVzaW5nIHJlZ2lzdGVyIHZhcmlhYmxlcyAgMSAyIDMg NCA1IDYgNyA4IDkgMTAKCjEgeCBEb3VibGUtUHJlY2lzaW9uIFdoZXRzdG9uZSAgMSAyIDMg NCA1IDYgNyA4IDkgMTAKCjEgeCBFeGVjbCBUaHJvdWdocHV0ICAxIDIgMwoKMSB4IEZpbGUg Q29weSAxMDI0IGJ1ZnNpemUgMjAwMCBtYXhibG9ja3MgIDEgMiAzCgoxIHggRmlsZSBDb3B5 IDI1NiBidWZzaXplIDUwMCBtYXhibG9ja3MgIDEgMiAzCgoxIHggRmlsZSBDb3B5IDQwOTYg YnVmc2l6ZSA4MDAwIG1heGJsb2NrcyAgMSAyIDMKCjEgeCBQaXBlIFRocm91Z2hwdXQgIDEg MiAzIDQgNSA2IDcgOCA5IDEwCgoxIHggUGlwZS1iYXNlZCBDb250ZXh0IFN3aXRjaGluZyAg MSAyIDMgNCA1IDYgNyA4IDkgMTAKCjEgeCBQcm9jZXNzIENyZWF0aW9uICAxIDIgMwoKMSB4 IFN5c3RlbSBDYWxsIE92ZXJoZWFkICAxIDIgMyA0IDUgNiA3IDggOSAxMAoKMSB4IFNoZWxs IFNjcmlwdHMgKDEgY29uY3VycmVudCkgIDEgMiAzCgoxIHggU2hlbGwgU2NyaXB0cyAoOCBj b25jdXJyZW50KSAgMSAyIDMKCjIgeCBEaHJ5c3RvbmUgMiB1c2luZyByZWdpc3RlciB2YXJp YWJsZXMgIDEgMiAzIDQgNSA2IDcgOCA5IDEwCgoyIHggRG91YmxlLVByZWNpc2lvbiBXaGV0 c3RvbmUgIDEgMiAzIDQgNSA2IDcgOCA5IDEwCgoyIHggRXhlY2wgVGhyb3VnaHB1dCAgMSAy IDMKCjIgeCBGaWxlIENvcHkgMTAyNCBidWZzaXplIDIwMDAgbWF4YmxvY2tzICAxIDIgMwoK MiB4IEZpbGUgQ29weSAyNTYgYnVmc2l6ZSA1MDAgbWF4YmxvY2tzICAxIDIgMwoKMiB4IEZp bGUgQ29weSA0MDk2IGJ1ZnNpemUgODAwMCBtYXhibG9ja3MgIDEgMiAzCgoyIHggUGlwZSBU aHJvdWdocHV0ICAxIDIgMyA0IDUgNiA3IDggOSAxMAoKMiB4IFBpcGUtYmFzZWQgQ29udGV4 dCBTd2l0Y2hpbmcgIDEgMiAzIDQgNSA2IDcgOCA5IDEwCgoyIHggUHJvY2VzcyBDcmVhdGlv biAgMSAyIDMKCjIgeCBTeXN0ZW0gQ2FsbCBPdmVyaGVhZCAgMSAyIDMgNCA1IDYgNyA4IDkg MTAKCjIgeCBTaGVsbCBTY3JpcHRzICgxIGNvbmN1cnJlbnQpICAxIDIgMwoKMiB4IFNoZWxs IFNjcmlwdHMgKDggY29uY3VycmVudCkgIDEgMiAzCgo9PT09PT09PT09PT09PT09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT0KICAg QllURSBVTklYIEJlbmNobWFya3MgKFZlcnNpb24gNS4xLjIpCgogICBTeXN0ZW06IHRlc3Qt dWJ1bnR1OiBHTlUvTGludXgKICAgT1M6IEdOVS9MaW51eCAtLSAyLjYuMjctNy1zZXJ2ZXIg LS0gIzEgU01QIEZyaSBPY3QgMjQgMDc6MjA6NDcgVVRDIDIwMDgKICAgTWFjaGluZTogeDg2 XzY0ICh1bmtub3duKQogICBMYW5ndWFnZTogZW5fVVMudXRmOCAoY2hhcm1hcD0iVVRGLTgi LCBjb2xsYXRlPSJVVEYtOCIpCiAgIENQVSAwOiBJbnRlbChSKSBYZW9uKFIpIENQVSBFNTQy MCBAIDIuNTBHSHogKDQ5OTkuOSBib2dvbWlwcykKICAgICAgICAgIHg4Ni02NCwgTU1YLCBQ aHlzaWNhbCBBZGRyZXNzIEV4dCwgU1lTRU5URVIvU1lTRVhJVCwgU1lTQ0FMTC9TWVNSRVQK ICAgQ1BVIDE6IEludGVsKFIpIFhlb24oUikgQ1BVIEU1NDIwIEAgMi41MEdIeiAoNTAwMC44 IGJvZ29taXBzKQogICAgICAgICAgeDg2LTY0LCBNTVgsIFBoeXNpY2FsIEFkZHJlc3MgRXh0 LCBTWVNFTlRFUi9TWVNFWElULCBTWVNDQUxML1NZU1JFVAogICAxNToxNTowNiB1cCAgMjox OSwgIDEgdXNlciwgIGxvYWQgYXZlcmFnZTogMC4wMCwgMC4wMCwgMC4wMDsgcnVubGV2ZWwg MgoKLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tCkJlbmNobWFyayBSdW46IE1vbiBGZWIgMDkgMjAwOSAx NToxNTowNiAtIDE1OjQzOjIwCjIgQ1BVcyBpbiBzeXN0ZW07IHJ1bm5pbmcgMSBwYXJhbGxl bCBjb3B5IG9mIHRlc3RzCgpEaHJ5c3RvbmUgMiB1c2luZyByZWdpc3RlciB2YXJpYWJsZXMg ICAgICAgMTg2MTA1NzUuMyBscHMgICAoMTAuMCBzLCA3IHNhbXBsZXMpCkRvdWJsZS1QcmVj aXNpb24gV2hldHN0b25lICAgICAgICAgICAgICAgICAgICAgMjk5MC4xIE1XSVBTICgxMC4w IHMsIDcgc2FtcGxlcykKRXhlY2wgVGhyb3VnaHB1dCAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAxMDU4LjYgbHBzICAgKDI5LjggcywgMiBzYW1wbGVzKQpGaWxlIENvcHkgMTAy NCBidWZzaXplIDIwMDAgbWF4YmxvY2tzICAgICAgICA0Njg5NzMuMiBLQnBzICAoMzAuMCBz LCAyIHNhbXBsZXMpCkZpbGUgQ29weSAyNTYgYnVmc2l6ZSA1MDAgbWF4YmxvY2tzICAgICAg ICAgIDEzMjAyMi4yIEtCcHMgICgzMC4wIHMsIDIgc2FtcGxlcykKRmlsZSBDb3B5IDQwOTYg YnVmc2l6ZSA4MDAwIG1heGJsb2NrcyAgICAgICAgOTIxNDQ4LjUgS0JwcyAgKDMwLjAgcywg MiBzYW1wbGVzKQpQaXBlIFRocm91Z2hwdXQgICAgICAgICAgICAgICAgICAgICAgICAgICAg IDExMzI5MzMuNiBscHMgICAoMTAuMCBzLCA3IHNhbXBsZXMpClBpcGUtYmFzZWQgQ29udGV4 dCBTd2l0Y2hpbmcgICAgICAgICAgICAgICAgICA5MzQyOS4wIGxwcyAgICgxMC4wIHMsIDcg c2FtcGxlcykKUHJvY2VzcyBDcmVhdGlvbiAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAxNzQ0LjMgbHBzICAgKDMwLjAgcywgMiBzYW1wbGVzKQpTaGVsbCBTY3JpcHRzICgxIGNv bmN1cnJlbnQpICAgICAgICAgICAgICAgICAgIDI1NjYuOSBscG0gICAoNjAuMCBzLCAyIHNh bXBsZXMpClNoZWxsIFNjcmlwdHMgKDggY29uY3VycmVudCkgICAgICAgICAgICAgICAgICAg IDUxOC40IGxwbSAgICg2MC4xIHMsIDIgc2FtcGxlcykKU3lzdGVtIENhbGwgT3ZlcmhlYWQg ICAgICAgICAgICAgICAgICAgICAgICAxOTM1NTc3LjAgbHBzICAgKDEwLjAgcywgNyBzYW1w bGVzKQoKU3lzdGVtIEJlbmNobWFya3MgSW5kZXggVmFsdWVzICAgICAgICAgICAgICAgQkFT RUxJTkUgICAgICAgUkVTVUxUICAgIElOREVYCkRocnlzdG9uZSAyIHVzaW5nIHJlZ2lzdGVy IHZhcmlhYmxlcyAgICAgICAgIDExNjcwMC4wICAgMTg2MTA1NzUuMyAgIDE1OTQuNwpEb3Vi bGUtUHJlY2lzaW9uIFdoZXRzdG9uZSAgICAgICAgICAgICAgICAgICAgICAgNTUuMCAgICAg ICAyOTkwLjEgICAgNTQzLjcKRXhlY2wgVGhyb3VnaHB1dCAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgIDQzLjAgICAgICAgMTA1OC42ICAgIDI0Ni4yCkZpbGUgQ29weSAxMDI0 IGJ1ZnNpemUgMjAwMCBtYXhibG9ja3MgICAgICAgICAgMzk2MC4wICAgICA0Njg5NzMuMiAg IDExODQuMwpGaWxlIENvcHkgMjU2IGJ1ZnNpemUgNTAwIG1heGJsb2NrcyAgICAgICAgICAg IDE2NTUuMCAgICAgMTMyMDIyLjIgICAgNzk3LjcKRmlsZSBDb3B5IDQwOTYgYnVmc2l6ZSA4 MDAwIG1heGJsb2NrcyAgICAgICAgICA1ODAwLjAgICAgIDkyMTQ0OC41ICAgMTU4OC43ClBp cGUgVGhyb3VnaHB1dCAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAxMjQ0MC4wICAg IDExMzI5MzMuNiAgICA5MTAuNwpQaXBlLWJhc2VkIENvbnRleHQgU3dpdGNoaW5nICAgICAg ICAgICAgICAgICAgIDQwMDAuMCAgICAgIDkzNDI5LjAgICAgMjMzLjYKUHJvY2VzcyBDcmVh dGlvbiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgMTI2LjAgICAgICAgMTc0NC4z ICAgIDEzOC40ClNoZWxsIFNjcmlwdHMgKDEgY29uY3VycmVudCkgICAgICAgICAgICAgICAg ICAgICA0Mi40ICAgICAgIDI1NjYuOSAgICA2MDUuNApTaGVsbCBTY3JpcHRzICg4IGNvbmN1 cnJlbnQpICAgICAgICAgICAgICAgICAgICAgIDYuMCAgICAgICAgNTE4LjQgICAgODY0LjAK U3lzdGVtIENhbGwgT3ZlcmhlYWQgICAgICAgICAgICAgICAgICAgICAgICAgIDE1MDAwLjAg ICAgMTkzNTU3Ny4wICAgMTI5MC40CiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICA9PT09PT09PQpTeXN0ZW0gQmVu Y2htYXJrcyBJbmRleCBTY29yZSAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgNjU2LjEKCi0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLQpCZW5jaG1hcmsgUnVuOiBNb24gRmVi IDA5IDIwMDkgMTU6NDM6MjAgLSAxNjoxMTozMwoyIENQVXMgaW4gc3lzdGVtOyBydW5uaW5n IDIgcGFyYWxsZWwgY29waWVzIG9mIHRlc3RzCgpEaHJ5c3RvbmUgMiB1c2luZyByZWdpc3Rl ciB2YXJpYWJsZXMgICAgICAgMzcyOTMwMTUuOCBscHMgICAoMTAuMCBzLCA3IHNhbXBsZXMp CkRvdWJsZS1QcmVjaXNpb24gV2hldHN0b25lICAgICAgICAgICAgICAgICAgICAgNTk4MC4x IE1XSVBTICgxMC4wIHMsIDcgc2FtcGxlcykKRXhlY2wgVGhyb3VnaHB1dCAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAyMjM1LjkgbHBzICAgKDMwLjAgcywgMiBzYW1wbGVzKQpG aWxlIENvcHkgMTAyNCBidWZzaXplIDIwMDAgbWF4YmxvY2tzICAgICAgICAyMDQzMDAuOSBL QnBzICAoMzAuMCBzLCAyIHNhbXBsZXMpCkZpbGUgQ29weSAyNTYgYnVmc2l6ZSA1MDAgbWF4 YmxvY2tzICAgICAgICAgICA2ODU2Ni45IEtCcHMgICgzMC4wIHMsIDIgc2FtcGxlcykKRmls ZSBDb3B5IDQwOTYgYnVmc2l6ZSA4MDAwIG1heGJsb2NrcyAgICAgICAgNDQzNDEwLjMgS0Jw cyAgKDMwLjAgcywgMiBzYW1wbGVzKQpQaXBlIFRocm91Z2hwdXQgICAgICAgICAgICAgICAg ICAgICAgICAgICAgIDIyNTkwNjcuMSBscHMgICAoMTAuMCBzLCA3IHNhbXBsZXMpClBpcGUt YmFzZWQgQ29udGV4dCBTd2l0Y2hpbmcgICAgICAgICAgICAgICAgIDE5Mzg5OS43IGxwcyAg ICgxMC4wIHMsIDcgc2FtcGxlcykKUHJvY2VzcyBDcmVhdGlvbiAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAzNTk0LjggbHBzICAgKDMwLjAgcywgMiBzYW1wbGVzKQpTaGVsbCBT Y3JpcHRzICgxIGNvbmN1cnJlbnQpICAgICAgICAgICAgICAgICAgIDQxNDUuNyBscG0gICAo NjAuMCBzLCAyIHNhbXBsZXMpClNoZWxsIFNjcmlwdHMgKDggY29uY3VycmVudCkgICAgICAg ICAgICAgICAgICAgIDUyOC42IGxwbSAgICg2MC4xIHMsIDIgc2FtcGxlcykKU3lzdGVtIENh bGwgT3ZlcmhlYWQgICAgICAgICAgICAgICAgICAgICAgICAyNjczMjE1LjkgbHBzICAgKDEw LjAgcywgNyBzYW1wbGVzKQoKU3lzdGVtIEJlbmNobWFya3MgSW5kZXggVmFsdWVzICAgICAg ICAgICAgICAgQkFTRUxJTkUgICAgICAgUkVTVUxUICAgIElOREVYCkRocnlzdG9uZSAyIHVz aW5nIHJlZ2lzdGVyIHZhcmlhYmxlcyAgICAgICAgIDExNjcwMC4wICAgMzcyOTMwMTUuOCAg IDMxOTUuNgpEb3VibGUtUHJlY2lzaW9uIFdoZXRzdG9uZSAgICAgICAgICAgICAgICAgICAg ICAgNTUuMCAgICAgICA1OTgwLjEgICAxMDg3LjMKRXhlY2wgVGhyb3VnaHB1dCAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgIDQzLjAgICAgICAgMjIzNS45ICAgIDUyMC4wCkZp bGUgQ29weSAxMDI0IGJ1ZnNpemUgMjAwMCBtYXhibG9ja3MgICAgICAgICAgMzk2MC4wICAg ICAyMDQzMDAuOSAgICA1MTUuOQpGaWxlIENvcHkgMjU2IGJ1ZnNpemUgNTAwIG1heGJsb2Nr cyAgICAgICAgICAgIDE2NTUuMCAgICAgIDY4NTY2LjkgICAgNDE0LjMKRmlsZSBDb3B5IDQw OTYgYnVmc2l6ZSA4MDAwIG1heGJsb2NrcyAgICAgICAgICA1ODAwLjAgICAgIDQ0MzQxMC4z ICAgIDc2NC41ClBpcGUgVGhyb3VnaHB1dCAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAxMjQ0MC4wICAgIDIyNTkwNjcuMSAgIDE4MTYuMApQaXBlLWJhc2VkIENvbnRleHQgU3dp dGNoaW5nICAgICAgICAgICAgICAgICAgIDQwMDAuMCAgICAgMTkzODk5LjcgICAgNDg0LjcK UHJvY2VzcyBDcmVhdGlvbiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgMTI2LjAg ICAgICAgMzU5NC44ICAgIDI4NS4zClNoZWxsIFNjcmlwdHMgKDEgY29uY3VycmVudCkgICAg ICAgICAgICAgICAgICAgICA0Mi40ICAgICAgIDQxNDUuNyAgICA5NzcuOApTaGVsbCBTY3Jp cHRzICg4IGNvbmN1cnJlbnQpICAgICAgICAgICAgICAgICAgICAgIDYuMCAgICAgICAgNTI4 LjYgICAgODgxLjEKU3lzdGVtIENhbGwgT3ZlcmhlYWQgICAgICAgICAgICAgICAgICAgICAg ICAgIDE1MDAwLjAgICAgMjY3MzIxNS45ICAgMTc4Mi4xCiAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICA9PT09PT09 PQpTeXN0ZW0gQmVuY2htYXJrcyBJbmRleCBTY29yZSAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgODM0LjQKCg== --------------070807020404010806080201-- --------------ms030502050109050601060304 Content-Type: application/x-pkcs7-signature; name="smime.p7s" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="smime.p7s" Content-Description: S/MIME Cryptographic Signature MIAGCSqGSIb3DQEHAqCAMIACAQExCzAJBgUrDgMCGgUAMIAGCSqGSIb3DQEHAQAAoIIJUTCC AwMwggJsoAMCAQICEFN8DarMNuuKJDEtfs0UaqUwDQYJKoZIhvcNAQEFBQAwYjELMAkGA1UE BhMCWkExJTAjBgNVBAoTHFRoYXd0ZSBDb25zdWx0aW5nIChQdHkpIEx0ZC4xLDAqBgNVBAMT I1RoYXd0ZSBQZXJzb25hbCBGcmVlbWFpbCBJc3N1aW5nIENBMB4XDTA4MDYzMDEzNTE1N1oX DTA5MDYzMDEzNTE1N1owaDEQMA4GA1UEBBMHdmFuIEVyazETMBEGA1UEKhMKU2ViYXN0aWFh bjEbMBkGA1UEAxMSU2ViYXN0aWFhbiB2YW4gRXJrMSIwIAYJKoZIhvcNAQkBFhNzZWJzdGVy QHNlYnN0ZXIuY29tMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAsJDDAeYHVmH/ GVxi+bhFx27dmg++9BdhPJfk8k041sqEqq7oXnR2GT54quY3Ac7A1BuOM2JvoICraGmjud4y b3EanRnqGIK6iH+VAhhTlV/Owrb2Qm1e13DLxwLp1SocSQl4IrEbF9Y5H3ASdIrE0iFqkpju nPiiHeNhz3LaI5ipjiluKYoH+F6gPx8njHoaDxPePCkSLg4r0IA0afLM74LVZxCRBZEfyRZS J6VVUJefKlz91dWSzR/3xSw/rO4u9Ds/Zh7VBUKy3K+YFryHxRpUek0gSepE1b70Q39L9Sqd M/NZqMvFpwrqgW2Zh2Nh8nqRge90maR4ypBzz3GzLwIDAQABozAwLjAeBgNVHREEFzAVgRNz ZWJzdGVyQHNlYnN0ZXIuY29tMAwGA1UdEwEB/wQCMAAwDQYJKoZIhvcNAQEFBQADgYEAS1Sk NMgDVzb0ktO9tPPacV0KdKhTYOHcICVmuDEe2sFHOkjLAI1iAKp640pqJEVqvRnfRcCFJ9hK koPjjVZ+ui2rVmJWBG6FSloLRS/YYED4tUAw6DQhK61UOpjkpQxjCdm+5bHG/2ZgJAda1j0x uiN822+xFkcaW/5PQgxSRxcwggMDMIICbKADAgECAhBTfA2qzDbriiQxLX7NFGqlMA0GCSqG SIb3DQEBBQUAMGIxCzAJBgNVBAYTAlpBMSUwIwYDVQQKExxUaGF3dGUgQ29uc3VsdGluZyAo UHR5KSBMdGQuMSwwKgYDVQQDEyNUaGF3dGUgUGVyc29uYWwgRnJlZW1haWwgSXNzdWluZyBD QTAeFw0wODA2MzAxMzUxNTdaFw0wOTA2MzAxMzUxNTdaMGgxEDAOBgNVBAQTB3ZhbiBFcmsx EzARBgNVBCoTClNlYmFzdGlhYW4xGzAZBgNVBAMTElNlYmFzdGlhYW4gdmFuIEVyazEiMCAG CSqGSIb3DQEJARYTc2Vic3RlckBzZWJzdGVyLmNvbTCCASIwDQYJKoZIhvcNAQEBBQADggEP ADCCAQoCggEBALCQwwHmB1Zh/xlcYvm4Rcdu3ZoPvvQXYTyX5PJNONbKhKqu6F50dhk+eKrm NwHOwNQbjjNib6CAq2hpo7neMm9xGp0Z6hiCuoh/lQIYU5VfzsK29kJtXtdwy8cC6dUqHEkJ eCKxGxfWOR9wEnSKxNIhapKY7pz4oh3jYc9y2iOYqY4pbimKB/heoD8fJ4x6Gg8T3jwpEi4O K9CANGnyzO+C1WcQkQWRH8kWUielVVCXnypc/dXVks0f98UsP6zuLvQ7P2Ye1QVCstyvmBa8 h8UaVHpNIEnqRNW+9EN/S/UqnTPzWajLxacK6oFtmYdjYfJ6kYHvdJmkeMqQc89xsy8CAwEA AaMwMC4wHgYDVR0RBBcwFYETc2Vic3RlckBzZWJzdGVyLmNvbTAMBgNVHRMBAf8EAjAAMA0G CSqGSIb3DQEBBQUAA4GBAEtUpDTIA1c29JLTvbTz2nFdCnSoU2Dh3CAlZrgxHtrBRzpIywCN YgCqeuNKaiRFar0Z30XAhSfYSpKD441Wfrotq1ZiVgRuhUpaC0Uv2GBA+LVAMOg0ISutVDqY 5KUMYwnZvuWxxv9mYCQHWtY9MbojfNtvsRZHGlv+T0IMUkcXMIIDPzCCAqigAwIBAgIBDTAN BgkqhkiG9w0BAQUFADCB0TELMAkGA1UEBhMCWkExFTATBgNVBAgTDFdlc3Rlcm4gQ2FwZTES MBAGA1UEBxMJQ2FwZSBUb3duMRowGAYDVQQKExFUaGF3dGUgQ29uc3VsdGluZzEoMCYGA1UE CxMfQ2VydGlmaWNhdGlvbiBTZXJ2aWNlcyBEaXZpc2lvbjEkMCIGA1UEAxMbVGhhd3RlIFBl cnNvbmFsIEZyZWVtYWlsIENBMSswKQYJKoZIhvcNAQkBFhxwZXJzb25hbC1mcmVlbWFpbEB0 aGF3dGUuY29tMB4XDTAzMDcxNzAwMDAwMFoXDTEzMDcxNjIzNTk1OVowYjELMAkGA1UEBhMC WkExJTAjBgNVBAoTHFRoYXd0ZSBDb25zdWx0aW5nIChQdHkpIEx0ZC4xLDAqBgNVBAMTI1Ro YXd0ZSBQZXJzb25hbCBGcmVlbWFpbCBJc3N1aW5nIENBMIGfMA0GCSqGSIb3DQEBAQUAA4GN ADCBiQKBgQDEpjxVc1X7TrnKmVoeaMB1BHCd3+n/ox7svc31W/Iadr1/DDph8r9RzgHU5VAK MNcCY1osiRVwjt3J8CuFWqo/cVbLrzwLB+fxH5E2JCoTzyvV84J3PQO+K/67GD4Hv0CAAmTX p6a7n2XRxSpUhQ9IBH+nttE8YQRAHmQZcmC3+wIDAQABo4GUMIGRMBIGA1UdEwEB/wQIMAYB Af8CAQAwQwYDVR0fBDwwOjA4oDagNIYyaHR0cDovL2NybC50aGF3dGUuY29tL1RoYXd0ZVBl cnNvbmFsRnJlZW1haWxDQS5jcmwwCwYDVR0PBAQDAgEGMCkGA1UdEQQiMCCkHjAcMRowGAYD VQQDExFQcml2YXRlTGFiZWwyLTEzODANBgkqhkiG9w0BAQUFAAOBgQBIjNFQg+oLLswNo2as Zw9/r6y+whehQ5aUnX9MIbj4Nh+qLZ82L8D0HFAgk3A8/a3hYWLD2ToZfoSxmRsAxRoLgnSe JVCUYsfbJ3FXJY3dqZw5jowgT2Vfldr394fWxghOrvbqNOUQGls1TXfjViF4gtwhGTXeJLHT HUb/XV9lTzGCA3EwggNtAgEBMHYwYjELMAkGA1UEBhMCWkExJTAjBgNVBAoTHFRoYXd0ZSBD b25zdWx0aW5nIChQdHkpIEx0ZC4xLDAqBgNVBAMTI1RoYXd0ZSBQZXJzb25hbCBGcmVlbWFp bCBJc3N1aW5nIENBAhBTfA2qzDbriiQxLX7NFGqlMAkGBSsOAwIaBQCgggHQMBgGCSqGSIb3 DQEJAzELBgkqhkiG9w0BBwEwHAYJKoZIhvcNAQkFMQ8XDTA5MDIxMDE0MjQxMFowIwYJKoZI hvcNAQkEMRYEFDTrt0UgMz3bl2enxPymT6EJxIP6MF8GCSqGSIb3DQEJDzFSMFAwCwYJYIZI AWUDBAECMAoGCCqGSIb3DQMHMA4GCCqGSIb3DQMCAgIAgDANBggqhkiG9w0DAgIBQDAHBgUr DgMCBzANBggqhkiG9w0DAgIBKDCBhQYJKwYBBAGCNxAEMXgwdjBiMQswCQYDVQQGEwJaQTEl MCMGA1UEChMcVGhhd3RlIENvbnN1bHRpbmcgKFB0eSkgTHRkLjEsMCoGA1UEAxMjVGhhd3Rl IFBlcnNvbmFsIEZyZWVtYWlsIElzc3VpbmcgQ0ECEFN8DarMNuuKJDEtfs0UaqUwgYcGCyqG SIb3DQEJEAILMXigdjBiMQswCQYDVQQGEwJaQTElMCMGA1UEChMcVGhhd3RlIENvbnN1bHRp bmcgKFB0eSkgTHRkLjEsMCoGA1UEAxMjVGhhd3RlIFBlcnNvbmFsIEZyZWVtYWlsIElzc3Vp bmcgQ0ECEFN8DarMNuuKJDEtfs0UaqUwDQYJKoZIhvcNAQEBBQAEggEARXItcyZSObQHQpiE U2dETZp6yv5DWUw1h1LrOz1jiG4abCyxDeTryvcRlXQIAmHiCMJaGnthllBH8iBZkXFrasfZ g8Ott+Alq96Sq+Pu056czJh+X/sQm1PvMEmlRLgrLhc7nFhdVucBkRVd4ASl84DaJn8jgMxY 4w49R16hl6Pz8d7Hpe9m9PozGzdVkZie8HIIRQMvQ57+q5cgq2RQDHW3NqviS3GLYNsc6E68 WUXT28nS+j4qbhwUgZg/aZtVpZnUFDNXyyjgk6QnYYv6jTONgQtuv98xFXs1aWpizBvjq4ZB DKy298lybVhujsOYqQ846fP/rGI/e/T228CGpQAAAAAAAA== --------------ms030502050109050601060304-- From owner-freebsd-performance@FreeBSD.ORG Tue Feb 10 14:44:45 2009 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 4D2B2106568B for ; Tue, 10 Feb 2009 14:44:45 +0000 (UTC) (envelope-from gofp-freebsd-performance@m.gmane.org) Received: from ciao.gmane.org (main.gmane.org [80.91.229.2]) by mx1.freebsd.org (Postfix) with ESMTP id C93DC8FC1D for ; Tue, 10 Feb 2009 14:44:44 +0000 (UTC) (envelope-from gofp-freebsd-performance@m.gmane.org) Received: from list by ciao.gmane.org with local (Exim 4.43) id 1LWtqv-0008Tq-Hk for freebsd-performance@freebsd.org; Tue, 10 Feb 2009 14:44:45 +0000 Received: from lara.cc.fer.hr ([161.53.72.113]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Tue, 10 Feb 2009 14:44:45 +0000 Received: from ivoras by lara.cc.fer.hr with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Tue, 10 Feb 2009 14:44:45 +0000 X-Injected-Via-Gmane: http://gmane.org/ To: freebsd-performance@freebsd.org From: Ivan Voras Date: Tue, 10 Feb 2009 15:44:33 +0100 Lines: 111 Message-ID: References: <499165F3.6050803@sebster.com> <49918DA6.4020608@sebster.com> <49918E0A.1060500@sebster.com> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enig282B5F4E84B36F935569B287" X-Complaints-To: usenet@ger.gmane.org X-Gmane-NNTP-Posting-Host: lara.cc.fer.hr User-Agent: Thunderbird 2.0.0.19 (X11/20090105) In-Reply-To: <49918E0A.1060500@sebster.com> X-Enigmail-Version: 0.95.0 Sender: news Subject: Re: FreeBSD 7.1 disk performance issue on ESXi 3.5 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 10 Feb 2009 14:44:45 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enig282B5F4E84B36F935569B287 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Sebastiaan van Erk wrote: > Sebastiaan van Erk wrote: >> (However, just to give you an idea I attached the basic 5.1.2 >> unixbench outputs (the CPU info for FreeBSD is "fake", since unixbench= >> does a cat /proc/cpuinfo, so I removed the /proc/ part and copied the >> output under linux to the "procinfo" file.) System: test-fbsd.vpn1.sebster.com: FreeBSD ------------------------------------------------------------------------ Benchmark Run: Tue Feb 10 2009 06:25:49 - 06:54:08 2 CPUs in system; running 1 parallel copy of tests System Benchmarks Index Values BASELINE RESULT IND= EX Dhrystone 2 using register variables 116700.0 14144383.9 1212= =2E0 Double-Precision Whetstone 55.0 3238.7 588= =2E9 Execl Throughput 43.0 630.0 146= =2E5 File Copy 1024 bufsize 2000 maxblocks 3960.0 28793.2 72= =2E7 File Copy 256 bufsize 500 maxblocks 1655.0 33410.0 201= =2E9 File Copy 4096 bufsize 8000 maxblocks 5800.0 33536.8 57= =2E8 Pipe Throughput 12440.0 1146784.7 921= =2E9 Pipe-based Context Switching 4000.0 36203.6 90= =2E5 Process Creation 126.0 783.3 62= =2E2 Shell Scripts (1 concurrent) 42.4 645.1 152= =2E2 Shell Scripts (8 concurrent) 6.0 115.4 192= =2E3 System Call Overhead 15000.0 939647.5 626= =2E4 =3D=3D= =3D=3D=3D=3D=3D=3D System Benchmarks Index Score 212= =2E4 System: test-ubuntu: GNU/Linux ------------------------------------------------------------------------ Benchmark Run: Mon Feb 09 2009 15:15:06 - 15:43:20 2 CPUs in system; running 1 parallel copy of tests System Benchmarks Index Values BASELINE RESULT IND= EX Dhrystone 2 using register variables 116700.0 18610575.3 1594= =2E7 Double-Precision Whetstone 55.0 2990.1 543= =2E7 Execl Throughput 43.0 1058.6 246= =2E2 File Copy 1024 bufsize 2000 maxblocks 3960.0 468973.2 1184= =2E3 File Copy 256 bufsize 500 maxblocks 1655.0 132022.2 797= =2E7 File Copy 4096 bufsize 8000 maxblocks 5800.0 921448.5 1588= =2E7 Pipe Throughput 12440.0 1132933.6 910= =2E7 Pipe-based Context Switching 4000.0 93429.0 233= =2E6 Process Creation 126.0 1744.3 138= =2E4 Shell Scripts (1 concurrent) 42.4 2566.9 605= =2E4 Shell Scripts (8 concurrent) 6.0 518.4 864= =2E0 System Call Overhead 15000.0 1935577.0 1290= =2E4 =3D=3D= =3D=3D=3D=3D=3D=3D System Benchmarks Index Score 656= =2E1 The results are ... interesting. It seems that FreeBSD simply dies in any test having a high context switch rate. Hmmm, this looks familiar. Either I or a collegue of mine had a similar situation some time ago, with the same discrepancy in disk speeds and the same difference in context switches. Unfortunately, there was no solution. --------------enig282B5F4E84B36F935569B287 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFJkZLRldnAQVacBcgRAhhFAKDV99HyKIYR/l430gZQ580Bd3NOdwCg0oXv rwsR0iAMX3ovSYziH5Nh7Ok= =JFdR -----END PGP SIGNATURE----- --------------enig282B5F4E84B36F935569B287-- From owner-freebsd-performance@FreeBSD.ORG Wed Feb 11 07:07:01 2009 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id E94AB1065672; Wed, 11 Feb 2009 07:07:01 +0000 (UTC) (envelope-from fbsd-performance@mawer.org) Received: from outbound.icp-qv1-irony-out1.iinet.net.au (outbound.icp-qv1-irony-out1.iinet.net.au [203.59.1.108]) by mx1.freebsd.org (Postfix) with ESMTP id 33A1D8FC16; Wed, 11 Feb 2009 07:07:00 +0000 (UTC) (envelope-from fbsd-performance@mawer.org) X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: AjwBAJ4AkknLzq3r/2dsb2JhbAAI00yEGgY X-IronPort-AV: E=Sophos;i="4.38,190,1233500400"; d="scan'208";a="452568463" Received: from unknown (HELO [10.24.1.1]) ([203.206.173.235]) by outbound.icp-qv1-irony-out1.iinet.net.au with ESMTP; 11 Feb 2009 15:38:07 +0900 Message-ID: <49927151.2030100@mawer.org> Date: Wed, 11 Feb 2009 17:33:53 +1100 From: Antony Mawer User-Agent: Thunderbird 2.0.0.19 (Windows/20081209) MIME-Version: 1.0 To: Ivan Voras References: <499165F3.6050803@sebster.com> <49918DA6.4020608@sebster.com> <49918E0A.1060500@sebster.com> In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-performance@freebsd.org Subject: Re: FreeBSD 7.1 disk performance issue on ESXi 3.5 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Feb 2009 07:07:02 -0000 Ivan Voras wrote: > Sebastiaan van Erk wrote: >> Sebastiaan van Erk wrote: >>> (However, just to give you an idea I attached the basic 5.1.2 >>> unixbench outputs (the CPU info for FreeBSD is "fake", since unixbench >>> does a cat /proc/cpuinfo, so I removed the /proc/ part and copied the >>> output under linux to the "procinfo" file.) > ... benchmark results snipped ... > > The results are ... interesting. It seems that FreeBSD simply dies in > any test having a high context switch rate. Hmmm, this looks familiar. > Either I or a collegue of mine had a similar situation some time ago, > with the same discrepancy in disk speeds and the same difference in > context switches. Unfortunately, there was no solution. How would one go about gathering data on such a scenario to help improve this? We were planning a project involving VMware deployments with FreeBSD 7.1 systems in the near future, but if performance is that bad it is likely to be a show stopper. Where do we start looking and who should we be talking to? -- Antony From owner-freebsd-performance@FreeBSD.ORG Wed Feb 11 10:12:41 2009 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 74878106566B for ; Wed, 11 Feb 2009 10:12:41 +0000 (UTC) (envelope-from gofp-freebsd-performance@m.gmane.org) Received: from ciao.gmane.org (main.gmane.org [80.91.229.2]) by mx1.freebsd.org (Postfix) with ESMTP id EF9CE8FC1F for ; Wed, 11 Feb 2009 10:12:40 +0000 (UTC) (envelope-from gofp-freebsd-performance@m.gmane.org) Received: from list by ciao.gmane.org with local (Exim 4.43) id 1LXC55-000833-0F for freebsd-performance@freebsd.org; Wed, 11 Feb 2009 10:12:35 +0000 Received: from lara.cc.fer.hr ([161.53.72.113]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Wed, 11 Feb 2009 10:12:34 +0000 Received: from ivoras by lara.cc.fer.hr with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Wed, 11 Feb 2009 10:12:34 +0000 X-Injected-Via-Gmane: http://gmane.org/ To: freebsd-performance@freebsd.org From: Ivan Voras Date: Wed, 11 Feb 2009 11:12:12 +0100 Lines: 63 Message-ID: References: <499165F3.6050803@sebster.com> <49918DA6.4020608@sebster.com> <49918E0A.1060500@sebster.com> <49927151.2030100@mawer.org> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enig00744A335C05FEADDA13CF39" X-Complaints-To: usenet@ger.gmane.org X-Gmane-NNTP-Posting-Host: lara.cc.fer.hr User-Agent: Thunderbird 2.0.0.19 (X11/20090105) In-Reply-To: <49927151.2030100@mawer.org> X-Enigmail-Version: 0.95.0 Sender: news Subject: Re: FreeBSD 7.1 disk performance issue on ESXi 3.5 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Feb 2009 10:12:41 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enig00744A335C05FEADDA13CF39 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Antony Mawer wrote: > Ivan Voras wrote: >> Sebastiaan van Erk wrote: >>> Sebastiaan van Erk wrote: >>>> (However, just to give you an idea I attached the basic 5.1.2 >>>> unixbench outputs (the CPU info for FreeBSD is "fake", since unixben= ch >>>> does a cat /proc/cpuinfo, so I removed the /proc/ part and copied th= e >>>> output under linux to the "procinfo" file.) >> > ... benchmark results snipped ... >> >> The results are ... interesting. It seems that FreeBSD simply dies in >> any test having a high context switch rate. Hmmm, this looks familiar.= >> Either I or a collegue of mine had a similar situation some time ago, >> with the same discrepancy in disk speeds and the same difference in >> context switches. Unfortunately, there was no solution. >=20 > How would one go about gathering data on such a scenario to help improv= e > this? We were planning a project involving VMware deployments with > FreeBSD 7.1 systems in the near future, but if performance is that bad > it is likely to be a show stopper. >=20 > Where do we start looking and who should we be talking to? Relax, we didn't yet actually establish that it isn't a local problem. I've talked a little with OP but nothing we did yet made it better. For what it's worth, my experience is that on VMWare Server, whose emulated SCSI hardware is detected exactly the same as on ESX, the performance is "normal" (i.e. as expected), and on an ESX 3.0 on a slow array (and sharing it with other active machines) I get results around 20 MB/s in dbench - which is better than the OP gets on a fast array. All this is with 32-bit guests, FreeBSD 7.0 or 7.1. If I get the chance, I'll try ESXi within the next few days and try to replicate the problem. --------------enig00744A335C05FEADDA13CF39 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFJkqSHldnAQVacBcgRAgyEAJ9jl4DhvCa9q5AtAi3MaMMXxNjREQCeM0f3 PX1RuWjXfc+Fk066RPXR9tk= =pvNT -----END PGP SIGNATURE----- --------------enig00744A335C05FEADDA13CF39-- From owner-freebsd-performance@FreeBSD.ORG Wed Feb 11 15:38:29 2009 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 156C8106564A for ; Wed, 11 Feb 2009 15:38:29 +0000 (UTC) (envelope-from Bradley.Radjoo@is.co.za) Received: from phobytor.is.co.za (phobytor.is.co.za [196.4.160.171]) by mx1.freebsd.org (Postfix) with ESMTP id F2B3A8FC1C for ; Wed, 11 Feb 2009 15:38:27 +0000 (UTC) (envelope-from Bradley.Radjoo@is.co.za) Received: from phobytor.is.co.za (localhost [127.0.0.1]) by phobytor.is.co.za (Postfix) with ESMTP id CA56D3BC405 for ; Wed, 11 Feb 2009 17:18:24 +0200 (SAST) Received: from ZABRYSVISMFW (zajnbisit.mfw.is.co.za [196.26.2.106]) by phobytor.is.co.za (Postfix) with ESMTP id 993023BC3FD for ; Wed, 11 Feb 2009 17:18:24 +0200 (SAST) Received: from zabrysvisex06.af.didata.local (Not Verified[10.1.8.16]) by ZABRYSVISMFW with MailMarshal (v6, 1, 8, 2172) id ; Wed, 11 Feb 2009 17:16:14 +0200 Received: from ZABRYSVISEX04.af.didata.local ([10.1.8.149]) by zabrysvisex06.af.didata.local with Microsoft SMTPSVC(6.0.3790.3959); Wed, 11 Feb 2009 17:18:23 +0200 X-MimeOLE: Produced By Microsoft Exchange V6.5 Content-class: urn:content-classes:message MIME-Version: 1.0 Date: Wed, 11 Feb 2009 17:18:17 +0200 Message-ID: <89D2AE9E4EAAB34FABDBF2913867C62F1CB4B133@ZABRYSVISEX04.af.didata.local> X-MS-Has-Attach: X-MS-TNEF-Correlator: Thread-Topic: Extremely slow write speeds to disk : FreeBSD 7.1 and Dell SAS 6/iR Adapter Thread-Index: AcmMW/daWeB+B54uTzugRKhDs/7cEA== From: "Bradley Radjoo" To: X-OriginalArrivalTime: 11 Feb 2009 15:18:23.0169 (UTC) FILETIME=[FAA35310:01C98C5B] X-Virus-Scanned: ClamAV using ClamSMTP Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Subject: Extremely slow write speeds to disk : FreeBSD 7.1 and Dell SAS 6/iR Adapter X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Feb 2009 15:38:29 -0000 Greetings, Please can you assist. I have attempted most of the popular BSD Variants such as NetBSD, Open BSD, FreeBSD... The only distrubution that seems to work on the is Dell SAS 6/iR Adapter is FreeBSD 7.1 Firmware version & date : 9/29/2008 00.25.47.00 But the issue is that writing to disk is extremely slow...i.e. 14Mb per second.... If I install any other linux distribution, like CentOS, write speek is the way it should be..it averages around 190Mb+ per second I was hoping if it were at all possible for you to assist me in with a later RAID Controller Driver for the SAS 6/iR Adapter This is on a Dell PowerEdge R300 Server.=20 BIOS Version 1.3.0 Running Raid 1 (ext3) NOTE :=20 - Disabling ACPI does not make a difference - I do have the latest Firmware across the hardware Kind Regards, Bradley Please note: This email and its content are subject to the disclaimer as = displayed at the following link http://www.is.co.za/legal/E-mail+Confiden= tiality+Notice+and+Disclaimer.htm. Should you not have Web access, send a= =20mail to disclaimers@is.co.za and a copy will be emailed to you. From owner-freebsd-performance@FreeBSD.ORG Wed Feb 11 18:23:09 2009 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 44B6A106566B for ; Wed, 11 Feb 2009 18:23:09 +0000 (UTC) (envelope-from mui@mui.fi) Received: from smtp-68.nebula.fi (smtp-68.nebula.fi [83.145.220.68]) by mx1.freebsd.org (Postfix) with ESMTP id F155F8FC14 for ; Wed, 11 Feb 2009 18:23:08 +0000 (UTC) (envelope-from mui@mui.fi) Received: from muiPC (mui.adm.nblnetworks.fi [83.145.192.227]) by smtp-68.nebula.fi (Postfix) with ESMTP id 6569232B0160; Wed, 11 Feb 2009 20:07:56 +0200 (EET) From: "Markus Kovero" To: "'Bradley Radjoo'" , References: <89D2AE9E4EAAB34FABDBF2913867C62F1CB4B133@ZABRYSVISEX04.af.didata.local> In-Reply-To: <89D2AE9E4EAAB34FABDBF2913867C62F1CB4B133@ZABRYSVISEX04.af.didata.local> Date: Wed, 11 Feb 2009 20:07:56 +0200 Message-ID: <153301c98c73$aa948e80$ffbdab80$@fi> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Mailer: Microsoft Office Outlook 12.0 Thread-Index: AcmMW/daWeB+B54uTzugRKhDs/7cEAAF5Atg Content-Language: fi X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=unavailable version=3.2.4 X-Spam-Checker-Version: SpamAssassin 3.2.4 (2008-01-01) on smtp-68.nebula.fi X-Mailman-Approved-At: Wed, 11 Feb 2009 18:30:37 +0000 Cc: Subject: RE: Extremely slow write speeds to disk : FreeBSD 7.1 and Dell SAS 6/iR Adapter X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Feb 2009 18:23:09 -0000 Hi, have you tried difference between UP and SMP kernels, years ago there were serious performance hit with SMP-kernel and adaptec/dell perc Yours Markus Kovero -----Original Message----- From: owner-freebsd-performance@freebsd.org [mailto:owner-freebsd-performance@freebsd.org] On Behalf Of Bradley Radjoo Sent: 11. helmikuuta 2009 17:18 To: freebsd-performance@freebsd.org Subject: Extremely slow write speeds to disk : FreeBSD 7.1 and Dell SAS 6/iR Adapter Greetings, Please can you assist. I have attempted most of the popular BSD Variants such as NetBSD, Open BSD, FreeBSD... The only distrubution that seems to work on the is Dell SAS 6/iR Adapter is FreeBSD 7.1 Firmware version & date : 9/29/2008 00.25.47.00 But the issue is that writing to disk is extremely slow...i.e. 14Mb per second.... If I install any other linux distribution, like CentOS, write speek is the way it should be..it averages around 190Mb+ per second I was hoping if it were at all possible for you to assist me in with a later RAID Controller Driver for the SAS 6/iR Adapter This is on a Dell PowerEdge R300 Server. BIOS Version 1.3.0 Running Raid 1 (ext3) NOTE : - Disabling ACPI does not make a difference - I do have the latest Firmware across the hardware Kind Regards, Bradley Please note: This email and its content are subject to the disclaimer as displayed at the following link http://www.is.co.za/legal/E-mail+Confidentiality+Notice+and+Disclaimer.htm. Should you not have Web access, send a mail to disclaimers@is.co.za and a copy will be emailed to you. _______________________________________________ freebsd-performance@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-performance To unsubscribe, send any mail to "freebsd-performance-unsubscribe@freebsd.org" From owner-freebsd-performance@FreeBSD.ORG Wed Feb 11 19:33:29 2009 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id DFB0A1065672 for ; Wed, 11 Feb 2009 19:33:29 +0000 (UTC) (envelope-from ivoras@gmail.com) Received: from yw-out-2324.google.com (yw-out-2324.google.com [74.125.46.29]) by mx1.freebsd.org (Postfix) with ESMTP id 951A38FC1A for ; Wed, 11 Feb 2009 19:33:29 +0000 (UTC) (envelope-from ivoras@gmail.com) Received: by yw-out-2324.google.com with SMTP id 2so215111ywt.13 for ; Wed, 11 Feb 2009 11:33:29 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:sender:received:in-reply-to :references:date:x-google-sender-auth:message-id:subject:from:to:cc :content-type:content-transfer-encoding; bh=Ql9SFdS+eRPTvVdLKhM+D/CNHBwOmgWG1Bu92el2roE=; b=VO6TR032AEV61CLe5vcwi/lzqt75tgCusT8UWPci0ZJN/sjpYtH9Qhl4v1ABuH7ux2 X+G8AUHZg+ztadNk94V3M1eLMZcOrN6uLbvHc5EfYGV049qqlPr1JUl8h5ucMPD/Ycsj ne0cERzIKdcD4yvmCkKqpmBV0bol7IjBvkTqQ= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:cc:content-type :content-transfer-encoding; b=PglEH2fherK4iWho+83gIvkco1pMuRcyo6crsLX/Renf8+58glgQPuneOWWXqy8nMq ZAIcDEDVMK3o32piqKnJuBn7/PL+ziSkVKlhkAHtcx0tQ5iqQ5a6FSs6aXoGUi5fzT6U BJY1lo7G07EgpUmUqukWLNXhmpugJv+vlon+U= MIME-Version: 1.0 Sender: ivoras@gmail.com Received: by 10.142.214.5 with SMTP id m5mr2375851wfg.266.1234378965332; Wed, 11 Feb 2009 11:02:45 -0800 (PST) In-Reply-To: <49927151.2030100@mawer.org> References: <499165F3.6050803@sebster.com> <49918DA6.4020608@sebster.com> <49918E0A.1060500@sebster.com> <49927151.2030100@mawer.org> Date: Wed, 11 Feb 2009 20:02:45 +0100 X-Google-Sender-Auth: 419056312391f1fa Message-ID: <9bbcef730902111102j5ef13491md4aa887de83e55f4@mail.gmail.com> From: Ivan Voras To: Antony Mawer Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Cc: freebsd-performance@freebsd.org Subject: Re: FreeBSD 7.1 disk performance issue on ESXi 3.5 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Feb 2009 19:33:30 -0000 2009/2/11 Antony Mawer : > How would one go about gathering data on such a scenario to help improve > this? We were planning a project involving VMware deployments with FreeBSD > 7.1 systems in the near future, but if performance is that bad it is likely > to be a show stopper. I have now tested it under ESXi 3.5, and here's what I find: In FreeBSD 7.1 amd64, 4 vCPUs performance for dbench is : 1 proc : 155 MB/s, 2 proc: 175 MB/s, 4 proc: 188 MB/s The same performance *as reported by VMWare's Infrastructure Client* ("performance" tab): around 50 MB/s in all cases Visual inspection of drives' LED indicators (2 drive 10k RPM RAID0 hw array) confirms constant activity. In Ubuntu 8.10 amd64, 4 vCPUs, performance for dbench is : 1 proc: 375 MB/s, 2 proc: 660 MB/s, 4 proc: 1055 MB/s (sic!) The same performance *as reported by VMWare Infrastructure Client*: around 25 MB/s in all cases (sic!) Visual inspection of drives: very sporadic activity The maximum performance expected from this array is around 150 MB/s *at peaks* - there is physically no way it can go above this, so I judge the above measurements bogus. This is all very strange. Someone here is caching more than it should be, and it looks like it's VMWare. It doesn't look as clock skew in the guests since "iostat 1" et al work at about 1sec wallclock time. The "visual inspection" oddity inspired me to do another benchmark: Bonnie++ reports: For FreeBSD: write: 52 MB/s, rewrite: 21 MB/s, read: 45 MB/s For Linux: write: 141 MB/s, rewrite: 55 MB/s, read: 168 MB/s VMWare's Infrastructure Client agrees with these performance measurements in both cases, and drives are blinking as expected. As previously demonstrated by me and others, Linux usually has significantly better file system performance in the non-virtualized case, so the difference could be simply increased by the virtualization. From owner-freebsd-performance@FreeBSD.ORG Thu Feb 12 11:57:16 2009 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 461AF1065676 for ; Thu, 12 Feb 2009 11:57:16 +0000 (UTC) (envelope-from richardtector@thekeelecentre.com) Received: from mx0.thekeelecentre.com (mx0.thekeelecentre.com [IPv6:2001:470:1f09:16f:2::3]) by mx1.freebsd.org (Postfix) with ESMTP id F2E428FC18 for ; Thu, 12 Feb 2009 11:57:15 +0000 (UTC) (envelope-from richardtector@thekeelecentre.com) Received: from localhost (filter.mx0.thekeelecentre.com [217.206.238.165]) by mx0.thekeelecentre.com (Postfix) with ESMTP id F3CD64515D; Thu, 12 Feb 2009 11:57:14 +0000 (GMT) X-Virus-Scanned: amavisd-new at thekeelecentre.com Received: from mx0.thekeelecentre.com ([217.206.238.167]) by localhost (filter.mx0.thekeelecentre.com [217.206.238.165]) (amavisd-new, port 10024) with ESMTP id V+pzzjrm-Tk9; Thu, 12 Feb 2009 11:57:12 +0000 (UTC) Received: from [10.0.2.50] (daffy.tector.org.uk [82.71.32.9]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mx0.thekeelecentre.com (Postfix) with ESMTPSA id 5060F45142; Thu, 12 Feb 2009 11:57:11 +0000 (GMT) Message-ID: <49940E8E.1080107@thekeelecentre.com> Date: Thu, 12 Feb 2009 11:57:02 +0000 From: Richard Tector User-Agent: Thunderbird 2.0.0.19 (Windows/20081209) MIME-Version: 1.0 To: Bradley Radjoo References: <89D2AE9E4EAAB34FABDBF2913867C62F1CB4B133@ZABRYSVISEX04.af.didata.local> In-Reply-To: <89D2AE9E4EAAB34FABDBF2913867C62F1CB4B133@ZABRYSVISEX04.af.didata.local> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-performance@freebsd.org Subject: Re: Extremely slow write speeds to disk : FreeBSD 7.1 and Dell SAS 6/iR Adapter X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 12 Feb 2009 11:57:16 -0000 Bradley Radjoo wrote: > Greetings, > > Please can you assist. > > I have attempted most of the popular BSD Variants such as NetBSD, Open > BSD, FreeBSD... > The only distrubution that seems to work on the is Dell SAS 6/iR Adapter > is FreeBSD 7.1 > Firmware version & date : 9/29/2008 00.25.47.00 > > But the issue is that writing to disk is extremely slow...i.e. 14Mb per > second.... > > If I install any other linux distribution, like CentOS, write speek is > the way it should be..it averages around 190Mb+ per second > > I was hoping if it were at all possible for you to assist me in with a > later RAID Controller Driver for the SAS 6/iR Adapter Try: hw.mpt.enable_sata_wc=1 in /boot/loader.conf and reboot. Assuming you are using SATA drives, the write cache is disabled by default. This reenables it. The mpt manpage holds more information. Regards, Richard From owner-freebsd-performance@FreeBSD.ORG Thu Feb 12 14:43:22 2009 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 7F9161065677 for ; Thu, 12 Feb 2009 14:43:22 +0000 (UTC) (envelope-from Bradley.Radjoo@is.co.za) Received: from phobytor.is.co.za (phobytor.is.co.za [196.4.160.171]) by mx1.freebsd.org (Postfix) with ESMTP id 0DC6C8FC15 for ; Thu, 12 Feb 2009 14:43:21 +0000 (UTC) (envelope-from Bradley.Radjoo@is.co.za) Received: from phobytor.is.co.za (localhost [127.0.0.1]) by phobytor.is.co.za (Postfix) with ESMTP id 6B84A3BC70A for ; Thu, 12 Feb 2009 16:43:20 +0200 (SAST) Received: from ZABRYSVISMFW (zajnbisit.mfw.is.co.za [196.26.2.106]) by phobytor.is.co.za (Postfix) with ESMTP id 3A2023BC700 for ; Thu, 12 Feb 2009 16:43:20 +0200 (SAST) Received: from zabrysvisex06.af.didata.local (Not Verified[10.1.8.16]) by ZABRYSVISMFW with MailMarshal (v6, 1, 8, 2172) id ; Thu, 12 Feb 2009 16:41:09 +0200 Received: from ZABRYSVISEX04.af.didata.local ([10.1.8.149]) by zabrysvisex06.af.didata.local with Microsoft SMTPSVC(6.0.3790.3959); Thu, 12 Feb 2009 16:43:20 +0200 X-MimeOLE: Produced By Microsoft Exchange V6.5 Content-class: urn:content-classes:message MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Date: Thu, 12 Feb 2009 16:43:15 +0200 Message-ID: <89D2AE9E4EAAB34FABDBF2913867C62F1CBB66F5@ZABRYSVISEX04.af.didata.local> X-MS-Has-Attach: X-MS-TNEF-Correlator: Thread-Topic: Extremely slow write speeds to disk : FreeBSD 7.1 and Dell SAS 6/iR Adapter Thread-Index: AcmNCQ9AXXxMaQxsTUGwG66FANBUPQAFravw References: <89D2AE9E4EAAB34FABDBF2913867C62F1CB4B133@ZABRYSVISEX04.af.didata.local> <49940E8E.1080107@thekeelecentre.com> From: "Bradley Radjoo" To: X-OriginalArrivalTime: 12 Feb 2009 14:43:20.0271 (UTC) FILETIME=[3FA04DF0:01C98D20] X-Virus-Scanned: ClamAV using ClamSMTP Subject: RE: Extremely slow write speeds to disk : FreeBSD 7.1 and Dell SAS 6/iR Adapter X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 12 Feb 2009 14:43:23 -0000 Thanks very much Richard, (They are 2 X 73Gig Ultra 320 scsi SAS drives) BUT seems that even with the UP kernel, I still get issues.. This is what I see in dmesg : mpt0: port 0xec00-0xecff mem 0xdfcec000-0xdfceffff,0xdfcf0000-0xdfcfffff irq 15 at device 0.0 on pci5 mpt0: [ITHREAD] mpt0: MPI Version=3D1.5.18.0 mpt0: mpt_wait_req(6) timed out mpt0: port 0 enable timed out mpt0: failed to enable port 0 mpt0: unable to initialize IOC da0 at mpt0 bus 0 target 0 lun 0 ses0 at mpt0 bus 0 target 8 lun 0 Please can you assist and advise=20 -----Original Message----- From: Richard Tector [mailto:richardtector@thekeelecentre.com]=20 Sent: 12 February 2009 01:57 PM To: Bradley Radjoo Cc: freebsd-performance@freebsd.org Subject: Re: Extremely slow write speeds to disk : FreeBSD 7.1 and Dell SAS 6/iR Adapter Bradley Radjoo wrote: > Greetings, >=20 > Please can you assist. >=20 > I have attempted most of the popular BSD Variants such as NetBSD, Open > BSD, FreeBSD... > The only distrubution that seems to work on the is Dell SAS 6/iR Adapter > is FreeBSD 7.1 > Firmware version & date : 9/29/2008 00.25.47.00 >=20 > But the issue is that writing to disk is extremely slow...i.e. 14Mb per > second.... >=20 > If I install any other linux distribution, like CentOS, write speek is > the way it should be..it averages around 190Mb+ per second >=20 > I was hoping if it were at all possible for you to assist me in with a > later RAID Controller Driver for the SAS 6/iR Adapter Try: hw.mpt.enable_sata_wc=3D1 in /boot/loader.conf and reboot. Assuming you are using SATA drives, the write cache is disabled by=20 default. This reenables it. The mpt manpage holds more information. Regards, Richard Please note: This email and its content are subject to the disclaimer as = displayed at the following link http://www.is.co.za/legal/E-mail+Confiden= tiality+Notice+and+Disclaimer.htm. Should you not have Web access, send a= =20mail to disclaimers@is.co.za and a copy will be emailed to you. From owner-freebsd-performance@FreeBSD.ORG Thu Feb 12 15:18:09 2009 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 63186106564A for ; Thu, 12 Feb 2009 15:18:09 +0000 (UTC) (envelope-from ohartman@zedat.fu-berlin.de) Received: from outpost1.zedat.fu-berlin.de (outpost1.zedat.fu-berlin.de [130.133.4.66]) by mx1.freebsd.org (Postfix) with ESMTP id E19048FC19 for ; Thu, 12 Feb 2009 15:18:08 +0000 (UTC) (envelope-from ohartman@zedat.fu-berlin.de) Received: from inpost2.zedat.fu-berlin.de ([130.133.4.69]) by outpost1.zedat.fu-berlin.de (Exim 4.69) with esmtp (envelope-from ) id <1LXd5b-0003SK-MG>; Thu, 12 Feb 2009 16:02:55 +0100 Received: from telesto.geoinf.fu-berlin.de ([130.133.86.198]) by inpost2.zedat.fu-berlin.de (Exim 4.69) with esmtpsa (envelope-from ) id <1LXd5b-00054z-Jf>; Thu, 12 Feb 2009 16:02:55 +0100 Message-ID: <499439A8.1080208@zedat.fu-berlin.de> Date: Thu, 12 Feb 2009 15:00:56 +0000 From: "O. Hartmann" Organization: Freie =?ISO-8859-15?Q?Universit=E4t_Berlin?= User-Agent: Thunderbird 2.0.0.19 (X11/20090209) MIME-Version: 1.0 To: Bradley Radjoo References: <89D2AE9E4EAAB34FABDBF2913867C62F1CB4B133@ZABRYSVISEX04.af.didata.local> <49940E8E.1080107@thekeelecentre.com> <89D2AE9E4EAAB34FABDBF2913867C62F1CBB66F5@ZABRYSVISEX04.af.didata.local> In-Reply-To: <89D2AE9E4EAAB34FABDBF2913867C62F1CBB66F5@ZABRYSVISEX04.af.didata.local> Content-Type: text/plain; charset=ISO-8859-15; format=flowed Content-Transfer-Encoding: 7bit X-Originating-IP: 130.133.86.198 Cc: freebsd-performance@freebsd.org Subject: Re: Extremely slow write speeds to disk : FreeBSD 7.1 and Dell SAS 6/iR Adapter X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 12 Feb 2009 15:18:09 -0000 Bradley Radjoo wrote: > Thanks very much Richard, > (They are 2 X 73Gig Ultra 320 scsi SAS drives) > > BUT seems that even with the UP kernel, I still get issues.. > This is what I see in dmesg : > > mpt0: port 0xec00-0xecff mem > 0xdfcec000-0xdfceffff,0xdfcf0000-0xdfcfffff irq 15 at device 0.0 on pci5 > mpt0: [ITHREAD] > mpt0: MPI Version=1.5.18.0 > mpt0: mpt_wait_req(6) timed out > mpt0: port 0 enable timed out > mpt0: failed to enable port 0 > mpt0: unable to initialize IOC > da0 at mpt0 bus 0 target 0 lun 0 > ses0 at mpt0 bus 0 target 8 lun 0 > > Please can you assist and advise > > -----Original Message----- > From: Richard Tector [mailto:richardtector@thekeelecentre.com] > Sent: 12 February 2009 01:57 PM > To: Bradley Radjoo > Cc: freebsd-performance@freebsd.org > Subject: Re: Extremely slow write speeds to disk : FreeBSD 7.1 and Dell > SAS 6/iR Adapter > > Bradley Radjoo wrote: >> Greetings, >> >> Please can you assist. >> >> I have attempted most of the popular BSD Variants such as NetBSD, Open >> BSD, FreeBSD... >> The only distrubution that seems to work on the is Dell SAS 6/iR > Adapter >> is FreeBSD 7.1 >> Firmware version & date : 9/29/2008 00.25.47.00 >> >> But the issue is that writing to disk is extremely slow...i.e. 14Mb > per >> second.... >> >> If I install any other linux distribution, like CentOS, write speek is >> the way it should be..it averages around 190Mb+ per second >> >> I was hoping if it were at all possible for you to assist me in with a >> later RAID Controller Driver for the SAS 6/iR Adapter > > Try: > hw.mpt.enable_sata_wc=1 > in /boot/loader.conf and reboot. > > Assuming you are using SATA drives, the write cache is disabled by > default. This reenables it. The mpt manpage holds more information. > > Regards, > > Richard > Please note: This email and its content are subject to the disclaimer as displayed at the following link http://www.is.co.za/legal/E-mail+Confidentiality+Notice+and+Disclaimer.htm. Should you not have Web access, send a mail to disclaimers@is.co.za and a copy will be emailed to you. > _______________________________________________ > freebsd-performance@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-performance > To unsubscribe, send any mail to "freebsd-performance-unsubscribe@freebsd.org" We're using a Dell 1950-III Poweredge server with two XEON 4-Core-CPUs and at the momen one 750GB SATA drive. This box suffers from incredible slow drive access speeds - approximately a half of what I see on other boxes around. When I read this posting I was quite happy having found a possible solution, but I can't find the above mentioned OID, FreeBSD 8.0-CURRENT/amd64 (running on this box) shows only "hw.ata.wc: 1" as a relevant OID. No hw.mpt.XXX OIDs anywere. This is the part from DMESG reflecting MPT: mpt0: port 0xec00-0xecff mem 0xfc4fc000-0xfc4fffff,0xfc4e0000-0xfc4effff irq 16 at device 0.0 on pci1 mpt0: [ITHREAD] mpt0: MPI Version=1.5.14.0 mpt0: Capabilities: ( RAID-0 RAID-1E RAID-1 ) mpt0: 0 Active Volumes (2 Max) mpt0: 0 Hidden Drive Members (14 Max) I can not tell you, at this very moment, what configuration has been done in the BIOS. The SATA HD is recognized as da0: da0 at mpt0 bus 0 target 0 lun 0 da0: Fixed Direct Access SCSI-5 device da0: 300.000MB/s transfers da0: Command Queueing Enabled da0: 715404MB (1465149168 512 byte sectors: 255H 63S/T 91201C) Maybe someon can followup on this if there is some kind of issue ... Thanks in advance, Oliver From owner-freebsd-performance@FreeBSD.ORG Thu Feb 12 18:04:50 2009 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 1DEF2106564A for ; Thu, 12 Feb 2009 18:04:50 +0000 (UTC) (envelope-from richardtector@thekeelecentre.com) Received: from mx0.thekeelecentre.com (mx0.thekeelecentre.com [IPv6:2001:470:1f09:16f:2::3]) by mx1.freebsd.org (Postfix) with ESMTP id CA3568FC08 for ; Thu, 12 Feb 2009 18:04:49 +0000 (UTC) (envelope-from richardtector@thekeelecentre.com) Received: from localhost (filter.mx0.thekeelecentre.com [217.206.238.165]) by mx0.thekeelecentre.com (Postfix) with ESMTP id 1FA3445142; Thu, 12 Feb 2009 18:04:49 +0000 (GMT) X-Virus-Scanned: amavisd-new at thekeelecentre.com Received: from mx0.thekeelecentre.com ([217.206.238.167]) by localhost (filter.mx0.thekeelecentre.com [217.206.238.165]) (amavisd-new, port 10024) with ESMTP id 5tZJklj2c+Qx; Thu, 12 Feb 2009 18:04:47 +0000 (UTC) Received: from [10.0.2.50] (daffy.tector.org.uk [82.71.32.9]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mx0.thekeelecentre.com (Postfix) with ESMTPSA id DF9AD45025; Thu, 12 Feb 2009 18:04:45 +0000 (GMT) Message-ID: <499464B5.3090001@thekeelecentre.com> Date: Thu, 12 Feb 2009 18:04:37 +0000 From: Richard Tector User-Agent: Thunderbird 2.0.0.19 (Windows/20081209) MIME-Version: 1.0 To: "O. Hartmann" References: <89D2AE9E4EAAB34FABDBF2913867C62F1CB4B133@ZABRYSVISEX04.af.didata.local> <49940E8E.1080107@thekeelecentre.com> <89D2AE9E4EAAB34FABDBF2913867C62F1CBB66F5@ZABRYSVISEX04.af.didata.local> <499439A8.1080208@zedat.fu-berlin.de> In-Reply-To: <499439A8.1080208@zedat.fu-berlin.de> Content-Type: text/plain; charset=ISO-8859-15; format=flowed Content-Transfer-Encoding: 7bit Cc: Bradley Radjoo , freebsd-performance@freebsd.org Subject: Re: Extremely slow write speeds to disk : FreeBSD 7.1 and Dell SAS 6/iR Adapter X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 12 Feb 2009 18:04:50 -0000 O. Hartmann wrote: > When I read this posting I was quite happy having found a possible > solution, but I can't find the above mentioned OID, FreeBSD > 8.0-CURRENT/amd64 (running on this box) shows only "hw.ata.wc: 1" as > a relevant OID. No hw.mpt.XXX OIDs anywere. This is the part from DMESG > reflecting MPT: > It's a driver tunable, not a sysctl. Richard From owner-freebsd-performance@FreeBSD.ORG Thu Feb 12 18:05:40 2009 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id CACE810656E4 for ; Thu, 12 Feb 2009 18:05:40 +0000 (UTC) (envelope-from richardtector@thekeelecentre.com) Received: from mx0.thekeelecentre.com (mx0.thekeelecentre.com [IPv6:2001:470:1f09:16f:2::3]) by mx1.freebsd.org (Postfix) with ESMTP id 822168FC29 for ; Thu, 12 Feb 2009 18:05:40 +0000 (UTC) (envelope-from richardtector@thekeelecentre.com) Received: from localhost (filter.mx0.thekeelecentre.com [217.206.238.165]) by mx0.thekeelecentre.com (Postfix) with ESMTP id D8B4545025; Thu, 12 Feb 2009 18:05:39 +0000 (GMT) X-Virus-Scanned: amavisd-new at thekeelecentre.com Received: from mx0.thekeelecentre.com ([217.206.238.167]) by localhost (filter.mx0.thekeelecentre.com [217.206.238.165]) (amavisd-new, port 10024) with ESMTP id 38ZMMlF8vDIG; Thu, 12 Feb 2009 18:05:37 +0000 (UTC) Received: from [10.0.2.50] (daffy.tector.org.uk [82.71.32.9]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mx0.thekeelecentre.com (Postfix) with ESMTPSA id B30C845142; Thu, 12 Feb 2009 18:05:37 +0000 (GMT) Message-ID: <499464E9.6060309@thekeelecentre.com> Date: Thu, 12 Feb 2009 18:05:29 +0000 From: Richard Tector User-Agent: Thunderbird 2.0.0.19 (Windows/20081209) MIME-Version: 1.0 To: Bradley Radjoo References: <89D2AE9E4EAAB34FABDBF2913867C62F1CB4B133@ZABRYSVISEX04.af.didata.local> <49940E8E.1080107@thekeelecentre.com> <89D2AE9E4EAAB34FABDBF2913867C62F1CBB66F5@ZABRYSVISEX04.af.didata.local> In-Reply-To: <89D2AE9E4EAAB34FABDBF2913867C62F1CBB66F5@ZABRYSVISEX04.af.didata.local> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-performance@freebsd.org Subject: Re: Extremely slow write speeds to disk : FreeBSD 7.1 and Dell SAS 6/iR Adapter X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 12 Feb 2009 18:05:42 -0000 Bradley Radjoo wrote: > Thanks very much Richard, > (They are 2 X 73Gig Ultra 320 scsi SAS drives) No idea then, sorry. But I do have 3 R200's which also use the SAS6 controller due to arrive tomorrow, so I'll see what results I get. Richard From owner-freebsd-performance@FreeBSD.ORG Fri Feb 13 07:32:03 2009 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 0BAE21065674 for ; Fri, 13 Feb 2009 07:32:03 +0000 (UTC) (envelope-from Bradley.Radjoo@is.co.za) Received: from phobytor.is.co.za (phobytor.is.co.za [196.4.160.171]) by mx1.freebsd.org (Postfix) with ESMTP id 8F6928FC14 for ; Fri, 13 Feb 2009 07:32:01 +0000 (UTC) (envelope-from Bradley.Radjoo@is.co.za) Received: from phobytor.is.co.za (localhost [127.0.0.1]) by phobytor.is.co.za (Postfix) with ESMTP id 0BABC3BC192; Fri, 13 Feb 2009 09:32:00 +0200 (SAST) Received: from ZABRYSVISMFW (zajnbisit.mfw.is.co.za [196.26.2.106]) by phobytor.is.co.za (Postfix) with ESMTP id CE5003BC121; Fri, 13 Feb 2009 09:31:59 +0200 (SAST) Received: from zabrysvisex06.af.didata.local (Not Verified[10.1.8.16]) by ZABRYSVISMFW with MailMarshal (v6, 1, 8, 2172) id ; Fri, 13 Feb 2009 09:29:48 +0200 Received: from ZABRYSVISEX04.af.didata.local ([10.1.8.149]) by zabrysvisex06.af.didata.local with Microsoft SMTPSVC(6.0.3790.3959); Fri, 13 Feb 2009 09:31:59 +0200 X-MimeOLE: Produced By Microsoft Exchange V6.5 Content-class: urn:content-classes:message MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Date: Fri, 13 Feb 2009 09:31:55 +0200 Message-ID: <89D2AE9E4EAAB34FABDBF2913867C62F1CC159F8@ZABRYSVISEX04.af.didata.local> X-MS-Has-Attach: X-MS-TNEF-Correlator: Thread-Topic: Extremely slow write speeds to disk : FreeBSD 7.1 and Dell SAS 6/iR Adapter thread-index: AcmNPISVQI42Ez0mTuqd5VH8ZkVQswAcHLrA References: <89D2AE9E4EAAB34FABDBF2913867C62F1CB4B133@ZABRYSVISEX04.af.didata.local> <49940E8E.1080107@thekeelecentre.com> <89D2AE9E4EAAB34FABDBF2913867C62F1CBB66F5@ZABRYSVISEX04.af.didata.local> <499464E9.6060309@thekeelecentre.com> From: "Bradley Radjoo" To: "Richard Tector" X-OriginalArrivalTime: 13 Feb 2009 07:31:59.0885 (UTC) FILETIME=[28208BD0:01C98DAD] X-Virus-Scanned: ClamAV using ClamSMTP Cc: freebsd-performance@freebsd.org Subject: RE: Extremely slow write speeds to disk : FreeBSD 7.1 and Dell SAS 6/iR Adapter X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 13 Feb 2009 07:32:03 -0000 Indeed, driver tunable ;-) All the best Richard, would like to know it goes Bradley=20 -----Original Message----- From: Richard Tector [mailto:richardtector@thekeelecentre.com]=20 Sent: 12 February 2009 08:05 PM To: Bradley Radjoo Cc: freebsd-performance@freebsd.org Subject: Re: Extremely slow write speeds to disk : FreeBSD 7.1 and Dell SAS 6/iR Adapter Bradley Radjoo wrote: > Thanks very much Richard, > (They are 2 X 73Gig Ultra 320 scsi SAS drives) No idea then, sorry. But I do have 3 R200's which also use the SAS6=20 controller due to arrive tomorrow, so I'll see what results I get. Richard Please note: This email and its content are subject to the disclaimer as = displayed at the following link http://www.is.co.za/legal/E-mail+Confiden= tiality+Notice+and+Disclaimer.htm. Should you not have Web access, send a= =20mail to disclaimers@is.co.za and a copy will be emailed to you. From owner-freebsd-performance@FreeBSD.ORG Fri Feb 13 19:46:13 2009 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 3ECEC106566B; Fri, 13 Feb 2009 19:46:13 +0000 (UTC) (envelope-from josh@tcbug.org) Received: from out5.smtp.messagingengine.com (out5.smtp.messagingengine.com [66.111.4.29]) by mx1.freebsd.org (Postfix) with ESMTP id 102468FC0A; Fri, 13 Feb 2009 19:46:12 +0000 (UTC) (envelope-from josh@tcbug.org) Received: from compute1.internal (compute1.internal [10.202.2.41]) by out1.messagingengine.com (Postfix) with ESMTP id ECC12293807; Fri, 13 Feb 2009 14:27:21 -0500 (EST) Received: from heartbeat2.messagingengine.com ([10.202.2.161]) by compute1.internal (MEProxy); Fri, 13 Feb 2009 14:27:21 -0500 X-Sasl-enc: UwXD5XHwPtmJk+ss0/I7Q3kYNxk+0scgInnWxpYK3F0O 1234553241 Received: from [10.0.1.199] (c-66-41-132-190.hsd1.mn.comcast.net [66.41.132.190]) by mail.messagingengine.com (Postfix) with ESMTPSA id 8765A24811; Fri, 13 Feb 2009 14:27:21 -0500 (EST) Message-Id: <666B517C-6E30-465D-8BAD-B6266C4D3743@tcbug.org> From: Josh Paetzel To: Ivan Voras In-Reply-To: <9bbcef730902111102j5ef13491md4aa887de83e55f4@mail.gmail.com> Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v930.3) Date: Fri, 13 Feb 2009 13:27:20 -0600 References: <499165F3.6050803@sebster.com> <49918DA6.4020608@sebster.com> <49918E0A.1060500@sebster.com> <49927151.2030100@mawer.org> <9bbcef730902111102j5ef13491md4aa887de83e55f4@mail.gmail.com> X-Mailer: Apple Mail (2.930.3) Cc: freebsd-performance@freebsd.org, Antony Mawer Subject: Re: FreeBSD 7.1 disk performance issue on ESXi 3.5 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 13 Feb 2009 19:46:13 -0000 On Feb 11, 2009, at 1:02 PM, Ivan Voras wrote: > > > As previously demonstrated by me and others, Linux usually has > significantly better file system performance in the non-virtualized > case, so the difference could be simply increased by the > virtualization. In my limited experience with VMWare linux seems to have near bare metal disk performance. FreeBSD seems to incur a significant performance penalty. For instance on my laptop, running OSX and VMWare Fusion, FreeBSd virtual machines can't saturate 100TX off the disk, raw dd manages about 7 Megs/sec, which is in line with what I get shovelling big files around. Disk is a 7200 RPM SATA2. Thanks, Josh Paetzel From owner-freebsd-performance@FreeBSD.ORG Fri Feb 13 20:01:23 2009 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 451BB106566B for ; Fri, 13 Feb 2009 20:01:23 +0000 (UTC) (envelope-from ivoras@gmail.com) Received: from fg-out-2122.google.com (fg-out-2122.google.com [72.14.220.26]) by mx1.freebsd.org (Postfix) with ESMTP id D069D8FC17 for ; Fri, 13 Feb 2009 20:01:22 +0000 (UTC) (envelope-from ivoras@gmail.com) Received: by fg-out-2122.google.com with SMTP id 23so76051fge.35 for ; Fri, 13 Feb 2009 12:01:21 -0800 (PST) MIME-Version: 1.0 In-Reply-To: <666B517C-6E30-465D-8BAD-B6266C4D3743@tcbug.org> Received: by 10.86.100.19 with SMTP id x19mr56395fgb.3.1234555281758; Fri, 13 Feb 2009 12:01:21 -0800 (PST) Message-ID: <000e0cd28750065bb80462d24d55@google.com> Date: Fri, 13 Feb 2009 20:01:21 +0000 From: ivoras@gmail.com To: Josh Paetzel , Ivan Voras , Antony Mawer , freebsd-performance@freebsd.org X-Mailman-Approved-At: Fri, 13 Feb 2009 20:42:03 +0000 Content-Type: text/plain; charset=ISO-8859-1; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: Subject: Re: Re: FreeBSD 7.1 disk performance issue on ESXi 3.5 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 13 Feb 2009 20:01:23 -0000 On Feb 13, 2009 8:27pm, Josh Paetzel wrote: > In my limited experience with VMWare linux seems to have near bare metal disk performance. FreeBSD seems to incur a significant performance penalty. For instance on my laptop, running OSX and VMWare Fusion, FreeBSd virtual machines can't saturate 100TX off the disk, raw dd manages about 7 Megs/sec, which is in line with what I get shovelling big files around. Disk is a 7200 RPM SATA2. > You might want to try the patch Scott Long made recently (http://svn.freebsd.org/changeset/base/188570) - I found it doubles the performance in some cases for VMWare (writing mostly, though sequential reading can be similarly improved by the combination of this patch and increasing vfs.read_max), but it's still worse than with Linux (100 MB/s vs 150 MB/s). As for the original thread topic: I've communicated with the OP and it appears his method of benchmarking had an error so the problems that appear in his post are bogus. From owner-freebsd-performance@FreeBSD.ORG Fri Feb 13 21:59:57 2009 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 1A3621065674 for ; Fri, 13 Feb 2009 21:59:57 +0000 (UTC) (envelope-from sebster@sebster.com) Received: from mail.sebster.com (mail.sebster.com [193.46.80.82]) by mx1.freebsd.org (Postfix) with SMTP id 53A368FC08 for ; Fri, 13 Feb 2009 21:59:55 +0000 (UTC) (envelope-from sebster@sebster.com) Received: (qmail 33797 invoked from network); 13 Feb 2009 21:59:54 -0000 Received: from unknown (HELO ?10.0.1.6?) (sebster@85.147.225.232) by mail.sebster.com with SMTP; 13 Feb 2009 21:59:54 -0000 Message-ID: <4995ED59.2090708@sebster.com> Date: Fri, 13 Feb 2009 22:59:53 +0100 From: Sebastiaan van Erk User-Agent: Thunderbird 2.0.0.19 (X11/20090105) MIME-Version: 1.0 To: freebsd-performance@freebsd.org References: <000e0cd28750065bb80462d24d55@google.com> In-Reply-To: <000e0cd28750065bb80462d24d55@google.com> Content-Type: multipart/signed; protocol="application/x-pkcs7-signature"; micalg=sha1; boundary="------------ms070107030602070806010703" Subject: Re: FreeBSD 7.1 disk performance issue on ESXi 3.5 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 13 Feb 2009 21:59:57 -0000 This is a cryptographically signed message in MIME format. --------------ms070107030602070806010703 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Hi, ivoras@gmail.com wrote: > As for the original thread topic: I've communicated with the OP and it > appears his method of benchmarking had an error so the problems that > appear in his post are bogus. It is not quite true that the "method" is bogus, there just seems to be a huge difference between a soft updates vs non-soft-updates disk. These are the results I get now: dbench -D -t 60 1 on / (ufs, local): Throughput 13.4561 MB/sec 1 procs on /tmp (ufs, local, soft-updates): Throughput 92.299 MB/sec 1 procs However, whether it is caching or not, Linux gets 350 MB/s using 1 process and even 650 MB/s using 2. As I understand it, this shouldn't be possible on the physical disks, but still, the *virtual* disk seems to get this performance. When I benchmark the linux vs the freebsd using Unixbench 4.1/5.1 (I tried both) I also get ***HUGE*** differences: System: test-fbsd.vpn1.sebster.com: FreeBSD ------------------------------------------------------------------------ Benchmark Run: Tue Feb 10 2009 06:25:49 - 06:54:08 2 CPUs in system; running 1 parallel copy of tests System Benchmarks Index Values BASELINE RESULT INDEX Dhrystone 2 using register variables 116700.0 14144383.9 1212.0 Double-Precision Whetstone 55.0 3238.7 588.9 Execl Throughput 43.0 630.0 146.5 File Copy 1024 bufsize 2000 maxblocks 3960.0 28793.2 72.7 File Copy 256 bufsize 500 maxblocks 1655.0 33410.0 201.9 File Copy 4096 bufsize 8000 maxblocks 5800.0 33536.8 57.8 Pipe Throughput 12440.0 1146784.7 921.9 Pipe-based Context Switching 4000.0 36203.6 90.5 Process Creation 126.0 783.3 62.2 Shell Scripts (1 concurrent) 42.4 645.1 152.2 Shell Scripts (8 concurrent) 6.0 115.4 192.3 System Call Overhead 15000.0 939647.5 626.4 ======== System Benchmarks Index Score 212.4 System: test-ubuntu: GNU/Linux ------------------------------------------------------------------------ Benchmark Run: Mon Feb 09 2009 15:15:06 - 15:43:20 2 CPUs in system; running 1 parallel copy of tests System Benchmarks Index Values BASELINE RESULT INDEX Dhrystone 2 using register variables 116700.0 18610575.3 1594.7 Double-Precision Whetstone 55.0 2990.1 543.7 Execl Throughput 43.0 1058.6 246.2 File Copy 1024 bufsize 2000 maxblocks 3960.0 468973.2 1184.3 File Copy 256 bufsize 500 maxblocks 1655.0 132022.2 797.7 File Copy 4096 bufsize 8000 maxblocks 5800.0 921448.5 1588.7 Pipe Throughput 12440.0 1132933.6 910.7 Pipe-based Context Switching 4000.0 93429.0 233.6 Process Creation 126.0 1744.3 138.4 Shell Scripts (1 concurrent) 42.4 2566.9 605.4 Shell Scripts (8 concurrent) 6.0 518.4 864.0 System Call Overhead 15000.0 1935577.0 1290.4 ======== System Benchmarks Index Score 656.1 Here the disk intensive test (file copy) and context switch/process creation test do terrible. For all my personal servers this is not an issue for me at all. But for a big high traffic web site I'm building, I'm afraid I'm going to have to go for Linux. :-( Regards, Sebastiaan > _______________________________________________ > freebsd-performance@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-performance > To unsubscribe, send any mail to > "freebsd-performance-unsubscribe@freebsd.org" --------------ms070107030602070806010703 Content-Type: application/x-pkcs7-signature; name="smime.p7s" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="smime.p7s" Content-Description: S/MIME Cryptographic Signature MIAGCSqGSIb3DQEHAqCAMIACAQExCzAJBgUrDgMCGgUAMIAGCSqGSIb3DQEHAQAAoIIJUTCC AwMwggJsoAMCAQICEFN8DarMNuuKJDEtfs0UaqUwDQYJKoZIhvcNAQEFBQAwYjELMAkGA1UE BhMCWkExJTAjBgNVBAoTHFRoYXd0ZSBDb25zdWx0aW5nIChQdHkpIEx0ZC4xLDAqBgNVBAMT I1RoYXd0ZSBQZXJzb25hbCBGcmVlbWFpbCBJc3N1aW5nIENBMB4XDTA4MDYzMDEzNTE1N1oX DTA5MDYzMDEzNTE1N1owaDEQMA4GA1UEBBMHdmFuIEVyazETMBEGA1UEKhMKU2ViYXN0aWFh bjEbMBkGA1UEAxMSU2ViYXN0aWFhbiB2YW4gRXJrMSIwIAYJKoZIhvcNAQkBFhNzZWJzdGVy QHNlYnN0ZXIuY29tMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAsJDDAeYHVmH/ GVxi+bhFx27dmg++9BdhPJfk8k041sqEqq7oXnR2GT54quY3Ac7A1BuOM2JvoICraGmjud4y b3EanRnqGIK6iH+VAhhTlV/Owrb2Qm1e13DLxwLp1SocSQl4IrEbF9Y5H3ASdIrE0iFqkpju nPiiHeNhz3LaI5ipjiluKYoH+F6gPx8njHoaDxPePCkSLg4r0IA0afLM74LVZxCRBZEfyRZS J6VVUJefKlz91dWSzR/3xSw/rO4u9Ds/Zh7VBUKy3K+YFryHxRpUek0gSepE1b70Q39L9Sqd M/NZqMvFpwrqgW2Zh2Nh8nqRge90maR4ypBzz3GzLwIDAQABozAwLjAeBgNVHREEFzAVgRNz ZWJzdGVyQHNlYnN0ZXIuY29tMAwGA1UdEwEB/wQCMAAwDQYJKoZIhvcNAQEFBQADgYEAS1Sk NMgDVzb0ktO9tPPacV0KdKhTYOHcICVmuDEe2sFHOkjLAI1iAKp640pqJEVqvRnfRcCFJ9hK koPjjVZ+ui2rVmJWBG6FSloLRS/YYED4tUAw6DQhK61UOpjkpQxjCdm+5bHG/2ZgJAda1j0x uiN822+xFkcaW/5PQgxSRxcwggMDMIICbKADAgECAhBTfA2qzDbriiQxLX7NFGqlMA0GCSqG SIb3DQEBBQUAMGIxCzAJBgNVBAYTAlpBMSUwIwYDVQQKExxUaGF3dGUgQ29uc3VsdGluZyAo UHR5KSBMdGQuMSwwKgYDVQQDEyNUaGF3dGUgUGVyc29uYWwgRnJlZW1haWwgSXNzdWluZyBD QTAeFw0wODA2MzAxMzUxNTdaFw0wOTA2MzAxMzUxNTdaMGgxEDAOBgNVBAQTB3ZhbiBFcmsx EzARBgNVBCoTClNlYmFzdGlhYW4xGzAZBgNVBAMTElNlYmFzdGlhYW4gdmFuIEVyazEiMCAG CSqGSIb3DQEJARYTc2Vic3RlckBzZWJzdGVyLmNvbTCCASIwDQYJKoZIhvcNAQEBBQADggEP ADCCAQoCggEBALCQwwHmB1Zh/xlcYvm4Rcdu3ZoPvvQXYTyX5PJNONbKhKqu6F50dhk+eKrm NwHOwNQbjjNib6CAq2hpo7neMm9xGp0Z6hiCuoh/lQIYU5VfzsK29kJtXtdwy8cC6dUqHEkJ eCKxGxfWOR9wEnSKxNIhapKY7pz4oh3jYc9y2iOYqY4pbimKB/heoD8fJ4x6Gg8T3jwpEi4O K9CANGnyzO+C1WcQkQWRH8kWUielVVCXnypc/dXVks0f98UsP6zuLvQ7P2Ye1QVCstyvmBa8 h8UaVHpNIEnqRNW+9EN/S/UqnTPzWajLxacK6oFtmYdjYfJ6kYHvdJmkeMqQc89xsy8CAwEA AaMwMC4wHgYDVR0RBBcwFYETc2Vic3RlckBzZWJzdGVyLmNvbTAMBgNVHRMBAf8EAjAAMA0G CSqGSIb3DQEBBQUAA4GBAEtUpDTIA1c29JLTvbTz2nFdCnSoU2Dh3CAlZrgxHtrBRzpIywCN YgCqeuNKaiRFar0Z30XAhSfYSpKD441Wfrotq1ZiVgRuhUpaC0Uv2GBA+LVAMOg0ISutVDqY 5KUMYwnZvuWxxv9mYCQHWtY9MbojfNtvsRZHGlv+T0IMUkcXMIIDPzCCAqigAwIBAgIBDTAN BgkqhkiG9w0BAQUFADCB0TELMAkGA1UEBhMCWkExFTATBgNVBAgTDFdlc3Rlcm4gQ2FwZTES MBAGA1UEBxMJQ2FwZSBUb3duMRowGAYDVQQKExFUaGF3dGUgQ29uc3VsdGluZzEoMCYGA1UE CxMfQ2VydGlmaWNhdGlvbiBTZXJ2aWNlcyBEaXZpc2lvbjEkMCIGA1UEAxMbVGhhd3RlIFBl cnNvbmFsIEZyZWVtYWlsIENBMSswKQYJKoZIhvcNAQkBFhxwZXJzb25hbC1mcmVlbWFpbEB0 aGF3dGUuY29tMB4XDTAzMDcxNzAwMDAwMFoXDTEzMDcxNjIzNTk1OVowYjELMAkGA1UEBhMC WkExJTAjBgNVBAoTHFRoYXd0ZSBDb25zdWx0aW5nIChQdHkpIEx0ZC4xLDAqBgNVBAMTI1Ro YXd0ZSBQZXJzb25hbCBGcmVlbWFpbCBJc3N1aW5nIENBMIGfMA0GCSqGSIb3DQEBAQUAA4GN ADCBiQKBgQDEpjxVc1X7TrnKmVoeaMB1BHCd3+n/ox7svc31W/Iadr1/DDph8r9RzgHU5VAK MNcCY1osiRVwjt3J8CuFWqo/cVbLrzwLB+fxH5E2JCoTzyvV84J3PQO+K/67GD4Hv0CAAmTX p6a7n2XRxSpUhQ9IBH+nttE8YQRAHmQZcmC3+wIDAQABo4GUMIGRMBIGA1UdEwEB/wQIMAYB Af8CAQAwQwYDVR0fBDwwOjA4oDagNIYyaHR0cDovL2NybC50aGF3dGUuY29tL1RoYXd0ZVBl cnNvbmFsRnJlZW1haWxDQS5jcmwwCwYDVR0PBAQDAgEGMCkGA1UdEQQiMCCkHjAcMRowGAYD VQQDExFQcml2YXRlTGFiZWwyLTEzODANBgkqhkiG9w0BAQUFAAOBgQBIjNFQg+oLLswNo2as Zw9/r6y+whehQ5aUnX9MIbj4Nh+qLZ82L8D0HFAgk3A8/a3hYWLD2ToZfoSxmRsAxRoLgnSe JVCUYsfbJ3FXJY3dqZw5jowgT2Vfldr394fWxghOrvbqNOUQGls1TXfjViF4gtwhGTXeJLHT HUb/XV9lTzGCA3EwggNtAgEBMHYwYjELMAkGA1UEBhMCWkExJTAjBgNVBAoTHFRoYXd0ZSBD b25zdWx0aW5nIChQdHkpIEx0ZC4xLDAqBgNVBAMTI1RoYXd0ZSBQZXJzb25hbCBGcmVlbWFp bCBJc3N1aW5nIENBAhBTfA2qzDbriiQxLX7NFGqlMAkGBSsOAwIaBQCgggHQMBgGCSqGSIb3 DQEJAzELBgkqhkiG9w0BBwEwHAYJKoZIhvcNAQkFMQ8XDTA5MDIxMzIxNTk1M1owIwYJKoZI hvcNAQkEMRYEFADgIqog0UzUI9SlHZnH8a1B5SGTMF8GCSqGSIb3DQEJDzFSMFAwCwYJYIZI AWUDBAECMAoGCCqGSIb3DQMHMA4GCCqGSIb3DQMCAgIAgDANBggqhkiG9w0DAgIBQDAHBgUr DgMCBzANBggqhkiG9w0DAgIBKDCBhQYJKwYBBAGCNxAEMXgwdjBiMQswCQYDVQQGEwJaQTEl MCMGA1UEChMcVGhhd3RlIENvbnN1bHRpbmcgKFB0eSkgTHRkLjEsMCoGA1UEAxMjVGhhd3Rl IFBlcnNvbmFsIEZyZWVtYWlsIElzc3VpbmcgQ0ECEFN8DarMNuuKJDEtfs0UaqUwgYcGCyqG SIb3DQEJEAILMXigdjBiMQswCQYDVQQGEwJaQTElMCMGA1UEChMcVGhhd3RlIENvbnN1bHRp bmcgKFB0eSkgTHRkLjEsMCoGA1UEAxMjVGhhd3RlIFBlcnNvbmFsIEZyZWVtYWlsIElzc3Vp bmcgQ0ECEFN8DarMNuuKJDEtfs0UaqUwDQYJKoZIhvcNAQEBBQAEggEAa3q8YQdVOOa1LlrQ RLMsjfJvBJgDT8ew9u/sG0iBGfd0BucuNYJKfrmG9I+Y0+MFZ1226wPojLqJg1TRqiI21pa1 3c041ExoiJgnZ/U9crIRgBnxUo2fOgPij53FtRS+pjoZFqnye0AcWUnVxI7Sf/lsUEHKdn+e ENYFNElcOsSbofOpcKLfMsNp5uSRyB+02FSIOEFQk/DfqnJwHNC8lq5gjClNUmD0jE6uuyu2 +tXyHZ2/FS/zQ9WkBgfrRmwg7ZWMSnR7kzr1mMNcON2CZRZAwBoM2Y1F6FYABRCwFqwqj/iS 5pJsEYjWW/QnDnVAW1U9lYA5qIiwRlalA/Q1gwAAAAAAAA== --------------ms070107030602070806010703-- From owner-freebsd-performance@FreeBSD.ORG Sat Feb 14 01:00:52 2009 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C9831106567A for ; Sat, 14 Feb 2009 01:00:52 +0000 (UTC) (envelope-from ohartman@mail.zedat.fu-berlin.de) Received: from outpost1.zedat.fu-berlin.de (outpost1.zedat.fu-berlin.de [130.133.4.66]) by mx1.freebsd.org (Postfix) with ESMTP id 7EC8F8FC0C for ; Sat, 14 Feb 2009 01:00:52 +0000 (UTC) (envelope-from ohartman@mail.zedat.fu-berlin.de) Received: from inpost2.zedat.fu-berlin.de ([130.133.4.69]) by outpost1.zedat.fu-berlin.de (Exim 4.69) with esmtp (envelope-from ) id <1LY8av-0001wu-9b>; Sat, 14 Feb 2009 01:41:21 +0100 Received: from e178005205.adsl.alicedsl.de ([85.178.5.205] helo=thor.walstatt.dyndns.org) by inpost2.zedat.fu-berlin.de (Exim 4.69) with esmtpsa (envelope-from ) id <1LY8av-0003PQ-5T>; Sat, 14 Feb 2009 01:41:21 +0100 Message-ID: <4996133E.9040302@mail.zedat.fu-berlin.de> Date: Sat, 14 Feb 2009 01:41:34 +0100 From: "O. Hartmann" User-Agent: Thunderbird 2.0.0.19 (X11/20090202) MIME-Version: 1.0 To: Richard Tector References: <89D2AE9E4EAAB34FABDBF2913867C62F1CB4B133@ZABRYSVISEX04.af.didata.local> <49940E8E.1080107@thekeelecentre.com> <89D2AE9E4EAAB34FABDBF2913867C62F1CBB66F5@ZABRYSVISEX04.af.didata.local> <499439A8.1080208@zedat.fu-berlin.de> <499464B5.3090001@thekeelecentre.com> In-Reply-To: <499464B5.3090001@thekeelecentre.com> X-Enigmail-Version: 0.95.7 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-Originating-IP: 85.178.5.205 X-Mailman-Approved-At: Sat, 14 Feb 2009 02:46:34 +0000 Cc: Bradley Radjoo , "O. Hartmann" , freebsd-performance@freebsd.org Subject: Re: Extremely slow write speeds to disk : FreeBSD 7.1 and Dell SAS 6/iR Adapter X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 14 Feb 2009 01:00:53 -0000 Richard Tector wrote: > O. Hartmann wrote: >> When I read this posting I was quite happy having found a possible >> solution, but I can't find the above mentioned OID, FreeBSD >> 8.0-CURRENT/amd64 (running on this box) shows only "hw.ata.wc: 1" as >> a relevant OID. No hw.mpt.XXX OIDs anywere. This is the part from >> DMESG reflecting MPT: >> > > It's a driver tunable, not a sysctl. > > Richard Oh, thanks, I forgot. From owner-freebsd-performance@FreeBSD.ORG Sat Feb 14 07:08:57 2009 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id F352C1065675 for ; Sat, 14 Feb 2009 07:08:56 +0000 (UTC) (envelope-from freebsd@sopwith.solgatos.com) Received: from sopwith.solgatos.com (pool-173-50-231-101.ptldor.fios.verizon.net [173.50.231.101]) by mx1.freebsd.org (Postfix) with ESMTP id 791378FC1E for ; Sat, 14 Feb 2009 07:08:56 +0000 (UTC) (envelope-from freebsd@sopwith.solgatos.com) Received: by sopwith.solgatos.com (Postfix, from userid 66) id 1A6B5B64F; Fri, 20 Feb 2009 22:49:36 -0800 (PST) Received: from localhost by sopwith.solgatos.com (8.8.8/6.24) id GAA14352; Sat, 21 Feb 2009 06:16:08 GMT Message-Id: <200902210616.GAA14352@sopwith.solgatos.com> To: freebsd-performance@freebsd.org In-reply-to: Your message of "Thu, 12 Feb 2009 11:57:02 GMT." <49940E8E.1080107@thekeelecentre.com> Date: Fri, 20 Feb 2009 22:16:08 +0000 From: Dieter Subject: Re: Extremely slow write speeds to disk : FreeBSD 7.1 and Dell SAS 6/iR Adapter X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 14 Feb 2009 07:08:57 -0000 > > But the issue is that writing to disk is extremely slow...i.e. 14Mb per > > second.... > > > > If I install any other linux distribution, like CentOS, write speek is > > the way it should be..it averages around 190Mb+ per second > > > > I was hoping if it were at all possible for you to assist me in with a > > later RAID Controller Driver for the SAS 6/iR Adapter > > Try: > hw.mpt.enable_sata_wc=1 > in /boot/loader.conf and reboot. > > Assuming you are using SATA drives, the write cache is disabled by > default. This reenables it. The mpt manpage holds more information. Just keep in mind that turning the disk's write cache on puts your data at risk. :-( The correct solution is NCQ. From owner-freebsd-performance@FreeBSD.ORG Sat Feb 14 07:58:13 2009 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id E3DA1106566C for ; Sat, 14 Feb 2009 07:58:13 +0000 (UTC) (envelope-from sebster@sebster.com) Received: from mail.sebster.com (mail.sebster.com [193.46.80.82]) by mx1.freebsd.org (Postfix) with SMTP id 433CC8FC1E for ; Sat, 14 Feb 2009 07:58:12 +0000 (UTC) (envelope-from sebster@sebster.com) Received: (qmail 39705 invoked from network); 14 Feb 2009 07:58:11 -0000 Received: from unknown (HELO ?10.0.1.6?) (sebster@85.147.225.232) by mail.sebster.com with SMTP; 14 Feb 2009 07:58:10 -0000 Message-ID: <499672F1.4060109@sebster.com> Date: Sat, 14 Feb 2009 08:29:53 +0100 From: Sebastiaan van Erk User-Agent: Thunderbird 2.0.0.19 (X11/20090105) MIME-Version: 1.0 To: Dieter References: <200902210616.GAA14352@sopwith.solgatos.com> In-Reply-To: <200902210616.GAA14352@sopwith.solgatos.com> Content-Type: multipart/signed; protocol="application/x-pkcs7-signature"; micalg=sha1; boundary="------------ms090808020805040708000804" Cc: freebsd-performance@freebsd.org Subject: Re: Extremely slow write speeds to disk : FreeBSD 7.1 and Dell SAS 6/iR Adapter X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 14 Feb 2009 07:58:14 -0000 This is a cryptographically signed message in MIME format. --------------ms090808020805040708000804 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Dieter wrote: >>> But the issue is that writing to disk is extremely slow...i.e. 14Mb per >>> second.... >>> >>> If I install any other linux distribution, like CentOS, write speek is >>> the way it should be..it averages around 190Mb+ per second >>> >>> I was hoping if it were at all possible for you to assist me in with a >>> later RAID Controller Driver for the SAS 6/iR Adapter >>> >> Try: >> hw.mpt.enable_sata_wc=1 >> in /boot/loader.conf and reboot. >> >> Assuming you are using SATA drives, the write cache is disabled by >> default. This reenables it. The mpt manpage holds more information. >> > > Just keep in mind that turning the disk's write cache on puts your > data at risk. :-( > > The correct solution is NCQ. Just wondering, if you have a battery on your RAID array, is this a problem? Wouldn't the cache get written anyway in case of a crash? Regards, Sebastiaan --------------ms090808020805040708000804 Content-Type: application/x-pkcs7-signature; name="smime.p7s" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="smime.p7s" Content-Description: S/MIME Cryptographic Signature MIAGCSqGSIb3DQEHAqCAMIACAQExCzAJBgUrDgMCGgUAMIAGCSqGSIb3DQEHAQAAoIIJUTCC AwMwggJsoAMCAQICEFN8DarMNuuKJDEtfs0UaqUwDQYJKoZIhvcNAQEFBQAwYjELMAkGA1UE BhMCWkExJTAjBgNVBAoTHFRoYXd0ZSBDb25zdWx0aW5nIChQdHkpIEx0ZC4xLDAqBgNVBAMT I1RoYXd0ZSBQZXJzb25hbCBGcmVlbWFpbCBJc3N1aW5nIENBMB4XDTA4MDYzMDEzNTE1N1oX DTA5MDYzMDEzNTE1N1owaDEQMA4GA1UEBBMHdmFuIEVyazETMBEGA1UEKhMKU2ViYXN0aWFh bjEbMBkGA1UEAxMSU2ViYXN0aWFhbiB2YW4gRXJrMSIwIAYJKoZIhvcNAQkBFhNzZWJzdGVy QHNlYnN0ZXIuY29tMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAsJDDAeYHVmH/ GVxi+bhFx27dmg++9BdhPJfk8k041sqEqq7oXnR2GT54quY3Ac7A1BuOM2JvoICraGmjud4y b3EanRnqGIK6iH+VAhhTlV/Owrb2Qm1e13DLxwLp1SocSQl4IrEbF9Y5H3ASdIrE0iFqkpju nPiiHeNhz3LaI5ipjiluKYoH+F6gPx8njHoaDxPePCkSLg4r0IA0afLM74LVZxCRBZEfyRZS J6VVUJefKlz91dWSzR/3xSw/rO4u9Ds/Zh7VBUKy3K+YFryHxRpUek0gSepE1b70Q39L9Sqd M/NZqMvFpwrqgW2Zh2Nh8nqRge90maR4ypBzz3GzLwIDAQABozAwLjAeBgNVHREEFzAVgRNz ZWJzdGVyQHNlYnN0ZXIuY29tMAwGA1UdEwEB/wQCMAAwDQYJKoZIhvcNAQEFBQADgYEAS1Sk NMgDVzb0ktO9tPPacV0KdKhTYOHcICVmuDEe2sFHOkjLAI1iAKp640pqJEVqvRnfRcCFJ9hK koPjjVZ+ui2rVmJWBG6FSloLRS/YYED4tUAw6DQhK61UOpjkpQxjCdm+5bHG/2ZgJAda1j0x uiN822+xFkcaW/5PQgxSRxcwggMDMIICbKADAgECAhBTfA2qzDbriiQxLX7NFGqlMA0GCSqG SIb3DQEBBQUAMGIxCzAJBgNVBAYTAlpBMSUwIwYDVQQKExxUaGF3dGUgQ29uc3VsdGluZyAo UHR5KSBMdGQuMSwwKgYDVQQDEyNUaGF3dGUgUGVyc29uYWwgRnJlZW1haWwgSXNzdWluZyBD QTAeFw0wODA2MzAxMzUxNTdaFw0wOTA2MzAxMzUxNTdaMGgxEDAOBgNVBAQTB3ZhbiBFcmsx EzARBgNVBCoTClNlYmFzdGlhYW4xGzAZBgNVBAMTElNlYmFzdGlhYW4gdmFuIEVyazEiMCAG CSqGSIb3DQEJARYTc2Vic3RlckBzZWJzdGVyLmNvbTCCASIwDQYJKoZIhvcNAQEBBQADggEP ADCCAQoCggEBALCQwwHmB1Zh/xlcYvm4Rcdu3ZoPvvQXYTyX5PJNONbKhKqu6F50dhk+eKrm NwHOwNQbjjNib6CAq2hpo7neMm9xGp0Z6hiCuoh/lQIYU5VfzsK29kJtXtdwy8cC6dUqHEkJ eCKxGxfWOR9wEnSKxNIhapKY7pz4oh3jYc9y2iOYqY4pbimKB/heoD8fJ4x6Gg8T3jwpEi4O K9CANGnyzO+C1WcQkQWRH8kWUielVVCXnypc/dXVks0f98UsP6zuLvQ7P2Ye1QVCstyvmBa8 h8UaVHpNIEnqRNW+9EN/S/UqnTPzWajLxacK6oFtmYdjYfJ6kYHvdJmkeMqQc89xsy8CAwEA AaMwMC4wHgYDVR0RBBcwFYETc2Vic3RlckBzZWJzdGVyLmNvbTAMBgNVHRMBAf8EAjAAMA0G CSqGSIb3DQEBBQUAA4GBAEtUpDTIA1c29JLTvbTz2nFdCnSoU2Dh3CAlZrgxHtrBRzpIywCN YgCqeuNKaiRFar0Z30XAhSfYSpKD441Wfrotq1ZiVgRuhUpaC0Uv2GBA+LVAMOg0ISutVDqY 5KUMYwnZvuWxxv9mYCQHWtY9MbojfNtvsRZHGlv+T0IMUkcXMIIDPzCCAqigAwIBAgIBDTAN BgkqhkiG9w0BAQUFADCB0TELMAkGA1UEBhMCWkExFTATBgNVBAgTDFdlc3Rlcm4gQ2FwZTES MBAGA1UEBxMJQ2FwZSBUb3duMRowGAYDVQQKExFUaGF3dGUgQ29uc3VsdGluZzEoMCYGA1UE CxMfQ2VydGlmaWNhdGlvbiBTZXJ2aWNlcyBEaXZpc2lvbjEkMCIGA1UEAxMbVGhhd3RlIFBl cnNvbmFsIEZyZWVtYWlsIENBMSswKQYJKoZIhvcNAQkBFhxwZXJzb25hbC1mcmVlbWFpbEB0 aGF3dGUuY29tMB4XDTAzMDcxNzAwMDAwMFoXDTEzMDcxNjIzNTk1OVowYjELMAkGA1UEBhMC WkExJTAjBgNVBAoTHFRoYXd0ZSBDb25zdWx0aW5nIChQdHkpIEx0ZC4xLDAqBgNVBAMTI1Ro YXd0ZSBQZXJzb25hbCBGcmVlbWFpbCBJc3N1aW5nIENBMIGfMA0GCSqGSIb3DQEBAQUAA4GN ADCBiQKBgQDEpjxVc1X7TrnKmVoeaMB1BHCd3+n/ox7svc31W/Iadr1/DDph8r9RzgHU5VAK MNcCY1osiRVwjt3J8CuFWqo/cVbLrzwLB+fxH5E2JCoTzyvV84J3PQO+K/67GD4Hv0CAAmTX p6a7n2XRxSpUhQ9IBH+nttE8YQRAHmQZcmC3+wIDAQABo4GUMIGRMBIGA1UdEwEB/wQIMAYB Af8CAQAwQwYDVR0fBDwwOjA4oDagNIYyaHR0cDovL2NybC50aGF3dGUuY29tL1RoYXd0ZVBl cnNvbmFsRnJlZW1haWxDQS5jcmwwCwYDVR0PBAQDAgEGMCkGA1UdEQQiMCCkHjAcMRowGAYD VQQDExFQcml2YXRlTGFiZWwyLTEzODANBgkqhkiG9w0BAQUFAAOBgQBIjNFQg+oLLswNo2as Zw9/r6y+whehQ5aUnX9MIbj4Nh+qLZ82L8D0HFAgk3A8/a3hYWLD2ToZfoSxmRsAxRoLgnSe JVCUYsfbJ3FXJY3dqZw5jowgT2Vfldr394fWxghOrvbqNOUQGls1TXfjViF4gtwhGTXeJLHT HUb/XV9lTzGCA3EwggNtAgEBMHYwYjELMAkGA1UEBhMCWkExJTAjBgNVBAoTHFRoYXd0ZSBD b25zdWx0aW5nIChQdHkpIEx0ZC4xLDAqBgNVBAMTI1RoYXd0ZSBQZXJzb25hbCBGcmVlbWFp bCBJc3N1aW5nIENBAhBTfA2qzDbriiQxLX7NFGqlMAkGBSsOAwIaBQCgggHQMBgGCSqGSIb3 DQEJAzELBgkqhkiG9w0BBwEwHAYJKoZIhvcNAQkFMQ8XDTA5MDIxNDA3Mjk1M1owIwYJKoZI hvcNAQkEMRYEFIBTVuaHXgaWQkHllYZobcBh37UkMF8GCSqGSIb3DQEJDzFSMFAwCwYJYIZI AWUDBAECMAoGCCqGSIb3DQMHMA4GCCqGSIb3DQMCAgIAgDANBggqhkiG9w0DAgIBQDAHBgUr DgMCBzANBggqhkiG9w0DAgIBKDCBhQYJKwYBBAGCNxAEMXgwdjBiMQswCQYDVQQGEwJaQTEl MCMGA1UEChMcVGhhd3RlIENvbnN1bHRpbmcgKFB0eSkgTHRkLjEsMCoGA1UEAxMjVGhhd3Rl IFBlcnNvbmFsIEZyZWVtYWlsIElzc3VpbmcgQ0ECEFN8DarMNuuKJDEtfs0UaqUwgYcGCyqG SIb3DQEJEAILMXigdjBiMQswCQYDVQQGEwJaQTElMCMGA1UEChMcVGhhd3RlIENvbnN1bHRp bmcgKFB0eSkgTHRkLjEsMCoGA1UEAxMjVGhhd3RlIFBlcnNvbmFsIEZyZWVtYWlsIElzc3Vp bmcgQ0ECEFN8DarMNuuKJDEtfs0UaqUwDQYJKoZIhvcNAQEBBQAEggEAIgYlMT5yjZOxQ9lQ TamK8cELOHzauJBv9oKco778AijRRb/w8+DmFF/exkt1oYxoTtS6ceIuB6Vzw3Gdx5842jh3 90y9fhYFSp2cDrfnzUMJ4NCmAmXm+IjnJqNUhUJ148OKTg7B527vj7aWDiZ7WCVgNgTku80j KRvwKPgVJGMeKTgPnru6KDwfQJpX6Mv6uPvMf+/nm0lh5Sg4zTP//EVeB6SvF1FYXZ6uwXI/ ZFbGLpkr8hL6iIxWNLY/9pOhz8b2eWwAwRlfnfROnCmoJZahw/sVbIVwyrUXbygnep8LlX+S ggwFF+nX5DQ9uXl49GXpqKScd80RV0oeBf7tdQAAAAAAAA== --------------ms090808020805040708000804--