From owner-freebsd-database@FreeBSD.ORG Thu Jan 12 13:17:07 2006 Return-Path: X-Original-To: freebsd-database@freebsd.org Delivered-To: freebsd-database@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 6B1A216A426 for ; Thu, 12 Jan 2006 13:17:07 +0000 (GMT) (envelope-from litgle@gmail.com) Received: from zproxy.gmail.com (zproxy.gmail.com [64.233.162.202]) by mx1.FreeBSD.org (Postfix) with ESMTP id 825EB43D55 for ; Thu, 12 Jan 2006 13:17:06 +0000 (GMT) (envelope-from litgle@gmail.com) Received: by zproxy.gmail.com with SMTP id 9so389804nzo for ; Thu, 12 Jan 2006 05:17:06 -0800 (PST) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:user-agent:mime-version:to:content-type:content-transfer-encoding; b=qpeA2P+cQOFf/G0V/4u5q5gR+Pls9CckZW9nGV82Jr3gCasJnWawl9fEimXRvoLORZVEVMyZr8rWRa97co77HoKkQlb+EYCqTzRI711yMakY5ef9DshCWK1OHZpMp+9Jx14lMkpqn3G+kJgw3PU+oEVbTlTURGNAk0WJvPIGP2A= Received: by 10.36.196.6 with SMTP id t6mr1764208nzf; Thu, 12 Jan 2006 05:17:05 -0800 (PST) Received: from ?192.168.1.80? ( [219.136.5.115]) by mx.gmail.com with ESMTP id 19sm889681nzp.2006.01.12.05.17.04; Thu, 12 Jan 2006 05:17:05 -0800 (PST) Message-ID: <43C656C9.7070605@gmail.com> Date: Thu, 12 Jan 2006 21:16:57 +0800 From: litgle User-Agent: Thunderbird 1.5 (Windows/20051201) MIME-Version: 1.0 To: freebsd-database@freebsd.org Content-Type: text/plain; charset=GB2312 Content-Transfer-Encoding: 7bit Subject: (no subject) X-BeenThere: freebsd-database@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Database use and development under FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 12 Jan 2006 13:17:07 -0000 From owner-freebsd-database@FreeBSD.ORG Fri Jan 13 03:45:56 2006 Return-Path: X-Original-To: freebsd-database@freebsd.org Delivered-To: freebsd-database@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 6D56016A41F for ; Fri, 13 Jan 2006 03:45:56 +0000 (GMT) (envelope-from Bath.Graham@saugov.sa.gov.au) Received: from adl0741.systems.sa.gov.au (adl0741.systems.sa.gov.au [143.216.236.20]) by mx1.FreeBSD.org (Postfix) with ESMTP id B27FD43D48 for ; Fri, 13 Jan 2006 03:45:53 +0000 (GMT) (envelope-from Bath.Graham@saugov.sa.gov.au) Received: from adl0741.systems.sa.gov.au (localhost [127.0.0.1]) by adl0741.systems.sa.gov.au OUTGOING (8.12.10/8.12.10) with ESMTP id k0D3jqZr011584 for ; Fri, 13 Jan 2006 14:15:52 +1030 (CST)' Received: from sagemsbb012.sagemsmrd01.sa.gov.au (sagemsbb012.sagemsmrd01.sa.gov.au [143.216.59.22]) by adl0741.systems.sa.gov.au INCOMING (8.12.10/8.12.10) with ESMTP id k0D3jqXs011575 for ; Fri, 13 Jan 2006 14:15:52 +1030 (CST)' Received: by sagemsbb012.sagemsmrd01.sa.gov.au with Internet Mail Service (5.5.2653.19) id ; Fri, 13 Jan 2006 14:15:51 +1030 Message-ID: From: "Bath, Graham (OCS)" To: freebsd-database@freebsd.org Date: Fri, 13 Jan 2006 14:13:30 +1030 MIME-Version: 1.0 X-Mailer: Internet Mail Service (5.5.2653.19) Content-Type: text/plain; charset="iso-8859-1" Subject: MySQL 5 Training X-BeenThere: freebsd-database@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Database use and development under FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 13 Jan 2006 03:45:56 -0000 Hi Greg, I've found your email address on the internet. Do you know of any local (Adelaide) MySQL 5.0 training? If not, I'm considering going to the course run by MySQL AB in Sydney in February. Cheers, Graham -------------------------------------------------- Graham Bath Office of Crime Statistics and Research Department of Justice Government of South Australia GPO Box 464, Adelaide SA 5001 p: +61 8 8207 1728 f: +61 8 8204 9575 m: 0401 143 356 e: bath.graham@saugov.sa.gov.au Department of Justice Disclaimer: The information in this email may be confidential and/or legally privileged. It is intended solely for the addressee. Access to this email by anyone else is unauthorised. Any disclosure, copying, distribution or any action taken or omitted to be taken in reliance on it by an unintended recipient, is prohibited and may be unlawful. From owner-freebsd-database@FreeBSD.ORG Fri Jan 13 04:00:50 2006 Return-Path: X-Original-To: freebsd-database@freebsd.org Delivered-To: freebsd-database@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 0733D16A41F for ; Fri, 13 Jan 2006 04:00:50 +0000 (GMT) (envelope-from grog@lemis.com) Received: from ext-gw.lemis.com (ext-gw.lemis.com [150.101.14.10]) by mx1.FreeBSD.org (Postfix) with ESMTP id 5466D43D48 for ; Fri, 13 Jan 2006 04:00:49 +0000 (GMT) (envelope-from grog@lemis.com) Received: from wantadilla.lemis.com (wantadilla.lemis.com [192.109.197.135]) by ext-gw.lemis.com (Postfix) with ESMTP id 136CE1310E2; Fri, 13 Jan 2006 14:30:48 +1030 (CST) Received: by wantadilla.lemis.com (Postfix, from userid 1004) id D0AFB85C2A; Fri, 13 Jan 2006 14:30:47 +1030 (CST) Date: Fri, 13 Jan 2006 14:30:47 +1030 From: Greg 'groggy' Lehey To: Graham Bath Message-ID: <20060113040047.GE73071@wantadilla.lemis.com> References: Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="7DP64HymKb+JCWvF" Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.4.2.1i Organization: The FreeBSD Project Phone: +61-8-8388-8286 Fax: +61-8-8388-8725 Mobile: +61-418-838-708 VoIP: sip:0871270137@sip.internode.on.net WWW-Home-Page: http://www.FreeBSD.org/ X-PGP-Fingerprint: 9A1B 8202 BCCE B846 F92F 09AC 22E6 F290 507A 4223 X-Mailman-Approved-At: Fri, 13 Jan 2006 04:17:30 +0000 Cc: David Logan Subject: Re: MySQL 5 Training X-BeenThere: freebsd-database@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Database use and development under FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 13 Jan 2006 04:00:50 -0000 --7DP64HymKb+JCWvF Content-Type: text/plain; charset=us-ascii Content-Disposition: inline I'm moving FreeBSD-database to Bcc: so the thread doesn't continue on that list (and using my FreeBSD mail address so that it will get delivered :-). If anybody else in Australia is interested, please reply to me. On Friday, 13 January 2006 at 14:13:30 +1030, Graham Bath wrote: > Hi Greg, > > I've found your email address on the internet. > > Do you know of any local (Adelaide) MySQL 5.0 training? Currently there's none planned. > If not, I'm considering going to the course run by MySQL AB in > Sydney in February. Yes, I think the is about the closest you'd come in the immediate future. On the other hand, we may be able to offer training in Adelaide for relatively small classes. Is it just you (too small :-), or do you have a few other people in your office who might be interested? I'd be interested to know how you're using MySQL, if this isn't confidential information. Also, you're aware of the inaugural meeting of the SA MySQL user group at the beginning of next month, right? See http://mysql.meetup.com/139/events/ for further details. I'm also copying David Logan, who's organizing the user group. Feel free to ask him if you have any questions about the group. Greg -- Greg Lehey, Senior Software Engineer MySQL AB, http://www.mysql.com/ Echunga, South Australia Phone: +61-8-8388-8286 Mobile: +61-418-838-708 VoIP: sip:4484@sip.mysql.com, sip:0871270137@sip.internode.on.net Are you MySQL certified? http://www.mysql.com/certification/ --7DP64HymKb+JCWvF Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.1 (FreeBSD) iD8DBQFDxyXvIubykFB6QiMRAicrAJ9ZiN3wYBOEufoGVOK9RZG2HjN47ACcCXr4 lvtCDqFstHOAg6UcwNPE94M= =ScUl -----END PGP SIGNATURE----- --7DP64HymKb+JCWvF-- From owner-freebsd-database@FreeBSD.ORG Fri Jan 13 20:20:16 2006 Return-Path: X-Original-To: freebsd-database@freebsd.org Delivered-To: freebsd-database@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 5C5D116A420 for ; Fri, 13 Jan 2006 20:20:16 +0000 (GMT) (envelope-from slawek.zak@gmail.com) Received: from uproxy.gmail.com (uproxy.gmail.com [66.249.92.202]) by mx1.FreeBSD.org (Postfix) with ESMTP id 7F1DB43D45 for ; Fri, 13 Jan 2006 20:20:15 +0000 (GMT) (envelope-from slawek.zak@gmail.com) Received: by uproxy.gmail.com with SMTP id j3so8610ugf for ; Fri, 13 Jan 2006 12:20:14 -0800 (PST) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:to:subject:mime-version:content-type:content-transfer-encoding:content-disposition; b=HWSbDES9MlMX0UvALxPFvD5UWHwF7rvD/3JYrhsD/mNemrxM/7YYevo9Y1t/B5kmxUOSvlQglNUswWSeo3AOdG6SxWMKKLnIEFGZ1kRuwJccvGHvyMnQmM62fIc6FsicmDFsBewuGTsdNV8zCBl9D4tWfSvww1xaezhxSMwsE84= Received: by 10.48.12.9 with SMTP id 9mr90226nfl; Fri, 13 Jan 2006 12:20:13 -0800 (PST) Received: by 10.49.60.13 with HTTP; Fri, 13 Jan 2006 12:20:13 -0800 (PST) Message-ID: <787bbe1c0601131220j7b3a052ege5fe4683156312a7@mail.gmail.com> Date: Fri, 13 Jan 2006 21:20:13 +0100 From: Slawek Zak To: freebsd-database@freebsd.org, freebsd-performance@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-2 Content-Transfer-Encoding: base64 Content-Disposition: inline Cc: Subject: Horrible PostgreSQL performance with NFS X-BeenThere: freebsd-database@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Database use and development under FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 13 Jan 2006 20:20:16 -0000 SGVsbG8gZXZlcnlvbmUsCgpBIGNvdXBsZSBvZiBkYXlzIGFnbyBJJ3ZlIG1vdmVkIG91ciBwcm9k dWN0aW9uIGRhdGFiYXNlIGZyb20gbG9jYWwKZGlza3MgdG8gTmV0QVBQIGZpbGVyIHNlcnZpbmcg TkZTLiBQZXJmb3JtYW5jZSBmb3IgdGhpcyBzZXJ2ZXIgZHJvcHBlZApieSBmYWN0b3Igb2YgMTAg aWYgbm90IG1vcmUuIEZyb20gYSBoYXBweSAxMCUgbG9hZCwgdGhlIHNlcnZlciBoaXQgdGhlCmNl aWxpbmcgYW5kIHNlZXMgbG9hZCBvZiAxMDAlIGFsbCB0aGUgdGltZSB3aXRoIHJ1bnF1ZXVlIGFi b3ZlIDMwLiBUaGUKc2VydmVyIGlzIGEgU3VuIFY0MHogbWFjaGluZSwgNHggT3B0ZXJvbiA4NTIs IDE2R0IgUkFNLCB0dW5lZCBmb3IgMTYwMApjb25jdXJyZW50IGNvbm5lY3Rpb25zLiBJJ20gcnVu bmluZyBGcmVlQlNEIDYuMCBCRVRBNS4gSSBkb24ndCBzZWUgYW55CnByb2JsZW0gd2l0aCB0aGUg bmV0d29yayBiYW5kd2lkdGggb3IgSS9PIG9wY291bnQuIFRvdGFsIGJhbmR3aWR0aApnZW5lcmF0 ZWQgYnkgdGhlIG1hY2hpbmUgdG9wcyBhdCAxME1icHMuIE5JQ3MgYXJlIGJnZSBjb25maWd1cmVk IGZvcgoxMDBNYnBzIGZ1bGwtZHVwbGV4LiBGaWxlciBoYXJkbHkgbm90aWNlcyB0aGUgdHJhZmZp Yy4gSXQgc3RheXMgYXJvdW5kCjElIENQVSBsb2FkIGFuZCA1MDAgTkZTIG9wcy9zIGluY2x1ZGlu ZyBzdGF0aWMgZmlsZSB0cmFuc2ZlcnMuIFRoaXMKcGFydGljdWxhciBtb2RlbCBjYW4gaGFuZGxl IGFyb3VuZCA2MDAwIEkvT3MgcGVyIHNlY29uZC4gVHJ1c3NpbmcKZGF0YWJhc2UgcHJvY2Vzc2Vz IHNob3dzIHRoYXQgbW9zdCBvZiB0aGUgc3lzY2FsbHMgYXJlIHNlbW9wcy4gSSB0cmllZAp0byBz ZWFyY2ggdGhlIGFyY2hpdmVzIGJ1dCBjb3VsZG4ndCBmaW5kIGFueXRoaW5nIHVzZWZ1bCBmb3Ig c3VjaApzZXR1cC4KCkkgY2FuIHByb3ZpZGUgcG9zdGdyZXNxbCBjb25maWcuIFN5c2N0bCBrbm9i cyByZW1haW4gdW50b3VjaGVkIG5vdApjb3VudGluZyBiYXNpYyBORlMgdHdlYWtpbmcuIEZvciBt b3VudF9uZnMgSSB0cmllZCB0byBjaGFuZ2UgTkZTCmJ1ZmZlciBzaXplcyAtciAtdy4gSSBhbHNv IHRyaWVkIHRoZSAtTCBvcHRpb24gdG8ga2VlcCB0aGUgbG9jawp0cmFmZmljIGxvY2FsLiBPbiB0 aGUgcG9zdGdyZXMgc2lkZSwgc2V0dGluZyBmc3luYyA9IG9mZiBpbgpwb3N0Z3Jlc3FsLmNvbmYu IEl0IGRpZG4ndCBjaGFuZ2UgYSB0aGluZy4KCkFueSBhZHZpY2UgYmVzaWRlcyAiZ2l2ZSB1cCBv biBORlMiIGlzIG1vc3Qgd2VsY29tZS4gSSBuZWVkIE5ldEFQUApvdmVyIE5GUyBmb3Igc25hcHNo b3RzIGFuZCBlYXN5IEZTIG1hbmFnZW1lbnQuCgpUSUEsIC9TCi0tClOzYXdlayCvYWsgLyBVTklY IFN5c3RlbXMgQWRtaW5pc3RyYXRvcgo= From owner-freebsd-database@FreeBSD.ORG Fri Jan 13 21:10:50 2006 Return-Path: X-Original-To: freebsd-database@freebsd.org Delivered-To: freebsd-database@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 6764A16A420 for ; Fri, 13 Jan 2006 21:10:50 +0000 (GMT) (envelope-from arne_woerner@yahoo.com) Received: from web30313.mail.mud.yahoo.com (web30313.mail.mud.yahoo.com [68.142.201.231]) by mx1.FreeBSD.org (Postfix) with SMTP id 649F743D49 for ; Fri, 13 Jan 2006 21:10:49 +0000 (GMT) (envelope-from arne_woerner@yahoo.com) Received: (qmail 31787 invoked by uid 60001); 13 Jan 2006 21:10:48 -0000 DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=Message-ID:Received:Date:From:Subject:To:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding; b=iEszZWXAynBg8QhAwKJkQLr828pfnzM2QRLsad658xg8jAdi4NvrSZhO9lL9ywDrAzWbuKjdVL9BaESRHnxTB4PyqKOCTZqrDY0F83J2F/woh4kxsQFnZZRqn/Hh+Xc5um4eqEeD9bsLvqiCWZu5kVLzi8NwMtsfksN8TcbtTyA= ; Message-ID: <20060113211048.31785.qmail@web30313.mail.mud.yahoo.com> Received: from [213.54.85.246] by web30313.mail.mud.yahoo.com via HTTP; Fri, 13 Jan 2006 13:10:48 PST Date: Fri, 13 Jan 2006 13:10:48 -0800 (PST) From: Arne Woerner To: Slawek Zak , freebsd-database@freebsd.org, freebsd-performance@freebsd.org In-Reply-To: <787bbe1c0601131220j7b3a052ege5fe4683156312a7@mail.gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: 8bit Cc: Subject: Re: Horrible PostgreSQL performance with NFS X-BeenThere: freebsd-database@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Database use and development under FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 13 Jan 2006 21:10:50 -0000 Hiho! --- Slawek Zak wrote: > A couple of days ago I've moved our > production database from local disks > to NetAPP filer serving NFS. Performance > for this server dropped by factor of 10 > if not more. > I would like to suggest some tests (I do not have a clear idea, why your system becomes slower; a hypothesis will follow below): 1. benchmark the local disc (watch cpu usage via e. g. vmstat 1) % dd if=/dev/zero of=/some/local/filesystem/a bs=1m count=1000 2. benchmark the NFS filesystem (watch cpu usage via e. g. vmstat 1) % dd if=/dev/zero of=/some/NFS/filesystem/a bs=1m count=1000 3. test the NIC performance with (again watching the CPU usage might help) % ping -s 50000 I get 17Mbit/sec which is the actual rate... neo# ping -s 50000 vaako PING vaako.riddick.homeunix.org (10.1.1.3): 50000 data bytes 50008 bytes from 10.1.1.3: icmp_seq=0 ttl=64 time=46.584 ms My theory would be, that your NICs need a lot of CPU time, while your local discs dont need so much CPU time. :-) Bye Arne __________________________________________________ Do You Yahoo!? Tired of spam? Yahoo! Mail has the best spam protection around http://mail.yahoo.com From owner-freebsd-database@FreeBSD.ORG Fri Jan 13 21:28:29 2006 Return-Path: X-Original-To: freebsd-database@freebsd.org Delivered-To: freebsd-database@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 9451816A41F; Fri, 13 Jan 2006 21:28:29 +0000 (GMT) (envelope-from brdavis@odin.ac.hmc.edu) Received: from odin.ac.hmc.edu (Odin.AC.HMC.Edu [134.173.32.75]) by mx1.FreeBSD.org (Postfix) with ESMTP id 2954E43D45; Fri, 13 Jan 2006 21:28:29 +0000 (GMT) (envelope-from brdavis@odin.ac.hmc.edu) Received: from odin.ac.hmc.edu (localhost.localdomain [127.0.0.1]) by odin.ac.hmc.edu (8.13.0/8.13.0) with ESMTP id k0DLSS6i015955; Fri, 13 Jan 2006 13:28:28 -0800 Received: (from brdavis@localhost) by odin.ac.hmc.edu (8.13.0/8.13.0/Submit) id k0DLSSKA015954; Fri, 13 Jan 2006 13:28:28 -0800 Date: Fri, 13 Jan 2006 13:28:28 -0800 From: Brooks Davis To: Arne Woerner Message-ID: <20060113212828.GB1819@odin.ac.hmc.edu> References: <787bbe1c0601131220j7b3a052ege5fe4683156312a7@mail.gmail.com> <20060113211048.31785.qmail@web30313.mail.mud.yahoo.com> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="mYCpIKhGyMATD0i+" Content-Disposition: inline In-Reply-To: <20060113211048.31785.qmail@web30313.mail.mud.yahoo.com> User-Agent: Mutt/1.4.1i X-Virus-Scanned: by amavisd-new X-Spam-Status: No, hits=0.0 required=8.0 tests=none autolearn=no version=2.63 X-Spam-Checker-Version: SpamAssassin 2.63 (2004-01-11) on odin.ac.hmc.edu Cc: freebsd-database@freebsd.org, freebsd-performance@freebsd.org Subject: Re: Horrible PostgreSQL performance with NFS X-BeenThere: freebsd-database@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Database use and development under FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 13 Jan 2006 21:28:29 -0000 --mYCpIKhGyMATD0i+ Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Fri, Jan 13, 2006 at 01:10:48PM -0800, Arne Woerner wrote: > Hiho! >=20 > --- Slawek Zak wrote: > > A couple of days ago I've moved our > > production database from local disks > > to NetAPP filer serving NFS. Performance > > for this server dropped by factor of 10 > > if not more. > > > I would like to suggest some tests (I do not have a clear idea, > why your system becomes slower; a hypothesis will follow below): >=20 > 1. benchmark the local disc (watch cpu usage via e. g. vmstat 1) > % dd if=3D/dev/zero of=3D/some/local/filesystem/a bs=3D1m count=3D1000 >=20 > 2. benchmark the NFS filesystem (watch cpu usage via e. g. vmstat > 1) > % dd if=3D/dev/zero of=3D/some/NFS/filesystem/a bs=3D1m count=3D1000 I'd suggest also testing with small blocks as well. I suspect that a large portion of many database accesses quite small and thus transaction overhead, not streaming performance is likely to be the issue. If streaming performance is an issue, increasing your network's MTU should help somewhat. > 3. test the NIC performance with (again watching the CPU usage > might help) > % ping -s 50000 > I get 17Mbit/sec which is the actual rate... > neo# ping -s 50000 vaako > PING vaako.riddick.homeunix.org (10.1.1.3): 50000 data bytes > 50008 bytes from 10.1.1.3: icmp_seq=3D0 ttl=3D64 time=3D46.584 ms I don't think this tells you much if anything. You need to know what your protocol overhead is, not how many ICMP packets you can spew. > My theory would be, that your NICs need a lot of CPU time, while > your local discs dont need so much CPU time. :-) That's certainly part of it, but I doubt it's the whole story. -- Brooks --=20 Any statement of the form "X is the one, true Y" is FALSE. PGP fingerprint 655D 519C 26A7 82E7 2529 9BF0 5D8E 8BE9 F238 1AD4 --mYCpIKhGyMATD0i+ Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.1 (GNU/Linux) iD8DBQFDyBt2XY6L6fI4GtQRAgrwAJsF1m5v/11V7w4LAFLXikEOgchpUQCfWoTe uzFjzaJ2sYtFyoQOcq4Hkg0= =xJXN -----END PGP SIGNATURE----- --mYCpIKhGyMATD0i+-- From owner-freebsd-database@FreeBSD.ORG Fri Jan 13 21:51:22 2006 Return-Path: X-Original-To: freebsd-database@freebsd.org Delivered-To: freebsd-database@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 67E2816A41F for ; Fri, 13 Jan 2006 21:51:22 +0000 (GMT) (envelope-from reinoud.v@n.leeuwen.net) Received: from spoetnik.xs4all.nl (spoetnik.xs4all.nl [213.84.24.58]) by mx1.FreeBSD.org (Postfix) with ESMTP id 8C13343D70 for ; Fri, 13 Jan 2006 21:51:19 +0000 (GMT) (envelope-from reinoud.v@n.leeuwen.net) Received: by spoetnik.xs4all.nl (Postfix, from userid 1000) id B209B1CC71; Fri, 13 Jan 2006 22:51:18 +0100 (CET) Date: Fri, 13 Jan 2006 22:51:18 +0100 From: Reinoud van Leeuwen To: freebsd-database@freebsd.org Message-ID: <20060113215118.GX32593@spoetnik.xs4all.nl> Mail-Followup-To: freebsd-database@freebsd.org References: <787bbe1c0601131220j7b3a052ege5fe4683156312a7@mail.gmail.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <787bbe1c0601131220j7b3a052ege5fe4683156312a7@mail.gmail.com> User-Agent: Mutt/1.4.2.1i X-message-flag: Warning! The sender of this mail thinks you should use a more secure email client. Subject: Re: Horrible PostgreSQL performance with NFS X-BeenThere: freebsd-database@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Database use and development under FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 13 Jan 2006 21:51:22 -0000 On Fri, Jan 13, 2006 at 09:20:13PM +0100, Slawek Zak wrote: > Hello everyone, > > A couple of days ago I've moved our production database from local > disks to NetAPP filer serving NFS. Performance for this server dropped > by factor of 10 if not more. From a happy 10% load, the server hit the > ceiling and sees load of 100% all the time with runqueue above 30. The > server is a Sun V40z machine, 4x Opteron 852, 16GB RAM, tuned for 1600 > concurrent connections. I'm running FreeBSD 6.0 BETA5. I don't see any > problem with the network bandwidth or I/O opcount. Total bandwidth > generated by the machine tops at 10Mbps. NICs are bge configured for > 100Mbps full-duplex. Filer hardly notices the traffic. It stays around > 1% CPU load and 500 NFS ops/s including static file transfers. This > particular model can handle around 6000 I/Os per second. Trussing > database processes shows that most of the syscalls are semops. I tried > to search the archives but couldn't find anything useful for such > setup. > > I can provide postgresql config. Sysctl knobs remain untouched not > counting basic NFS tweaking. For mount_nfs I tried to change NFS > buffer sizes -r -w. I also tried the -L option to keep the lock > traffic local. On the postgres side, setting fsync = off in > postgresql.conf. It didn't change a thing. > > Any advice besides "give up on NFS" is most welcome. I need NetAPP > over NFS for snapshots and easy FS management. Snapshots of your database files? What do you plan to do with those? Posgresql does support PITR these days... -- __________________________________________________ "Nothing is as subjective as reality" Reinoud van Leeuwen reinoud.v@n.leeuwen.net http://www.xs4all.nl/~reinoud __________________________________________________ From owner-freebsd-database@FreeBSD.ORG Fri Jan 13 22:15:34 2006 Return-Path: X-Original-To: freebsd-database@freebsd.org Delivered-To: freebsd-database@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id EF8E016A420 for ; Fri, 13 Jan 2006 22:15:34 +0000 (GMT) (envelope-from kometen@gmail.com) Received: from wproxy.gmail.com (wproxy.gmail.com [64.233.184.198]) by mx1.FreeBSD.org (Postfix) with ESMTP id 10C8D43D45 for ; Fri, 13 Jan 2006 22:15:33 +0000 (GMT) (envelope-from kometen@gmail.com) Received: by wproxy.gmail.com with SMTP id 71so740097wra for ; Fri, 13 Jan 2006 14:15:33 -0800 (PST) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=icCdC6jyAW7R2ZlIioUOyB3YWtfw7KhN51PT0e8vuQgWX7z03hAwWouKimxhlYlcSeoHPy/Hbge8RIWzmnEUFNelc6ez4NNLph0jAODBXHz62/Rl81LpE5iOxwR3p+ovicrGjuiM/lgFVxweoBEoazZavtXH4Kt3YL0bFXwAXAE= Received: by 10.65.218.4 with SMTP id v4mr2120984qbq; Fri, 13 Jan 2006 14:15:33 -0800 (PST) Received: by 10.65.192.14 with HTTP; Fri, 13 Jan 2006 14:15:33 -0800 (PST) Message-ID: Date: Fri, 13 Jan 2006 23:15:33 +0100 From: Claus Guttesen To: Slawek Zak In-Reply-To: <787bbe1c0601131220j7b3a052ege5fe4683156312a7@mail.gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Content-Disposition: inline References: <787bbe1c0601131220j7b3a052ege5fe4683156312a7@mail.gmail.com> Cc: freebsd-database@freebsd.org, freebsd-performance@freebsd.org Subject: Re: Horrible PostgreSQL performance with NFS X-BeenThere: freebsd-database@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Database use and development under FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 13 Jan 2006 22:15:35 -0000 > A couple of days ago I've moved our production database from local > disks to NetAPP filer serving NFS. Performance for this server dropped > by factor of 10 if not more. From a happy 10% load, the server hit the > ceiling and sees load of 100% all the time with runqueue above 30. The > > I can provide postgresql config. Sysctl knobs remain untouched not > counting basic NFS tweaking. For mount_nfs I tried to change NFS > buffer sizes -r -w. I also tried the -L option to keep the lock > traffic local. On the postgres side, setting fsync =3D off in > postgresql.conf. It didn't change a thing. Did you try tcp? regards Claus From owner-freebsd-database@FreeBSD.ORG Sat Jan 14 12:52:09 2006 Return-Path: X-Original-To: freebsd-database@freebsd.org Delivered-To: freebsd-database@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 98DEF16A41F for ; Sat, 14 Jan 2006 12:52:09 +0000 (GMT) (envelope-from slawek.zak@gmail.com) Received: from uproxy.gmail.com (uproxy.gmail.com [66.249.92.198]) by mx1.FreeBSD.org (Postfix) with ESMTP id B1A7243D48 for ; Sat, 14 Jan 2006 12:52:08 +0000 (GMT) (envelope-from slawek.zak@gmail.com) Received: by uproxy.gmail.com with SMTP id o2so165603uge for ; Sat, 14 Jan 2006 04:52:07 -0800 (PST) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=fmkQl39sBJWjBuhItWdvt3ZRdTm01O65PWY4omDxgkALmz4Ci7PuYZumeUSKh9QgJoIoc831/rTUaY2YsF/UQXMoek7nKtNmbd2Em0T1pUKQRJ8eCeQjPwX7QgOVJdcH4CNPJeTu8x62hQue3oAij4ftK/XO83NHIxegJWGB8bo= Received: by 10.49.9.14 with SMTP id m14mr124841nfi; Sat, 14 Jan 2006 04:52:07 -0800 (PST) Received: by 10.49.60.13 with HTTP; Sat, 14 Jan 2006 04:52:07 -0800 (PST) Message-ID: <787bbe1c0601140452p43291399xe79e99fd1e956e4a@mail.gmail.com> Date: Sat, 14 Jan 2006 13:52:07 +0100 From: Slawek Zak To: Claus Guttesen In-Reply-To: MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-2 Content-Transfer-Encoding: base64 Content-Disposition: inline References: <787bbe1c0601131220j7b3a052ege5fe4683156312a7@mail.gmail.com> Cc: freebsd-database@freebsd.org, freebsd-performance@freebsd.org Subject: Re: Horrible PostgreSQL performance with NFS X-BeenThere: freebsd-database@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Database use and development under FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 14 Jan 2006 12:52:09 -0000 T24gMS8xMy8wNiwgQ2xhdXMgR3V0dGVzZW4gPGtvbWV0ZW5AZ21haWwuY29tPiB3cm90ZToKPiA+ IEEgY291cGxlIG9mIGRheXMgYWdvIEkndmUgbW92ZWQgb3VyIHByb2R1Y3Rpb24gZGF0YWJhc2Ug ZnJvbSBsb2NhbAo+ID4gZGlza3MgdG8gTmV0QVBQIGZpbGVyIHNlcnZpbmcgTkZTLiBQZXJmb3Jt YW5jZSBmb3IgdGhpcyBzZXJ2ZXIgZHJvcHBlZAo+ID4gYnkgZmFjdG9yIG9mIDEwIGlmIG5vdCBt b3JlLiBGcm9tIGEgaGFwcHkgMTAlIGxvYWQsIHRoZSBzZXJ2ZXIgaGl0IHRoZQo+ID4gY2VpbGlu ZyBhbmQgc2VlcyBsb2FkIG9mIDEwMCUgYWxsIHRoZSB0aW1lIHdpdGggcnVucXVldWUgYWJvdmUg MzAuIFRoZQo+ID4KPiA+IEkgY2FuIHByb3ZpZGUgcG9zdGdyZXNxbCBjb25maWcuIFN5c2N0bCBr bm9icyByZW1haW4gdW50b3VjaGVkIG5vdAo+ID4gY291bnRpbmcgYmFzaWMgTkZTIHR3ZWFraW5n LiBGb3IgbW91bnRfbmZzIEkgdHJpZWQgdG8gY2hhbmdlIE5GUwo+ID4gYnVmZmVyIHNpemVzIC1y IC13LiBJIGFsc28gdHJpZWQgdGhlIC1MIG9wdGlvbiB0byBrZWVwIHRoZSBsb2NrCj4gPiB0cmFm ZmljIGxvY2FsLiBPbiB0aGUgcG9zdGdyZXMgc2lkZSwgc2V0dGluZyBmc3luYyA9IG9mZiBpbgo+ ID4gcG9zdGdyZXNxbC5jb25mLiBJdCBkaWRuJ3QgY2hhbmdlIGEgdGhpbmcuCj4KPiBEaWQgeW91 IHRyeSB0Y3A/CgpZZXAuIFNhbWUgdGhpbmcuCgovUwotLQpTs2F3ZWsgr2FrIC8gVU5JWCBTeXN0 ZW1zIEFkbWluaXN0cmF0b3IK From owner-freebsd-database@FreeBSD.ORG Sat Jan 14 12:57:32 2006 Return-Path: X-Original-To: freebsd-database@freebsd.org Delivered-To: freebsd-database@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 060F016A41F for ; Sat, 14 Jan 2006 12:57:32 +0000 (GMT) (envelope-from slawek.zak@gmail.com) Received: from uproxy.gmail.com (uproxy.gmail.com [66.249.92.198]) by mx1.FreeBSD.org (Postfix) with ESMTP id 0397443D58 for ; Sat, 14 Jan 2006 12:57:30 +0000 (GMT) (envelope-from slawek.zak@gmail.com) Received: by uproxy.gmail.com with SMTP id o2so166648uge for ; Sat, 14 Jan 2006 04:57:29 -0800 (PST) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:to:subject:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=dfcVRr2ht/FHc228SKjbJeVn0x/2lmR7k0t0iCweDOSvVgIx55oykOzn5SDK5dYbp6Oz6CClFmkktygB+w/eaVUPsnEYN6BXguED+b/w2Ua2X8AEGMNDi4ujTd9FiKR3O6O2kXo9K5xG+/JDrtDVLnr/AszbX48VFSbWJ8XpOzI= Received: by 10.48.43.4 with SMTP id q4mr125043nfq; Sat, 14 Jan 2006 04:57:29 -0800 (PST) Received: by 10.49.60.13 with HTTP; Sat, 14 Jan 2006 04:57:29 -0800 (PST) Message-ID: <787bbe1c0601140457y6de99891n86b49a728eedac94@mail.gmail.com> Date: Sat, 14 Jan 2006 13:57:29 +0100 From: Slawek Zak To: Arne Woerner , freebsd-performance@freebsd.org, freebsd-database@freebsd.org In-Reply-To: <20060113211048.31785.qmail@web30313.mail.mud.yahoo.com> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-2 Content-Transfer-Encoding: base64 Content-Disposition: inline References: <787bbe1c0601131220j7b3a052ege5fe4683156312a7@mail.gmail.com> <20060113211048.31785.qmail@web30313.mail.mud.yahoo.com> Cc: Subject: Re: Horrible PostgreSQL performance with NFS X-BeenThere: freebsd-database@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Database use and development under FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 14 Jan 2006 12:57:32 -0000 T24gMS8xMy8wNiwgQXJuZSBXb2VybmVyIDxhcm5lX3dvZXJuZXJAeWFob28uY29tPiB3cm90ZToK PiBIaWhvIQo+Cj4gLS0tIFNsYXdlayBaYWsgPHNsYXdlay56YWtAZ21haWwuY29tPiB3cm90ZToK PiA+IEEgY291cGxlIG9mIGRheXMgYWdvIEkndmUgbW92ZWQgb3VyCj4gPiBwcm9kdWN0aW9uIGRh dGFiYXNlIGZyb20gbG9jYWwgZGlza3MKPiA+IHRvIE5ldEFQUCBmaWxlciBzZXJ2aW5nIE5GUy4g UGVyZm9ybWFuY2UKPiA+IGZvciB0aGlzIHNlcnZlciBkcm9wcGVkIGJ5IGZhY3RvciBvZiAxMAo+ ID4gaWYgbm90IG1vcmUuCj4gPgo+IEkgd291bGQgbGlrZSB0byBzdWdnZXN0IHNvbWUgdGVzdHMg KEkgZG8gbm90IGhhdmUgYSBjbGVhciBpZGVhLAo+IHdoeSB5b3VyIHN5c3RlbSBiZWNvbWVzIHNs b3dlcjsgYSBoeXBvdGhlc2lzIHdpbGwgZm9sbG93IGJlbG93KToKPgo+IDEuIGJlbmNobWFyayB0 aGUgbG9jYWwgZGlzYyAod2F0Y2ggY3B1IHVzYWdlIHZpYSBlLiBnLiB2bXN0YXQgMSkKPiAlIGRk IGlmPS9kZXYvemVybyBvZj0vc29tZS9sb2NhbC9maWxlc3lzdGVtL2EgYnM9MW0gY291bnQ9MTAw MAoKNDBNQi9zLiBDUFUgbG9hZCBuZWdsaWdpYmxlLiBJIGRvbid0IGhhdmUgYW4gZXhhY3QgbnVt YmVyLCBhcyB0aGlzCm1hY2hpbmUgaGFzIG90aGVyIHByb2Nlc3NlcyBydW5uaW5nLiBCdXQgb3Zl cmFsbCwgdGhlIHN5c3RlbSBsb2FkCmRpZG4ndCBleGNlZWQgNSUuCgo+IDIuIGJlbmNobWFyayB0 aGUgTkZTIGZpbGVzeXN0ZW0gKHdhdGNoIGNwdSB1c2FnZSB2aWEgZS4gZy4gdm1zdGF0Cj4gMSkK PiAlIGRkIGlmPS9kZXYvemVybyBvZj0vc29tZS9ORlMvZmlsZXN5c3RlbS9hIGJzPTFtIGNvdW50 PTEwMDAKCkkgc2F0dXJhdGVkIGZhc3QgZXRoZXJuZXQgb24gdGhlIGhvc3Qgd2l0aCB0aGlzIHRl c3QuIEZpbGVyIGlzCmNvbm5lY3RlZCB3aXRoIEdiIGFuZCBjYW4gc3BldyBhcm91bmQgNzBNQi9z IGVhc2lseS4gQ1BVIGxvYWQgb24gdGhlCmhvc3QgZGlkbid0IGV4Y2VlZCA0JS4KCj4gMy4gdGVz dCB0aGUgTklDIHBlcmZvcm1hbmNlIHdpdGggKGFnYWluIHdhdGNoaW5nIHRoZSBDUFUgdXNhZ2UK PiBtaWdodCBoZWxwKQo+ICUgcGluZyAtcyA1MDAwMCA8bmZzLXNlcnZlcj4KPiBJIGdldCAxN01i aXQvc2VjIHdoaWNoIGlzIHRoZSBhY3R1YWwgcmF0ZS4uLgo+IG5lbyMgcGluZyAtcyA1MDAwMCB2 YWFrbwo+IFBJTkcgdmFha28ucmlkZGljay5ob21ldW5peC5vcmcgKDEwLjEuMS4zKTogNTAwMDAg ZGF0YSBieXRlcwo+IDUwMDA4IGJ5dGVzIGZyb20gMTAuMS4xLjM6IGljbXBfc2VxPTAgdHRsPTY0 IHRpbWU9NDYuNTg0IG1zCgpGaWxlciBkb2Vzbid0IHJlc3BvbmQgdG8gbGFyZ2UgaWNtcCBwYWNr ZXRzLiAyMDAwMCB3YXMgdGhlIGJpZ2dlc3QKdGhhdCB3b3JrZWQuIENQVSBsb2FkIG5lZ2xpZ2li bGUuCgo+IE15IHRoZW9yeSB3b3VsZCBiZSwgdGhhdCB5b3VyIE5JQ3MgbmVlZCBhIGxvdCBvZiBD UFUgdGltZSwgd2hpbGUKPiB5b3VyIGxvY2FsIGRpc2NzIGRvbnQgbmVlZCBzbyBtdWNoIENQVSB0 aW1lLiA6LSkKCkkgZG9uJ3QgdGhpbmsgc28uIERyaXZlcnMgYWNjb3V0IGZvciBzeXN0ZW0gdGlt ZS4gSXQgZG9lc24ndCBleGNlZWQKMjAlIG9mIG92ZXJhbGwgbG9hZC4gVGhlIHBvc3RncmVzIHBy b2Nlc3NlcyBhcmUgdmVyeSBidXN5IGRvaW5nIGFsbW9zdApub3RoaW5nLiBTZW1vcHMgaXMgbW9z dCBvZiB0aGUgd29yayB0aGV5IHNlZW0gdG8gZG8uCgpUaGFua3MsIC9TCi0tClOzYXdlayCvYWsg LyBVTklYIFN5c3RlbXMgQWRtaW5pc3RyYXRvcgo= From owner-freebsd-database@FreeBSD.ORG Sat Jan 14 14:42:03 2006 Return-Path: X-Original-To: freebsd-database@freebsd.org Delivered-To: freebsd-database@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 8935516A420 for ; Sat, 14 Jan 2006 14:42:03 +0000 (GMT) (envelope-from arne_woerner@yahoo.com) Received: from web30315.mail.mud.yahoo.com (web30315.mail.mud.yahoo.com [68.142.201.233]) by mx1.FreeBSD.org (Postfix) with SMTP id CDE9443D46 for ; Sat, 14 Jan 2006 14:42:02 +0000 (GMT) (envelope-from arne_woerner@yahoo.com) Received: (qmail 6201 invoked by uid 60001); 14 Jan 2006 14:42:02 -0000 DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=Message-ID:Received:Date:From:Subject:To:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding; b=Sk4zUBB5SVYo5NWxEIU788OQQyI+d+jCtnRxF6//QNNQpRWQ5ugzsm/MCPvnR00bJ+zVbBV72yVYctZYTYUG39NmVwjPF06H9rzPhkHlEpKDqiWkw2S3ZX0PMOoRPuObx4T4gFf17zVF60DcJrDrxrFQu+iWK2EodJ8p+st+G4A= ; Message-ID: <20060114144202.6199.qmail@web30315.mail.mud.yahoo.com> Received: from [213.54.74.99] by web30315.mail.mud.yahoo.com via HTTP; Sat, 14 Jan 2006 06:42:02 PST Date: Sat, 14 Jan 2006 06:42:02 -0800 (PST) From: Arne Woerner To: Slawek Zak , freebsd-performance@freebsd.org, freebsd-database@freebsd.org In-Reply-To: <787bbe1c0601140457y6de99891n86b49a728eedac94@mail.gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: 8bit Cc: Subject: Re: Horrible PostgreSQL performance with NFS X-BeenThere: freebsd-database@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Database use and development under FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 14 Jan 2006 14:42:03 -0000 --- Slawek Zak wrote: > On 1/13/06, Arne Woerner wrote: > 40MB/s. CPU load negligible. I don't have > an exact number, as this machine has other > processes running. But overall, the system > load didn't exceed 5%. > Looks good... > I saturated fast ethernet on the host > with this test. Filer is connected with > Gb and can spew around 70MB/s easily. > CPU load on the host didn't exceed 4%. > Looks even better... :-) > > 3. test the NIC performance with > Filer doesn't respond to large icmp packets. > Ok... This isn't so important, since NFS speed is higher than local disc speed. > > My theory would be, that your NICs need a > > lot of CPU time, while your local discs > > dont need so much CPU time. :-) > > I don't think so. Drivers account for system > time. It doesn't exceed 20% of overall load. > The postgres processes are very busy doing > almost nothing. Semops is most of the work > they seem to do. > Hmm... But why does switching from local disc to NFS makes the PostgreSQL performance so bad? The semops of postgres are most likely the same, since postgres would not check if it runs on NFS or local filesystems, would it? Were there any other changes? Did you do those "dd" tests with small block sizes (like 1byte: bs=1), like somebody on one of those lists suggests, too? Then we could see, if there is a high latency that ruins everything... -Arne __________________________________________________ Do You Yahoo!? Tired of spam? Yahoo! Mail has the best spam protection around http://mail.yahoo.com From owner-freebsd-database@FreeBSD.ORG Sat Jan 14 17:18:04 2006 Return-Path: X-Original-To: freebsd-database@freebsd.org Delivered-To: freebsd-database@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 2FE8516A420 for ; Sat, 14 Jan 2006 17:18:04 +0000 (GMT) (envelope-from michael.bowerman@gmail.com) Received: from xproxy.gmail.com (xproxy.gmail.com [66.249.82.198]) by mx1.FreeBSD.org (Postfix) with ESMTP id A458F43D48 for ; Sat, 14 Jan 2006 17:18:03 +0000 (GMT) (envelope-from michael.bowerman@gmail.com) Received: by xproxy.gmail.com with SMTP id t12so653082wxc for ; Sat, 14 Jan 2006 09:18:03 -0800 (PST) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:to:subject:mime-version:content-type:content-transfer-encoding:content-disposition; b=oMt8A1uJDHv91GF1PlBK4zObi/+JI6H9FAvQEmUsjrtiEtVhka61uPzgGtbPX2nS246cjM2MYlq6UR1rmEyW9FeG8O3y3dmrV6zUeBwowt7lqKuotIPxWUro1LvZYCHdZ5+Led34hQ1btpO+OuaDOeHIDeGd92R6jI+ToK7B4+A= Received: by 10.70.50.16 with SMTP id x16mr5448345wxx; Sat, 14 Jan 2006 09:18:02 -0800 (PST) Received: by 10.70.7.6 with HTTP; Sat, 14 Jan 2006 09:18:02 -0800 (PST) Message-ID: <8038a35b0601140918t459b534cnea1c2a22ea578cc@mail.gmail.com> Date: Sat, 14 Jan 2006 17:18:02 +0000 From: Michael Bowerman To: freebsd-database@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Content-Disposition: inline Subject: MySQL and FreeBSD native threads X-BeenThere: freebsd-database@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Database use and development under FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 14 Jan 2006 17:18:04 -0000 A while ago, I was planning to move my MySQL server over from Linux to FreeBSD. But, I was scared off by some blogs and the MySQL website that said that FreeBSD threading had some problems dealing with high loads, since some calls were not threadsafe. So, my question is this: has FreeBSD threading improved since the 4.x line? It seems to me like a lot of work has gone into this area since then. But, I haven't been able to find any updated information on 5.x and 6.x. I'm trying to move completely to FreeBSD on my home network. So, I'd prefer to make the switch. My server has a very small load and the data isn't exactly mission critical (simple web stuff). So, even with the threading problem, it would probably still meet my needs. But, it's mostly a matter of worry free life cycle. I don't like to spend a lot of time on maintenance (or wondering if it's my code, or the server), except for upgrades. Thanks for your thoughts, Mike From owner-freebsd-database@FreeBSD.ORG Sat Jan 14 18:09:05 2006 Return-Path: X-Original-To: freebsd-database@freebsd.org Delivered-To: freebsd-database@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 3414616A420; Sat, 14 Jan 2006 18:09:05 +0000 (GMT) (envelope-from dmiller@sparks.net) Received: from search.sparks.net (search.sparks.net [207.5.180.136]) by mx1.FreeBSD.org (Postfix) with ESMTP id 7F49D43D49; Sat, 14 Jan 2006 18:09:04 +0000 (GMT) (envelope-from dmiller@sparks.net) Received: from [10.0.0.10] (dsl-66-243-211-31.pivot.net [66.243.211.31]) by search.sparks.net (Postfix) with ESMTP id 11E12A90A; Sat, 14 Jan 2006 13:09:03 -0500 (EST) Message-ID: <43C93E3E.30009@sparks.net> Date: Sat, 14 Jan 2006 13:09:02 -0500 From: David Miller User-Agent: Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; en-US; rv:1.7.12) Gecko/20050915 X-Accept-Language: en-us, en MIME-Version: 1.0 To: Arne Woerner References: <20060114144202.6199.qmail@web30315.mail.mud.yahoo.com> In-Reply-To: <20060114144202.6199.qmail@web30315.mail.mud.yahoo.com> Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-database@freebsd.org, freebsd-performance@freebsd.org Subject: Re: Horrible PostgreSQL performance with NFS X-BeenThere: freebsd-database@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Database use and development under FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 14 Jan 2006 18:09:05 -0000 Arne Woerner wrote: >--- Slawek Zak wrote: > > >>On 1/13/06, Arne Woerner wrote: >>40MB/s. CPU load negligible. I don't have >>an exact number, as this machine has other >>processes running. But overall, the system >>load didn't exceed 5%. >> >> >> >Looks good... > > > >>I saturated fast ethernet on the host >>with this test. Filer is connected with >>Gb and can spew around 70MB/s easily. >>CPU load on the host didn't exceed 4%. >> >> >> >Looks even better... :-) > > > >>>3. test the NIC performance with >>> >>> >>Filer doesn't respond to large icmp packets. >> >> >> >Ok... This isn't so important, since NFS speed is higher than >local disc speed. > > > >>>My theory would be, that your NICs need a >>>lot of CPU time, while your local discs >>>dont need so much CPU time. :-) >>> >>> >>I don't think so. Drivers account for system >>time. It doesn't exceed 20% of overall load. >>The postgres processes are very busy doing >>almost nothing. Semops is most of the work >>they seem to do. >> >> >> >Hmm... > >But why does switching from local disc to NFS makes the PostgreSQL >performance so bad? > > It certainly sounds like something is no longer caching things - either reads or writes or both - when using NFS. Does FreeBSD 6.x have a version of lockd that works with the netApp? --- David