From owner-freebsd-performance@FreeBSD.ORG Fri Jan 13 21:28:29 2006 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 9451816A41F; Fri, 13 Jan 2006 21:28:29 +0000 (GMT) (envelope-from brdavis@odin.ac.hmc.edu) Received: from odin.ac.hmc.edu (Odin.AC.HMC.Edu [134.173.32.75]) by mx1.FreeBSD.org (Postfix) with ESMTP id 2954E43D45; Fri, 13 Jan 2006 21:28:29 +0000 (GMT) (envelope-from brdavis@odin.ac.hmc.edu) Received: from odin.ac.hmc.edu (localhost.localdomain [127.0.0.1]) by odin.ac.hmc.edu (8.13.0/8.13.0) with ESMTP id k0DLSS6i015955; Fri, 13 Jan 2006 13:28:28 -0800 Received: (from brdavis@localhost) by odin.ac.hmc.edu (8.13.0/8.13.0/Submit) id k0DLSSKA015954; Fri, 13 Jan 2006 13:28:28 -0800 Date: Fri, 13 Jan 2006 13:28:28 -0800 From: Brooks Davis To: Arne Woerner Message-ID: <20060113212828.GB1819@odin.ac.hmc.edu> References: <787bbe1c0601131220j7b3a052ege5fe4683156312a7@mail.gmail.com> <20060113211048.31785.qmail@web30313.mail.mud.yahoo.com> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="mYCpIKhGyMATD0i+" Content-Disposition: inline In-Reply-To: <20060113211048.31785.qmail@web30313.mail.mud.yahoo.com> User-Agent: Mutt/1.4.1i X-Virus-Scanned: by amavisd-new X-Spam-Status: No, hits=0.0 required=8.0 tests=none autolearn=no version=2.63 X-Spam-Checker-Version: SpamAssassin 2.63 (2004-01-11) on odin.ac.hmc.edu Cc: freebsd-database@freebsd.org, Slawek Zak , freebsd-performance@freebsd.org Subject: Re: Horrible PostgreSQL performance with NFS X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 13 Jan 2006 21:28:29 -0000 --mYCpIKhGyMATD0i+ Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Fri, Jan 13, 2006 at 01:10:48PM -0800, Arne Woerner wrote: > Hiho! >=20 > --- Slawek Zak wrote: > > A couple of days ago I've moved our > > production database from local disks > > to NetAPP filer serving NFS. Performance > > for this server dropped by factor of 10 > > if not more. > > > I would like to suggest some tests (I do not have a clear idea, > why your system becomes slower; a hypothesis will follow below): >=20 > 1. benchmark the local disc (watch cpu usage via e. g. vmstat 1) > % dd if=3D/dev/zero of=3D/some/local/filesystem/a bs=3D1m count=3D1000 >=20 > 2. benchmark the NFS filesystem (watch cpu usage via e. g. vmstat > 1) > % dd if=3D/dev/zero of=3D/some/NFS/filesystem/a bs=3D1m count=3D1000 I'd suggest also testing with small blocks as well. I suspect that a large portion of many database accesses quite small and thus transaction overhead, not streaming performance is likely to be the issue. If streaming performance is an issue, increasing your network's MTU should help somewhat. > 3. test the NIC performance with (again watching the CPU usage > might help) > % ping -s 50000 > I get 17Mbit/sec which is the actual rate... > neo# ping -s 50000 vaako > PING vaako.riddick.homeunix.org (10.1.1.3): 50000 data bytes > 50008 bytes from 10.1.1.3: icmp_seq=3D0 ttl=3D64 time=3D46.584 ms I don't think this tells you much if anything. You need to know what your protocol overhead is, not how many ICMP packets you can spew. > My theory would be, that your NICs need a lot of CPU time, while > your local discs dont need so much CPU time. :-) That's certainly part of it, but I doubt it's the whole story. -- Brooks --=20 Any statement of the form "X is the one, true Y" is FALSE. PGP fingerprint 655D 519C 26A7 82E7 2529 9BF0 5D8E 8BE9 F238 1AD4 --mYCpIKhGyMATD0i+ Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.1 (GNU/Linux) iD8DBQFDyBt2XY6L6fI4GtQRAgrwAJsF1m5v/11V7w4LAFLXikEOgchpUQCfWoTe uzFjzaJ2sYtFyoQOcq4Hkg0= =xJXN -----END PGP SIGNATURE----- --mYCpIKhGyMATD0i+--