From owner-freebsd-questions@FreeBSD.ORG Mon Jan 8 02:44:56 2007 Return-Path: X-Original-To: freebsd-questions@freebsd.org Delivered-To: freebsd-questions@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 5F46A16A403 for ; Mon, 8 Jan 2007 02:44:56 +0000 (UTC) (envelope-from kirk@strauser.com) Received: from kanga.honeypot.net (kanga.honeypot.net [208.162.254.122]) by mx1.freebsd.org (Postfix) with ESMTP id 1D7F513C44C for ; Mon, 8 Jan 2007 02:44:56 +0000 (UTC) (envelope-from kirk@strauser.com) Received: from localhost (localhost [127.0.0.1]) by kanga.honeypot.net (Postfix) with ESMTP id 4823220867A for ; Sun, 7 Jan 2007 20:44:55 -0600 (CST) X-Virus-Scanned: amavisd-new at honeypot.net Received: from kanga.honeypot.net ([127.0.0.1]) by localhost (kanga.honeypot.net [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id PU2LgWmbdwQU for ; Sun, 7 Jan 2007 20:44:50 -0600 (CST) Received: from kanga.honeypot.net (kanga.honeypot.net [IPv6:2001:470:1f01:224:1::2]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by kanga.honeypot.net (Postfix) with ESMTP id 8C6B720679F for ; Sun, 7 Jan 2007 20:44:50 -0600 (CST) From: Kirk Strauser To: freebsd-questions@freebsd.org Date: Sun, 7 Jan 2007 20:44:40 -0600 User-Agent: KMail/1.9.5 References: <200701071301.27423.kirk@strauser.com> <200701071618.11242.kirk@strauser.com> In-Reply-To: X-Face: &'; cS03F?rr_w2Qce.d2f7xmwXfcJWDs>}CkpDw.c]ZJJ_)i0Nx Subject: Re: Tuning PostgreSQL for bulk imports X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 08 Jan 2007 02:44:56 -0000 --nextPart3228807.ruG0a6YjMV Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable Content-Disposition: inline On Sunday 07 January 2007 17:15, Ivan Voras wrote: > What are your current IO rates? Since you have only two drives you might = be > restricted by available disk bandwidth...=20 So says gstat. According to top, the import only takes about 40% of one CP= U,=20 but both of the drives are saturated. I'm contemplating mounting that filesystem async and letting PostgreSQL dec= ide=20 when to sync it. Although I'm sort of allergic to the idea, this seems lik= e=20 it might be relatively safe since no other process touches that data. Any= =20 thoughts? The biggest benefit I'm getting from SMP right now is that I can run the=20 =46oxpro->PostgreSQL conversion on one processor while postmaster grinds aw= ay=20 on the other. > I've just remembered - do you run VACUUM ANALYZE after your big imports? > You should (to get performance on SELECTs afterwards, but it won't help > the imports themselves). Actually, I've been letting the vacuum daemon make that decision for the la= st=20 few months with no perceptible ill effects. > Ok. Be careful not to use SELECT ... LIMIT ALL ;) LOL! Duly noted. =2D-=20 Kirk Strauser --nextPart3228807.ruG0a6YjMV Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (FreeBSD) iD8DBQBFobAf5sRg+Y0CpvERAvygAJ0YAZ68Mb4/hW422Gbr1Cs56kOvkQCeO1Qj zva1cztYriLGrR+VWhOZHRY= =JRSv -----END PGP SIGNATURE----- --nextPart3228807.ruG0a6YjMV--