From owner-freebsd-performance@FreeBSD.ORG Thu Jul 17 15:45:33 2014 Return-Path: Delivered-To: performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id C11458F9; Thu, 17 Jul 2014 15:45:33 +0000 (UTC) Received: from mail-we0-x22d.google.com (mail-we0-x22d.google.com [IPv6:2a00:1450:400c:c03::22d]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 36FB723CC; Thu, 17 Jul 2014 15:45:33 +0000 (UTC) Received: by mail-we0-f173.google.com with SMTP id q58so3399358wes.4 for ; Thu, 17 Jul 2014 08:45:29 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=message-id:date:from:user-agent:mime-version:to:cc:subject :references:in-reply-to:content-type:content-transfer-encoding; bh=6LmG3rTHaBSoMk93ffyAaidW7Jc/LoXXVmRh4VUX9u4=; b=a28PCZYaPow4kicRV0dJ6ffKWnP+dqE1/OnwQ1mhw8dGPz+RHhK3N6lzYCHnaHaSq4 Jl5+igPlT4lPnoLTYazccGq3vQN2Q01c0+3pyJstvnLSvddZarVzfpjUC1mUPe25ptYW T54MQaAe2s+tRCcxAf6ax0qodnXfERgP7Aty3gUa6BzQGF9cYITwZXV6NVHcr9HH5gqS KOJdmhFUoPJ3jeSz6JA9aSvV3Pia8RnIr2fMDesG2HgAvjLah5LYhjRDxYRx++HRtnld DzjB+K0BPuXvLdkrGeIGDsBKlUxXsaozhaYgK0qOOYpj29/qBbjWC8/CP+szAniXTyxW FIxg== X-Received: by 10.180.24.97 with SMTP id t1mr23564487wif.45.1405611929767; Thu, 17 Jul 2014 08:45:29 -0700 (PDT) Received: from [192.168.2.30] ([2.176.167.69]) by mx.google.com with ESMTPSA id eh10sm22332778wic.0.2014.07.17.08.45.27 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Thu, 17 Jul 2014 08:45:28 -0700 (PDT) Message-ID: <53C7EFA3.3070100@gmail.com> Date: Thu, 17 Jul 2014 20:15:39 +0430 From: Hooman Fazaeli User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:17.0) Gecko/20130215 Thunderbird/17.0.3 MIME-Version: 1.0 To: Konstantin Belousov Subject: Re: PostgreSQL performance on FreeBSD References: <20140627125613.GT93733@kib.kiev.ua> <20140716132938.GB93733@kib.kiev.ua> In-Reply-To: <20140716132938.GB93733@kib.kiev.ua> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: performance@freebsd.org, current@freebsd.org X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 17 Jul 2014 15:45:33 -0000 On 7/16/2014 5:59 PM, Konstantin Belousov wrote: > On Fri, Jun 27, 2014 at 03:56:13PM +0300, Konstantin Belousov wrote: >> Hi, >> I did some measurements and hacks to see about the performance and >> scalability of PostgreSQL 9.3 on FreeBSD, sponsored by The FreeBSD >> Foundation. >> >> The results are described in https://kib.kiev.ua/kib/pgsql_perf.pdf. >> The uncommitted patches, referenced in the article, are available as >> https://kib.kiev.ua/kib/pig1.patch.txt >> https://kib.kiev.ua/kib/patch-2 > A followup to the original paper. > > Most importantly, I identified the cause for the drop on the graph > after the 30 clients, which appeared to be the debugging version > of malloc(3) in libc. > > Also there are some updates on the patches. > > New version of the paper is available at > https://www.kib.kiev.ua/kib/pgsql_perf_v2.0.pdf > The changes are marked as 'update for version 2.0'. Thanks for the great work! Did you tested the effect of hyper-threading (on or off) on the results? -- Best regards. Hooman Fazaeli From owner-freebsd-performance@FreeBSD.ORG Fri Jul 18 03:31:35 2014 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id F20C2F4D for ; Fri, 18 Jul 2014 03:31:35 +0000 (UTC) Received: from smtp2911-211.mail.sina.com.cn (mail2-161.sinamail.sina.com.cn [60.28.2.161]) by mx1.freebsd.org (Postfix) with SMTP id 4D2202FEF for ; Fri, 18 Jul 2014 03:31:33 +0000 (UTC) Received: from unknown( HELO webmail.sinamail.sina.com.cn)([172.16.201.149]) by sina.com with SMTP 18 Jul 2014 09:44:51 +0800 (CST) X-Sender: zjusomwu@sina.com X-SMAIL-MID: 1002049061677 Received: by webmail.sinamail.sina.com.cn (Postfix, from userid 80) id 388E7718001; Fri, 18 Jul 2014 09:44:50 +0800 (CST) Date: Fri, 18 Jul 2014 09:44:50 +0800 Received: from zjusomwu@sina.com([202.127.26.196]) by m0.mail.sina.com.cn via HTTP; Fri, 18 Jul 2014 09:44:50 +0800 (CST) Reply-To: zjusomwu@sina.com From: To: "freebsd-performance" Subject: about network interrupt MIME-Version: 1.0 X-Priority: 3 X-MessageID: 53c87c125b67b97 X-Originating-IP: [172.16.201.149] X-Mailer: Sina WebMail 4.0 Message-Id: <20140718014450.388E7718001@webmail.sinamail.sina.com.cn> Content-Type: text/plain; charset=GBK Content-Transfer-Encoding: base64 Content-Disposition: inline X-Content-Filtered-By: Mailman/MimeDel 2.1.18 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 18 Jul 2014 03:31:36 -0000 aGksYWxsOgogICBJJ20gdGVzdGluZyBuZXR3b3JrIHBlcmZvcm1hbmNlIG9mIG5naW54IHVzaW5n IGZyZWVic2QsYW5kIEkgZmluZCBzb21ldGhpbmcgc3RyYW5nZSwgdGhhdCBpcyA6d2hpbGUgc2Vu ZGluZyBodWdlIGFtb3VudCBodHRwIHJlcXVlc3QgdG8gbmdpbnggYW5kIHVzZSB0b3AgdG8gbW9u aXRvciB0aGlzIG1hY2hpbmUsIGZvciBzb21lIG1hY2hpbmVzIGEgbG90IG9mIGNwdSBpcyBjb25z dW1lZCBieSBpbnRlcnJ1cHQgYnV0IHRoZSBvdGhlcnMgbm90ISBBbmQgSSB1c2Ugb25lIG1hY2hp bmUgZm9yIHRlc3QgdXNpbmcgZGlmZmVyZW50IHZlcnNpb24gb2YgZnJlZWJzZCx0aGVuIEkgZmlu ZCBGcmVlYnNkIDggbm90IHVzaW5nIGludGVycnVwdCBidXQgMTAgZG9lcyEgICAgSW4gb3JkZXIg dG8gZXhwbGFpbiB0aGlzIEkgZmlyc3QgZ3Vlc3MgaXQgaXMgdGhlIHBvbGxpbmcgbWFrZSBpdCBk aWZmLGJ1dCBhZnRlciBJIHVzaW5nICJpZmNvbmZpZyBlbTAgLXBvbGxpbmciIHRvIGRpc2FibGUg cG9sbGluZyBvZiB0aGUgbmV0d29yayBpbnRlcmZhY2UgaXQgZG9lcyBubyBlZmZlY3QhIE5vdyBJ IGNhbid0IGV4cGxhaW4gaXQuIFdobyBjYW4gZ2l2ZSBtZSBzb21lIGFkdmljZT8KICAgICAgIHNv bXd1 From owner-freebsd-performance@FreeBSD.ORG Fri Jul 18 04:21:52 2014 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id CC19341E for ; Fri, 18 Jul 2014 04:21:52 +0000 (UTC) Received: from mail-qg0-x230.google.com (mail-qg0-x230.google.com [IPv6:2607:f8b0:400d:c04::230]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 8D2D62382 for ; Fri, 18 Jul 2014 04:21:52 +0000 (UTC) Received: by mail-qg0-f48.google.com with SMTP id i50so2771259qgf.21 for ; Thu, 17 Jul 2014 21:21:51 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type:content-transfer-encoding; bh=ed13zmBdaD+9FlTVfBlxHbuSu7m/h9Fpuf5XrpVJewE=; b=Yfh1wd0vfmZ0RuvB9dLIc2DpJlbYB8lvj4yJD4HHGQsOJtQ9xnAJIg5SOjEup0I1Rj xmUFOGlx+BQ4ejqtVuMQLencK5IMdyMAv1Pl+IkVSma3WNj6tPquvE7ay1E3Ozv66jS6 K0jwQ4xyRuYVhXAylSweyn+DzOpWjBProzoCjpxXWUZuJ0J2SlieAu3KBB7vJYhVB5Rh Sj1CoFMl7mdiYSG5A+VIl9+u9zZXwX9DLE4u76D4BtvDupEo8ydHervI4dmq8ezslD1f 9WD8LEN1/utpx5k9zrHXkanWj9ReKq2paBn0/yt86KfhoRimh9CVDhYx5nqvmNoIMUDM OpcQ== MIME-Version: 1.0 X-Received: by 10.140.19.176 with SMTP id 45mr3226880qgh.46.1405657311252; Thu, 17 Jul 2014 21:21:51 -0700 (PDT) Sender: adrian.chadd@gmail.com Received: by 10.224.202.193 with HTTP; Thu, 17 Jul 2014 21:21:51 -0700 (PDT) In-Reply-To: <20140718014450.388E7718001@webmail.sinamail.sina.com.cn> References: <20140718014450.388E7718001@webmail.sinamail.sina.com.cn> Date: Thu, 17 Jul 2014 21:21:51 -0700 X-Google-Sender-Auth: irBtIxlUkYakoG7M0XUzQzFdYM4 Message-ID: Subject: Re: about network interrupt From: Adrian Chadd To: zjusomwu@sina.com Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Cc: freebsd-performance X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 18 Jul 2014 04:21:52 -0000 Hi! So em(4) doesn't use multiple CPUs on the traffic receive path, so things won't scale all that well. can you retry with an igb(4) NIC? I do have a TODO item to implement generic receive load balancing based on a GSoC project and some of the RSS stuff that is in -HEAD now but it's going to be some time before I can take advantage of it. -a On 17 July 2014 18:44, wrote: > hi,all: > I'm testing network performance of nginx using freebsd,and I find some= thing strange, that is :while sending huge amount http request to nginx and= use top to monitor this machine, for some machines a lot of cpu is consume= d by interrupt but the others not! And I use one machine for test using dif= ferent version of freebsd,then I find Freebsd 8 not using interrupt but 10 = does! In order to explain this I first guess it is the polling make it d= iff,but after I using "ifconfig em0 -polling" to disable polling of the net= work interface it does no effect! Now I can't explain it. Who can give me s= ome advice? > somwu > _______________________________________________ > freebsd-performance@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-performance > To unsubscribe, send any mail to "freebsd-performance-unsubscribe@freebsd= .org" From owner-freebsd-performance@FreeBSD.ORG Fri Jul 18 05:54:26 2014 Return-Path: Delivered-To: performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 45B482C9; Fri, 18 Jul 2014 05:54:26 +0000 (UTC) Received: from outpost1.zedat.fu-berlin.de (outpost1.zedat.fu-berlin.de [130.133.4.66]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id F34B52A55; Fri, 18 Jul 2014 05:54:25 +0000 (UTC) Received: from inpost2.zedat.fu-berlin.de ([130.133.4.69]) by outpost.zedat.fu-berlin.de (Exim 4.82) with esmtp (envelope-from ) id <1X817e-001nT0-RT>; Fri, 18 Jul 2014 07:54:22 +0200 Received: from e179168030.adsl.alicedsl.de ([85.179.168.30] helo=thor.walstatt.dynvpn.de) by inpost2.zedat.fu-berlin.de (Exim 4.82) with esmtpsa (envelope-from ) id <1X817e-0004wl-Nq>; Fri, 18 Jul 2014 07:54:22 +0200 Date: Fri, 18 Jul 2014 07:54:16 +0200 From: "O. Hartmann" To: Hooman Fazaeli Subject: Re: PostgreSQL performance on FreeBSD Message-ID: <20140718075416.2bde7e9d.ohartman@zedat.fu-berlin.de> In-Reply-To: <53C7EFA3.3070100@gmail.com> References: <20140627125613.GT93733@kib.kiev.ua> <20140716132938.GB93733@kib.kiev.ua> <53C7EFA3.3070100@gmail.com> Organization: FU Berlin X-Mailer: Claws Mail 3.10.1 (GTK+ 2.24.22; amd64-portbld-freebsd11.0) MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; boundary="Sig_/ktPsIHr7PD1VnsaAGF96FL2"; protocol="application/pgp-signature" X-Originating-IP: 85.179.168.30 X-ZEDAT-Hint: A Cc: Konstantin Belousov , performance@freebsd.org, current@freebsd.org X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 18 Jul 2014 05:54:26 -0000 --Sig_/ktPsIHr7PD1VnsaAGF96FL2 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: quoted-printable Am Thu, 17 Jul 2014 20:15:39 +0430 Hooman Fazaeli schrieb: > On 7/16/2014 5:59 PM, Konstantin Belousov wrote: > > On Fri, Jun 27, 2014 at 03:56:13PM +0300, Konstantin Belousov wrote: > >> Hi, > >> I did some measurements and hacks to see about the performance and > >> scalability of PostgreSQL 9.3 on FreeBSD, sponsored by The FreeBSD > >> Foundation. > >> > >> The results are described in https://kib.kiev.ua/kib/pgsql_perf.pdf. > >> The uncommitted patches, referenced in the article, are available as > >> https://kib.kiev.ua/kib/pig1.patch.txt > >> https://kib.kiev.ua/kib/patch-2 > > A followup to the original paper. > > > > Most importantly, I identified the cause for the drop on the graph > > after the 30 clients, which appeared to be the debugging version > > of malloc(3) in libc. > > > > Also there are some updates on the patches. > > > > New version of the paper is available at > > https://www.kib.kiev.ua/kib/pgsql_perf_v2.0.pdf > > The changes are marked as 'update for version 2.0'. >=20 > Thanks for the great work! >=20 > Did you tested the effect of hyper-threading (on or off) on the results? >=20 >=20 A "naive" question besides: Does this labor and effort only affects the work with the PostgreSQL 9.3 da= tabase and is recent FreeBSD only optimized for this servicing puprpose or provides this = also some benefeits for other high-performance scenarios? Oliver=20 --Sig_/ktPsIHr7PD1VnsaAGF96FL2 Content-Type: application/pgp-signature; name=signature.asc Content-Disposition: attachment; filename=signature.asc -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iQEcBAEBAgAGBQJTyLaOAAoJEOgBcD7A/5N8MdIIAKTL6TAh/N2rDVC8qx4tIN7V DiSLcK2cBfkEXgPXJc6krk6QwDE5aTCJh3XUrnp2Fq8YSk+hK1+aVy/4Chr6oe7X q1wi1UNOvl6FPPntKZI7GFp2ML/1kjwKRMV/JKTfqOXegvlB/jLaEXi0wFkBUnRL mLnHXf3ORR4asBtleEstFe6YAdwfHwPV5jNs/lZrL9n62I7kf5UyR4e2xHqTrg29 23VNeAkfpqTDpLLAvZmjD4qBev1UtuqqCVwHqbJdPDF/dmXr+tJqWXh8xps4/6++ t1MeVq34uZlOyDZ7l6W/q8UzUx9E+p9wttFLfsksJmZfGFVQ3QQR6ooRXBSLJxE= =Qr8a -----END PGP SIGNATURE----- --Sig_/ktPsIHr7PD1VnsaAGF96FL2--