Date: Sun, 7 May 2006 15:59:41 -0400 From: Kris Kennaway <kris@obsecurity.org> To: Robert Watson <rwatson@FreeBSD.org> Cc: Sven Petai <hadara@bsd.ee>, csjp@FreeBSD.org, performance@freebsd.org, current@freebsd.org, Kris Kennaway <kris@obsecurity.org> Subject: Re: Fine-grained locking for POSIX local sockets (UNIX domain sockets) Message-ID: <20060507195941.GA2978@xor.obsecurity.org> In-Reply-To: <20060507205627.B46997@fledge.watson.org> References: <20060506150622.C17611@fledge.watson.org> <200605071949.54978.hadara@bsd.ee> <20060507190844.K46997@fledge.watson.org> <200605072200.42529.hadara@bsd.ee> <20060507191641.GA1851@xor.obsecurity.org> <20060507205627.B46997@fledge.watson.org>
next in thread | previous in thread | raw e-mail | index | archive | help
--zYM0uCDKw75PZbzx Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Sun, May 07, 2006 at 08:57:21PM +0100, Robert Watson wrote: >=20 > >On Sun, May 07, 2006 at 10:00:41PM +0300, Sven Petai wrote: > > > >>The results in my mail were mean values over 2 runs, > >>only once did I see really huge (more than 10%) differences between=20 > >>several > >>subsequent runs with same settings, this case was clearly mentioned in= =20 > >>the results. > > > >FYI, 2 is not really enough, you should do at least 10 repetitions of ea= ch=20 > >test to reduce variance (which can be a lot, despite what you saw!) and = so=20 > >that differences between them can be accurately estimated. Ministat is= =20 > >really helpful for this. >=20 > Typically, I do 12 runs of supersmack in each configuration, and discard= =20 > the first 2 runs in which the cache and scheduler (etc) are still settlin= g,=20 > as I'm interested in the steady state. Yeah, forgot to mention that too. Also keeping in mind that mysql performance is not time-constant, e.g. you should restart it in between test configurations instead of comparing early and late times. Kris --zYM0uCDKw75PZbzx Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.3 (FreeBSD) iD8DBQFEXlGtWry0BWjoQKURAh/BAKCPgPuGgxUzTeBWbstBc85S8zAEQQCgpDtT qP+XbWrbbL5xauyq3dOie18= =gMww -----END PGP SIGNATURE----- --zYM0uCDKw75PZbzx--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20060507195941.GA2978>