From owner-freebsd-performance@freebsd.org Wed Nov 11 22:34:22 2015 Return-Path: Delivered-To: freebsd-performance@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E8185A2C003 for ; Wed, 11 Nov 2015 22:34:22 +0000 (UTC) (envelope-from dan@langille.org) Received: from clavin1.langille.org (clavin.langille.org [162.208.116.86]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "clavin.langille.org", Issuer "StartCom Class 2 Primary Intermediate Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id BC4981822 for ; Wed, 11 Nov 2015 22:34:21 +0000 (UTC) (envelope-from dan@langille.org) Received: from (clavin1.int.langille.org (clavin1.int.unixathome.org [10.4.7.7]) (Authenticated sender: hidden) with ESMTPSA id CDC8B2599 ; Wed, 11 Nov 2015 22:34:12 +0000 (UTC) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 9.1 \(3096.5\)) Subject: Re: Measuring ZFS configuration differences From: Dan Langille In-Reply-To: <8B37FEDC-218A-4071-8CB7-48361BB72B1D@langille.org> Date: Wed, 11 Nov 2015 17:34:12 -0500 Cc: freebsd-performance@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <14A0EA61-6545-42BB-910E-62C752D4396C@langille.org> References: <8B37FEDC-218A-4071-8CB7-48361BB72B1D@langille.org> To: Marcelo Araujo X-Mailer: Apple Mail (2.3096.5) X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Nov 2015 22:34:23 -0000 On Oct 12, 2015, at 1:00 PM, Dan Langille wrote: >=20 > Following up on the discussions during EuroBSDCon 2015 (Stockholm) = during the FreeBSD Developer > Summit regarding various ZFS configuration settings, I write to start = our implementation phase now that some > usual suspects have joined the list. >=20 > re https://wiki.freebsd.org/201510DevSummit/Performance >=20 > I think the first order of business is granting access rights to the = server (varm) in question: >=20 > http://dan.langille.org/2015/07/19/varm/ >=20 > During the workshop, mention was made of serial access. I can arrange = that. >=20 > The server has IPMI, however, my first thought: >=20 > 1 - connect a USB-serial cable to varm & link that to another server = in my rack. Marcelo: At EuroBSDCon, was it you who mentioned a particular = configuration for the test machine which made it easy to configure and run tests? Was it PXE booting or something? > 2 - create a jail in that server and give it access to that serial = connection > 3 - redirect incoming port XYZ to that jail via a public-key-only ssh = connection > 4 - give people access >=20 > Any suggestions? =E2=80=94=20 Dan Langille http://langille.org/ From owner-freebsd-performance@freebsd.org Thu Nov 12 06:30:10 2015 Return-Path: Delivered-To: freebsd-performance@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D1F5AA2C64B for ; Thu, 12 Nov 2015 06:30:10 +0000 (UTC) (envelope-from araujobsdport@gmail.com) Received: from mail-oi0-x22c.google.com (mail-oi0-x22c.google.com [IPv6:2607:f8b0:4003:c06::22c]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 96F3013DA for ; Thu, 12 Nov 2015 06:30:10 +0000 (UTC) (envelope-from araujobsdport@gmail.com) Received: by oige206 with SMTP id e206so28038259oig.2 for ; Wed, 11 Nov 2015 22:30:09 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:reply-to:in-reply-to:references:date:message-id :subject:from:to:cc:content-type; bh=Uz2dlpwv2UeMu+xGFovc5Z0w/juO15RTKeIocx8mU+I=; b=W8ybeO5kLmqAaYvOV0MWllwMFbZFGcEl92VvYOY0GIcQdX84zFUDXMS7amQl1siiAM z3Ri8jlE+QlcAZmcQGkVtpAaydwYSdiyQdfzVolu2Sy2XP5MBwj5OJlZANaTtJXo/boL VdZGPSJiyGuLaFN0V9ZBZdqJG3nluIvD54lObwoVPLQmjk1ec72bhaz7IK9GVmBb5gX1 zB3HOJLM5FboyjPf6IVmF2wZhYaVyFLx95Ml/PNR9ItztWYjuF3zm243DABDG3kI17Nf Lw6WxvbFbaBOtNDpE2tV2IF1is6kJGTnMECBjTtQmCDN9/ydSkWyZvXF8WR9cHVw2Qqe fxaA== MIME-Version: 1.0 X-Received: by 10.202.59.132 with SMTP id i126mr7380925oia.63.1447309809301; Wed, 11 Nov 2015 22:30:09 -0800 (PST) Received: by 10.182.250.227 with HTTP; Wed, 11 Nov 2015 22:30:09 -0800 (PST) Reply-To: araujo@FreeBSD.org In-Reply-To: <14A0EA61-6545-42BB-910E-62C752D4396C@langille.org> References: <8B37FEDC-218A-4071-8CB7-48361BB72B1D@langille.org> <14A0EA61-6545-42BB-910E-62C752D4396C@langille.org> Date: Thu, 12 Nov 2015 14:30:09 +0800 Message-ID: Subject: Re: Measuring ZFS configuration differences From: Marcelo Araujo To: Dan Langille Cc: freebsd-performance@freebsd.org Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 12 Nov 2015 06:30:10 -0000 2015-11-12 6:34 GMT+08:00 Dan Langille : > On Oct 12, 2015, at 1:00 PM, Dan Langille wrote: > > > > Following up on the discussions during EuroBSDCon 2015 (Stockholm) > during the FreeBSD Developer > > Summit regarding various ZFS configuration settings, I write to start > our implementation phase now that some > > usual suspects have joined the list. > > > > re https://wiki.freebsd.org/201510DevSummit/Performance > > > > I think the first order of business is granting access rights to the > server (varm) in question: > > > > http://dan.langille.org/2015/07/19/varm/ > > > > During the workshop, mention was made of serial access. I can arrange > that. > > > > The server has IPMI, however, my first thought: > > > > 1 - connect a USB-serial cable to varm & link that to another server in > my rack. > > Marcelo: At EuroBSDCon, was it you who mentioned a particular > configuration for the test machine which made > it easy to configure and run tests? Was it PXE booting or something? > > > 2 - create a jail in that server and give it access to that serial > connection > > 3 - redirect incoming port XYZ to that jail via a public-key-only ssh > connection > > 4 - give people access > > > > Any suggestions? > > =E2=80=94 > Dan Langille > http://langille.org/ > > Hello Dan, Yes, was me :) I mention about zopkio test framework. I gave a presentation last weekend at PyCon Hong Kong about it. Here is my slides: http://www.slideshare.net/araujobsd/functional-and-scale-performance-tests-= using-zopkio The good of Zopkio is, we can write tests at once and run it as much as we want in different machines. Also Zopkio depends of Naarad, that can parse a CSV file and create metrics and SLA over those metrics, plot graphs and so on. Pretty nice tool!!! I'm wondering if we could start to test something and maybe show it at AsiaBSDCon and BSDCon(Canada) next year? What do you think? What I need right now would be a list of tests that we want to perform as well as what parameters we would like to take as metrics to compare. Best Regards, --=20 --=20 Marcelo Araujo (__)araujo@FreeBSD.org \\\'',)http://www.FreeBSD.org \/ \ ^ Power To Server. .\. /_) From owner-freebsd-performance@freebsd.org Thu Nov 12 06:38:35 2015 Return-Path: Delivered-To: freebsd-performance@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E55B9A2C8FE for ; Thu, 12 Nov 2015 06:38:34 +0000 (UTC) (envelope-from allanjude@freebsd.org) Received: from mx1.scaleengine.net (mx1.scaleengine.net [209.51.186.6]) by mx1.freebsd.org (Postfix) with ESMTP id A7602190C for ; Thu, 12 Nov 2015 06:38:34 +0000 (UTC) (envelope-from allanjude@freebsd.org) Received: from [10.1.1.2] (unknown [10.1.1.2]) (Authenticated sender: allanjude.freebsd@scaleengine.com) by mx1.scaleengine.net (Postfix) with ESMTPSA id 6AE7BD56B for ; Thu, 12 Nov 2015 06:38:28 +0000 (UTC) Subject: Re: Measuring ZFS configuration differences To: freebsd-performance@freebsd.org References: <8B37FEDC-218A-4071-8CB7-48361BB72B1D@langille.org> <14A0EA61-6545-42BB-910E-62C752D4396C@langille.org> From: Allan Jude Message-ID: <564433F2.2050601@freebsd.org> Date: Thu, 12 Nov 2015 01:38:42 -0500 User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:38.0) Gecko/20100101 Thunderbird/38.3.0 MIME-Version: 1.0 In-Reply-To: Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="AChIpCt7ogtCFlInP2XRI3IW6SsuB5WfT" X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 12 Nov 2015 06:38:35 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --AChIpCt7ogtCFlInP2XRI3IW6SsuB5WfT Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable On 2015-11-12 01:30, Marcelo Araujo wrote: > 2015-11-12 6:34 GMT+08:00 Dan Langille : >=20 >> On Oct 12, 2015, at 1:00 PM, Dan Langille wrote: >>> >>> Following up on the discussions during EuroBSDCon 2015 (Stockholm) >> during the FreeBSD Developer >>> Summit regarding various ZFS configuration settings, I write to start= >> our implementation phase now that some >>> usual suspects have joined the list. >>> >>> re https://wiki.freebsd.org/201510DevSummit/Performance >>> >>> I think the first order of business is granting access rights to the >> server (varm) in question: >>> >>> http://dan.langille.org/2015/07/19/varm/ >>> >>> During the workshop, mention was made of serial access. I can arrang= e >> that. >>> >>> The server has IPMI, however, my first thought: >>> >>> 1 - connect a USB-serial cable to varm & link that to another server = in >> my rack. >> >> Marcelo: At EuroBSDCon, was it you who mentioned a particular >> configuration for the test machine which made >> it easy to configure and run tests? Was it PXE booting or something? >> >>> 2 - create a jail in that server and give it access to that serial >> connection >>> 3 - redirect incoming port XYZ to that jail via a public-key-only ssh= >> connection >>> 4 - give people access >>> >>> Any suggestions? >> >> =E2=80=94 >> Dan Langille >> http://langille.org/ >> >> > Hello Dan, >=20 > Yes, was me :) >=20 > I mention about zopkio test framework. > I gave a presentation last weekend at PyCon Hong Kong about it. >=20 > Here is my slides: > http://www.slideshare.net/araujobsd/functional-and-scale-performance-te= sts-using-zopkio >=20 > The good of Zopkio is, we can write tests at once and run it as much as= we > want in different machines. Also Zopkio depends of Naarad, that can par= se a > CSV file and create metrics and SLA over those metrics, plot graphs and= so > on. Pretty nice tool!!! >=20 > I'm wondering if we could start to test something and maybe show it at > AsiaBSDCon and BSDCon(Canada) next year? What do you think? > What I need right now would be a list of tests that we want to perform = as > well as what parameters we would like to take as metrics to compare. >=20 > Best Regards, >=20 >=20 Would this work for testing other things, like SSH performance? I am looking at doing some SSH + HPN tests to prove that it is worth keeping. --=20 Allan Jude --AChIpCt7ogtCFlInP2XRI3IW6SsuB5WfT Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.22 (MingW32) iQIcBAEBAgAGBQJWRDP2AAoJEBmVNT4SmAt+8D8P/0v+z8v0LPF+J96AqFqBw/G8 GBlq0BUXsF8JyWAsTDBunGfM8B5CAQU6Xp/V73uGeBRJCf8gYmPa+5t19M/2bHqh IDAabb36qexGNc0ohPrChv8eUJDPFYMOgffNl28LvXIckWRkg+yMksmaqBtI42nJ hBoBHmZXlEOMMJ4ebLNXS9Q8K0BQrb27CSwv2JwvjlM0meQbyIWhAnXdVMoI1UVx +r0evRBTGWoEeWWB1yYTYoJSOFaNiNYjl/cUsTcSNZVJlu4OELqwq+et7oEqVPLE fiDlgetiFbPK7ALFjXsy+bZqwK5UyX83TZuwz+b63fQsXi/hLVbUY+LOq8o+sdDb e+9UJxJRCVsP/1WbV/ZpWehRLsnQthnYYgrlLWwTUqpiaPSe6812Bums0O6mBiE5 +NX6SJk4ZebDFsJ/fN7d3YMdoJm0zsBz/5e4BEwMuOhQ1zRBoZSOH8+35rUV8MUP 8DtjvX6vJGa3egS2q9SBlAOE6GA+iVdPIVLVtITVI7kFI2BLFwDS3B9ybjnYF+iX 7U6x6tpgDXa7RyCSk90P1UPhDIBBNiGDgfhwmjepshR7jBOErX1g401+MqkGyel8 A6TM21ldTlE9ZLaxX5AuOXnLAJltFLzDWdDVZxkz8oLRngqrIdoXtjt0YHuiKkZh PpduKtDUI3LSakGPZIO0 =01ne -----END PGP SIGNATURE----- --AChIpCt7ogtCFlInP2XRI3IW6SsuB5WfT-- From owner-freebsd-performance@freebsd.org Thu Nov 12 06:40:36 2015 Return-Path: Delivered-To: freebsd-performance@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id AA569A2CAB1 for ; Thu, 12 Nov 2015 06:40:36 +0000 (UTC) (envelope-from araujobsdport@gmail.com) Received: from mail-ob0-x22d.google.com (mail-ob0-x22d.google.com [IPv6:2607:f8b0:4003:c01::22d]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 781991ADB; Thu, 12 Nov 2015 06:40:36 +0000 (UTC) (envelope-from araujobsdport@gmail.com) Received: by obdgf3 with SMTP id gf3so39909453obd.3; Wed, 11 Nov 2015 22:40:35 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:reply-to:in-reply-to:references:date:message-id :subject:from:to:cc:content-type; bh=3xYlDQFPMA1BUB4mFVEZAVxauLSHCpvM0rJRbpXwxEU=; b=nL2ocA9QTqSs6OU8yDUQtRXbDFNg/iiELYeAkpmzMYc0tZuVLlROmqvYUqlS3ZgdV1 44vppUvgW++q7brbxElPp0LKgKIBgf4A57+rSoqn+ZOkFvRR+e2VuPVOUPH2HckRiRz7 IIMTjEY8vKlxWhkAucUAEVx7wRSPevNN/YJzgK86m6MJjivs4/Bpv5/B3DLFdJ6FCaGJ j2iCrF+kPGu+ATMX44x6E+OVw/2f0G1yolCQXBKn6cop1JRX+gV8Yeu/yv9M0sdW97by paSrrCFNEsScIaznXcmIygzd1FXPZZSjh7AswELc6kQa3Rxqtq31jDHyERLa7t65HW3k sSag== MIME-Version: 1.0 X-Received: by 10.60.44.228 with SMTP id h4mr7514221oem.64.1447310435746; Wed, 11 Nov 2015 22:40:35 -0800 (PST) Received: by 10.182.250.227 with HTTP; Wed, 11 Nov 2015 22:40:35 -0800 (PST) Reply-To: araujo@FreeBSD.org In-Reply-To: <564433F2.2050601@freebsd.org> References: <8B37FEDC-218A-4071-8CB7-48361BB72B1D@langille.org> <14A0EA61-6545-42BB-910E-62C752D4396C@langille.org> <564433F2.2050601@freebsd.org> Date: Thu, 12 Nov 2015 14:40:35 +0800 Message-ID: Subject: Re: Measuring ZFS configuration differences From: Marcelo Araujo To: Allan Jude Cc: freebsd-performance@freebsd.org Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 12 Nov 2015 06:40:36 -0000 2015-11-12 14:38 GMT+08:00 Allan Jude : > On 2015-11-12 01:30, Marcelo Araujo wrote: > > 2015-11-12 6:34 GMT+08:00 Dan Langille : > > > >> On Oct 12, 2015, at 1:00 PM, Dan Langille wrote: > >>> > >>> Following up on the discussions during EuroBSDCon 2015 (Stockholm) > >> during the FreeBSD Developer > >>> Summit regarding various ZFS configuration settings, I write to start > >> our implementation phase now that some > >>> usual suspects have joined the list. > >>> > >>> re https://wiki.freebsd.org/201510DevSummit/Performance > >>> > >>> I think the first order of business is granting access rights to the > >> server (varm) in question: > >>> > >>> http://dan.langille.org/2015/07/19/varm/ > >>> > >>> During the workshop, mention was made of serial access. I can arrang= e > >> that. > >>> > >>> The server has IPMI, however, my first thought: > >>> > >>> 1 - connect a USB-serial cable to varm & link that to another server = in > >> my rack. > >> > >> Marcelo: At EuroBSDCon, was it you who mentioned a particular > >> configuration for the test machine which made > >> it easy to configure and run tests? Was it PXE booting or something? > >> > >>> 2 - create a jail in that server and give it access to that serial > >> connection > >>> 3 - redirect incoming port XYZ to that jail via a public-key-only ssh > >> connection > >>> 4 - give people access > >>> > >>> Any suggestions? > >> > >> =E2=80=94 > >> Dan Langille > >> http://langille.org/ > >> > >> > > Hello Dan, > > > > Yes, was me :) > > > > I mention about zopkio test framework. > > I gave a presentation last weekend at PyCon Hong Kong about it. > > > > Here is my slides: > > > http://www.slideshare.net/araujobsd/functional-and-scale-performance-test= s-using-zopkio > > > > The good of Zopkio is, we can write tests at once and run it as much as > we > > want in different machines. Also Zopkio depends of Naarad, that can > parse a > > CSV file and create metrics and SLA over those metrics, plot graphs and > so > > on. Pretty nice tool!!! > > > > I'm wondering if we could start to test something and maybe show it at > > AsiaBSDCon and BSDCon(Canada) next year? What do you think? > > What I need right now would be a list of tests that we want to perform = as > > well as what parameters we would like to take as metrics to compare. > > > > Best Regards, > > > > > > Would this work for testing other things, like SSH performance? I am > looking at doing some SSH + HPN tests to prove that it is worth keeping. > > -- > Allan Jude > > It would depends what kind of performance you want to test! If the metrics you can output to a CSV file, the answer would be yes, it can! Best, --=20 --=20 Marcelo Araujo (__)araujo@FreeBSD.org \\\'',)http://www.FreeBSD.org \/ \ ^ Power To Server. .\. /_)