From owner-freebsd-performance@freebsd.org Tue Nov 24 18:13:24 2015 Return-Path: Delivered-To: freebsd-performance@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id EBDBBA362FC for ; Tue, 24 Nov 2015 18:13:23 +0000 (UTC) (envelope-from dan@langille.org) Received: from clavin1.langille.org (clavin.langille.org [162.208.116.86]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "clavin.langille.org", Issuer "StartCom Class 2 Primary Intermediate Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id B6FE018D3; Tue, 24 Nov 2015 18:13:23 +0000 (UTC) (envelope-from dan@langille.org) Received: from (clavin1.int.langille.org (clavin1.int.unixathome.org [10.4.7.7]) (Authenticated sender: hidden) with ESMTPSA id 4914F535C ; Tue, 24 Nov 2015 18:13:06 +0000 (UTC) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 9.1 \(3096.5\)) Subject: Re: Measuring ZFS configuration differences From: Dan Langille In-Reply-To: Date: Tue, 24 Nov 2015 13:13:06 -0500 Cc: freebsd-performance@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <21F00F37-FC30-4AE5-B5E5-7FD8C22004E9@langille.org> References: <8B37FEDC-218A-4071-8CB7-48361BB72B1D@langille.org> <14A0EA61-6545-42BB-910E-62C752D4396C@langille.org> To: Marcelo Araujo X-Mailer: Apple Mail (2.3096.5) X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 24 Nov 2015 18:13:24 -0000 > On Nov 18, 2015, at 4:12 PM, Dan Langille wrote: >=20 >=20 >> On Nov 17, 2015, at 9:31 PM, Marcelo Araujo = wrote: >>=20 >> 2015-11-18 10:23 GMT+08:00 Dan Langille : >>=20 >>>=20 >>>> On Nov 17, 2015, at 8:46 PM, Marcelo Araujo = >>> wrote: >>>>=20 >>>> 2015-11-18 3:14 GMT+08:00 Dan Langille : >>>>=20 >>>>>=20 >>>>> On Nov 12, 2015, at 1:30 AM, Marcelo Araujo = >>>>> wrote: >>>>>=20 >>>>>=20 >>>>>=20 >>>>> 2015-11-12 6:34 GMT+08:00 Dan Langille : >>>>>=20 >>>>>> On Oct 12, 2015, at 1:00 PM, Dan Langille = wrote: >>>>>>>=20 >>>>>>> Following up on the discussions during EuroBSDCon 2015 = (Stockholm) >>>>>> during the FreeBSD Developer >>>>>>> Summit regarding various ZFS configuration settings, I write to = start >>>>>> our implementation phase now that some >>>>>>> usual suspects have joined the list. >>>>>>>=20 >>>>>>> re https://wiki.freebsd.org/201510DevSummit/Performance >>>>>>>=20 >>>>>>> I think the first order of business is granting access rights to = the >>>>>> server (varm) in question: >>>>>>>=20 >>>>>>> http://dan.langille.org/2015/07/19/varm/ >>>>>>>=20 >>>>>>> During the workshop, mention was made of serial access. I can = arrange >>>>>> that. >>>>>>>=20 >>>>>>> The server has IPMI, however, my first thought: >>>>>>>=20 >>>>>>> 1 - connect a USB-serial cable to varm & link that to another = server >>> in >>>>>> my rack. >>>>>>=20 >>>>>> Marcelo: At EuroBSDCon, was it you who mentioned a particular >>>>>> configuration for the test machine which made >>>>>> it easy to configure and run tests? Was it PXE booting or = something? >>>>>>=20 >>>>>>> 2 - create a jail in that server and give it access to that = serial >>>>>> connection >>>>>>> 3 - redirect incoming port XYZ to that jail via a = public-key-only ssh >>>>>> connection >>>>>>> 4 - give people access >>>>>>>=20 >>>>>>> Any suggestions? >>>>>>=20 >>>>>> =E2=80=94 >>>>>> Dan Langille >>>>>> http://langille.org/ >>>>>>=20 >>>>>>=20 >>>>> Hello Dan, >>>>>=20 >>>>> Yes, was me :) >>>>>=20 >>>>> I mention about zopkio test framework. >>>>> I gave a presentation last weekend at PyCon Hong Kong about it. >>>>>=20 >>>>> Here is my slides: >>>>>=20 >>> = http://www.slideshare.net/araujobsd/functional-and-scale-performance-tests= -using-zopkio >>>>>=20 >>>>> The good of Zopkio is, we can write tests at once and run it as = much as >>> we >>>>> want in different machines. Also Zopkio depends of Naarad, that = can >>> parse a >>>>> CSV file and create metrics and SLA over those metrics, plot = graphs and >>> so >>>>> on. Pretty nice tool!!! >>>>>=20 >>>>> I'm wondering if we could start to test something and maybe show = it at >>>>> AsiaBSDCon and BSDCon(Canada) next year? What do you think? >>>>> What I need right now would be a list of tests that we want to = perform >>> as >>>>> well as what parameters we would like to take as metrics to = compare.\ >>>>>=20 >>>>>=20 >>>>> For tests, we can start with this list: >>>>> https://github.com/dlangille/zfs_benchmarks/issues >>>>>=20 >>>>> We can start as soon as I figure out how to provide access to the >>>>> testers. See above re serial connection. >>>>>=20 >>>>> I want to provide access, but I want to keep access restricted to = only >>>>> this box and not to the rest of my home LAN. I plan to do this = via a >>>>> VLAN. >>>>>=20 >>>>> I could fire up a Rasperberry Pi and allow ssh into that. Will = that be >>>>> enough >>>>> power for what you need to do? >>>>>=20 >>>>>=20 >>>> First of all, thanks to share the tests cases. >>>>=20 >>>> If I use zopkio, the best would be access SSH direct to the target >>> machine >>>> where I need to run the tests. For zopkio, I need to have my SSH = KEY on >>> the >>>> target machine. >>>=20 >>> I am OK with this. >>>=20 >>>> As I don't know your network, maybe what you could do is: Via >>> RasperBerry, >>>> forward the SSH to the target machine, I will pass-through via your >>>> RasperBerry where you can control the access for the rest of your = LAN. >>>>=20 >>>> Another approach could be, two different subnets and a firewall. Or = as >>> you >>>> said, VLANS. >>>=20 >>> I will be doing VLANS, which have yet to be set up. >>>=20 >>> The target system will have ZFS pools can be configured for = different >>> tests (i.e. raidz2 vs raidz3). >>> This will involve gpart etc because the drives & pools will need to = be >>> 'wiped' between different test >>> runs. >>>=20 >>> I seem to recall someone suggesting PXE boot and configuring the = system >>> remotely. Does anyone >>> recall that? That aspect of the discussion was not recorded: >>> https://wiki.freebsd.org/201510DevSummit/Performance >>>=20 >>>=20 >> Bapt@ mentioned that, this is the way how we are doing in another = project. >> But in my point of view, it is not a must for our case! >>=20 >> The PXE wold be good if we try to test different of OS flavors, or = build >> different images. >=20 > OK. The only thing holding us back is: >=20 > - adding the air filters to the case > - moving to the new switch with the new VLANs >=20 > It's now a matter of time. Done. The server is ready for access. Please send me your ssh-key off-list and I will create a login for you. We do have some data on the system: $ zpool list NAME SIZE ALLOC FREE EXPANDSZ FRAG CAP DEDUP = HEALTH ALTROOT benchmarking 21.8T 6.44T 15.3T - 11% 29% 1.00x = ONLINE - music 30T 5.58T 24.4T - 9% 18% 1.00x = ONLINE - random_mirror 2.72T 372K 2.72T - 0% 0% 1.00x = ONLINE - zroot 220G 1.79G 218G - 0% 0% 1.00x = ONLINE - The music pool has about 1.4TB of music files for testing via copy. =E2=80=94=20 Dan Langille http://langille.org/ From owner-freebsd-performance@freebsd.org Wed Nov 25 02:00:18 2015 Return-Path: Delivered-To: freebsd-performance@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 430C5A37AE5 for ; Wed, 25 Nov 2015 02:00:18 +0000 (UTC) (envelope-from araujobsdport@gmail.com) Received: from mail-ob0-x22c.google.com (mail-ob0-x22c.google.com [IPv6:2607:f8b0:4003:c01::22c]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 05F35135E for ; Wed, 25 Nov 2015 02:00:18 +0000 (UTC) (envelope-from araujobsdport@gmail.com) Received: by obbnk6 with SMTP id nk6so28450858obb.2 for ; Tue, 24 Nov 2015 18:00:17 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:reply-to:in-reply-to:references:date:message-id :subject:from:to:cc:content-type; bh=dgEr7wOxYmt7mHxd8wvegT58beut51XYhfQaYjyAM4g=; b=lIy9LpeGXXkuZXJCRkOnmLWjRQyJFAoVZ0knvKGru0xMYtXlL5VR3YK9rb8aDNm1Na wHQlMdn6bjpjd1RVkCXmvffQR3lnag/oULwXLhHFSi6WYn13cTbNf2dVmEcPHDDg6KiH B6OCRKFL2XKx6YqdZpaY9FCLx6clcUavxCE5R2e4EAKITrrl/A2vrESAYuSUbj6mV9hT j0X2NNG9IRWPXxOlgjiSY6cAUSHlvReT8HBL2jrvNuf+WzFulDJ23b5cWneC9OrzO1ol QrthjyKwJ57Tw1+tvRJ3l15rhucNC26bIAT3U19dOaJssYq0v2GScwDSNTFikSrOVMy8 LcAg== MIME-Version: 1.0 X-Received: by 10.60.246.67 with SMTP id xu3mr23365744oec.59.1448416817216; Tue, 24 Nov 2015 18:00:17 -0800 (PST) Received: by 10.182.174.1 with HTTP; Tue, 24 Nov 2015 18:00:17 -0800 (PST) Reply-To: araujo@FreeBSD.org In-Reply-To: <21F00F37-FC30-4AE5-B5E5-7FD8C22004E9@langille.org> References: <8B37FEDC-218A-4071-8CB7-48361BB72B1D@langille.org> <14A0EA61-6545-42BB-910E-62C752D4396C@langille.org> <21F00F37-FC30-4AE5-B5E5-7FD8C22004E9@langille.org> Date: Wed, 25 Nov 2015 10:00:17 +0800 Message-ID: Subject: Re: Measuring ZFS configuration differences From: Marcelo Araujo To: Dan Langille Cc: freebsd-performance@freebsd.org Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 25 Nov 2015 02:00:18 -0000 Hey Dan! 2015-11-25 2:13 GMT+08:00 Dan Langille : > > > Done. > > The server is ready for access. > Cool!!! Very good news, thank you to work on it and provide resources! > > Please send me your ssh-key off-list and I will create a login for you. > I will do very soon! > > We do have some data on the system: > > $ zpool list > NAME SIZE ALLOC FREE EXPANDSZ FRAG CAP DEDUP HEALTH > ALTROOT > benchmarking 21.8T 6.44T 15.3T - 11% 29% 1.00x ONLINE > - > music 30T 5.58T 24.4T - 9% 18% 1.00x ONLINE > - > random_mirror 2.72T 372K 2.72T - 0% 0% 1.00x ONLINE > - > zroot 220G 1.79G 218G - 0% 0% 1.00x ONLINE > - > > The music pool has about 1.4TB of music files for testing via copy. > By the name, I guess the benchmark(ing) is the one we will use for our tests. Best, -- -- Marcelo Araujo (__)araujo@FreeBSD.org \\\'',)http://www.FreeBSD.org \/ \ ^ Power To Server. .\. /_) From owner-freebsd-performance@freebsd.org Wed Nov 25 15:21:00 2015 Return-Path: Delivered-To: freebsd-performance@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3D627A37D1D for ; Wed, 25 Nov 2015 15:21:00 +0000 (UTC) (envelope-from dan@langille.org) Received: from clavin1.langille.org (clavin.langille.org [162.208.116.86]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "clavin.langille.org", Issuer "StartCom Class 2 Primary Intermediate Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id F0DF61601; Wed, 25 Nov 2015 15:20:59 +0000 (UTC) (envelope-from dan@langille.org) Received: from (clavin1.int.langille.org (clavin1.int.unixathome.org [10.4.7.7]) (Authenticated sender: hidden) with ESMTPSA id F32BD5382 ; Wed, 25 Nov 2015 15:20:58 +0000 (UTC) Subject: Re: Measuring ZFS configuration differences Mime-Version: 1.0 (Mac OS X Mail 9.1 \(3096.5\)) Content-Type: multipart/signed; boundary="Apple-Mail=_912B0EB8-11C8-49E5-AABD-F8C68AD33553"; protocol="application/pgp-signature"; micalg=pgp-sha512 X-Pgp-Agent: GPGMail 2.6b2 From: Dan Langille In-Reply-To: Date: Wed, 25 Nov 2015 10:20:59 -0500 Cc: freebsd-performance@freebsd.org Message-Id: References: <8B37FEDC-218A-4071-8CB7-48361BB72B1D@langille.org> <14A0EA61-6545-42BB-910E-62C752D4396C@langille.org> <21F00F37-FC30-4AE5-B5E5-7FD8C22004E9@langille.org> To: Marcelo Araujo X-Mailer: Apple Mail (2.3096.5) X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 25 Nov 2015 15:21:00 -0000 --Apple-Mail=_912B0EB8-11C8-49E5-AABD-F8C68AD33553 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 > On Nov 24, 2015, at 9:00 PM, Marcelo Araujo = wrote: >=20 > Hey Dan! >=20 > 2015-11-25 2:13 GMT+08:00 Dan Langille : >=20 >>=20 >>=20 >> Done. >>=20 >> The server is ready for access. >>=20 >=20 > Cool!!! Very good news, thank you to work on it and provide resources! >=20 >=20 >>=20 >> Please send me your ssh-key off-list and I will create a login for = you. >>=20 >=20 > I will do very soon! >=20 >=20 >>=20 >> We do have some data on the system: >>=20 >> $ zpool list >> NAME SIZE ALLOC FREE EXPANDSZ FRAG CAP DEDUP = HEALTH >> ALTROOT >> benchmarking 21.8T 6.44T 15.3T - 11% 29% 1.00x = ONLINE >> - >> music 30T 5.58T 24.4T - 9% 18% 1.00x = ONLINE >> - >> random_mirror 2.72T 372K 2.72T - 0% 0% 1.00x = ONLINE >> - >> zroot 220G 1.79G 218G - 0% 0% 1.00x = ONLINE >> - >>=20 >> The music pool has about 1.4TB of music files for testing via copy. >>=20 >=20 > By the name, I guess the benchmark(ing) is the one we will use for our > tests. I want to retain music intact. I think everything else can be = reconfigured as required. We will be doing a lot of reconfiguration: raidz1-3, 1-13 drives in an = array, etc. For now, let's make sure you can login, ensure your root access works, = etc. =E2=80=94 Dan Langille http://langille.org/ --Apple-Mail=_912B0EB8-11C8-49E5-AABD-F8C68AD33553 Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP using GPGMail -----BEGIN PGP SIGNATURE----- Comment: GPGTools - http://gpgtools.org iQJ8BAEBCgBmBQJWVdHbXxSAAAAAAC4AKGlzc3Vlci1mcHJAbm90YXRpb25zLm9w ZW5wZ3AuZmlmdGhob3JzZW1hbi5uZXQ1MTE2RjM0ODIzRDdERDM4OTY0OUJBNzdF QjIxNTlERUU5NzI3MzlGAAoJEOshWd7pcnOfbPYQAIc03ctmzfqfx+Hwl3pwvYPZ 0Zk1lwUIzpsREukzW90OlkOthjH2vnQehb9m9tsh0ISB2mGXPXDL8cBj3tOKF+JG cAUEegbuWnzIhP6MBJwo7VOP2vR/KSz3ueh98vbpqexGXs/6NPOjNSmnhaQgWow3 Urf5ElyxTeDfhl77PmZaZCODLXV0jyFqIrxlvQ7fHnNrwtJ9bY/j9c+z/47tsrP3 K7taeENP9qZ3MpuWOLBr7jbFEf64m14BRiehWZLH8ewRt4fceV3X8YLKABvnm+Qb gALZARI+AO+xM4/lc+Uq1gIDHrjCP8RyKxnbCCRnrZVX1QyINFmOnXuv8twOTTig O3eiNoasDDJUYadFnd/HDfVK3OGpKgZl0kOxD7gIppfpYoeKZGq7TE+e45cFFdq9 BNrHnW04ShboF5CnZoMMhDJ66VvD5ay8nyoxSdqVn5ZpkfxTvKsoPNxlKmRCdtp4 3VZFijFtUTf5l2+9so+bQQr7M9Gp1yJodI4e+jfXYClOt9vlp/N79y4PXfvD9D7x gJAvqEX4rkI0xaDhsjmozhMu+VKFzQAUwZgCHTbJOlnv6Tj+B2Jy6nO/SD9hJ4he wdxayFSnoxCRfOi1gKzc/t6TaQModq0kKy+nCJKskYycLIA3vkhz/dCvMDk6lw+p 2T7r5QLV3NaLp9pQGbFt =dp68 -----END PGP SIGNATURE----- --Apple-Mail=_912B0EB8-11C8-49E5-AABD-F8C68AD33553--