From owner-dev-commits-src-main@freebsd.org Tue Feb 23 17:01:04 2021 Return-Path: Delivered-To: dev-commits-src-main@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E391E54A3CE; Tue, 23 Feb 2021 17:01:04 +0000 (UTC) (envelope-from mavbsd@gmail.com) Received: from mail-qt1-x82b.google.com (mail-qt1-x82b.google.com [IPv6:2607:f8b0:4864:20::82b]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DlQL85V20z3pGQ; Tue, 23 Feb 2021 17:01:04 +0000 (UTC) (envelope-from mavbsd@gmail.com) Received: by mail-qt1-x82b.google.com with SMTP id c1so12390966qtc.1; Tue, 23 Feb 2021 09:01:04 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=sender:subject:to:cc:references:from:autocrypt:message-id:date :user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=/yBvXi/5pEfzGf02BPka5E3vydo5poXt8IV1c5q5u4Q=; b=rh+ffamo/zN8jJ+n5JoZ0dxHaCRt9YHNhzaLpUTGomngwq6JOLGaac4UzjFARk4nEn O9G9QVVV/zTM3bqw5k0TOVbYvUk+PYwnsWBQW4QaQtsak6ea/XI7UNaH9ZhxroY10PsY 4403FrMR+6l7SbOsS1brWDnsc/cX7pN9Tq97t18cQZLvzeqFWmxttuMXkrZJCn7cBNei LWQ7dRB0V9JrKZjZrluo8evmgK5evWNmZaVhua75IUS460Uc9n1nqKNbArIdg4YG+xdk m2dAehtlMp8Y1ITSgV8OPkVYOMWeirp56XIT/iZ44jRmvRiZBihiH3yUdAx4+XdyHEIy 6dFA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:subject:to:cc:references:from:autocrypt :message-id:date:user-agent:mime-version:in-reply-to :content-language:content-transfer-encoding; bh=/yBvXi/5pEfzGf02BPka5E3vydo5poXt8IV1c5q5u4Q=; b=DaedA2yLRlZ7cl9mRUZb1GckkhYIdpucldUq9ibu+IgAf7Z1H91dMA9fGopRzmoZYU 90vLweqec6FQK1WjRD9W5T7lIaa/jOpn1AcPEewC8SVTz4Y6C6fd8Zg0+zNnskiB/lmA eV49HwlJ3v8OG2tTMFEXcusMBnZkzw1FGStypI9UgyFEhMVqUpTgHkJFTocnDvAbAMAX XDYjFKOiv2HK7u+3seCPW3WwQhgSz68mRUfNrHbdB5PaQro4aaK3ocTK0eTwiM3E3kF3 wKrC46N3CrzogE3uUmcZCLehpEP7kVSguuXIRLvEVkfufz9+NRKD/Z6Be4SYv5roue2/ b9JA== X-Gm-Message-State: AOAM532r9Ou7Tjx7XulquYpuZTVvJMthvo8cmBS7Oil4c3N4b5wHDdnh caMhBvCfQ4d1WViKiRguCEeC8XMMAjid8w== X-Google-Smtp-Source: ABdhPJymYYfgeL5OzVTEF4v7w6I4usMwLOK+5+J0UjQkEAd2KboLAiUMr7z2n9+of+KFBnvl5AdWuA== X-Received: by 2002:ac8:5d45:: with SMTP id g5mr25467553qtx.247.1614099662978; Tue, 23 Feb 2021 09:01:02 -0800 (PST) Received: from mavoffice.ixsystems.com ([38.32.73.2]) by smtp.gmail.com with ESMTPSA id p6sm15015947qkg.36.2021.02.23.09.01.01 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Tue, 23 Feb 2021 09:01:01 -0800 (PST) Sender: Alexander Motin Subject: Re: git: 7d4c444374d5 - main - Bump CTL block backend threads from 14 to 32 per LUN. To: rgrimes@freebsd.org Cc: src-committers@freebsd.org, dev-commits-src-all@freebsd.org, dev-commits-src-main@freebsd.org References: <202102231640.11NGeMsl017773@gndrsh.dnsmgr.net> From: Alexander Motin Autocrypt: addr=mav@FreeBSD.org; prefer-encrypt=mutual; keydata= mQENBFOzxAwBCADkPrax0pI2W/ig0CK9nRJJwsHitAGEZ2HZiFEuti+6/4UVxj81yr4ak/4g 9bKUyC7rMEAp/ZHNhd+MFCPAAcHPvtovnfykqE/vuosCS3wlSLloix2iKVLks0CwbLHGAyne 46lTQW74Xl/33c3W1Z6d8jD9gVFT/xaVzZ0U9xdzOmsYAZaAj4ki0tuxO9F7L+ct9grRe7iP g8t9hai7BL4ee3VRwk2JXnKb7UvBiVITKYWKz1jRvZIrjPokgEcCLOSlv7x/1kjuFnj3xWZU 7HSFFT8J93epBbrSSCsYsppIk2fZH41kaaFXsMQfTPH8wkeM6qwrvOh4HiQM08R+9tThABEB AAG0IUFsZXhhbmRlciBNb3RpbiA8bWF2QEZyZWVCU0Qub3JnPokBVwQTAQoAQQIbAwULCQgH AwUVCgkICwUWAwIBAAIeAQIXgAIZARYhBOmM88TmnMPNDledVYMYw5VbqyJ/BQJZYMKuBQkN McyiAAoJEIMYw5VbqyJ/tuUIAOG3ONOSNYqjK4eTZ1TVh9jdUBAhWk5nhDFnODN49Wj0AbYm 7aIqy8O1hnCDSZG5LttjSAo3UfXJZDKQM0BLb0gpRMBnAYqO6tdolLNqAbPGJBnGoPjsh24y 6KcbDaNnis+lD4GwPXwQM+92wZGhCUFElPV9NciZGVS65TNIgk7X+yEjjhD1MSWKKijZ1r9Z zIt4OzUTxxNOvzdlABZS88nNRdJkatOQJPmFdd1mpP6UzTNCiLUo1pIqOEtJgvVVDYq5WHY6 tciWWYdmZG/tIBexJmv2mV2OLVjXR6ZeKmntVH14H72/wRHJuYHQC+r5SVRcWWayrThsY6jZ Yr4+raS5AQ0EU7PEDAEIAOZgWf2cJIu+58IzP2dkXE/urj3tr4OqrB/yHGWUf71Lz6D0Fi6Z AXgDtmcFLGPfMyWuLAvSM+xmoguk7zC4hRBYvQycmIhuqBq1jO1Wp/Z+lpoPM/1cDYLn8Flv mI/c40MhUZh345DA4jYWWaZNjQHUWVQ1fPf595vdVVMPT/abE8E5DaF6fSkRmqFTmfYRkfbt 3ytU8NdUapDcJVY7cEP2nJBVNZPnOIObR/ZIgSxjjrG5o34yXoqeup8JvwEv+/NylzzuyXEZ R1EdEIzQ/a1nh/0j4NXtzZEqKW4aTWlmSqb6wN8jh1OSOOqkYsfnE3nfxcZbxi4IRoNQYlm5 9R8AEQEAAYkBPAQYAQoAJgIbDBYhBOmM88TmnMPNDledVYMYw5VbqyJ/BQJZYMLYBQkNMczM AAoJEIMYw5VbqyJ/TqgH/RQHClkvecE0262lwKoP/m0Mh4I5TLRgoJJn8S7G1BnqohYJkiLq A6xe6urGD7OqdNAl12UbrjWbdJV+zvea3vJoM4MZuYiYrGaXWxzFXqWJcPwMU9sAh8MRghHu uC5vgPb45Tnftw9/+n0i8GfVhQhOqepUGdQg4NPcXviSkoAvig6pp9Lcxisn0groUQKt15Gc sS9YcQWg3j9Hnipc6Mu416HX98Fb113NHJqc2geTHLkRyuBFOoyIqB6N9GKjzOAIzxxsVdl9 TevwGsrp4M4/RFzWbSgsbOnbE7454lmuVZGfReEjnUm8RHp9Q2UWKXlp3exlZjvOp/uVEpCg lz65AQ0EU7PEDAEIAOZgWf2cJIu+58IzP2dkXE/urj3tr4OqrB/yHGWUf71Lz6D0Fi6ZAXgD tmcFLGPfMyWuLAvSM+xmoguk7zC4hRBYvQycmIhuqBq1jO1Wp/Z+lpoPM/1cDYLn8FlvmI/c 40MhUZh345DA4jYWWaZNjQHUWVQ1fPf595vdVVMPT/abE8E5DaF6fSkRmqFTmfYRkfbt3ytU 8NdUapDcJVY7cEP2nJBVNZPnOIObR/ZIgSxjjrG5o34yXoqeup8JvwEv+/NylzzuyXEZR1Ed EIzQ/a1nh/0j4NXtzZEqKW4aTWlmSqb6wN8jh1OSOOqkYsfnE3nfxcZbxi4IRoNQYlm59R8A EQEAAYkBPAQYAQoAJgIbDBYhBOmM88TmnMPNDledVYMYw5VbqyJ/BQJZYMLYBQkNMczMAAoJ EIMYw5VbqyJ/TqgH/RQHClkvecE0262lwKoP/m0Mh4I5TLRgoJJn8S7G1BnqohYJkiLqA6xe 6urGD7OqdNAl12UbrjWbdJV+zvea3vJoM4MZuYiYrGaXWxzFXqWJcPwMU9sAh8MRghHuuC5v gPb45Tnftw9/+n0i8GfVhQhOqepUGdQg4NPcXviSkoAvig6pp9Lcxisn0groUQKt15GcsS9Y cQWg3j9Hnipc6Mu416HX98Fb113NHJqc2geTHLkRyuBFOoyIqB6N9GKjzOAIzxxsVdl9Tevw Gsrp4M4/RFzWbSgsbOnbE7454lmuVZGfReEjnUm8RHp9Q2UWKXlp3exlZjvOp/uVEpCglz4= Message-ID: <9a722455-7bc0-c10c-9a42-1650952475eb@FreeBSD.org> Date: Tue, 23 Feb 2021 12:01:00 -0500 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:68.0) Gecko/20100101 Thunderbird/68.8.1 MIME-Version: 1.0 In-Reply-To: <202102231640.11NGeMsl017773@gndrsh.dnsmgr.net> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: 4DlQL85V20z3pGQ X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] X-BeenThere: dev-commits-src-main@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Commit messages for the main branch of the src repository List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 23 Feb 2021 17:01:05 -0000 On 23.02.2021 11:40, Rodney W. Grimes wrote: >> The branch main has been updated by mav: >> >> URL: https://cgit.FreeBSD.org/src/commit/?id=7d4c444374d53e54ce197138df64bf40c1fb05a3 >> >> commit 7d4c444374d53e54ce197138df64bf40c1fb05a3 >> Author: Alexander Motin >> AuthorDate: 2021-02-23 15:58:56 +0000 >> Commit: Alexander Motin >> CommitDate: 2021-02-23 16:03:32 +0000 >> >> Bump CTL block backend threads from 14 to 32 per LUN. >> >> This makes random read benchmarks look better on a wide ZFS pools. >> I am not sure where the original value goes from, but it is there >> for too long now. > > I would think this should be bounded by the number of cores/threads > in the system. What happens on a 4 thread system with this value? Since our VFS layer is still synchronous, the primary goal of these threads is to wait for disk I/O. And 4 thread system with HDDs should still benefit from higher value. For SSD system CPUs may become a bottleneck, but it would just speak about under-powered system. My biggest worry is a random locks contention from double number of threads. Not many algorithms scale to 32 threads on small I/Os and very high IOP. But that is theoretical, while on wide pool of slower HDDs I do see double performance from this right now. -- Alexander Motin