Date: Mon, 22 Apr 2024 16:07:00 -0400 From: Karl Denninger <karl@denninger.net> To: freebsd-hackers@freebsd.org Subject: Re: Stressing malloc(9) Message-ID: <b1e56d20-dc98-4fff-adec-3f8cfae26c05@denninger.net> In-Reply-To: <CAOtMX2hDfX-T90x9Fb2Wh%2BvgLvw9fUGmaDxh-FWaYwBTPwFY6Q@mail.gmail.com> References: <CAOtMX2jeDHS15bGgzD89AOAd1SzS_=FikorkCdv9-eAxCZ2P5w@mail.gmail.com> <ZiPaFw0q17RGE7cS@nuc> <CAOtMX2jk6%2BSvqMP7Cbmdk0KQCFZ34yWuir7n_8ewZYJF2MwPSg@mail.gmail.com> <ZiU6IZ29syVsg61p@nuc> <CAOtMX2j=yaYeE%2B-fycg2mRRC_Jb9p74cn_dcenhH2xRRxz1shg@mail.gmail.com> <CAOtMX2hDfX-T90x9Fb2Wh%2BvgLvw9fUGmaDxh-FWaYwBTPwFY6Q@mail.gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
This is a cryptographically signed message in MIME format.
--------------ms080707000903030302050808
Content-Type: multipart/alternative;
boundary="------------H2q7nl5KNV3fGY01y1MXZ54v"
--------------H2q7nl5KNV3fGY01y1MXZ54v
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: base64
T24gNC8yMi8yMDI0IDEyOjQ2LCBBbGFuIFNvbWVycyB3cm90ZToNCj4gV2hlbiBJIHNhaWQg
IjMza2lCIiBJIG1lYW50ICIzMyBwYWdlcyIsIG9yIDEzMiBrQi4gIEFuZCB0aGUgc29sdXRp
b24NCj4gdHVybnMgb3V0IHRvIGJlIHZlcnkgZWFzeS4gIFNpbmNlIEknbSB1c2luZyBaRlMg
b24gdG9wIG9mIGdlbGksIHdpdGgNCj4gdGhlIGRlZmF1bHQgcmVjc2l6ZSBvZiAxMjhrQiwg
SSdsbCBqdXN0IHNldA0KPiB2ZnMuemZzLnZkZXYuYWdncmVnYXRpb25fbGltaXQgdG8gMTI4
IGtCLiAgVGhhdCB3YXkgZ2VsaSB3aWxsIG5ldmVyDQo+IG5lZWQgdG8gYWxsb2NhdGUgbW9y
ZSB0aGFuIDEyOGtCIGNvbnRpZ3VvdXNseS4gIFpGUyBkb2Vzbid0IGV2ZW4gbmVlZA0KPiB0
aG9zZSBiaWcgYWxsb2NhdGlvbnMgdG8gYmUgY29udGlndW91czsgaXQncyBqdXN0IGFnZ3Jl
Z2F0aW5nIHNtYWxsZXINCj4gb3BlcmF0aW9ucyB0byByZWR1Y2UgZGlzayBJT1BzLiAgQnV0
IGFnZ3JlZ2F0aW5nIHVwIHRvIDFNQiAodGhlDQo+IGRlZmF1bHQpIGlzIG92ZXJraWxsOyBh
bnkgcm90YXRpbmcgSEREIHNob3VsZCBlYXNpbHkgYmUgYWJsZSB0byBtYXgNCj4gb3V0IGl0
cyBjb25zZWN1dGl2ZSB3cml0ZSBJT1BzIHdpdGggMTI4a0Igb3BlcmF0aW9uIHNpemUuICBJ
J2xsIGFkZCBhDQo+IHJlYWQtb25seSBzeXNjdGwgZm9yIGdfZWxpX2FsbG9jX3N6IHRvby4g
IFRoYW5rcyBNYXJrLg0KPg0KPiAtQWxhbg0KDQpTZXR0aW5nIHRoaXMgb24gb25lIG9mIG15
IHByb2R1Y3Rpb24gbWFjaGluZXMgdGhhdCB1c2VzIHpmcyBiZWhpbmQgZ2VsaSANCmRyb3Bz
IHRoZSBsb2FkIGF2ZXJhZ2UgcXVpdGUgbWF0ZXJpYWxseSB3aXRoIHplcm8gaW1wYWN0IG9u
IHRocm91Z2hwdXQgDQp0aGF0IEkgY2FuIHNlZSAodGh1cyBmYXIuKcKgIEkgd2lsbCBydW4g
dGhpcyBmb3IgYSB3aGlsZSBidXQgaXQgY2VydGFpbmx5IA0KZG9lc24ndCBhcHBlYXIgdG8g
aGF2ZSBhbnkgbmVnYXRpdmVzIGFzc29jaWF0ZWQgd2l0aCBpdCBhbmQgZG9lcyBhcHBlYXIg
DQp0byBpbXByb3ZlIGVmZmljaWVuY3kgcXVpdGUgYSBiaXQuDQoNCi0tIA0KS2FybCBEZW5u
aW5nZXINCmthcmxAZGVubmluZ2VyLm5ldA0KL1RoZSBNYXJrZXQgVGlja2VyLw0KL1tTL01J
TUUgZW5jcnlwdGVkIGVtYWlsIHByZWZlcnJlZF0vDQo=
--------------H2q7nl5KNV3fGY01y1MXZ54v
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
<!DOCTYPE html>
<html>
<head>
<meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3DUTF=
-8">
</head>
<body>
<div class=3D"moz-cite-prefix">On 4/22/2024 12:46, Alan Somers wrote:=
<br>
</div>
<blockquote type=3D"cite"
cite=3D"mid:CAOtMX2hDfX-T90x9Fb2Wh+vgLvw9fUGmaDxh-FWaYwBTPwFY6Q@mail.gmai=
l.com"><span
style=3D"white-space: pre-wrap">
</span>
<pre class=3D"moz-quote-pre" wrap=3D"">When I said "33kiB" I meant =
"33 pages", or 132 kB. And the solution
turns out to be very easy. Since I'm using ZFS on top of geli, with
the default recsize of 128kB, I'll just set
vfs.zfs.vdev.aggregation_limit to 128 kB. That way geli will never
need to allocate more than 128kB contiguously. ZFS doesn't even need
those big allocations to be contiguous; it's just aggregating smaller
operations to reduce disk IOPs. But aggregating up to 1MB (the
default) is overkill; any rotating HDD should easily be able to max
out its consecutive write IOPs with 128kB operation size. I'll add a
read-only sysctl for g_eli_alloc_sz too. Thanks Mark.
-Alan
</pre>
</blockquote>
<p>Setting this on one of my production machines that uses zfs
behind geli drops the load average quite materially with zero
impact on throughput that I can see (thus far.)=C2=A0 I will run th=
is
for a while but it certainly doesn't appear to have any negatives
associated with it and does appear to improve efficiency quite a
bit.</p>
<div class=3D"moz-signature">-- <br>
Karl Denninger<br>
<a href=3D"mailto:karl@denninger.net" class=3D"moz-txt-link-freetex=
t">karl@denninger.net</a><br>
<i>The Market Ticker</i><br>
<font size=3D"-2"><i>[S/MIME encrypted email preferred]</i></font><=
/div>
</body>
</html>
--------------H2q7nl5KNV3fGY01y1MXZ54v--
--------------ms080707000903030302050808
Content-Type: application/pkcs7-signature; name="smime.p7s"
Content-Transfer-Encoding: base64
Content-Disposition: attachment; filename="smime.p7s"
Content-Description: S/MIME Cryptographic Signature
MIAGCSqGSIb3DQEHAqCAMIACAQExDzANBglghkgBZQMEAgMFADCABgkqhkiG9w0BBwEAAKCC
DbowggagMIIEiKADAgECAhMA5EiKghDOXrvfxYxjITXYDdhIMA0GCSqGSIb3DQEBCwUAMIGL
MQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTESMBAGA1UEBwwJTmljZXZpbGxlMRkw
FwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5c3RlbXMgQ0ExITAf
BgNVBAMMGEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBDQTAeFw0xNzA4MTcxNjQyMTdaFw0yNzA4
MTUxNjQyMTdaMHsxCzAJBgNVBAYTAlVTMRAwDgYDVQQIDAdGbG9yaWRhMRkwFwYDVQQKDBBD
dWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5c3RlbXMgQ0ExJTAjBgNVBAMMHEN1
ZGEgU3lzdGVtcyBMTEMgMjAxNyBJbnQgQ0EwggIiMA0GCSqGSIb3DQEBAQUAA4ICDwAwggIK
AoICAQC1aJotNUI+W4jP7xQDO8L/b4XiF4Rss9O0B+3vMH7Njk85fZ052QhZpMVlpaaO+sCI
KqG3oNEbuOHzJB/NDJFnqh7ijBwhdWutdsq23Ux6TvxgakyMPpT6TRNEJzcBVQA0kpby1DVD
0EKSK/FrWWBiFmSxg7qUfmIq/mMzgE6epHktyRM3OGq3dbRdOUgfumWrqHXOrdJz06xE9NzY
vc9toqZnd79FUtE/nSZVm1VS3Grq7RKV65onvX3QOW4W1ldEHwggaZxgWGNiR/D4eosAGFxn
uYeWlKEC70c99Mp1giWux+7ur6hc2E+AaTGh+fGeijO5q40OGd+dNMgK8Es0nDRw81lRcl24
SWUEky9y8DArgIFlRd6d3ZYwgc1DMTWkTavx3ZpASp5TWih6yI8ACwboTvlUYeooMsPtNa9E
6UQ1nt7VEi5syjxnDltbEFoLYcXBcqhRhFETJe9CdenItAHAtOya3w5+fmC2j/xJz29og1KH
YqWHlo3Kswi9G77an+zh6nWkMuHs+03DU8DaOEWzZEav3lVD4u76bKRDTbhh0bMAk4eXriGL
h4MUoX3Imfcr6JoyheVrAdHDL/BixbMH1UUspeRuqQMQ5b2T6pabXP0oOB4FqldWiDgJBGRd
zWLgCYG8wPGJGYgHibl5rFiI5Ix3FQncipc6SdUzOQIDAQABo4IBCjCCAQYwHQYDVR0OBBYE
FF3AXsKnjdPND5+bxVECGKtc047PMIHABgNVHSMEgbgwgbWAFBu1oRhUMNEzjODolDka5k4Q
EDBioYGRpIGOMIGLMQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTESMBAGA1UEBwwJ
TmljZXZpbGxlMRkwFwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5
c3RlbXMgQ0ExITAfBgNVBAMMGEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBDQYIJAKxAy1WBo2kY
MBIGA1UdEwEB/wQIMAYBAf8CAQAwDgYDVR0PAQH/BAQDAgGGMA0GCSqGSIb3DQEBCwUAA4IC
AQCB5686UCBVIT52jO3sz9pKuhxuC2npi8ZvoBwt/IH9piPA15/CGF1XeXUdu2qmhOjHkVLN
gO7XB1G8CuluxofOIUce0aZGyB+vZ1ylHXlMeB0R82f5dz3/T7RQso55Y2Vog2Zb7PYTC5B9
oNy3ylsnNLzanYlcW3AAfzZcbxYuAdnuq0Im3EpGm8DoItUcf1pDezugKm/yKtNtY6sDyENj
tExZ377cYA3IdIwqn1Mh4OAT/Rmh8au2rZAo0+bMYBy9C11Ex0hQ8zWcvPZBDn4v4RtO8g+K
uQZQcJnO09LJNtw94W3d2mj4a7XrsKMnZKvm6W9BJIQ4Nmht4wXAtPQ1xA+QpxPTmsGAU0Cv
HmqVC7XC3qxFhaOrD2dsvOAK6Sn3MEpH/YrfYCX7a7cz5zW3DsJQ6o3pYfnnQz+hnwLlz4MK
17NIA0WOdAF9IbtQqarf44+PEyUbKtz1r0KGeGLs+VGdd2FLA0e7yuzxJDYcaBTVwqaHhU2/
Fna/jGU7BhrKHtJbb/XlLeFJ24yvuiYKpYWQSSyZu1R/gvZjHeGb344jGBsZdCDrdxtQQcVA
6OxsMAPSUPMrlg9LWELEEYnVulQJerWxpUecGH92O06wwmPgykkz//UmmgjVSh7ErNvL0lUY
UMfunYVO/O5hwhW+P4gviCXzBFeTtDZH259O7TCCBxIwggT6oAMCAQICEgLG8yH4PQFdbd9x
Ugmpzl1jXzANBgkqhkiG9w0BAQsFADB7MQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlk
YTEZMBcGA1UECgwQQ3VkYSBTeXN0ZW1zIExMQzEYMBYGA1UECwwPQ3VkYSBTeXN0ZW1zIENB
MSUwIwYDVQQDDBxDdWRhIFN5c3RlbXMgTExDIDIwMTcgSW50IENBMB4XDTIyMDYyOTE2MTYz
NloXDTI3MDYyODE2MTYzNlowOjELMAkGA1UEBhMCVVMxEjAQBgNVBAgMCVRlbm5lc3NlZTEX
MBUGA1UEAwwOS2FybCBEZW5uaW5nZXIwggIiMA0GCSqGSIb3DQEBAQUAA4ICDwAwggIKAoIC
AQC+HVSyxVtJhy3Ohs+PAGRuO//Dha9A16l5FPATr6wude9zjX5f2lrkRyU8vhCXTZW7WbvW
ZKpcZ8r0dtZmiK9uF58Ec6hhvfkxJzbg96WHBw5Fumd5ahZzuCJDtCAWW8R7/KN+zwzQf1+B
3MVLmbaXAFBuKzySKhKMcHbK3/wjUYTgy+3UK6v2SBrowvkUBC+jxNg3Wy12GsTXcUS/8FYI
XgVVPgfZZrbJJb5HWOQpvvhILpPCD3xsYJFNKEPltXKWHT7Qtc2HNqikgNwj8oqOb+PeZGMi
WapsatKm8mxuOOGOEBhAoTVTwUHlMNTg6QUCJtuWFCK38qOCyk9Haj+86lUU8RG6FkRXWgMb
NQm1mWREQhw3axgGLSntjjnznJr5vsvXSYR6c+XKLd5KQZcS6LL8FHYNjqVKHBYM+hDnrTZM
qa20JLAF1YagutDiMRURU23iWS7bA9tMcXcqkclTSDtFtxahRifXRI7Epq2GSKuEXe/1Tfb5
CE8QsbCpGsfSwv2tZ/SpqVG08MdRiXxN5tmZiQWo15IyWoeKOXl/hKxA9KPuDHngXX022b1l
y+5ZOZbxBAZZMod4y4b4FiRUhRI97r9lCxsP/EPHuuTIZ82BYhrhbtab8HuRo2ofne2TfAWY
2BlA7ExM8XShMd9bRPZrNTokPQPUCWCgCdIATQIDAQABo4IBzzCCAcswPAYIKwYBBQUHAQEE
MDAuMCwGCCsGAQUFBzABhiBodHRwOi8vb2NzcC5jdWRhc3lzdGVtcy5uZXQ6ODg4ODAJBgNV
HRMEAjAAMBEGCWCGSAGG+EIBAQQEAwIFoDAOBgNVHQ8BAf8EBAMCBeAwHQYDVR0lBBYwFAYI
KwYBBQUHAwIGCCsGAQUFBwMEMDMGCWCGSAGG+EIBDQQmFiRPcGVuU1NMIEdlbmVyYXRlZCBD
bGllbnQgQ2VydGlmaWNhdGUwHQYDVR0OBBYEFLElmNWeVgsBPe7O8NiBzjvjYnpRMIHKBgNV
HSMEgcIwgb+AFF3AXsKnjdPND5+bxVECGKtc047PoYGRpIGOMIGLMQswCQYDVQQGEwJVUzEQ
MA4GA1UECAwHRmxvcmlkYTESMBAGA1UEBwwJTmljZXZpbGxlMRkwFwYDVQQKDBBDdWRhIFN5
c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5c3RlbXMgQ0ExITAfBgNVBAMMGEN1ZGEgU3lz
dGVtcyBMTEMgMjAxNyBDQYITAORIioIQzl6738WMYyE12A3YSDAdBgNVHREEFjAUgRJrYXJs
QGRlbm5pbmdlci5uZXQwDQYJKoZIhvcNAQELBQADggIBAKquc7cu0xc8FNtAQauZvocDzWQj
7HG9YvMbWnMi+ckhiA3rdW5NwWg0HBhBho1YlnqV+ntCVE2L8ezohHWm+KAdfXgpraL86Vsn
3ywNlZu/3COMpo2ALuHln8YQtH3Y8ebvzKMdlf2b5WB+7mOFIxXIr4AnNOLKCkq5ZhzC6JW6
Jvw3P0csiGa3UrfatYID5NvPgkaQvEgimEjG3psZqwQTL2Wxohvw783PrDt3wS0XeNhvQ61g
3QJFZKuv+bmGH3YBSPo1t6NUGAr+JozX5lDihB8JGkBt/NwdYec49a08uL0BbPaAJ7NjuIPG
7Y0Ak7PXZT37yx/Zla9PzLMJFgbelOkaatdzbblMZPDEVZ27l4lGMmV83Lm3YP17sdAyS/Wp
mav7WmJUkQ9iuIKzSpdc82i9Mfujl1vbBtwtkHNPPtKuulIFM4ZwrPKjlVdLqTSqD8m9yHEi
Y0PuAooq63OpJWF6hvMaiIPBWEAVIaDW9uG0MshLl9DnHnMyrJTfuC33Z9mOGMz7dRBjJd5Y
W02xAzYnUuEBOpj+LQv5R8XIFMHFXktqEKvQrXeM2RU+PcZqKOBkTktxBLn3NI5VfA15Jk0c
5V5XcOqo3p2hvrwvXrinrb2pEREnoqmfrkXT3zOq5Y6ryRH8u734lGEF0dILXzoV4PM7XFit
oTePoEjmMYIFBDCCBQACAQEwgZEwezELMAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3JpZGEx
GTAXBgNVBAoMEEN1ZGEgU3lzdGVtcyBMTEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBDQTEl
MCMGA1UEAwwcQ3VkYSBTeXN0ZW1zIExMQyAyMDE3IEludCBDQQISAsbzIfg9AV1t33FSCanO
XWNfMA0GCWCGSAFlAwQCAwUAoIICQzAYBgkqhkiG9w0BCQMxCwYJKoZIhvcNAQcBMBwGCSqG
SIb3DQEJBTEPFw0yNDA0MjIyMDA3MDBaME8GCSqGSIb3DQEJBDFCBECOHt1wXHx5CvSPENR3
5jx0y3K/3IwD92Z+srA3GqAnVSLlnNEd5mBHmvHgpNZB5d7lChofKrpMccmYd5HqeIV6MGwG
CSqGSIb3DQEJDzFfMF0wCwYJYIZIAWUDBAEqMAsGCWCGSAFlAwQBAjAKBggqhkiG9w0DBzAO
BggqhkiG9w0DAgICAIAwDQYIKoZIhvcNAwICAUAwBwYFKw4DAgcwDQYIKoZIhvcNAwICASgw
gaIGCSsGAQQBgjcQBDGBlDCBkTB7MQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTEZ
MBcGA1UECgwQQ3VkYSBTeXN0ZW1zIExMQzEYMBYGA1UECwwPQ3VkYSBTeXN0ZW1zIENBMSUw
IwYDVQQDDBxDdWRhIFN5c3RlbXMgTExDIDIwMTcgSW50IENBAhICxvMh+D0BXW3fcVIJqc5d
Y18wgaQGCyqGSIb3DQEJEAILMYGUoIGRMHsxCzAJBgNVBAYTAlVTMRAwDgYDVQQIDAdGbG9y
aWRhMRkwFwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5c3RlbXMg
Q0ExJTAjBgNVBAMMHEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBJbnQgQ0ECEgLG8yH4PQFdbd9x
Ugmpzl1jXzANBgkqhkiG9w0BAQEFAASCAgAAOOCpIE2WCS8QRNvUJGAm+kJHs/cidPacOwqd
9Wz/fQGZxOqGplh1cjNp1J82yR8yquGFiMM/ivncWU0k/Lo6AoTlAZt2YcYUPB/SQ5/+4+q/
3qHvy5OsrpwZHdZFZvgI5YrDsB+G0GAxQULI8AA2BAytNSAZ6CZOExf4TgLCdpKcsjj0YyNQ
+HBMvMRhrQy2HS3o+Xdru2jwGiWqvcfVng2kLySdBeHiqN7jR/ncbqd82wtDdtFgSxTgWmtj
6GTqw/CqWykJaP3mlY9/KvMa3Fu5OMqxEzbAyKylTXMVPt5qPqRXtXNBkgolwYkVbWy9sapg
PSImC4pILbgurxUEKpSvHPQdJig9hGs+eouUJAMV4c+nhmFcwgs0afnRd5ibS7H9Qpqft+oP
K/D6EaRVMOSYseIpoa3mBW4Az8Q3pQHZJPpNiDVDQHphFS1lPwfmMt1mDFaAQ71DhmhlRaLm
SSLz6wGxRjnkMkMxnVRNNSB7oD/2jn4jDxQNEHXMwW5Swg6HgXKyj8idJjFX3wBMZW1YDlV1
zFM9cCu0M5lGh/TC7z3SFJXzJZFu+B6IlrccrqGKdfSLvL5eRqFhlyjD5Cu7Fg/0n01ukkAC
FbpiZBwdyLWYN8yd0BiE4FcgCf5XvDVN7IPiAypEIXfuz0oUzHrtou3lP1KpZ5+ps8onPwAA
AAAAAA==
--------------ms080707000903030302050808--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?b1e56d20-dc98-4fff-adec-3f8cfae26c05>