From owner-freebsd-fs@freebsd.org Sun Aug 21 13:55:27 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BF70CBC1678 for ; Sun, 21 Aug 2016 13:55:27 +0000 (UTC) (envelope-from karl@denninger.net) Received: from mail.denninger.net (denninger.net [70.169.168.7]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 7683D1CA0 for ; Sun, 21 Aug 2016 13:55:27 +0000 (UTC) (envelope-from karl@denninger.net) Received: from [192.168.1.40] (Karl-Desktop.Denninger.net [192.168.1.40]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by mail.denninger.net (Postfix) with ESMTPSA id 72DAF21C8E for ; Sun, 21 Aug 2016 08:55:19 -0500 (CDT) Subject: Re: ZFS ARC under memory pressure References: <20160816193416.GM8192@zxy.spb.ru> <8dbf2a3a-da64-f7f8-5463-bfa23462446e@FreeBSD.org> <20160818202657.GS8192@zxy.spb.ru> <20160819201840.GA12519@zxy.spb.ru> <20160820152225.GP83214@kib.kiev.ua> <97f166f0-4d47-d5a3-ecb3-d15f1ecf9c1f@denninger.net> <20160821082842.GR83214@kib.kiev.ua> To: freebsd-fs@freebsd.org From: Karl Denninger Message-ID: <73545a4b-fafc-f623-a8f5-cfcd3d8a2bd7@denninger.net> Date: Sun, 21 Aug 2016 08:55:11 -0500 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.2.0 MIME-Version: 1.0 In-Reply-To: <20160821082842.GR83214@kib.kiev.ua> Content-Type: multipart/signed; protocol="application/pkcs7-signature"; micalg=sha-512; boundary="------------ms040408040108020304040707" X-Content-Filtered-By: Mailman/MimeDel 2.1.22 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 21 Aug 2016 13:55:27 -0000 This is a cryptographically signed message in MIME format. --------------ms040408040108020304040707 Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable On 8/21/2016 03:28, Konstantin Belousov wrote: > On Sat, Aug 20, 2016 at 11:08:44AM -0500, Karl Denninger wrote: >> If you are talking about the case of an executable in which part of th= e >> text is evicted you are correct, however, you are still choosing in th= at >> instance to evict a page for which there will likely be a future deman= d >> and thus require an I/O (should that executable come back up for >> execution) as opposed to one for which you have no idea how likely >> demand for same will be (a data page in the ARC.) > No, I am not talking about only text segments. > Any clean page can be reused after unmapping. And this accounts for pages being evicted to the swap..... how?=20 (Obviously they're not simply unmapped, and thus were not "clean" when targeted by the VM) >> Since the VM has no means of "coloring" the ARC (as it is opaque other= >> than the consumption of system memory to the VM) as to how "useful" >> (e.g. how often used, etc) a particular data item in the ARC is, it ha= s >> no information available on which to decide. However, the fact that a= n >> executing process is in some sort of waiting state still likely trumps= >> an ARC data page in terms of likelihood of future access. > Buffer cache behaves exactly the same, since access references are not > counted for the pages constituing buffers. It is always amusing when I am told how things are supposed to occur (and thus assumptions that were made when writing code) when I have spent countless hours observing how they actually do behave and writing code to mitigate the very behavior that is claimed to not happen. I should have something for 11-MostlyStable on the original PR's thread in a couple of weeks, assuming I manage to complete what I'm working on right now on-schedule. --=20 Karl Denninger karl@denninger.net /The Market Ticker/ /[S/MIME encrypted email preferred]/ --------------ms040408040108020304040707 Content-Type: application/pkcs7-signature; name="smime.p7s" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="smime.p7s" Content-Description: S/MIME Cryptographic Signature MIAGCSqGSIb3DQEHAqCAMIACAQExDzANBglghkgBZQMEAgMFADCABgkqhkiG9w0BBwEAAKCC Bl8wggZbMIIEQ6ADAgECAgEpMA0GCSqGSIb3DQEBCwUAMIGQMQswCQYDVQQGEwJVUzEQMA4G A1UECBMHRmxvcmlkYTESMBAGA1UEBxMJTmljZXZpbGxlMRkwFwYDVQQKExBDdWRhIFN5c3Rl bXMgTExDMRwwGgYDVQQDExNDdWRhIFN5c3RlbXMgTExDIENBMSIwIAYJKoZIhvcNAQkBFhND dWRhIFN5c3RlbXMgTExDIENBMB4XDTE1MDQyMTAyMjE1OVoXDTIwMDQxOTAyMjE1OVowWjEL MAkGA1UEBhMCVVMxEDAOBgNVBAgTB0Zsb3JpZGExGTAXBgNVBAoTEEN1ZGEgU3lzdGVtcyBM TEMxHjAcBgNVBAMTFUthcmwgRGVubmluZ2VyIChPQ1NQKTCCAiIwDQYJKoZIhvcNAQEBBQAD ggIPADCCAgoCggIBALmEWPhAdphrWd4K5VTvE5pxL3blRQPyGF3ApjUjgtavqU1Y8pbI3Byg XDj2/Uz9Si8XVj/kNbKEjkRh5SsNvx3Fc0oQ1uVjyCq7zC/kctF7yLzQbvWnU4grAPZ3IuAp 3/fFxIVaXpxEdKmyZAVDhk9az+IgHH43rdJRIMzxJ5vqQMb+n2EjadVqiGPbtG9aZEImlq7f IYDTnKyToi23PAnkPwwT+q1IkI2DTvf2jzWrhLR5DTX0fUYC0nxlHWbjgpiapyJWtR7K2YQO aevQb/3vN9gSojT2h+cBem7QIj6U69rEYcEDvPyCMXEV9VcXdcmW42LSRsPvZcBHFkWAJqMZ Myiz4kumaP+s+cIDaXitR/szoqDKGSHM4CPAZV9Yh8asvxQL5uDxz5wvLPgS5yS8K/o7zDR5 vNkMCyfYQuR6PAJxVOk5Arqvj9lfP3JSVapwbr01CoWDBkpuJlKfpQIEeC/pcCBKknllbMYq yHBO2TipLyO5Ocd1nhN/nOsO+C+j31lQHfOMRZaPQykXVPWG5BbhWT7ttX4vy5hOW6yJgeT/ o3apynlp1cEavkQRS8uJHoQszF6KIrQMID/JfySWvVQ4ksnfzwB2lRomrdrwnQ4eG/HBS+0l eozwOJNDIBlAP+hLe8A5oWZgooIIK/SulUAsfI6Sgd8dTZTTYmlhAgMBAAGjgfQwgfEwNwYI KwYBBQUHAQEEKzApMCcGCCsGAQUFBzABhhtodHRwOi8vY3VkYXN5c3RlbXMubmV0Ojg4ODgw CQYDVR0TBAIwADARBglghkgBhvhCAQEEBAMCBaAwCwYDVR0PBAQDAgXgMCwGCWCGSAGG+EIB DQQfFh1PcGVuU1NMIEdlbmVyYXRlZCBDZXJ0aWZpY2F0ZTAdBgNVHQ4EFgQUxRyULenJaFwX RtT79aNmIB/u5VkwHwYDVR0jBBgwFoAUJHGbnYV9/N3dvbDKkpQDofrTbTUwHQYDVR0RBBYw FIESa2FybEBkZW5uaW5nZXIubmV0MA0GCSqGSIb3DQEBCwUAA4ICAQBPf3cYtmKowmGIYsm6 eBinJu7QVWvxi1vqnBz3KE+HapqoIZS8/PolB/hwiY0UAE1RsjBJ7yEjihVRwummSBvkoOyf G30uPn4yg4vbJkR9lTz8d21fPshWETa6DBh2jx2Qf13LZpr3Pj2fTtlu6xMYKzg7cSDgd2bO sJGH/rcvva9Spkx5Vfq0RyOrYph9boshRN3D4tbWgBAcX9POdXCVfJONDxhfBuPHsJ6vEmPb An+XL5Yl26XYFPiODQ+Qbk44Ot1kt9s7oS3dVUrh92Qv0G3J3DF+Vt6C15nED+f+bk4gScu+ JHT7RjEmfa18GT8DcT//D1zEke1Ymhb41JH+GyZchDRWtjxsS5OBFMzrju7d264zJUFtX7iJ 3xvpKN7VcZKNtB6dLShj3v/XDsQVQWXmR/1YKWZ93C3LpRs2Y5nYdn6gEOpL/WfQFThtfnat HNc7fNs5vjotaYpBl5H8+VCautKbGOs219uQbhGZLYTv6okuKcY8W+4EJEtK0xB08vqr9Jd0 FS9MGjQE++GWo+5eQxFt6nUENHbVYnsr6bYPQsZH0CRNycgTG9MwY/UIXOf4W034UpR82TBG 1LiMsYfb8ahQJhs3wdf1nzipIjRwoZKT1vGXh/cj3gwSr64GfenURBxaFZA5O1acOZUjPrRT n3ci4McYW/0WVVA3lDGCBRMwggUPAgEBMIGWMIGQMQswCQYDVQQGEwJVUzEQMA4GA1UECBMH RmxvcmlkYTESMBAGA1UEBxMJTmljZXZpbGxlMRkwFwYDVQQKExBDdWRhIFN5c3RlbXMgTExD MRwwGgYDVQQDExNDdWRhIFN5c3RlbXMgTExDIENBMSIwIAYJKoZIhvcNAQkBFhNDdWRhIFN5 c3RlbXMgTExDIENBAgEpMA0GCWCGSAFlAwQCAwUAoIICTTAYBgkqhkiG9w0BCQMxCwYJKoZI hvcNAQcBMBwGCSqGSIb3DQEJBTEPFw0xNjA4MjExMzU1MTFaME8GCSqGSIb3DQEJBDFCBEC9 pc0+jrZ0NX1tcdjEiw11v/KjDQbuGvjFC7TC4kl/8/Y3k5ByJDgIttFRurk1aLBW6bFxDm6l g9ZN44SP8gRCMGwGCSqGSIb3DQEJDzFfMF0wCwYJYIZIAWUDBAEqMAsGCWCGSAFlAwQBAjAK BggqhkiG9w0DBzAOBggqhkiG9w0DAgICAIAwDQYIKoZIhvcNAwICAUAwBwYFKw4DAgcwDQYI KoZIhvcNAwICASgwgacGCSsGAQQBgjcQBDGBmTCBljCBkDELMAkGA1UEBhMCVVMxEDAOBgNV BAgTB0Zsb3JpZGExEjAQBgNVBAcTCU5pY2V2aWxsZTEZMBcGA1UEChMQQ3VkYSBTeXN0ZW1z IExMQzEcMBoGA1UEAxMTQ3VkYSBTeXN0ZW1zIExMQyBDQTEiMCAGCSqGSIb3DQEJARYTQ3Vk YSBTeXN0ZW1zIExMQyBDQQIBKTCBqQYLKoZIhvcNAQkQAgsxgZmggZYwgZAxCzAJBgNVBAYT AlVTMRAwDgYDVQQIEwdGbG9yaWRhMRIwEAYDVQQHEwlOaWNldmlsbGUxGTAXBgNVBAoTEEN1 ZGEgU3lzdGVtcyBMTEMxHDAaBgNVBAMTE0N1ZGEgU3lzdGVtcyBMTEMgQ0ExIjAgBgkqhkiG 9w0BCQEWE0N1ZGEgU3lzdGVtcyBMTEMgQ0ECASkwDQYJKoZIhvcNAQEBBQAEggIADmOtAIUa 0iN5NYqGUe8eRO77avZpPHDaq7yLkFbhefpDQzRyjlqd1S8wuQikiNkXdxa8qi6ZpVBXZVvM 1hs/CtmArnxF/De3uCf2NFCSrqPAUtSfXeM7TzVLs8rtoJHnh27H706RB9BkayJXPH4GSlg1 DcSmHiGg0wPbHVN5xTirvIbUIVi09aWNnZL31wJ+rRP+zLHEVifvLb9Oxo1iODRTErO0Pi6K Odr20I2lZF/ULgGa6KuA9PG8spadfZmuDilg8WCXYdFicRPky1ldpIfVVwSEQwSUiMyzu7aF kbpYbplBvMnVu704K+mvrUJYVhHyG9TbXIj/34ICItPQFG278FuOiVVHEA1+dS7KQyOWribi 5XYg6i7EwcPw3rfZrblsOW5TDZfX+ktv57HUCBvwuKGjRHbm/MNEfRQc4npSku2aO2OmoI+K 4+zEcf6SEaJVwuEvJl2e9yb/yrDgf0zH7ESIubekgVeyzeheJ7kkFcevtJc4vsnIwXgSqwWU gsCWmnSTDdEibLq6nOAt4HrmyMd8LJ0sv1SrepoK0hoviup+NiYlL5Ytwt+L7wPW+TysIZ6t Yqu2LG7+hH6R0SLvcBRU3mMhtLvXybz39qYVFNZ+jMQOLCxkbqVi3635UchGWnA0VA7rzaRL xX0zoChmSsJDUPQED89Z6phD600AAAAAAAA= --------------ms040408040108020304040707--