Date: Tue, 12 Feb 2019 13:18:05 -0500 From: Mark Johnston <markj@freebsd.org> To: Eugene Grosbein <eugen@grosbein.net> Cc: FreeBSD stable <freebsd-stable@freebsd.org>, kib@freebsd.org Subject: Re: 11.2-STABLE kernel wired memory leak Message-ID: <20190212181805.GB29847@raichu> In-Reply-To: <4ab1331f-80e3-b856-b402-9985e73618bc@grosbein.net> References: <d8c7abc0-3ba1-40e4-22b1-1b30d28ced14@grosbein.net> <20190212163446.GA29847@raichu> <4ab1331f-80e3-b856-b402-9985e73618bc@grosbein.net>
next in thread | previous in thread | raw e-mail | index | archive | help
On Wed, Feb 13, 2019 at 01:03:37AM +0700, Eugene Grosbein wrote: > 12.02.2019 23:34, Mark Johnston wrote: > > > I suspect that the "leaked" memory is simply being used to cache UMA > > items. Note that the values in the FREE column of vmstat -z output are > > quite large. The cached items are reclaimed only when the page daemon > > wakes up to reclaim memory; if there are no memory shortages, large > > amounts of memory may accumulate in UMA caches. In this case, the sum > > of the product of columns 2 and 5 gives a total of roughly 4GB cached. > > > >> as well as "sysctl hw": http://www.grosbein.net/freebsd/leak/sysctl-hw.txt > >> and "sysctl vm": http://www.grosbein.net/freebsd/leak/sysctl-vm.txt > > It seems page daemon is broken somehow as it did not reclaim several gigs of wired memory > despite of long period of vm thrashing: Depending on the system's workload, it is possible for the caches to grow quite quickly after a reclaim. If you are able to run kgdb on the kernel, you can find the time of the last reclaim by comparing the values of lowmem_uptime and time_uptime. > $ sed 's/:/,/' vmstat-z.txt | awk -F, '{printf "%10s %s\n", $2*$5/1024/1024, $1}' | sort -k1,1 -rn | head > 1892 abd_chunk > 454.629 dnode_t > 351.35 zio_buf_512 > 228.391 zio_buf_16384 > 173.968 dmu_buf_impl_t > 130.25 zio_data_buf_131072 > 93.6887 VNODE > 81.6978 arc_buf_hdr_t_full > 74.9368 256 > 57.4102 4096 >
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20190212181805.GB29847>