Date: Mon, 5 Oct 2009 11:28:32 -0700 From: Artem Belevich <fbsdlist@src.cx> To: Pawel Jakub Dawidek <pjd@freebsd.org> Cc: freebsd-fs@freebsd.org Subject: Re: ARC size constantly shrinks, then ZFS slows down extremely Message-ID: <ed91d4a80910051128r568c7b0fj278452ec2c4d6bd5@mail.gmail.com> In-Reply-To: <ed91d4a80910021759h4a3d3b9csde86c59075795eeb@mail.gmail.com> References: <4AC1E540.9070001@fsn.hu> <4AC5B2C7.2000200@fsn.hu> <20091002184526.GA1660@garage.freebsd.pl> <ed91d4a80910021638r72213389uf0767b9bb523b7d9@mail.gmail.com> <20091003000909.GD1660@garage.freebsd.pl> <ed91d4a80910021759h4a3d3b9csde86c59075795eeb@mail.gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
--001636283b62ef22e804753447f5 Content-Type: text/plain; charset=ISO-8859-1 I left my box running over the weekend (vm.kmem_size=8G) in a loop doing a build and then deleting build results. Each loop cycle takes about 5 hours. All in all it touches about 2GB of sources and produces about 30GB of object files and stuff. This morning ARC size is around 2.5G. Now and then it dips down to 1G. I've attached graph with memory stats and ARC size. --Artem > =============================================================== > Now, the same experiment, with vm.kmem_size=8G > vm.kmem_size: 8589934592 > vfs.zfs.arc_min: 939524096 > vfs.zfs.arc_max: 7516192768 > > ARC grows to 6.2G: > Mem: 47M Active, 13M Inact, 7376M Wired, 31M Buf, 473M Free > > Then it quickly shrinks to 4.6G and grows to 6.2G again, shrinks again, etc.. > > What's different from the previous case is that after a while ZFS > adjusts target size (kstat.zfs.misc.arcstats.c) down to ~5.8G and > after that ZFS size oscillates between 4.2G and 5.6G. Another > observation -- ARC shrinking happens when system is left with ~512M of > free memory. Yet another observation is that even with ARC peak of > ~5.8G, system has about 7.5G wired. Where did almost 2G of difference > go? Fragmentation? > > I've tried both experiments with and without L2ARC -- behavior seems > to be the same. > > --Artem > --001636283b62ef22e804753447f5--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?ed91d4a80910051128r568c7b0fj278452ec2c4d6bd5>