Date: Sat, 26 Sep 2015 13:04:41 +0200 From: Fabian Keil <freebsd-listen@fabiankeil.de> Cc: freebsd-questions@freebsd.org Subject: Re: Problems with ZFS file servers Message-ID: <4abb7c52.5adf5378@fabiankeil.de> In-Reply-To: <20150925232658.GB42532@neutralgood.org> References: <55F5CF06.5080602@rpi.edu> <1442191342.426007007.amnhjwng@frv35.fwdcdn.com> <55F62523.7010402@rpi.edu> <1442267713.360040098.um8wwy4s@frv35.fwdcdn.com> <5605A3A5.7080905@rpi.edu> <5605AD8D.4080706@FreeBSD.org> <20150925232658.GB42532@neutralgood.org>
next in thread | previous in thread | raw e-mail | index | archive | help
--Sig_/DdhJIUE69CrDTbt_a6pUFSv Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: quoted-printable kpneal@pobox.com wrote: > On Fri, Sep 25, 2015 at 09:24:45PM +0100, Matthew Seaman wrote: > > On 25/09/2015 20:42, Bob Healey wrote: > > > I've got another machine acting up, this machine is a Sun X2250, > > > originally was running Solaris until this summer when the owner dropp= ed > > > the support contract. A zpool export, reinstall to FreeBSD 10.1, and > > > zpool import and it was back in business. Most of the requested info > > > can be found at http://origami.phys.rpi.edu/~healer/lepton. I am > > > working on getting cacti installed. I am currently trying to rsync a > > > workstation to this pool so I can reload the OS. If I use > > > --bwlimit=3D10240 or lower, I have no issues, but if I don't rsync fr= eezes > > > on me on the client side. > >=20 > > I've found, through bitter experience, that you need to apply some > > tunings to ZFS machines, and quite possibly some kernel patches too. > > When you're pumping wads of data into a ZFS machine at high speed, it is > > all too easy to get it to lock up. > >=20 > > First up, the default setting where ZFS grabs all but 1GB of available > > RAM for use by the ARC is nuts. You need to chop that down and give the > > rest of the OS a fair share of RAM to play with by setting > > vfs.zfs.arc_max in /boot/loader.conf. What you set it to depends on the > > application mix on your server, but somewhere around 50% of available > > RAM seems reasonable to me. Reboot to enable that, obviously. >=20 > My personal experience: >=20 > I have swap space configured. My box has 8GB of memory, and when I save > large mailboxes with mutt I see up to 4GB of swap space used.=20 >=20 > It may be the case that adding swap space will eliminate the need to > limit the ARC manually in /boot/loader.conf.=20 Without the ARC patches or manual tuning the swap use could be the result of the ARC failing to adapt to the memory pressure in which case even active processes may start paging that otherwise wouldn't have to. In that situation, adding more swap space may degrade performance even further as it allows the ARC to hold on to the memory even longer. Thus I wouldn't recommend it without analysing the cause of the swap use first. Fabian --Sig_/DdhJIUE69CrDTbt_a6pUFSv Content-Type: application/pgp-signature Content-Description: OpenPGP digital signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iEYEARECAAYFAlYGe8MACgkQBYqIVf93VJ00rgCeLRFI57rWupcb8cuFkBKFeQmc QKIAnj8VkLFb+5D2/XR5l+g5lglMbMU+ =BG6V -----END PGP SIGNATURE----- --Sig_/DdhJIUE69CrDTbt_a6pUFSv--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?4abb7c52.5adf5378>