From owner-freebsd-stable@freebsd.org Thu Jul 30 08:39:16 2015 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 618B59ADD7F for ; Thu, 30 Jul 2015 08:39:16 +0000 (UTC) (envelope-from bc979@lafn.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 4B1AD3F3 for ; Thu, 30 Jul 2015 08:39:16 +0000 (UTC) (envelope-from bc979@lafn.org) Received: by mailman.ysv.freebsd.org (Postfix) id 47EF49ADD7E; Thu, 30 Jul 2015 08:39:16 +0000 (UTC) Delivered-To: stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 469139ADD7D for ; Thu, 30 Jul 2015 08:39:16 +0000 (UTC) (envelope-from bc979@lafn.org) Received: from zoom.lafn.org (zoom.lafn.org [108.92.93.123]) by mx1.freebsd.org (Postfix) with ESMTP id EE98B3F1 for ; Thu, 30 Jul 2015 08:39:15 +0000 (UTC) (envelope-from bc979@lafn.org) Received: from [10.0.1.2] (static-71-177-216-148.lsanca.fios.verizon.net [71.177.216.148]) (authenticated bits=0) by zoom.lafn.org (8.14.7/8.14.9) with ESMTP id t6U8dC12015118 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Thu, 30 Jul 2015 01:39:14 -0700 (PDT) (envelope-from bc979@lafn.org) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 8.2 \(2102\)) Subject: Re: Swap Usage From: Doug Hardie In-Reply-To: <20150730064444.GA88137@server.rulingia.com> Date: Thu, 30 Jul 2015 01:39:12 -0700 Cc: FreeBSD Stable ML Content-Transfer-Encoding: quoted-printable Message-Id: <10F94D23-E58C-466E-ADCA-5E6670054BD7@lafn.org> References: <20150730064444.GA88137@server.rulingia.com> To: Peter Jeremy X-Mailer: Apple Mail (2.2102) X-Virus-Scanned: clamav-milter 0.98 at zoom.lafn.org X-Virus-Status: Clean X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 30 Jul 2015 08:39:16 -0000 > On 29 July 2015, at 23:44, Peter Jeremy wrote: >=20 > [reformatted] >=20 > On 2015-Jul-29 17:41:33 -0700, Doug Hardie wrote: >> I have several FreeBSD 9.3 systems that are using swap and I can=E2=80=99= t >> figure out what is doing it. The key system has 6GB swap and >> currently it has over 2GB in use. >=20 > Is the system currently paging (top(1) and "systat -v" will show > this)? If not, this just means that at some time in the past, the > system was under memory pressure and paged some process memory out. > Since then, that memory hasn't been touched so the system hasn't paged > it in. >=20 >> ps shows only a kernel module >> [intr] with a W status. >=20 > 'W' means the whole process is 'swapped' out - this will only occur > under severe RAM pressure. Normally, the system will just page out > inactive parts of a processes address space - and none of the ps flags > will show this. >=20 >> How do I figure out what that swap space is being used for? >=20 > I don't think this can be trivially done. "procstat -v" will show > the number of resident pages within each swap-backed region, any > pages in that region that have been touched but are not resident > are on the swap device but any pages that have never been touched > aren't counted at all. Bingo. procstat shows the problem. The process that I suspected has a = large number of entries like: 650 0x834c00000 0x835800000 rw- 0 0 1 0 ---- = sw=20 650 0x835800000 0x835c00000 rw- 0 0 1 0 ---- = sw=20 650 0x835c00000 0x837c00000 rw- 1 0 1 0 ---- = sw=20 I don=E2=80=99t know whats in those areas yet. If I were to kill the = process with SIGABRT would the core dump show those areas? I might be = able to figure out what they are from that. Thanks for the pointer.