From owner-freebsd-stable@FreeBSD.ORG Fri Jun 4 17:58:23 2010 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id AA3BF1065674; Fri, 4 Jun 2010 17:58:23 +0000 (UTC) (envelope-from alc@cs.rice.edu) Received: from mail.cs.rice.edu (mail.cs.rice.edu [128.42.1.31]) by mx1.freebsd.org (Postfix) with ESMTP id 7B2838FC2A; Fri, 4 Jun 2010 17:58:23 +0000 (UTC) Received: from mail.cs.rice.edu (localhost.localdomain [127.0.0.1]) by mail.cs.rice.edu (Postfix) with ESMTP id 846E32C2B58; Fri, 4 Jun 2010 12:58:22 -0500 (CDT) X-Virus-Scanned: by amavis-2.4.0 at mail.cs.rice.edu Received: from mail.cs.rice.edu ([127.0.0.1]) by mail.cs.rice.edu (mail.cs.rice.edu [127.0.0.1]) (amavisd-new, port 10024) with LMTP id dwfWIXRGEi9N; Fri, 4 Jun 2010 12:58:14 -0500 (CDT) Received: from adsl-216-63-78-18.dsl.hstntx.swbell.net (adsl-216-63-78-18.dsl.hstntx.swbell.net [216.63.78.18]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.cs.rice.edu (Postfix) with ESMTP id 3D2862C2B32; Fri, 4 Jun 2010 12:58:14 -0500 (CDT) Message-ID: <4C093EB5.3060406@cs.rice.edu> Date: Fri, 04 Jun 2010 12:58:13 -0500 From: Alan Cox User-Agent: Thunderbird 2.0.0.24 (X11/20100501) MIME-Version: 1.0 To: Matthew D Fleming , John Baldwin References: <201005272348.o4RNmgWh014243@hugeraid.jetcafe.org> <201006031029.00588.jhb@freebsd.org> <201006040937.o549bEFt054288@hugeraid.jetcafe.org> <201006040820.49741.jhb@freebsd.org> <20100604153210.GA8522@amaretto> In-Reply-To: <20100604153210.GA8522@amaretto> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-stable@freebsd.org, Clifton Royston , alc@freebsd.org, Garrett Cooper , Jeremy Chadwick Subject: Re: Locking a file backed mdconfig into memory X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Jun 2010 17:58:23 -0000 Matthew D Fleming wrote: > On Fri, Jun 04, 2010 at 08:20:49AM -0400, John Baldwin wrote: > >> Hmmm, I would just try increasing NKPT then. You might have to poke >> around in sys/amd64 to see what the default size is and how to tune >> it. >> > > When Isilon did the stable/7 merge and amd64 default NKPT changed from > 240 to 32 amd64 started having weird pmap issues during boot. At panic > time the stack wasn't very useful, and I didn't finish debugging the > issue since eventually I just had to get something working. We just > reverted NKPT to 240 and it worked for us. I didn't see an anything in > optsions.amd64 so I hard-coded it in amd64/include/pmap.h. > > Supposedly amd64 can deal with a small NKPT and grow dynamically, but it > didn't seem to work for us. :-( Perhaps when we do the next merge > project I'll have a few days to devote to debugging the root cause. > NKPT controls the number of page table pages that are initially allocated at the bottom of the top 2GB of the kernel address space. However, the vast majority of the kernel address space, 510GB in FreeBSD >=7.3, is below these page table pages. The page table pages for this region are dynamically allocated as needed. If you're booting a kernel and modules greater than 64GB in size, then I can certainly see why you would need to increase NKPT. John, is there some way to know at boot time how big the kernel and modules were? Then, we could probably eliminate NKPT. Alan