Date: Fri, 22 Jan 2010 12:11:47 -0800 From: Artem Belevich <fbsdlist@src.cx> To: Doug Poland <doug@polands.org> Cc: freebsd-fs@freebsd.org Subject: Re: Repeatable ZFS "kmem map too small" panic on 8.0-STABLE Message-ID: <ed91d4a81001221211j2bc05b6bv22a51a8b2fcbcec1@mail.gmail.com> In-Reply-To: <a4ab3938f95de65086a18607309178c4.squirrel@email.polands.org> References: <4B58976E.1020402@polands.org> <4B58A069.8000802@egr.msu.edu> <4B58BD2D.30803@rcn.com> <ed91d4a81001211421r4f7ba7a8n1c92bfc413e5feed@mail.gmail.com> <4B58D4D3.80009@egr.msu.edu> <20100122042843.GA8858@polands.org> <ed91d4a81001212209o3cf5955fw1eb0dd78703ad905@mail.gmail.com> <a8b9c9e35a14c4ada1c8f2602c91db63.squirrel@email.polands.org> <a4ab3938f95de65086a18607309178c4.squirrel@email.polands.org>
next in thread | previous in thread | raw e-mail | index | archive | help
What do following sysctls show on your box? hw.physmem: vm.kmem_size vm.kmem_size_max vfs.zfs.arc_max --Artem On Fri, Jan 22, 2010 at 10:09 AM, Doug Poland <doug@polands.org> wrote: > > On Fri, January 22, 2010 07:22, Doug Poland wrote: >> On Fri, January 22, 2010 00:09, Artem Belevich wrote: >>> On Thu, Jan 21, 2010 at 8:28 PM, Doug Poland <doug@polands.org> >>> wrote: >>>> Interesting discussion :) =A0I added vm.kmem_size=3D"20G" to >>>> /boot/loader.conf per your instructions. =A0This time, it didn't >>>> panic at the same point in the test, however, it appears the >>>> filesystem is "hanging". >>>> >>>> On the fdisk test, I hit <CTRL> T and get: >>>> cmd: fsdisk 37066 [zio->io_cv)] 245.62r 0.12u 25.10s 0 >>>> >>>> My various metrics are still running, but anything that needs the >>>> filesystem appears "stuck". >>>> >>>> The memory usage of the item "solaris" (vmstat -m | grep solaris) >>>> spiked at 3334781952 (3180.30 MiB). >>>> >>>> # zpool iostat 2, a <CTRL> T shows: >>>> load: 0.00 =A0cmd: zpool 934 [tx->tx_quiesce_done_cv)] 2052.45r 0.06 >> u 0.39s 0% 0k >>>> >>>> # vmstat -v | grep solaris to disk every second and it's hung at: >>>> load: 0.00 =A0cmd: sh 38551 [zfs] 909.85r 0.00u 0.00s 0% 16k >>>> >>>> Any suggestions! >>>> >>> Next step would be to set vfs.zfs.arc_max to a value that's somewhat >>> below your physical memory size. Let's say - 1G or so. On my box >>> with >>> 8GB of RAM I set these values: >>> >>> vfs.zfs.arc_max=3D"6500M" >>> vfs.zfs.arc_min=3D"4G" >>> >> OK, I'll give that a shot... >> > > panic: kmem_malloc(131072): kmem_map too small: 3593236480 total > allocate d > > # cat /boot/loader.conf > vfs.root.mountfrom=3D"zfs:bethesda" > vfs.zfs.arc_max=3D"1G" > vm.kmem_size=3D"20G" > zfs_load=3D"YES" > > OK, what do we do next? :) > > > -- > Regards, > Doug > >
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?ed91d4a81001221211j2bc05b6bv22a51a8b2fcbcec1>