From owner-freebsd-amd64@FreeBSD.ORG Fri Dec 24 06:30:11 2010 Return-Path: Delivered-To: freebsd-amd64@hub.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id E6803106566C for ; Fri, 24 Dec 2010 06:30:10 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id A46B28FC15 for ; Fri, 24 Dec 2010 06:30:10 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.4/8.14.4) with ESMTP id oBO6UAVP020318 for ; Fri, 24 Dec 2010 06:30:10 GMT (envelope-from gnats@freefall.freebsd.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.4/8.14.4/Submit) id oBO6UAER020314; Fri, 24 Dec 2010 06:30:10 GMT (envelope-from gnats) Resent-Date: Fri, 24 Dec 2010 06:30:10 GMT Resent-Message-Id: <201012240630.oBO6UAER020314@freefall.freebsd.org> Resent-From: FreeBSD-gnats-submit@FreeBSD.org (GNATS Filer) Resent-To: freebsd-amd64@FreeBSD.org Resent-Reply-To: FreeBSD-gnats-submit@FreeBSD.org, Kenji Togashi Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 5D0761065675 for ; Fri, 24 Dec 2010 06:27:14 +0000 (UTC) (envelope-from nobody@FreeBSD.org) Received: from red.freebsd.org (unknown [IPv6:2001:4f8:fff6::22]) by mx1.freebsd.org (Postfix) with ESMTP id 4C6708FC16 for ; Fri, 24 Dec 2010 06:27:14 +0000 (UTC) Received: from red.freebsd.org (localhost [127.0.0.1]) by red.freebsd.org (8.14.4/8.14.4) with ESMTP id oBO6RDYx046846 for ; Fri, 24 Dec 2010 06:27:13 GMT (envelope-from nobody@red.freebsd.org) Received: (from nobody@localhost) by red.freebsd.org (8.14.4/8.14.4/Submit) id oBO6RDuR046845; Fri, 24 Dec 2010 06:27:13 GMT (envelope-from nobody) Message-Id: <201012240627.oBO6RDuR046845@red.freebsd.org> Date: Fri, 24 Dec 2010 06:27:13 GMT From: Kenji Togashi To: freebsd-gnats-submit@FreeBSD.org X-Send-Pr-Version: www-3.1 X-Mailman-Approved-At: Fri, 24 Dec 2010 11:51:10 +0000 Cc: Subject: amd64/153418: Kernel Panic occurred writing to zfs volume via nfs. X-BeenThere: freebsd-amd64@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Porting FreeBSD to the AMD64 platform List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 24 Dec 2010 06:30:11 -0000 >Number: 153418 >Category: amd64 >Synopsis: Kernel Panic occurred writing to zfs volume via nfs. >Confidential: no >Severity: critical >Priority: high >Responsible: freebsd-amd64 >State: open >Quarter: >Keywords: >Date-Required: >Class: sw-bug >Submitter-Id: current-users >Arrival-Date: Fri Dec 24 06:30:10 UTC 2010 >Closed-Date: >Last-Modified: >Originator: Kenji Togashi >Release: FreeBSD-8.1-RELEASE-amd64-dvd1.iso >Organization: Ricoh Co., Ltd. >Environment: FreeBSD fbsd64 8.1-RELEASE FreeBSD 8.1-RELEASE #0: Mon Jul 19 02:36:49 UTC 2010 root@mason.cse.buffalo.edu:/usr/obj/usr/src/sys/GENERIC amd64 >Description: Dear, I set up zfs volume, and export via nfs on freebsd8.1. It mounts by client, and vdbench is executed. The kernel panic is occurred. The detailed procedure is as follows. --- nfs server(freebsd8.1 amd64) --- <> The data for partition 2 is: sysid 165 (0xa5),(FreeBSD/NetBSD/386BSD) start 40949685, size 244718145 (119491 Meg), flag 0 beg: cyl 501/ head 0/ sector 1; end: cyl 373/ head 254/ sector 63 <> The data for partition 2 is: sysid 165 (0xa5),(FreeBSD/NetBSD/386BSD) start 40949685, size 244718145 (119491 Meg), flag 0 beg: cyl 501/ head 0/ sector 1; end: cyl 373/ head 254/ sector 63 <> The data for partition 2 is: sysid 165 (0xa5),(FreeBSD/NetBSD/386BSD) start 40949685, size 244718145 (119491 Meg), flag 0 beg: cyl 501/ head 0/ sector 1; end: cyl 373/ head 254/ sector 63 # zpool create expdsk raidz mfid0s2 mfid1s2 mfid2s2 # zpool status pool: expdsk state: ONLINE scrub: none requested config: NAME STATE READ WRITE CKSUM expdsk ONLINE 0 0 0 raidz1 ONLINE 0 0 0 mfid0s2 ONLINE 0 0 0 mfid1s2 ONLINE 0 0 0 mfid2s2 ONLINE 0 0 0 errors: No known data errors # df -Th Filesystem Type Size Used Avail Capacity Mounted on /dev/mfid0s1a ufs 496M 275M 182M 60% / devfs devfs 1.0K 1.0K 0B 100% /dev /dev/mfid0s1e ufs 496M 12K 456M 0% /tmp /dev/mfid0s1f ufs 9.2G 1.2G 7.3G 14% /usr /dev/mfid0s1d ufs 4.8G 766K 4.4G 0% /var expdsk zfs 229G 23G 207G 10% /expdsk # vi /etc/rc.conf nfs_server_enable="YES" mountd_flags="-r" mountd_enable="YES" rpcbind_enable="YES" # vi /etc/exports /expdsk -network 192.168.184.0 -mask 255.255.255.192 -mapall=root # vi /etc/hosts.allow rpcbind : 192.168.184.0/255.255.255.192 : allow # service rpcbind start # service nfsd start # service mountd start # zfs sharenfs=on /expdsk --- nfs client(CentOS5.5 i386) --- The vdbench(5.02) is executed on client side(CentOS5.5), kernel panic is occurred on nfs server(freebsd8.1) after while. # mount -t nfs 192.168.184.xx:/expdsk /mnt # ./vdbench -f vdb_setting <> fsd=fsd1,anchor=/mnt,depth=5,width=3,files=200,sizes=(4k,25,32k,15,256k,20,2m,25,16m,15) fwd=fwd1,fsd=fsd1,operation=write,xfersizes=64k,fileio=sequential,fileselect=random,threads=4 rd=rd1,fwd=fwd1,fwdrate=max,format=on,elapsed=180,interval=10 --- nfs server --- About 24GB is written, and kernel panic as follows is occurred. panic: kmem_malloc(131072): kmem_map too small: 1356701696 total allocated cpuid = 1 Uptime: 24m43s Cannot dump. Device not defined or unavailable Automatic reboot in 15 seconds - press akey on the console to abort >How-To-Repeat: # ./vdbench -f vdb_setting >Fix: >Release-Note: >Audit-Trail: >Unformatted: