From owner-freebsd-stable@FreeBSD.ORG Sat May 4 06:20:08 2013 Return-Path: Delivered-To: stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id 1C3574CB for ; Sat, 4 May 2013 06:20:08 +0000 (UTC) (envelope-from kiri@pis.elm.toba-cmt.ac.jp) Received: from pis.elm.toba-cmt.ac.jp (pis.elm.toba-cmt.ac.jp [202.26.248.196]) by mx1.freebsd.org (Postfix) with ESMTP id A9A7E1636 for ; Sat, 4 May 2013 06:20:06 +0000 (UTC) Received: from kiri.pis.pis.elm.toba-cmt.ac.jp (kiri.pis [192.168.1.1] (may be forged)) by pis.elm.toba-cmt.ac.jp (8.14.5/8.14.5) with ESMTP id r445qNB3023430 for ; Sat, 4 May 2013 14:52:23 +0900 (JST) (envelope-from kiri@pis.elm.toba-cmt.ac.jp) Message-Id: <201305040552.r445qNB3023430@pis.elm.toba-cmt.ac.jp> Date: Sat, 04 May 2013 14:52:23 +0900 From: KIRIYAMA Kazuhiko To: stable@freebsd.org Subject: Vimage Jail kernel crashed User-Agent: Wanderlust/2.14.0 (Africa) SEMI/1.14.6 (Maruoka) FLIM/1.14.9 (=?ISO-8859-4?Q?Goj=F2?=) APEL/10.6 MULE XEmacs/21.4 (patch 22) (Instant Classic) (amd64--freebsd) MIME-Version: 1.0 (generated by SEMI 1.14.6 - "Maruoka") Content-Type: text/plain; charset=US-ASCII X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 04 May 2013 06:20:08 -0000 Dear stable list, I've created private network by Vimage Jail using ezjail referenced [1] as follows: em0 X.X.X.X bridge0 192.168.1.254 --+-- epair0a --+-- epair0b 192.168.1.1(ns) | +-- epair1a --+-- epair1b 192.168.1.2(ns1) | +-- epair2a --+-- epair2b 192.168.1.3(cvs) | +-- epair3a --+-- epair3b 192.168.1.4(mail) | +-- epair4a --+-- epair4b 192.168.1.5(web) where X.X.X.X is the global address of outer network. All jail environments are under /jails: admin@xxxxxx:~[112]% ll /jails/ total 52 drwxrwxr-x 2 root operator 512 Apr 28 03:03 .snap drwxr-xr-x 9 root wheel 512 Apr 7 06:13 basejail drwxr-xr-x 4 root wheel 512 Apr 7 06:15 commonjail drwxr-xr-x 13 root wheel 512 Apr 7 06:35 cvs drwxr-xr-x 16 root wheel 3072 Apr 14 03:14 distfiles drwxr-xr-x 3 root wheel 512 Apr 7 06:13 flavours drwx------ 69 root operator 4096 Apr 18 21:06 lost+found drwxr-xr-x 13 root wheel 512 Apr 7 06:35 mail drwxr-xr-x 13 root wheel 512 Apr 7 06:16 newjail drwxr-xr-x 13 root wheel 512 Apr 7 06:35 ns drwxr-xr-x 13 root wheel 512 Apr 7 06:35 ns1 drwxr-xr-x 2 root wheel 512 Apr 6 08:00 packages drwxr-xr-x 13 root wheel 512 Apr 7 06:35 web admin@xxxxxx:~[113]% All seemd to go well. But when jail host shutdown, freezed and kernel paniced to put: Apr 28 09:56:40 xxxxxx root: /etc/rc.d/jail: DEBUG: cvs parameters: Apr 28 09:56:41 xxxxxx root: /etc/pccard_ether: DEBUG: run_rc_command: start_precmd: checkauto Apr 28 09:56:41 xxxxxx kernel: ifa_del_loopback_route: deletion failed Apr 28 09:56:41 xxxxxx kernel: Freed UMA keg was not empty (50 items). Lost 5 pages of memory. Apr 28 09:56:41 xxxxxx kernel: Freed UMA keg was not empty (672 items). Lost 4 pages of memory. Apr 28 09:56:41 xxxxxx kernel: Freed UMA keg was not empty (50 items). Lost 5 pages of memory. Apr 28 09:56:41 xxxxxx kernel: Freed UMA keg was not empty (28 items). Lost 7 pages of memory. Apr 28 09:56:41 xxxxxx kernel: hhook_vnet_uninit: hhook_head type=1, id=1 cleanup required Apr 28 09:56:41 xxxxxx kernel: hhook_vnet_uninit: hhook_head type=1, id=0 cleanup required May 4 11:19:46 xxxxxx syslogd: kernel boot file is /boot/kernel/kernel May 4 11:19:46 xxxxxx kernel: epair2a: promiscuous mode disabled May 4 11:19:46 xxxxxx kernel: May 4 11:19:46 xxxxxx kernel: May 4 11:19:46 xxxxxx kernel: Fatal trap 12: page fault while in kernel mode May 4 11:19:46 xxxxxx kernel: cpuid = 2; apic id = 02 May 4 11:19:46 xxxxxx kernel: fault virtual address = 0x7818c3798 May 4 11:19:46 xxxxxx kernel: fault code = supervisor write data, page not present May 4 11:19:46 xxxxxx kernel: instruction pointer = 0x20:0xffffffff8162c19e May 4 11:19:46 xxxxxx kernel: stack pointer = 0x28:0xffffff8121b22860 May 4 11:19:46 xxxxxx kernel: frame pointer = 0x28:0xffffff8121b22870 May 4 11:19:46 xxxxxx kernel: code segment = base 0x0, limit 0xfffff, type 0x1b May 4 11:19:46 xxxxxx kernel: = DPL 0, pres 1, long 1, def32 0, gran 1 May 4 11:19:46 xxxxxx kernel: processor eflags = interrupt enabled, resume, IOPL = 0 May 4 11:19:46 xxxxxx kernel: current process = 15360 (ifconfig) May 4 11:19:46 xxxxxx kernel: trap number = 12 May 4 11:19:46 xxxxxx kernel: panic: page fault May 4 11:19:46 xxxxxx kernel: cpuid = 2 May 4 11:19:46 xxxxxx kernel: KDB: stack backtrace: May 4 11:19:46 xxxxxx kernel: #0 0xffffffff80923446 at kdb_backtrace+0x66 May 4 11:19:46 xxxxxx kernel: #1 0xffffffff808ed0be at panic+0x1ce May 4 11:19:46 xxxxxx kernel: #2 0xffffffff80c7e330 at trap_fatal+0x290 May 4 11:19:46 xxxxxx kernel: #3 0xffffffff80c7e668 at trap_pfault+0x1e8 May 4 11:19:46 xxxxxx kernel: #4 0xffffffff80c7ec6e at trap+0x3be May 4 11:19:46 xxxxxx kernel: #5 0xffffffff80c682ef at calltrap+0x8 May 4 11:19:46 xxxxxx kernel: #6 0xffffffff8162c76d at pfi_change_group_event+0x4d May 4 11:19:46 xxxxxx kernel: #7 0xffffffff809a0d3b at if_delgroup+0x38b May 4 11:19:46 xxxxxx kernel: #8 0xffffffff809a7846 at if_clone_destroyif+0x136 May 4 11:19:46 xxxxxx kernel: #9 0xffffffff809a831a at if_clone_destroy+0x17a May 4 11:19:46 xxxxxx kernel: #10 0xffffffff809a5892 at ifioctl+0x482 May 4 11:19:46 xxxxxx kernel: #11 0xffffffff80934ef6 at kern_ioctl+0x106 May 4 11:19:46 xxxxxx kernel: #12 0xffffffff8093513d at sys_ioctl+0xfd May 4 11:19:46 xxxxxx kernel: #13 0xffffffff80c7dc10 at amd64_syscall+0x540 May 4 11:19:46 xxxxxx kernel: #14 0xffffffff80c685d7 at Xfast_syscall+0xf7 My detail environment is as follows: (0) OS version and kernel configuration file[2] admin@xxxxxx:~[113]% uname -a FreeBSD xxxxxx.org 9.1-STABLE FreeBSD 9.1-STABLE #0 r249220M: Sun Apr 7 01:55:59 JST 2013 admin@xxxxxx:/usr/obj/usr/src/sys/GENERIC amd64 admin@xxxxxx:~[114]% diff -u /sys/amd64/conf/GENERIC.org /sys/amd64/conf/GENERIC --- /sys/amd64/conf/GENERIC.org 2013-04-06 22:46:15.000000000 +0900 +++ /sys/amd64/conf/GENERIC 2013-05-04 12:24:35.000000000 +0900 @@ -19,7 +19,7 @@ # $FreeBSD: stable/9/sys/amd64/conf/GENERIC 247306 2013-02-26 05:27:02Z bryanv $ cpu HAMMER -ident GENERIC +ident XXXXXX makeoptions DEBUG=-g # Build kernel with gdb(1) debug symbols @@ -349,3 +349,5 @@ device virtio_blk # VirtIO Block device device virtio_scsi # VirtIO SCSI device device virtio_balloon # VirtIO Memory Balloon device +options NULLFS # enable mount_nullfs without null.ko +options VIMAGE # enable Vimage Jail admin@xxxxxx:~[115]% (1) Vimage Jail startup scripts' patch according to [1] is [3] (2) /var/log/messages is [4] (3) ezjail startup files are [5] (4) /etc/devfs.rules is [6] (5) /etc/rc.conf is [7] (6) Jail envirinments' fstabs' are [8] (7) pf(4) configuration file is [9] Is there any suggestions? Best regards --- Kazuhiko Kiriyama kiri@openedu.org [1] http://wiki.polymorf.fr/index.php/Howto:FreeBSD_jail_vnet [2] http://www.st.toba-cmt.ac.jp/~admin/log/GENERIC [3] http://www.st.toba-cmt.ac.jp/~admin/log/jail.r243757.patch [4] http://www.st.toba-cmt.ac.jp/~admin/log/messages [5] http://www.st.toba-cmt.ac.jp/~admin/log/ns1 http://www.st.toba-cmt.ac.jp/~admin/log/ns http://www.st.toba-cmt.ac.jp/~admin/log/cvs http://www.st.toba-cmt.ac.jp/~admin/log/mail http://www.st.toba-cmt.ac.jp/~admin/log/web [6] http://www.st.toba-cmt.ac.jp/~admin/log/devfs.rules [7] http://www.st.toba-cmt.ac.jp/~admin/log/rc.conf [8] http://www.st.toba-cmt.ac.jp/~admin/log/fstab.ns1 http://www.st.toba-cmt.ac.jp/~admin/log/fstab.ns http://www.st.toba-cmt.ac.jp/~admin/log/fstab.cvs http://www.st.toba-cmt.ac.jp/~admin/log/fstab.mail http://www.st.toba-cmt.ac.jp/~admin/log/fstab.web [9] http://www.st.toba-cmt.ac.jp/~admin/log/pf.conf