Skip site navigation (1)Skip section navigation (2)
Date:      Sat, 04 May 2013 14:52:23 +0900
From:      KIRIYAMA Kazuhiko <kiri@pis.elm.toba-cmt.ac.jp>
To:        stable@freebsd.org
Subject:   Vimage Jail kernel crashed
Message-ID:  <201305040552.r445qNB3023430@pis.elm.toba-cmt.ac.jp>

next in thread | raw e-mail | index | archive | help
Dear stable list,

I've created private network by Vimage Jail using ezjail referenced [1] as
follows:

em0 X.X.X.X bridge0 192.168.1.254 --+-- epair0a --+-- epair0b 192.168.1.1(ns)
                                    |
                                    +-- epair1a --+-- epair1b 192.168.1.2(ns1)
                                    |
                                    +-- epair2a --+-- epair2b 192.168.1.3(cvs)
                                    |
                                    +-- epair3a --+-- epair3b 192.168.1.4(mail)
                                    |
                                    +-- epair4a --+-- epair4b 192.168.1.5(web)

where X.X.X.X is the global address of outer network. All jail environments
are under /jails:

admin@xxxxxx:~[112]% ll /jails/
total 52
drwxrwxr-x   2 root  operator   512 Apr 28 03:03 .snap
drwxr-xr-x   9 root  wheel      512 Apr  7 06:13 basejail
drwxr-xr-x   4 root  wheel      512 Apr  7 06:15 commonjail
drwxr-xr-x  13 root  wheel      512 Apr  7 06:35 cvs
drwxr-xr-x  16 root  wheel     3072 Apr 14 03:14 distfiles
drwxr-xr-x   3 root  wheel      512 Apr  7 06:13 flavours
drwx------  69 root  operator  4096 Apr 18 21:06 lost+found
drwxr-xr-x  13 root  wheel      512 Apr  7 06:35 mail
drwxr-xr-x  13 root  wheel      512 Apr  7 06:16 newjail
drwxr-xr-x  13 root  wheel      512 Apr  7 06:35 ns
drwxr-xr-x  13 root  wheel      512 Apr  7 06:35 ns1
drwxr-xr-x   2 root  wheel      512 Apr  6 08:00 packages
drwxr-xr-x  13 root  wheel      512 Apr  7 06:35 web
admin@xxxxxx:~[113]% 

All seemd to go well. But when jail host shutdown, freezed and kernel paniced
to put:

Apr 28 09:56:40 xxxxxx root: /etc/rc.d/jail: DEBUG: cvs parameters: 
Apr 28 09:56:41 xxxxxx root: /etc/pccard_ether: DEBUG: run_rc_command: start_precmd: checkauto 
Apr 28 09:56:41 xxxxxx kernel: ifa_del_loopback_route: deletion failed
Apr 28 09:56:41 xxxxxx kernel: Freed UMA keg was not empty (50 items).  Lost 5 pages of memory.
Apr 28 09:56:41 xxxxxx kernel: Freed UMA keg was not empty (672 items).  Lost 4 pages of memory.
Apr 28 09:56:41 xxxxxx kernel: Freed UMA keg was not empty (50 items).  Lost 5 pages of memory.
Apr 28 09:56:41 xxxxxx kernel: Freed UMA keg was not empty (28 items).  Lost 7 pages of memory.
Apr 28 09:56:41 xxxxxx kernel: hhook_vnet_uninit: hhook_head type=1, id=1 cleanup required
Apr 28 09:56:41 xxxxxx kernel: hhook_vnet_uninit: hhook_head type=1, id=0 cleanup required
May  4 11:19:46 xxxxxx syslogd: kernel boot file is /boot/kernel/kernel
May  4 11:19:46 xxxxxx kernel: epair2a: promiscuous mode disabled
May  4 11:19:46 xxxxxx kernel: 
May  4 11:19:46 xxxxxx kernel: 
May  4 11:19:46 xxxxxx kernel: Fatal trap 12: page fault while in kernel mode
May  4 11:19:46 xxxxxx kernel: cpuid = 2; apic id = 02
May  4 11:19:46 xxxxxx kernel: fault virtual address	= 0x7818c3798
May  4 11:19:46 xxxxxx kernel: fault code		= supervisor write data, page not present
May  4 11:19:46 xxxxxx kernel: instruction pointer	= 0x20:0xffffffff8162c19e
May  4 11:19:46 xxxxxx kernel: stack pointer	        = 0x28:0xffffff8121b22860
May  4 11:19:46 xxxxxx kernel: frame pointer	        = 0x28:0xffffff8121b22870
May  4 11:19:46 xxxxxx kernel: code segment		= base 0x0, limit 0xfffff, type 0x1b
May  4 11:19:46 xxxxxx kernel: = DPL 0, pres 1, long 1, def32 0, gran 1
May  4 11:19:46 xxxxxx kernel: processor eflags	= interrupt enabled, resume, IOPL = 0
May  4 11:19:46 xxxxxx kernel: current process		= 15360 (ifconfig)
May  4 11:19:46 xxxxxx kernel: trap number		= 12
May  4 11:19:46 xxxxxx kernel: panic: page fault
May  4 11:19:46 xxxxxx kernel: cpuid = 2
May  4 11:19:46 xxxxxx kernel: KDB: stack backtrace:
May  4 11:19:46 xxxxxx kernel: #0 0xffffffff80923446 at kdb_backtrace+0x66
May  4 11:19:46 xxxxxx kernel: #1 0xffffffff808ed0be at panic+0x1ce
May  4 11:19:46 xxxxxx kernel: #2 0xffffffff80c7e330 at trap_fatal+0x290
May  4 11:19:46 xxxxxx kernel: #3 0xffffffff80c7e668 at trap_pfault+0x1e8
May  4 11:19:46 xxxxxx kernel: #4 0xffffffff80c7ec6e at trap+0x3be
May  4 11:19:46 xxxxxx kernel: #5 0xffffffff80c682ef at calltrap+0x8
May  4 11:19:46 xxxxxx kernel: #6 0xffffffff8162c76d at pfi_change_group_event+0x4d
May  4 11:19:46 xxxxxx kernel: #7 0xffffffff809a0d3b at if_delgroup+0x38b
May  4 11:19:46 xxxxxx kernel: #8 0xffffffff809a7846 at if_clone_destroyif+0x136
May  4 11:19:46 xxxxxx kernel: #9 0xffffffff809a831a at if_clone_destroy+0x17a
May  4 11:19:46 xxxxxx kernel: #10 0xffffffff809a5892 at ifioctl+0x482
May  4 11:19:46 xxxxxx kernel: #11 0xffffffff80934ef6 at kern_ioctl+0x106
May  4 11:19:46 xxxxxx kernel: #12 0xffffffff8093513d at sys_ioctl+0xfd
May  4 11:19:46 xxxxxx kernel: #13 0xffffffff80c7dc10 at amd64_syscall+0x540
May  4 11:19:46 xxxxxx kernel: #14 0xffffffff80c685d7 at Xfast_syscall+0xf7

My detail environment is as follows:

(0) OS version and kernel configuration file[2]

admin@xxxxxx:~[113]% uname -a
FreeBSD xxxxxx.org 9.1-STABLE FreeBSD 9.1-STABLE #0 r249220M: Sun Apr  7
01:55:59 JST 2013     admin@xxxxxx:/usr/obj/usr/src/sys/GENERIC  amd64
admin@xxxxxx:~[114]% diff -u
/sys/amd64/conf/GENERIC.org /sys/amd64/conf/GENERIC
--- /sys/amd64/conf/GENERIC.org 2013-04-06 22:46:15.000000000 +0900
+++ /sys/amd64/conf/GENERIC     2013-05-04 12:24:35.000000000 +0900
@@ -19,7 +19,7 @@
 # $FreeBSD: stable/9/sys/amd64/conf/GENERIC 247306 2013-02-26 05:27:02Z
bryanv $
 
 cpu            HAMMER
-ident          GENERIC
+ident          XXXXXX
 
 makeoptions    DEBUG=-g                # Build kernel with gdb(1) debug
symbols
 
@@ -349,3 +349,5 @@
 device         virtio_blk      # VirtIO Block device
 device         virtio_scsi     # VirtIO SCSI device
 device         virtio_balloon  # VirtIO Memory Balloon device
+options                NULLFS                  # enable mount_nullfs without null.ko
+options                VIMAGE                  # enable Vimage Jail
admin@xxxxxx:~[115]% 

(1) Vimage Jail startup scripts' patch according to [1] is [3]
(2) /var/log/messages is [4]
(3) ezjail startup files are [5]
(4) /etc/devfs.rules is [6]
(5) /etc/rc.conf is [7]
(6) Jail envirinments' fstabs' are [8]
(7) pf(4) configuration file is [9]

Is there any suggestions? 

Best regards
---
Kazuhiko Kiriyama
kiri@openedu.org

[1] http://wiki.polymorf.fr/index.php/Howto:FreeBSD_jail_vnet
[2] http://www.st.toba-cmt.ac.jp/~admin/log/GENERIC
[3] http://www.st.toba-cmt.ac.jp/~admin/log/jail.r243757.patch
[4] http://www.st.toba-cmt.ac.jp/~admin/log/messages
[5] http://www.st.toba-cmt.ac.jp/~admin/log/ns1
    http://www.st.toba-cmt.ac.jp/~admin/log/ns
    http://www.st.toba-cmt.ac.jp/~admin/log/cvs
    http://www.st.toba-cmt.ac.jp/~admin/log/mail
    http://www.st.toba-cmt.ac.jp/~admin/log/web
[6] http://www.st.toba-cmt.ac.jp/~admin/log/devfs.rules
[7] http://www.st.toba-cmt.ac.jp/~admin/log/rc.conf
[8] http://www.st.toba-cmt.ac.jp/~admin/log/fstab.ns1
    http://www.st.toba-cmt.ac.jp/~admin/log/fstab.ns
    http://www.st.toba-cmt.ac.jp/~admin/log/fstab.cvs
    http://www.st.toba-cmt.ac.jp/~admin/log/fstab.mail
    http://www.st.toba-cmt.ac.jp/~admin/log/fstab.web
[9] http://www.st.toba-cmt.ac.jp/~admin/log/pf.conf



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?201305040552.r445qNB3023430>