From owner-freebsd-net@freebsd.org Thu Jul 14 16:00:09 2016 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3BBB6B98607 for ; Thu, 14 Jul 2016 16:00:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 2A75015E1 for ; Thu, 14 Jul 2016 16:00:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u6EG09E4009930 for ; Thu, 14 Jul 2016 16:00:09 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-net@FreeBSD.org Subject: [Bug 199096] Kernel panic after some time using mpd (netgraph) and ipfw Date: Thu, 14 Jul 2016 16:00:09 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 9.2-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: donaldbaud@yahoo.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 14 Jul 2016 16:00:09 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D199096 Donald Baud changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |donaldbaud@yahoo.com --- Comment #2 from Donald Baud --- We started using mpd5.8 (netgraph l2tp) with FreeBSD RELENG-10.3=20 This is a replacement to a cisco7206 npeg (LNS)=20 Terminates about 300 l2tp tunnels, 800sessions and 800Mbit/s I noticed several unresolved bug reports relating to crash with netgraph: Bug 199096 Kernel panic after some time using mpd (netgraph) and ipfw=20 Bug 176401 [netgraph] page fault in netgraph=20 Bug 154286 [netgraph] [panic] 8.2-PRERELEASE panic in netgraph=20 Bug 154091 - [netgraph] [panic] netgraph, unaligned mbuf?=20 Bug 153497 - [netgraph] netgraph panic due to race conditions=20 I don't want to start an new PR but I'm noticing many panic's, once a day mostly: I've experimented with net.graph values but did't do any difference: # grep net.graph /etc/sysctl.conf ; grep net.graph /boot/loader.conf #net.graph.maxdgram=3D524288 #default 20480 #net.graph.recvspace=3D524288 #default 20480 #net.graph.maxdata=3D65536 #default 4096 #net.graph.maxalloc=3D65536 #default 4096 # uname -a FreeBSD mybox.example.com 10.3-RELEASE-p4 FreeBSD 10.3-RELEASE-p4 #0: Sat M= ay 28 12:23:44 UTC 2016=20=20=20=20 root@amd64-builder.daemonology.net:/usr/obj/usr/src/sys/GENERIC amd64 # sysctl -a | grep net.graph net.graph.mppe.max_rekey: 1000 net.graph.mppe.log_max_rekey: 1 net.graph.mppe.block_on_max_rekey: 0 net.graph.control.proto: 2 net.graph.data.proto: 1 net.graph.family: 32 net.graph.recvspace: 20480 net.graph.maxdgram: 20480 net.graph.msg_version: 8 net.graph.abi_version: 12 net.graph.maxdata: 4096 net.graph.maxalloc: 4096 net.graph.threads: 4 # kldstat Id Refs Address Size Name 1 34 0xffffffff80200000 17bc6a8 kernel 2 2 0xffffffff81c11000 114db ipfw.ko 3 1 0xffffffff81c23000 d32f dummynet.ko 4 1 0xffffffff81c31000 3831 ng_socket.ko 5 9 0xffffffff81c35000 ba02 netgraph.ko 6 1 0xffffffff81c41000 2b99 ng_mppc.ko 7 1 0xffffffff81c44000 80c rc4.ko 8 1 0xffffffff81c45000 23dc vmmemctl.ko 9 1 0xffffffff81c48000 397d ng_l2tp.ko 10 1 0xffffffff81c4c000 4b04 ng_ksocket.ko 11 1 0xffffffff81c51000 17d6 ng_tee.ko 12 1 0xffffffff81c53000 40d2 ng_iface.ko 13 1 0xffffffff81c58000 5829 ng_ppp.ko 14 1 0xffffffff81c5e000 18b1 ng_tcpmss.ko 15 1 0xffffffff81c60000 2df7 ng_vjc.ko # vmstat -z | head -1 ; vmstat -z | grep NetGraph ITEM SIZE LIMIT USED FREE REQ FAIL SLEEP NetGraph items: 72, 4123, 0, 1271,96158617, 0, 0 NetGraph data items: 72, 4123, 4, 1639,244942156, 0, 0 # /etc/rc.conf ipv6_network_interfaces=3D"none" # Default is auto=20 ip6addrctl_enable=3D"NO" # New way to disable IPv6 support=20 devd_enable=3D"NO"=20 mpd_enable=3D"YES" quagga_enable=3D"YES" quagga_daemons=3D"zebra ospfd" =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D Crash log: Jul 14 03:20:16 mybox kernel: Fatal trap 12: page fault while in kernel mode Jul 14 03:20:16 mybox kernel: cpuid =3D 3; apic id =3D 03 Jul 14 03:20:16 mybox kernel: fault virtual address =3D 0x60 Jul 14 03:20:16 mybox kernel: fault code =3D supervisor read= data, page not present Jul 14 03:20:16 mybox kernel: instruction pointer =3D 0x20:0xffffffff80a27d7a Jul 14 03:20:16 mybox kernel: stack pointer =3D 0x28:0xfffffe0174dcb600 Jul 14 03:20:16 mybox kernel: frame pointer =3D 0x28:0xfffffe0174dcb620 Jul 14 03:20:16 mybox kernel: code segment =3D base 0x0, limit 0xfffff, type 0x1b Jul 14 03:20:16 mybox kernel: =3D DPL 0, pres 1, long 1, def32 0, gran 1 Jul 14 03:20:16 mybox kernel: processor eflags =3D interrupt enabled, resu= me, IOPL =3D 0 Jul 14 03:20:16 mybox kernel: current process =3D 656 (mpd5) Jul 14 03:20:16 mybox kernel: trap number =3D 12 Jul 14 03:20:16 mybox kernel: panic: page fault Jul 14 03:20:16 mybox kernel: cpuid =3D 3 Jul 14 03:20:16 mybox kernel: KDB: stack backtrace: Jul 14 03:20:16 mybox kernel: #0 0xffffffff8098e390 at kdb_backtrace+0x60 Jul 14 03:20:16 mybox kernel: #1 0xffffffff80951066 at vpanic+0x126 Jul 14 03:20:16 mybox kernel: #2 0xffffffff80950f33 at panic+0x43 Jul 14 03:20:16 mybox kernel: #3 0xffffffff80d55f7b at trap_fatal+0x36b Jul 14 03:20:16 mybox kernel: #4 0xffffffff80d5627d at trap_pfault+0x2ed Jul 14 03:20:16 mybox kernel: #5 0xffffffff80d558fa at trap+0x47a Jul 14 03:20:16 mybox kernel: #6 0xffffffff80d3b8d2 at calltrap+0x8 Jul 14 03:20:16 mybox kernel: #7 0xffffffff80a8161d at in_ifadownkill+0x8d Jul 14 03:20:16 mybox kernel: #8 0xffffffff80a26e70 at rn_walktree+0x80 Jul 14 03:20:16 mybox kernel: #9 0xffffffff80a8151f at in_ifadown+0x9f Jul 14 03:20:16 mybox kernel: #10 0xffffffff80a76a2c at in_control+0x76c Jul 14 03:20:16 mybox kernel: #11 0xffffffff80a17d7b at ifioctl+0x15eb Jul 14 03:20:16 mybox kernel: #12 0xffffffff809a8c35 at kern_ioctl+0x255 Jul 14 03:20:16 mybox kernel: #13 0xffffffff809a8930 at sys_ioctl+0x140 Jul 14 03:20:16 mybox kernel: #14 0xffffffff80d5694f at amd64_syscall+0x40f Jul 14 03:20:16 mybox kernel: #15 0xffffffff80d3bbbb at Xfast_syscall+0xfb Jul 14 03:20:16 mybox kernel: Uptime: 1d8h24m23s Jul 14 03:20:16 mybox kernel: Dumping 557 out of 6119 MB:..3%..12%..21%..32%..41%..52%..61%..72%..81%..92% Jul 14 03:20:16 mybox kernel: Dump complete =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D other crash logs: /var/log/messages.1.bz2:Jul 12 04:18:05 mybox kernel: Fatal trap 9: general protection fault while in kernel mode /var/log/messages.1.bz2:Jul 12 04:18:05 mybox kernel: cpuid =3D 0; apic id = =3D 00 /var/log/messages.1.bz2:Jul 12 04:18:05 mybox kernel: instruction pointer= =20=20=20=20=20=20 =3D 0x20:0xffffffff81c3828d /var/log/messages.1.bz2:Jul 12 04:18:05 mybox kernel: stack pointer=20=20= =20=20=20=20=20=20=20=20=20=20 =3D 0x28:0xfffffe0174da8380 /var/log/messages.1.bz2:Jul 12 04:18:05 mybox kernel: frame pointer=20=20= =20=20=20=20=20=20=20=20=20=20 =3D 0x28:0xfffffe0174da83c0 /var/log/messages.1.bz2:Jul 12 04:18:05 mybox kernel: code segment=20=20=20= =20=20=20=20=20=20=20=20=20=20 =3D base 0x0, limit 0xfffff, type 0x1b /var/log/messages.1.bz2:Jul 12 04:18:05 mybox kernel: =3D DPL 0, pres 1, lo= ng 1, def32 0, gran 1 /var/log/messages.1.bz2:Jul 12 04:18:05 mybox kernel: processor eflags =3D interrupt enabled, resume, IOPL =3D 0 /var/log/messages.1.bz2:Jul 12 04:18:05 mybox kernel: current process=20=20= =20=20=20=20=20=20=20=20 =3D 659 (ng_queue3) /var/log/messages.1.bz2:Jul 12 04:18:05 mybox kernel: trap number=20=20=20= =20=20=20=20=20=20=20=20=20=20=20 =3D 9 /var/log/messages.1.bz2:Jul 12 04:18:05 mybox kernel: panic: general protec= tion fault /var/log/messages.1.bz2:Jul 12 04:18:05 mybox kernel: cpuid =3D 0 /var/log/messages.1.bz2:Jul 12 04:18:05 mybox kernel: KDB: stack backtrace: /var/log/messages.1.bz2:Jul 12 04:18:05 mybox kernel: #0 0xffffffff8098e390= at kdb_backtrace+0x60 /var/log/messages.1.bz2:Jul 12 04:18:05 mybox kernel: #1 0xffffffff80951066= at vpanic+0x126 /var/log/messages.1.bz2:Jul 12 04:18:05 mybox kernel: #2 0xffffffff80950f33= at panic+0x43 /var/log/messages.1.bz2:Jul 12 04:18:05 mybox kernel: #3 0xffffffff80d55f7b= at trap_fatal+0x36b /var/log/messages.1.bz2:Jul 12 04:18:05 mybox kernel: #4 0xffffffff80d55bfd= at trap+0x77d /var/log/messages.1.bz2:Jul 12 04:18:05 mybox kernel: #5 0xffffffff80d3b8d2= at calltrap+0x8 /var/log/messages.1.bz2:Jul 12 04:18:05 mybox kernel: #6 0xffffffff81c49606= at ng_l2tp_rcvdata_lower+0x946 /var/log/messages.1.bz2:Jul 12 04:18:05 mybox kernel: #7 0xffffffff81c370ca= at ng_apply_item+0x21a /var/log/messages.1.bz2:Jul 12 04:18:05 mybox kernel: #8 0xffffffff81c36d1a= at ng_snd_item+0x38a /var/log/messages.1.bz2:Jul 12 04:18:05 mybox kernel: #9 0xffffffff81c4d3e2= at ng_ksocket_incoming2+0x2f2 /var/log/messages.1.bz2:Jul 12 04:18:05 mybox kernel: #10 0xffffffff81c36f6= 2 at ng_apply_item+0xb2 /var/log/messages.1.bz2:Jul 12 04:18:05 mybox kernel: #11 0xffffffff81c38d3= 9 at ngthread+0x1b9 /var/log/messages.1.bz2:Jul 12 04:18:05 mybox kernel: #12 0xffffffff8091a4e= a at fork_exit+0x9a /var/log/messages.1.bz2:Jul 12 04:18:05 mybox kernel: #13 0xffffffff80d3be0= e at fork_trampoline+0xe /var/log/messages.1.bz2:Jul 12 04:18:05 mybox kernel: Uptime: 1d19h53m59s /var/log/messages.1.bz2:Jul 12 04:18:05 mybox kernel: Dumping 560 out of 61= 19 MB:..3%..12%..23%..32%..43%..52%..63%..72%..83%..92% /var/log/messages.1.bz2:Jul 12 04:18:05 mybox kernel: Dump complete [...] /var/log/messages.1.bz2:Jul 12 04:18:05 mybox kernel: Hypervisor: Origin =3D "VMwareVMware" /var/log/messages.1.bz2:Jul 12 04:18:05 mybox kernel: real memory =3D 6442= 450944 (6144 MB) /var/log/messages.1.bz2:Jul 12 04:18:05 mybox kernel: avail memory =3D 6183= 518208 (5897 MB) /var/log/messages.1.bz2:Jul 12 04:18:05 mybox kernel: Event timer "LAPIC" quality 600 /var/log/messages.1.bz2:Jul 12 04:18:05 mybox kernel: ACPI APIC Table: /var/log/messages.1.bz2:Jul 12 04:18:05 mybox kernel: FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs /var/log/messages.1.bz2:Jul 12 04:18:05 mybox kernel: FreeBSD/SMP: 1 packag= e(s) x 4 core(s) [...] /var/log/messages.1.bz2:Jul 12 04:18:05 mybox kernel: em0: port 0x2000-0x203f mem 0xfd5c0000-0xfd5dffff,0xfdff0000-0xfdffffff irq 18 at device 0.0 on pci2 /var/log/messages.1.bz2:Jul 12 04:18:05 mybox kernel: em0: Ethernet address: 00:50:56:8d:d7:57 /var/log/messages.1.bz2:Jul 12 04:18:05 mybox kernel: pcib3: at device 21.0 on pci0 /var/log/messages.1.bz2:Jul 12 04:18:05 mybox kernel: pci3: = on pcib3 /var/log/messages.1.bz2:Jul 12 04:18:05 mybox kernel: vmx0: port 0x4000-0x400f mem 0xfd4fc000-0xfd4fcfff,0xfd4fd000-0xfd4fdfff,0xfd4fe000-0xfd4fffff irq 18 at device 0.0 on pci3 /var/log/messages.1.bz2:Jul 12 04:18:05 mybox kernel: vmx0: Ethernet addres= s: 00:50:56:8d:4c:68 [...] /var/log/messages.1.bz2:Jul 12 04:18:05 mybox kernel: vmx1: port 0x5000-0x500f mem 0xfd3fc000-0xfd3fcfff,0xfd3fd000-0xfd3fdfff,0xfd3fe000-0xfd3fffff irq 19 at device 0.0 on pci11 /var/log/messages.1.bz2:Jul 12 04:18:05 mybox kernel: vmx1: Ethernet addres= s: 00:50:56:8d:85:29 [...] /var/log/messages.1.bz2:Jul 12 04:18:32 mybox kernel: VMware memory control driver initialized /var/log/messages.1.bz2:Jul 12 04:18:32 mybox kernel: done -------- /var/log/messages.1.bz2:Jul 12 18:55:22 mybox kernel: Fatal trap 9: general protection fault while in kernel mode /var/log/messages.1.bz2:Jul 12 18:55:22 mybox kernel: cpuid =3D 0; apic id = =3D 01 /var/log/messages.1.bz2:Jul 12 18:55:22 mybox kernel: instruction pointer= =20=20=20=20=20=20 =3D 0x20:0xffffffff81c31f40 /var/log/messages.1.bz2:Jul 12 18:55:22 mybox kernel: stack pointer=20=20= =20=20=20=20=20=20=20=20=20=20 =3D 0x28:0xfffffe017359a510 /var/log/messages.1.bz2:Jul 12 18:55:22 mybox kernel: frame pointer=20=20= =20=20=20=20=20=20=20=20=20=20 =3D 0x28:0xfffffe017359a560 /var/log/messages.1.bz2:Jul 12 18:55:22 mybox kernel: code segment=20=20=20= =20=20=20=20=20=20=20=20=20=20 =3D base 0x0, limit 0xfffff, type 0x1b /var/log/messages.1.bz2:Jul 12 18:55:22 mybox kernel: =3D DPL 0, pres 1, lo= ng 1, def32 0, gran 1 /var/log/messages.1.bz2:Jul 12 18:55:22 mybox kernel: processor eflags =3D interrupt enabled, resume, IOPL =3D 0 /var/log/messages.1.bz2:Jul 12 18:55:22 mybox kernel: current process=20=20= =20=20=20=20=20=20=20=20 =3D 656 (mpd5) /var/log/messages.1.bz2:Jul 12 18:55:22 mybox kernel: trap number=20=20=20= =20=20=20=20=20=20=20=20=20=20=20 =3D 9 /var/log/messages.1.bz2:Jul 12 18:55:22 mybox kernel: panic: general protec= tion fault /var/log/messages.1.bz2:Jul 12 18:55:22 mybox kernel: cpuid =3D 0 /var/log/messages.1.bz2:Jul 12 18:55:22 mybox kernel: KDB: stack backtrace: /var/log/messages.1.bz2:Jul 12 18:55:22 mybox kernel: #0 0xffffffff8098e390= at kdb_backtrace+0x60 /var/log/messages.1.bz2:Jul 12 18:55:22 mybox kernel: #1 0xffffffff80951066= at vpanic+0x126 /var/log/messages.1.bz2:Jul 12 18:55:22 mybox kernel: #2 0xffffffff80950f33= at panic+0x43 /var/log/messages.1.bz2:Jul 12 18:55:22 mybox kernel: #3 0xffffffff80d55f7b= at trap_fatal+0x36b /var/log/messages.1.bz2:Jul 12 18:55:22 mybox kernel: #4 0xffffffff80d55bfd= at trap+0x77d /var/log/messages.1.bz2:Jul 12 18:55:22 mybox kernel: #5 0xffffffff80d3b8d2= at calltrap+0x8 /var/log/messages.1.bz2:Jul 12 18:55:22 mybox kernel: #6 0xffffffff81c395b6= at ng_add_hook+0x106 /var/log/messages.1.bz2:Jul 12 18:55:22 mybox kernel: #7 0xffffffff81c390bb= at ng_mkpeer+0x3b /var/log/messages.1.bz2:Jul 12 18:55:22 mybox kernel: #8 0xffffffff81c37275= at ng_apply_item+0x3c5 /var/log/messages.1.bz2:Jul 12 18:55:22 mybox kernel: #9 0xffffffff81c36d1a= at ng_snd_item+0x38a /var/log/messages.1.bz2:Jul 12 18:55:22 mybox kernel: #10 0xffffffff81c319f= 1 at ngc_send+0x221 /var/log/messages.1.bz2:Jul 12 18:55:22 mybox kernel: #11 0xffffffff809cc2d= 6 at sosend_generic+0x476 /var/log/messages.1.bz2:Jul 12 18:55:22 mybox kernel: #12 0xffffffff809d263= 5 at kern_sendit+0x245 /var/log/messages.1.bz2:Jul 12 18:55:22 mybox kernel: #13 0xffffffff809d295= 9 at sendit+0x129 /var/log/messages.1.bz2:Jul 12 18:55:22 mybox kernel: #14 0xffffffff809d281= d at sys_sendto+0x4d /var/log/messages.1.bz2:Jul 12 18:55:22 mybox kernel: #15 0xffffffff80d5694= f at amd64_syscall+0x40f /var/log/messages.1.bz2:Jul 12 18:55:22 mybox kernel: #16 0xffffffff80d3bbb= b at Xfast_syscall+0xfb /var/log/messages.1.bz2:Jul 12 18:55:22 mybox kernel: Uptime: 14h36m50s /var/log/messages.1.bz2:Jul 12 18:55:22 mybox kernel: Dumping 327 out of 61= 19 MB:..5%..15%..25%..35%..44%..54%..64%..74%..84%..93% /var/log/messages.1.bz2:Jul 12 18:55:22 mybox kernel: Dump complete ------ /var/log/messages.3.bz2:Jul 10 08:23:37 mybox kernel: Fatal trap 9: general protection fault while in kernel mode /var/log/messages.3.bz2:Jul 10 08:23:37 mybox kernel: cpuid =3D 0; apic id = =3D 00 /var/log/messages.3.bz2:Jul 10 08:23:37 mybox kernel: instruction pointer= =20=20=20=20=20=20 =3D 0x20:0xffffffff80b8f26b /var/log/messages.3.bz2:Jul 10 08:23:37 mybox kernel: stack pointer=20=20= =20=20=20=20=20=20=20=20=20=20 =3D 0x28:0xfffffe0174d12730 /var/log/messages.3.bz2:Jul 10 08:23:37 mybox kernel: frame pointer=20=20= =20=20=20=20=20=20=20=20=20=20 =3D 0x28:0xfffffe0174d127d0 /var/log/messages.3.bz2:Jul 10 08:23:37 mybox kernel: code segment=20=20=20= =20=20=20=20=20=20=20=20=20=20 =3D base 0x0, limit 0xfffff, type 0x1b /var/log/messages.3.bz2:Jul 10 08:23:37 mybox kernel: =3D DPL 0, pres 1, lo= ng 1, def32 0, gran 1 /var/log/messages.3.bz2:Jul 10 08:23:37 mybox kernel: processor eflags =3D interrupt enabled, resume, IOPL =3D 0 /var/log/messages.3.bz2:Jul 10 08:23:37 mybox kernel: current process=20=20= =20=20=20=20=20=20=20=20 =3D 16 (syncer) /var/log/messages.3.bz2:Jul 10 08:23:37 mybox kernel: trap number=20=20=20= =20=20=20=20=20=20=20=20=20=20=20 =3D 9 /var/log/messages.3.bz2:Jul 10 08:23:37 mybox kernel: panic: general protec= tion fault /var/log/messages.3.bz2:Jul 10 08:23:37 mybox kernel: cpuid =3D 3 /var/log/messages.3.bz2:Jul 10 08:23:37 mybox kernel: KDB: stack backtrace: /var/log/messages.3.bz2:Jul 10 08:23:37 mybox kernel: #0 0xffffffff8098e390= at kdb_backtrace+0x60 /var/log/messages.3.bz2:Jul 10 08:23:37 mybox kernel: #1 0xffffffff80951066= at vpanic+0x126 /var/log/messages.3.bz2:Jul 10 08:23:37 mybox kernel: #2 0xffffffff80950f33= at panic+0x43 /var/log/messages.3.bz2:Jul 10 08:23:37 mybox kernel: #3 0xffffffff80d55f7b= at trap_fatal+0x36b /var/log/messages.3.bz2:Jul 10 08:23:37 mybox kernel: #4 0xffffffff80d55bfd= at trap+0x77d /var/log/messages.3.bz2:Jul 10 08:23:37 mybox kernel: #5 0xffffffff80d3b8d2= at calltrap+0x8 /var/log/messages.3.bz2:Jul 10 08:23:37 mybox kernel: #6 0xffffffff80baf5be= at ffs_geom_strategy+0x15e /var/log/messages.3.bz2:Jul 10 08:23:37 mybox kernel: #7 0xffffffff80bc0fc0= at ufs_strategy+0x80 /var/log/messages.3.bz2:Jul 10 08:23:37 mybox kernel: #8 0xffffffff80e82a5b= at VOP_STRATEGY_APV+0xab /var/log/messages.3.bz2:Jul 10 08:23:37 mybox kernel: #9 0xffffffff809dc23c= at bufstrategy+0x2c /var/log/messages.3.bz2:Jul 10 08:23:37 mybox kernel: #10 0xffffffff809dc16= 5 at bufwrite+0x185 /var/log/messages.3.bz2:Jul 10 08:23:37 mybox kernel: #11 0xffffffff80bb139= c at ffs_syncvnode+0x2dc /var/log/messages.3.bz2:Jul 10 08:23:37 mybox kernel: #12 0xffffffff80bb01e= 3 at ffs_fsync+0x23 /var/log/messages.3.bz2:Jul 10 08:23:37 mybox kernel: #13 0xffffffff80e81af= 7 at VOP_FSYNC_APV+0xa7 /var/log/messages.3.bz2:Jul 10 08:23:37 mybox kernel: #14 0xffffffff809fbe1= b at sched_sync+0x3ab /var/log/messages.3.bz2:Jul 10 08:23:37 mybox kernel: #15 0xffffffff8091a4e= a at fork_exit+0x9a /var/log/messages.3.bz2:Jul 10 08:23:37 mybox kernel: #16 0xffffffff80d3be0= e at fork_trampoline+0xe /var/log/messages.3.bz2:Jul 10 08:23:37 mybox kernel: Uptime: 1d12h20m38s /var/log/messages.3.bz2:Jul 10 08:23:37 mybox kernel: Dumping 563 out of 61= 19 MB:..3%..12%..23%..32%..43%..52%..63%..71%..83%..91% /var/log/messages.3.bz2:Jul 10 08:23:37 mybox kernel: Dump complete -------- /var/log/messages.5.bz2:Jul 8 08:09:04 mybox kernel: Fatal trap 12: page f= ault while in kernel mode /var/log/messages.5.bz2:Jul 8 08:09:04 mybox kernel: cpuid =3D 1; apic id = =3D 01 /var/log/messages.5.bz2:Jul 8 08:09:04 mybox kernel: fault virtual address= =20=20=20=20 =3D 0x28 /var/log/messages.5.bz2:Jul 8 08:09:04 mybox kernel: fault code=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20 =3D supervisor read data, page not present /var/log/messages.5.bz2:Jul 8 08:09:04 mybox kernel: instruction pointer= =20=20=20=20=20=20 =3D 0x20:0xffffffff81c38283 /var/log/messages.5.bz2:Jul 8 08:09:04 mybox kernel: stack pointer=20=20= =20=20=20=20=20=20=20=20=20=20 =3D 0x28:0xfffffe0174d85540 /var/log/messages.5.bz2:Jul 8 08:09:04 mybox kernel: frame pointer=20=20= =20=20=20=20=20=20=20=20=20=20 =3D 0x28:0xfffffe0174d85580 /var/log/messages.5.bz2:Jul 8 08:09:04 mybox kernel: code segment=20=20=20= =20=20=20=20=20=20=20=20=20=20 =3D base 0x0, limit 0xfffff, type 0x1b /var/log/messages.5.bz2:Jul 8 08:09:04 mybox kernel: =3D DPL 0, pres 1, lo= ng 1, def32 0, gran 1 /var/log/messages.5.bz2:Jul 8 08:09:04 mybox kernel: processor eflags =3D interrupt enabled, resume, IOPL =3D 0 /var/log/messages.5.bz2:Jul 8 08:09:04 mybox kernel: current process=20=20= =20=20=20=20=20=20=20=20 =3D 628 (ng_queue2) /var/log/messages.5.bz2:Jul 8 08:09:04 mybox kernel: trap number=20=20=20= =20=20=20=20=20=20=20=20=20=20=20 =3D 12 /var/log/messages.5.bz2:Jul 8 08:09:04 mybox kernel: panic: page fault /var/log/messages.5.bz2:Jul 8 08:09:04 mybox kernel: cpuid =3D 1 /var/log/messages.5.bz2:Jul 8 08:09:04 mybox kernel: KDB: stack backtrace: /var/log/messages.5.bz2:Jul 8 08:09:04 mybox kernel: #0 0xffffffff8098e390= at kdb_backtrace+0x60 /var/log/messages.5.bz2:Jul 8 08:09:04 mybox kernel: #1 0xffffffff80951066= at vpanic+0x126 /var/log/messages.5.bz2:Jul 8 08:09:04 mybox kernel: #2 0xffffffff80950f33= at panic+0x43 /var/log/messages.5.bz2:Jul 8 08:09:04 mybox kernel: #3 0xffffffff80d55f7b= at trap_fatal+0x36b /var/log/messages.5.bz2:Jul 8 08:09:04 mybox kernel: #4 0xffffffff80d5627d= at trap_pfault+0x2ed /var/log/messages.5.bz2:Jul 8 08:09:04 mybox kernel: #5 0xffffffff80d558fa= at trap+0x47a /var/log/messages.5.bz2:Jul 8 08:09:04 mybox kernel: #6 0xffffffff80d3b8d2= at calltrap+0x8 /var/log/messages.5.bz2:Jul 8 08:09:04 mybox kernel: #7 0xffffffff81c5e509= at ng_tcpmss_rcvdata+0x2d9 /var/log/messages.5.bz2:Jul 8 08:09:04 mybox kernel: #8 0xffffffff81c370ca= at ng_apply_item+0x21a /var/log/messages.5.bz2:Jul 8 08:09:04 mybox kernel: #9 0xffffffff81c36d1a= at ng_snd_item+0x38a /var/log/messages.5.bz2:Jul 8 08:09:04 mybox kernel: #10 0xffffffff81c5a1c= 8 at ng_ppp_comp_recv+0x148 /var/log/messages.5.bz2:Jul 8 08:09:04 mybox kernel: #11 0xffffffff81c370c= a at ng_apply_item+0x21a /var/log/messages.5.bz2:Jul 8 08:09:04 mybox kernel: #12 0xffffffff81c36d1= a at ng_snd_item+0x38a /var/log/messages.5.bz2:Jul 8 08:09:04 mybox kernel: #13 0xffffffff81c370c= a at ng_apply_item+0x21a /var/log/messages.5.bz2:Jul 8 08:09:04 mybox kernel: #14 0xffffffff81c36d1= a at ng_snd_item+0x38a /var/log/messages.5.bz2:Jul 8 08:09:04 mybox kernel: #15 0xffffffff81c370c= a at ng_apply_item+0x21a /var/log/messages.5.bz2:Jul 8 08:09:04 mybox kernel: #16 0xffffffff81c36d1= a at ng_snd_item+0x38a /var/log/messages.5.bz2:Jul 8 08:09:04 mybox kernel: #17 0xffffffff81c4d3e= 2 at ng_ksocket_incoming2+0x2f2 /var/log/messages.5.bz2:Jul 8 08:09:04 mybox kernel: Uptime: 5d17h47m38s ------- /var/log/messages.5.bz2:Jul 8 20:02:30 mybox kernel: Fatal trap 12: page f= ault while in kernel mode /var/log/messages.5.bz2:Jul 8 20:02:30 mybox kernel: cpuid =3D 2; apic id = =3D 02 /var/log/messages.5.bz2:Jul 8 20:02:30 mybox kernel: fault virtual address= =20=20=20=20 =3D 0x28 /var/log/messages.5.bz2:Jul 8 20:02:30 mybox kernel: fault code=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20 =3D supervisor read data, page not present /var/log/messages.5.bz2:Jul 8 20:02:30 mybox kernel: instruction pointer= =20=20=20=20=20=20 =3D 0x20:0xffffffff81c38283 /var/log/messages.5.bz2:Jul 8 20:02:30 mybox kernel: stack pointer=20=20= =20=20=20=20=20=20=20=20=20=20 =3D 0x28:0xfffffe0174d99660 /var/log/messages.5.bz2:Jul 8 20:02:30 mybox kernel: frame pointer=20=20= =20=20=20=20=20=20=20=20=20=20 =3D 0x28:0xfffffe0174d996a0 /var/log/messages.5.bz2:Jul 8 20:02:30 mybox kernel: code segment=20=20=20= =20=20=20=20=20=20=20=20=20=20 =3D base 0x0, limit 0xfffff, type 0x1b /var/log/messages.5.bz2:Jul 8 20:02:30 mybox kernel: =3D DPL 0, pres 1, lo= ng 1, def32 0, gran 1 /var/log/messages.5.bz2:Jul 8 20:02:30 mybox kernel: processor eflags =3D interrupt enabled, resume, IOPL =3D 0 /var/log/messages.5.bz2:Jul 8 20:02:30 mybox kernel: current process=20=20= =20=20=20=20=20=20=20=20 =3D 627 (ng_queue3) /var/log/messages.5.bz2:Jul 8 20:02:30 mybox kernel: trap number=20=20=20= =20=20=20=20=20=20=20=20=20=20=20 =3D 12 /var/log/messages.5.bz2:Jul 8 20:02:30 mybox kernel: panic: page fault /var/log/messages.5.bz2:Jul 8 20:02:30 mybox kernel: cpuid =3D 2 /var/log/messages.5.bz2:Jul 8 20:02:30 mybox kernel: KDB: stack backtrace: /var/log/messages.5.bz2:Jul 8 20:02:30 mybox kernel: #0 0xffffffff8098e390= at kdb_backtrace+0x60 /var/log/messages.5.bz2:Jul 8 20:02:30 mybox kernel: #1 0xffffffff80951066= at vpanic+0x126 /var/log/messages.5.bz2:Jul 8 20:02:30 mybox kernel: #2 0xffffffff80950f33= at panic+0x43 /var/log/messages.5.bz2:Jul 8 20:02:30 mybox kernel: #3 0xffffffff80d55f7b= at trap_fatal+0x36b /var/log/messages.5.bz2:Jul 8 20:02:30 mybox kernel: #4 0xffffffff80d5627d= at trap_pfault+0x2ed /var/log/messages.5.bz2:Jul 8 20:02:30 mybox kernel: #5 0xffffffff80d558fa= at trap+0x47a /var/log/messages.5.bz2:Jul 8 20:02:30 mybox kernel: #6 0xffffffff80d3b8d2= at calltrap+0x8 /var/log/messages.5.bz2:Jul 8 20:02:30 mybox kernel: #7 0xffffffff81c5a042= at ng_ppp_bypass+0x62 /var/log/messages.5.bz2:Jul 8 20:02:30 mybox kernel: #8 0xffffffff81c370ca= at ng_apply_item+0x21a /var/log/messages.5.bz2:Jul 8 20:02:30 mybox kernel: #9 0xffffffff81c36d1a= at ng_snd_item+0x38a /var/log/messages.5.bz2:Jul 8 20:02:30 mybox kernel: #10 0xffffffff81c370c= a at ng_apply_item+0x21a /var/log/messages.5.bz2:Jul 8 20:02:30 mybox kernel: #11 0xffffffff81c36d1= a at ng_snd_item+0x38a /var/log/messages.5.bz2:Jul 8 20:02:30 mybox kernel: #12 0xffffffff81c370c= a at ng_apply_item+0x21a /var/log/messages.5.bz2:Jul 8 20:02:30 mybox kernel: #13 0xffffffff81c36d1= a at ng_snd_item+0x38a /var/log/messages.5.bz2:Jul 8 20:02:30 mybox kernel: #14 0xffffffff81c4d3e= 2 at ng_ksocket_incoming2+0x2f2 /var/log/messages.5.bz2:Jul 8 20:02:30 mybox kernel: #15 0xffffffff81c36f6= 2 at ng_apply_item+0xb2 /var/log/messages.5.bz2:Jul 8 20:02:30 mybox kernel: #16 0xffffffff81c38d3= 9 at ngthread+0x1b9 /var/log/messages.5.bz2:Jul 8 20:02:30 mybox kernel: #17 0xffffffff8091a4e= a at fork_exit+0x9a /var/log/messages.5.bz2:Jul 8 20:02:30 mybox kernel: Uptime: 11h52m56s /var/log/messages.5.bz2:Jul 8 20:02:30 mybox kernel: Dumping 591 out of 61= 19 MB:..3%..11%..22%..33%..41%..52%..63%..71%..82%..92% /var/log/messages.5.bz2:Jul 8 20:02:30 mybox kernel: Dump complete --=20 You are receiving this mail because: You are the assignee for the bug.=