From owner-freebsd-ipfw@FreeBSD.ORG Mon May 18 07:28:14 2015 Return-Path: Delivered-To: freebsd-ipfw@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 27AA63D5 for ; Mon, 18 May 2015 07:28:14 +0000 (UTC) Received: from mail.protvino.net (mail.protvino.net [91.207.114.2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 835171B91 for ; Mon, 18 May 2015 07:28:13 +0000 (UTC) Received: from [91.207.115.1] (unknown [91.207.115.1]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.protvino.net (Postfix) with ESMTPSA id 18D6C36ED94 for ; Mon, 18 May 2015 10:21:18 +0300 (MSK) From: =?utf-8?B?0JHQtdC30LfRg9Cx0L7QsiDQkNC70LXQutGB0LDQvdC00YA=?= Subject: Panic kernel 10.0&10.1 Message-Id: <61ECD41E-247A-426C-92BD-9B8D496FFB93@gmail.com> Date: Mon, 18 May 2015 10:21:13 +0300 To: freebsd-ipfw@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 8.2 \(2100\)) X-Mailer: Apple Mail (2.2100) X-Spam-Status: No, score=-3.1 required=5.0 tests=ALL_TRUSTED, AWL, FREEMAIL_FROM, HTML_MESSAGE,URIBL_BLOCKED autolearn=no autolearn_force=no version=3.4.0 X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on mail.protvino.net Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-ipfw@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: IPFW Technical Discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 May 2015 07:28:14 -0000 Hello! Please help to find problem why kernel panic on 10.0 and 10.1? =E2=80=94 # uname -a FreeBSD nas3.xxx.net 10.0-RELEASE-p9 FreeBSD 10.0-RELEASE-p9 #0: Thu Sep = 25 04:23:16 MSK 2014 # kgdb kernel.debug /var/crash/vmcore.7 GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you = are welcome to change it and/or distribute copies of it under certain = conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for = details. This GDB was configured as "amd64-marcel-freebsd"... Unread portion of the kernel message buffer: instruction pointer =3D 0x20:0xffffffff80a49825 stack pointer =3D 0x28:0xfffffe011ea908a0 frame pointer =3D 0x28:0xfffffe011ea908f0 code segment =3D base 0x0, limit 0xfffff, type 0x1b =3D DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags =3D interrupt enabled, resume, IOPL =3D 0 current process =3D 0 (dummynet) trap number =3D 12 panic: page fault cpuid =3D 0 KDB: stack backtrace: #0 0xffffffff809321b0 at kdb_backtrace+0x60 #1 0xffffffff808f9c95 at panic+0x155 #2 0xffffffff80d167e2 at trap_fatal+0x3a2 #3 0xffffffff80d16ab9 at trap_pfault+0x2c9 #4 0xffffffff80d16246 at trap+0x5e6 #5 0xffffffff80cfd4e2 at calltrap+0x8 #6 0xffffffff809bf1ae at netisr_dispatch_src+0x5e #7 0xffffffff80afd79c at dummynet_send+0x10c #8 0xffffffff80afd394 at dummynet_task+0x2c4 #9 0xffffffff8093ff46 at taskqueue_run_locked+0xe6 #10 0xffffffff809407c8 at taskqueue_thread_loop+0xa8 #11 0xffffffff808cb05a at fork_exit+0x9a #12 0xffffffff80cfda1e at fork_trampoline+0xe Uptime: 1d0h35m18s Dumping 570 out of 4045 = MB:..3%..12%..23%..31%..43%..51%..62%..71%..82%..93% Reading symbols from /boot/kernel/coretemp.ko.symbols...done. Loaded symbols for /boot/kernel/coretemp.ko.symbols Reading symbols from /boot/kernel/ng_ipfw.ko.symbols...done. Loaded symbols for /boot/kernel/ng_ipfw.ko.symbols Reading symbols from /boot/kernel/ng_car.ko.symbols...done. Loaded symbols for /boot/kernel/ng_car.ko.symbols Reading symbols from /boot/kernel/ums.ko.symbols...done. Loaded symbols for /boot/kernel/ums.ko.symbols Reading symbols from /boot/kernel/ng_socket.ko.symbols...done. Loaded symbols for /boot/kernel/ng_socket.ko.symbols Reading symbols from /boot/kernel/ng_tee.ko.symbols...done. Loaded symbols for /boot/kernel/ng_tee.ko.symbols Reading symbols from /boot/kernel/ng_tcpmss.ko.symbols...done. Loaded symbols for /boot/kernel/ng_tcpmss.ko.symbols Reading symbols from /boot/kernel/ng_vjc.ko.symbols...done. Loaded symbols for /boot/kernel/ng_vjc.ko.symbols Reading symbols from /boot/kernel/zfs.ko.symbols...done. Loaded symbols for /boot/kernel/zfs.ko.symbols Reading symbols from /boot/kernel/opensolaris.ko.symbols...done. Loaded symbols for /boot/kernel/opensolaris.ko.symbols #0 doadump (textdump=3D) at pcpu.h:219 219 __asm("movq %%gs:%1,%0" : "=3Dr" (td) (kgdb) bt #0 doadump (textdump=3D) at pcpu.h:219 #1 0xffffffff808f9910 in kern_reboot (howto=3D260) at = /usr/src/sys/kern/kern_shutdown.c:447 #2 0xffffffff808f9cd4 in panic (fmt=3D) at = /usr/src/sys/kern/kern_shutdown.c:754 #3 0xffffffff80d167e2 in trap_fatal (frame=3D, = eva=3D) at /usr/src/sys/amd64/amd64/trap.c:882 #4 0xffffffff80d16ab9 in trap_pfault (frame=3D0xfffffe011ea907f0, = usermode=3D0) at /usr/src/sys/amd64/amd64/trap.c:699 #5 0xffffffff80d16246 in trap (frame=3D0xfffffe011ea907f0) at = /usr/src/sys/amd64/amd64/trap.c:463 #6 0xffffffff80cfd4e2 in calltrap () at = /usr/src/sys/amd64/amd64/exception.S:232 #7 0xffffffff80a49825 in ip_input (m=3D0xfffff80008727700) at = /usr/src/sys/netinet/ip_input.c:623 #8 0xffffffff809bf1ae in netisr_dispatch_src (proto=3D, source=3D, m=3D0x4000000001) at = /usr/src/sys/net/netisr.c:972 #9 0xffffffff80afd79c in dummynet_send (m=3D) at = /usr/src/sys/netpfil/ipfw/ip_dn_io.c:665 #10 0xffffffff80afd394 in dummynet_task (context=3D, pending=3D) at = /usr/src/sys/netpfil/ipfw/ip_dn_io.c:625 #11 0xffffffff8093ff46 in taskqueue_run_locked = (queue=3D0xfffff800103b6c00) at /usr/src/sys/kern/subr_taskqueue.c:333 #12 0xffffffff809407c8 in taskqueue_thread_loop (arg=3D) at /usr/src/sys/kern/subr_taskqueue.c:535 #13 0xffffffff808cb05a in fork_exit (callout=3D0xffffffff80940720 = , arg=3D0xffffffff8151efc8, = frame=3D0xfffffe011ea90ac0) at /usr/src/sys/kern/kern_fork.c:995 #14 0xffffffff80cfda1e in fork_trampoline () at = /usr/src/sys/amd64/amd64/exception.S:606 #15 0x0000000000000000 in ?? () Current language: auto; currently minimal =E2=80=94 Then I upgraded to 10.1: =E2=80=94 # uname -a FreeBSD nas3.XXX.net 10.1-RELEASE-p9 FreeBSD 10.1-RELEASE-p9 #0: Tue May = 5 00:50:29 MSK 2015 root@nas3.XXX.net:/usr/obj/usr/src/sys/GENERIC = amd64 Yesterday server restarted again: root@nas3:~ # last -10 root pts/1 10.1.2.2 Thu May 7 00:06 still = logged in root pts/0 help.XXX.net Wed May 6 23:56 still logged in boot time Wed May 6 18:56 root pts/0 10.1.2.2 Tue May 5 11:54 - 13:44 = (01:49) In /var/crash I have: -rw------- 1 root wheel 639356928 May 6 18:55 vmcore.8 kgdb: root@nas3:/usr/obj/usr/src/sys/GENERIC # kgdb kernel.debug = /var/crash/vmcore.8 GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you = are welcome to change it and/or distribute copies of it under certain = conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for = details. This GDB was configured as "amd64-marcel-freebsd"... Unread portion of the kernel message buffer: Reading symbols from /boot/kernel/coretemp.ko.symbols...done. Loaded symbols for /boot/kernel/coretemp.ko.symbols Reading symbols from /boot/kernel/netgraph.ko.symbols...done. Loaded symbols for /boot/kernel/netgraph.ko.symbols Reading symbols from /boot/kernel/ng_ipfw.ko.symbols...done. Loaded symbols for /boot/kernel/ng_ipfw.ko.symbols Reading symbols from /boot/kernel/ipfw.ko.symbols...done. Loaded symbols for /boot/kernel/ipfw.ko.symbols Reading symbols from /boot/kernel/ng_car.ko.symbols...done. Loaded symbols for /boot/kernel/ng_car.ko.symbols Reading symbols from /boot/kernel/ums.ko.symbols...done. Loaded symbols for /boot/kernel/ums.ko.symbols Reading symbols from /boot/kernel/ng_socket.ko.symbols...done. Loaded symbols for /boot/kernel/ng_socket.ko.symbols Reading symbols from /boot/kernel/ng_mppc.ko.symbols...done. Loaded symbols for /boot/kernel/ng_mppc.ko.symbols Reading symbols from /boot/kernel/rc4.ko.symbols...done. Loaded symbols for /boot/kernel/rc4.ko.symbols Reading symbols from /boot/kernel/ng_ether.ko.symbols...done. Loaded symbols for /boot/kernel/ng_ether.ko.symbols Reading symbols from /boot/kernel/ng_pppoe.ko.symbols...done. Loaded symbols for /boot/kernel/ng_pppoe.ko.symbols Reading symbols from /boot/kernel/ng_tee.ko.symbols...done. Loaded symbols for /boot/kernel/ng_tee.ko.symbols Reading symbols from /boot/kernel/ng_pptpgre.ko.symbols...done. Loaded symbols for /boot/kernel/ng_pptpgre.ko.symbols Reading symbols from /boot/kernel/ng_ksocket.ko.symbols...done. Loaded symbols for /boot/kernel/ng_ksocket.ko.symbols Reading symbols from /boot/kernel/ng_iface.ko.symbols...done. Loaded symbols for /boot/kernel/ng_iface.ko.symbols Reading symbols from /boot/kernel/ng_ppp.ko.symbols...done. Loaded symbols for /boot/kernel/ng_ppp.ko.symbols Reading symbols from /boot/kernel/ng_netflow.ko.symbols...done. Loaded symbols for /boot/kernel/ng_netflow.ko.symbols Reading symbols from /boot/kernel/ng_tcpmss.ko.symbols...done. Loaded symbols for /boot/kernel/ng_tcpmss.ko.symbols Reading symbols from /boot/kernel/ng_bpf.ko.symbols...done. Loaded symbols for /boot/kernel/ng_bpf.ko.symbols Reading symbols from /boot/kernel/zfs.ko.symbols...done. Loaded symbols for /boot/kernel/zfs.ko.symbols Reading symbols from /boot/kernel/opensolaris.ko.symbols...done. Loaded symbols for /boot/kernel/opensolaris.ko.symbols Reading symbols from /boot/kernel/ng_vjc.ko.symbols...done. Loaded symbols for /boot/kernel/ng_vjc.ko.symbols Reading symbols from /boot/kernel/ng_l2tp.ko.symbols...done. Loaded symbols for /boot/kernel/ng_l2tp.ko.symbols #0 doadump (textdump=3D) at pcpu.h:219 219 __asm("movq %%gs:%1,%0" : "=3Dr" (td) (kgdb) bt #0 doadump (textdump=3D) at pcpu.h:219 #1 0xffffffff80927da2 in kern_reboot (howto=3D260) at = /usr/src/sys/kern/kern_shutdown.c:452 #2 0xffffffff80928164 in panic (fmt=3D) at = /usr/src/sys/kern/kern_shutdown.c:759 #3 0xffffffff80d24f5f in trap_fatal (frame=3D, = eva=3D) at /usr/src/sys/amd64/amd64/trap.c:865 #4 0xffffffff80d25278 in trap_pfault (frame=3D0xfffffe011a565310, = usermode=3D) at /usr/src/sys/amd64/amd64/trap.c:676 #5 0xffffffff80d248da in trap (frame=3D0xfffffe011a565310) at = /usr/src/sys/amd64/amd64/trap.c:440 #6 0xffffffff80d0a7c2 in calltrap () at = /usr/src/sys/amd64/amd64/exception.S:232 #7 0xffffffff81a466db in bpf_filter (pc=3D0x34646dc7, = p=3D0xfffff8003e94380e "E", wirelen=3D40, buflen=3D40) at = /usr/src/sys/modules/netgraph/bpf/../../../net/bpf_filter.c:193 #8 0xffffffff81a4645f in ng_bpf_rcvdata (hook=3D, = item=3D) at = /usr/src/sys/modules/netgraph/bpf/../../../netgraph/ng_bpf.c:476 #9 0xffffffff8195d0ca in ng_apply_item (node=3D0xfffff80119342a00, = item=3D0xfffff8003e2c5400, rw=3D0) at = /usr/src/sys/modules/netgraph/netgraph/../../../netgraph/ng_base.c:2397 #10 0xffffffff8195cd1a in ng_snd_item (item=3D0xfffff8003e2c5400, = flags=3D) at = /usr/src/sys/modules/netgraph/netgraph/../../../netgraph/ng_base.c:2314 #11 0xffffffff81a31d59 in ng_iface_send (ifp=3D0xfffff80119d61800, = m=3D, sa=3D) at = /usr/src/sys/modules/netgraph/iface/../../../netgraph/ng_iface.c:473 #12 0xffffffff81a318b8 in ng_iface_output (ifp=3D0xfffff80119d61800, = m=3D0xfffff8003ec6da00, dst=3D, ro=3D0x0) at = /usr/src/sys/modules/netgraph/iface/../../../netgraph/ng_iface.c:408 #13 0xffffffff80a59024 in ip_output (m=3D0xfffff8003ec6da00, opt=3D, flags=3D, imo=3D, inp=3D) at /usr/src/sys/netinet/ip_output.c:638 #14 0xffffffff80a558ff in ip_forward (m=3D0xfffff8003ec6da00, = srcrt=3D) at /usr/src/sys/netinet/ip_input.c:1472 #15 0xffffffff80a5557d in ip_input (m=3D0xfffff8003ec6da00) at = /usr/src/sys/netinet/ip_input.c:681 #16 0xffffffff809f44e2 in netisr_dispatch_src (proto=3D, source=3D, m=3D0x0) at = /usr/src/sys/net/netisr.c:972 #17 0xffffffff809eb996 in ether_demux (ifp=3D, = m=3D0xfffff8003ec6da00) at /usr/src/sys/net/if_ethersubr.c:851 #18 0xffffffff809ec63e in ether_nh_input (m=3D) at = /usr/src/sys/net/if_ethersubr.c:646 #19 0xffffffff809f44e2 in netisr_dispatch_src (proto=3D, source=3D, m=3D0x0) at = /usr/src/sys/net/netisr.c:972 #20 0xffffffff804d45db in em_rxeof (count=3D99) at = /usr/src/sys/dev/e1000/if_em.c:4532 #21 0xffffffff804d3d3c in em_handle_que (context=3D0xfffffe0000a4e000, = pending=3D) at /usr/src/sys/dev/e1000/if_em.c:1534 #22 0xffffffff80971475 in taskqueue_run_locked = (queue=3D0xfffff80002ba4d00) at /usr/src/sys/kern/subr_taskqueue.c:342 #23 0xffffffff80971f08 in taskqueue_thread_loop (arg=3D) at /usr/src/sys/kern/subr_taskqueue.c:563 #24 0xffffffff808f8b6a in fork_exit (callout=3D0xffffffff80971e60 = , arg=3D0xfffffe0000a50738, = frame=3D0xfffffe011a565ac0) at /usr/src/sys/kern/kern_fork.c:996 #25 0xffffffff80d0acfe in fork_trampoline () at = /usr/src/sys/amd64/amd64/exception.S:606 #26 0x0000000000000000 in ?? () Current language: auto; currently minimal I use a firewall, only one pipe: 00400 161854 8289970 fwd X.X.X.X,3128 tcp from table(1) to any = dst-port 80 00401 199967 10465560 pipe tablearg ip from any to table(1) 00401 187811 10188461 pipe tablearg ip from table(2) to any ${fwcmd} pipe 1 config bw 256Kbit/s mask dst-ip 0xffffffff ${fwcmd} pipe 2 config bw 256Kbit/s mask src-ip 0xffffffff Then I tried to recompile kernel without netgraph. Now I have GENERIC + = only: options IPFIREWALL options DUMMYNET Few days ago it rebooted again: kgdb kernel.debug /var/crash/vmcore.1 root@nas3:/usr/obj/usr/src/sys/nas # kgdb kernel.debug = /var/crash/vmcore.last GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you = are welcome to change it and/or distribute copies of it under certain = conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for = details. This GDB was configured as "amd64-marcel-freebsd"... Unread portion of the kernel message buffer: panic: page fault cpuid =3D 0 KDB: stack backtrace: #0 0xffffffff80963e70 at kdb_backtrace+0x60 #1 0xffffffff80928f95 at panic+0x155 #2 0xffffffff80d3840f at trap_fatal+0x38f #3 0xffffffff80d38728 at trap_pfault+0x308 #4 0xffffffff80d37d8a at trap+0x47a #5 0xffffffff80d1dc72 at calltrap+0x8 #6 0xffffffff809f5352 at netisr_dispatch_src+0x62 #7 0xffffffff80b1433c at dummynet_send+0x10c #8 0xffffffff80b13f54 at dummynet_task+0x2c4 #9 0xffffffff809722e5 at taskqueue_run_locked+0xe5 #10 0xffffffff80972d78 at taskqueue_thread_loop+0xa8 #11 0xffffffff808f99da at fork_exit+0x9a #12 0xffffffff80d1e1ae at fork_trampoline+0xe Uptime: 4d21h21m20s Dumping 555 out of 4044 = MB:..3%..12%..21%..32%..41%..52%..61%..72%..81%..93% Reading symbols from /boot/kernel/coretemp.ko.symbols...done. Loaded symbols for /boot/kernel/coretemp.ko.symbols Reading symbols from /boot/kernel/netgraph.ko.symbols...done. Loaded symbols for /boot/kernel/netgraph.ko.symbols Reading symbols from /boot/kernel/ng_ipfw.ko.symbols...done. Loaded symbols for /boot/kernel/ng_ipfw.ko.symbols Reading symbols from /boot/kernel/ng_car.ko.symbols...done. Loaded symbols for /boot/kernel/ng_car.ko.symbols Reading symbols from /boot/kernel/ums.ko.symbols...done. Loaded symbols for /boot/kernel/ums.ko.symbols Reading symbols from /boot/kernel/ng_socket.ko.symbols...done. Loaded symbols for /boot/kernel/ng_socket.ko.symbols Reading symbols from /boot/kernel/ng_mppc.ko.symbols...done. Loaded symbols for /boot/kernel/ng_mppc.ko.symbols Reading symbols from /boot/kernel/rc4.ko.symbols...done. Loaded symbols for /boot/kernel/rc4.ko.symbols Reading symbols from /boot/kernel/ng_ether.ko.symbols...done. Loaded symbols for /boot/kernel/ng_ether.ko.symbols Reading symbols from /boot/kernel/ng_pppoe.ko.symbols...done. Loaded symbols for /boot/kernel/ng_pppoe.ko.symbols Reading symbols from /boot/kernel/ng_tee.ko.symbols...done. Loaded symbols for /boot/kernel/ng_tee.ko.symbols Reading symbols from /boot/kernel/ng_pptpgre.ko.symbols...done. Loaded symbols for /boot/kernel/ng_pptpgre.ko.symbols Reading symbols from /boot/kernel/ng_ksocket.ko.symbols...done. Loaded symbols for /boot/kernel/ng_ksocket.ko.symbols Reading symbols from /boot/kernel/ng_iface.ko.symbols...done. Loaded symbols for /boot/kernel/ng_iface.ko.symbols Reading symbols from /boot/kernel/ng_ppp.ko.symbols...done. Loaded symbols for /boot/kernel/ng_ppp.ko.symbols Reading symbols from /boot/kernel/ng_netflow.ko.symbols...done. Loaded symbols for /boot/kernel/ng_netflow.ko.symbols Reading symbols from /boot/kernel/ng_tcpmss.ko.symbols...done. Loaded symbols for /boot/kernel/ng_tcpmss.ko.symbols Reading symbols from /boot/kernel/ng_bpf.ko.symbols...done. Loaded symbols for /boot/kernel/ng_bpf.ko.symbols Reading symbols from /boot/kernel/zfs.ko.symbols...done. Loaded symbols for /boot/kernel/zfs.ko.symbols Reading symbols from /boot/kernel/opensolaris.ko.symbols...done. Loaded symbols for /boot/kernel/opensolaris.ko.symbols Reading symbols from /boot/kernel/ng_vjc.ko.symbols...done. Loaded symbols for /boot/kernel/ng_vjc.ko.symbols #0 doadump (textdump=3D) at pcpu.h:219 219 __asm("movq %%gs:%1,%0" : "=3Dr" (td) (kgdb) bt #0 doadump (textdump=3D) at pcpu.h:219 #1 0xffffffff80928c12 in kern_reboot (howto=3D260) at = /usr/src/sys/kern/kern_shutdown.c:452 #2 0xffffffff80928fd4 in panic (fmt=3D) at = /usr/src/sys/kern/kern_shutdown.c:759 #3 0xffffffff80d3840f in trap_fatal (frame=3D, = eva=3D) at /usr/src/sys/amd64/amd64/trap.c:865 #4 0xffffffff80d38728 in trap_pfault (frame=3D0xfffffe011e99c800, = usermode=3D) at /usr/src/sys/amd64/amd64/trap.c:676 #5 0xffffffff80d37d8a in trap (frame=3D0xfffffe011e99c800) at = /usr/src/sys/amd64/amd64/trap.c:440 #6 0xffffffff80d1dc72 in calltrap () at = /usr/src/sys/amd64/amd64/exception.S:232 #7 0xffffffff80a5627d in ip_input (m=3D0xfffff8004b041400) at = /usr/src/sys/netinet/ip_input.c:594 #8 0xffffffff809f5352 in netisr_dispatch_src (proto=3D, source=3D, m=3D0x40000000c1) at /usr/src/sys/net/netisr.c:972 #9 0xffffffff80b1433c in dummynet_send (m=3D) at = /usr/src/sys/netpfil/ipfw/ip_dn_io.c:665 #10 0xffffffff80b13f54 in dummynet_task (context=3D, pending=3D) at /usr/src/sys/netpfil/ipfw/ip_dn_io.c:625 #11 0xffffffff809722e5 in taskqueue_run_locked = (queue=3D0xfffff800193b2a00) at /usr/src/sys/kern/subr_taskqueue.c:342 #12 0xffffffff80972d78 in taskqueue_thread_loop (arg=3D) at /usr/src/sys/kern/subr_taskqueue.c:563 #13 0xffffffff808f99da in fork_exit (callout=3D0xffffffff80972cd0 = , arg=3D0xffffffff815e6800, frame=3D0xfffffe011e99cac0) at /usr/src/sys/kern/kern_fork.c:996 #14 0xffffffff80d1e1ae in fork_trampoline () at = /usr/src/sys/amd64/amd64/exception.S:606 #15 0x0000000000000000 in ?? () Current language: auto; currently minimal[/CODE] I have a suspicion of a dummynet module. root@nas:/var/crash # sysctl -a | grep dummynet[/CMD] net.inet.ip.dummynet.hash_size: 64 net.inet.ip.dummynet.pipe_slot_limit: 100 net.inet.ip.dummynet.pipe_byte_limit: 1048576 net.inet.ip.dummynet.io_fast: 0 net.inet.ip.dummynet.debug: 0 net.inet.ip.dummynet.red_lookup_depth: 256 net.inet.ip.dummynet.red_avg_pkt_size: 512 net.inet.ip.dummynet.red_max_pkt_size: 1500 net.inet.ip.dummynet.tick_delta: 0 net.inet.ip.dummynet.tick_delta_sum: -233 net.inet.ip.dummynet.tick_adjustment: 5593 net.inet.ip.dummynet.tick_diff: -4366 net.inet.ip.dummynet.tick_lost: 0 net.inet.ip.dummynet.expire: 1 net.inet.ip.dummynet.expire_cycle: 0 net.inet.ip.dummynet.schk_count: 60 net.inet.ip.dummynet.si_count: 0 net.inet.ip.dummynet.fsk_count: 30 net.inet.ip.dummynet.queue_count: 0 net.inet.ip.dummynet.io_pkt: 1038380 net.inet.ip.dummynet.io_pkt_fast: 0 net.inet.ip.dummynet.io_pkt_drop: 66254 I will try: root@nas:/var/crash # sysctl -w net.inet.ip.dummynet.io_fast=3D1 May be I mistaked and something doing wrong and problem anywhere else? Thanks From owner-freebsd-ipfw@FreeBSD.ORG Tue May 19 21:26:10 2015 Return-Path: Delivered-To: freebsd-ipfw@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 76350A42 for ; Tue, 19 May 2015 21:26:10 +0000 (UTC) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 6101B17CB for ; Tue, 19 May 2015 21:26:10 +0000 (UTC) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.14.9/8.14.9) with ESMTP id t4JLQA4d040756 for ; Tue, 19 May 2015 21:26:10 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-ipfw@FreeBSD.org Subject: [Bug 116458] [ipfw]: Logging problems with syslog and ipfw an 6.2.REL-p5 Date: Tue, 19 May 2015 21:26:10 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 6.2-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: bdrewery@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: freebsd-ipfw@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: see_also cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-ipfw@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: IPFW Technical Discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 19 May 2015 21:26:10 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=116458 Bryan Drewery changed: What |Removed |Added ---------------------------------------------------------------------------- See Also| |https://bugs.freebsd.org/bu | |gzilla/show_bug.cgi?id=1163 | |10 CC| |bdrewery@FreeBSD.org -- You are receiving this mail because: You are the assignee for the bug. From owner-freebsd-ipfw@FreeBSD.ORG Thu May 21 19:42:28 2015 Return-Path: Delivered-To: freebsd-ipfw@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 69F6A50A; Thu, 21 May 2015 19:42:28 +0000 (UTC) Received: from mail.strugglingcoder.info (strugglingcoder.info [65.19.130.35]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 554991DEC; Thu, 21 May 2015 19:42:28 +0000 (UTC) Received: from localhost (unknown [10.1.1.3]) (Authenticated sender: hiren@strugglingcoder.info) by mail.strugglingcoder.info (Postfix) with ESMTPSA id 3761F1110DD; Thu, 21 May 2015 12:42:27 -0700 (PDT) Date: Thu, 21 May 2015 12:42:27 -0700 From: hiren panchasara To: Jason Wolfe Cc: Ian Smith , Julian Elischer , freebsd-ipfw@freebsd.org Subject: Re: ipfw on just inbound and not outbound Message-ID: <20150521194227.GF95600@strugglingcoder.info> References: <20150414210901.GA10620@strugglingcoder.info> <552F2F82.1060506@freebsd.org> <20150416164024.B93161@sola.nimnet.asn.au> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="w3uUfsyyY1Pqa/ej" Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.23 (2014-03-12) X-BeenThere: freebsd-ipfw@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: IPFW Technical Discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 21 May 2015 19:42:28 -0000 --w3uUfsyyY1Pqa/ej Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Getting back to this now to see if I can avoid ipfw on outgoing packets. @@ -500,7 +507,7 @@ ipfw_hook(int onoff, int pf) hook_func =3D (pf =3D=3D AF_LINK) ? ipfw_check_frame : ipfw_check_p= acket; =20 (void) (onoff ? pfil_add_hook : pfil_remove_hook) - (hook_func, NULL, PFIL_IN | PFIL_OUT | PFIL_WAITOK, pfh); + (hook_func, NULL, PFIL_IN | PFIL_WAITOK, pfh); =20 return 0; } Should this do the right thing? I'll report back once I test this patch. cheers, Hiren --w3uUfsyyY1Pqa/ej Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.22 (FreeBSD) iQF8BAEBCgBmBQJVXjUiXxSAAAAAAC4AKGlzc3Vlci1mcHJAbm90YXRpb25zLm9w ZW5wZ3AuZmlmdGhob3JzZW1hbi5uZXRBNEUyMEZBMUQ4Nzg4RjNGMTdFNjZGMDI4 QjkyNTBFMTU2M0VERkU1AAoJEIuSUOFWPt/liV0H/0rfdfG5CBvL+G3Z/FXcHo8t ZmDkNEP39AI/tk2QGvtxiTXojMd+XLgyqr4RmLipw3k12KNp9qniWT60m5zBMLJj SFU/gJ3VgxHE0H8K/JGVpA1cZ1WnovcyGLpS0GkAvg2lMqISu8y5DdvjjlAB3hQ2 nC/IaTDQrIs9iduE5SJLpWCGRH9eOQwvpO0oyFdyFJrTMtDKms65MWcjpjwWCLaR 8FG09sGiJgC0q9AaaAm1hbYfmtFMlPFcPsiFSW011c7P8wWVtryp2p3XVial5f7b d0GTHA/ofKurc5Kc+iQnxX4MoTdVxxAMcyEl2n4i0Zh5WVdQ660PUmjVglE9Lb8= =uFRo -----END PGP SIGNATURE----- --w3uUfsyyY1Pqa/ej-- From owner-freebsd-ipfw@FreeBSD.ORG Thu May 21 21:05:07 2015 Return-Path: Delivered-To: freebsd-ipfw@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 1AC64FDA; Thu, 21 May 2015 21:05:07 +0000 (UTC) Received: from mail.strugglingcoder.info (strugglingcoder.info [65.19.130.35]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 049A0177C; Thu, 21 May 2015 21:05:06 +0000 (UTC) Received: from localhost (unknown [10.1.1.3]) (Authenticated sender: hiren@strugglingcoder.info) by mail.strugglingcoder.info (Postfix) with ESMTPSA id 83EAC111789; Thu, 21 May 2015 14:05:05 -0700 (PDT) Date: Thu, 21 May 2015 14:05:05 -0700 From: hiren panchasara To: Jason Wolfe Cc: Ian Smith , Julian Elischer , freebsd-ipfw@freebsd.org Subject: Re: ipfw on just inbound and not outbound Message-ID: <20150521210505.GH95600@strugglingcoder.info> References: <20150414210901.GA10620@strugglingcoder.info> <552F2F82.1060506@freebsd.org> <20150416164024.B93161@sola.nimnet.asn.au> <20150521194227.GF95600@strugglingcoder.info> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="y9PDtDHaFrXNoMPU" Content-Disposition: inline In-Reply-To: <20150521194227.GF95600@strugglingcoder.info> User-Agent: Mutt/1.5.23 (2014-03-12) X-BeenThere: freebsd-ipfw@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: IPFW Technical Discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 21 May 2015 21:05:07 -0000 --y9PDtDHaFrXNoMPU Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On 05/21/15 at 12:42P, hiren panchasara wrote: > Getting back to this now to see if I can avoid ipfw on outgoing packets. >=20 > @@ -500,7 +507,7 @@ ipfw_hook(int onoff, int pf) > hook_func =3D (pf =3D=3D AF_LINK) ? ipfw_check_frame : ipfw_check= _packet; > =20 > (void) (onoff ? pfil_add_hook : pfil_remove_hook) > - (hook_func, NULL, PFIL_IN | PFIL_OUT | PFIL_WAITOK, pfh); > + (hook_func, NULL, PFIL_IN | PFIL_WAITOK, pfh); > =20 > return 0; > } >=20 > Should this do the right thing? I'll report back once I test this patch. I am still seeing ipfw_chk() getting called in my iperf test. Now, if I also remove PFIL_IN, i.e if I do: - (hook_func, NULL, PFIL_IN | PFIL_OUT | PFIL_WAITOK, pfh); + (hook_func, NULL, PFIL_WAITOK, pfh); I don't see ipfw_chk() getting triggered.=20 Somehow incoming traffic is affecting the outgoing traffic? I'd appreciate any inputs/thoughts. I'll keep poking at this. Cheers, Hiren --y9PDtDHaFrXNoMPU Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.22 (FreeBSD) iQF8BAEBCgBmBQJVXkiAXxSAAAAAAC4AKGlzc3Vlci1mcHJAbm90YXRpb25zLm9w ZW5wZ3AuZmlmdGhob3JzZW1hbi5uZXRBNEUyMEZBMUQ4Nzg4RjNGMTdFNjZGMDI4 QjkyNTBFMTU2M0VERkU1AAoJEIuSUOFWPt/lUNIH+wXc2tCLJH2dIUvNpbFo5Dtx g7e35FZEDpQSffU2QQNZjgaHZpYlknTOrc8hBpeQDnRq6h1ZEXP7RKe1GneOVSLz unCmmV82WCBn/CjKXeIxuyZ/DgbiGg3aZXkVyHYd7mpAjRKE5ITpZWIdxXkzZ3x5 bVDvUxMP1hCe+vwQnAAqvHt5h7oCZkgQFeaC5pm6xH/7AvPIlGj/3DUGcgajXRbc +P14+PeBdxwFRFMMj2+vsdSRyPXzk1Gy6OHeVHo2hAYofQw5MXKRZlo2lyr6UL+d zbKgt2g0LaNFovpyDS5NQWnK+5HcvqcTEzfUFCmSK8AJMF7eucrQqap+89f/v30= =dfX/ -----END PGP SIGNATURE----- --y9PDtDHaFrXNoMPU-- From owner-freebsd-ipfw@FreeBSD.ORG Sat May 23 00:58:36 2015 Return-Path: Delivered-To: freebsd-ipfw@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 442B5FA8; Sat, 23 May 2015 00:58:36 +0000 (UTC) Received: from mail.strugglingcoder.info (strugglingcoder.info [65.19.130.35]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 2E29B161F; Sat, 23 May 2015 00:58:35 +0000 (UTC) Received: from localhost (unknown [10.1.1.3]) (Authenticated sender: hiren@strugglingcoder.info) by mail.strugglingcoder.info (Postfix) with ESMTPSA id 9CFA2CEA04; Fri, 22 May 2015 17:58:28 -0700 (PDT) Date: Fri, 22 May 2015 17:58:28 -0700 From: hiren panchasara To: Jason Wolfe Cc: Ian Smith , Julian Elischer , freebsd-ipfw@freebsd.org Subject: Re: ipfw on just inbound and not outbound Message-ID: <20150523005828.GL95600@strugglingcoder.info> References: <20150414210901.GA10620@strugglingcoder.info> <552F2F82.1060506@freebsd.org> <20150416164024.B93161@sola.nimnet.asn.au> <20150521194227.GF95600@strugglingcoder.info> <20150521210505.GH95600@strugglingcoder.info> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="zH41lVBEV8cLJnCl" Content-Disposition: inline In-Reply-To: <20150521210505.GH95600@strugglingcoder.info> User-Agent: Mutt/1.5.23 (2014-03-12) X-BeenThere: freebsd-ipfw@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: IPFW Technical Discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 23 May 2015 00:58:36 -0000 --zH41lVBEV8cLJnCl Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On 05/21/15 at 02:05P, hiren panchasara wrote: > On 05/21/15 at 12:42P, hiren panchasara wrote: > > Getting back to this now to see if I can avoid ipfw on outgoing packets. > >=20 > > @@ -500,7 +507,7 @@ ipfw_hook(int onoff, int pf) > > hook_func =3D (pf =3D=3D AF_LINK) ? ipfw_check_frame : ipfw_che= ck_packet; > > =20 > > (void) (onoff ? pfil_add_hook : pfil_remove_hook) > > - (hook_func, NULL, PFIL_IN | PFIL_OUT | PFIL_WAITOK, pfh); > > + (hook_func, NULL, PFIL_IN | PFIL_WAITOK, pfh); > > =20 > > return 0; > > } > >=20 > > Should this do the right thing? I'll report back once I test this patch. >=20 > I am still seeing ipfw_chk() getting called in my iperf test. Now, if I > also remove PFIL_IN, i.e if I do: > - (hook_func, NULL, PFIL_IN | PFIL_OUT | PFIL_WAITOK, pfh); > + (hook_func, NULL, PFIL_WAITOK, pfh); >=20 > I don't see ipfw_chk() getting triggered.=20 >=20 > Somehow incoming traffic is affecting the outgoing traffic? It seems I screwed up something in testing and the following does seem to d= o the right thing: - (hook_func, NULL, PFIL_IN | PFIL_OUT | PFIL_WAITOK, pfh); + (hook_func, NULL, PFIL_IN | PFIL_WAITOK, pfh); I confirmed this with pmcstat callgraphs that ipfw_chk() is not getting called in OUT direction. Any thoughts on this? Is this something that can be upstreamed with a sysctl knob if there is interest? cheers, Hiren --zH41lVBEV8cLJnCl Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.22 (FreeBSD) iQF8BAEBCgBmBQJVX9C0XxSAAAAAAC4AKGlzc3Vlci1mcHJAbm90YXRpb25zLm9w ZW5wZ3AuZmlmdGhob3JzZW1hbi5uZXRBNEUyMEZBMUQ4Nzg4RjNGMTdFNjZGMDI4 QjkyNTBFMTU2M0VERkU1AAoJEIuSUOFWPt/lANgH/1G7ej//YdKBIMesSCOQxkdy hXnx6vdYKCgX9Isbwzl51VcUSlAYEj7a7lfQRKy0GARWq+ptk8hFOgQLJzNaSsFb kqPt1w7JPAnaVtrptn8f73Ejjqc75EVyBbjNOQId2+YdjGzd/vI2ru/ujjudWA3s atXdE5Hqz7doGpioTNW88YGze9Bk1Id6I5pj4dD1TYRQ+/FN8uDpqeXyyFVKBqtl WzzVu1up+uHzO6Ctzd6Lz0QhRtyyMs/1/2IUa6eQNb6UP8zTVKPTw1kv8kAlqfcF 8b0pt2pHYHaEcJqq56zIGM1+jDGqWS8cgRhXOp+Y7EC082eJ4UR0HhpqOehxLgU= =bNUo -----END PGP SIGNATURE----- --zH41lVBEV8cLJnCl--