From owner-freebsd-current@FreeBSD.ORG Sun May 14 10:18:06 2006 Return-Path: X-Original-To: freebsd-current@freebsd.org Delivered-To: freebsd-current@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 6D40316A408 for ; Sun, 14 May 2006 10:18:06 +0000 (UTC) (envelope-from gexlie@gmail.com) Received: from nz-out-0102.google.com (nz-out-0102.google.com [64.233.162.202]) by mx1.FreeBSD.org (Postfix) with ESMTP id D283343D46 for ; Sun, 14 May 2006 10:18:04 +0000 (GMT) (envelope-from gexlie@gmail.com) Received: by nz-out-0102.google.com with SMTP id i11so445161nzi for ; Sun, 14 May 2006 03:18:04 -0700 (PDT) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:references; b=RpmEgeZEn9SSpLMmA/rlHstkpw79syhHy+775RK0EgbHB82jwXmvBvrfdGFFprElml7Uin/5RZkIqH4xHVB/FFyJa1kzaciOFcIh7JolvNkFR/oppXV5POhdOJaUKpG3Prsjf3+WgWc38JYwbvjw2xrBfYE9r6f1AB+sVrmAWUU= Received: by 10.36.72.8 with SMTP id u8mr390971nza; Sun, 14 May 2006 03:18:04 -0700 (PDT) Received: by 10.36.222.48 with HTTP; Sun, 14 May 2006 03:18:03 -0700 (PDT) Message-ID: <53cc795f0605140318h46cc8e03qc5c24e9c4e70296a@mail.gmail.com> Date: Sun, 14 May 2006 14:18:03 +0400 From: sekes To: "Christian S.J. Peron" In-Reply-To: <44669BF6.5050700@FreeBSD.org> MIME-Version: 1.0 References: <53cc795f0605131026n2d9a5776jd75630e3f9505e55@mail.gmail.com> <53cc795f0605131345t718d0ad7ia7792f2ed4446037@mail.gmail.com> <44669BF6.5050700@FreeBSD.org> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: quoted-printable Content-Disposition: inline X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-current@freebsd.org Subject: Re: deadlock every 15-20 min X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 14 May 2006 10:18:06 -0000 On 5/14/06, Christian S.J. Peron wrote: > > What does your ipfw rules look like? ipfw show 00100 0 0 count ip from any to 10.10.0.2 00200 0 0 count ip from 10.10.0.2 to any 00300 0 0 count ip from any to 10.10.0.3 00400 0 0 count ip from 10.10.0.3 to any 00500 20 1776 count ip from any to 10.10.0.5 00600 20 1848 count ip from 10.10.0.5 to any 00700 34 2868 count ip from any to 10.10.0.6 00800 35 2806 count ip from 10.10.0.6 to any 00900 0 0 count ip from any to 10.10.0.7 01000 0 0 count ip from 10.10.0.7 to any 01100 0 0 count ip from any to 10.10.0.9 01200 0 0 count ip from 10.10.0.9 to any 01300 0 0 count ip from any to 10.10.0.10 01400 0 0 count ip from 10.10.0.10 to any 01500 0 0 count ip from any to 10.10.0.11 01600 0 0 count ip from 10.10.0.11 to any 01700 464973 645569163 count ip from not 192.168.0.0/24,10.10.0.0/24,192.168.2.104/29,10.8.108.108 to 192.168.2.108 01800 473474 21742504 count ip from 192.168.2.108 to not 192.168.0.0/24,10.10.0.0/24,192.168.2.104/29,10.8.108.108 01900 473193 650015708 queue 109 ip from not 192.168.0.0/24,10.10.0.0/24,192.168.2.104/29,10.8.108.108 to 192.168.0.1, 10.10.0.0/24,192.168.2.104/29 02000 0 0 divert 8668 ip from 10.10.0.0/24 to any out via tun= 0 02100 0 0 divert 8668 ip from 192.168.2.108,192.168.0.1 to an= y out via tun0 02200 0 0 divert 8668 ip from 10.8.108.108 to any out via tun= 0 02300 0 0 divert 8668 ip from any to 82.208.115.253 in via tun0 02400 1293271 543262863 allow ip from any to any 65535 6 408 deny ip from any to any sekes wrote: > > i found the reason of my unpredictable reboots. > > it is in netgraph.ko module. if i don't let ppp(8) and mpd(8) load > module > > system works fine. > > otherwise after a bit of time it hangs up with following error: > > > > WARNING: attempt to net_add_domain(netgraph) after domainfinalize() > > lock order reversal: > > 1st 0xc2b8b090 inp (divinp) @ > > /usr/src/sys/modules/ipdivert/../../netinet/ip_divert.c:336 > > 2nd 0xc0a44db8 PFil hook read/write mutex (PFil hook read/write mutex) = @ > > /usr/src/sys/net/pfil.c:73 > > KDB: stack backtrace: > > kdb_backtrace(0,ffffffff,c0a04aa8,c0a04ee0,c09b1e84) at > > kdb_backtrace+0x29 > > witness_checkorder(c0a44db8,1,c0916282,49) at witness_checkorder+0x586 > > _rw_rlock(c0a44db8,c0916282,49) at _rw_rlock+0x54 > > pfil_run_hooks(c0a44da0,d4b00b3c,c29b2400,2,0) at pfil_run_hooks+0x2c > > ip_output(c2aa9200,0,d4b00b08,22,0) at ip_output+0x627 > > div_send(c2b2c14c,0,c2aa9200,c2ab7950,0) at div_send+0x208 > > sosend(c2b2c14c,c2ab7950,d4b00be4,c2aa9200,0) at sosend+0x3e5 > > kern_sendit(c29bdbd0,3,d4b00c64,0,0) at kern_sendit+0x108 > > sendit(c29bdbd0,3,d4b00c64,0,bfbdebdf) at sendit+0x15f > > sendto(c29bdbd0,d4b00d04,c2ad48d0,c,c29bdbd0) at sendto+0x4d > > syscall(3b,3b,bfbf003b,2,4f) at syscall+0x27e > > Xint0x80_syscall() at Xint0x80_syscall+0x1f > > --- syscall (133, FreeBSD ELF32, sendto), eip =3D 0x2813069b, esp =3D > > 0xbfbdeafc, ebp =3D 0xbfbeeba8 --- > > > > > > > > On 5/13/06, sekes wrote: > >> > >> i csuped and built new kernel this morning > >> now every time i catch strong deadlock in the 15-20 minutes after > >> booting > >> up. > >> > >> i'm completely cutoff :-( > >> > >> this is the last produced message on the screen before the system hang= s > >> up. > >> > >> panic: rip_detach: inp =3D=3D NULL > >> cpuid =3D 0 > >> KDB: enter: panic > >> [thread pid 11 tid 100005 ] > >> Stopped at kdb_enter+0x2b: nop > >> db> > >> > >> xnet# uname -a > >> FreeBSD xnet.nnov.ru 7.0-CURRENT FreeBSD 7.0-CURRENT #0: Sat May 13 > >> 11:28:49 MSD 2006 root@xnet.nnov.ru:/usr/obj/usr/src/sys/GENERIC > >> i386 > >> > >> > >> > >> > >> Copyright (c) 1992-2006 The FreeBSD Project. > >> Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, > 1994 > >> The Regents of the University of California. All rights > >> reserved. > >> FreeBSD 7.0-CURRENT #0: Sat May 13 11:28:49 MSD 2006 > >> root@xnet.nnov.ru:/usr/obj/usr/src/sys/GENERIC > >> WARNING: WITNESS option enabled, expect reduced performance. > >> WARNING: MPSAFE network stack disabled, expect reduced performance. > >> Timecounter "i8254" frequency 1193182 Hz quality 0 > >> CPU: Pentium II/Pentium II Xeon/Celeron (350.80-MHz 686-class CPU) > >> Origin =3D "GenuineIntel" Id =3D 0x652 Stepping =3D 2 > >> > >> > Features=3D0x183f9ff > >> > >> real memory =3D 536858624 (511 MB) > >> avail memory =3D 511541248 (487 MB) > >> kbd1 at kbdmux0 > >> ath_hal: 0.9.16.16 (AR5210, AR5211, AR5212, RF5111, RF5112, RF2413, > >> RF5413) > >> ACPI disabled by blacklist. Contact your BIOS vendor. > >> cpu0 on motherboard > >> pcib0: pcibus 0 on > >> motherboard > >> > >> pir0: on motherboard > >> pci0: on pcib0 > >> agp0: on hostb0 > >> pcib1: at device 1.0 on pci0 > >> pci1: on pcib1 > >> vgapci0: port 0x8a135330-0x8a13534f mem > >> 0xdc000000-0xdfffffff at device 0.0 on pci1 > >> isab0: at device 4.0 on pci0 > >> isa0: on isab0 > >> atapci0: port > >> 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xd800-0xd80f at device 4.1 on pci= 0 > >> ata0: on atapci0 > >> ata1: on atapci0 > >> uhci0: port 0xd400-0xd41f > >> irq 5 > >> at device 4.2 on pci0 > >> uhci0: [GIANT-LOCKED] > >> usb0: on uhci0 > >> usb0: USB revision 1.0 > >> uhub0: on usb0 > >> uhub0: 2 ports with 2 removable, self powered > >> piix0: port 0xe800-0xe80f at device 4.3 on pci0 > >> Timecounter "PIIX" frequency 3579545 Hz quality 0 > >> rl0: port 0xd000-0xd0ff mem > >> 0xdb800000-0xdb8000ff irq 12 at device 10.0 on pci0 > >> miibus0: on rl0 > >> rlphy0: on miibus0 > >> rlphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto > >> rl0: Ethernet address: 00:80:48:31:0d:1f > >> rl0: [GIANT-LOCKED] > >> rl1: port 0xb800-0xb8ff mem > >> 0xdb000000-0xdb0000ff irq 10 at device 11.0 on pci0 > >> miibus1: on rl1 > >> rlphy1: on miibus1 > >> rlphy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto > >> rl1: Ethernet address: 00:80:48:25:36:9e > >> rl1: [GIANT-LOCKED] > >> rl2: port 0xb400-0xb4ff mem > >> 0xda800000-0xda8000ff irq 11 at device 12.0 on pci0 > >> miibus2: on rl2 > >> rlphy2: on miibus2 > >> rlphy2: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto > >> rl2: Ethernet address: 00:30:84:3a:e2:85 > >> rl2: [GIANT-LOCKED] > >> pmtimer0 on isa0 > >> orm0: at iomem 0xc0000-0xc7fff pnpid ORM0000 on isa0 > >> atkbdc0: at port 0x60,0x64 on isa0 > >> atkbd0: irq 1 on atkbdc0 > >> kbd0 at atkbd0 > >> atkbd0: [GIANT-LOCKED] > >> fdc0: at port 0x3f0-0x3f5,0x3f7 irq 6 drq > 2 > >> on isa0 > >> fdc0: [FAST] > >> ppc0: at port 0x378-0x37f irq 7 on isa0 > >> ppc0: SMC-like chipset (ECP/EPP/PS2/NIBBLE) in COMPATIBLE mode > >> ppc0: FIFO with 16/16/9 bytes threshold > >> ppbus0: on ppc0 > >> plip0: on ppbus0 > >> lpt0: on ppbus0 > >> lpt0: Interrupt-driven port > >> ppi0: on ppbus0 > >> ppc0: [GIANT-LOCKED] > >> sc0: at flags 0x100 on isa0 > >> sc0: EGA <16 virtual consoles, flags=3D0x300> > >> sio0 at port 0x3f8-0x3ff irq 4 flags 0x10 on isa0 > >> sio0: type 16550A > >> sio0: [FAST] > >> sio1 at port 0x2f8-0x2ff irq 3 on isa0 > >> sio1: type 16550A > >> sio1: [FAST] > >> vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on > >> isa0 > >> unknown: can't assign resources (port) > >> unknown: can't assign resources (port) > >> unknown: can't assign resources (port) > >> unknown: can't assign resources (port) > >> unknown: can't assign resources (memory) > >> unknown: can't assign resources (port) > >> unknown: can't assign resources (port) > >> Timecounter "TSC" frequency 350798189 Hz quality 800 > >> Timecounters tick every 1.000 msec > >> ipfw2 (+ipv6) initialized, divert loadable, rule-based forwarding > >> disabled, default to deny, logging disabled > >> ad0: 9541MB at ata0-master UDMA33 > >> ad1: 39266MB at ata0-slave UDMA33 > >> Trying to mount root from ufs:/dev/ad0s1a > >> WARNING: / was not properly dismounted > >> GEOM_ELI: Device ad0s1b.eli created. > >> GEOM_ELI: Cipher: AES > >> GEOM_ELI: Key length: 256 > >> GEOM_ELI: Crypto: software > >> WARNING: /usr was not properly dismounted > >> WARNING: /mnt/DISK1 was not properly dismounted > >> pid 761 (ircd), uid 0: exited on signal 11 (core dumped) > >> rl0: promiscuous mode enabled > >> rl0: promiscuous mode disabled > >> WARNING: attempt to net_add_domain(netgraph) after domainfinalize() > >> lock order reversal: > >> 1st 0xc2b8b090 inp (divinp) @ > >> /usr/src/sys/modules/ipdivert/../../netinet/ip_divert.c:336 > >> 2nd 0xc0a44db8 PFil hook read/write mutex (PFil hook read/write > >> mutex) @ > >> /usr/src/sys/net/pfil.c:73 > >> KDB: stack backtrace: > >> kdb_backtrace(0,ffffffff,c0a04aa8,c0a04ee0,c09b1e84) at > >> kdb_backtrace+0x29 > >> witness_checkorder(c0a44db8,1,c0916282,49) at witness_checkorder+0x586 > >> _rw_rlock(c0a44db8,c0916282,49) at _rw_rlock+0x54 > >> pfil_run_hooks(c0a44da0,d4b00b3c,c29b2400,2,0) at pfil_run_hooks+0x2c > >> ip_output(c2aa9200,0,d4b00b08,22,0) at ip_output+0x627 > >> div_send(c2b2c14c,0,c2aa9200,c2ab7950,0) at div_send+0x208 > >> sosend(c2b2c14c,c2ab7950,d4b00be4,c2aa9200,0) at sosend+0x3e5 > >> kern_sendit(c29bdbd0,3,d4b00c64,0,0) at kern_sendit+0x108 > >> sendit(c29bdbd0,3,d4b00c64,0,bfbdebdf) at sendit+0x15f > >> sendto(c29bdbd0,d4b00d04,c2ad48d0,c,c29bdbd0) at sendto+0x4d > >> syscall(3b,3b,bfbf003b,2,4f) at syscall+0x27e > >> Xint0x80_syscall() at Xint0x80_syscall+0x1f > >> --- syscall (133, FreeBSD ELF32, sendto), eip =3D 0x2813069b, esp =3D > >> 0xbfbdeafc, ebp =3D 0xbfbeeba8 --- > >> arp: 00:11:95:c4:ca:b0 attempts to modify permanent entry for > >> 192.168.1.1on rl1 > >> > > _______________________________________________ > > freebsd-current@freebsd.org mailing list > > http://lists.freebsd.org/mailman/listinfo/freebsd-current > > To unsubscribe, send any mail to > > "freebsd-current-unsubscribe@freebsd.org" > > > > > > > -- > Christian S.J. Peron > csjp@FreeBSD.ORG > FreeBSD Committer > FreeBSD Security Team > >