From owner-freebsd-mips@freebsd.org Sun Oct 25 11:37:04 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 93F6F8699 for ; Sun, 25 Oct 2015 11:37:04 +0000 (UTC) (envelope-from egrosbein@rdtc.ru) Received: from hz.grosbein.net (hz.grosbein.net [78.47.246.247]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 323E81374 for ; Sun, 25 Oct 2015 11:37:02 +0000 (UTC) (envelope-from egrosbein@rdtc.ru) Received: from eg.sd.rdtc.ru (root@eg.sd.rdtc.ru [62.231.161.221]) by hz.grosbein.net (8.14.9/8.14.9) with ESMTP id t9PBaixa023066 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT) for ; Sun, 25 Oct 2015 12:36:47 +0100 (CET) (envelope-from egrosbein@rdtc.ru) X-Envelope-From: egrosbein@rdtc.ru X-Envelope-To: Received: from eg.sd.rdtc.ru (eugen@localhost [127.0.0.1]) by eg.sd.rdtc.ru (8.15.2/8.15.2) with ESMTP id t9PBaZQh047576 for ; Sun, 25 Oct 2015 18:36:36 +0700 (KRAT) (envelope-from egrosbein@rdtc.ru) To: freebsd-mips@freebsd.org From: Eugene Grosbein Subject: arge1 on TL WDR3600 Message-ID: <562CBEC3.8030308@rdtc.ru> Date: Sun, 25 Oct 2015 18:36:35 +0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.2.0 MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=-2.3 required=5.0 tests=BAYES_00,RP_MATCHES_RCVD autolearn=ham version=3.3.2 X-Spam-Report: * 0.0 RP_MATCHES_RCVD Envelope sender domain matches handover relay domain * -2.3 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on hz.grosbein.net X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 25 Oct 2015 11:37:04 -0000 Hi! What is arge1 on TP-Link WDR3600? All gigabit ethernet ports seem to be connected to arge0 interface by default. And how can I manage its switch to create vlans and assign physical ports to vlans? From owner-freebsd-mips@freebsd.org Sun Oct 25 12:22:32 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0ED6F84C7 for ; Sun, 25 Oct 2015 12:22:32 +0000 (UTC) (envelope-from lists@opsec.eu) Received: from home.opsec.eu (home.opsec.eu [IPv6:2001:14f8:200::1]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id BF5B91A1A for ; Sun, 25 Oct 2015 12:22:31 +0000 (UTC) (envelope-from lists@opsec.eu) Received: from pi by home.opsec.eu with local (Exim 4.86 (FreeBSD)) (envelope-from ) id 1ZqKJh-000ICX-Kp for freebsd-mips@freebsd.org; Sun, 25 Oct 2015 13:22:29 +0100 Date: Sun, 25 Oct 2015 13:22:29 +0100 From: Kurt Jaeger To: freebsd-mips@freebsd.org Subject: Edge Router Lite, 11-current and vi dumping core ? Message-ID: <20151025122229.GS19913@home.opsec.eu> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 25 Oct 2015 12:22:32 -0000 Hi! I built a very recent 11-current to run on the Ubiquity Edge Router Lite, using mkerlimage from http://rtfm.net/FreeBSD/ERL/. If I try to invoke vi via serial console or via remote ssh session, a crash is recorded on the serial console: root@erl:~ # uname -a FreeBSD erl 11.0-CURRENT FreeBSD 11.0-CURRENT #0 r289925M: Sun Oct 25 09:31:34 CET 2015 pi@fc.opsec.eu:/usr/obj/mips.mips64/usr/src/sys/ERL mips root@erl:~ # [invoking vi via SSH on other session] cpuid = 1 Oct 25 12:05:28 erl kernel: BAD_PAGE_FAULT: pid 1326 tid 100056 (vi), uid 0: pc 0x120013480 got a write fault (type 0x3) at 0x161616b98 Oct 25 12:05:28 erl kernel: Trapframe Register Dump: Oct 25 12:05:28 erl kernel: zero: 0 at: 0x7fffffffffffffff v0: 0x161616030 v1: 0xa Oct 25 12:05:28 erl kernel: a0: 0x120080eb8 a1: 0x15 a2: 0x16 a3: 0x120012068 Oct 25 12:05:28 erl kernel: a4: 0x1602ea270 a5: 0x1602ffa00 a6: 0xff a6: 0x16060d000 Oct 25 12:05:28 erl kernel: t0: 0 t1: 0 t2: 0x8 t3: 0x120013458 Oct 25 12:05:28 erl kernel: t8: 0x232 t9: 0x1 s0: 0x120011f10 s1: 0x160616000 Oct 25 12:05:28 erl kernel: s2: 0 s3: 0x16067a000 s4: 0 s5: 0x7fffffeb70 Oct 25 12:05:28 erl kernel: s6: 0x1 s7: 0 k0: 0 k1: 0 Oct 25 12:05:28 erl kernel: gp: 0x120089960 sp: 0x7fffffe838 s8: 0x160616010 ra: 0x120013458 Oct 25 12:05:28 erl kernel: sr: 0x808cb3 mullo: 0x30 mulhi: 0 badvaddr: 0x161616b98 Oct 25 12:05:28 erl kernel: cause: 0xc pc: 0x120013480 Oct 25 12:05:28 erl kernel: Page table info for pc address 0x120013480: pde = 0x9800000005f73000, pte = 0x28000000018fe5a Oct 25 12:05:28 erl kernel: Dumping 4 words starting at pc address 0x120013480: Oct 25 12:05:28 erl kernel: ac430b68 24a50001 14c5fff9 64840008 Oct 25 12:05:28 erl kernel: Page table info for bad address 0x161616b98: pde = 0x98000000050ad000, pte = 0 Any ideas on how I can debug this ? -- pi@opsec.eu +49 171 3101372 5 years to go ! From owner-freebsd-mips@freebsd.org Sun Oct 25 17:39:43 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B7ED289A2 for ; Sun, 25 Oct 2015 17:39:43 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: from mail-ig0-x22e.google.com (mail-ig0-x22e.google.com [IPv6:2607:f8b0:4001:c05::22e]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 861F4190D for ; Sun, 25 Oct 2015 17:39:43 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: by igbkq10 with SMTP id kq10so44955351igb.0 for ; Sun, 25 Oct 2015 10:39:43 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=9af2ULR+JBfl24utYKL6ZdwwxCmbSF+kVfgz5KPQtpA=; b=L3JROZR37sVM+sdGCO5jQqWwndw+FYmwordTYECP9wXIecWQ5FTAB8zagpx63P9uIX pSRPPzc1/TJrynciflSWldspTndIssqpko+v9C2JKO75LdUvG9QS3Dv9rHPtdcqz7ARN UWuF5agwT3q/5hldshIOumno161ItwKB9t1Fvs0erQg0EVpskzGpLaCKTqnPE9QsY5gc avnfsc4ybGh/BW8zLSxyd75Yy47NNZ2bFQrrz8oLn4oUtxCYt4JuvnWOGXBV7GLY4r3r ZdmxPxX9cDSzxh1Nwn0UcQ7RjNfRrpS/BN0mG7DZLqmZ/lamCSYJV9RFs9ue3//KFo8K 9iWQ== MIME-Version: 1.0 X-Received: by 10.50.111.226 with SMTP id il2mr13676069igb.61.1445794782945; Sun, 25 Oct 2015 10:39:42 -0700 (PDT) Received: by 10.36.46.66 with HTTP; Sun, 25 Oct 2015 10:39:42 -0700 (PDT) In-Reply-To: <562CBEC3.8030308@rdtc.ru> References: <562CBEC3.8030308@rdtc.ru> Date: Sun, 25 Oct 2015 10:39:42 -0700 Message-ID: Subject: Re: arge1 on TL WDR3600 From: Adrian Chadd To: Eugene Grosbein Cc: "freebsd-mips@freebsd.org" Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 25 Oct 2015 17:39:43 -0000 Hi, I'll try to answer more thoroughly tomorrow, but in the meanwhile: The AR8327 switch has two CPU ports - MAC0, and MAC6. MAC1..MAC5 are the switch ethernet ports connected to the external physical ports PHY1..PHY5. Now, normally MAC1..MAC4 are "LAN" and MAC5 is "WAN". Sometimes they disconnect PHY5 (the physical port) from MAC5 (the internal switch ethernet port) and connect PHY5 to arge1. Now, the AP135 reference board does this - arge0 -> MAC6, arge1 -> MAC0. arge0 in the AR955x SoC has extra hardware for NAT/filtering, so it's typically used as the "WAN" port. But I think (according to openwrt) arge1 isn't connected to anything; only arge0 is connected to switch MAC0. Now, you can use etherswitchcfg to configure dot1q and tag things. eg: * etherswitchcfg config vlan_mode dot1q will put it into dot1q mode Then each port has a pvid (native vlan id) and on this switch you can configure each vlan as tagged or untagged. eg: etherswitchcfg vlangroup0 vlan 1 members 6 # this just disables vlan 1 on any active port etherswitchcfg vlangroup1 vlan 2 members 0t,1,2,3,4 etherswitchcfg vlangroup2 vlan 3 members 0t,5 etherswitchcfg port1 pvid 2 etherswitchcfg port2 pvid 2 etherswitchcfg port3 pvid 2 etherswitchcfg port4 pvid 2 etherswitchcfg port5 pvid 3 This creates two VLANs - vlan2 is LAN, vlan3 is WAN, port0 (MAC0, which is hooked up to arge0) is configured as seeing vlans 2,3 as tagged; port1..4 have native vlan 2 (LAN), port 5 has native VLAN 3 (WAN). Then to configure vlans: * kldload if_vlan (and add it to the modules list in /etc/cfg/rc.conf); * ifconfig arge0.2 create vlandev arge0 vlan 2 * ifconfig arge0.3 create vlandev arge0 vlan 3 * ifconfig bridge0 deletem arge0 * ifconfig bridge0 addm arge0.2 arge0.3 (bridges the two VLANs together via bridge0, but you may not want to do this. Maybe. it's up to you!) -adrian On 25 October 2015 at 04:36, Eugene Grosbein wrote: > Hi! > > What is arge1 on TP-Link WDR3600? > All gigabit ethernet ports seem to be connected to arge0 interface by default. > And how can I manage its switch to create vlans and assign physical ports to vlans? > _______________________________________________ > freebsd-mips@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-mips > To unsubscribe, send any mail to "freebsd-mips-unsubscribe@freebsd.org" From owner-freebsd-mips@freebsd.org Mon Oct 26 13:53:06 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 96CC18CDA for ; Mon, 26 Oct 2015 13:53:06 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from hz.grosbein.net (hz.grosbein.net [78.47.246.247]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 2D55115AC for ; Mon, 26 Oct 2015 13:53:05 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from eg.sd.rdtc.ru (root@eg.sd.rdtc.ru [62.231.161.221]) by hz.grosbein.net (8.14.9/8.14.9) with ESMTP id t9QDqmfa027691 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT); Mon, 26 Oct 2015 14:52:48 +0100 (CET) (envelope-from eugen@grosbein.net) X-Envelope-From: eugen@grosbein.net X-Envelope-To: adrian.chadd@gmail.com Received: from eg.sd.rdtc.ru (eugen@localhost [127.0.0.1]) by eg.sd.rdtc.ru (8.15.2/8.15.2) with ESMTP id t9QDqdcx056892; Mon, 26 Oct 2015 20:52:40 +0700 (KRAT) (envelope-from eugen@grosbein.net) Subject: Re: arge1 on TL WDR3600 To: Adrian Chadd References: <562CBEC3.8030308@rdtc.ru> Cc: "freebsd-mips@freebsd.org" From: Eugene Grosbein Message-ID: <562E3027.4020806@grosbein.net> Date: Mon, 26 Oct 2015 20:52:39 +0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.2.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=0.3 required=5.0 tests=BAYES_00,LOCAL_FROM autolearn=no version=3.3.2 X-Spam-Report: * -2.3 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 2.6 LOCAL_FROM From my domains X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on hz.grosbein.net X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 26 Oct 2015 13:53:06 -0000 On 26.10.2015 00:39, Adrian Chadd wrote: > Hi, > > I'll try to answer more thoroughly tomorrow, but in the meanwhile: [skip] Thank you very much for explanation. Another thing: when I insert cable into "WAN" port, kernel writes to console: arswitch0: arswitch_miipollstat: port 0: port -> UP But then, etherswitchcfg command shows "status: active" for port 1 having no flags and port 0 is CPUPORT: etherswitch0: VLAN mode: DOT1Q port0: pvid: 1 flags=1 media: Ethernet 1000baseT status: active port1: pvid: 1 flags=0<> media: Ethernet autoselect (1000baseT ) status: active Isn't it off-by-one error in the arswitch diagnostics output? From owner-freebsd-mips@freebsd.org Mon Oct 26 15:21:30 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2B997A1D42C for ; Mon, 26 Oct 2015 15:21:30 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from hz.grosbein.net (hz.grosbein.net [78.47.246.247]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id B3085113D for ; Mon, 26 Oct 2015 15:21:29 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from eg.sd.rdtc.ru (root@eg.sd.rdtc.ru [62.231.161.221]) by hz.grosbein.net (8.14.9/8.14.9) with ESMTP id t9QFLIb5027924 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT) for ; Mon, 26 Oct 2015 16:21:20 +0100 (CET) (envelope-from eugen@grosbein.net) X-Envelope-From: eugen@grosbein.net X-Envelope-To: Received: from eg.sd.rdtc.ru (eugen@localhost [127.0.0.1]) by eg.sd.rdtc.ru (8.15.2/8.15.2) with ESMTP id t9QFLDgu057279 for ; Mon, 26 Oct 2015 22:21:14 +0700 (KRAT) (envelope-from eugen@grosbein.net) To: freebsd-mips@freebsd.org From: Eugene Grosbein Subject: Strange results of TP-Link WDR3600 wired ethernet performace test X-Enigmail-Draft-Status: N1110 Message-ID: <562E44E9.8090605@grosbein.net> Date: Mon, 26 Oct 2015 22:21:13 +0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.2.0 MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=0.3 required=5.0 tests=BAYES_00,LOCAL_FROM autolearn=no version=3.3.2 X-Spam-Report: * -2.3 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 2.6 LOCAL_FROM From my domains X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on hz.grosbein.net X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 26 Oct 2015 15:21:30 -0000 Hi! When I first got my TP-Link WDR3600, it has very old stock firmware without support for hardware NAT acceleration. I made some wired ethernet performance tests using that firmware. I have FreeBSD 10.2/amd64 desktop (4-core i7 @ 3.1Ghz) having 2 Intel gigabit ethernet ports em0/em1 to send and receive FTP traffic. I use VNET and FIB kernel features to force kernel pass traffic from itself to itself using physical ports and not loopback: jail -c name=test vnet persist exec.fib=1 ifconfig em1 vnet test etc. I've verified that this Core i7 easily saturates 1Gbps link using direct ethernet cable between em0 and em1. Then I've connected em1 to LAN port of WDR3600 and em0 to its WAN port. WDR3600 had forwarded over 35 MBytes/s from WAN to LAN (according to "systat -ifstat") with NAT disabled and over 33 MBytes/s with NAT enabled (but not hardware NAT). Then I've upgraded the device to latest stock firmware version 3.14.3 Build 150605 Rel.52210n that has hardware NAT acceleration support and repeated tests. With NAT completely disabled, it forwarded over 33 MBytes/s. With NAT enabled but hardware NAT acceleration disabled, it forwarded over 28 MBytes/s. With hardware NAT acceleration enabled, it forwarded over 112 MBytes/s FTP traffic saturating gigabit link. Now I perform my first FreeBSD 11 performance test using same environment and it forwards about 6MByte/s only while CPU load is less than 50%. Here is "top -SHPI" report: last pid: 628; load averages: 0.85, 0.76, 0.69 up 0+00:44:39 22:02:55 48 processes: 2 running, 35 sleeping, 11 waiting CPU: 1.6% user, 0.0% nice, 2.3% system, 42.2% interrupt, 53.9% idle Mem: 5244K Active, 11M Inact, 8616K Wired, 496K Buf, 96M Free Swap: PID USERNAME PRI NICE SIZE RES STATE TIME WCPU COMMAND 10 root 155 ki31 0K 8K RUN 40:50 53.07% idle 11 root -92 - 0K 88K WAIT 2:18 43.38% intr{int2 arge0} 2 root -16 - 0K 8K - 0:05 1.35% rand_harvestq 628 root 40 0 7624K 2640K RUN 0:01 1.33% top 11 root -60 - 0K 88K WAIT 0:18 0.72% intr{swi4: clock (0 11 root -76 - 0K 88K WAIT 0:00 0.15% intr{swi0: uart} 15 root -16 - 0K 8K - 0:00 0.01% schedcpu 5 root -16 - 0K 16K psleep 0:00 0.00% pagedaemon{pagedaem 8 root -8 - 0K 8K - 0:00 0.00% bufspacedaemon 14 root -4 - 0K 8K vlruwt 0:00 0.00% vnlru 9 root 16 - 0K 8K syncer 0:00 0.00% syncer 7 root -16 - 0K 8K psleep 0:00 0.00% bufdaemon I use sysctl net.inet.ip.fastforwarding=1 and not packet filters compiled in/loaded. The question is: why so many idle CPU cycles and why wired ethernet performance is so bad? From owner-freebsd-mips@freebsd.org Mon Oct 26 17:04:43 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DE306A1E890 for ; Mon, 26 Oct 2015 17:04:43 +0000 (UTC) (envelope-from egrosbein@rdtc.ru) Received: from hz.grosbein.net (hz.grosbein.net [78.47.246.247]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 6E6B413E4 for ; Mon, 26 Oct 2015 17:04:41 +0000 (UTC) (envelope-from egrosbein@rdtc.ru) Received: from eg.sd.rdtc.ru (root@eg.sd.rdtc.ru [62.231.161.221]) by hz.grosbein.net (8.14.9/8.14.9) with ESMTP id t9QH4Vdf028198 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT) for ; Mon, 26 Oct 2015 18:04:33 +0100 (CET) (envelope-from egrosbein@rdtc.ru) X-Envelope-From: egrosbein@rdtc.ru X-Envelope-To: Received: from eg.sd.rdtc.ru (eugen@localhost [127.0.0.1]) by eg.sd.rdtc.ru (8.15.2/8.15.2) with ESMTP id t9QH4N3N057976 for ; Tue, 27 Oct 2015 00:04:23 +0700 (KRAT) (envelope-from egrosbein@rdtc.ru) Subject: Re: Strange results of TP-Link WDR3600 wired ethernet performace test To: freebsd-mips@freebsd.org References: <562E44E9.8090605@grosbein.net> From: Eugene Grosbein X-Enigmail-Draft-Status: N1110 Message-ID: <562E5D17.7030700@rdtc.ru> Date: Tue, 27 Oct 2015 00:04:23 +0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.2.0 MIME-Version: 1.0 In-Reply-To: <562E44E9.8090605@grosbein.net> Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=-2.3 required=5.0 tests=BAYES_00,RP_MATCHES_RCVD, T_DATE_IN_FUTURE_96_Q autolearn=ham version=3.3.2 X-Spam-Report: * 0.0 T_DATE_IN_FUTURE_96_Q Date: is 4 days to 4 months after Received: * date * 0.0 RP_MATCHES_RCVD Envelope sender domain matches handover relay domain * -2.3 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on hz.grosbein.net X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 26 Oct 2015 17:04:44 -0000 On 26.10.2015 22:21, Eugene Grosbein wrote: > The question is: why so many idle CPU cycles and why wired > ethernet performance is so bad? I've updated sources to latest HEAD and not speed is 11.5MB/s instead of 6MB/s but kernel floods console with following messages under load: interrupt storm detected on "int2"; throttling interrupt source From owner-freebsd-mips@freebsd.org Mon Oct 26 17:04:42 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B770BA1E88C for ; Mon, 26 Oct 2015 17:04:42 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from hz.grosbein.net (hz.grosbein.net [78.47.246.247]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4B26713E3 for ; Mon, 26 Oct 2015 17:04:41 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from eg.sd.rdtc.ru (root@eg.sd.rdtc.ru [62.231.161.221]) by hz.grosbein.net (8.14.9/8.14.9) with ESMTP id t9QH4WKC028199 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT) for ; Mon, 26 Oct 2015 18:04:33 +0100 (CET) (envelope-from eugen@grosbein.net) X-Envelope-From: eugen@grosbein.net X-Envelope-To: Received: from eg.sd.rdtc.ru (eugen@localhost [127.0.0.1]) by eg.sd.rdtc.ru (8.15.2/8.15.2) with ESMTP id t9QH4S3c057990 for ; Tue, 27 Oct 2015 00:04:29 +0700 (KRAT) (envelope-from eugen@grosbein.net) Subject: Re: Strange results of TP-Link WDR3600 wired ethernet performace test To: freebsd-mips@freebsd.org References: <562E44E9.8090605@grosbein.net> From: Eugene Grosbein X-Enigmail-Draft-Status: N1110 Message-ID: <562E5D1C.2010007@grosbein.net> Date: Tue, 27 Oct 2015 00:04:28 +0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.2.0 MIME-Version: 1.0 In-Reply-To: <562E44E9.8090605@grosbein.net> Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=0.3 required=5.0 tests=BAYES_00,LOCAL_FROM autolearn=no version=3.3.2 X-Spam-Report: * -2.3 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 2.6 LOCAL_FROM From my domains X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on hz.grosbein.net X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 26 Oct 2015 17:04:42 -0000 On 26.10.2015 22:21, Eugene Grosbein wrote: > The question is: why so many idle CPU cycles and why wired > ethernet performance is so bad? I've updated sources to latest HEAD and not speed is 11.5MB/s instead of 6MB/s but kernel floods console with following messages under load: interrupt storm detected on "int2"; throttling interrupt source From owner-freebsd-mips@freebsd.org Mon Oct 26 17:49:11 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 94FB3813F for ; Mon, 26 Oct 2015 17:49:11 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: from mail-ig0-x22d.google.com (mail-ig0-x22d.google.com [IPv6:2607:f8b0:4001:c05::22d]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 6230C1E50 for ; Mon, 26 Oct 2015 17:49:11 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: by igbdj2 with SMTP id dj2so61622043igb.1 for ; Mon, 26 Oct 2015 10:49:10 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=QuIy5PB3Xnlan/HSkuWzHEalIMhhAg+v8wmnkF9MSIQ=; b=N76z46aLIyyEVVvmrFerqn0qOS45ssW4brrA56uLDZL85DmEnuD1p6b1+e26IcY8jr +PAtmASdymGTQWGi5ggd5+pcjHdl4kABug1KEvV0vnKiJkMXZPj3FXD+xSa6rvqJQEdf 5C1nXuxxE6ZE6TrNUKilSbBfkPeLXW7FkwMgdmxs3LC82YvsIN8HlXg8EowJ39k8lc3V 0XiJOqyZo0yWAKrRbYtUqrFLqPCrNjo8RRUxQcGQPrG3B8uZPqFIWe79GwO3Am4xIaad lfWHt/V01in1w36xYCyiDNZU3xKwWpYEUqGwNH4ihffp3TwJgQMFDbwiLaEgGDtvBcXc q8Lg== MIME-Version: 1.0 X-Received: by 10.50.111.226 with SMTP id il2mr18985972igb.61.1445881750655; Mon, 26 Oct 2015 10:49:10 -0700 (PDT) Received: by 10.36.46.66 with HTTP; Mon, 26 Oct 2015 10:49:10 -0700 (PDT) In-Reply-To: <562E5D17.7030700@rdtc.ru> References: <562E44E9.8090605@grosbein.net> <562E5D17.7030700@rdtc.ru> Date: Mon, 26 Oct 2015 10:49:10 -0700 Message-ID: Subject: Re: Strange results of TP-Link WDR3600 wired ethernet performace test From: Adrian Chadd To: Eugene Grosbein Cc: "freebsd-mips@freebsd.org" Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 26 Oct 2015 17:49:11 -0000 Hi, I'm glad that the throughput is higher - I was expecting exactly that. The interrupt storm - not sure. I haven't reproduced that at home. There's some bit(s) in the interrupt status register that don't seem to be cleared by taking action. I don't know what they are yet. We don't yet have hardware NAT acceleration in our stack. Someone has to write it. :-) -adrian From owner-freebsd-mips@freebsd.org Mon Oct 26 17:50:13 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id EDCE181E5 for ; Mon, 26 Oct 2015 17:50:13 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: from mail-ig0-x229.google.com (mail-ig0-x229.google.com [IPv6:2607:f8b0:4001:c05::229]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id BBABA1FCB for ; Mon, 26 Oct 2015 17:50:13 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: by igbdj2 with SMTP id dj2so61644106igb.1 for ; Mon, 26 Oct 2015 10:50:13 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=vghIM8uAUZ/b2NGa5R6p4ICGv1MChz5cK0OtDevGuFk=; b=g04JQNBtcdcModBjze4fTFcmextkI3ZlEoLcpFkaTKaDqi6HBbwrxRQuvGgqyRWy3v 7vMN/QDzBpZRLLgf3MvFLZb+gnWqqjSKf1jWd+EW4DkZEjrOqvONcB0GMazei6gDgx7m v2NyoJeoPEy2o8lKJF3eNdFBdVUNDSnU8zQ5Ph5J7Q8rPDG6F0FEsNpYh0iiSC8k9ltG GXhGgeIDM3lkyFzfUPLFX/E0wn5eNjpkfpif1VKT6OuuelLussbKJDWz/lC7pjLweSZN 82e3EGWeYXRICvGSf6LvzXceMjhAVpz4I/qepP+CGIrC311wSwgp9YX3xuh2sOSm/Tu6 b0ew== MIME-Version: 1.0 X-Received: by 10.50.178.141 with SMTP id cy13mr19100404igc.61.1445881813155; Mon, 26 Oct 2015 10:50:13 -0700 (PDT) Received: by 10.36.46.66 with HTTP; Mon, 26 Oct 2015 10:50:13 -0700 (PDT) In-Reply-To: <562E3027.4020806@grosbein.net> References: <562CBEC3.8030308@rdtc.ru> <562E3027.4020806@grosbein.net> Date: Mon, 26 Oct 2015 10:50:13 -0700 Message-ID: Subject: Re: arge1 on TL WDR3600 From: Adrian Chadd To: Eugene Grosbein Cc: "freebsd-mips@freebsd.org" Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 26 Oct 2015 17:50:14 -0000 It's one of those unclear things - there's no port0 MII/PHY. port1 == phy0, port2 == phy1, etc. -a On 26 October 2015 at 06:52, Eugene Grosbein wrote: > On 26.10.2015 00:39, Adrian Chadd wrote: >> Hi, >> >> I'll try to answer more thoroughly tomorrow, but in the meanwhile: > > [skip] > > Thank you very much for explanation. > > Another thing: when I insert cable into "WAN" port, kernel writes to console: > > arswitch0: arswitch_miipollstat: port 0: port -> UP > > But then, etherswitchcfg command shows "status: active" for port 1 > having no flags and port 0 is CPUPORT: > > etherswitch0: VLAN mode: DOT1Q > port0: > pvid: 1 > flags=1 > media: Ethernet 1000baseT > status: active > port1: > pvid: 1 > flags=0<> > media: Ethernet autoselect (1000baseT ) > status: active > > Isn't it off-by-one error in the arswitch diagnostics output? > From owner-freebsd-mips@freebsd.org Mon Oct 26 19:21:43 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 99012A1EB29 for ; Mon, 26 Oct 2015 19:21:43 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: from mail-io0-x22f.google.com (mail-io0-x22f.google.com [IPv6:2607:f8b0:4001:c06::22f]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 619631134 for ; Mon, 26 Oct 2015 19:21:43 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: by iody8 with SMTP id y8so42043796iod.1 for ; Mon, 26 Oct 2015 12:21:42 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=/+ldigxhchF/Jot7eS5y+A10yjOuK9V41oywmbuAOf4=; b=D7J1YMyA+YxxXRCfvaW6pRiwvyTGYVPbDBz7o2XviiVTtljjvVbxL5TLnq800Ge4f7 NWFAIZDO5fqAb6iuGjlXA1/bdyKzSusf1asDr6b0oAcYl/d6e8vtI3keEgWFRJ1Oomeb FuP5qXyBpNdbf6KsL0cTrco/7LH/HF4GtL0QHpsO+tNeX4u3qMwchMzST4+KruEfyb2g ghpsNKEfm49N83KOLRXbt3wOchneYqopXvS9l5uaLFmaXuKehQdW9CuuF0G/4BiP8QZW x6rdrxDkiHC9loMhcCuCgYNEGMNZ4zSPE2srNCdUUrCw6kHSfmwepJrvFc9sx+KdYdug gTqQ== MIME-Version: 1.0 X-Received: by 10.107.3.72 with SMTP id 69mr36292717iod.75.1445887302499; Mon, 26 Oct 2015 12:21:42 -0700 (PDT) Received: by 10.36.46.66 with HTTP; Mon, 26 Oct 2015 12:21:42 -0700 (PDT) In-Reply-To: References: <562E44E9.8090605@grosbein.net> <562E5D17.7030700@rdtc.ru> Date: Mon, 26 Oct 2015 12:21:42 -0700 Message-ID: Subject: Re: Strange results of TP-Link WDR3600 wired ethernet performace test From: Adrian Chadd To: Eugene Grosbein Cc: "freebsd-mips@freebsd.org" Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 26 Oct 2015 19:21:43 -0000 Also, right now my focus is testing bridging performance, not forwarding performance. That way I can stress test a small subset of the network stack and not have to get caught up in everything. Can you test with iperf2 instead of FTP? It's easier. -adrian From owner-freebsd-mips@freebsd.org Tue Oct 27 11:07:25 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1BA1DA1F1D2 for ; Tue, 27 Oct 2015 11:07:25 +0000 (UTC) (envelope-from pkubaj@riseup.net) Received: from mx1.riseup.net (mx1.riseup.net [198.252.153.129]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.riseup.net", Issuer "COMODO RSA Domain Validation Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id F2F3A118C for ; Tue, 27 Oct 2015 11:07:24 +0000 (UTC) (envelope-from pkubaj@riseup.net) Received: from cotinga.riseup.net (unknown [10.0.1.164]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (Client CN "*.riseup.net", Issuer "COMODO RSA Domain Validation Secure Server CA" (verified OK)) by mx1.riseup.net (Postfix) with ESMTPS id 0F07A1A2CF3; Tue, 27 Oct 2015 04:07:18 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=riseup.net; s=squak; t=1445944038; bh=0DOwKT/oYxVtZNPP70S/ldD7jNBWJKFJokC075Z6K+8=; h=To:References:Subject:Cc:From:Date:In-Reply-To:From; b=bZ05ttHXeBxs9+kWJN3VUdc8jcCZVeTbxqvbK/5I8CQgoU9RMV8NlCyYBWDf8YjDK KeiOlBvOApjvVitkUXrCw5fF7WeQLC3otpz0RV7G4p+NE2Td6XsFBo0WOVWfIefJsa uNLW1GbM+uOTXrYmFr2kbbF4srt1rKdNSOJupVnI= Received: from [127.0.0.1] (localhost [127.0.0.1]) (Authenticated sender: pkubaj) with ESMTPSA id 374F6403AA To: freebsd-mips@freebsd.org References: Subject: Re: arge1 on TL WDR3600 Cc: Adrian Chadd , eugen@grosbein.net From: Piotr Kubaj Message-ID: <562F5AE2.8010301@riseup.net> Date: Tue, 27 Oct 2015 12:07:14 +0100 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.3.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: clamav-milter 0.98.7 at mx1.riseup.net X-Virus-Status: Clean X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Oct 2015 11:07:25 -0000 Thanks Adrian, that also helped me with my 1043ND. At first I thought that since arge0 works for LAN, arge1 must be WAN, but reading your email made me realize I was wrong. I think you should put this into wiki (that arge1 may be a dumb NIC and how to configure embedded switch to use the WAN port). Also, it would be quite useful to have some way of automatically loading etherswitch configuration at boot time. For now the only way is to use rc.local. I know that your scripts make it possible, but with stock FreeBSD (which is what I use on my 1043ND for now) it's not really possible. From owner-freebsd-mips@freebsd.org Tue Oct 27 11:17:34 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C5F7FA1F40C for ; Tue, 27 Oct 2015 11:17:34 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from hz.grosbein.net (hz.grosbein.net [78.47.246.247]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 5723615C4 for ; Tue, 27 Oct 2015 11:17:33 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from eg.sd.rdtc.ru (root@eg.sd.rdtc.ru [62.231.161.221]) by hz.grosbein.net (8.14.9/8.14.9) with ESMTP id t9RBHPG9031877 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT); Tue, 27 Oct 2015 12:17:26 +0100 (CET) (envelope-from eugen@grosbein.net) X-Envelope-From: eugen@grosbein.net X-Envelope-To: pkubaj@riseup.net Received: from eg.sd.rdtc.ru (eugen@localhost [127.0.0.1]) by eg.sd.rdtc.ru (8.15.2/8.15.2) with ESMTP id t9RBHM6t011180; Tue, 27 Oct 2015 18:17:22 +0700 (KRAT) (envelope-from eugen@grosbein.net) Subject: Re: arge1 on TL WDR3600 To: Piotr Kubaj , freebsd-mips@freebsd.org References: <562F5AE2.8010301@riseup.net> Cc: Adrian Chadd From: Eugene Grosbein Message-ID: <562F5D42.9010804@grosbein.net> Date: Tue, 27 Oct 2015 18:17:22 +0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.2.0 MIME-Version: 1.0 In-Reply-To: <562F5AE2.8010301@riseup.net> Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=0.3 required=5.0 tests=BAYES_00,LOCAL_FROM, T_DATE_IN_FUTURE_96_Q autolearn=no version=3.3.2 X-Spam-Report: * 0.0 T_DATE_IN_FUTURE_96_Q Date: is 4 days to 4 months after Received: * date * -2.3 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 2.6 LOCAL_FROM From my domains X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on hz.grosbein.net X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Oct 2015 11:17:34 -0000 On 27.10.2015 18:07, Piotr Kubaj wrote: > Thanks Adrian, that also helped me with my 1043ND. At first I thought > that since arge0 works for LAN, arge1 must be WAN, but reading your > email made me realize I was wrong. I think you should put this into wiki > (that arge1 may be a dumb NIC and how to configure embedded switch to > use the WAN port). > > Also, it would be quite useful to have some way of automatically loading > etherswitch configuration at boot time. For now the only way is to use > rc.local. I know that your scripts make it possible, but with stock > FreeBSD (which is what I use on my 1043ND for now) it's not really possible. It is possible using /etc/start_if.switch0. Use this line in the /etc/rc.conf: network_interfaces="switch0 arge0" Then create shell script /etc/start_if.switch0 and put etherswitchcfg configuration there. Standard rcNG will setup switch using this script before arge0 configuration then. From owner-freebsd-mips@freebsd.org Tue Oct 27 12:40:13 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id F186CA1E001 for ; Tue, 27 Oct 2015 12:40:13 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from hz.grosbein.net (hz.grosbein.net [78.47.246.247]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 869AC11A1 for ; Tue, 27 Oct 2015 12:40:13 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from eg.sd.rdtc.ru (root@eg.sd.rdtc.ru [62.231.161.221]) by hz.grosbein.net (8.14.9/8.14.9) with ESMTP id t9RCe7Ip032093 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT); Tue, 27 Oct 2015 13:40:08 +0100 (CET) (envelope-from eugen@grosbein.net) X-Envelope-From: eugen@grosbein.net X-Envelope-To: adrian.chadd@gmail.com Received: from eg.sd.rdtc.ru (eugen@localhost [127.0.0.1]) by eg.sd.rdtc.ru (8.15.2/8.15.2) with ESMTP id t9RCe1DU011584; Tue, 27 Oct 2015 19:40:01 +0700 (KRAT) (envelope-from eugen@grosbein.net) Subject: Re: Strange results of TP-Link WDR3600 wired ethernet performace test To: Adrian Chadd References: <562E44E9.8090605@grosbein.net> <562E5D17.7030700@rdtc.ru> Cc: "freebsd-mips@freebsd.org" From: Eugene Grosbein Message-ID: <562F70A1.9010701@grosbein.net> Date: Tue, 27 Oct 2015 19:40:01 +0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.2.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=0.3 required=5.0 tests=BAYES_00,LOCAL_FROM, T_DATE_IN_FUTURE_96_Q autolearn=no version=3.3.2 X-Spam-Report: * 0.0 T_DATE_IN_FUTURE_96_Q Date: is 4 days to 4 months after Received: * date * -2.3 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 2.6 LOCAL_FROM From my domains X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on hz.grosbein.net X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Oct 2015 12:40:14 -0000 On 27.10.2015 00:49, Adrian Chadd wrote: > Hi, > > I'm glad that the throughput is higher - I was expecting exactly that. > > The interrupt storm - not sure. I haven't reproduced that at home. > There's some bit(s) in the interrupt status register that don't seem > to be cleared by taking action. I don't know what they are yet. To be precise: first it forwards traffic just fine, without interrupt storm and speed may raise over 22MByte/s but after a minute or less, interrupt storm begins. By default, hw.intr_storm_threshold is 1000 and it does not help increasing it upto 100,000. If I set it to zero (disable throttling), the device locks up solid when storm occurs: no traffic forwarding, no ping replies, even console is dead. Power cycle is required to revive it. This is 100% repeatable. I have PMC (performance monitoring counters) compiled in kernel. Now can I try to debug this? From owner-freebsd-mips@freebsd.org Tue Oct 27 12:53:35 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7F809A1E5EE for ; Tue, 27 Oct 2015 12:53:35 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: from mail-ig0-x22d.google.com (mail-ig0-x22d.google.com [IPv6:2607:f8b0:4001:c05::22d]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4C7811BD4 for ; Tue, 27 Oct 2015 12:53:35 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: by igdg1 with SMTP id g1so81708974igd.1 for ; Tue, 27 Oct 2015 05:53:34 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=xNWQuFQmRVhHXbY7ujKfV47AQYBgqQD1Zg7si6SQeDk=; b=fdjnVvuJb9ii6+iceKZvvyow193RqD2V54chss7xey+9PbmezydUwVeCmx1T4OxNBI 7+mBTia21injzptXXdk0TXXoHlYJW4foHuP1lI3+J7FV5UxR+rV47sPYuGYH5FNuqTRH 5Lak7QDM4la1htITTtZ8lXlK2GWhP6TTYnG2pH+SdW2kZ1W8gOjKXzrZDRM+C+nWWdga ohlJV9Jc4EByk4TqHzMg+dmkKPW2tZSv1S6c5tfXNq2sIRnMkYsCB2cHlYOJsA2QVjpx LbB4u7Rvr7U+Tf6gR305Msqpz1nHJkZGrrkusnc8zPIYt+a8NMNRMnbXC37IfhlLW4vs bYVw== MIME-Version: 1.0 X-Received: by 10.50.155.41 with SMTP id vt9mr15898501igb.22.1445950414683; Tue, 27 Oct 2015 05:53:34 -0700 (PDT) Received: by 10.36.46.66 with HTTP; Tue, 27 Oct 2015 05:53:34 -0700 (PDT) In-Reply-To: <562F5D42.9010804@grosbein.net> References: <562F5AE2.8010301@riseup.net> <562F5D42.9010804@grosbein.net> Date: Tue, 27 Oct 2015 07:53:34 -0500 Message-ID: Subject: Re: arge1 on TL WDR3600 From: Adrian Chadd To: Eugene Grosbein Cc: Piotr Kubaj , "freebsd-mips@freebsd.org" Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Oct 2015 12:53:35 -0000 There's definitely a framework to start the ethernet switch in freebsd-wifi-build. I added it around 8 months ago. https://github.com/freebsd/freebsd-wifi-build/wiki/Config-Overview Look at the "etherswitch" section. -adrian From owner-freebsd-mips@freebsd.org Tue Oct 27 12:54:46 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6AC01A1E60E for ; Tue, 27 Oct 2015 12:54:46 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: from mail-io0-x229.google.com (mail-io0-x229.google.com [IPv6:2607:f8b0:4001:c06::229]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 37B141C1B for ; Tue, 27 Oct 2015 12:54:46 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: by iody8 with SMTP id y8so64077094iod.1 for ; Tue, 27 Oct 2015 05:54:45 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=QOS6wWbSH4maETYZzVpy7rYy65xW5hylgcVbIfRqpNs=; b=M4Rs2UJrbE55933dBDCaUyUjcr7pgMN5y0Z7Ls3RntL9uvQ+yjtzZBZJdOkuxM1qI0 AgjaksNSQN4mVWOaSeb3trrLR1yBEhLNtM8ztzu3uNejjBYnlQSRIjPNwL8hhcx2fwCI Mm3D5TgwdHHWPTxnLSyXdELlVIAni2nK8QxahX7mwELuM9B71nidshmR1F2xQHqfntzO El49XVf2kyvU6MpRl7+hZzDBb6aYVdNd1zzgwdAOLMbufaJUnfb6+KYVkzPJEqOwCmLt 87wT11R95qlPiNuaTGALrqwKpnhb9EXCnHhxO81tiePjoOWqxBFZL2HC7/CFZWweqZb0 xB2Q== MIME-Version: 1.0 X-Received: by 10.107.152.2 with SMTP id a2mr30098904ioe.123.1445950485704; Tue, 27 Oct 2015 05:54:45 -0700 (PDT) Received: by 10.36.46.66 with HTTP; Tue, 27 Oct 2015 05:54:45 -0700 (PDT) In-Reply-To: <562F70A1.9010701@grosbein.net> References: <562E44E9.8090605@grosbein.net> <562E5D17.7030700@rdtc.ru> <562F70A1.9010701@grosbein.net> Date: Tue, 27 Oct 2015 07:54:45 -0500 Message-ID: Subject: Re: Strange results of TP-Link WDR3600 wired ethernet performace test From: Adrian Chadd To: Eugene Grosbein Cc: "freebsd-mips@freebsd.org" Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Oct 2015 12:54:46 -0000 HI, PMC won't help with the interrupt storm. We need to go see what the "stuck" bits are in the arge_intr() / arge_intr_filter() routine. I'll go add some debugging tonight to count each interrupt bit. That should tell us which bit it is. I wish I could reproduce it here. I'd fix it really quickly :( -adrian From owner-freebsd-mips@freebsd.org Tue Oct 27 12:56:15 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 895E1A1E665 for ; Tue, 27 Oct 2015 12:56:15 +0000 (UTC) (envelope-from pkubaj@riseup.net) Received: from mx1.riseup.net (mx1.riseup.net [198.252.153.129]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.riseup.net", Issuer "COMODO RSA Domain Validation Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 6A8F61C4E for ; Tue, 27 Oct 2015 12:56:15 +0000 (UTC) (envelope-from pkubaj@riseup.net) Received: from piha.riseup.net (unknown [10.0.1.163]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (Client CN "*.riseup.net", Issuer "COMODO RSA Domain Validation Secure Server CA" (verified OK)) by mx1.riseup.net (Postfix) with ESMTPS id 60F8F1A2DB3; Tue, 27 Oct 2015 05:56:14 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=riseup.net; s=squak; t=1445950574; bh=Pyc6wxVPYdAN2QaLL0tpT7dR7a320VFq9tjuNPY0YFg=; h=Subject:To:References:Cc:From:Date:In-Reply-To:From; b=ansc7Vv3NE+/4Vmwae47A7wBIB4Ej4B5k4JBnYuH72Rus0oNfQn0rr3I71gIZhVZY /XrEiThebo6WekEpapGYkcquoFD2HHmGFtuGlq4qj2IJ54ot+DLh/j6g4CeV4aHWqu HrAadmAqda9sfsubc+tzin5QRxp/ZxuxXw8rJ00Y= Received: from [127.0.0.1] (localhost [127.0.0.1]) (Authenticated sender: pkubaj) with ESMTPSA id 2EDA21C02BE Subject: Re: arge1 on TL WDR3600 To: Adrian Chadd , Eugene Grosbein References: <562F5AE2.8010301@riseup.net> <562F5D42.9010804@grosbein.net> Cc: "freebsd-mips@freebsd.org" From: Piotr Kubaj Message-ID: <562F746A.8070401@riseup.net> Date: Tue, 27 Oct 2015 13:56:10 +0100 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.3.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: clamav-milter 0.98.7 at mx1.riseup.net X-Virus-Status: Clean X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Oct 2015 12:56:15 -0000 I know, but right now I use stock FreeBSD on pendrive with kernel on flash. AFAIK pure FreeBSD right now doesn't have a framework to configure ethernet switches apart from freebsd-wifi-build which is more like a FreeBSD distribution than pure FreeBSD. On 10/27/15 13:53, Adrian Chadd wrote: > There's definitely a framework to start the ethernet switch in > freebsd-wifi-build. I added it around 8 months ago. > > https://github.com/freebsd/freebsd-wifi-build/wiki/Config-Overview > > Look at the "etherswitch" section. > > > > > -adrian From owner-freebsd-mips@freebsd.org Tue Oct 27 12:57:42 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0FE9BA1E6B6 for ; Tue, 27 Oct 2015 12:57:42 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from hz.grosbein.net (hz.grosbein.net [78.47.246.247]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 999CD1CA5 for ; Tue, 27 Oct 2015 12:57:41 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from eg.sd.rdtc.ru (root@eg.sd.rdtc.ru [62.231.161.221]) by hz.grosbein.net (8.14.9/8.14.9) with ESMTP id t9RCvWSS032160 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT); Tue, 27 Oct 2015 13:57:33 +0100 (CET) (envelope-from eugen@grosbein.net) X-Envelope-From: eugen@grosbein.net X-Envelope-To: adrian.chadd@gmail.com Received: from eg.sd.rdtc.ru (eugen@localhost [127.0.0.1]) by eg.sd.rdtc.ru (8.15.2/8.15.2) with ESMTP id t9RCvTwt011664; Tue, 27 Oct 2015 19:57:29 +0700 (KRAT) (envelope-from eugen@grosbein.net) Subject: Re: Strange results of TP-Link WDR3600 wired ethernet performace test To: Adrian Chadd References: <562E44E9.8090605@grosbein.net> <562E5D17.7030700@rdtc.ru> <562F70A1.9010701@grosbein.net> Cc: "freebsd-mips@freebsd.org" From: Eugene Grosbein Message-ID: <562F74B9.9030400@grosbein.net> Date: Tue, 27 Oct 2015 19:57:29 +0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.2.0 MIME-Version: 1.0 In-Reply-To: <562F70A1.9010701@grosbein.net> Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=0.3 required=5.0 tests=BAYES_00,LOCAL_FROM, T_DATE_IN_FUTURE_96_Q autolearn=no version=3.3.2 X-Spam-Report: * 0.0 T_DATE_IN_FUTURE_96_Q Date: is 4 days to 4 months after Received: * date * -2.3 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 2.6 LOCAL_FROM From my domains X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on hz.grosbein.net X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Oct 2015 12:57:42 -0000 On 27.10.2015 19:40, Eugene Grosbein wrote: > To be precise: first it forwards traffic just fine, without interrupt storm > and speed may raise over 22MByte/s but after a minute or less, > interrupt storm begins. By default, hw.intr_storm_threshold is 1000 > and it does not help increasing it upto 100,000. If I set it to zero > (disable throttling), the device locks up solid when storm occurs: > no traffic forwarding, no ping replies, even console is dead. > Power cycle is required to revive it. This is 100% repeatable. > > I have PMC (performance monitoring counters) compiled in kernel. > Now can I try to debug this? s/Now/How/ From owner-freebsd-mips@freebsd.org Tue Oct 27 12:58:54 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B8194A1E722 for ; Tue, 27 Oct 2015 12:58:54 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from hz.grosbein.net (hz.grosbein.net [78.47.246.247]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4BD351DF2 for ; Tue, 27 Oct 2015 12:58:53 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from eg.sd.rdtc.ru (root@eg.sd.rdtc.ru [62.231.161.221]) by hz.grosbein.net (8.14.9/8.14.9) with ESMTP id t9RCwnNR032168 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT); Tue, 27 Oct 2015 13:58:50 +0100 (CET) (envelope-from eugen@grosbein.net) X-Envelope-From: eugen@grosbein.net X-Envelope-To: adrian.chadd@gmail.com Received: from eg.sd.rdtc.ru (eugen@localhost [127.0.0.1]) by eg.sd.rdtc.ru (8.15.2/8.15.2) with ESMTP id t9RCwjna011680; Tue, 27 Oct 2015 19:58:45 +0700 (KRAT) (envelope-from eugen@grosbein.net) Subject: Re: Strange results of TP-Link WDR3600 wired ethernet performace test To: Adrian Chadd References: <562E44E9.8090605@grosbein.net> <562E5D17.7030700@rdtc.ru> Cc: "freebsd-mips@freebsd.org" From: Eugene Grosbein Message-ID: <562F7505.2060001@grosbein.net> Date: Tue, 27 Oct 2015 19:58:45 +0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.2.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=0.3 required=5.0 tests=BAYES_00,LOCAL_FROM, T_DATE_IN_FUTURE_96_Q autolearn=no version=3.3.2 X-Spam-Report: * 0.0 T_DATE_IN_FUTURE_96_Q Date: is 4 days to 4 months after Received: * date * -2.3 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 2.6 LOCAL_FROM From my domains X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on hz.grosbein.net X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Oct 2015 12:58:54 -0000 On 27.10.2015 02:21, Adrian Chadd wrote: > Also, right now my focus is testing bridging performance, not > forwarding performance. That way I can stress test a small subset of > the network stack and not have to get caught up in everything. > > Can you test with iperf2 instead of FTP? It's easier. What is iperf2 and why does it matter which kind of traffic is used for test? From owner-freebsd-mips@freebsd.org Tue Oct 27 13:02:40 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2F4DFA1E94C for ; Tue, 27 Oct 2015 13:02:40 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from hz.grosbein.net (hz.grosbein.net [78.47.246.247]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id B866A130E for ; Tue, 27 Oct 2015 13:02:39 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from eg.sd.rdtc.ru (root@eg.sd.rdtc.ru [62.231.161.221]) by hz.grosbein.net (8.14.9/8.14.9) with ESMTP id t9RD2W5Z032200 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT); Tue, 27 Oct 2015 14:02:33 +0100 (CET) (envelope-from eugen@grosbein.net) X-Envelope-From: eugen@grosbein.net X-Envelope-To: adrian.chadd@gmail.com Received: from eg.sd.rdtc.ru (eugen@localhost [127.0.0.1]) by eg.sd.rdtc.ru (8.15.2/8.15.2) with ESMTP id t9RD2QVT011719; Tue, 27 Oct 2015 20:02:26 +0700 (KRAT) (envelope-from eugen@grosbein.net) Subject: Re: arge1 on TL WDR3600 To: Adrian Chadd References: <562CBEC3.8030308@rdtc.ru> <562E3027.4020806@grosbein.net> Cc: "freebsd-mips@freebsd.org" From: Eugene Grosbein Message-ID: <562F75E2.9000505@grosbein.net> Date: Tue, 27 Oct 2015 20:02:26 +0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.2.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=0.3 required=5.0 tests=BAYES_00,LOCAL_FROM, T_DATE_IN_FUTURE_96_Q autolearn=no version=3.3.2 X-Spam-Report: * 0.0 T_DATE_IN_FUTURE_96_Q Date: is 4 days to 4 months after Received: * date * -2.3 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 2.6 LOCAL_FROM From my domains X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on hz.grosbein.net X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Oct 2015 13:02:40 -0000 On 27.10.2015 00:50, Adrian Chadd wrote: >>> I'll try to answer more thoroughly tomorrow, but in the meanwhile: >> >> [skip] >> >> Thank you very much for explanation. >> >> Another thing: when I insert cable into "WAN" port, kernel writes to console: >> >> arswitch0: arswitch_miipollstat: port 0: port -> UP > It's one of those unclear things - there's no port0 MII/PHY. port1 == > phy0, port2 == phy1, etc. It is still misleading, arswitch_miipollstat should print phy 0 instead of port 0 then, shouldn't it? "port 0" is used in both places (arswitch and etherswitchcfg) but has distinct meanings, that's not good. From owner-freebsd-mips@freebsd.org Tue Oct 27 13:08:13 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E5632A1EB0B for ; Tue, 27 Oct 2015 13:08:13 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from hz.grosbein.net (hz.grosbein.net [78.47.246.247]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 7AFB21788 for ; Tue, 27 Oct 2015 13:08:13 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from eg.sd.rdtc.ru (root@eg.sd.rdtc.ru [62.231.161.221]) by hz.grosbein.net (8.14.9/8.14.9) with ESMTP id t9RD85Dk032218 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT); Tue, 27 Oct 2015 14:08:05 +0100 (CET) (envelope-from eugen@grosbein.net) X-Envelope-From: eugen@grosbein.net X-Envelope-To: adrian.chadd@gmail.com Received: from eg.sd.rdtc.ru (eugen@localhost [127.0.0.1]) by eg.sd.rdtc.ru (8.15.2/8.15.2) with ESMTP id t9RD7w8q011758; Tue, 27 Oct 2015 20:07:59 +0700 (KRAT) (envelope-from eugen@grosbein.net) Subject: Re: Strange results of TP-Link WDR3600 wired ethernet performace test To: Adrian Chadd References: <562E44E9.8090605@grosbein.net> <562E5D17.7030700@rdtc.ru> <562F70A1.9010701@grosbein.net> Cc: "freebsd-mips@freebsd.org" From: Eugene Grosbein Message-ID: <562F772E.90205@grosbein.net> Date: Tue, 27 Oct 2015 20:07:58 +0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.2.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=0.3 required=5.0 tests=BAYES_00,LOCAL_FROM autolearn=no version=3.3.2 X-Spam-Report: * -2.3 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 2.6 LOCAL_FROM From my domains X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on hz.grosbein.net X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Oct 2015 13:08:14 -0000 On 27.10.2015 19:54, Adrian Chadd wrote: > HI, > > PMC won't help with the interrupt storm. We need to go see what the > "stuck" bits are in the arge_intr() / arge_intr_filter() routine. > > I'll go add some debugging tonight to count each interrupt bit. That > should tell us which bit it is. > > I wish I could reproduce it here. I'd fix it really quickly :( I'm ready to apply debugging patches and re-test. From owner-freebsd-mips@freebsd.org Tue Oct 27 16:18:15 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 43690A1EF1D for ; Tue, 27 Oct 2015 16:18:15 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: from mail-ig0-x234.google.com (mail-ig0-x234.google.com [IPv6:2607:f8b0:4001:c05::234]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 0F36C1C4C for ; Tue, 27 Oct 2015 16:18:15 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: by igpw7 with SMTP id w7so9727278igp.1 for ; Tue, 27 Oct 2015 09:18:14 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=oiyJ/slLq7e3evncDQY1TKaE+FQBZXN1YLW4Bf3/ArA=; b=LMc+gOTcDZq5PD4Z3EV0zn6jUkpnmPY094Nm+rYkjvrr6uxJoarvZE0P/gdwoXungg u4VBV5y7FTNLsgoeJUyhR/1nIddm3r0DCKzdBb3VpKgDieqmJIYiMbDTfRtXoyr0h1D9 +fkL9KzEHtUy/43Br1LXlxxa/gJpFE5pDfZHX8ZW4zqh8O42GSRBy3MQB/7SDiMZ9F2B hpW1vHPrXdJt04EyK4OmzYAS5b3MDCuelUBLMlKcHxZDdEjIgXEegYm52tRGW5sf2gdD aEpGBOn0pmYhw1UouCDYOzuWatgIgDM6799gzOlds2PvrWXqaHbkU82TnEs5LRIhoP3h z6WA== MIME-Version: 1.0 X-Received: by 10.50.23.52 with SMTP id j20mr747197igf.22.1445962694384; Tue, 27 Oct 2015 09:18:14 -0700 (PDT) Received: by 10.36.46.66 with HTTP; Tue, 27 Oct 2015 09:18:14 -0700 (PDT) In-Reply-To: <562F772E.90205@grosbein.net> References: <562E44E9.8090605@grosbein.net> <562E5D17.7030700@rdtc.ru> <562F70A1.9010701@grosbein.net> <562F772E.90205@grosbein.net> Date: Tue, 27 Oct 2015 11:18:14 -0500 Message-ID: Subject: Re: Strange results of TP-Link WDR3600 wired ethernet performace test From: Adrian Chadd To: Eugene Grosbein Cc: "freebsd-mips@freebsd.org" Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Oct 2015 16:18:15 -0000 ok, I'll try to do something this week, but no promises. Note: I'm suggesting using iperf so I can exactly replicate what you're doing. -adrian From owner-freebsd-mips@freebsd.org Tue Oct 27 18:35:43 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9D02DA1FC63 for ; Tue, 27 Oct 2015 18:35:43 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: from mail-io0-x22e.google.com (mail-io0-x22e.google.com [IPv6:2607:f8b0:4001:c06::22e]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 69DEB18F0 for ; Tue, 27 Oct 2015 18:35:43 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: by iody8 with SMTP id y8so75751823iod.1 for ; Tue, 27 Oct 2015 11:35:42 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=CQgAg2sW8egS0y0oThzVu6e6LWtNzYr3qE0M89YVxuc=; b=J4Cvm4vfCGM+BDU/X2LN9v3r/YP25QOW0CVE6K9Y0UZ+8xK8KZt04tMvVMj6rjJXf1 xEmV+o/XEfKlSRbVhGDuQZOn8900GYanTrmAwsk6x1WjlO4DsbWu33mAtbCpvb46c0aq llwRKM4E7y8qx0hYz9VC84EKIYbbHt/djVBLjZE1hTqsCCzPy952XXGgRp8VAHkbOOZJ pqGEllqHTTaa3W9s6eoWOeBdKUVAG/IyZD2lzeJLjRPbIqqEBF54x3ZXdUntOTWc0zmG gcKpSRixiJFah2j8VTwWcHin0te51aU2dUbyw83APE1W0rOH/WLoP8RzK2f80ZDFZ2Fd MOqA== MIME-Version: 1.0 X-Received: by 10.107.3.72 with SMTP id 69mr42169145iod.75.1445970942690; Tue, 27 Oct 2015 11:35:42 -0700 (PDT) Received: by 10.36.46.66 with HTTP; Tue, 27 Oct 2015 11:35:42 -0700 (PDT) In-Reply-To: <562F75E2.9000505@grosbein.net> References: <562CBEC3.8030308@rdtc.ru> <562E3027.4020806@grosbein.net> <562F75E2.9000505@grosbein.net> Date: Tue, 27 Oct 2015 13:35:42 -0500 Message-ID: Subject: Re: arge1 on TL WDR3600 From: Adrian Chadd To: Eugene Grosbein Cc: "freebsd-mips@freebsd.org" Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Oct 2015 18:35:43 -0000 I'm totally open to patches to fix behaviour to be more sensible. I'm just out of spare cycles right now... :) -a From owner-freebsd-mips@freebsd.org Wed Oct 28 04:47:57 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 22111A1F532 for ; Wed, 28 Oct 2015 04:47:57 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: from mail-io0-x22a.google.com (mail-io0-x22a.google.com [IPv6:2607:f8b0:4001:c06::22a]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id DA34C13C9 for ; Wed, 28 Oct 2015 04:47:56 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: by iody8 with SMTP id y8so88926832iod.1 for ; Tue, 27 Oct 2015 21:47:56 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=MPaPHvHQ5CiaY29eHsBg875iC7qvwGiYOQY9jJb9t34=; b=NVKGR4tGqhtvRxK+aLqfRPD63kSxoLRbPEK4Zjtp9R6o1XqpEDnAhlEng1UaDk4iX+ h072LaPjGkL1ZTWdHQwz5okci23ZwV4eNNXPweh+3DotQ8HBUcX7ZAKR5dvLxcKEm+tN N396BTIHZRSXJgdb2yIkARZT2FjJllpRv0zkfHkc1glcXLudHwgbqhsCQRNYl9jt4jqQ RbpTsccSKLxvvibPrC+dMo+rgYz8FYCfBXmBIOtdjfhrznzRjipvuI/fTm6H340RrpHT QsMdLYBXJXjD7Acjkb8ooY20jBoDlPqaqKuVZAZEOJ/lfEqCwZ1lYrXyaPFFjAWVQafD CDtA== MIME-Version: 1.0 X-Received: by 10.107.152.2 with SMTP id a2mr34162450ioe.123.1446007676217; Tue, 27 Oct 2015 21:47:56 -0700 (PDT) Received: by 10.36.46.66 with HTTP; Tue, 27 Oct 2015 21:47:56 -0700 (PDT) In-Reply-To: References: <562CBEC3.8030308@rdtc.ru> <562E3027.4020806@grosbein.net> <562F75E2.9000505@grosbein.net> Date: Tue, 27 Oct 2015 21:47:56 -0700 Message-ID: Subject: Re: arge1 on TL WDR3600 From: Adrian Chadd To: Eugene Grosbein Cc: "freebsd-mips@freebsd.org" Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 28 Oct 2015 04:47:57 -0000 So, I fired up hwpmc. uncomment hwpmc/hwpmc_mips74k/HWPMC_HOOKS in the relevant kernel file (AR934X_BASE, QCA955X_BASE). pmc just works(tm). Here's the output from doing iperf across the interfaces; it's doing ~ 220mbit of IP routing: PMC: [CYCLES] Samples: 45578 (100.0%) , 0 unresolved %SAMP IMAGE FUNCTION CALLERS 5.1 kernel arge_intr 4.8 kernel ip_forward 4.3 kernel memcpy 4.0 kernel _bus_dmamap_sync 3.8 libpmc.so. pmclog_read 3.6 kernel ip_input 3.4 kernel _bus_dmamap_load_buf 3.3 kernel ip_output 2.9 kernel ether_nh_input 2.7 kernel uma_zfree_arg 2.7 kernel mb_ctor_pack 2.3 kernel qca955x_chip_ddr_flu 2.2 kernel if_transmit 2.2 kernel __rw_rlock 2.2 kernel mipsNN_pdcache_inv_r 2.2 kernel _bus_dmamap_unload 2.2 kernel netisr_dispatch_src 2.2 kernel ether_output 1.8 kernel bridge_input 1.6 kernel arge_start_locked .. I dunno why arge_intr() is triggering so much but yeah, that should be fixed. that memcpy() shows up in bridging as well, so it's either an artefact from sampling or it's actually some copy in the packet processing or busdma path that needs to be addressed. -adrian From owner-freebsd-mips@freebsd.org Wed Oct 28 05:12:10 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 14DCBA1FB7E for ; Wed, 28 Oct 2015 05:12:10 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: from mail-io0-x232.google.com (mail-io0-x232.google.com [IPv6:2607:f8b0:4001:c06::232]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id D4D9B107B for ; Wed, 28 Oct 2015 05:12:09 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: by iofz202 with SMTP id z202so244466103iof.2 for ; Tue, 27 Oct 2015 22:12:09 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=cC/Mc+wn1zf8f0LWpHyh9Roo8Bq48LLaZ+FKCKnVYK4=; b=CXK5pNf6OAYPgayZ5cu3ipuw5PfOsEBpOBj9ra2RCLopPRKeS/87Kp/plVOJLNIpam mPVpAuAPEF5GDYTSIvIHMXDpvBxHolqFLbVwv0mkSOX+js8po6FDitdcszTrSK7Bk/A8 vXYK7Dp4m7zLkAYhQqWT8yGjLU2p7YaSUHjXxX3COf3QqPy6Q8tE0tVpj0xozV7gFuyZ Zx2RaHE4j+2DYUFhZ8VpIMACxQwraqKVZwbrAAbeaZ8R99ihat5Rp+OsafveNAbg52bw 4c1TLhiacLKj2Qvxh8J1oNtQ8TItjgK7Wh8mDYo9+oKQrR7MpK8Z//oTf4enHrOatx8R a59A== MIME-Version: 1.0 X-Received: by 10.107.3.72 with SMTP id 69mr44395834iod.75.1446009129157; Tue, 27 Oct 2015 22:12:09 -0700 (PDT) Received: by 10.36.46.66 with HTTP; Tue, 27 Oct 2015 22:12:09 -0700 (PDT) In-Reply-To: References: <562CBEC3.8030308@rdtc.ru> <562E3027.4020806@grosbein.net> <562F75E2.9000505@grosbein.net> Date: Tue, 27 Oct 2015 22:12:09 -0700 Message-ID: Subject: Re: arge1 on TL WDR3600 From: Adrian Chadd To: Eugene Grosbein Cc: "freebsd-mips@freebsd.org" Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 28 Oct 2015 05:12:10 -0000 Hi, update to the latest -HEAD and try again. Make sure you have ARGE_DEBUG defined. sysctl dev.arge.0 and sysctl dev.arge.1 after you've seen the interrupt storm - i'd like to see which interrupt source is getting stuck. a- From owner-freebsd-mips@freebsd.org Wed Oct 28 15:23:09 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6A22AA20C76 for ; Wed, 28 Oct 2015 15:23:09 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from hz.grosbein.net (hz.grosbein.net [78.47.246.247]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 135971EB9 for ; Wed, 28 Oct 2015 15:23:08 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from eg.sd.rdtc.ru (root@eg.sd.rdtc.ru [62.231.161.221]) by hz.grosbein.net (8.14.9/8.14.9) with ESMTP id t9SFMr94037176 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT); Wed, 28 Oct 2015 16:22:54 +0100 (CET) (envelope-from eugen@grosbein.net) X-Envelope-From: eugen@grosbein.net X-Envelope-To: adrian.chadd@gmail.com Received: from eg.sd.rdtc.ru (eugen@localhost [127.0.0.1]) by eg.sd.rdtc.ru (8.15.2/8.15.2) with ESMTP id t9SFMiJU024432; Wed, 28 Oct 2015 22:22:44 +0700 (KRAT) (envelope-from eugen@grosbein.net) Subject: Re: arge1 on TL WDR3600 To: Adrian Chadd References: <562CBEC3.8030308@rdtc.ru> <562E3027.4020806@grosbein.net> <562F75E2.9000505@grosbein.net> Cc: "freebsd-mips@freebsd.org" From: Eugene Grosbein Message-ID: <5630E844.2080807@grosbein.net> Date: Wed, 28 Oct 2015 22:22:44 +0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.2.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=0.3 required=5.0 tests=BAYES_00,LOCAL_FROM, T_DATE_IN_FUTURE_96_Q autolearn=no version=3.3.2 X-Spam-Report: * 0.0 T_DATE_IN_FUTURE_96_Q Date: is 4 days to 4 months after Received: * date * -2.3 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 2.6 LOCAL_FROM From my domains X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on hz.grosbein.net X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 28 Oct 2015 15:23:09 -0000 On 28.10.2015 12:12, Adrian Chadd wrote: > Hi, > > update to the latest -HEAD and try again. Make sure you have ARGE_DEBUG defined. > > sysctl dev.arge.0 and sysctl dev.arge.1 after you've seen the > interrupt storm - i'd like to see which interrupt source is getting > stuck. Here it is: dev.arge.0.tx_cnt: 126 dev.arge.0.tx_cons: 99 dev.arge.0.tx_prod: 97 dev.arge.0.intr_ok: 37796 dev.arge.0.intr_stray_intr: 0 dev.arge.0.intr_stray_filter: 0 dev.arge.0.tx_pkts_nosegs: 55 dev.arge.0.tx_pkts_unaligned_len: 0 dev.arge.0.tx_pkts_unaligned_start: 0 dev.arge.0.tx_pkts_unaligned: 0 dev.arge.0.tx_pkts_aligned: 56879 dev.arge.0.intr.31: 0 dev.arge.0.intr.30: 0 dev.arge.0.intr.29: 0 dev.arge.0.intr.28: 0 dev.arge.0.intr.27: 0 dev.arge.0.intr.26: 0 dev.arge.0.intr.25: 0 dev.arge.0.intr.24: 0 dev.arge.0.intr.23: 0 dev.arge.0.intr.22: 0 dev.arge.0.intr.21: 0 dev.arge.0.intr.20: 0 dev.arge.0.intr.19: 0 dev.arge.0.intr.18: 0 dev.arge.0.intr.17: 0 dev.arge.0.intr.16: 3242 dev.arge.0.intr.15: 0 dev.arge.0.intr.14: 0 dev.arge.0.intr.13: 0 dev.arge.0.intr.12: 0 dev.arge.0.intr.11: 0 dev.arge.0.intr.10: 0 dev.arge.0.intr.9: 0 dev.arge.0.intr.8: 0 dev.arge.0.intr.7: 0 dev.arge.0.intr.6: 0 dev.arge.0.intr.5: 0 dev.arge.0.intr.4: 0 dev.arge.0.intr.3: 0 dev.arge.0.intr.2: 35197 dev.arge.0.intr.1: 35478 dev.arge.0.intr.0: 0 dev.arge.0.debug: 0 dev.arge.0.%parent: nexus0 dev.arge.0.%pnpinfo: dev.arge.0.%location: dev.arge.0.%driver: arge dev.arge.0.%desc: Atheros AR71xx built-in ethernet interface dev.arge.1.tx_cnt: 0 dev.arge.1.tx_cons: 0 dev.arge.1.tx_prod: 0 dev.arge.1.intr_ok: 0 dev.arge.1.intr_stray_intr: 0 dev.arge.1.intr_stray_filter: 0 dev.arge.1.tx_pkts_nosegs: 0 dev.arge.1.tx_pkts_unaligned_len: 0 dev.arge.1.tx_pkts_unaligned_start: 0 dev.arge.1.tx_pkts_unaligned: 0 dev.arge.1.tx_pkts_aligned: 0 dev.arge.1.intr.31: 0 dev.arge.1.intr.30: 0 dev.arge.1.intr.29: 0 dev.arge.1.intr.28: 0 dev.arge.1.intr.27: 0 dev.arge.1.intr.26: 0 dev.arge.1.intr.25: 0 dev.arge.1.intr.24: 0 dev.arge.1.intr.23: 0 dev.arge.1.intr.22: 0 dev.arge.1.intr.21: 0 dev.arge.1.intr.20: 0 dev.arge.1.intr.19: 0 dev.arge.1.intr.18: 0 dev.arge.1.intr.17: 0 dev.arge.1.intr.16: 0 dev.arge.1.intr.15: 0 dev.arge.1.intr.14: 0 dev.arge.1.intr.13: 0 dev.arge.1.intr.12: 0 dev.arge.1.intr.11: 0 dev.arge.1.intr.10: 0 dev.arge.1.intr.9: 0 dev.arge.1.intr.8: 0 dev.arge.1.intr.7: 0 dev.arge.1.intr.6: 0 dev.arge.1.intr.5: 0 dev.arge.1.intr.4: 0 dev.arge.1.intr.3: 0 dev.arge.1.intr.2: 0 dev.arge.1.intr.1: 0 dev.arge.1.intr.0: 0 dev.arge.1.debug: 0 dev.arge.1.%parent: nexus0 dev.arge.1.%pnpinfo: dev.arge.1.%location: dev.arge.1.%driver: arge dev.arge.1.%desc: Atheros AR71xx built-in ethernet interface # interrupt storm detected on "int2"; throttling interrupt source From owner-freebsd-mips@freebsd.org Wed Oct 28 18:19:35 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 95BDDA1F5F5 for ; Wed, 28 Oct 2015 18:19:35 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from hz.grosbein.net (hz.grosbein.net [78.47.246.247]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 41FE11D82; Wed, 28 Oct 2015 18:19:34 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from eg.sd.rdtc.ru (root@eg.sd.rdtc.ru [62.231.161.221]) by hz.grosbein.net (8.14.9/8.14.9) with ESMTP id t9SIJOuN037646 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT); Wed, 28 Oct 2015 19:19:26 +0100 (CET) (envelope-from eugen@grosbein.net) X-Envelope-From: eugen@grosbein.net X-Envelope-To: adrian@freebsd.org Received: from eg.sd.rdtc.ru (eugen@localhost [127.0.0.1]) by eg.sd.rdtc.ru (8.15.2/8.15.2) with ESMTP id t9SIJIel025427; Thu, 29 Oct 2015 01:19:18 +0700 (KRAT) (envelope-from eugen@grosbein.net) Subject: Re: Initial flashing for TPLink TL-WDR3600 To: Adrian Chadd References: <5614D073.9060706@riseup.net> <5614E36E.6000803@grosbein.net> <5615F57E.1010405@riseup.net> <5615F697.6080700@riseup.net> <5616AA5B.8030609@grosbein.net> Cc: "freebsd-mips@freebsd.org" , mark.treacy@gmail.com From: Eugene Grosbein X-Enigmail-Draft-Status: N1110 Message-ID: <563111A6.1020006@grosbein.net> Date: Thu, 29 Oct 2015 01:19:18 +0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.2.0 MIME-Version: 1.0 In-Reply-To: <5616AA5B.8030609@grosbein.net> Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=0.3 required=5.0 tests=BAYES_00,LOCAL_FROM, T_DATE_IN_FUTURE_96_Q autolearn=no version=3.3.2 X-Spam-Report: * 0.0 T_DATE_IN_FUTURE_96_Q Date: is 4 days to 4 months after Received: * date * -2.3 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 2.6 LOCAL_FROM From my domains X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on hz.grosbein.net X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 28 Oct 2015 18:19:35 -0000 On 09.10.2015 00:39, Eugene Grosbein wrote: > About reflashing. > > I've just built tl-wdr3600.factory.bin using HEAD sources and instructions at > https://github.com/freebsd/freebsd-wifi-build/wiki/TPLink-TL-WDR3600 > > My device has "TFTP auto recovery" described at > http://wiki.openwrt.org/toh/tp-link/tl-wdr3600#tftp_auto_recovery_in_revision_15 > > It sends tftp RRQ "wdr3600v1_tp_recovery.bin" just like that article says. > Is it possible to reflash the device to FreeBSD using this tftp method? > > I have no TTL cable handy yet. And, more important, I want to discover easy reflashing method > that does not require making cable and opening/soldering device > so that I could recommend it to others in local community and "lower the wall" for FreeBSD/mips. Answering to myself. There is reliable way to flash FreeBSD image to TPLink TL-WDR3600 having stock firmware without need to open case and use/solder TTL cable or use intermediate firmwares like OpenWRT. I've tested it and it works. 1. Upgrade stock firmware to its latest version using official TP-Link site and instructions. This gives you "TFTP auto recovery" feature. That is, U-Boot 1.1.4 with TFTP client. The page is http://www.tplink.com/en/download/TL-WDR3600_V1.html#Firmware and the archive is http://www.tplink.com/res/down/soft/TL-WDR3600_V1_150518.zip containing "wdr3600v1_en_3_14_3_up_boot(150518).bin" file. Important part is its length 8192512 bytes (16001*512) and word "boot" in its name indicating that it has U-Boot embedded. You can use that image or localized one. I've tested with above file and with wdr3600v1_ru_3_14_3_up_boot(150605).bin having same size, both work. 2. Get first 257 blocks (512 bytes each) from stock firmware: # dd if='wdr3600v1_en_3_14_3_up_boot(150518).bin' bs=512 count=257 of=recovery-header.bin 257+0 records in 257+0 records out 131584 bytes transferred in 0.000705 secs (186642982 bytes/sec) You get different contents for different source images (english or localized), it works anyway. 3. Build FreeBSD image as Adrian's wiki tells. 4. Now you need to prepend FreeBSD image with recovery-header.bin and pad it with anything up to same 8192512 bytes length. Zero padding works just fine despite of stock image being padded with 0xff bytes: size=$(stat -f '%z' freebsd.img) padsize=$(( 8192512-($size+131584) )) dd if=/dev/zero bs=$padsize count=1 | cat recovery-header.bin freebsd.img - > wdr3600v1_tp_recovery.bin 5. Now just follow standard stock procedure for firmware recovery: - setup tftp server using address 192.168.0.66/24 having wdr3600v1_tp_recovery.bin; - connect TL-WDR3600 to tftp server using LAN port; its U-Boot uses address 192.168.0.86/24 for recovery purpose; - turn the device off, press and hold WPS button and turn it on holding WPS button for about 5 seconds until LAN activity LED starts to bink; you may release the button after that - it should download wdr3600v1_tp_recovery.bin from tftp server, flash it and reboot; give it some time to finish re-flashing and it resets automatically blinking all LEDs and boots FreeBSD. Credits to Leon George and his following post to OpenWrt-Devel list: https://mail-archive.com/openwrt-devel%40lists.openwrt.org/msg32888.html Have fun! From owner-freebsd-mips@freebsd.org Wed Oct 28 23:39:49 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 26EFCA20C41 for ; Wed, 28 Oct 2015 23:39:49 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: from mail-io0-x229.google.com (mail-io0-x229.google.com [IPv6:2607:f8b0:4001:c06::229]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id E47D61DEB for ; Wed, 28 Oct 2015 23:39:48 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: by iody8 with SMTP id y8so28284215iod.1 for ; Wed, 28 Oct 2015 16:39:48 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=5KDc3bg+oEdHpmtVEE54uI+X4bfT08012j8+Nm+E8ZQ=; b=BOQZ10XvSuzy/4xhku/D2Emgjn1qZlMSZXfXDdeLTXjAedluIy9f9eq+GNxFri6AsO 6rzHCUb2rkeTj63GYKeBQJuoHvy7if8aXD2oieaMYjaPvv1ebNPi7eWtpiM30pueSHEe Efb5ouMt+465Q/nPNBc8W7D+MDfpJ0SMIYOq+5J+wvJRWkVBKcogkcq0E6XhduMz9g9m F+JFwvq7xUvzQLWE2iA+ZWv35QdTZvAL8lGaD3vWFHgj1Zd0wcwSxiCvUU9gDyzZU867 gesHm2xX/hmg0LrbOcMuUDtJCHXQfDpiij3Ijlo/DhH/HTyJyMUOQL/6Egjt8nwX+k0B iODw== MIME-Version: 1.0 X-Received: by 10.107.152.2 with SMTP id a2mr106659ioe.123.1446075587957; Wed, 28 Oct 2015 16:39:47 -0700 (PDT) Received: by 10.36.46.66 with HTTP; Wed, 28 Oct 2015 16:39:47 -0700 (PDT) In-Reply-To: <5630E844.2080807@grosbein.net> References: <562CBEC3.8030308@rdtc.ru> <562E3027.4020806@grosbein.net> <562F75E2.9000505@grosbein.net> <5630E844.2080807@grosbein.net> Date: Wed, 28 Oct 2015 19:39:47 -0400 Message-ID: Subject: Re: arge1 on TL WDR3600 From: Adrian Chadd To: Eugene Grosbein Cc: "freebsd-mips@freebsd.org" Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 28 Oct 2015 23:39:49 -0000 Eep, try updating it again. I messed up the stats. Sorry! -adrian On 28 October 2015 at 11:22, Eugene Grosbein wrote: > On 28.10.2015 12:12, Adrian Chadd wrote: >> Hi, >> >> update to the latest -HEAD and try again. Make sure you have ARGE_DEBUG defined. >> >> sysctl dev.arge.0 and sysctl dev.arge.1 after you've seen the >> interrupt storm - i'd like to see which interrupt source is getting >> stuck. > > Here it is: > > dev.arge.0.tx_cnt: 126 > dev.arge.0.tx_cons: 99 > dev.arge.0.tx_prod: 97 > dev.arge.0.intr_ok: 37796 > dev.arge.0.intr_stray_intr: 0 > dev.arge.0.intr_stray_filter: 0 > dev.arge.0.tx_pkts_nosegs: 55 > dev.arge.0.tx_pkts_unaligned_len: 0 > dev.arge.0.tx_pkts_unaligned_start: 0 > dev.arge.0.tx_pkts_unaligned: 0 > dev.arge.0.tx_pkts_aligned: 56879 > dev.arge.0.intr.31: 0 > dev.arge.0.intr.30: 0 > dev.arge.0.intr.29: 0 > dev.arge.0.intr.28: 0 > dev.arge.0.intr.27: 0 > dev.arge.0.intr.26: 0 > dev.arge.0.intr.25: 0 > dev.arge.0.intr.24: 0 > dev.arge.0.intr.23: 0 > dev.arge.0.intr.22: 0 > dev.arge.0.intr.21: 0 > dev.arge.0.intr.20: 0 > dev.arge.0.intr.19: 0 > dev.arge.0.intr.18: 0 > dev.arge.0.intr.17: 0 > dev.arge.0.intr.16: 3242 > dev.arge.0.intr.15: 0 > dev.arge.0.intr.14: 0 > dev.arge.0.intr.13: 0 > dev.arge.0.intr.12: 0 > dev.arge.0.intr.11: 0 > dev.arge.0.intr.10: 0 > dev.arge.0.intr.9: 0 > dev.arge.0.intr.8: 0 > dev.arge.0.intr.7: 0 > dev.arge.0.intr.6: 0 > dev.arge.0.intr.5: 0 > dev.arge.0.intr.4: 0 > dev.arge.0.intr.3: 0 > dev.arge.0.intr.2: 35197 > dev.arge.0.intr.1: 35478 > dev.arge.0.intr.0: 0 > dev.arge.0.debug: 0 > dev.arge.0.%parent: nexus0 > dev.arge.0.%pnpinfo: > dev.arge.0.%location: > dev.arge.0.%driver: arge > dev.arge.0.%desc: Atheros AR71xx built-in ethernet interface > dev.arge.1.tx_cnt: 0 > dev.arge.1.tx_cons: 0 > dev.arge.1.tx_prod: 0 > dev.arge.1.intr_ok: 0 > dev.arge.1.intr_stray_intr: 0 > dev.arge.1.intr_stray_filter: 0 > dev.arge.1.tx_pkts_nosegs: 0 > dev.arge.1.tx_pkts_unaligned_len: 0 > dev.arge.1.tx_pkts_unaligned_start: 0 > dev.arge.1.tx_pkts_unaligned: 0 > dev.arge.1.tx_pkts_aligned: 0 > dev.arge.1.intr.31: 0 > dev.arge.1.intr.30: 0 > dev.arge.1.intr.29: 0 > dev.arge.1.intr.28: 0 > dev.arge.1.intr.27: 0 > dev.arge.1.intr.26: 0 > dev.arge.1.intr.25: 0 > dev.arge.1.intr.24: 0 > dev.arge.1.intr.23: 0 > dev.arge.1.intr.22: 0 > dev.arge.1.intr.21: 0 > dev.arge.1.intr.20: 0 > dev.arge.1.intr.19: 0 > dev.arge.1.intr.18: 0 > dev.arge.1.intr.17: 0 > dev.arge.1.intr.16: 0 > dev.arge.1.intr.15: 0 > dev.arge.1.intr.14: 0 > dev.arge.1.intr.13: 0 > dev.arge.1.intr.12: 0 > dev.arge.1.intr.11: 0 > dev.arge.1.intr.10: 0 > dev.arge.1.intr.9: 0 > dev.arge.1.intr.8: 0 > dev.arge.1.intr.7: 0 > dev.arge.1.intr.6: 0 > dev.arge.1.intr.5: 0 > dev.arge.1.intr.4: 0 > dev.arge.1.intr.3: 0 > dev.arge.1.intr.2: 0 > dev.arge.1.intr.1: 0 > dev.arge.1.intr.0: 0 > dev.arge.1.debug: 0 > dev.arge.1.%parent: nexus0 > dev.arge.1.%pnpinfo: > dev.arge.1.%location: > dev.arge.1.%driver: arge > dev.arge.1.%desc: Atheros AR71xx built-in ethernet interface > # interrupt storm detected on "int2"; throttling interrupt source > From owner-freebsd-mips@freebsd.org Wed Oct 28 23:40:17 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3EDE6A20C85 for ; Wed, 28 Oct 2015 23:40:17 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: from mail-io0-x233.google.com (mail-io0-x233.google.com [IPv6:2607:f8b0:4001:c06::233]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 076EE1E1C for ; Wed, 28 Oct 2015 23:40:17 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: by iody8 with SMTP id y8so28293151iod.1 for ; Wed, 28 Oct 2015 16:40:16 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=510sX36aRSyrvCSQvupW5NywMs6TPeP05aBI1noLIa4=; b=p34uVYWu4rKAbvdWOLJXL58KzYF3X25nnGuj5SKNKo56ECn5zjx94DRq866UEAXiej OxETc0C15qh/lWNcG6nCdxSatzyOEHJWSFZD+zw6TA6Flezgohx9DWyIXa4ZZ11L4vsx kGmR6JF5rfUQ6ws2cMBqb/NkpjN+hdZqcd1b92XnNqOWzgVtmgBhIg80GaiC273RHCLk 228UE3IaAmbX803aAA/R4yq4PY3Dve5hJAdZtpTPq0E0wEXpR7rrj4n7q07K58B9B43W +ypO341qh1uLqCgKIMYUmsGS7n6LDJu/UhaMdP5pSakCcpjdW6KVzOPI+Sc09uPjmAkL h00w== MIME-Version: 1.0 X-Received: by 10.107.46.142 with SMTP id u14mr97843iou.165.1446075616501; Wed, 28 Oct 2015 16:40:16 -0700 (PDT) Received: by 10.36.46.66 with HTTP; Wed, 28 Oct 2015 16:40:16 -0700 (PDT) In-Reply-To: References: <562CBEC3.8030308@rdtc.ru> <562E3027.4020806@grosbein.net> <562F75E2.9000505@grosbein.net> <5630E844.2080807@grosbein.net> Date: Wed, 28 Oct 2015 19:40:16 -0400 Message-ID: Subject: Re: arge1 on TL WDR3600 From: Adrian Chadd To: Eugene Grosbein Cc: "freebsd-mips@freebsd.org" Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 28 Oct 2015 23:40:17 -0000 .. and what's your bridge config? I can setup a one-arm bridge setup tonight - I've been routing between arge0<->arge1 and I should really be doing arge0 between VLANs. -a From owner-freebsd-mips@freebsd.org Thu Oct 29 10:01:05 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 011ECA1EFED for ; Thu, 29 Oct 2015 10:01:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id C7535180E for ; Thu, 29 Oct 2015 10:01:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id t9TA145F044996 for ; Thu, 29 Oct 2015 10:01:04 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-mips@FreeBSD.org Subject: [Bug 204118] dns/dnscrypt-proxy: doesn't work on FreeBSD/mips Date: Thu, 29 Oct 2015 10:01:03 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Ports & Packages X-Bugzilla-Component: Individual Port(s) X-Bugzilla-Version: Latest X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: pkubaj@riseup.net X-Bugzilla-Status: New X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-ports-bugs@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status bug_severity priority component assigned_to reporter cc flagtypes.name Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 29 Oct 2015 10:01:05 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D204118 Bug ID: 204118 Summary: dns/dnscrypt-proxy: doesn't work on FreeBSD/mips Product: Ports & Packages Version: Latest Hardware: mips OS: Any Status: New Severity: Affects Only Me Priority: --- Component: Individual Port(s) Assignee: freebsd-ports-bugs@FreeBSD.org Reporter: pkubaj@riseup.net CC: freebsd-mips@FreeBSD.org, freebsd@dns-lab.com Flags: maintainer-feedback?(freebsd@dns-lab.com) CC: freebsd-mips@FreeBSD.org, freebsd@dns-lab.com I try to run dnscrypt-proxy on a TP-LINK router with FreeBSD. I know that dnscrypt-proxy runs on mips (I've checked on OpenWRT) and it also runs on FreeBSD. But running it on FreeBSD/mips gives only errors. Running service dnscrypt-proxy start throws: root@TL-WR1043ND:~ # service dnscrypt-proxy start Starting dnscrypt_proxy. Cannot execute shared object /usr/local/sbin/dnscrypt-proxy: ELF: not found /usr/local/sbin/dnscrypt-proxy: IP4=EF=BF=BDl: not found /usr/local/sbin/dnscrypt-proxy: 4: not found /usr/local/sbin/dnscrypt-proxy: 7: Syntax error: word unexpected (expecting ")") /usr/local/etc/rc.d/dnscrypt-proxy: WARNING: failed to start dnscrypt_proxy root@TL-WR1043ND:~ # uname -a FreeBSD TL-WR1043ND 11.0-CURRENT FreeBSD 11.0-CURRENT #8 r290023M: Mon Oct = 26 22:33:05 CET 2015=20=20=20=20 pkubaj@DESKTOP1:/home/pkubaj/obj/mips_ap/mips.mips/home/pkubaj/srcmips/sys/= TP-WN1043ND_64_RAM mips Please see the attachment with truss output. --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-mips@freebsd.org Thu Oct 29 10:03:33 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E12F4A1F196 for ; Thu, 29 Oct 2015 10:03:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id CCEC61A34 for ; Thu, 29 Oct 2015 10:03:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id t9TA3XNx069999 for ; Thu, 29 Oct 2015 10:03:33 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-mips@FreeBSD.org Subject: [Bug 204118] dns/dnscrypt-proxy: doesn't work on FreeBSD/mips Date: Thu, 29 Oct 2015 10:03:33 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Ports & Packages X-Bugzilla-Component: Individual Port(s) X-Bugzilla-Version: Latest X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: pkubaj@riseup.net X-Bugzilla-Status: New X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-ports-bugs@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 29 Oct 2015 10:03:34 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=204118 --- Comment #1 from pkubaj@riseup.net --- Created attachment 162559 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=162559&action=edit truss /usr/local/sbin/dnscrypt-proxy -- You are receiving this mail because: You are on the CC list for the bug. From owner-freebsd-mips@freebsd.org Thu Oct 29 10:05:23 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A397BA1F229 for ; Thu, 29 Oct 2015 10:05:23 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 8F3931AB8 for ; Thu, 29 Oct 2015 10:05:23 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id t9TA5NLS071811 for ; Thu, 29 Oct 2015 10:05:23 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-mips@FreeBSD.org Subject: [Bug 204118] dns/dnscrypt-proxy: doesn't work on FreeBSD/mips Date: Thu, 29 Oct 2015 10:05:23 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Ports & Packages X-Bugzilla-Component: Individual Port(s) X-Bugzilla-Version: Latest X-Bugzilla-Keywords: needs-patch, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-ports-bugs@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: keywords cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 29 Oct 2015 10:05:23 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=204118 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |needs-patch, needs-qa CC| |koobs@FreeBSD.org --- Comment #2 from Kubilay Kocak --- A full build log (including configure/build) as an attachment might also be handy here. I've pinged the author on twitter about it in case he can shed some light. -- You are receiving this mail because: You are on the CC list for the bug. From owner-freebsd-mips@freebsd.org Thu Oct 29 13:28:10 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 968F5A1F056 for ; Thu, 29 Oct 2015 13:28:10 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from hz.grosbein.net (hz.grosbein.net [78.47.246.247]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 2A5001340 for ; Thu, 29 Oct 2015 13:28:09 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from eg.sd.rdtc.ru (root@eg.sd.rdtc.ru [62.231.161.221]) by hz.grosbein.net (8.14.9/8.14.9) with ESMTP id t9TDRw4H041688 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT); Thu, 29 Oct 2015 14:27:58 +0100 (CET) (envelope-from eugen@grosbein.net) X-Envelope-From: eugen@grosbein.net X-Envelope-To: adrian.chadd@gmail.com Received: from eg.sd.rdtc.ru (eugen@localhost [127.0.0.1]) by eg.sd.rdtc.ru (8.15.2/8.15.2) with ESMTP id t9TDRro9032487; Thu, 29 Oct 2015 20:27:54 +0700 (KRAT) (envelope-from eugen@grosbein.net) Subject: Re: arge1 on TL WDR3600 To: Adrian Chadd References: <562CBEC3.8030308@rdtc.ru> <562E3027.4020806@grosbein.net> <562F75E2.9000505@grosbein.net> <5630E844.2080807@grosbein.net> Cc: "freebsd-mips@freebsd.org" From: Eugene Grosbein X-Enigmail-Draft-Status: N1110 Message-ID: <56321ED9.4050602@grosbein.net> Date: Thu, 29 Oct 2015 20:27:53 +0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.2.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=0.3 required=5.0 tests=BAYES_00,LOCAL_FROM autolearn=no version=3.3.2 X-Spam-Report: * -2.3 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 2.6 LOCAL_FROM From my domains X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on hz.grosbein.net X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 29 Oct 2015 13:28:10 -0000 On 29.10.2015 06:40, Adrian Chadd wrote: > .. and what's your bridge config? I can setup a one-arm bridge setup > tonight - I've been routing between arge0<->arge1 and I should really > be doing arge0 between VLANs. For now, I prefer to stick with my forwarding (not bridging) setup because it shows interrupt storm reproduceably and this problem is more important than performance. Switch is configured with vlangroup0 (LAN, tag 1): all ports including CPU but excluding WAN, all untagged and vlangroup1 (WAN, tag 2): CPU port (tagged) and WAN port (untagged): #!/bin/sh cpu=0 wan=1 lan1=2 lan2=3 lan3=4 lan4=5; lantag="1" wantag="2" etherswitchcfg config vlan_mode dot1q etherswitchcfg vlangroup0 vlan $lantag members $cpu,$lan1,$lan2,$lan3,$lan4 etherswitchcfg vlangroup1 vlan $wantag members ${cpu}t,$wan etherswitchcfg port$cpu pvid $lantag etherswitchcfg port$lan1 pvid $lantag etherswitchcfg port$lan2 pvid $lantag etherswitchcfg port$lan3 pvid $lantag etherswitchcfg port$lan4 pvid $lantag etherswitchcfg port$wan pvid $wantag #EOF >From /etc/rc.conf: # LAN ifconfig_arge0="inet 192.168.0.86/24" # WAN ifconfig_vlan2="inet 10.58.0.12/24 vlan 2 vlandev arge0" FTP client is 192.168.0.66, it downloads 1GB file from FTP server 10.58.0.4 Here are new stats (head at r290136): dev.arge.0.tx_cnt: 126 dev.arge.0.tx_cons: 38 dev.arge.0.tx_prod: 36 dev.arge.0.intr_ok: 38356 dev.arge.0.intr_stray_intr: 0 dev.arge.0.intr_stray_filter: 0 dev.arge.0.tx_pkts_nosegs: 518 dev.arge.0.tx_pkts_unaligned_len: 0 dev.arge.0.tx_pkts_unaligned_start: 0 dev.arge.0.tx_pkts_unaligned: 0 dev.arge.0.tx_pkts_aligned: 345184 dev.arge.0.intr.31: 0 dev.arge.0.intr.30: 0 dev.arge.0.intr.29: 0 dev.arge.0.intr.28: 0 dev.arge.0.intr.27: 0 dev.arge.0.intr.26: 0 dev.arge.0.intr.25: 0 dev.arge.0.intr.24: 0 dev.arge.0.intr.23: 0 dev.arge.0.intr.22: 0 dev.arge.0.intr.21: 0 dev.arge.0.intr.20: 0 dev.arge.0.intr.19: 0 dev.arge.0.intr.18: 0 dev.arge.0.intr.17: 0 dev.arge.0.intr.16: 0 dev.arge.0.intr.15: 0 dev.arge.0.intr.14: 0 dev.arge.0.intr.13: 0 dev.arge.0.intr.12: 0 dev.arge.0.intr.11: 0 dev.arge.0.intr.10: 0 dev.arge.0.intr.9: 0 dev.arge.0.intr.8: 0 dev.arge.0.intr.7: 0 dev.arge.0.intr.6: 1 dev.arge.0.intr.5: 0 dev.arge.0.intr.4: 14275 dev.arge.0.intr.3: 0 dev.arge.0.intr.2: 0 dev.arge.0.intr.1: 26360 dev.arge.0.intr.0: 28596 dev.arge.0.debug: 0 dev.arge.0.%parent: nexus0 dev.arge.0.%pnpinfo: dev.arge.0.%location: dev.arge.0.%driver: arge dev.arge.0.%desc: Atheros AR71xx built-in ethernet interface dev.arge.1.tx_cnt: 0 dev.arge.1.tx_cons: 0 dev.arge.1.tx_prod: 0 dev.arge.1.intr_ok: 0 dev.arge.1.intr_stray_intr: 0 dev.arge.1.intr_stray_filter: 0 dev.arge.1.tx_pkts_nosegs: 0 dev.arge.1.tx_pkts_unaligned_len: 0 dev.arge.1.tx_pkts_unaligned_start: 0 dev.arge.1.tx_pkts_unaligned: 0 dev.arge.1.tx_pkts_aligned: 0 dev.arge.1.intr.31: 0 dev.arge.1.intr.30: 0 dev.arge.1.intr.29: 0 dev.arge.1.intr.28: 0 dev.arge.1.intr.27: 0 dev.arge.1.intr.26: 0 dev.arge.1.intr.25: 0 dev.arge.1.intr.24: 0 dev.arge.1.intr.23: 0 dev.arge.1.intr.22: 0 dev.arge.1.intr.21: 0 dev.arge.1.intr.20: 0 dev.arge.1.intr.19: 0 dev.arge.1.intr.18: 0 dev.arge.1.intr.17: 0 dev.arge.1.intr.16: 0 dev.arge.1.intr.15: 0 dev.arge.1.intr.14: 0 dev.arge.1.intr.13: 0 dev.arge.1.intr.12: 0 dev.arge.1.intr.11: 0 dev.arge.1.intr.10: 0 dev.arge.1.intr.9: 0 dev.arge.1.intr.8: 0 dev.arge.1.intr.7: 0 dev.arge.1.intr.6: 0 dev.arge.1.intr.5: 0 dev.arge.1.intr.4: 0 dev.arge.1.intr.3: 0 dev.arge.1.intr.2: 0 dev.arge.1.intr.1: 0 dev.arge.1.intr.0: 0 dev.arge.1.debug: 0 dev.arge.1.%parent: nexus0 dev.arge.1.%pnpinfo: dev.arge.1.%location: dev.arge.1.%driver: arge dev.arge.1.%desc: Atheros AR71xx built-in ethernet interface # interrupt storm detected on "int2"; throttling interrupt source From owner-freebsd-mips@freebsd.org Thu Oct 29 13:43:48 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 31E50A1F487 for ; Thu, 29 Oct 2015 13:43:48 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: from mail-ig0-x235.google.com (mail-ig0-x235.google.com [IPv6:2607:f8b0:4001:c05::235]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id ED5F21C14 for ; Thu, 29 Oct 2015 13:43:47 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: by igpw7 with SMTP id w7so28270471igp.0 for ; Thu, 29 Oct 2015 06:43:47 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=tWjVKo51erJeSWBR/4XUGazXxSo5/XsNsQVOLd6bJGw=; b=UBwGBihIRTY4a7W943KVf5s0hlRsUvw1YPU175hG9ZOicc1o0UfoGMHrfUFdgKI0ur KNbozdizAJamSZgAaHP4u+VYfrkIuzi8nts/tTK3UR1hp3ZnThV/GGe/UFd9LNBEhfBZ TSeUn++NMjhAHi6iafYAWfsJyogKaAnptxlHzRO/fMDjPc6AJbl1iIaTtr2p1hKCnSBH M3ZSD5m9yTgtfxFCmbOYdJ00H4agAIsouxBJ7sqzFrJYq2lFMAkL4B9g/7UUAn5OdaDn AE4n7VpxReSKYez6982n9qxweysiNwcFi7TNhZJUVa/XIBx8kIgh203gKH/Ro8uRUaLQ mKig== MIME-Version: 1.0 X-Received: by 10.50.155.41 with SMTP id vt9mr9536362igb.22.1446126227319; Thu, 29 Oct 2015 06:43:47 -0700 (PDT) Received: by 10.36.46.66 with HTTP; Thu, 29 Oct 2015 06:43:47 -0700 (PDT) In-Reply-To: <56321ED9.4050602@grosbein.net> References: <562CBEC3.8030308@rdtc.ru> <562E3027.4020806@grosbein.net> <562F75E2.9000505@grosbein.net> <5630E844.2080807@grosbein.net> <56321ED9.4050602@grosbein.net> Date: Thu, 29 Oct 2015 09:43:47 -0400 Message-ID: Subject: Re: arge1 on TL WDR3600 From: Adrian Chadd To: Eugene Grosbein Cc: "freebsd-mips@freebsd.org" Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 29 Oct 2015 13:43:48 -0000 Right, and this is interrupt storming? -a On 29 October 2015 at 09:27, Eugene Grosbein wrote: > On 29.10.2015 06:40, Adrian Chadd wrote: >> .. and what's your bridge config? I can setup a one-arm bridge setup >> tonight - I've been routing between arge0<->arge1 and I should really >> be doing arge0 between VLANs. > > For now, I prefer to stick with my forwarding (not bridging) setup > because it shows interrupt storm reproduceably and this problem is more important > than performance. > > Switch is configured with vlangroup0 (LAN, tag 1): all ports > including CPU but excluding WAN, all untagged and vlangroup1 (WAN, tag 2): > CPU port (tagged) and WAN port (untagged): > > #!/bin/sh > > cpu=0 > wan=1 > lan1=2 > lan2=3 > lan3=4 > lan4=5; > > lantag="1" > wantag="2" > > etherswitchcfg config vlan_mode dot1q > etherswitchcfg vlangroup0 vlan $lantag members $cpu,$lan1,$lan2,$lan3,$lan4 > etherswitchcfg vlangroup1 vlan $wantag members ${cpu}t,$wan > etherswitchcfg port$cpu pvid $lantag > etherswitchcfg port$lan1 pvid $lantag > etherswitchcfg port$lan2 pvid $lantag > etherswitchcfg port$lan3 pvid $lantag > etherswitchcfg port$lan4 pvid $lantag > etherswitchcfg port$wan pvid $wantag > > #EOF > > From /etc/rc.conf: > > # LAN > ifconfig_arge0="inet 192.168.0.86/24" > # WAN > ifconfig_vlan2="inet 10.58.0.12/24 vlan 2 vlandev arge0" > > FTP client is 192.168.0.66, it downloads 1GB file from FTP server 10.58.0.4 > > Here are new stats (head at r290136): > > dev.arge.0.tx_cnt: 126 > dev.arge.0.tx_cons: 38 > dev.arge.0.tx_prod: 36 > dev.arge.0.intr_ok: 38356 > dev.arge.0.intr_stray_intr: 0 > dev.arge.0.intr_stray_filter: 0 > dev.arge.0.tx_pkts_nosegs: 518 > dev.arge.0.tx_pkts_unaligned_len: 0 > dev.arge.0.tx_pkts_unaligned_start: 0 > dev.arge.0.tx_pkts_unaligned: 0 > dev.arge.0.tx_pkts_aligned: 345184 > dev.arge.0.intr.31: 0 > dev.arge.0.intr.30: 0 > dev.arge.0.intr.29: 0 > dev.arge.0.intr.28: 0 > dev.arge.0.intr.27: 0 > dev.arge.0.intr.26: 0 > dev.arge.0.intr.25: 0 > dev.arge.0.intr.24: 0 > dev.arge.0.intr.23: 0 > dev.arge.0.intr.22: 0 > dev.arge.0.intr.21: 0 > dev.arge.0.intr.20: 0 > dev.arge.0.intr.19: 0 > dev.arge.0.intr.18: 0 > dev.arge.0.intr.17: 0 > dev.arge.0.intr.16: 0 > dev.arge.0.intr.15: 0 > dev.arge.0.intr.14: 0 > dev.arge.0.intr.13: 0 > dev.arge.0.intr.12: 0 > dev.arge.0.intr.11: 0 > dev.arge.0.intr.10: 0 > dev.arge.0.intr.9: 0 > dev.arge.0.intr.8: 0 > dev.arge.0.intr.7: 0 > dev.arge.0.intr.6: 1 > dev.arge.0.intr.5: 0 > dev.arge.0.intr.4: 14275 > dev.arge.0.intr.3: 0 > dev.arge.0.intr.2: 0 > dev.arge.0.intr.1: 26360 > dev.arge.0.intr.0: 28596 > dev.arge.0.debug: 0 > dev.arge.0.%parent: nexus0 > dev.arge.0.%pnpinfo: > dev.arge.0.%location: > dev.arge.0.%driver: arge > dev.arge.0.%desc: Atheros AR71xx built-in ethernet interface > dev.arge.1.tx_cnt: 0 > dev.arge.1.tx_cons: 0 > dev.arge.1.tx_prod: 0 > dev.arge.1.intr_ok: 0 > dev.arge.1.intr_stray_intr: 0 > dev.arge.1.intr_stray_filter: 0 > dev.arge.1.tx_pkts_nosegs: 0 > dev.arge.1.tx_pkts_unaligned_len: 0 > dev.arge.1.tx_pkts_unaligned_start: 0 > dev.arge.1.tx_pkts_unaligned: 0 > dev.arge.1.tx_pkts_aligned: 0 > dev.arge.1.intr.31: 0 > dev.arge.1.intr.30: 0 > dev.arge.1.intr.29: 0 > dev.arge.1.intr.28: 0 > dev.arge.1.intr.27: 0 > dev.arge.1.intr.26: 0 > dev.arge.1.intr.25: 0 > dev.arge.1.intr.24: 0 > dev.arge.1.intr.23: 0 > dev.arge.1.intr.22: 0 > dev.arge.1.intr.21: 0 > dev.arge.1.intr.20: 0 > dev.arge.1.intr.19: 0 > dev.arge.1.intr.18: 0 > dev.arge.1.intr.17: 0 > dev.arge.1.intr.16: 0 > dev.arge.1.intr.15: 0 > dev.arge.1.intr.14: 0 > dev.arge.1.intr.13: 0 > dev.arge.1.intr.12: 0 > dev.arge.1.intr.11: 0 > dev.arge.1.intr.10: 0 > dev.arge.1.intr.9: 0 > dev.arge.1.intr.8: 0 > dev.arge.1.intr.7: 0 > dev.arge.1.intr.6: 0 > dev.arge.1.intr.5: 0 > dev.arge.1.intr.4: 0 > dev.arge.1.intr.3: 0 > dev.arge.1.intr.2: 0 > dev.arge.1.intr.1: 0 > dev.arge.1.intr.0: 0 > dev.arge.1.debug: 0 > dev.arge.1.%parent: nexus0 > dev.arge.1.%pnpinfo: > dev.arge.1.%location: > dev.arge.1.%driver: arge > dev.arge.1.%desc: Atheros AR71xx built-in ethernet interface > # interrupt storm detected on "int2"; throttling interrupt source > From owner-freebsd-mips@freebsd.org Thu Oct 29 15:01:08 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E8308A217A1 for ; Thu, 29 Oct 2015 15:01:08 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from hz.grosbein.net (hz.grosbein.net [78.47.246.247]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 77D481104 for ; Thu, 29 Oct 2015 15:01:07 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from eg.sd.rdtc.ru (root@eg.sd.rdtc.ru [62.231.161.221]) by hz.grosbein.net (8.14.9/8.14.9) with ESMTP id t9TF0upU041963 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT); Thu, 29 Oct 2015 16:00:56 +0100 (CET) (envelope-from eugen@grosbein.net) X-Envelope-From: eugen@grosbein.net X-Envelope-To: adrian.chadd@gmail.com Received: from [10.58.0.10] (dadvw [10.58.0.10]) by eg.sd.rdtc.ru (8.15.2/8.15.2) with ESMTPS id t9TF0nf0032927 (version=TLSv1.2 cipher=DHE-RSA-AES128-SHA bits=128 verify=NOT); Thu, 29 Oct 2015 22:00:49 +0700 (KRAT) (envelope-from eugen@grosbein.net) Subject: Re: arge1 on TL WDR3600 To: Adrian Chadd References: <562CBEC3.8030308@rdtc.ru> <562E3027.4020806@grosbein.net> <562F75E2.9000505@grosbein.net> <5630E844.2080807@grosbein.net> <56321ED9.4050602@grosbein.net> Cc: "freebsd-mips@freebsd.org" From: Eugene Grosbein Message-ID: <56323496.609@grosbein.net> Date: Thu, 29 Oct 2015 22:00:38 +0700 User-Agent: Mozilla/5.0 (Windows NT 6.3; WOW64; rv:38.0) Gecko/20100101 Thunderbird/38.3.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit X-Spam-Status: No, score=0.3 required=5.0 tests=BAYES_00,LOCAL_FROM autolearn=no version=3.3.2 X-Spam-Report: * -2.3 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 2.6 LOCAL_FROM From my domains X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on hz.grosbein.net X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 29 Oct 2015 15:01:09 -0000 29.10.2015 20:43, Adrian Chadd пишет: > Right, and this is interrupt storming? Yes, throttled. From owner-freebsd-mips@freebsd.org Thu Oct 29 16:46:24 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4F062A21FB0 for ; Thu, 29 Oct 2015 16:46:24 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: from mail-ig0-x22f.google.com (mail-ig0-x22f.google.com [IPv6:2607:f8b0:4001:c05::22f]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 1456A1E97 for ; Thu, 29 Oct 2015 16:46:24 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: by igpw7 with SMTP id w7so32684745igp.0 for ; Thu, 29 Oct 2015 09:46:23 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:content-transfer-encoding; bh=pvu5ltC/WP+/VAlKLTeZriNdHs+wy/p9rg4qe0VupNE=; b=U/GyJwbIOcz1KkWIeuAccCIdazxHkVu3tdAZuZXxFtXoPNWrU9gQZieIWzNXWfwJSL Dx8Obc/ACXbFq8A5NK2pGdnLcW/phnANWWSARExy4i64St6av3ZV6psNmnOpLBjQ3PwV QtpwoF25uvfwOcmJuXYIjrDSWPVaUiUJ96ca3qsZ/eiOHqC5cvlINKOUfuxiPwcEq5M5 HGgnTVveq6jsZR0rOdO5pBgKmu4sbHdVhklkV6AUs9bNu+xQRfa2o0rOyEJWOxiUxIE7 yxYq/WOB3pNhU7i8WPIzsj+TxEuPRj7SOIKNNf8/x4vLZfvyIB9iYotKPpufVU9WUtG6 YdgQ== MIME-Version: 1.0 X-Received: by 10.50.79.232 with SMTP id m8mr4668950igx.22.1446137183325; Thu, 29 Oct 2015 09:46:23 -0700 (PDT) Received: by 10.36.46.66 with HTTP; Thu, 29 Oct 2015 09:46:23 -0700 (PDT) In-Reply-To: <56323496.609@grosbein.net> References: <562CBEC3.8030308@rdtc.ru> <562E3027.4020806@grosbein.net> <562F75E2.9000505@grosbein.net> <5630E844.2080807@grosbein.net> <56321ED9.4050602@grosbein.net> <56323496.609@grosbein.net> Date: Thu, 29 Oct 2015 12:46:23 -0400 Message-ID: Subject: Re: arge1 on TL WDR3600 From: Adrian Chadd To: Eugene Grosbein Cc: "freebsd-mips@freebsd.org" Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 29 Oct 2015 16:46:24 -0000 On 29 October 2015 at 11:00, Eugene Grosbein wrote: > 29.10.2015 20:43, Adrian Chadd =D0=BF=D0=B8=D1=88=D0=B5=D1=82: >> >> Right, and this is interrupt storming? > > > Yes, throttled. Ok. So when it starts doing that, please do this: sysctl dev.arge.0.debug=3D0x12 (0x10 is ERR, 0x02 is INTR.) I'd like to see what interrupt bits are currently set. Something keeps triggering and I'd like to know why. Thanks! -a From owner-freebsd-mips@freebsd.org Thu Oct 29 17:29:37 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id EA5EBA20A7A for ; Thu, 29 Oct 2015 17:29:37 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from hz.grosbein.net (hz.grosbein.net [78.47.246.247]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 97B2211DE for ; Thu, 29 Oct 2015 17:29:36 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from eg.sd.rdtc.ru (root@eg.sd.rdtc.ru [62.231.161.221]) by hz.grosbein.net (8.14.9/8.14.9) with ESMTP id t9THTJ19042354 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT); Thu, 29 Oct 2015 18:29:20 +0100 (CET) (envelope-from eugen@grosbein.net) X-Envelope-From: eugen@grosbein.net X-Envelope-To: adrian.chadd@gmail.com Received: from eg.sd.rdtc.ru (eugen@localhost [127.0.0.1]) by eg.sd.rdtc.ru (8.15.2/8.15.2) with ESMTP id t9THTDYr033621; Fri, 30 Oct 2015 00:29:13 +0700 (KRAT) (envelope-from eugen@grosbein.net) Subject: Re: arge1 on TL WDR3600 To: Adrian Chadd References: <562CBEC3.8030308@rdtc.ru> <562E3027.4020806@grosbein.net> <562F75E2.9000505@grosbein.net> <5630E844.2080807@grosbein.net> <56321ED9.4050602@grosbein.net> <56323496.609@grosbein.net> Cc: "freebsd-mips@freebsd.org" From: Eugene Grosbein Message-ID: <56325769.8070202@grosbein.net> Date: Fri, 30 Oct 2015 00:29:13 +0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.2.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=0.3 required=5.0 tests=BAYES_00,LOCAL_FROM, T_DATE_IN_FUTURE_96_Q autolearn=no version=3.3.2 X-Spam-Report: * 0.0 T_DATE_IN_FUTURE_96_Q Date: is 4 days to 4 months after Received: * date * -2.3 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 2.6 LOCAL_FROM From my domains X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on hz.grosbein.net X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 29 Oct 2015 17:29:38 -0000 On 29.10.2015 23:46, Adrian Chadd wrote: >>> Right, and this is interrupt storming? >> Yes, throttled. > Ok. So when it starts doing that, please do this: > > sysctl dev.arge.0.debug=0x12 > > (0x10 is ERR, 0x02 is INTR.) > > I'd like to see what interrupt bits are currently set. Something keeps > triggering and I'd like to know why. Here it is: # sysctl dev.arge.0.debug=0x12interrupt storm detected on "int2"; throttling interrupt source interrupt storm detected on "int2"; throttling interrupt source interrupt storm detected on "int2"; throttling interrupt source interrupt storm detected on "int2"; throttling interrupt source dev.arge.0.debugarge0: int mask(filter) = db arge0: status(filter) = 3 arge0: int status(intr) = 3 : 0 -> 18 arge0: int mask(filter) = db arge0: status(filter) = 3 arge0: int status(intr) = 3 # arge0: int mask(filter) = db arge0: status(filter) = 3 arge0: int status(intr) = 3 arge0: int mask(filter) = db arge0: status(filter) = 3 arge0: int status(intr) = 3 arge0: int mask(filter) = db arge0: status(filter) = 3 arge0: int status(intr) = 3 arge0: int mask(filter) = db arge0: status(filter) = 3 arge0: int status(intr) = 3 arge0: int mask(filter) = db arge0: status(filter) = 3 arge0: int status(intr) = 3 arge0: int mask(filter) = db arge0: status(filter) = 3 arge0: int status(intr) = 3 arge0: int mask(filter) = db arge0: status(filter) = 3 arge0: int status(intr) = 3 arge0: int mask(filter) = db arge0: status(filter) = 3 And it keeps repeating over and over endlessly. From owner-freebsd-mips@freebsd.org Thu Oct 29 17:52:39 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 18975A20EF3 for ; Thu, 29 Oct 2015 17:52:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 03EF31E55 for ; Thu, 29 Oct 2015 17:52:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id t9THqcqd065713 for ; Thu, 29 Oct 2015 17:52:38 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-mips@FreeBSD.org Subject: [Bug 204118] dns/dnscrypt-proxy: doesn't work on FreeBSD/mips Date: Thu, 29 Oct 2015 17:52:39 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Ports & Packages X-Bugzilla-Component: Individual Port(s) X-Bugzilla-Version: Latest X-Bugzilla-Keywords: needs-patch, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: pkubaj@riseup.net X-Bugzilla-Status: New X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-ports-bugs@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 29 Oct 2015 17:52:39 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=204118 --- Comment #3 from pkubaj@riseup.net --- Created attachment 162575 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=162575&action=edit poudriere log of dns/dnscrypt-proxy -- You are receiving this mail because: You are on the CC list for the bug. From owner-freebsd-mips@freebsd.org Thu Oct 29 17:52:59 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4B297A20F18 for ; Thu, 29 Oct 2015 17:52:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 36E601EBB for ; Thu, 29 Oct 2015 17:52:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id t9THqxMU066049 for ; Thu, 29 Oct 2015 17:52:59 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-mips@FreeBSD.org Subject: [Bug 204118] dns/dnscrypt-proxy: doesn't work on FreeBSD/mips Date: Thu, 29 Oct 2015 17:52:59 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Ports & Packages X-Bugzilla-Component: Individual Port(s) X-Bugzilla-Version: Latest X-Bugzilla-Keywords: needs-patch, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: pkubaj@riseup.net X-Bugzilla-Status: New X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-ports-bugs@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 29 Oct 2015 17:52:59 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=204118 --- Comment #4 from pkubaj@riseup.net --- (In reply to Kubilay Kocak from comment #2) I've attached the full log. -- You are receiving this mail because: You are on the CC list for the bug. From owner-freebsd-mips@freebsd.org Thu Oct 29 18:41:56 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4D024A216DB for ; Thu, 29 Oct 2015 18:41:56 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: from mail-ig0-x22f.google.com (mail-ig0-x22f.google.com [IPv6:2607:f8b0:4001:c05::22f]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 123291386 for ; Thu, 29 Oct 2015 18:41:56 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: by igvi2 with SMTP id i2so30493215igv.0 for ; Thu, 29 Oct 2015 11:41:55 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=0aBTzIJkwdUNYyWU11dJPcvfK+/z8WpZwiyE+9+U5Gs=; b=xl6N8XETbuyXiOWJRhEJjNukXFuyZitmTtGgqmNZD3D4hv+f3z1kehsRepF6BmVj6j VYXw2fjc5/vPiNmi2fLo7xrK+T+HlGGc782wdX7AYEXqKm2ut7zU1ZXaleZRL6n9oXOF K1f35vnoItHwKWfp0Yde23jNZ4d3XOxVCEBNExIuuqTmnBROg/iurxEAp1FOF3IwAzEa 94X6wo4+fMpY3EGtmv+gUf90OnS6knF5ZJAWei8a1nr+mi2122+aZQ2c5ZlWyj8GDCdW 5vALACdnC+hA5BA503vB3NrdIGXGT4k/QKO905kcKF7EIL+v9U/hXVxEK/l9RfFw00Xs XBpw== MIME-Version: 1.0 X-Received: by 10.50.178.141 with SMTP id cy13mr5345347igc.61.1446144115428; Thu, 29 Oct 2015 11:41:55 -0700 (PDT) Received: by 10.36.46.66 with HTTP; Thu, 29 Oct 2015 11:41:55 -0700 (PDT) In-Reply-To: <56325769.8070202@grosbein.net> References: <562CBEC3.8030308@rdtc.ru> <562E3027.4020806@grosbein.net> <562F75E2.9000505@grosbein.net> <5630E844.2080807@grosbein.net> <56321ED9.4050602@grosbein.net> <56323496.609@grosbein.net> <56325769.8070202@grosbein.net> Date: Thu, 29 Oct 2015 14:41:55 -0400 Message-ID: Subject: Re: arge1 on TL WDR3600 From: Adrian Chadd To: Eugene Grosbein Cc: "freebsd-mips@freebsd.org" Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 29 Oct 2015 18:41:56 -0000 AH, ok. So it says TX_UNDERRUN + TX_PKT_SENT. So hm. The way this is supposed to work is .. odd. You queue TX packets to the hardware. The hardware increments TXPKTCOUNT in the TX DMA status register. Then for each packet you see transmitted, you write TXPKTSENT to the TX DMA status register and that decrements TXPKTCOUNT. Once it's zero, you won't see any more TX interrupts. Now, the 'arge_tx_cnt' value tracks that; it should be zero if it's idle. It's 126, which means there are still things to process. there's 128 ring slots, so that prod/cons value indicates there's 126 things in the ring. arge_tx_locked() does the decrementing and poking TXPKTSENT. So, I bet the driver and hardware is out of sync. I bet that the (ctrl & ARGE_DESC_EMPTY) check is triggering on the current frame in that ring. I don't know if it's because prod/cons are out of whack, or it's currently trying to check a descriptor in a multi-frame TX descriptor, or whether the hardware is just plain buggy and it didn't update that. But, that's actually what's going on. So that's my 5 minute analysis of it. I wish I could reproduce it on what I have here because then I could see what the state of the ring is and whether the hardware is buggy or our tx prod/cons tracking is busted. I'd reaally appreciate help here :( -adrian From owner-freebsd-mips@freebsd.org Thu Oct 29 19:57:57 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 49879A213C4 for ; Thu, 29 Oct 2015 19:57:57 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: from mail-io0-x229.google.com (mail-io0-x229.google.com [IPv6:2607:f8b0:4001:c06::229]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id D48481A42 for ; Thu, 29 Oct 2015 19:57:56 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: by iody8 with SMTP id y8so58009916iod.1 for ; Thu, 29 Oct 2015 12:57:56 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=hpQs546F+isUGxO9TYWb4GpKirhLskFIvJkhlhft/qw=; b=s/e9PiRabvl5RsqRgpnkqxKOQtGqqZ2EGptV9wCgXdes0SdBL/9DZ5b1EXZJEdgqnk uhofMDZI4lo8rYp/HWxTFyLkSSJg2z4BJrmEVbGDmQnZf+YXmC5yJ7Vg+PVuj5yp9Rd3 9HAjTYbwSAc/DTLNHEGWjFP4BL2ixLSdcDS5296/zrKfl9v2m4VbamRClBGtk205eGAA +sBqsT/enHGB5Dwlhr+oMnY/FIV3t6N7X8MNCCi+dz3FbAcmkevCyo8XdSa3uCX6HDTL Trb+x9S8WjsoiBCYO+SyHoyI3LioNMfs+7URlz7Q5Pn6vekSRoS5TOFUnh3mFyXw/VA5 NIpg== MIME-Version: 1.0 X-Received: by 10.107.46.142 with SMTP id u14mr5677501iou.165.1446148676175; Thu, 29 Oct 2015 12:57:56 -0700 (PDT) Received: by 10.36.46.66 with HTTP; Thu, 29 Oct 2015 12:57:56 -0700 (PDT) In-Reply-To: References: <562CBEC3.8030308@rdtc.ru> <562E3027.4020806@grosbein.net> <562F75E2.9000505@grosbein.net> <5630E844.2080807@grosbein.net> <56321ED9.4050602@grosbein.net> <56323496.609@grosbein.net> <56325769.8070202@grosbein.net> Date: Thu, 29 Oct 2015 15:57:56 -0400 Message-ID: Subject: Re: arge1 on TL WDR3600 From: Adrian Chadd To: Eugene Grosbein Cc: "freebsd-mips@freebsd.org" Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 29 Oct 2015 19:57:57 -0000 This may actually be a bug in how the rx/tx descriptors are handled. I'm going to have to change it to pad them out to be one descriptor per cache line. It's the only way this'll work. -a On 29 October 2015 at 14:41, Adrian Chadd wrote: > AH, ok. So it says TX_UNDERRUN + TX_PKT_SENT. So hm. > > The way this is supposed to work is .. odd. > > You queue TX packets to the hardware. The hardware increments > TXPKTCOUNT in the TX DMA status register. > > Then for each packet you see transmitted, you write TXPKTSENT to the > TX DMA status register and that decrements TXPKTCOUNT. Once it's zero, > you won't see any more TX interrupts. > > Now, the 'arge_tx_cnt' value tracks that; it should be zero if it's > idle. It's 126, which means there are still things to process. there's > 128 ring slots, so that prod/cons value indicates there's 126 things > in the ring. arge_tx_locked() does the decrementing and poking > TXPKTSENT. > > So, I bet the driver and hardware is out of sync. I bet that the (ctrl > & ARGE_DESC_EMPTY) check is triggering on the current frame in that > ring. I don't know if it's because prod/cons are out of whack, or it's > currently trying to check a descriptor in a multi-frame TX descriptor, > or whether the hardware is just plain buggy and it didn't update that. > But, that's actually what's going on. > > So that's my 5 minute analysis of it. I wish I could reproduce it on > what I have here because then I could see what the state of the ring > is and whether the hardware is buggy or our tx prod/cons tracking is > busted. I'd reaally appreciate help here :( > > > -adrian From owner-freebsd-mips@freebsd.org Thu Oct 29 21:15:20 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A9FC2A202D0 for ; Thu, 29 Oct 2015 21:15:20 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from hz.grosbein.net (hz.grosbein.net [78.47.246.247]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 3D9C11518 for ; Thu, 29 Oct 2015 21:15:19 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from eg.sd.rdtc.ru (root@eg.sd.rdtc.ru [62.231.161.221]) by hz.grosbein.net (8.14.9/8.14.9) with ESMTP id t9TLF7Yj042952 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT); Thu, 29 Oct 2015 22:15:08 +0100 (CET) (envelope-from eugen@grosbein.net) X-Envelope-From: eugen@grosbein.net X-Envelope-To: adrian.chadd@gmail.com Received: from eg.sd.rdtc.ru (eugen@localhost [127.0.0.1]) by eg.sd.rdtc.ru (8.15.2/8.15.2) with ESMTP id t9TLF05k035281; Fri, 30 Oct 2015 04:15:01 +0700 (KRAT) (envelope-from eugen@grosbein.net) Subject: Re: arge1 on TL WDR3600 To: Adrian Chadd References: <562CBEC3.8030308@rdtc.ru> <562E3027.4020806@grosbein.net> <562F75E2.9000505@grosbein.net> <5630E844.2080807@grosbein.net> <56321ED9.4050602@grosbein.net> <56323496.609@grosbein.net> <56325769.8070202@grosbein.net> Cc: "freebsd-mips@freebsd.org" From: Eugene Grosbein X-Enigmail-Draft-Status: N1110 Message-ID: <56328C54.1050709@grosbein.net> Date: Fri, 30 Oct 2015 04:15:00 +0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.2.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=0.3 required=5.0 tests=BAYES_00,LOCAL_FROM autolearn=no version=3.3.2 X-Spam-Report: * -2.3 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 2.6 LOCAL_FROM From my domains X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on hz.grosbein.net X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 29 Oct 2015 21:15:20 -0000 On 30.10.2015 01:41, Adrian Chadd wrote: > AH, ok. So it says TX_UNDERRUN + TX_PKT_SENT. So hm. > > The way this is supposed to work is .. odd. > > You queue TX packets to the hardware. The hardware increments > TXPKTCOUNT in the TX DMA status register. > > Then for each packet you see transmitted, you write TXPKTSENT to the > TX DMA status register and that decrements TXPKTCOUNT. Once it's zero, > you won't see any more TX interrupts. > > Now, the 'arge_tx_cnt' value tracks that; it should be zero if it's > idle. It's 126, which means there are still things to process. there's > 128 ring slots, so that prod/cons value indicates there's 126 things > in the ring. arge_tx_locked() does the decrementing and poking > TXPKTSENT. > > So, I bet the driver and hardware is out of sync. I bet that the (ctrl > & ARGE_DESC_EMPTY) check is triggering on the current frame in that > ring. I don't know if it's because prod/cons are out of whack, or it's > currently trying to check a descriptor in a multi-frame TX descriptor, > or whether the hardware is just plain buggy and it didn't update that. > But, that's actually what's going on. > > So that's my 5 minute analysis of it. I wish I could reproduce it on > what I have here because then I could see what the state of the ring > is and whether the hardware is buggy or our tx prod/cons tracking is > busted. I'd reaally appreciate help here :( I do not think that hardware is buggy because several versions of "official" TP-Link firmware work just fine with this particular device and earlier versions of FreeBSD 11 also work without interrupt storms. In fact, I've applied dichotomy and found guilty commit. It took 12 iterations but here is it: kernel built using head at r289897 runs my test without a storm (but forwarding speed is pretty bad) and kernel built with r289898 or later revisions has interrupt storm. This is the change: https://svnweb.freebsd.org/base/head/sys/mips/atheros/if_arge.c?r1=289744&r2=289898&view=patch My device has hw.model: Atheros AR9344 rev 2 From owner-freebsd-mips@freebsd.org Thu Oct 29 21:21:04 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8E372A20431 for ; Thu, 29 Oct 2015 21:21:04 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from hz.grosbein.net (hz.grosbein.net [78.47.246.247]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 13FEE18C1 for ; Thu, 29 Oct 2015 21:21:03 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from eg.sd.rdtc.ru (root@eg.sd.rdtc.ru [62.231.161.221]) by hz.grosbein.net (8.14.9/8.14.9) with ESMTP id t9TLKwbX042967 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT); Thu, 29 Oct 2015 22:20:59 +0100 (CET) (envelope-from eugen@grosbein.net) X-Envelope-From: eugen@grosbein.net X-Envelope-To: adrian.chadd@gmail.com Received: from eg.sd.rdtc.ru (eugen@localhost [127.0.0.1]) by eg.sd.rdtc.ru (8.15.2/8.15.2) with ESMTP id t9TLKnPg035581; Fri, 30 Oct 2015 04:20:50 +0700 (KRAT) (envelope-from eugen@grosbein.net) Subject: Re: arge1 on TL WDR3600 To: Adrian Chadd References: <562CBEC3.8030308@rdtc.ru> <562E3027.4020806@grosbein.net> <562F75E2.9000505@grosbein.net> <5630E844.2080807@grosbein.net> <56321ED9.4050602@grosbein.net> <56323496.609@grosbein.net> <56325769.8070202@grosbein.net> <56328C54.1050709@grosbein.net> Cc: "freebsd-mips@freebsd.org" From: Eugene Grosbein Message-ID: <56328DB1.9010105@grosbein.net> Date: Fri, 30 Oct 2015 04:20:49 +0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.2.0 MIME-Version: 1.0 In-Reply-To: <56328C54.1050709@grosbein.net> Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=0.3 required=5.0 tests=BAYES_00,LOCAL_FROM autolearn=no version=3.3.2 X-Spam-Report: * -2.3 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 2.6 LOCAL_FROM From my domains X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on hz.grosbein.net X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 29 Oct 2015 21:21:04 -0000 On 30.10.2015 04:15, Eugene Grosbein wrote: > I do not think that hardware is buggy because several versions of "official" > TP-Link firmware work just fine with this particular device and earlier > versions of FreeBSD 11 also work without interrupt storms. > > In fact, I've applied dichotomy and found guilty commit. It took 12 iterations > but here is it: kernel built using head at r289897 runs my test without a storm > (but forwarding speed is pretty bad) and kernel built with r289898 or later > revisions has interrupt storm. > > This is the change: > https://svnweb.freebsd.org/base/head/sys/mips/atheros/if_arge.c?r1=289744&r2=289898&view=patch > > My device has hw.model: Atheros AR9344 rev 2 Also, for slow but stable (pre-289898) revisions stats show that all tx packets are unaligned: dev.arge.0.tx_pkts_unaligned: 1189534 dev.arge.0.tx_pkts_aligned: 0 And, as I've already wrote, later revisions show opposite, like: > dev.arge.0.tx_pkts_unaligned: 0 > dev.arge.0.tx_pkts_aligned: 345184 Hope this helps. From owner-freebsd-mips@freebsd.org Fri Oct 30 01:43:43 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B7B58A20EAB for ; Fri, 30 Oct 2015 01:43:43 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: from mail-io0-x22f.google.com (mail-io0-x22f.google.com [IPv6:2607:f8b0:4001:c06::22f]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 87BE614E7 for ; Fri, 30 Oct 2015 01:43:43 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: by ioll68 with SMTP id l68so66060067iol.3 for ; Thu, 29 Oct 2015 18:43:43 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=Fjvc69NmPTAnUaqWTKx5GI678SVPHtBkYVQoOZMMbXg=; b=UFUJhzjnbsV02umgLafPgHlF8qtARtLT3IMpu9pwwSqWdi2x65SzT/i2XLPzu3nzbG EhBUDauuUAqTmHTaHOybs58W8vVxsSUmgFKs+1TGG/ppguulbHJda5IcQlfYgfKQB3Ej bsmS9X0JSso86c1kqWOH2lHC0Ll4g4oETR6rWJDz5FwQBc/4/cq4RN/zkbl3luqaLf+e Y3tgi+ay9ksON+lrEcfZLHLyVUI5luE9RDsk+c2DFv42aimCsjPdXgwVpFoz3e7zRQnS /DN63ZecbeS3ZD2FdbJ+LgiDuU3bqXBf3O5JoatVAl8M50b3qrg+U7zHJ3JCPLJR/zf/ 14HQ== MIME-Version: 1.0 X-Received: by 10.107.3.72 with SMTP id 69mr6928103iod.75.1446169422897; Thu, 29 Oct 2015 18:43:42 -0700 (PDT) Received: by 10.36.46.66 with HTTP; Thu, 29 Oct 2015 18:43:42 -0700 (PDT) In-Reply-To: <56328DB1.9010105@grosbein.net> References: <562CBEC3.8030308@rdtc.ru> <562E3027.4020806@grosbein.net> <562F75E2.9000505@grosbein.net> <5630E844.2080807@grosbein.net> <56321ED9.4050602@grosbein.net> <56323496.609@grosbein.net> <56325769.8070202@grosbein.net> <56328C54.1050709@grosbein.net> <56328DB1.9010105@grosbein.net> Date: Thu, 29 Oct 2015 18:43:42 -0700 Message-ID: Subject: Re: arge1 on TL WDR3600 From: Adrian Chadd To: Eugene Grosbein Cc: "freebsd-mips@freebsd.org" Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 30 Oct 2015 01:43:43 -0000 Right. the real problem here is now we're handing multi-descrpitor TX frames to the hardware and there are likely bugs there which need to be fixed. -a From owner-freebsd-mips@freebsd.org Fri Oct 30 14:16:09 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2D5E9A1E98A for ; Fri, 30 Oct 2015 14:16:09 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: from mail-ig0-x22d.google.com (mail-ig0-x22d.google.com [IPv6:2607:f8b0:4001:c05::22d]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id DAC9C1927 for ; Fri, 30 Oct 2015 14:16:08 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: by igpw7 with SMTP id w7so12499252igp.0 for ; Fri, 30 Oct 2015 07:16:08 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=T2wfQRY7CceLbYWUZd5nhwPdkbQfmR9g6T9yX0F21GI=; b=tn44+SdACt0c7JWZ+EkRGIs4sdo5pq5AL+F0sXmpZDyL3yva9QHsQJmQyYKjP4kMD6 hFN+zWMJGxfxB48IRbMEDuTS6OIGrRZl+enKNUL8aEZ9xTxiAgPLHU2UfUHuRE92ulcB WurhH1xs72uSFGkboNdJTdFTbk3NX0GJr7VFEM5OjGYLHjiotuM8UVcXaq0lhuoKAC0k AO+SUOwRHnfDwKJqzWluxbnXqNUnuwXMzgxdO5TN+L+d+LUJ1eIN5NEeR9tm3LW4N7S6 XeKty0DWOm7bBVArQ84+c8Sm/5q4P4afaAt5lsh2bpcaPMCBgCo4lfXP3tD2T3GppmmW GMkg== MIME-Version: 1.0 X-Received: by 10.50.155.41 with SMTP id vt9mr3152911igb.22.1446214568312; Fri, 30 Oct 2015 07:16:08 -0700 (PDT) Received: by 10.36.46.66 with HTTP; Fri, 30 Oct 2015 07:16:06 -0700 (PDT) In-Reply-To: References: <562CBEC3.8030308@rdtc.ru> <562E3027.4020806@grosbein.net> <562F75E2.9000505@grosbein.net> <5630E844.2080807@grosbein.net> <56321ED9.4050602@grosbein.net> <56323496.609@grosbein.net> <56325769.8070202@grosbein.net> <56328C54.1050709@grosbein.net> <56328DB1.9010105@grosbein.net> Date: Fri, 30 Oct 2015 07:16:06 -0700 Message-ID: Subject: Re: arge1 on TL WDR3600 From: Adrian Chadd To: Eugene Grosbein Cc: "freebsd-mips@freebsd.org" Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 30 Oct 2015 14:16:09 -0000 Hiya, Would you mind testing out this patch? I want to see if this makes any difference. :-) Thanks! adrian@victoria:~/work/freebsd/head-embedded/src/sys/mips/atheros % svn diff if_argevar.h Index: if_argevar.h =================================================================== --- if_argevar.h (revision 290090) +++ if_argevar.h (working copy) @@ -101,11 +101,16 @@ #define ARGE_DESC_MORE (1 << 24) #define ARGE_DESC_SIZE_MASK ((1 << 12) - 1) #define ARGE_DMASIZE(len) ((len) & ARGE_DESC_SIZE_MASK) + +/* + * Pad each descriptor out to a cache line (32 bytes.) + */ struct arge_desc { uint32_t packet_addr; uint32_t packet_ctrl; uint32_t next_desc; uint32_t padding; + uint32_t padding2[4]; }; struct arge_txdesc { -adrian From owner-freebsd-mips@freebsd.org Fri Oct 30 14:39:12 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E0E49A1EDDA for ; Fri, 30 Oct 2015 14:39:11 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: from mail-io0-x230.google.com (mail-io0-x230.google.com [IPv6:2607:f8b0:4001:c06::230]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id A27D5136E for ; Fri, 30 Oct 2015 14:39:11 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: by iofz202 with SMTP id z202so81564752iof.2 for ; Fri, 30 Oct 2015 07:39:11 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=VxrRtnHikBtWdaDI6LwrHtmErC/LufDF2Qfa3MUwe38=; b=CPmM8QARU6aRcZD4/yIK7E9Y/voGqAsg4JEflESaK+il1eE5eHI9yMX+mOagYpILZ+ ZmMmZveG8boQ6rar6sPXGUwtvavb83/hWpcYiyGwM5tb3as6PwnuQvzX3yTZKJ9MACZm yLyUpvO1vWE0pu9oPRxYzcyoUCt1kjVQqYIqlv4UmPixHlobIuhfjggL6MWdamBcneOP lTsq+UNWapVx1H5emu+BqW4oCKJEVlvVr20vUzSxvrjy82X6KftANYUgGv+UFH+ehXvo Fx35mQY3f2SjpNjYPXhyO9awIQNluJjPQweQe7SbcGyg12dZ4/9DSL021EpAE2ORy8As ePWA== MIME-Version: 1.0 X-Received: by 10.107.46.142 with SMTP id u14mr9803913iou.165.1446215951073; Fri, 30 Oct 2015 07:39:11 -0700 (PDT) Received: by 10.36.46.66 with HTTP; Fri, 30 Oct 2015 07:39:10 -0700 (PDT) In-Reply-To: References: <562CBEC3.8030308@rdtc.ru> <562E3027.4020806@grosbein.net> <562F75E2.9000505@grosbein.net> <5630E844.2080807@grosbein.net> <56321ED9.4050602@grosbein.net> <56323496.609@grosbein.net> <56325769.8070202@grosbein.net> <56328C54.1050709@grosbein.net> <56328DB1.9010105@grosbein.net> Date: Fri, 30 Oct 2015 07:39:10 -0700 Message-ID: Subject: Re: arge1 on TL WDR3600 From: Adrian Chadd To: Eugene Grosbein Cc: "freebsd-mips@freebsd.org" Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 30 Oct 2015 14:39:12 -0000 And also try this: adrian@victoria:~/work/freebsd/head-embedded/src/sys/mips/mips % svn diff . Index: busdma_machdep.c =================================================================== --- busdma_machdep.c (revision 290082) +++ busdma_machdep.c (working copy) @@ -66,6 +66,9 @@ #define BUS_DMA_COULD_BOUNCE BUS_DMA_BUS3 #define BUS_DMA_MIN_ALLOC_COMP BUS_DMA_BUS4 +/* XXX */ +#define SYNC __asm volatile("sync") + struct bounce_zone; struct bus_dma_tag { @@ -1220,11 +1223,16 @@ if (STAILQ_FIRST(&map->bpages)) _bus_dmamap_sync_bp(dmat, map, op); - if (dmat->flags & BUS_DMA_COHERENT) + /* XXX ? */ + if (dmat->flags & BUS_DMA_COHERENT) { + SYNC; return; + } - if (map->flags & DMAMAP_UNCACHEABLE) + if (map->flags & DMAMAP_UNCACHEABLE) { + SYNC; return; + } aligned = (map->flags & DMAMAP_CACHE_ALIGNED) ? 1 : 0; .. I /think/ we also need to be doing SYNC operations on uncachable memory. Thanks, -a From owner-freebsd-mips@freebsd.org Fri Oct 30 19:36:57 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3AB6CA1FED4 for ; Fri, 30 Oct 2015 19:36:57 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from hz.grosbein.net (hz.grosbein.net [78.47.246.247]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 9D4161287 for ; Fri, 30 Oct 2015 19:36:55 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from eg.sd.rdtc.ru (root@eg.sd.rdtc.ru [62.231.161.221]) by hz.grosbein.net (8.14.9/8.14.9) with ESMTP id t9UJERZt046917 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT); Fri, 30 Oct 2015 20:14:28 +0100 (CET) (envelope-from eugen@grosbein.net) X-Envelope-From: eugen@grosbein.net X-Envelope-To: adrian.chadd@gmail.com Received: from eg.sd.rdtc.ru (eugen@localhost [127.0.0.1]) by eg.sd.rdtc.ru (8.15.2/8.15.2) with ESMTP id t9UJEKl5042978; Sat, 31 Oct 2015 02:14:20 +0700 (KRAT) (envelope-from eugen@grosbein.net) Subject: Re: arge1 on TL WDR3600 To: Adrian Chadd References: <562CBEC3.8030308@rdtc.ru> <5630E844.2080807@grosbein.net> <56321ED9.4050602@grosbein.net> <56323496.609@grosbein.net> <56325769.8070202@grosbein.net> <56328C54.1050709@grosbein.net> <56328DB1.9010105@grosbein.net> Cc: "freebsd-mips@freebsd.org" From: Eugene Grosbein X-Enigmail-Draft-Status: N1110 Message-ID: <5633C18C.2030006@grosbein.net> Date: Sat, 31 Oct 2015 02:14:20 +0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.2.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=0.3 required=5.0 tests=BAYES_00,LOCAL_FROM, T_DATE_IN_FUTURE_96_Q autolearn=no version=3.3.2 X-Spam-Report: * 0.0 T_DATE_IN_FUTURE_96_Q Date: is 4 days to 4 months after Received: * date * -2.3 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 2.6 LOCAL_FROM From my domains X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on hz.grosbein.net X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 30 Oct 2015 19:36:57 -0000 On 30.10.2015 21:39, Adrian Chadd wrote: > And also try this: I've updated source tree back to recent head (r290200) and tried both patches: only first patch (for if_argevar.h) - problem persists, interrupt storm occurs. Then, backed out first patch and applied second (for busdma_machdep.c) - problem persists. And with both patches applied, the problem persists too. From owner-freebsd-mips@freebsd.org Sat Oct 31 00:12:00 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 41109A22901 for ; Sat, 31 Oct 2015 00:12:00 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: from mail-io0-x231.google.com (mail-io0-x231.google.com [IPv6:2607:f8b0:4001:c06::231]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 0A99F1CAB for ; Sat, 31 Oct 2015 00:12:00 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: by iody8 with SMTP id y8so95742846iod.1 for ; Fri, 30 Oct 2015 17:11:59 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=FInn45JOtZZJ60hInfa+1Pd3QAaCKMBHNpl6ihDTLUE=; b=LmeIArD0zu0P3NRpdhT+3aGujsoj1UHKI47O8xl6KV6VKkMm45qdybBFYNayzqqKTl Fjt4Srx+53KsZax2EJC78DgEHej2k/PELHs3Si7Z5HjS51K3vlRT00dhF9h/yj6HfDDC pX64m4o8zEjpJQI/cGHCTzGQr8gaPjmcKWhpPUAuBzcSMLLUMGJPHqzYSsbV6J/80Ags B6FTWUpABlyjl9kQDf8Iw6nZsd1X6B+n6H5Rg1WCHm92Jmz51lfT9TgubUYQCHrNQx9h kK3Xz2/1+GiDomHsGs8EaUf7PSFIDBaxwkJ/bfAXMbZPowKxkBDZX0Vke7o0NEjhJv/q bz/w== MIME-Version: 1.0 X-Received: by 10.107.3.72 with SMTP id 69mr12524324iod.75.1446250319324; Fri, 30 Oct 2015 17:11:59 -0700 (PDT) Received: by 10.36.46.66 with HTTP; Fri, 30 Oct 2015 17:11:59 -0700 (PDT) In-Reply-To: <5633C18C.2030006@grosbein.net> References: <562CBEC3.8030308@rdtc.ru> <5630E844.2080807@grosbein.net> <56321ED9.4050602@grosbein.net> <56323496.609@grosbein.net> <56325769.8070202@grosbein.net> <56328C54.1050709@grosbein.net> <56328DB1.9010105@grosbein.net> <5633C18C.2030006@grosbein.net> Date: Fri, 30 Oct 2015 17:11:59 -0700 Message-ID: Subject: Re: arge1 on TL WDR3600 From: Adrian Chadd To: Eugene Grosbein Cc: "freebsd-mips@freebsd.org" Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 31 Oct 2015 00:12:00 -0000 Hi, can you svn update and retry? The latest changes I made to the mips74k support has routing up to 330mbit and bridging up to 720mbit for me; up from 120mbit when I started. I also hit your issue a couple of times before I fixed some things and now it doesn't occur. Would you mind giving it a whirl and reporting back? You'll have to do a clean kernel build as I went and changed some mips .h stuff. Thanks! -a From owner-freebsd-mips@freebsd.org Sat Oct 31 07:41:28 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 400BBA226E6 for ; Sat, 31 Oct 2015 07:41:28 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from hz.grosbein.net (hz.grosbein.net [78.47.246.247]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id A01D01271 for ; Sat, 31 Oct 2015 07:41:26 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from eg.sd.rdtc.ru (root@eg.sd.rdtc.ru [62.231.161.221]) by hz.grosbein.net (8.14.9/8.14.9) with ESMTP id t9V7fE2E049580 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT); Sat, 31 Oct 2015 08:41:15 +0100 (CET) (envelope-from eugen@grosbein.net) X-Envelope-From: eugen@grosbein.net X-Envelope-To: adrian.chadd@gmail.com Received: from eg.sd.rdtc.ru (eugen@localhost [127.0.0.1]) by eg.sd.rdtc.ru (8.15.2/8.15.2) with ESMTP id t9V7f4d3046891; Sat, 31 Oct 2015 14:41:05 +0700 (KRAT) (envelope-from eugen@grosbein.net) Subject: SOLVED: interrup storm (Re: arge1 on TL WDR3600) To: Adrian Chadd References: <562CBEC3.8030308@rdtc.ru> <5630E844.2080807@grosbein.net> <56321ED9.4050602@grosbein.net> <56323496.609@grosbein.net> <56325769.8070202@grosbein.net> <56328C54.1050709@grosbein.net> <56328DB1.9010105@grosbein.net> <5633C18C.2030006@grosbein.net> Cc: "freebsd-mips@freebsd.org" From: Eugene Grosbein Message-ID: <56347090.6030301@grosbein.net> Date: Sat, 31 Oct 2015 14:41:04 +0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.2.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=0.3 required=5.0 tests=BAYES_00,LOCAL_FROM autolearn=no version=3.3.2 X-Spam-Report: * -2.3 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 2.6 LOCAL_FROM From my domains X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on hz.grosbein.net X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 31 Oct 2015 07:41:28 -0000 On 31.10.2015 07:11, Adrian Chadd wrote: > Hi, > > can you svn update and retry? > > The latest changes I made to the mips74k support has routing up to > 330mbit and bridging up to 720mbit for me; up from 120mbit when I > started. I also hit your issue a couple of times before I fixed some > things and now it doesn't occur. > > Would you mind giving it a whirl and reporting back? You'll have to do > a clean kernel build as I went and changed some mips .h stuff. I've updated source tree to r290224 and no additional patches, did clean rebuild and repeated my test 3 times. No interrupt storms now, it works just fine. Average routing speed is slightly above 16MBytes/s and peak speed is 22,714 MB/s according to systat -ifstat. Thank you very much! I will take some PMC tests as next step. From owner-freebsd-mips@freebsd.org Sat Oct 31 08:48:56 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 52BD9A21560 for ; Sat, 31 Oct 2015 08:48:56 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from hz.grosbein.net (hz.grosbein.net [78.47.246.247]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id D640518C2 for ; Sat, 31 Oct 2015 08:48:55 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from eg.sd.rdtc.ru (root@eg.sd.rdtc.ru [62.231.161.221]) by hz.grosbein.net (8.14.9/8.14.9) with ESMTP id t9V8mi36049758 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT) for ; Sat, 31 Oct 2015 09:48:46 +0100 (CET) (envelope-from eugen@grosbein.net) X-Envelope-From: eugen@grosbein.net X-Envelope-To: Received: from eg.sd.rdtc.ru (eugen@localhost [127.0.0.1]) by eg.sd.rdtc.ru (8.15.2/8.15.2) with ESMTP id t9V8mZBl047514 for ; Sat, 31 Oct 2015 15:48:36 +0700 (KRAT) (envelope-from eugen@grosbein.net) To: freebsd-mips@freebsd.org From: Eugene Grosbein Subject: CPU underload Message-ID: <56348063.3090508@grosbein.net> Date: Sat, 31 Oct 2015 15:48:35 +0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.2.0 MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=0.3 required=5.0 tests=BAYES_00,LOCAL_FROM autolearn=no version=3.3.2 X-Spam-Report: * -2.3 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 2.6 LOCAL_FROM From my domains X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on hz.grosbein.net X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 31 Oct 2015 08:48:56 -0000 Hi! I'm trying to get familiar with PMC and uncover reason of MIPS32 CPU being underloaded - about 50% - while performing traffic forwarding. It seems, kernel code abuses DELAY function as "pmcstat -S instructions -T" shows: %SAMP IMAGE FUNCTION CALLERS 6.3 kernel spinlock_exit 5.3 kernel ip_fastforward 4.4 kernel memcpy 4.2 kernel _libmd_SHA256_Transf 3.3 kernel _bus_dmamap_load_buf 3.3 kernel DELAY 3.3 kernel arge_start_locked 3.1 kernel bzero 3.0 kernel arge_intr 2.8 kernel _bus_dmamap_sync 2.8 kernel ether_nh_input 2.6 kernel ether_output 2.5 kernel if_inc_counter 2.3 kernel critical_enter 2.2 kernel bus_dmamap_sync_buf 2.0 kernel critical_exit 1.8 kernel _rw_runlock_cookie 1.7 kernel __rw_rlock 1.6 kernel rn_match 1.5 kernel mipsNN_pdcache_inv_r 1.5 kernel _rm_rlock 1.4 kernel _bus_dmamap_load_mbu 1.4 kernel m_adj 1.3 kernel arge_newbuf 1.3 kernel mipsNN_pdcache_wb_ra 1.3 kernel bcmp 1.2 kernel _bus_dmamap_unload 1.2 kernel uma_zfree_arg 1.2 libpmc.so. pmclog_read 1.2 kernel if_transmit 1.1 kernel arpresolve 1.1 kernel arge_start 1.0 kernel netisr_dispatch_src 1.0 kernel ether_demux 0.9 kernel _rm_runlock 0.9 kernel uma_zalloc_arg 0.9 kernel generic_bs_barrier CONVERSION STATISTICS:input #samples/total 75152 #samples/unknown-function 2180 And why so heavy usage of _libmd_SHA256_Transf ? From owner-freebsd-mips@freebsd.org Sat Oct 31 08:56:34 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 079FCA21769 for ; Sat, 31 Oct 2015 08:56:34 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from hz.grosbein.net (hz.grosbein.net [78.47.246.247]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 77F651BF3 for ; Sat, 31 Oct 2015 08:56:33 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from eg.sd.rdtc.ru (root@eg.sd.rdtc.ru [62.231.161.221]) by hz.grosbein.net (8.14.9/8.14.9) with ESMTP id t9V8uSTY049786 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT) for ; Sat, 31 Oct 2015 09:56:29 +0100 (CET) (envelope-from eugen@grosbein.net) X-Envelope-From: eugen@grosbein.net X-Envelope-To: Received: from eg.sd.rdtc.ru (eugen@localhost [127.0.0.1]) by eg.sd.rdtc.ru (8.15.2/8.15.2) with ESMTP id t9V8uP3e047549 for ; Sat, 31 Oct 2015 15:56:25 +0700 (KRAT) (envelope-from eugen@grosbein.net) Subject: Re: CPU underload To: freebsd-mips@freebsd.org References: <56348063.3090508@grosbein.net> From: Eugene Grosbein Message-ID: <56348239.3050701@grosbein.net> Date: Sat, 31 Oct 2015 15:56:25 +0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.2.0 MIME-Version: 1.0 In-Reply-To: <56348063.3090508@grosbein.net> Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=0.3 required=5.0 tests=BAYES_00,LOCAL_FROM, T_DATE_IN_FUTURE_96_Q autolearn=no version=3.3.2 X-Spam-Report: * 0.0 T_DATE_IN_FUTURE_96_Q Date: is 4 days to 4 months after Received: * date * -2.3 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 2.6 LOCAL_FROM From my domains X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on hz.grosbein.net X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 31 Oct 2015 08:56:34 -0000 On 31.10.2015 15:48, Eugene Grosbein wrote: > Hi! > > I'm trying to get familiar with PMC and uncover reason of MIPS32 > CPU being underloaded - about 50% - while performing traffic forwarding. > > It seems, kernel code abuses DELAY function as "pmcstat -S instructions -T" shows: [skip] > And why so heavy usage of _libmd_SHA256_Transf ? Well, it seems to be kern.random.harvest is guity for SHA256 abuse. I've set sysctl kern.random.harvest.mask=0 and now it' gone: PMC: [INSTR_EXECUTED] Samples: 7490 (100.0%) , 0 unresolved %SAMP IMAGE FUNCTION CALLERS 4.6 kernel ip_fastforward 4.5 kernel memcpy 4.4 kernel DELAY 3.9 kernel arge_start_locked 3.8 kernel _bus_dmamap_load_buf 3.2 kernel ether_nh_input 3.1 kernel if_inc_counter 3.0 kernel arge_intr 3.0 kernel ether_output 2.9 kernel _bus_dmamap_sync 2.6 kernel bzero 2.6 kernel critical_enter 2.4 kernel critical_exit 2.3 kernel bus_dmamap_sync_buf 2.2 kernel _rw_runlock_cookie 2.1 kernel rn_match 1.9 kernel __rw_rlock 1.7 kernel netisr_dispatch_src 1.5 kernel spinlock_exit 1.5 kernel uma_zalloc_arg 1.5 kernel generic_bs_barrier 1.4 kernel _bus_dmamap_load_mbu 1.4 kernel arge_newbuf 1.4 kernel _rm_rlock 1.4 kernel m_adj 1.4 libpmc.so. pmclog_read 1.4 kernel mipsNN_pdcache_wb_ra 1.4 kernel arpresolve 1.3 kernel bcmp 1.3 kernel ether_demux 1.3 kernel mipsNN_pdcache_inv_r 1.3 kernel _bus_dmamap_unload 1.2 kernel uma_zfree_arg 1.2 kernel if_transmit 1.2 kernel bus_dmamap_load_mbuf 1.1 kernel _rm_runlock 1.0 kernel rtfree CONVERSION STATISTICS:oc1_fib #exec/elf 1 #samples/total 102761 #samples/unknown-function 2939 #callchain/dubious-frames 23 Still too many of DELAYs. From owner-freebsd-mips@freebsd.org Sat Oct 31 12:52:18 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0B001A2145A for ; Sat, 31 Oct 2015 12:52:18 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: from mail-ig0-x22e.google.com (mail-ig0-x22e.google.com [IPv6:2607:f8b0:4001:c05::22e]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id CC3511C8C for ; Sat, 31 Oct 2015 12:52:17 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: by igpw7 with SMTP id w7so25643164igp.1 for ; Sat, 31 Oct 2015 05:52:17 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=NEqFZLH9l02T9cNKo5tfNqao8OvxdM1SPneljDAgumo=; b=NKCaVFXFIJM2f5joIxMxZWp0EJWv6laootPQFhLdFMbzpI+f5T7RblA6a759KjEWQ5 n/voGFD1T2nJENdpZeyHTXi0Lz8rY2NEUpJ499joNwtIfYw/TpDUBCW3UR52C7T3h3mG KXB/58OhA5cKkVHRLH6Xvf7afRG4uFD/7SMDF9CfFSvVBXAwqJWrWlBKzxrJ8OLbWHvJ vyhgn5NRidTeSTDir/PeDUNR7Gc5UjH83C/ERTWy8nzsJBEvBOflYlN+KR77t79duoVe paufwpIfvx70VMhTn7KnNQEnR/C37tUKmbXPcWsbRh/n7f1zhzgl2cf31mxDrP02OLRb B+4A== MIME-Version: 1.0 X-Received: by 10.50.155.41 with SMTP id vt9mr2899862igb.22.1446295937150; Sat, 31 Oct 2015 05:52:17 -0700 (PDT) Received: by 10.36.46.66 with HTTP; Sat, 31 Oct 2015 05:52:17 -0700 (PDT) In-Reply-To: <56348239.3050701@grosbein.net> References: <56348063.3090508@grosbein.net> <56348239.3050701@grosbein.net> Date: Sat, 31 Oct 2015 08:52:17 -0400 Message-ID: Subject: Re: CPU underload From: Adrian Chadd To: Eugene Grosbein Cc: "freebsd-mips@freebsd.org" Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 31 Oct 2015 12:52:18 -0000 hi, there's a mips callchain kernel option. Sorry, I'm on my mac atm so I can't tell you. look in sys/conf/options for callchain, callgraph, etc. It's a build option. Just rebuild your kernel with that and check. I haven't tried with fastforward. What else are you doing? pf? ipfw? -adrian On 31 October 2015 at 04:56, Eugene Grosbein wrote: > On 31.10.2015 15:48, Eugene Grosbein wrote: >> Hi! >> >> I'm trying to get familiar with PMC and uncover reason of MIPS32 >> CPU being underloaded - about 50% - while performing traffic forwarding. >> >> It seems, kernel code abuses DELAY function as "pmcstat -S instructions -T" shows: > > [skip] > >> And why so heavy usage of _libmd_SHA256_Transf ? > > Well, it seems to be kern.random.harvest is guity for SHA256 abuse. > I've set sysctl kern.random.harvest.mask=0 and now it' gone: > > PMC: [INSTR_EXECUTED] Samples: 7490 (100.0%) , 0 unresolved > > %SAMP IMAGE FUNCTION CALLERS > 4.6 kernel ip_fastforward > 4.5 kernel memcpy > 4.4 kernel DELAY > 3.9 kernel arge_start_locked > 3.8 kernel _bus_dmamap_load_buf > 3.2 kernel ether_nh_input > 3.1 kernel if_inc_counter > 3.0 kernel arge_intr > 3.0 kernel ether_output > 2.9 kernel _bus_dmamap_sync > 2.6 kernel bzero > 2.6 kernel critical_enter > 2.4 kernel critical_exit > 2.3 kernel bus_dmamap_sync_buf > 2.2 kernel _rw_runlock_cookie > 2.1 kernel rn_match > 1.9 kernel __rw_rlock > 1.7 kernel netisr_dispatch_src > 1.5 kernel spinlock_exit > 1.5 kernel uma_zalloc_arg > 1.5 kernel generic_bs_barrier > 1.4 kernel _bus_dmamap_load_mbu > 1.4 kernel arge_newbuf > 1.4 kernel _rm_rlock > 1.4 kernel m_adj > 1.4 libpmc.so. pmclog_read > 1.4 kernel mipsNN_pdcache_wb_ra > 1.4 kernel arpresolve > 1.3 kernel bcmp > 1.3 kernel ether_demux > 1.3 kernel mipsNN_pdcache_inv_r > 1.3 kernel _bus_dmamap_unload > 1.2 kernel uma_zfree_arg > 1.2 kernel if_transmit > 1.2 kernel bus_dmamap_load_mbuf > 1.1 kernel _rm_runlock > 1.0 kernel rtfree > CONVERSION STATISTICS:oc1_fib > #exec/elf 1 > #samples/total 102761 > #samples/unknown-function 2939 > #callchain/dubious-frames 23 > > Still too many of DELAYs. > > _______________________________________________ > freebsd-mips@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-mips > To unsubscribe, send any mail to "freebsd-mips-unsubscribe@freebsd.org" From owner-freebsd-mips@freebsd.org Sat Oct 31 12:53:53 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2252AA214C1 for ; Sat, 31 Oct 2015 12:53:53 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: from mail-io0-x229.google.com (mail-io0-x229.google.com [IPv6:2607:f8b0:4001:c06::229]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id D869D1CF2 for ; Sat, 31 Oct 2015 12:53:52 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: by ioll68 with SMTP id l68so105941735iol.3 for ; Sat, 31 Oct 2015 05:53:52 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=KISndXJWSR2tGB9Wm+o4bUZdF/5NGSAF8JoHFQyjqd0=; b=B4agXwEPLoWgCXtTqXYK/BEhPNaOk7/JQywg8SyW7pGJw9A1wLzq9hLTIpvas4ixbU 5YiUAc6OvFclNXnk7rmVZutptjyD1rPmOhG+m0DwgBYFvwoIo/QpXMiSDzyCNewX4BiR qYFK+Hlf/BlxgoEW/nedzxtVK8yYeBQ6e3aRiHZSXLKuKMWJX55N2UYZ4n1IK63DkqE5 PeDgBDvh1PAiWoGxEQMvCS8SEftne1I50QFPdKd8g87MDW0NcWksFURQRBVHJvQVkjsQ Lk8ItcsISMQhijAq0sik17eeRoWVyQlWyaIyrda6gthaddsjAIwsuRtRbSQJ+VK+iHbS wzaw== MIME-Version: 1.0 X-Received: by 10.107.46.142 with SMTP id u14mr14382565iou.165.1446296032212; Sat, 31 Oct 2015 05:53:52 -0700 (PDT) Received: by 10.36.46.66 with HTTP; Sat, 31 Oct 2015 05:53:52 -0700 (PDT) In-Reply-To: <56347090.6030301@grosbein.net> References: <562CBEC3.8030308@rdtc.ru> <5630E844.2080807@grosbein.net> <56321ED9.4050602@grosbein.net> <56323496.609@grosbein.net> <56325769.8070202@grosbein.net> <56328C54.1050709@grosbein.net> <56328DB1.9010105@grosbein.net> <5633C18C.2030006@grosbein.net> <56347090.6030301@grosbein.net> Date: Sat, 31 Oct 2015 08:53:52 -0400 Message-ID: Subject: Re: SOLVED: interrup storm (Re: arge1 on TL WDR3600) From: Adrian Chadd To: Eugene Grosbein Cc: "freebsd-mips@freebsd.org" Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 31 Oct 2015 12:53:53 -0000 On 31 October 2015 at 03:41, Eugene Grosbein wrote: > On 31.10.2015 07:11, Adrian Chadd wrote: >> Hi, >> >> can you svn update and retry? >> >> The latest changes I made to the mips74k support has routing up to >> 330mbit and bridging up to 720mbit for me; up from 120mbit when I >> started. I also hit your issue a couple of times before I fixed some >> things and now it doesn't occur. >> >> Would you mind giving it a whirl and reporting back? You'll have to do >> a clean kernel build as I went and changed some mips .h stuff. > > I've updated source tree to r290224 and no additional patches, > did clean rebuild and repeated my test 3 times. No interrupt storms now, > it works just fine. Average routing speed is slightly above 16MBytes/s > and peak speed is 22,714 MB/s according to systat -ifstat. > > Thank you very much! > > I will take some PMC tests as next step. Yay! I'm so glad that I both figured out how to make this a heck of a lot faster and fix your bugs at the same time. Going from 120mbit to 720mbit in straight bridging tests is pretty amazing. I'll go see what I can find out about the forwarding performance. Hopefully there are some more low hanging fruit that I can address to increase performance a bit. -adrian From owner-freebsd-mips@freebsd.org Sat Oct 31 13:12:12 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A9BA4A21941 for ; Sat, 31 Oct 2015 13:12:12 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from hz.grosbein.net (hz.grosbein.net [78.47.246.247]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 40993139F for ; Sat, 31 Oct 2015 13:12:11 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from eg.sd.rdtc.ru (root@eg.sd.rdtc.ru [62.231.161.221]) by hz.grosbein.net (8.14.9/8.14.9) with ESMTP id t9VDBwna050424 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT); Sat, 31 Oct 2015 14:11:59 +0100 (CET) (envelope-from eugen@grosbein.net) X-Envelope-From: eugen@grosbein.net X-Envelope-To: adrian.chadd@gmail.com Received: from eg.sd.rdtc.ru (eugen@localhost [127.0.0.1]) by eg.sd.rdtc.ru (8.15.2/8.15.2) with ESMTP id t9VDBn2M048972; Sat, 31 Oct 2015 20:11:50 +0700 (KRAT) (envelope-from eugen@grosbein.net) Subject: Re: CPU underload To: Adrian Chadd References: <56348063.3090508@grosbein.net> <56348239.3050701@grosbein.net> Cc: "freebsd-mips@freebsd.org" From: Eugene Grosbein Message-ID: <5634BE15.8010204@grosbein.net> Date: Sat, 31 Oct 2015 20:11:49 +0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.2.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=0.3 required=5.0 tests=BAYES_00,LOCAL_FROM autolearn=no version=3.3.2 X-Spam-Report: * -2.3 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 2.6 LOCAL_FROM From my domains X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on hz.grosbein.net X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 31 Oct 2015 13:12:12 -0000 On 31.10.2015 19:52, Adrian Chadd wrote: > hi, > > there's a mips callchain kernel option. Sorry, I'm on my mac atm so I > can't tell you. look in sys/conf/options for callchain, callgraph, > etc. It's a build option. Perhaps, options HWPMC_MIPS_BACKTRACE ? > > Just rebuild your kernel with that and check. How do I use utilize this option? > I haven't tried with fastforward. What else are you doing? pf? ipfw? No packet filters compiled nor loaded. Plain (fast)forwarding. No NAT yet. From owner-freebsd-mips@freebsd.org Sat Oct 31 13:42:52 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 14567A2209B for ; Sat, 31 Oct 2015 13:42:52 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from hz.grosbein.net (hz.grosbein.net [78.47.246.247]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id B46421F6B for ; Sat, 31 Oct 2015 13:42:51 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from eg.sd.rdtc.ru (root@eg.sd.rdtc.ru [62.231.161.221]) by hz.grosbein.net (8.14.9/8.14.9) with ESMTP id t9VDgkhV050487 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT); Sat, 31 Oct 2015 14:42:46 +0100 (CET) (envelope-from eugen@grosbein.net) X-Envelope-From: eugen@grosbein.net X-Envelope-To: adrian.chadd@gmail.com Received: from eg.sd.rdtc.ru (eugen@localhost [127.0.0.1]) by eg.sd.rdtc.ru (8.15.2/8.15.2) with ESMTP id t9VDggTp049121; Sat, 31 Oct 2015 20:42:42 +0700 (KRAT) (envelope-from eugen@grosbein.net) Subject: Re: CPU underload To: Adrian Chadd References: <56348063.3090508@grosbein.net> <56348239.3050701@grosbein.net> Cc: "freebsd-mips@freebsd.org" From: Eugene Grosbein Message-ID: <5634C552.8040201@grosbein.net> Date: Sat, 31 Oct 2015 20:42:42 +0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.2.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=0.3 required=5.0 tests=BAYES_00,LOCAL_FROM, T_DATE_IN_FUTURE_96_Q autolearn=no version=3.3.2 X-Spam-Report: * 0.0 T_DATE_IN_FUTURE_96_Q Date: is 4 days to 4 months after Received: * date * -2.3 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 2.6 LOCAL_FROM From my domains X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on hz.grosbein.net X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 31 Oct 2015 13:42:52 -0000 On 31.10.2015 19:52, Adrian Chadd wrote: > hi, > > there's a mips callchain kernel option. Sorry, I'm on my mac atm so I > can't tell you. look in sys/conf/options for callchain, callgraph, > etc. It's a build option. > > Just rebuild your kernel with that and check. Oh, I got it. But it does not help, empty "CALLERS" list for DELAY: %SAMP IMAGE FUNCTION CALLERS PMC: [INSTR_EXECUTED] Samples: 8875 (100.0%) , 0 unresolved %SAMP IMAGE FUNCTION CALLERS 9.9 kernel MipsUserIntr 4.4 kernel DELAY 4.2 kernel ip_fastforward ether_demux 3.7 kernel memcpy 3.1 kernel _bus_dmamap_sync arge_start_locked:1.4 arge_rx_locked:0.9 arge_newbuf:0.5 2.9 kernel _bus_dmamap_load_buf _bus_dmamap_load_mbuf_sg 2.9 kernel ether_nh_input netisr_dispatch_src 2.8 kernel if_inc_counter ether_nh_input:0.6 arge_tx_locked:0.5 2.5 libc.so.7 bsearch pmcstat_symbol_search 2.5 kernel ether_output ip_fastforward 2.4 kernel bzero 2.3 kernel arge_start_locked arge_start:1.8 arge_intr:0.5 2.2 kernel critical_enter 1.9 kernel critical_exit if_inc_counter 1.7 kernel _rw_runlock_cookie arpresolve 1.6 kernel rn_match rtalloc1_fib 1.6 kernel __rw_rlock in_lltable_lookup:0.5 arpresolve:0.5 1.4 kernel mips_wait cpu_idle 1.4 kernel mipsNN_pdcache_inv_r 1.4 kernel _rm_rlock in_localip:0.8 vlan_input:0.5 1.4 libpmc.so. pmclog_read pmcstat_process_log 1.3 kernel arge_tx_locked arge_intr 1.3 kernel _bus_dmamap_unload arge_tx_locked:0.8 arge_newbuf:0.5 1.3 kernel bus_dmamap_sync_buf 1.3 kernel mipsNN_pdcache_wb_ra 1.2 kernel generic_bs_barrier 1.1 kernel _bus_dmamap_load_mbu bus_dmamap_load_mbuf_sg 1.1 kernel if_transmit ether_output_frame 1.1 kernel m_adj 1.1 kernel netisr_dispatch_src netisr_dispatch 1.1 kernel bcmp 1.1 kernel spinlock_exit ithread_loop 1.1 kernel bus_dmamap_load_mbuf arge_start_locked:0.6 arge_newbuf:0.5 1.1 kernel arge_newbuf arge_rx_locked 1.0 kernel arge_rx_locked arge_intr 1.0 kernel ether_demux ether_nh_input 1.0 kernel uma_zalloc_arg arge_newbuf 0.9 kernel uma_zfree_arg mb_free_ext CONVERSION STATISTICS:e ip_fastforward #samples/total 34618 #samples/unknown-function 2202 From owner-freebsd-mips@freebsd.org Sat Oct 31 17:57:34 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3EF4FA21FDF for ; Sat, 31 Oct 2015 17:57:34 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from hz.grosbein.net (hz.grosbein.net [78.47.246.247]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id D48C01DE1 for ; Sat, 31 Oct 2015 17:57:32 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from eg.sd.rdtc.ru (root@eg.sd.rdtc.ru [62.231.161.221]) by hz.grosbein.net (8.14.9/8.14.9) with ESMTP id t9VHvLfx051164 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT); Sat, 31 Oct 2015 18:57:22 +0100 (CET) (envelope-from eugen@grosbein.net) X-Envelope-From: eugen@grosbein.net X-Envelope-To: adrian.chadd@gmail.com Received: from eg.sd.rdtc.ru (eugen@localhost [127.0.0.1]) by eg.sd.rdtc.ru (8.15.2/8.15.2) with ESMTP id t9VHvGXM051206; Sun, 1 Nov 2015 00:57:16 +0700 (KRAT) (envelope-from eugen@grosbein.net) Subject: Re: CPU underload To: Adrian Chadd References: <56348063.3090508@grosbein.net> <56348239.3050701@grosbein.net> Cc: "freebsd-mips@freebsd.org" From: Eugene Grosbein X-Enigmail-Draft-Status: N1110 Message-ID: <563500FC.8020201@grosbein.net> Date: Sun, 1 Nov 2015 00:57:16 +0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.2.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=0.3 required=5.0 tests=BAYES_00,LOCAL_FROM, T_DATE_IN_FUTURE_96_Q autolearn=no version=3.3.2 X-Spam-Report: * 0.0 T_DATE_IN_FUTURE_96_Q Date: is 4 days to 4 months after Received: * date * -2.3 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 2.6 LOCAL_FROM From my domains X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on hz.grosbein.net X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 31 Oct 2015 17:57:34 -0000 On 31.10.2015 19:52, Adrian Chadd wrote: > hi, > > there's a mips callchain kernel option. Sorry, I'm on my mac atm so I > can't tell you. look in sys/conf/options for callchain, callgraph, > etc. It's a build option. > > Just rebuild your kernel with that and check. Please tell me how do you test bridging performance. I've tried to test inter-vlan bridging using FTP transit traffic and it is still not very fast, although a bit faster than forwarding: 37MByte/s according to systat -ifstat. The system still has half of CPU cycles idle and "if_inc_counter" has surprisingly high counters: PMC: [INSTR_EXECUTED] Samples: 5181 (100.0%) , 447 unresolved %SAMP IMAGE FUNCTION CALLERS 9.1 kernel MipsUserIntr 7.6 kernel if_inc_counter vlan_transmit:1.8 ether_nh_input:1.1 arge_tx_locked:0.6 if_transmit:0.5 5.2 kernel DELAY 4.2 kernel ether_nh_input netisr_dispatch_src 4.1 kernel _bus_dmamap_load_buf _bus_dmamap_load_mbuf_sg 3.9 kernel arge_start_locked arge_start 3.4 kernel _bus_dmamap_sync arge_start_locked:1.2 arge_newbuf:0.9 arge_rx_locked:0.8 3.1 kernel memcpy 2.8 kernel critical_exit if_inc_counter 2.5 kernel critical_enter 2.0 kernel arge_newbuf arge_rx_locked 2.0 kernel bus_dmamap_sync_buf 1.8 kernel netisr_dispatch_src netisr_dispatch 1.8 kernel _bus_dmamap_load_mbu bus_dmamap_load_mbuf_sg 1.7 kernel vlan_transmit 1.6 kernel bus_dmamap_load_mbuf arge_newbuf:1.0 arge_start_locked:0.6 1.5 kernel arge_rx_locked arge_intr 1.5 kernel mipsNN_pdcache_inv_r 1.5 kernel generic_bs_barrier 1.5 kernel _bus_dmamap_unload arge_tx_locked:0.8 arge_newbuf:0.7 1.5 kernel arge_tx_locked arge_intr 1.4 kernel bzero 1.4 kernel mb_ctor_pack uma_zalloc_arg 1.4 libc.so.7 bsearch pmcstat_symbol_search 1.4 kernel if_transmit vlan_transmit 1.3 kernel memcmp 1.2 libpmc.so. pmclog_read pmcstat_process_log 1.2 kernel vlan_input ether_demux 1.2 kernel mipsNN_pdcache_wb_ra 1.2 kernel arge_start if_start 1.2 kernel m_adj arge_newbuf 1.1 kernel _rm_rlock vlan_input 1.0 kernel uma_zalloc_arg arge_newbuf 0.9 kernel trap MipsUserGenException 0.9 kernel ar934x_chip_ddr_flus arge_flush_ddr 0.9 kernel _bus_dmamap_addseg 0.8 kernel uma_zfree_arg mb_free_ext 0.8 kernel m_freem arge_tx_locked CONVERSION STATISTICS:unlock vlan_input #samples/total 179577 #samples/unknown-function 5253 #callchain/dubious-frames 17747 From owner-freebsd-mips@freebsd.org Sat Oct 31 18:11:35 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C7FEBA1B225 for ; Sat, 31 Oct 2015 18:11:35 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: from mail-ig0-x229.google.com (mail-ig0-x229.google.com [IPv6:2607:f8b0:4001:c05::229]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 905D814E1 for ; Sat, 31 Oct 2015 18:11:35 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: by igdg1 with SMTP id g1so32500395igd.1 for ; Sat, 31 Oct 2015 11:11:34 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=FVv7odk/RcnvW5MtbE06G7P/gUlep3xKRO5NE4tLjqg=; b=tiKmV1nfvTt+gwowiE3ItXBQkX8xQ70slY/q151HnYEKSHeuq+0b/RT6bqrgdWUEcr Uyeqg8skMN4NBnDPlBaABK/tXuMcvtKs/vZ1d6CVhsxiEZohumOSIV4wJ7I6/55AV2S/ 5HMaLm+trGArTRKXNKZ/D3T+IfbWGDy5r8i0HeajwNsT4ac+opAW3udfzlf/jplZs7Te iiQOdXG3hSH5P37R5HcN07ua4Q5B2bxgDlN9xuxiYE+vg3koBWOCK4MWkDwT/ZnnTnOl /pt6UkmymBfrcB9U0mCdmJPr7nM00Fftyn7m++helbcyddg+1k1SqMMhVCl5wTFlXqL+ O99w== MIME-Version: 1.0 X-Received: by 10.50.79.232 with SMTP id m8mr4062386igx.22.1446315094858; Sat, 31 Oct 2015 11:11:34 -0700 (PDT) Received: by 10.36.46.66 with HTTP; Sat, 31 Oct 2015 11:11:34 -0700 (PDT) In-Reply-To: <563500FC.8020201@grosbein.net> References: <56348063.3090508@grosbein.net> <56348239.3050701@grosbein.net> <563500FC.8020201@grosbein.net> Date: Sat, 31 Oct 2015 14:11:34 -0400 Message-ID: Subject: Re: CPU underload From: Adrian Chadd To: Eugene Grosbein Cc: "freebsd-mips@freebsd.org" Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 31 Oct 2015 18:11:35 -0000 Hi, I don't see any DELAY in my testing, nor MipsUserIntr, so yeah, I must be doing something different. I am testing on QCA9558, not AR9344 though. My AR9344 isn't with me atm. Just run 'top'; what's showing? Are there other processes running? Is devd doing something stupid? Does 'dmesg' show the switch ports flapping or something? My CPU is definitely pegged during these tests. Since yours isn't then yeah, something odd is going on. Can you post the output of 'vmstat 1' whilst you're running your tests? -adrian On 31 October 2015 at 13:57, Eugene Grosbein wrote: > On 31.10.2015 19:52, Adrian Chadd wrote: >> hi, >> >> there's a mips callchain kernel option. Sorry, I'm on my mac atm so I >> can't tell you. look in sys/conf/options for callchain, callgraph, >> etc. It's a build option. >> >> Just rebuild your kernel with that and check. > > Please tell me how do you test bridging performance. > I've tried to test inter-vlan bridging using FTP transit traffic > and it is still not very fast, although a bit faster than forwarding: > 37MByte/s according to systat -ifstat. > > The system still has half of CPU cycles idle and > "if_inc_counter" has surprisingly high counters: > > PMC: [INSTR_EXECUTED] Samples: 5181 (100.0%) , 447 unresolved > > %SAMP IMAGE FUNCTION CALLERS > 9.1 kernel MipsUserIntr > 7.6 kernel if_inc_counter vlan_transmit:1.8 ether_nh_input:1.1 arge_tx_locked:0.6 if_transmit:0.5 > 5.2 kernel DELAY > 4.2 kernel ether_nh_input netisr_dispatch_src > 4.1 kernel _bus_dmamap_load_buf _bus_dmamap_load_mbuf_sg > 3.9 kernel arge_start_locked arge_start > 3.4 kernel _bus_dmamap_sync arge_start_locked:1.2 arge_newbuf:0.9 arge_rx_locked:0.8 > 3.1 kernel memcpy > 2.8 kernel critical_exit if_inc_counter > 2.5 kernel critical_enter > 2.0 kernel arge_newbuf arge_rx_locked > 2.0 kernel bus_dmamap_sync_buf > 1.8 kernel netisr_dispatch_src netisr_dispatch > 1.8 kernel _bus_dmamap_load_mbu bus_dmamap_load_mbuf_sg > 1.7 kernel vlan_transmit > 1.6 kernel bus_dmamap_load_mbuf arge_newbuf:1.0 arge_start_locked:0.6 > 1.5 kernel arge_rx_locked arge_intr > 1.5 kernel mipsNN_pdcache_inv_r > 1.5 kernel generic_bs_barrier > 1.5 kernel _bus_dmamap_unload arge_tx_locked:0.8 arge_newbuf:0.7 > 1.5 kernel arge_tx_locked arge_intr > 1.4 kernel bzero > 1.4 kernel mb_ctor_pack uma_zalloc_arg > 1.4 libc.so.7 bsearch pmcstat_symbol_search > 1.4 kernel if_transmit vlan_transmit > 1.3 kernel memcmp > 1.2 libpmc.so. pmclog_read pmcstat_process_log > 1.2 kernel vlan_input ether_demux > 1.2 kernel mipsNN_pdcache_wb_ra > 1.2 kernel arge_start if_start > 1.2 kernel m_adj arge_newbuf > 1.1 kernel _rm_rlock vlan_input > 1.0 kernel uma_zalloc_arg arge_newbuf > 0.9 kernel trap MipsUserGenException > 0.9 kernel ar934x_chip_ddr_flus arge_flush_ddr > 0.9 kernel _bus_dmamap_addseg > 0.8 kernel uma_zfree_arg mb_free_ext > 0.8 kernel m_freem arge_tx_locked > CONVERSION STATISTICS:unlock vlan_input > #samples/total 179577 > #samples/unknown-function 5253 > #callchain/dubious-frames 17747 > From owner-freebsd-mips@freebsd.org Sat Oct 31 18:27:52 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 37AE6A1B4CA for ; Sat, 31 Oct 2015 18:27:52 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from hz.grosbein.net (hz.grosbein.net [78.47.246.247]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 613981A29 for ; Sat, 31 Oct 2015 18:27:50 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from eg.sd.rdtc.ru (root@eg.sd.rdtc.ru [62.231.161.221]) by hz.grosbein.net (8.14.9/8.14.9) with ESMTP id t9VIRgYh051242 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT); Sat, 31 Oct 2015 19:27:42 +0100 (CET) (envelope-from eugen@grosbein.net) X-Envelope-From: eugen@grosbein.net X-Envelope-To: adrian.chadd@gmail.com Received: from eg.sd.rdtc.ru (eugen@localhost [127.0.0.1]) by eg.sd.rdtc.ru (8.15.2/8.15.2) with ESMTP id t9VIRbM8051475; Sun, 1 Nov 2015 01:27:38 +0700 (KRAT) (envelope-from eugen@grosbein.net) Subject: Re: CPU underload To: Adrian Chadd References: <56348063.3090508@grosbein.net> <56348239.3050701@grosbein.net> <563500FC.8020201@grosbein.net> Cc: "freebsd-mips@freebsd.org" From: Eugene Grosbein X-Enigmail-Draft-Status: N1110 Message-ID: <56350819.6030900@grosbein.net> Date: Sun, 1 Nov 2015 01:27:37 +0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.2.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=0.3 required=5.0 tests=BAYES_00,LOCAL_FROM autolearn=no version=3.3.2 X-Spam-Report: * -2.3 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 2.6 LOCAL_FROM From my domains X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on hz.grosbein.net X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 31 Oct 2015 18:27:52 -0000 On 01.11.2015 01:11, Adrian Chadd wrote: > Hi, > > I don't see any DELAY in my testing, nor MipsUserIntr, so yeah, I must > be doing something different. > > I am testing on QCA9558, not AR9344 though. My AR9344 isn't with me atm. > > Just run 'top'; what's showing? Are there other processes running? Inter-vlan bridging; while traffic runs: # top -SH last pid: 1063; load averages: 0.38, 0.27, 0.47 up 0+05:02:08 01:18:20 50 processes: 3 running, 37 sleeping, 10 waiting CPU: 1.3% user, 0.0% nice, 0.7% system, 52.6% interrupt, 45.4% idle Mem: 1504K Active, 27M Inact, 19M Wired, 668K Buf, 73M Free Swap: PID USERNAME PRI NICE SIZE RES STATE TIME WCPU COMMAND 11 root -92 - 0K 88K RUN 17:13 52.84% intr{int2 arge0} 10 root 155 ki31 0K 8K RUN 276:11 44.75% idle 1063 root 40 0 7624K 2644K RUN 0:00 4.43% top 11 root -60 - 0K 88K WAIT 2:11 0.65% intr{swi4: clock (0)} 11 root -76 - 0K 88K WAIT 0:01 0.20% intr{swi0: uart} 13 root -72 - 0K 40K - 0:01 0.01% usb{usbus0} 2 root -16 - 0K 8K - 0:01 0.01% rand_harvestq 337 root 40 0 6192K 1640K select 2:21 0.01% syslogd 16 root -16 - 0K 8K - 0:01 0.01% schedcpu 11 root -88 - 0K 88K WAIT 0:01 0.01% intr{int1 ehci0} 3 root -8 - 0K 16K - 0:00 0.00% cam{doneq0} 5 root -16 - 0K 16K psleep 0:00 0.00% pagedaemon{pagedaemon} 9 root -16 - 0K 8K psleep 0:00 0.00% bufdaemon 15 root 16 - 0K 8K syncer 0:01 0.00% syncer 7 root -16 ki-1 0K 8K pollid 0:00 0.00% idlepoll 8 root -8 - 0K 8K - 0:00 0.00% bufspacedaemon 14 root -4 - 0K 8K vlruwt 0:00 0.00% vnlru 4 root -8 - 0K 8K jobque 0:29 0.00% task: mx25l flash 12 root -8 - 0K 24K - 0:12 0.00% geom{g_up} 11 root -72 - 0K 88K WAIT 0:09 0.00% intr{swi1: netisr 0} 0 root -16 0 0K 48K swapin 0:07 0.00% kernel{swapper} 12 root -8 - 0K 24K - 0:06 0.00% geom{g_event} 13 root -68 - 0K 40K - 0:01 0.00% usb{usbus0} 542 root 8 0 6664K 2488K wait 0:01 0.00% sh 13 root -68 - 0K 40K - 0:01 0.00% usb{usbus0} 30 root -8 - 0K 8K mdwait 0:00 0.00% md0 40 root -8 - 0K 8K mdwait 0:00 0.00% md1 12 root -8 - 0K 24K - 0:00 0.00% geom{g_down} 499 root 8 0 6176K 1464K nanslp 0:00 0.00% cron 541 root 8 0 7416K 2296K wait 0:00 0.00% login 978 root -8 - 0K 8K mdwait 0:00 0.00% md2 11 root -52 - 0K 88K WAIT 0:00 0.00% intr{swi6: task queue} 1 root 8 0 5048K 872K wait 0:00 0.00% init 0 root 8 0 0K 48K - 0:00 0.00% kernel{thread taskq} > Is devd doing something stupid? devd is not started; my freebsd/mips build does not even contains devd. > Does 'dmesg' show the switch ports flapping or something? dmesg is flooded with messages: Unaligned Load Word: pc=0xffffffff80314fb8, badvaddr=0x7ffdd845 Unaligned Load Word: pc=0xffffffff80314fb8, badvaddr=0x7ffdd841 Unaligned Load Word: pc=0xffffffff80314fb8, badvaddr=0x7ffdd83d Unaligned Load Word: pc=0xffffffff80314fb8, badvaddr=0x7ffdd839 Unaligned Load Word: pc=0xffffffff80314fb8, badvaddr=0x7ffdd835 Unaligned Load Word: pc=0xffffffff80314fb8, badvaddr=0x7ffdd831 Unaligned Load Word: pc=0xffffffff80314fb8, badvaddr=0x7ffdd82d Unaligned Load Word: pc=0xffffffff80314fb8, badvaddr=0x7ffdd829 Unaligned Load Word: pc=0xffffffff80314fb8, badvaddr=0x7ffdd825 Unaligned Load Word: pc=0xffffffff80314fb8, badvaddr=0x7ffdd821 No other lines in dmesg output. > My CPU is definitely pegged during these tests. Since yours isn't then > yeah, something odd is going on. > > Can you post the output of 'vmstat 1' whilst you're running your tests? # vmstat 1 procs memory page disks faults cpu r b w avm fre flt re pi po fr sr fl0 md0 in sy cs us sy id 1 1 0 69M 73M 28 0 0 0 6 1 0 0 1822 433 188 0 8 91 0 0 0 57M 74M 185 0 0 0 330 0 0 0 2240 1444 281 2 59 39 0 0 0 57M 74M 0 0 0 0 0 0 0 0 2516 105 458 0 56 44 0 0 0 57M 74M 0 0 0 0 0 1 0 0 2138 105 383 0 39 61 0 0 0 57M 74M 0 0 0 0 0 0 0 0 2162 105 387 0 43 57 0 0 0 57M 74M 0 0 0 0 0 0 0 0 3218 105 704 0 77 23 0 0 0 57M 74M 0 0 0 0 0 1 0 0 2007 105 444 0 30 70 0 0 0 57M 74M 0 0 0 0 0 0 0 0 2737 105 538 0 63 37 0 0 0 57M 74M 0 0 0 0 0 0 0 0 2625 105 569 0 52 48 0 0 0 57M 74M 0 0 0 0 0 1 0 0 2586 105 499 0 61 39 0 0 0 57M 74M 0 0 0 0 0 0 0 0 2024 105 423 0 30 70 0 0 0 57M 74M 0 0 0 0 0 0 0 0 2500 105 590 0 47 53 0 0 0 57M 74M 0 0 0 0 0 1 0 0 2105 105 401 0 34 66 0 0 0 57M 74M 0 0 0 0 0 0 0 0 2441 105 453 0 48 52 0 0 0 57M 74M 0 0 0 0 0 0 0 0 3002 105 732 1 60 39 0 0 0 57M 74M 0 0 0 0 0 1 0 0 2374 105 528 0 47 53 0 0 0 57M 74M 0 0 0 0 0 0 0 0 2813 105 639 0 63 37 0 0 0 57M 74M 0 0 0 0 0 0 0 0 2472 105 435 0 56 44 0 0 0 57M 74M 0 0 0 0 0 1 0 0 2855 105 665 0 64 36 0 0 0 57M 74M 0 0 0 0 0 0 0 0 3189 109 675 0 74 26 0 0 0 57M 74M 0 0 0 0 0 0 0 0 2488 105 542 0 51 49 0 0 0 57M 74M 0 0 0 0 0 1 0 0 2518 105 452 0 50 50 0 0 0 57M 74M 0 0 0 0 0 0 0 1 2488 105 521 0 50 50 0 0 0 57M 74M 0 0 0 0 0 0 0 0 2023 105 438 0 31 69 0 0 0 57M 74M 0 0 0 0 0 1 0 0 2501 105 524 0 44 56 0 0 0 57M 74M 0 0 0 0 0 0 0 0 2976 105 622 0 70 30 0 0 0 57M 74M 0 0 0 0 0 0 0 0 2694 105 592 0 59 41 0 0 0 57M 74M 0 0 0 0 0 1 0 0 2870 105 600 0 70 30 0 0 0 57M 74M 0 0 0 0 0 0 0 0 2368 105 447 0 46 54 0 0 0 57M 74M 0 0 0 0 0 0 0 0 2853 105 565 0 69 31 0 0 0 57M 74M 0 0 0 0 0 1 0 0 2546 105 476 1 54 45 That's it. From owner-freebsd-mips@freebsd.org Sat Oct 31 19:21:08 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5A4F1A1BF16 for ; Sat, 31 Oct 2015 19:21:08 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from hz.grosbein.net (hz.grosbein.net [78.47.246.247]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id AD45C1B91 for ; Sat, 31 Oct 2015 19:21:07 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from eg.sd.rdtc.ru (root@eg.sd.rdtc.ru [62.231.161.221]) by hz.grosbein.net (8.14.9/8.14.9) with ESMTP id t9VJKpno051392 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT); Sat, 31 Oct 2015 20:20:51 +0100 (CET) (envelope-from eugen@grosbein.net) X-Envelope-From: eugen@grosbein.net X-Envelope-To: adrian.chadd@gmail.com Received: from eg.sd.rdtc.ru (eugen@localhost [127.0.0.1]) by eg.sd.rdtc.ru (8.15.2/8.15.2) with ESMTP id t9VJKhL2051994; Sun, 1 Nov 2015 02:20:44 +0700 (KRAT) (envelope-from eugen@grosbein.net) Subject: Re: CPU underload To: Adrian Chadd References: <56348063.3090508@grosbein.net> <56348239.3050701@grosbein.net> <563500FC.8020201@grosbein.net> Cc: "freebsd-mips@freebsd.org" From: Eugene Grosbein X-Enigmail-Draft-Status: N1110 Message-ID: <5635148B.2070307@grosbein.net> Date: Sun, 1 Nov 2015 02:20:43 +0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.2.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=0.3 required=5.0 tests=BAYES_00,LOCAL_FROM autolearn=no version=3.3.2 X-Spam-Report: * -2.3 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 2.6 LOCAL_FROM From my domains X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on hz.grosbein.net X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 31 Oct 2015 19:21:08 -0000 On 01.11.2015 01:11, Adrian Chadd wrote: > Hi, > > I don't see any DELAY in my testing, nor MipsUserIntr, so yeah, I must > be doing something different. I had compiled the system using CFLAGS+=-Os trying to minimize code size. It seems, that was not wise. Now I rebuilt it without -Os and got better numbers: 60MByte/s under same inter-vlan briding test. However, this time "interrupt storm" stroke again but that was not same bug but just really higher numbers of interrupts on arge0 due to higher speed. I raised hw.intr_storm_threshold from default 1000 upto 10000 and "storm" is no more. "Unaligned Load Word" messages in dmesg I've mentioned before are generated by running pmcstat. If I do not run it, dmesg is not flooded and its last line is: "Nov 1 01:43:06 tl-wdr3600 login: ROOT LOGIN (root) ON ttyu0". No port flapping. CPU utilization has raised too, but idle part is still pretty large and it is very unstable: # vmstat 1 procs memory page disks faults cpu r b w avm fre flt re pi po fr sr fl0 md0 in sy cs us sy id 0 0 0 58M 93M 297 0 3 0 217 2 0 0 1826 8680 184 5 63 32 0 0 0 58M 93M 0 0 0 0 0 2 0 0 3773 105 138 0 78 22 0 0 0 58M 93M 0 0 0 0 0 2 0 0 2316 105 116 0 62 38 0 0 0 58M 93M 0 0 0 0 0 5 0 0 5786 105 167 0 80 20 0 0 0 58M 93M 0 0 0 0 0 2 0 0 4177 105 95 0 79 21 0 0 0 58M 93M 0 0 0 0 0 2 0 0 3032 105 85 0 81 19 0 0 0 58M 93M 0 0 0 0 0 2 0 0 2831 105 152 0 66 34 0 0 0 58M 93M 0 0 0 0 0 1 0 0 4436 105 147 0 75 25 0 0 0 58M 93M 0 0 0 0 0 2 0 0 2943 105 84 0 75 25 0 0 0 58M 93M 0 0 0 0 0 2 0 0 2886 105 141 0 73 27 0 0 0 58M 93M 0 0 0 0 0 3 0 0 5727 105 50 0 95 5 0 0 0 58M 93M 0 0 0 0 0 2 0 0 3021 105 141 0 64 36 0 0 0 58M 93M 0 0 0 0 0 2 0 0 2824 105 127 0 76 24 0 0 0 58M 93M 0 0 0 0 0 2 0 0 2168 105 153 0 54 46 0 0 0 58M 93M 0 0 0 0 0 2 0 0 4879 105 116 0 83 17 0 0 0 58M 93M 0 0 0 0 0 2 0 0 4341 105 210 0 81 19 0 0 0 58M 93M 0 0 0 0 0 2 0 0 2294 105 127 0 54 46 0 0 0 58M 93M 0 0 0 0 0 2 0 0 4178 109 126 1 79 20 0 0 0 58M 93M 0 0 0 0 0 5 0 0 5048 105 106 0 72 28 pmcstat still shows some DELAY samples (but much less now) and MipsUserIntr is still here: PMC: [INSTR_EXECUTED] Samples: 14535 (100.0%) , 0 unresolved %SAMP IMAGE FUNCTION CALLERS 9.1 kernel MipsUserIntr 6.1 kernel if_inc_counter vlan_transmit:1.1 bridge_forward:1.1 ... 3.8 kernel ether_nh_input netisr_dispatch_src 3.7 kernel bridge_input ether_nh_input 3.5 kernel _bus_dmamap_sync arge_start_locked:1.7 arge_intr:1.0 ... 3.3 kernel _bus_dmamap_load_buf _bus_dmamap_load_mbuf_sg 3.1 kernel critical_enter 3.1 kernel arge_intr intr_event_execute_handlers 2.9 kernel bridge_rtnode_lookup bridge_rtlookup:1.5 ... 2.9 kernel memcpy 2.8 kernel arge_start_locked arge_start 2.6 libc.so.7 bsearch pmcstat_symbol_search 2.2 kernel critical_exit if_inc_counter 2.1 kernel bridge_forward bridge_input 1.9 kernel bridge_rtnode_addr_c 1.9 kernel bus_dmamap_sync_buf _bus_dmamap_sync 1.9 kernel DELAY 1.8 kernel arge_newbuf arge_intr 1.7 kernel netisr_dispatch_src netisr_dispatch 1.6 kernel mipsNN_pdcache_inv_r CONVERSION STATISTICS:g_read pmcstat_process_log #exec/elf 2 #samples/total 261959 #samples/unknown-function 8887 From owner-freebsd-mips@freebsd.org Sat Oct 31 19:24:47 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0BB5DA1BF5D for ; Sat, 31 Oct 2015 19:24:47 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: from mail-io0-x229.google.com (mail-io0-x229.google.com [IPv6:2607:f8b0:4001:c06::229]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id C4BC51D41 for ; Sat, 31 Oct 2015 19:24:46 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: by ioll68 with SMTP id l68so111208383iol.3 for ; Sat, 31 Oct 2015 12:24:46 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type; bh=ppAL3r32qpa6/Pfb1KGT4ZZJlGZhrSgumXYcODNmJm4=; b=TOF7+plVViSFRcvp5j8IKzY/C6W6UJpRmrGp8K1I13dfR8U8tDMcawXPS0OoMENUQ3 /3aYiH7QcMB5WJLYZeXu8neov+ibYYMmGTVIN4pk71iHuQpjpzkUqzLWJhE23a05Kbj6 bLWfBPPtBrr3qSzFICtlu8BIgZio+n4vjcoqBPb/mPgfesVRhfy86Tv84898aO8W+LSR HQhLkhyXdPiPCJm4/wQcE7eEL4rlKIAKoLzPR3KwubFWe71f6LteDpifm/Y1AMLKd4od ri3n95NA80Jo6IOSBrnAa/ZOpBFjm6oJKjLBvYAwqvCwCrZG56SUqF58QPBaSzfa6sgo v1EA== MIME-Version: 1.0 X-Received: by 10.107.3.72 with SMTP id 69mr15695556iod.75.1446319486135; Sat, 31 Oct 2015 12:24:46 -0700 (PDT) Sender: adrian.chadd@gmail.com Received: by 10.36.46.66 with HTTP; Sat, 31 Oct 2015 12:24:46 -0700 (PDT) In-Reply-To: <5635148B.2070307@grosbein.net> References: <56348063.3090508@grosbein.net> <56348239.3050701@grosbein.net> <563500FC.8020201@grosbein.net> <5635148B.2070307@grosbein.net> Date: Sat, 31 Oct 2015 15:24:46 -0400 X-Google-Sender-Auth: x2rHOIkhNaOmOH3KDWXfldxm5Vs Message-ID: Subject: Re: CPU underload From: Adrian Chadd To: Eugene Grosbein Cc: "freebsd-mips@freebsd.org" Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 31 Oct 2015 19:24:47 -0000 OK, so those messages are expected when you run hwpmc. Sigh, I should just rate limit that message and make it a counter. (I had to comment it out here.) Do you get those unaligned fixup messages when you're not running hwpmc? (sysctl kern.msgbuf_clear=1 and then retest without running pmcstat, etc.) During the test, what's the latency between your two test boxes? Try a ping from FTP client->server and see. Thanks, -adrian From owner-freebsd-mips@freebsd.org Sat Oct 31 19:47:01 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 20076A2247A for ; Sat, 31 Oct 2015 19:47:01 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from hz.grosbein.net (hz.grosbein.net [78.47.246.247]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id A5E801525; Sat, 31 Oct 2015 19:47:00 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from eg.sd.rdtc.ru (root@eg.sd.rdtc.ru [62.231.161.221]) by hz.grosbein.net (8.14.9/8.14.9) with ESMTP id t9VJkptu051463 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT); Sat, 31 Oct 2015 20:46:52 +0100 (CET) (envelope-from eugen@grosbein.net) X-Envelope-From: eugen@grosbein.net X-Envelope-To: adrian@freebsd.org Received: from eg.sd.rdtc.ru (eugen@localhost [127.0.0.1]) by eg.sd.rdtc.ru (8.15.2/8.15.2) with ESMTP id t9VJkkX0052282; Sun, 1 Nov 2015 02:46:46 +0700 (KRAT) (envelope-from eugen@grosbein.net) Subject: Re: CPU underload To: Adrian Chadd References: <56348063.3090508@grosbein.net> <56348239.3050701@grosbein.net> <563500FC.8020201@grosbein.net> <5635148B.2070307@grosbein.net> Cc: "freebsd-mips@freebsd.org" From: Eugene Grosbein X-Enigmail-Draft-Status: N1110 Message-ID: <56351AA6.80903@grosbein.net> Date: Sun, 1 Nov 2015 02:46:46 +0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.2.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=0.3 required=5.0 tests=BAYES_00,LOCAL_FROM, T_DATE_IN_FUTURE_96_Q autolearn=no version=3.3.2 X-Spam-Report: * 0.0 T_DATE_IN_FUTURE_96_Q Date: is 4 days to 4 months after Received: * date * -2.3 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 2.6 LOCAL_FROM From my domains X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on hz.grosbein.net X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 31 Oct 2015 19:47:01 -0000 On 01.11.2015 02:24, Adrian Chadd wrote: > OK, so those messages are expected when you run hwpmc. Sigh, I should > just rate limit that message and make it a counter. (I had to comment > it out here.) > > Do you get those unaligned fixup messages when you're not running > hwpmc? No. > During the test, what's the latency between your two test boxes? Try a > ping from FTP client->server and see. It takes 20 seconds now to transfer 1GB file over FTP. "ping -c 150 -s 1472 -i 0.1" during the test results in: 150 packets transmitted, 150 packets received, 0.0% packet loss round-trip min/avg/max/stddev = 0.250/0.735/7.362/0.775 ms And with idle network it shows pretty same: 150 packets transmitted, 150 packets received, 0.0% packet loss round-trip min/avg/max/stddev = 0.252/0.753/6.927/1.538 ms Maximum delay is pretty hight and that bothers me. Here is the output without -q flag. Note that high delay occured for packets number 35, 45, 55, 65, 105. Script started on Sun Nov 1 02:38:05 2015 command: ping -c 150 -s 1472 -i 0.1 192.168.3.1 PING 192.168.3.1 (192.168.3.1): 1472 data bytes 1480 bytes from 192.168.3.1: icmp_seq=0 ttl=64 time=0.307 ms 1480 bytes from 192.168.3.1: icmp_seq=1 ttl=64 time=0.692 ms 1480 bytes from 192.168.3.1: icmp_seq=2 ttl=64 time=0.266 ms 1480 bytes from 192.168.3.1: icmp_seq=3 ttl=64 time=0.268 ms 1480 bytes from 192.168.3.1: icmp_seq=4 ttl=64 time=0.267 ms 1480 bytes from 192.168.3.1: icmp_seq=5 ttl=64 time=0.283 ms 1480 bytes from 192.168.3.1: icmp_seq=6 ttl=64 time=0.285 ms 1480 bytes from 192.168.3.1: icmp_seq=7 ttl=64 time=0.270 ms 1480 bytes from 192.168.3.1: icmp_seq=8 ttl=64 time=0.264 ms 1480 bytes from 192.168.3.1: icmp_seq=9 ttl=64 time=0.264 ms 1480 bytes from 192.168.3.1: icmp_seq=10 ttl=64 time=0.290 ms 1480 bytes from 192.168.3.1: icmp_seq=11 ttl=64 time=0.693 ms 1480 bytes from 192.168.3.1: icmp_seq=12 ttl=64 time=0.261 ms 1480 bytes from 192.168.3.1: icmp_seq=13 ttl=64 time=0.277 ms 1480 bytes from 192.168.3.1: icmp_seq=14 ttl=64 time=0.265 ms 1480 bytes from 192.168.3.1: icmp_seq=15 ttl=64 time=0.296 ms 1480 bytes from 192.168.3.1: icmp_seq=16 ttl=64 time=0.266 ms 1480 bytes from 192.168.3.1: icmp_seq=17 ttl=64 time=0.265 ms 1480 bytes from 192.168.3.1: icmp_seq=18 ttl=64 time=0.270 ms 1480 bytes from 192.168.3.1: icmp_seq=19 ttl=64 time=0.276 ms 1480 bytes from 192.168.3.1: icmp_seq=20 ttl=64 time=0.267 ms 1480 bytes from 192.168.3.1: icmp_seq=21 ttl=64 time=0.697 ms 1480 bytes from 192.168.3.1: icmp_seq=22 ttl=64 time=0.274 ms 1480 bytes from 192.168.3.1: icmp_seq=23 ttl=64 time=0.271 ms 1480 bytes from 192.168.3.1: icmp_seq=24 ttl=64 time=0.264 ms 1480 bytes from 192.168.3.1: icmp_seq=25 ttl=64 time=0.320 ms 1480 bytes from 192.168.3.1: icmp_seq=26 ttl=64 time=0.275 ms 1480 bytes from 192.168.3.1: icmp_seq=27 ttl=64 time=0.268 ms 1480 bytes from 192.168.3.1: icmp_seq=28 ttl=64 time=0.258 ms 1480 bytes from 192.168.3.1: icmp_seq=29 ttl=64 time=0.265 ms 1480 bytes from 192.168.3.1: icmp_seq=30 ttl=64 time=0.263 ms 1480 bytes from 192.168.3.1: icmp_seq=31 ttl=64 time=0.689 ms 1480 bytes from 192.168.3.1: icmp_seq=32 ttl=64 time=0.263 ms 1480 bytes from 192.168.3.1: icmp_seq=33 ttl=64 time=0.274 ms 1480 bytes from 192.168.3.1: icmp_seq=34 ttl=64 time=0.257 ms 1480 bytes from 192.168.3.1: icmp_seq=35 ttl=64 time=6.195 ms 1480 bytes from 192.168.3.1: icmp_seq=36 ttl=64 time=0.267 ms 1480 bytes from 192.168.3.1: icmp_seq=37 ttl=64 time=0.264 ms 1480 bytes from 192.168.3.1: icmp_seq=38 ttl=64 time=0.259 ms 1480 bytes from 192.168.3.1: icmp_seq=39 ttl=64 time=0.345 ms 1480 bytes from 192.168.3.1: icmp_seq=40 ttl=64 time=0.270 ms 1480 bytes from 192.168.3.1: icmp_seq=41 ttl=64 time=0.690 ms 1480 bytes from 192.168.3.1: icmp_seq=42 ttl=64 time=0.264 ms 1480 bytes from 192.168.3.1: icmp_seq=43 ttl=64 time=0.271 ms 1480 bytes from 192.168.3.1: icmp_seq=44 ttl=64 time=0.330 ms 1480 bytes from 192.168.3.1: icmp_seq=45 ttl=64 time=6.913 ms 1480 bytes from 192.168.3.1: icmp_seq=46 ttl=64 time=0.293 ms 1480 bytes from 192.168.3.1: icmp_seq=47 ttl=64 time=0.259 ms 1480 bytes from 192.168.3.1: icmp_seq=48 ttl=64 time=0.259 ms 1480 bytes from 192.168.3.1: icmp_seq=49 ttl=64 time=0.267 ms 1480 bytes from 192.168.3.1: icmp_seq=50 ttl=64 time=0.274 ms 1480 bytes from 192.168.3.1: icmp_seq=51 ttl=64 time=0.690 ms 1480 bytes from 192.168.3.1: icmp_seq=52 ttl=64 time=0.282 ms 1480 bytes from 192.168.3.1: icmp_seq=53 ttl=64 time=0.268 ms 1480 bytes from 192.168.3.1: icmp_seq=54 ttl=64 time=0.256 ms 1480 bytes from 192.168.3.1: icmp_seq=55 ttl=64 time=6.875 ms 1480 bytes from 192.168.3.1: icmp_seq=56 ttl=64 time=0.307 ms 1480 bytes from 192.168.3.1: icmp_seq=57 ttl=64 time=0.265 ms 1480 bytes from 192.168.3.1: icmp_seq=58 ttl=64 time=0.259 ms 1480 bytes from 192.168.3.1: icmp_seq=59 ttl=64 time=0.266 ms 1480 bytes from 192.168.3.1: icmp_seq=60 ttl=64 time=0.277 ms 1480 bytes from 192.168.3.1: icmp_seq=61 ttl=64 time=0.693 ms 1480 bytes from 192.168.3.1: icmp_seq=62 ttl=64 time=0.281 ms 1480 bytes from 192.168.3.1: icmp_seq=63 ttl=64 time=0.268 ms 1480 bytes from 192.168.3.1: icmp_seq=64 ttl=64 time=0.257 ms 1480 bytes from 192.168.3.1: icmp_seq=65 ttl=64 time=6.877 ms 1480 bytes from 192.168.3.1: icmp_seq=66 ttl=64 time=0.281 ms 1480 bytes from 192.168.3.1: icmp_seq=67 ttl=64 time=0.259 ms 1480 bytes from 192.168.3.1: icmp_seq=68 ttl=64 time=0.281 ms 1480 bytes from 192.168.3.1: icmp_seq=69 ttl=64 time=0.269 ms 1480 bytes from 192.168.3.1: icmp_seq=70 ttl=64 time=0.264 ms 1480 bytes from 192.168.3.1: icmp_seq=71 ttl=64 time=0.264 ms 1480 bytes from 192.168.3.1: icmp_seq=72 ttl=64 time=0.262 ms 1480 bytes from 192.168.3.1: icmp_seq=73 ttl=64 time=0.266 ms 1480 bytes from 192.168.3.1: icmp_seq=74 ttl=64 time=0.261 ms 1480 bytes from 192.168.3.1: icmp_seq=75 ttl=64 time=0.280 ms 1480 bytes from 192.168.3.1: icmp_seq=76 ttl=64 time=0.264 ms 1480 bytes from 192.168.3.1: icmp_seq=77 ttl=64 time=0.265 ms 1480 bytes from 192.168.3.1: icmp_seq=78 ttl=64 time=0.267 ms 1480 bytes from 192.168.3.1: icmp_seq=79 ttl=64 time=0.266 ms 1480 bytes from 192.168.3.1: icmp_seq=80 ttl=64 time=0.263 ms 1480 bytes from 192.168.3.1: icmp_seq=81 ttl=64 time=0.684 ms 1480 bytes from 192.168.3.1: icmp_seq=82 ttl=64 time=0.263 ms 1480 bytes from 192.168.3.1: icmp_seq=83 ttl=64 time=0.318 ms 1480 bytes from 192.168.3.1: icmp_seq=84 ttl=64 time=0.287 ms 1480 bytes from 192.168.3.1: icmp_seq=85 ttl=64 time=0.277 ms 1480 bytes from 192.168.3.1: icmp_seq=86 ttl=64 time=0.260 ms 1480 bytes from 192.168.3.1: icmp_seq=87 ttl=64 time=0.269 ms 1480 bytes from 192.168.3.1: icmp_seq=88 ttl=64 time=0.262 ms 1480 bytes from 192.168.3.1: icmp_seq=89 ttl=64 time=0.266 ms 1480 bytes from 192.168.3.1: icmp_seq=90 ttl=64 time=0.266 ms 1480 bytes from 192.168.3.1: icmp_seq=91 ttl=64 time=0.689 ms 1480 bytes from 192.168.3.1: icmp_seq=92 ttl=64 time=0.265 ms 1480 bytes from 192.168.3.1: icmp_seq=93 ttl=64 time=0.265 ms 1480 bytes from 192.168.3.1: icmp_seq=94 ttl=64 time=0.262 ms 1480 bytes from 192.168.3.1: icmp_seq=95 ttl=64 time=0.277 ms 1480 bytes from 192.168.3.1: icmp_seq=96 ttl=64 time=0.263 ms 1480 bytes from 192.168.3.1: icmp_seq=97 ttl=64 time=0.296 ms 1480 bytes from 192.168.3.1: icmp_seq=98 ttl=64 time=0.282 ms 1480 bytes from 192.168.3.1: icmp_seq=99 ttl=64 time=0.269 ms 1480 bytes from 192.168.3.1: icmp_seq=100 ttl=64 time=0.264 ms 1480 bytes from 192.168.3.1: icmp_seq=101 ttl=64 time=0.691 ms 1480 bytes from 192.168.3.1: icmp_seq=102 ttl=64 time=0.263 ms 1480 bytes from 192.168.3.1: icmp_seq=103 ttl=64 time=0.267 ms 1480 bytes from 192.168.3.1: icmp_seq=104 ttl=64 time=0.261 ms 1480 bytes from 192.168.3.1: icmp_seq=105 ttl=64 time=6.101 ms 1480 bytes from 192.168.3.1: icmp_seq=106 ttl=64 time=0.274 ms 1480 bytes from 192.168.3.1: icmp_seq=107 ttl=64 time=0.264 ms 1480 bytes from 192.168.3.1: icmp_seq=108 ttl=64 time=0.259 ms 1480 bytes from 192.168.3.1: icmp_seq=109 ttl=64 time=0.271 ms 1480 bytes from 192.168.3.1: icmp_seq=110 ttl=64 time=0.264 ms 1480 bytes from 192.168.3.1: icmp_seq=111 ttl=64 time=0.691 ms 1480 bytes from 192.168.3.1: icmp_seq=112 ttl=64 time=0.263 ms 1480 bytes from 192.168.3.1: icmp_seq=113 ttl=64 time=0.267 ms 1480 bytes from 192.168.3.1: icmp_seq=114 ttl=64 time=0.262 ms 1480 bytes from 192.168.3.1: icmp_seq=115 ttl=64 time=0.274 ms 1480 bytes from 192.168.3.1: icmp_seq=116 ttl=64 time=0.262 ms 1480 bytes from 192.168.3.1: icmp_seq=117 ttl=64 time=0.261 ms 1480 bytes from 192.168.3.1: icmp_seq=118 ttl=64 time=0.263 ms 1480 bytes from 192.168.3.1: icmp_seq=119 ttl=64 time=0.266 ms 1480 bytes from 192.168.3.1: icmp_seq=120 ttl=64 time=0.264 ms 1480 bytes from 192.168.3.1: icmp_seq=121 ttl=64 time=0.271 ms 1480 bytes from 192.168.3.1: icmp_seq=122 ttl=64 time=0.277 ms 1480 bytes from 192.168.3.1: icmp_seq=123 ttl=64 time=0.268 ms 1480 bytes from 192.168.3.1: icmp_seq=124 ttl=64 time=0.262 ms 1480 bytes from 192.168.3.1: icmp_seq=125 ttl=64 time=0.279 ms 1480 bytes from 192.168.3.1: icmp_seq=126 ttl=64 time=0.289 ms 1480 bytes from 192.168.3.1: icmp_seq=127 ttl=64 time=0.269 ms 1480 bytes from 192.168.3.1: icmp_seq=128 ttl=64 time=0.261 ms 1480 bytes from 192.168.3.1: icmp_seq=129 ttl=64 time=0.265 ms 1480 bytes from 192.168.3.1: icmp_seq=130 ttl=64 time=0.263 ms 1480 bytes from 192.168.3.1: icmp_seq=131 ttl=64 time=0.257 ms 1480 bytes from 192.168.3.1: icmp_seq=132 ttl=64 time=0.264 ms 1480 bytes from 192.168.3.1: icmp_seq=133 ttl=64 time=0.266 ms 1480 bytes from 192.168.3.1: icmp_seq=134 ttl=64 time=0.260 ms 1480 bytes from 192.168.3.1: icmp_seq=135 ttl=64 time=2.064 ms 1480 bytes from 192.168.3.1: icmp_seq=136 ttl=64 time=0.273 ms 1480 bytes from 192.168.3.1: icmp_seq=137 ttl=64 time=0.270 ms 1480 bytes from 192.168.3.1: icmp_seq=138 ttl=64 time=0.261 ms 1480 bytes from 192.168.3.1: icmp_seq=139 ttl=64 time=0.267 ms 1480 bytes from 192.168.3.1: icmp_seq=140 ttl=64 time=0.261 ms 1480 bytes from 192.168.3.1: icmp_seq=141 ttl=64 time=0.685 ms 1480 bytes from 192.168.3.1: icmp_seq=142 ttl=64 time=0.261 ms 1480 bytes from 192.168.3.1: icmp_seq=143 ttl=64 time=0.264 ms 1480 bytes from 192.168.3.1: icmp_seq=144 ttl=64 time=0.257 ms 1480 bytes from 192.168.3.1: icmp_seq=145 ttl=64 time=0.274 ms 1480 bytes from 192.168.3.1: icmp_seq=146 ttl=64 time=0.257 ms 1480 bytes from 192.168.3.1: icmp_seq=147 ttl=64 time=0.270 ms 1480 bytes from 192.168.3.1: icmp_seq=148 ttl=64 time=0.255 ms 1480 bytes from 192.168.3.1: icmp_seq=149 ttl=64 time=0.264 ms --- 192.168.3.1 ping statistics --- 150 packets transmitted, 150 packets received, 0.0% packet loss round-trip min/avg/max/stddev = 0.255/0.527/6.913/1.143 ms First I've supposed its some bridge's STP timer firing up but disabling STP does not help, same periodic delays. From owner-freebsd-mips@freebsd.org Sat Oct 31 20:10:24 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 58BF4A22779 for ; Sat, 31 Oct 2015 20:10:24 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: from mail-ig0-x230.google.com (mail-ig0-x230.google.com [IPv6:2607:f8b0:4001:c05::230]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 238E21C2F for ; Sat, 31 Oct 2015 20:10:24 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: by igvi2 with SMTP id i2so29052346igv.0 for ; Sat, 31 Oct 2015 13:10:23 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type; bh=Bfeen8BKFE7fOv/HrMEJEBNQwRatPDh1tQoFt7FKK+Q=; b=t3rwxU0BdMrel7xND/uh3FiOU41Qb+1psi+d/b9IBWi8gWL3+EWNgz7SbLBUAkOEyi ZpebB/yfPYczDroQg5qu+ia2W3HTabIoCnpdHnZWJrqMbaYtUa7MShP2kKDSimQsEwfn EO/9u861KGHovzdGDN7+PkniWzAkhB+LIXEyYJQ7/Yhx4VsWFlPl9jtnRHFi9Mq3Iw5I Q7ALY6yWPSOMlyF07TYyQacvIxsMhwaUT17nI1j13yb49PKozz/VmPI+eqmUSEVAMtgG vaLFPRv/jvnJ9zKyGsMjFPfewIBsmcovuYbh88X1aT4rgrUbAaJwAkM6B2XLG8JNlM6V 6YWQ== MIME-Version: 1.0 X-Received: by 10.50.111.226 with SMTP id il2mr4266503igb.61.1446322223515; Sat, 31 Oct 2015 13:10:23 -0700 (PDT) Sender: adrian.chadd@gmail.com Received: by 10.36.46.66 with HTTP; Sat, 31 Oct 2015 13:10:23 -0700 (PDT) In-Reply-To: <56351AA6.80903@grosbein.net> References: <56348063.3090508@grosbein.net> <56348239.3050701@grosbein.net> <563500FC.8020201@grosbein.net> <5635148B.2070307@grosbein.net> <56351AA6.80903@grosbein.net> Date: Sat, 31 Oct 2015 16:10:23 -0400 X-Google-Sender-Auth: QRr_fA11Yy5uQySEe1x3C-NYkrA Message-ID: Subject: Re: CPU underload From: Adrian Chadd To: Eugene Grosbein Cc: "freebsd-mips@freebsd.org" Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 31 Oct 2015 20:10:24 -0000 Hm, okay. Try doing ping -i 0.01 (ie, every 10ms.) I wonder if it's happening more frequently and we're hitting sampling bias. -a From owner-freebsd-mips@freebsd.org Sat Oct 31 20:15:11 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 59A55A228AA for ; Sat, 31 Oct 2015 20:15:11 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from hz.grosbein.net (hz.grosbein.net [78.47.246.247]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id EEA271EA7 for ; Sat, 31 Oct 2015 20:15:10 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from eg.sd.rdtc.ru (root@eg.sd.rdtc.ru [62.231.161.221]) by hz.grosbein.net (8.14.9/8.14.9) with ESMTP id t9VKF303051550 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT); Sat, 31 Oct 2015 21:15:04 +0100 (CET) (envelope-from eugen@grosbein.net) X-Envelope-From: eugen@grosbein.net X-Envelope-To: adrian.chadd@gmail.com Received: from eg.sd.rdtc.ru (eugen@localhost [127.0.0.1]) by eg.sd.rdtc.ru (8.15.2/8.15.2) with ESMTP id t9VKExGm053054; Sun, 1 Nov 2015 03:14:59 +0700 (KRAT) (envelope-from eugen@grosbein.net) Subject: Re: CPU underload To: Adrian Chadd References: <56348063.3090508@grosbein.net> <56348239.3050701@grosbein.net> <563500FC.8020201@grosbein.net> Cc: "freebsd-mips@freebsd.org" From: Eugene Grosbein Message-ID: <56352143.7080006@grosbein.net> Date: Sun, 1 Nov 2015 03:14:59 +0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.2.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=0.3 required=5.0 tests=BAYES_00,LOCAL_FROM, T_DATE_IN_FUTURE_96_Q autolearn=no version=3.3.2 X-Spam-Report: * 0.0 T_DATE_IN_FUTURE_96_Q Date: is 4 days to 4 months after Received: * date * -2.3 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 2.6 LOCAL_FROM From my domains X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on hz.grosbein.net X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 31 Oct 2015 20:15:11 -0000 On 01.11.2015 01:11, Adrian Chadd wrote: > Hi, > > I don't see any DELAY in my testing, nor MipsUserIntr, so yeah, I must > be doing something different. I've removed options HWPMC_MIPS_BACKTRACE from the kernel and now pmcstat shows no MipsUserIntr and I've got full CPU load for same inter-vlan bridging test: # vmstat 1 procs memory page disks faults cpu r b w avm fre flt re pi po fr sr fl0 md0 in sy cs us sy id 0 0 0 85M 74M 86 0 1 0 66 3 0 0 2633 3117 223 2 40 57 0 0 0 85M 74M 0 0 0 0 0 3 0 0 5049 116 858 0 100 0 0 0 0 85M 74M 0 0 0 0 0 6 0 0 5896 111 738 0 100 0 0 0 0 85M 74M 0 0 0 0 0 6 0 0 6115 111 687 0 100 0 0 0 0 85M 74M 0 0 0 0 0 6 0 0 3789 118 499 0 100 0 0 0 0 85M 74M 0 0 0 0 0 3 0 0 3789 111 592 1 99 1 0 0 0 85M 74M 0 0 0 0 0 6 0 0 5474 111 689 1 98 1 0 0 0 85M 74M 0 0 0 0 0 3 0 0 5234 111 762 0 100 0 0 0 0 85M 74M 0 0 0 0 0 6 0 0 4810 111 648 0 99 1 0 0 0 85M 74M 0 0 0 0 0 3 0 0 4884 111 653 0 100 0 0 0 0 85M 74M 0 0 0 0 0 6 0 0 4914 111 629 1 99 1 0 0 0 85M 74M 0 0 0 0 0 6 0 0 5679 111 713 0 100 0 0 0 0 85M 74M 0 0 0 0 0 3 0 0 4417 111 698 0 100 0 0 0 0 85M 74M 0 0 0 0 0 6 0 0 6107 118 621 0 100 0 0 0 0 85M 74M 0 0 0 0 0 6 0 1 4251 111 594 0 100 0 0 0 0 85M 74M 0 0 0 0 0 3 0 0 6050 111 747 0 100 0 0 0 0 85M 74M 0 0 0 0 0 6 0 0 4487 111 698 0 99 1 0 0 0 85M 74M 0 0 0 0 0 6 0 0 5104 111 624 0 100 0 0 0 0 85M 74M 0 0 0 0 0 3 0 0 4762 115 818 0 99 1 0 0 0 85M 74M 0 0 0 0 0 6 0 0 6223 111 706 0 100 0 0 0 0 85M 74M 0 0 0 0 0 6 0 0 6020 111 719 0 100 0 0 0 0 85M 74M 0 0 0 0 0 6 0 0 5950 111 818 0 100 0 0 0 0 85M 74M 0 0 0 0 0 6 0 0 5373 118 761 0 100 0 0 0 0 85M 74M 0 0 0 0 0 6 0 0 5488 111 729 0 100 0 0 0 0 85M 74M 0 0 0 0 0 6 0 0 5527 117 691 0 100 0 0 0 0 85M 74M 0 0 0 0 0 3 0 0 6637 119 916 0 100 0 0 0 0 85M 74M 0 0 0 0 0 6 0 0 3980 111 634 1 99 0 0 0 0 85M 74M 0 0 0 0 0 6 0 0 6396 111 932 0 100 0 However, speed is still no more than 59,5MByte/s. Does arge(4) driver support DEVICE_POLLING? When CPU is overloaded with interrupts, userland has no cycles to run. From owner-freebsd-mips@freebsd.org Sat Oct 31 20:20:19 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5D874A22952 for ; Sat, 31 Oct 2015 20:20:19 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: from mail-ig0-x236.google.com (mail-ig0-x236.google.com [IPv6:2607:f8b0:4001:c05::236]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 3ADF21F1F for ; Sat, 31 Oct 2015 20:20:19 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: by igbhv6 with SMTP id hv6so31903136igb.0 for ; Sat, 31 Oct 2015 13:20:18 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=0buN/gSBj/IrMGOdfMRwuji0mu80WdhlbmxW5fYxLBs=; b=PhWXaDkRhGyOTUSvOhJV9onWFNJvTnGXgLMmk9o5KR6DrezRTrWMn2orF2zUX+dRE/ EqANbt0HC68Hp98RYN9lzGm9hkCF51mmvFcXHy9Gl+xiNxwvf7qydl5Qnoy1fkLyKFtA aFbj3MwAmAcGoKV6LLOTAHS3Awo1Bu4LI+nowF21YRycsktqo88JqhvPTv4z8d3ytEG9 0R1zORmYkkVkmLQ5CQ7gE1kvWwQFHt4ByjRcJyrOseV0MKUrWAHFkXSa4arXcpsPg0H1 ZATUA9R8piuuNbrP6XwTd/aT5EtHnLtzM/79WWZvvT6ApY8p+ejoHe8PVuMEoLoIL3u2 lJkQ== MIME-Version: 1.0 X-Received: by 10.50.164.196 with SMTP id ys4mr4695543igb.37.1446322818513; Sat, 31 Oct 2015 13:20:18 -0700 (PDT) Received: by 10.36.46.66 with HTTP; Sat, 31 Oct 2015 13:20:18 -0700 (PDT) In-Reply-To: <56352143.7080006@grosbein.net> References: <56348063.3090508@grosbein.net> <56348239.3050701@grosbein.net> <563500FC.8020201@grosbein.net> <56352143.7080006@grosbein.net> Date: Sat, 31 Oct 2015 16:20:18 -0400 Message-ID: Subject: Re: CPU underload From: Adrian Chadd To: Eugene Grosbein Cc: "freebsd-mips@freebsd.org" Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 31 Oct 2015 20:20:19 -0000 Hi, cool. Yeah, I'll go fix the userland alignment spew next week and add some more useful output / rate limiting. polling is broken on arge. I haven't fixed that yet. That's actually next on my list now that your issues have been resolved! -adrian From owner-freebsd-mips@freebsd.org Sat Oct 31 20:26:02 2015 Return-Path: Delivered-To: freebsd-mips@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id AE764A22A88 for ; Sat, 31 Oct 2015 20:26:02 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from hz.grosbein.net (hz.grosbein.net [78.47.246.247]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 325061167; Sat, 31 Oct 2015 20:26:01 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from eg.sd.rdtc.ru (root@eg.sd.rdtc.ru [62.231.161.221]) by hz.grosbein.net (8.14.9/8.14.9) with ESMTP id t9VKPpIl051586 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT); Sat, 31 Oct 2015 21:25:52 +0100 (CET) (envelope-from eugen@grosbein.net) X-Envelope-From: eugen@grosbein.net X-Envelope-To: adrian@freebsd.org Received: from eg.sd.rdtc.ru (eugen@localhost [127.0.0.1]) by eg.sd.rdtc.ru (8.15.2/8.15.2) with ESMTP id t9VKPkDG053174; Sun, 1 Nov 2015 03:25:47 +0700 (KRAT) (envelope-from eugen@grosbein.net) Subject: Re: CPU underload To: Adrian Chadd References: <56348063.3090508@grosbein.net> <56348239.3050701@grosbein.net> <563500FC.8020201@grosbein.net> <5635148B.2070307@grosbein.net> <56351AA6.80903@grosbein.net> Cc: "freebsd-mips@freebsd.org" From: Eugene Grosbein Message-ID: <563523CA.3040207@grosbein.net> Date: Sun, 1 Nov 2015 03:25:46 +0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.2.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=0.3 required=5.0 tests=BAYES_00,LOCAL_FROM autolearn=no version=3.3.2 X-Spam-Report: * -2.3 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 2.6 LOCAL_FROM From my domains X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on hz.grosbein.net X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 31 Oct 2015 20:26:02 -0000 On 01.11.2015 03:10, Adrian Chadd wrote: > Hm, okay. Try doing ping -i 0.01 (ie, every 10ms.) I wonder if it's > happening more frequently and we're hitting sampling bias. Now without HWPMC_MIPS_BACKTRACE and with full CPU load it started dropping packets under load, both with "-i 0.1" and "-i 0.01": # ping -c 450 -s 1472 -i 0.1 192.168.3.1 [skip] 450 packets transmitted, 425 packets received, 5.6% packet loss round-trip min/avg/max/stddev = 0.285/0.715/7.184/0.383 ms # ping -c 4500 -s 1472 -i 0.01 192.168.3.1 [skip] 4500 packets transmitted, 4284 packets received, 4.8% packet loss round-trip min/avg/max/stddev = 0.238/0.725/7.677/0.389 ms In the latter case: # grep -v 'time=[01]' log PING 192.168.3.1 (192.168.3.1): 1472 data bytes 1480 bytes from 192.168.3.1: icmp_seq=5 ttl=64 time=7.017 ms 1480 bytes from 192.168.3.1: icmp_seq=101 ttl=64 time=6.517 ms 1480 bytes from 192.168.3.1: icmp_seq=490 ttl=64 time=2.121 ms 1480 bytes from 192.168.3.1: icmp_seq=684 ttl=64 time=2.640 ms 1480 bytes from 192.168.3.1: icmp_seq=1165 ttl=64 time=2.987 ms 1480 bytes from 192.168.3.1: icmp_seq=1453 ttl=64 time=6.688 ms 1480 bytes from 192.168.3.1: icmp_seq=2419 ttl=64 time=2.769 ms 1480 bytes from 192.168.3.1: icmp_seq=2515 ttl=64 time=4.655 ms 1480 bytes from 192.168.3.1: icmp_seq=2612 ttl=64 time=4.706 ms 1480 bytes from 192.168.3.1: icmp_seq=2902 ttl=64 time=7.677 ms 1480 bytes from 192.168.3.1: icmp_seq=2998 ttl=64 time=7.548 ms 1480 bytes from 192.168.3.1: icmp_seq=3095 ttl=64 time=3.359 ms 1480 bytes from 192.168.3.1: icmp_seq=3191 ttl=64 time=5.047 ms 1480 bytes from 192.168.3.1: icmp_seq=3483 ttl=64 time=7.278 ms 1480 bytes from 192.168.3.1: icmp_seq=3579 ttl=64 time=7.192 ms 1480 bytes from 192.168.3.1: icmp_seq=3870 ttl=64 time=6.866 ms 1480 bytes from 192.168.3.1: icmp_seq=3967 ttl=64 time=4.824 ms 1480 bytes from 192.168.3.1: icmp_seq=4063 ttl=64 time=4.385 ms 1480 bytes from 192.168.3.1: icmp_seq=4352 ttl=64 time=7.525 ms 1480 bytes from 192.168.3.1: icmp_seq=4450 ttl=64 time=2.993 ms --- 192.168.3.1 ping statistics --- 4500 packets transmitted, 4284 packets received, 4.8% packet loss round-trip min/avg/max/stddev = 0.238/0.725/7.677/0.389 ms