Date: Tue, 29 Jan 2019 11:25:24 +0000 From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 230465] ixl: not working in netmap mode Message-ID: <bug-230465-7501-O2IaVV6buk@https.bugs.freebsd.org/bugzilla/> In-Reply-To: <bug-230465-7501@https.bugs.freebsd.org/bugzilla/> References: <bug-230465-7501@https.bugs.freebsd.org/bugzilla/>
next in thread | previous in thread | raw e-mail | index | archive | help
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D230465 --- Comment #20 from Charles Goncalves <halfling@halfling.com.br> --- (In reply to Vincenzo Maffione from comment #19) Oh yes now I remember it's about 5 months. I had set this to max_queues =3D= 1 (in /boot/loader.conf) to test with pkt-gen, because with max_queues =3D 8 doen= s't work. Output of pkt-gen with hw.ixl.max_queues=3D1: # pkt-gen -i ixl0 -f tx 945.763330 main [2593] interface is ixl0 945.763376 main [2727] running on 1 cpus (have 8) 945.763602 extract_ip_range [468] range is 10.0.0.1:1234 to 10.0.0.1:1234 945.763619 extract_ip_range [468] range is 10.1.0.1:1234 to 10.1.0.1:1234 945.907652 main [2822] mapped 294020KB at 0x801600000 Sending on netmap:ixl0: 1 queues, 1 threads and 1 cpus. 10.0.0.1 -> 10.1.0.1 (00:00:00:00:00:00 -> ff:ff:ff:ff:ff:ff) 945.907746 main [2919] Sending 512 packets every 0.000000000 s 945.907791 start_threads [2274] Wait 2 secs for phy reset 947.974562 start_threads [2276] Ready... 947.974737 sender_body [1464] start, fd 3 main_fd 3 947.989037 sender_body [1546] drop copy 949.001809 main_thread [2364] 4.285 Mpps (4.401 Mpkts 2.112 Gbps in 1027068 usec) 343.53 avg_batch 0 min_space 950.016811 main_thread [2364] 4.265 Mpps (4.329 Mpkts 2.078 Gbps in 1015002 usec) 341.05 avg_batch 99999 min_space 951.053574 main_thread [2364] 4.212 Mpps (4.367 Mpkts 2.096 Gbps in 1036763 usec) 341.39 avg_batch 99999 min_space 952.054597 main_thread [2364] 4.262 Mpps (4.266 Mpkts 2.048 Gbps in 1001023 usec) 341.66 avg_batch 99999 min_space Now with hw.ixl.max_queues=3D8: # pkt-gen -i ixl0 -f tx 734.500918 main [2593] interface is ixl0 734.500963 main [2727] running on 1 cpus (have 8) 734.501188 extract_ip_range [468] range is 10.0.0.1:1234 to 10.0.0.1:1234 734.501205 extract_ip_range [468] range is 10.1.0.1:1234 to 10.1.0.1:1234 734.651421 main [2822] mapped 294020KB at 0x801600000 Sending on netmap:ixl0: 8 queues, 1 threads and 1 cpus. 10.0.0.1 -> 10.1.0.1 (00:00:00:00:00:00 -> ff:ff:ff:ff:ff:ff) 734.651514 main [2919] Sending 512 packets every 0.000000000 s 734.651558 start_threads [2274] Wait 2 secs for phy reset 736.666615 start_threads [2276] Ready... 736.666799 sender_body [1464] start, fd 3 main_fd 3 737.506822 sender_body [1538] poll error on 3 ring 0-7 737.677616 main_thread [2364] 8.103 Kpps (8.191 Kpkts 3.932 Mbps in 1010813 usec) 511.94 avg_batch 0 min_space 737.856747 main_thread [2391] ouch, thread 0 exited with error Sent 8191 packets 491460 bytes 16 events 60 bytes each in -1548760736.67 seconds. Speed: -0.000 pps Bandwidth: -0.003 bps (raw -0.004 bps). Average batch: 51= 1.94 pkts Then with max_queues=3D8 I have errors in my /var/log/messages: Jan 29 09:21:29 rt1 kernel: 888.923727 [1637] nm_txsync_prologue ixl0 TX1: fail 'kring->nr_hwcur >=3D n || kring->rhead >=3D n || kring->rtail >= =3D n || kring->nr_hwtail >=3D n' h 0 c 0 t -1678351873 rh 512 rc 512 rt -1678351873= hc 512 ht -1678351873 Jan 29 09:21:29 rt1 kernel: 888.981468 [1758] netmap_ring_reinit cal= led for ixl0 TX1 Jan 29 09:21:29 rt1 kernel: 888.998372 [1783] netmap_ring_reinit tot= al 1 errors Jan 29 09:21:29 rt1 kernel: 889.013966 [1787] netmap_ring_reinit ixl0 TX1 reinit, cur 0 -> 512 tail -1678351873 -> -1678351873 Jan 29 09:21:29 rt1 kernel: 889.041778 [1637] nm_txsync_prologue ixl0 TX2: fail 'kring->nr_hwcur >=3D n || kring->rhead >=3D n || kring->rtail >= =3D n || kring->nr_hwtail >=3D n' h 0 c 0 t -1676512769 rh 512 rc 512 rt -1676512769= hc 512 ht -1676512769 Jan 29 09:21:29 rt1 kernel: 889.099769 [1758] netmap_ring_reinit cal= led for ixl0 TX2 Jan 29 09:21:29 rt1 kernel: 889.116664 [1783] netmap_ring_reinit tot= al 1 errors Jan 29 09:21:29 rt1 kernel: 889.132258 [1787] netmap_ring_reinit ixl0 TX2 reinit, cur 0 -> 512 tail -1676512769 -> -1676512769 Jan 29 09:21:29 rt1 kernel: 889.160084 [1637] nm_txsync_prologue ixl0 TX3: fail 'kring->nr_hwcur >=3D n || kring->rhead >=3D n || kring->rtail >= =3D n || kring->nr_hwtail >=3D n' h 0 c 0 t -1674673665 rh 512 rc 512 rt -1674673665= hc 512 ht -1674673665 Jan 29 09:21:29 rt1 kernel: 889.218053 [1758] netmap_ring_reinit cal= led for ixl0 TX3 Jan 29 09:21:29 rt1 kernel: 889.234957 [1783] netmap_ring_reinit tot= al 1 errors Jan 29 09:21:29 rt1 kernel: 889.250560 [1787] netmap_ring_reinit ixl0 TX3 reinit, cur 0 -> 512 tail -1674673665 -> -1674673665 Jan 29 09:21:29 rt1 kernel: 889.278372 [1637] nm_txsync_prologue ixl0 TX4: fail 'kring->nr_hwcur >=3D n || kring->rhead >=3D n || kring->rtail >= =3D n || kring->nr_hwtail >=3D n' h 0 c 0 t -1672834561 rh 512 rc 512 rt -1672834561= hc 512 ht -1672834561 Jan 29 09:21:29 rt1 kernel: 889.336348 [1758] netmap_ring_reinit cal= led for ixl0 TX4 Jan 29 09:21:29 rt1 kernel: 889.353258 [1783] netmap_ring_reinit tot= al 1 errors Jan 29 09:21:29 rt1 kernel: 889.368847 [1787] netmap_ring_reinit ixl0 TX4 reinit, cur 0 -> 512 tail -1672834561 -> -1672834561 Jan 29 09:21:29 rt1 kernel: 889.396679 [1637] nm_txsync_prologue ixl0 TX5: fail 'kring->nr_hwcur >=3D n || kring->rhead >=3D n || kring->rtail >= =3D n || kring->nr_hwtail >=3D n' h 0 c 0 t -1670995457 rh 512 rc 512 rt -1670995457= hc 512 ht -1670995457 Jan 29 09:21:29 rt1 kernel: 889.454648 [1758] netmap_ring_reinit cal= led for ixl0 TX5 Jan 29 09:21:29 rt1 kernel: 889.471553 [1783] netmap_ring_reinit tot= al 1 errors Jan 29 09:21:29 rt1 kernel: 889.487148 [1787] netmap_ring_reinit ixl0 TX5 reinit, cur 0 -> 512 tail -1670995457 -> -1670995457 Jan 29 09:21:29 rt1 kernel: 889.514967 [1637] nm_txsync_prologue ixl0 TX6: fail 'kring->nr_hwcur >=3D n || kring->rhead >=3D n || kring->rtail >= =3D n ||=20 Jan 29 09:21:29 rt1 kernel: kring->nr_hwtail >=3D n' h 0 c 0 t -1669156353 = rh 512 rc 512 rt -1669156353 hc 512 ht -1669156353 Jan 29 09:21:29 rt1 kernel: 889.572947 [1758] netmap_ring_reinit cal= led for ixl0 TX6 Jan 29 09:21:29 rt1 kernel: 889.589850 [1783] netmap_ring_reinit tot= al 1 errors Jan 29 09:21:29 rt1 kernel: 889.605444 [1787] netmap_ring_reinit ixl0 TX6 reinit, cur 0 -> 512 tail -1669156353 -> -1669156353 Jan 29 09:21:29 rt1 kernel: 889.633261 [1758] netmap_ring_reinit cal= led for ixl0 TX7 Jan 29 09:21:29 rt1 kernel: 889.650170 [1783] netmap_ring_reinit tot= al 1 errors Jan 29 09:21:29 rt1 kernel: 889.665760 [1787] netmap_ring_reinit ixl0 TX7 reinit, cur 0 -> 512 tail -1667321345 -> -1667321345 I also test this in my netmap application and with these tests I think that when a application try to write in txring > 0 like TX1, TX2 or so this error occurs --=20 You are receiving this mail because: You are on the CC list for the bug.=
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?bug-230465-7501-O2IaVV6buk>