Skip site navigation (1)Skip section navigation (2)
Date:      Tue, 19 Feb 2013 11:35:43 +0500
From:      Tahir Rauf <tahir.rauf1@gmail.com>
To:        Luigi Rizzo <rizzo@iet.unipi.it>
Cc:        freebsd-current <freebsd-current@freebsd.org>
Subject:   Re: netmap error (Unable to get if info for eth1)
Message-ID:  <CAOx3-HLNa1Q4R7L-5vmbmi05ceqfmhHmJd6qf1qRM3W4ax8c6g@mail.gmail.com>
In-Reply-To: <CA%2BhQ2%2BgdtRBYVCnBMTQxH9frWpmn07X14gdreuQbbhUXTodKsA@mail.gmail.com>
References:  <CAOx3-HKjHK4v7zBtw_XiE0PoSN2Bt1r5wBNhAdxRofGd78PWZg@mail.gmail.com> <CA%2BhQ2%2BgdtRBYVCnBMTQxH9frWpmn07X14gdreuQbbhUXTodKsA@mail.gmail.com>

next in thread | previous in thread | raw e-mail | index | archive | help
Dear Luigui,

Thanks for your prompt answer. Below I try to give complete information so
that it becomes easy for you to identify the problem.

*netmap version used*:
20120813 new unified source code for Linux and FreeBSD

*System credentials:*
O/S: Ubuntu 12.04 LTS
machine: x86_64
processor: x86_64
O/S kernel version: #51-Ubuntu SMP Wed Sep 26 21:33:09 UTC 2012
O/S kernel release: 3.2.0-32-generic

*10G NIC used*
product: 82598EB 10-Gigabit AF Dual Port Network Connection
vendor: Intel Corporation
physical id: 0
bus info: pci@0000:01:00.0
logical name: eth1
version: 01
serial: 00:1b:21:c1:6d:e3
width: 32 bits
capabilities: pm msi msix pciexpress bus_master cap_list ethernet physical
fibre
configuration: autonegotiation=off broadcast=yes driver=ixgbe
driverversion=3.6.7-k duplex=full firmware=0xc1b30000 latency=0 link=yes
multicast=yes
resources: irq:16 memory:f7ba0000-f7bbffff memory:f7b40000-f7b7ffff
ioport:e020(size=32) memory:f7bc4000-f7bc7fff

*Pkt-gen command*
sudo ./pkt-gen -i eth1 tx -n 500111222 -l 60 -w 5

*Output of pkt-gen program*
tahir@tahir-desktop:~/Desktop/netmap-old/examples$ sudo ./pkt-gen -i eth1
tx -n 500111222 -l 60 -w 5
extract_ip_range [119] extract IP range from 10.0.0.1
extract_ip_range [129] 10.0.0.1 starts at 10.0.0.1
extract_ip_range [119] extract IP range from 10.1.0.1
extract_ip_range [129] 10.1.0.1 starts at 10.1.0.1
extract_mac_range [135] extract MAC range from 00:1b:21:c1:6d:e3
extract_mac_range [150] 00:1b:21:c1:6d:e3 starts at 0:1b:21:c1:6d:e3
extract_mac_range [135] extract MAC range from ff:ff:ff:ff:ff:ff
extract_mac_range [150] ff:ff:ff:ff:ff:ff starts at ff:ff:ff:ff:ff:ff
main [1053] map size is 207712 Kb
main [1059] Unable to get if info for eth1
main [1066] bad nthreads 1, have 0 queues
main [1075] mmapping 207712 Kbytes
main [1094] Unable to register interface eth1
Receiving from eth1: 0 queues, 1 threads and 1 cpus.
main [1128] Wait 5 secs for phy reset
main [1130] Ready...
main [1181] Unable to register eth1
main [1242] 0 pps
Received 0 packets, in 0.00 seconds.
Speed: -nanpps.

*Sequence of commands used*
sudo insmod netmap_lin.ko
sudo rmmod ixgbe
sudo insmod ixgbe/ixgbe.ko
sudo ./pkt-gen -i eth1 tx -n 500111222 -l 60 -w 5

*Dmesg output*
[82904.219757] 549.080148 netmap_new_obj_allocator [426] objsize 1024
clustsize 4096 objects 4
[82904.219837] 549.080229 netmap_new_obj_allocator [504] Pre-allocated 128
clusters (4/512KB) for 'netmap_if'
[82904.219841] 549.080233 netmap_new_obj_allocator [426] objsize 36864
clustsize 36864 objects 1
[82904.221431] 549.081825 netmap_new_obj_allocator [504] Pre-allocated 200
clusters (36/7200KB) for 'netmap_ring'
[82904.221436] 549.081833 netmap_new_obj_allocator [426] objsize 2048
clustsize 4096 objects 2
[82904.251034] 549.111513 netmap_new_obj_allocator [504] Pre-allocated
50000 clusters (4/200000KB) for 'netmap_buf'
[82904.251038] 549.111520 netmap_memory_init [554] Have 512 KB for
interfaces, 7200 KB for rings and 195 MB for buffers
[82904.251039] netmap: loaded module with 202 Mbytes
[82918.659224] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver -
version 3.6.7-k
[82918.659228] ixgbe: Copyright (c) 1999-2011 Intel Corporation.
[82918.659260] ixgbe 0000:01:00.0: PCI INT A -> GSI 16 (level, low) -> IRQ
16
[82918.659276] ixgbe 0000:01:00.0: setting latency timer to 64
[82920.223583] ixgbe 0000:01:00.0: irq 53 for MSI/MSI-X
[82920.223592] ixgbe 0000:01:00.0: irq 54 for MSI/MSI-X
[82920.223597] ixgbe 0000:01:00.0: irq 55 for MSI/MSI-X
[82920.223603] ixgbe 0000:01:00.0: irq 56 for MSI/MSI-X
[82920.223608] ixgbe 0000:01:00.0: irq 57 for MSI/MSI-X
[82920.223614] ixgbe 0000:01:00.0: irq 58 for MSI/MSI-X
[82920.223619] ixgbe 0000:01:00.0: irq 59 for MSI/MSI-X
[82920.223625] ixgbe 0000:01:00.0: irq 60 for MSI/MSI-X
[82920.223630] ixgbe 0000:01:00.0: irq 61 for MSI/MSI-X
[82920.223649] ixgbe 0000:01:00.0: Multiqueue Enabled: Rx Queue count = 8,
Tx Queue count = 8
[82920.223797] ixgbe 0000:01:00.0: (PCI Express:2.5GT/s:Width x8)
00:1b:21:c1:6d:e3
[82920.223871] ixgbe 0000:01:00.0: MAC: 1, PHY: 7, SFP+: 0, PBA No:
E37002-011
[82920.224934] ixgbe 0000:01:00.0: Intel(R) 10 Gigabit Network Connection
[82920.224957] ixgbe 0000:01:00.1: PCI INT B -> GSI 17 (level, low) -> IRQ
17
[82920.224971] ixgbe 0000:01:00.1: setting latency timer to 64
[82920.305560] ADDRCONF(NETDEV_UP): eth1: link is not ready
[82920.306249] ADDRCONF(NETDEV_UP): eth1: link is not ready
[82921.727292] ixgbe 0000:01:00.1: irq 62 for MSI/MSI-X
[82921.727301] ixgbe 0000:01:00.1: irq 63 for MSI/MSI-X
[82921.727307] ixgbe 0000:01:00.1: irq 64 for MSI/MSI-X
[82921.727313] ixgbe 0000:01:00.1: irq 65 for MSI/MSI-X
[82921.727319] ixgbe 0000:01:00.1: irq 66 for MSI/MSI-X
[82921.727324] ixgbe 0000:01:00.1: irq 67 for MSI/MSI-X
[82921.727330] ixgbe 0000:01:00.1: irq 68 for MSI/MSI-X
[82921.727336] ixgbe 0000:01:00.1: irq 69 for MSI/MSI-X
[82921.727341] ixgbe 0000:01:00.1: irq 70 for MSI/MSI-X
[82921.727359] ixgbe 0000:01:00.1: Multiqueue Enabled: Rx Queue count = 8,
Tx Queue count = 8
[82921.727508] ixgbe 0000:01:00.1: (PCI Express:2.5GT/s:Width x8)
00:1b:21:c1:6d:e2
[82921.727582] ixgbe 0000:01:00.1: MAC: 1, PHY: 7, SFP+: 0, PBA No:
E37002-011
[82921.728677] ixgbe 0000:01:00.1: Intel(R) 10 Gigabit Network Connection
[82921.754094] ADDRCONF(NETDEV_UP): eth2: link is not ready
[82921.754635] ADDRCONF(NETDEV_UP): eth2: link is not ready
[82921.793753] ixgbe 0000:01:00.0: eth1: detected SFP+: 0
[82923.189007] ixgbe 0000:01:00.1: eth2: detected SFP+: 0
[82925.922486] ixgbe 0000:01:00.1: eth2: NIC Link is Up 10 Gbps, Flow
Control: RX/TX
[82925.923286] ADDRCONF(NETDEV_CHANGE): eth2: link becomes ready
[82925.958596] ixgbe 0000:01:00.0: eth1: NIC Link is Up 10 Gbps, Flow
Control: RX/TX
[82925.959037] ADDRCONF(NETDEV_CHANGE): eth1: link becomes ready
[82936.420026] eth2: no IPv6 routers present
[82937.840689] eth1: no IPv6 routers present

*NOTE*: It is important to note that both realteck and igb is working. I
made little change in  if_e1000e_netmap.h file and add following lines to
eliminate few problems for my linux kernel version Ubuntu
3.2.0-32.51-generic.

#define E1000_GET_DESC(R, i, type)      (&(((struct type *)((R).desc))[i]))
#define E1000_RX_DESC(R, i)             E1000_GET_DESC(R, i, e1000_rx_desc)


Regards

On Tue, Feb 19, 2013 at 10:57 AM, Luigi Rizzo <rizzo@iet.unipi.it> wrote:

> On Mon, Feb 18, 2013 at 9:51 PM, Tahir Rauf <tahir.rauf1@gmail.com> wrote:
>
>> Hi all,
>>
>> I am giving netmap a try and have tested it on my Realtech and Intel 1G
>> NICs (by using r8169 and e1000e kernel modules), and it is working fine.
>>
>> However, I am facing problem while running it on my intel 10G NIC (82598EB
>> 10-Gigabit AF Dual Port Network Connection). Whenever, I run the pkt-gen
>> example with 10G interface, it shows me following error
>>
>>
> likely you are running an unpatched version of the ixgbe driver.
> Does dmesg say anything about netmap when loading the ixgbe driver ?
> (also which version of the code are you using ? it seems you
> are running linux...)
>
> cheers
> luigi
>
> =======================================================================
>> sudo ./pkt-gen -i eth1 -f tx -l 60
>> extract_ip_range [119] extract IP range from 10.0.0.1
>> extract_ip_range [129] 10.0.0.1 starts at 10.0.0.1
>> extract_ip_range [119] extract IP range from 10.1.0.1
>> extract_ip_range [129] 10.1.0.1 starts at 10.1.0.1
>> extract_mac_range [135] extract MAC range from 00:1b:21:ce:f3:6a
>> extract_mac_range [150] 00:1b:21:ce:f3:6a starts at 0:1b:21:ce:f3:6a
>> extract_mac_range [135] extract MAC range from ff:ff:ff:ff:ff:ff
>> extract_mac_range [150] ff:ff:ff:ff:ff:ff starts at ff:ff:ff:ff:ff:ff
>> main [1053] map size is 207712 Kb
>> main [1059] Unable to get if info for eth1
>> main [1066] bad nthreads 1, have 0 queues
>> main [1075] mmapping 207712 Kbytes
>> main [1094] Unable to register interface eth1
>> Sending on eth1: 0 queues, 1 threads and 1 cpus.
>> 10.0.0.1 -> 10.1.0.1 (00:1b:21:ce:f3:6a -> ff:ff:ff:ff:ff:ff)
>> main [1128] Wait 2 secs for phy reset
>> main [1130] Ready...
>> main [1181] Unable to register eth1
>> main [1242] 0 pps
>> Sent 0 packets, 60 bytes each, in 0.00 seconds.
>> =======================================================================
>>
>> Any idea that what's going wrong here?
>>
>> Regards
>>
>> Tahir Rauf
>> (+92) 312-7767761
>>
>> --------------------------------------------------------------------------------------------------------------------------------------------------------------
>> This electronic message transmission contains information from the Company
>> that may be proprietary, confidential and/or privileged. The information
>> is
>> intended only for the use of the individuals or entity named above. If you
>> are not the intended recipient, be aware that any disclosure, copying or
>> distribution or use of the contents of this information is prohibited. If
>> you have received this electronic transmission in error, please notify the
>> sender immediately by replying to this email.
>> _______________________________________________
>> freebsd-current@freebsd.org mailing list
>> http://lists.freebsd.org/mailman/listinfo/freebsd-current
>> To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org
>> "
>>
>
>
>
> --
> -----------------------------------------+-------------------------------
>  Prof. Luigi RIZZO, rizzo@iet.unipi.it  . Dip. di Ing. dell'Informazione
>  http://www.iet.unipi.it/~luigi/        . Universita` di Pisa
>  TEL      +39-050-2211611               . via Diotisalvi 2
>  Mobile   +39-338-6809875               . 56122 PISA (Italy)
> -----------------------------------------+-------------------------------
>



-- 
Tahir Rauf



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CAOx3-HLNa1Q4R7L-5vmbmi05ceqfmhHmJd6qf1qRM3W4ax8c6g>