Date: Tue, 7 Jun 2016 15:22:25 +0300 From: Andrew Vylegzhanin <avv314@gmail.com> To: "freebsd-net@freebsd.org" <freebsd-net@freebsd.org> Cc: Luigi Rizzo <rizzo@iet.unipi.it>, Ryan Stone <rysto32@gmail.com> Subject: Re: Is netmap jumbo frames broken in STABLE? Message-ID: <CA%2BBi_YiqcOTw7T_dDzjis8yFu7oGd8G-av2BEaStXFiU7ovUCw@mail.gmail.com> In-Reply-To: <CAFMmRNy=PEFOxM4tGM7TQqpMnhTba17ACiaOcfuG8fkDET0RZw@mail.gmail.com> References: <CA%2BBi_YhqCnt5pQ_hC5zWdBp24=Zn3Rcj29AwtMrguPhSoJZSdQ@mail.gmail.com> <CA%2BhQ2%2BjcT_E4osrTB00%2Bf0gwSCoG_Zy%2BVdU8LXndqsjnmxPQ3Q@mail.gmail.com> <CAFMmRNy=PEFOxM4tGM7TQqpMnhTba17ACiaOcfuG8fkDET0RZw@mail.gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
Just for support Luigi assumption.
I've tested on 11.0-ALPHA1 (r301204).
Same situation with frame size 5166 and works _well_ with frame size 4032.
--
Andrew
2016-06-07 1:47 GMT+03:00 Ryan Stone <rysto32@gmail.com>:
> The use of mbuf clusters larger than a single page really doesn't work.
> The problem is that over time physical memory becomes fragmented and
> eventually 9K of contiguous memory can't be allocated anymore. This is w=
hy
> many drivers now limit themselves to page-sized clusters.
>
> On Mon, Jun 6, 2016 at 10:03 AM, Luigi Rizzo <rizzo@iet.unipi.it> wrote:
>
>> On Mon, Jun 6, 2016 at 3:22 PM, Andrew Vylegzhanin <avv314@gmail.com>
>> wrote:
>>
>> > Hello all,
>> >
>> >
>> > I have an application that uses netmap for capture jumbo frames. The
>> frames
>> > are fixed size and have fixed rate (for example size 5166, rate 50000
>> pps).
>> > The frames are pure Ethernet, without IP header.
>> >
>> >
>> > Everything works fine in 10.0-RELEASE, 10.1-RELEASE.
>> >
>> >
>> > Starting from 10.3 and actual 10-STABLE I've got wrong data from netma=
p
>> > ring. It's looks like packet data broke and packet split on two parts
>> 4092
>> > and 1070 bytes, where original size was 5166.
>> >
>> > A code ring precessing is based on macros from netmap_user.h :
>> >
>> >
>> > n =3D nm_ring_space(ring);
>> >
>> > for (rx =3D 0; rx < limit; rx++) {
>> >
>> > struct netmap_slot *slot =3D &ring->slot[cur];
>> >
>> > char *p =3D NETMAP_BUF(ring, slot->buf_idx);
>> >
>> > process_payload(p, slot->len, datapx);
>> >
>> > cur =3D nm_ring_next(ring, cur);
>> >
>> > }
>> >
>> > ring->head =3D ring->cur =3D cur;
>> >
>> >
>> > Here is netmap sysctl's:
>> >
>> > dev.netmap.buf_num=3D81920
>> >
>> > dev.netmap.ring_size=3D73728
>> >
>> > dev.netmap.buf_size=3D5248
>> >
>> >
>> > Hardware is Dell R720 (2x E5-2643 v2) with four Intel Ethernet 10G 2P
>> X520
>> > Adapter. I use only one hardware queue per interface.
>> >
>> >
>> > BTW, may be a new version of Intel ixgbe driver (3.1.13-k) is a reason=
?
>> >
>> >
>> =E2=80=8BHi,
>> yes I suspect the problem may be in the new ixgbe driver,
>> probably it programs the hardware to limit buffer sizes to 4k
>> even when large MTUs are in use,
>> so the receiver will split
>> the incoming frame in two buffers, while netmap is expecting
>> only one.
>> I suggest to have a look at the ioctl handler (in the driver)
>> that handles the MTU setting and compare with the code
>> in the previous driver.
>>
>> cheers
>> luigi
>>
>>
>> > Does it make sense to try with 11-CURRENT?
>> >
>> >
>> > Thank you in advance.
>> >
>> >
>> > --
>> >
>> > Andrew
>> > _______________________________________________
>> > freebsd-net@freebsd.org mailing list
>> > https://lists.freebsd.org/mailman/listinfo/freebsd-net
>> > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org"
>> >
>>
>>
>>
>> --
>> -----------------------------------------+------------------------------=
-
>> Prof. Luigi RIZZO, rizzo@iet.unipi.it . Dip. di Ing. dell'Informazione
>> http://www.iet.unipi.it/~luigi/ . Universita` di Pisa
>> TEL +39-050-2217533 . via Diotisalvi 2
>> Mobile +39-338-6809875 . 56122 PISA (Italy)
>> -----------------------------------------+------------------------------=
-
>> _______________________________________________
>> freebsd-net@freebsd.org mailing list
>> https://lists.freebsd.org/mailman/listinfo/freebsd-net
>> To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org"
>>
>
>
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CA%2BBi_YiqcOTw7T_dDzjis8yFu7oGd8G-av2BEaStXFiU7ovUCw>