Skip site navigation (1)Skip section navigation (2)
Date:      Fri, 26 Oct 2018 15:30:30 +0300
From:      Lev Serebryakov <lev@FreeBSD.org>
To:        freebsd-net@freebsd.org
Subject:   What are conditions to spread traffic across different NIC queues?
Message-ID:  <cbcadec2-bf74-a1a9-2c66-97d9d409907f@FreeBSD.org>

next in thread | raw e-mail | index | archive | help
This is an OpenPGP/MIME signed message (RFC 4880 and 3156)
--mw5zARou40adCGixCJR0wJjYp3C0eL7um
Content-Type: multipart/mixed; boundary="H60gB5TGsHUFykB42cCMKlMq8qGJMNmZb";
 protected-headers="v1"
From: Lev Serebryakov <lev@FreeBSD.org>
Reply-To: lev@FreeBSD.org
To: freebsd-net@freebsd.org
Message-ID: <cbcadec2-bf74-a1a9-2c66-97d9d409907f@FreeBSD.org>
Subject: What are conditions to spread traffic across different NIC queues?

--H60gB5TGsHUFykB42cCMKlMq8qGJMNmZb
Content-Type: text/plain; charset=utf-8
Content-Language: en-US
Content-Transfer-Encoding: quoted-printable


 I have "router" with two em (82574L) NICs. It has dual-core CPU and
each NIC creates two receive and two transmit queues:

$ sysctl dev.em | grep queue | grep _irq
dev.em.1.queue_rx_1.rx_irq: 0
dev.em.1.queue_rx_0.rx_irq: 0
dev.em.1.queue_tx_1.tx_irq: 0
dev.em.1.queue_tx_0.tx_irq: 0
dev.em.0.queue_rx_1.rx_irq: 0
dev.em.0.queue_rx_0.rx_irq: 0
dev.em.0.queue_tx_1.tx_irq: 0
dev.em.0.queue_tx_0.tx_irq: 0
$

 When I pass, say, 64 UDP streams through this router, only one core is
100% loaded and other is 100% idle. These streams are for same IP pair,
but port pairs are all different.

 What are right conditions to spread such traffic per queues and cores?

--=20
// Lev Serebryakov


--H60gB5TGsHUFykB42cCMKlMq8qGJMNmZb--

--mw5zARou40adCGixCJR0wJjYp3C0eL7um
Content-Type: application/pgp-signature; name="signature.asc"
Content-Description: OpenPGP digital signature
Content-Disposition: attachment; filename="signature.asc"

-----BEGIN PGP SIGNATURE-----

iQKTBAEBCgB9FiEE+W0coLX0MYtnSzMK6rA8WL/cR48FAlvTCOZfFIAAAAAALgAo
aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldEY5
NkQxQ0EwQjVGNDMxOEI2NzRCMzMwQUVBQjAzQzU4QkZEQzQ3OEYACgkQ6rA8WL/c
R4/3xA//Wzp9mLnQSciQEYdeYjpSapskGjv8jh773UfV1/7Dawn1XIg4PgBfHlcn
MNTEU84nWf3i9eR54MYHwvOZ6a7F7BTqdbmAcy3k/S5YsPWu1aztW3fIpI78bO45
m9YjRK9C9S8JMtbT5NVbqrQfTlxjK7l4Vt92zWAV1hw++JeV7ukCBObGqPgnAZEC
Q/fIgFb6tMp26htfFba87JMf7n4QNnaCtzQRsYbTeUyEnkgmBmfHoVSjHOc61SPD
lhS+KqtWeqA1FDuaLqBqiRRPzZ8cjkZFjkFKBtWfsMPyl51N22GDM/RnQBMebhxn
4Hr0v81zIarVJwHxyM6Vd9fQNy12+V1xhlOfC031SF5GB4ralnzVH1JPQtoM4dVe
mr39R4SWlAwMoQon0XqTKYvDbIEYy+55Pc8eoNjPkmc5wk1VMsCteFHcbmOG7ywJ
6mC0rVv1z5MHBGyJY4nSa/ZCXC6oAhk2zL/LmNtvdHFI0O/pVtCGaukcTpz4Z8nw
5uJXldLr4BjJe3/PAfOzgv75V+c5rmLKtiyDLwh75su76xlrTnIgZjx3Lr2Xvlxw
eOSd0NlFwCc+eHWVI0r9UYiF+sgqt/ic8+Df8KRHTwzfkjAbsdLFswTEuBWQ6Zp5
iBCbNhmeh+r0JWgUz2GwH5dvv5uzVCBDIbnDjKa30gTQeL6GuuY=
=Vkcj
-----END PGP SIGNATURE-----

--mw5zARou40adCGixCJR0wJjYp3C0eL7um--



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?cbcadec2-bf74-a1a9-2c66-97d9d409907f>