Skip site navigation (1)Skip section navigation (2)
Date:      Mon, 10 Nov 2008 13:56:40 +0100
From:      Ivan Voras <ivoras@freebsd.org>
To:        freebsd-smp@freebsd.org
Subject:   Re: CPU affinity with ULE scheduler
Message-ID:  <gf9b1o$pmi$1@ger.gmane.org>
In-Reply-To: <42e3d810811100033w172e90dbl209ecbab640cc24f@mail.gmail.com>
References:  <42e3d810811100033w172e90dbl209ecbab640cc24f@mail.gmail.com>

next in thread | previous in thread | raw e-mail | index | archive | help
This is an OpenPGP/MIME signed message (RFC 2440 and 3156)
--------------enig0D62A50CF2198A0578721DE4
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

Archimedes Gaviola wrote:
> To Whom It May Concerned:
>=20
> Can someone explain or share about ULE scheduler (latest version 2 if
> I'm not mistaken) dealing with CPU affinity? Is there any existing
> benchmarks on this with FreeBSD? Because I am currently using 4BSD

Yes but not for network loads. See for example benchmarks in
http://people.freebsd.org/~kris/scaling/7.0%20and%20beyond.pdf

> scheduler and as what I have observed especially on processing high
> network load traffic on multiple CPU cores, only one CPU were being
> stressed with network interrupt while the rests are mostly in idle
> state. This is an AMD-64 (4x) dual-core IBM system with GigE Broadcom
> network interface cards (bce0 and bce1). Below is the snapshot of the
> case.

This is unfortunately so and cannot be changed for now - you are not the
first with this particular performance problem. BUT, looking at the data
in the snapshot you gave, it's not clear that there is a performance
problem in your case - bce is not nearly taking as much CPU time to be
bottlenecking. What exactly do you think is wrong in your case?

>   PID USERNAME  THR PRI NICE   SIZE    RES STATE  C   TIME   WCPU COMMA=
ND
>    17 root        1 171   52     0K    16K RUN    0  96:04 97.71% idle:=
 cpu0
>    15 root        1 171   52     0K    16K RUN    2  98:41 97.07% idle:=
 cpu2
>    14 root        1 171   52     0K    16K RUN    3 103:56 95.90% idle:=
 cpu3
>    13 root        1 171   52     0K    16K RUN    4 104:17 88.23% idle:=
 cpu4
>    12 root        1 171   52     0K    16K RUN    5  97:59 86.57% idle:=
 cpu5
>    10 root        1 171   52     0K    16K RUN    7  81:51 82.08% idle:=
 cpu7
>    11 root        1 171   52     0K    16K RUN    6  95:28 81.35% idle:=
 cpu6
>    16 root        1 171   52     0K    16K RUN    1 102:15 77.78% idle:=
 cpu1
>    36 root        1 -68 -187     0K    16K WAIT   7  19:37  4.59%
> irq23: bce0 bce1
>    18 root        1 -32 -151     0K    16K CPU0   0   2:13  0.00%
> swi4: clock sio
>  4488 root        1  96    0 30728K  4292K select 3   1:51  0.00% sshd
>    43 root        1 171   52     0K    16K pgzero 3   1:08  0.00% pagez=
ero
>   218 root        1  96    0  3852K  1380K select 3   0:38  0.00% syslo=
gd
>    20 root        1 -44 -163     0K    16K WAIT   7   0:32  0.00% swi1:=
 net



--------------enig0D62A50CF2198A0578721DE4
Content-Type: application/pgp-signature; name="signature.asc"
Content-Description: OpenPGP digital signature
Content-Disposition: attachment; filename="signature.asc"

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.6 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iD8DBQFJGC+IldnAQVacBcgRAmZhAKCGm05TVnG2a9QfilPND5pc5lquAACdGBz6
2kywcxj15+WCN+Ufb+SoLtg=
=X6RQ
-----END PGP SIGNATURE-----

--------------enig0D62A50CF2198A0578721DE4--




Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?gf9b1o$pmi$1>