Skip site navigation (1)Skip section navigation (2)
Date:      Mon, 25 Feb 2008 15:17:47 -0800
From:      Alfred Perlstein <alfred@freebsd.org>
To:        Jeff Roberson <jroberson@chesapeake.net>
Cc:        Brooks Davis <brooks@freebsd.org>, Andrew Gallatin <gallatin@cs.duke.edu>, Daniel Eischen <deischen@freebsd.org>, arch@freebsd.org, Robert Watson <rwatson@freebsd.org>, David Xu <davidxu@freebsd.org>
Subject:   Re: cpuset and affinity implementation
Message-ID:  <20080225231747.GT99258@elvis.mu.org>
In-Reply-To: <20080224001902.J920@desktop>
References:  <20080220175532.Q920@desktop> <20080220213253.A920@desktop> <20080221092011.J52922@fledge.watson.org> <20080222121253.N920@desktop> <20080222231245.GA28788@lor.one-eyed-alien.net> <20080222134923.M920@desktop> <20080223194047.GB38485@lor.one-eyed-alien.net> <20080223111659.K920@desktop> <20080223213507.GD39699@lor.one-eyed-alien.net> <20080224001902.J920@desktop>

next in thread | previous in thread | raw e-mail | index | archive | help
* Jeff Roberson <jroberson@chesapeake.net> [080224 02:39] wrote:
> Please see:
> http://people.freebsd.org/~jeff/cpuset.diff
> 
> This is unfortunately intertwined with ULE's new CPU selection algorithm 
> so that code is in the patch as well.  Otherwise, this includes a simple, 
> ugly userland tool called cpuset and all of the kernel support required. 
> I have tested this by creating sets and subsets and modifying their cpu 
> masks under load.  I'm able to dynamically reprovision without issue.
> 
> This doesn't have support for jails but the infrastructure is there.  It 
> also fails to modify sets if it would leave threads without a valid cpu 
> to run on.  I have not implemented a force option but it will be trivial 
> to do so.  The initial cpu set is also created before we know all_cpus so 
> it's faked up with all cpus set for now.
> 
> I mostly want people to look at the interface in cpuset.h and make sure 
> they agree with it before I start polishing to commit.  I'm fairly happy 
> with the way the syscall api looks now.  The code itself ended up being 
> much more complicated than I'd hoped due to locking considerations.  Try 
> not to look at cpuset_setproc() ;).


Jeff, this is very cool.  I do have one issue though:

+ * A thread may not be assigned to a a group seperate from other threads in
+ * the process.  This is to remove ambiguity when the setid is queried with
+ * a pid argument.  There is no other technical limitation.

Am I understanding things correctly such that within a process there
can only be one "set"?

If so this restricts some of the benifits you get with sets and
binding.

An example would be some sort of system with multiple CPUs where some
are assigned specifically for pseudo-realtime processing and others are for
general control things such as cli, stats, etc.

In our case we would like to be able to run some threads on specific
cpu sets, and other threads to be run anywhere on the control CPUs.

Can this be done with this API?

-Alfred



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20080225231747.GT99258>