From owner-freebsd-stable@FreeBSD.ORG Thu Dec 15 21:55:55 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C8E1F1065670; Thu, 15 Dec 2011 21:55:55 +0000 (UTC) (envelope-from sgk@troutmask.apl.washington.edu) Received: from troutmask.apl.washington.edu (troutmask.apl.washington.edu [128.95.76.21]) by mx1.freebsd.org (Postfix) with ESMTP id A1D4A8FC16; Thu, 15 Dec 2011 21:55:55 +0000 (UTC) Received: from troutmask.apl.washington.edu (localhost.apl.washington.edu [127.0.0.1]) by troutmask.apl.washington.edu (8.14.5/8.14.5) with ESMTP id pBFLttKt087668; Thu, 15 Dec 2011 13:55:55 -0800 (PST) (envelope-from sgk@troutmask.apl.washington.edu) Received: (from sgk@localhost) by troutmask.apl.washington.edu (8.14.5/8.14.5/Submit) id pBFLtsUA087667; Thu, 15 Dec 2011 13:55:54 -0800 (PST) (envelope-from sgk) Date: Thu, 15 Dec 2011 13:55:54 -0800 From: Steve Kargl To: Attilio Rao Message-ID: <20111215215554.GA87606@troutmask.apl.washington.edu> References: <4EE1EAFE.3070408@m5p.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.4.2.3i Cc: Andrey Chernov , George Mitchell , Doug Barton , freebsd-stable@freebsd.org Subject: Re: SCHED_ULE should not be the default X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 15 Dec 2011 21:55:55 -0000 On Thu, Dec 15, 2011 at 05:25:51PM +0100, Attilio Rao wrote: > > I basically went through all the e-mail you just sent and identified 4 > real report on which we could work on and summarizied in the attached > Excel file. > I'd like that George, Steve, Doug, Andrey and Mike possibly review the > few datas there and add more, if they want, or make more important > clarifications in particular about the Xorg presence (or rather not) > in their workload. Your summary of my observations appears correct. I have grabbed an up-to-date /usr/src, built and installed world, and built and installed a new kernel on one of the nodes in my cluster. It has CPU: Dual Core AMD Opteron(tm) Processor 280 (2392.65-MHz K8-class CPU) Origin = "AuthenticAMD" Id = 0x20f12 Family = f Model = 21 Stepping = 2 Features=0x178bfbff Features2=0x1 AMD Features=0xe2500800 AMD Features2=0x3 real memory = 17179869184 (16384 MB) avail memory = 16269832192 (15516 MB) FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs FreeBSD/SMP: 2 package(s) x 2 core(s) I can perform new tests with both ULE and 4BSD, but you'll need to be precise in the information you want collected (and how to collect the data) due to the rather limited amount of time I currently have. To summarize my workload, on the master node on my cluster I start a job that will send N slave jobs to the node of interest. The slaves perform nearly identical cpu-bound floating point computations, so the expectation is that each slave should take nearly the same amount of cpu-time to complete its task. Communication occurs between only the master and a slave at the start of the process and when it finishes. The communication is over GigE ipv4 internal network. The slaves do not read or write to disk. -- Steve