From owner-freebsd-arch@FreeBSD.ORG Fri Mar 6 21:46:07 2015 Return-Path: Delivered-To: freebsd-arch@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 00A71492 for ; Fri, 6 Mar 2015 21:46:06 +0000 (UTC) Received: from bigwig.baldwin.cx (bigwig.baldwin.cx [IPv6:2001:470:1f11:75::1]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id CC9C586F for ; Fri, 6 Mar 2015 21:46:06 +0000 (UTC) Received: from ralph.baldwin.cx (pool-173-54-116-245.nwrknj.fios.verizon.net [173.54.116.245]) by bigwig.baldwin.cx (Postfix) with ESMTPSA id 5CFFFB980; Fri, 6 Mar 2015 16:46:05 -0500 (EST) From: John Baldwin To: freebsd-arch@freebsd.org Subject: Re: RFC: Simplfying hyperthreading distinctions Date: Fri, 06 Mar 2015 16:17:37 -0500 Message-ID: <1526311.uylCbgv5VB@ralph.baldwin.cx> User-Agent: KMail/4.14.2 (FreeBSD/10.1-STABLE; KDE/4.14.2; amd64; ; ) In-Reply-To: <54FA1180.3080605@astrodoggroup.com> References: <1640664.8z9mx3EOQs@ralph.baldwin.cx> <54FA1180.3080605@astrodoggroup.com> MIME-Version: 1.0 Content-Transfer-Encoding: 7Bit Content-Type: text/plain; charset="us-ascii" X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.2.7 (bigwig.baldwin.cx); Fri, 06 Mar 2015 16:46:05 -0500 (EST) Cc: Harrison Grundy X-BeenThere: freebsd-arch@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Discussion related to FreeBSD architecture List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 06 Mar 2015 21:46:07 -0000 On Friday, March 06, 2015 12:43:44 PM Harrison Grundy wrote: > On 03/06/15 12:44, John Baldwin wrote: > > Currently we go out of our way a bit to distinguish Pentium4-era > > hyperthreading from more recent ("modern") hyperthreading. I > > suspect that this distinction probably results in confusion more > > than anything else. Intel's documentation does not make near as > > broad a distinction as far as I can tell. Both types of SMT are > > called hyperthreading in the SDM for example. However, we have the > > astonishing behavior that 'machdep.hyperthreading_allowed' only > > affects "old" hyperthreads, but not "new" ones. We also try to be > > overly cute in our dmesg output by using HTT for "old" > > hyperthreading, and SMT for "new" hyperthreading. I propose the > > following changes to simplify things a bit: > > > > 1) Call both "old" and "new" hyperthreading HTT in dmesg. > > > > 2) Change machdep.hyperthreading_allowed to apply to both new and > > old HTT. However, doing this means a POLA violation in that we > > would now disable modern HTT by default. Balanced against > > re-enabling "old" HTT by default on an increasingly-shrinking pool > > of old hardware, I think the better approach here would be to also > > change the default to allow HTT. > > > > 3) Possibly add a different knob (or change the behavior of > > machdep.hyperthreading_allowed) to still bring up hyperthreads, but > > leave them out of the default cpuset (set 1). This would allow > > those threads to be re-enabled dynamically at runtime by adjusting > > the mask on set 1. The original htt settings back when > > 'hyperthreading_allowed' was introduced actually permitted this via > > by adjusting 'machdep.hlt_cpus' at runtime. > > > > What do people think? > > I'm not sure of how interrupt handling works as it relates to HTT, but > wouldn't using cpuset potentially leave them active for interrupt > handling? > > Other than that question, this all makes sense to me. Interrupt handling works differently. Per my commit a few minutes ago, we do not send interrupts to hyperthreads by default (either old or new). However, ithreads that are not explicitly bound to a specific CPU will "float" among all the CPUs in set 1 so 3) would affect that. Eventually I want to use a separate cpuset for interrupts that ithreads inherit from (rather than belonging to set 1). -- John Baldwin